Lates News

Musk: It is undoubtedly better than the 2.1 trillion parameter model trained based on Jax, but we made some mistakes during the training process and only corrected them midway through training. Over the past few months, we have significantly improved data quality. The upcoming 3 trillion parameter model training will use optimized in-house training software and much better quality data.