Today marks a really big achievement for Nous, but also potentially the AI Landscape. We have begun a decentralized pretraining run of what is basically a dense Deepseek - 40B parameters, over 20T tokens, with MLA for long context efficiency. All checkpoints, unannealed,

Nous Research
@NousResearch
05-15
Announcing the launch of Psyche
https://nousresearch.com/nous-psyche/
Nous Research is democratizing the development of Artificial Intelligence. Today, we’re embarking on our greatest effort to date to make that mission a reality: The Psyche Network
Psyche is a decentralized training


From Twitter
Disclaimer: The content above is only the author's opinion which does not represent any position of Followin, and is not intended as, and shall not be understood or construed as, investment advice from Followin.
Like
Add to Favorites
Comments
Share
Relevant content




