Intellect 1 is the first decentralized training run of a 10-billion-parameter model, inviting anyone to contribute compute.
• app.primeintellect.ai
Everything will be open sourced; the training framework and dataset.
AI Model specs:
• 10B parameters, 6T+ tokens dataset
• Llama Architecture and tokenizer
• Dataset mix: Fineweb-edu, DLCM, Stack v2, OpenWebMath
The goal is to create the most powerful open source AI model. This excites me so much. Not to mention you can train your own models and it's so cheap.
#Intellect1 #AIML #OSS
@Dagmawi_Babi
• app.primeintellect.ai
Everything will be open sourced; the training framework and dataset.
AI Model specs:
• 10B parameters, 6T+ tokens dataset
• Llama Architecture and tokenizer
• Dataset mix: Fineweb-edu, DLCM, Stack v2, OpenWebMath
The goal is to create the most powerful open source AI model. This excites me so much. Not to mention you can train your own models and it's so cheap.
#Intellect1 #AIML #OSS
@Dagmawi_Babi