Skip to main content
November (preview); March 2024 (open-weights) · 2023

Grok-1 — 314B MoE + Open-Weights Release

Demonstrated rapid iteration (models every few months) and a selective open-sourcing strategy while maintaining focus on maximum truth-seeking over other priorities.

Grok-1 (Nov 2023 preview; full access 2024): 314B parameter Mixture-of-Experts (MoE). Early beta. Open-weights release March 2024 (GitHub, JAX code + weights, Apache 2.0). 'Best we could do with 2 months of training.' Rapid development enabled by Colossus-scale compute in later models. Access: Primarily via X (Premium+), grok.com / apps, API.

Source: x.ai / GitHub xai-org/grok-1

Story
Post story on X

Read it in the full timeline

Independent educational fan project. Not affiliated with Space Exploration Technologies Corp. (SpaceX) or xAI Corp.