Meta largest open-weights model with 128K context. 405B parameters. Excellent instruction following (92/100) and code (90/100). Industry benchmark for open models.
Metrics
Performance
Context Window128,000
Maximum input token capacity
Info
ProviderMeta
Organization that created the model
Open WeightsYes
Model weights publicly available
Open SourceYes
Open source availability
Parameters405
Total model parameter count
ArchitectureLlamaForCausalLM
Neural network architecture type
Score Breakdown
code
20%90
Code generation, understanding, and debugging
math
20%88
Mathematical reasoning and problem solving
reasoning
15%89
Multi-step logical reasoning
intelligence
30%90
Overall reasoning and task completion ability
instruction following
92
Compatibility(8)
Sources(2)
Developed by
Meta AIBenchmark Performance
Compare Models| Dimension | Score |
|---|---|
| Intelligence | 90.0 |
| Reasoning | 89.0 |
| Math | 88.0 |
| Code | 90.0 |
| Instruction Following | 92.0 |
| Overall | 91 |
Loading chart...
Data: Epoch AI (CC-BY 4.0)