NeoSignal
← Back to models
C

Calme 3.1 Instruct 78b

Models
84

Open-source 78B parameter model based on Qwen2 architecture

Ranked #2 on HuggingFace Open LLM Leaderboard

Metrics

providerMaziyarPanahi
hf average51.29
parameters77.965
open source
architectureQwen2ForCausalLM
context window32,768

Score Breakdown

code70
math39
reasoning62
intelligence69
instruction following81

Compatibility

111111119511111111951111111190

Scoring Methodology

intelligence30% weight

Overall reasoning and task completion ability

Source: LMArena ELO, Artificial Analysis Intelligence Index, HuggingFace MMLU-PRO

math20% weight

Mathematical reasoning and problem solving

Source: MATH benchmark, GSM8K, HuggingFace MATH-Lvl5

code20% weight

Code generation, understanding, and debugging

Source: HumanEval, MBPP, SWE-bench

reasoning15% weight

Multi-step logical reasoning

Source: ARC-Challenge, BBH, MMLU-Pro, HuggingFace BBH

instruction_following15% weight

Ability to follow complex instructions accurately

Source: HuggingFace IFEval

Data Sources

huggingface.cohuggingface.co
Last updated: December 24, 2025