Trainium GPU with large 96GB HBM.
Metrics
Memory GB96
High-bandwidth memory capacity
ArchitectureTrainium
Neural network architecture type
TDP400W
Thermal design power consumption
Score Breakdown
training
15%46
LLM training time-to-convergence
ecosystem
15%83
Software stack maturity and framework support
performance
30%85
Raw compute throughput and memory bandwidth
availability
15%78
Market supply and cloud instance availability