iCreatAI News
Skip to content
Hugging Face Blog·· 24 days agoAI score38

Does Your Model Run on AWS Trainium? Look It Up

Does Your Model Run on AWS Trainium? Look It Up

AI summary

Hugging Face introduces a Space that checks whether popular Hub models run unmodified on AWS Trainium via the torch-neuronx backend, reporting sharding, wall time, and peak memory, and providing the run.py script used. Results come from the public aws-neuron/torch-neuronx-model-support dataset, with one Parquet file per neuronx-cc and library version pair. Tests currently cover text-generation and image-text-to-text Transformers models fitting on at most 4 Trainium2 devices (16 cores), generating 32 tokens.

Source: Hugging Face Blog · huggingface.co