🔥 Trending today
Hugging Face Accelerate ND-Parallel 指南：高效多 GPU 訓練完全解析★ 80
Hugging Face Blog310 days agoTutorialAs the parameter counts of generative AI and large language models (LLMs) push into the tens and hundreds of billions, the memory of a single GPU has long been…
揭秘 BLOOM 訓練背後的技術：如何用 Megatron-DeepSpeed 訓練 1760 億參數開源大模型★ 80
Hugging Face Blog1,431 days agoTutorialThis article documents in detail how the BigScience project trained BLOOM, an open-source multilingual large language model with 176 billion parameters. This…