https://huggingface.co/spaces/nanotron/ultrascale-playbookHugging Face 发布了 Scaling LLM Training on GPU 的 playbook，应该会比 DeepMind 那本侧重 TPU 的 scaling book 更普适一些。 #llm

Parallel Experiments

https://jax-ml.github.io/scaling-book/ 非常值得学习的分享，作者列表里好几个 Gemini 核心团队的人😃 Sholto、Jacob、Sharad 等人都是超一流的 research engineer 🙏 #llm

https://huggingface.co/spaces/nanotron/ultrascale-playbook
Hugging Face 发布了 Scaling LLM Training on GPU 的 playbook，应该会比 DeepMind 那本侧重 TPU 的 scaling book 更普适一些。 #llm

huggingface.co

The Ultra-Scale Playbook - a Hugging Face Space by nanotron

This blog post explains how to efficiently train large language models (LLMs) using GPU clusters, providing insights and guidance on optimizing performance and resource utilization.

www.tg-me.com/it/Parallel Experiments/com.LinghaoCh/922

1.2K viewsLinghao Zhang, Feb 19 at 20:32

tg-me.com/LinghaoCh/922

Create: 2025-02-19
Last Update: 2025-06-14 05:00:06

BY Parallel Experiments

Share with your friend now:
tg-me.com/LinghaoCh/922

Parallel Experiments Telegram | DID YOU KNOW?

Telegram is riding high, adding tens of million of users this year. Now the bill is coming due.Telegram is one of the few significant social-media challengers to Facebook Inc., FB -1.90% on a trajectory toward one billion users active each month by the end of 2022, up from roughly 550 million today.

For some time, Mr. Durov and a few dozen staffers had no fixed headquarters, but rather traveled the world, setting up shop in one city after another, he told the Journal in 2016. The company now has its operational base in Dubai, though it says it doesn’t keep servers there.Mr. Durov maintains a yearslong friendship from his VK days with actor and tech investor Jared Leto, with whom he shares an ascetic lifestyle that eschews meat and alcohol.