← 开源
volcengine

veScale

Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs

Model DevelopmentLLM trainingPython
在 GitHub 打开
增长势头
+024 小时新增 Star0.0%
1.04k
Star
66
Fork
+2
本周
13
贡献者
创建于 2024-02-26 · 更新于 2026-10-15 · 今日第 11922 名
主要开发者
liwenchangbdbzleonardo0lyjjc-bytedance

volcengine/veScale 排名第 11,922,有 1,043 个星标。

同类别比较

volcengine/veScale 排名第 11,922,此处有 8 个同类条目;openai/supervised-reptile 排名第 11,919。

同类别比较
名称排名指标
facebookresearch/cc_net11,906
语言:
Python
星标数:
1,045
分叉数:
152
简介:
Tools to download and cleanup Common Crawl data
thuml/Anomaly-Transformer11,912
语言:
Python
星标数:
1,045
分叉数:
269
简介:
About Code release for "Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancy" (ICLR 2022 Spotlight), https://openreview.net/forum?id=LzQQ89U1qm_
facebookresearch/FixRes11,916
语言:
Python
星标数:
1,043
分叉数:
146
简介:
This repository reproduces the results of the paper: "Fixing the train-test resolution discrepancy" https://arxiv.org/abs/1906.06423
openai/supervised-reptile11,919
语言:
JavaScript
星标数:
1,043
分叉数:
212
简介:
Code for the paper "On First-Order Meta-Learning Algorithms"
google-research/morph-net11,925
语言:
Python
星标数:
1,042
分叉数:
151
简介:
Fast & Simple Resource-Constrained Learning of Deep Network Structure
motional/nuplan-devkit11,926
语言:
Python
星标数:
1,042
分叉数:
219
简介:
The devkit of the nuPlan dataset.
descriptinc/melgan-neurips11,929
语言:
Python
星标数:
1,041
分叉数:
210
简介:
GAN-based Mel-Spectrogram Inversion Network for Text-to-Speech Synthesis
pykaldi/pykaldi11,932
语言:
Python
星标数:
1,041
分叉数:
246
简介:
A Python wrapper for Kaldi
关键参数与规格
关键参数与规格
参数值
语言Python
类别Model Development
子类别LLM training
关键词Distributed training
星标数1,043
分叉数66
贡献者13
创建日期2024-02-26
更新日期2026-10-15
1 天星标数0
7 天星标数2
排名11,922
上次排名6,076
排名变化-5,846
7 天星标排名8,283
上次 7 天星标排名8,355
7 天星标排名变化72
总星标排名10,815
上次总星标排名10,784
总星标排名变化-31
国家China
README 摘录

Old veScale Has been Moved to ; New veScale is Coming . veScale veScale is an internal PyTorch Distributed library, enabling hyperscale distributed training of LLMs and RLs. This repo open-sources a small piece of veScale for a better community. Content **Quick Start** **RaggedShard DTensor** Publication **veScale 2025-2026**: **veScale 2023-2025**: Citation License The veScale Project is under the Apache License v2.

常见问题

记录了多少星标和分叉?

volcengine/veScale 有 1,043 个星标和 66 个分叉。

仓库排名是多少?

volcengine/veScale 排名第 11,922。

记录的语言和类别是什么?

volcengine/veScale 有 1,043 个星标,语言为 Python,类别为 Model Development。

哪个仓库排名最接近?

volcengine/veScale 与 openai/supervised-reptile 比较,后者排名第 11,919,有 1,043 个星标。

README

Old veScale Has been Moved to legacy/; New veScale is Coming ...

 ![](./docs/pictures/icon.png) 

veScale

veScale is an internal PyTorch Distributed library, enabling hyperscale distributed training of LLMs and RLs. This repo open-sources a small piece of veScale for a better community.

Content

Publication

Citation

@misc{wang2026vescalefsdpflexiblehighperformancefsdp,
      title={veScale-FSDP: Flexible and High-Performance FSDP at Scale}, 
      author={Zezhou Wang and Youjie Li and Zhiqi Lin and Jiacheng Yang and Cong Xie and Guanyu Feng and Zheng Zhong and Ziyue Huang and Hongyu Zhu and Zhi Zhang and Yanghua Peng and Xin Liu},
      year={2026},
      eprint={2602.22437},
      archivePrefix={arXiv},
      primaryClass={cs.DC},
      url={https://arxiv.org/abs/2602.22437}, 
}

@misc{li2025vescale,
      title={veScale: Consistent and Efficient Tensor Programming with Eager-Mode SPMD}, 
      author={Youjie Li and Cheng Wan and Zhiqi Lin and Hongyu Zhu and Jiacheng Yang and Ziang Song and Xinyi Di and Jiawei Wu and Huiyao Shu and Wenlei Bao and Yanghua Peng and Haibin Lin and Li-Wen Chang},
      year={2025},
      eprint={2509.07003},
      archivePrefix={arXiv},
      primaryClass={cs.PL},
      url={https://arxiv.org/abs/2509.07003}, 
}

License

The veScale Project is under the Apache License v2.0.

排名相邻
同类项目