← Open Source
Robbyant

lingbot-video

Scaling Mixture-of-Experts Video Pretraining for Embodied Intelligence.

ModelsVision modelsPython
Open on GitHub
Momentum
+0stars in 24 hours0.0%
974
Stars
46
Forks
+7
This week
3
Contributors
Created 2026-07-08 · Updated 2026-10-14 · #12290 today
Top developers
jiangbonadiafelixcheng97xiaomabufei

Robbyant/lingbot-video is ranked 12,290 with 974 stars.

Same-category comparison

Robbyant/lingbot-video is ranked 12,290 among these 8 peers; grammarly/gector is ranked 12,287.

Same-category comparison
NameRankMetrics
gabrielmittag/NISQA12,281
Language:
Python
Stars:
976
Forks:
155
Description:
NISQA - Non-Intrusive Speech Quality and TTS Naturalness Assessment.
microsoft/renderformer12,282
Language:
Python
Stars:
976
Forks:
62
Description:
Official Code Release for [SIGGRAPH 2025] RenderFormer: Transformer-based Neural Rendering of Triangle Meshes with Global Illumination.
1adrianb/2D-and-3D-face-alignment12,284
Language:
Lua
Stars:
975
Forks:
208
Description:
This repository implements a demo of the networks described in "How far are we from solving the 2D & 3D Face Alignment problem. (and a dataset of 230,000 3D facial landmarks)" paper.
grammarly/gector12,287
Language:
Python
Stars:
975
Forks:
220
Description:
Official implementation of the papers "GECToR – Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagging" (BEA-21).
alibaba/animate-anything12,299
Language:
Python
Stars:
973
Forks:
78
Description:
Fine-Grained Open Domain Image Animation with Motion Guidance.
DataXujing/YOLO-v512,309
Language:
Jupyter Notebook
Stars:
971
Forks:
191
dexmal/opendw12,313
Language:
Python
Stars:
970
Forks:
56
Description:
An Open-Source World Model for Action-Conditioned Embodied Intelligence.
mbzuai-oryx/groundingLMM12,324
Language:
Python
Stars:
969
Forks:
56
Description:
[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.
Key parameters and specifications
Key parameters and specifications
ParameterValue
LanguagePython
CategoryModels
SubcategoryVision models
KeywordsEmbodied, Model architecture, Text-to-video, Video production
Stars974
Forks46
Contributors3
Created date2026-07-08
Updated date2026-10-14
Stars in 1 day0
Stars in 7 days7
Rank12,290
Previous rank4,183
Rank change-8,107
7-day stars rank4,794
Previous 7-day stars rank4,502
7-day stars rank change-292
Total stars rank11,378
Previous total stars rank11,361
Total stars rank change-17
CountryUSA
README summary

As a top-tier video model, LingBot-Video is designed to bridge the gap between video synthesis and physical world understanding. 🔥 Key Highlights **🚀 Efficient MoE Architecture**: Scaled from scratch; balanced between capacity and cost with **~3x** faster inference. **📦 Data Engine**: Trained on massive web videos integrated with **70,000+ hours** of embodied data. **⚖️ Multi Reward System**: Rewarded for **high aesthetics**, **physical rationality**, and **task completion**. **⚡ Few-Step Student Sampling**: DMD-distilled checkpoints (t2v and ti2v) for 8-step video generation

, on both the diffusers and SGLang engines. 🎬 Video Demos 🔥 Latest News Sept 18, 2026: ⚡ We release the 8-step DMD student model for LingBot-Video. Aug 5, 2026: 🎉 We release the RBench evaluation for LingBot-Video. July 9, 2026: 🎉 We release the technical report, code, models, rewriters for LingBot-Video. 3B) | T2I, T2V, TI2V | 🤗 Huggingface 🤖 ModelScope | | 💪 LingBot-Video-MoE | MoE (30B-A3B) + Refiner | T2I, T2V, TI2V, Refinement | 🤗 Huggingface 🤖 ModelScope | | ⚡ LingBot-Video-MoE-DMD | MoE (30B-A3B), 8-step distilled student

| T2V, TI2V | 🤗 Huggingface 🤖 ModelScope | | 📝 LingBot-Video-Rewriter-Base | Qwen3. 6-27B official | Prompt rewriter (Expand) | 🤗 Huggingface 🤖 ModelScope | | 📝 LingBot-Video-Rewriter-Adapter | Qwen3. **💡 Rewriter deployment**: the bundled rewriter uses the single-process backend. For higher throughput, deploy the VLM yourself and call it through an OpenAI-compatible API. Preserve the two-stage semantics: step 1 must use the base VLM without the rewriter LoRA, while step 2 must use the same base VLM with the rewriter LoRA enabled. This can be

implemented with two endpoints, or with one server that can select the adapter per request. The default examples produce **121 frames at 832 × 480 and 24 fps**, without a refiner. must be a downloaded **local model root**, containing , , , , , and . Its must contain the DMD student weights. A transformer-only export is not sufficient. Start with the structured prompts and matching first frame already bundled in this repository: The scripts accept , , (TI2V), , , , , , and environment overrides. For example, to use your own

prepared TI2V input: Or call the unified runner directly: For TI2V, replace the mode and prompt with and add . For new plain-language prompts, follow Prompt Preparation and use the same first frame for rewriting and TI2V generation. 0, the examples do not need an Auto Negative step. The existing ordinary MoE scripts use a different scheduler and guidance recipe; use the DMD scripts above for student checkpoints. The single-GPU 5-second examples were checked on a GPU with

about 140 GiB of memory, using BF16 DiT/text encoder and FP32 VAE. Observed PyTorch peak allocated memory was about 82 GiB; this is not a minimum-memory specification. See the DMD guide for sampling and precision details. 🧭 Recommended Inference Workflow LingBot-Video DiT inference is designed to consume structured JSON captions, not casual natural-language prompts. Rewrite the user's plain prompt with Prompt Rewriter. For TI2V, pass the same first frame to the rewriter. Run Auto Negative by default

to prune the negative prompt for this specific caption. Run the unified inference runner with and select direct diffusers or

Frequently asked questions

How many stars and forks are recorded?

Robbyant/lingbot-video has 974 stars and 46 forks.

What is the repository rank?

Robbyant/lingbot-video is ranked 12,290.

What language and category are recorded?

Robbyant/lingbot-video has 974 stars, uses Python and belongs to Models.

Which repository is closest in rank?

Robbyant/lingbot-video is compared with grammarly/gector, ranked 12,287 with 975 stars.

Nearby in the ranking
Similar items