← Open Source
Vchitect

Vchitect-2.0

Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Models.

ModelsVision modelsPython
Open on GitHub
Momentum
+0stars in 24 hours0.0%
921
Stars
22
Forks
+0
This week
2
Contributors
Created 2024-09-09 · Updated 2026-09-09 · #12621 today
Top developers
WeichenFanChenyangSi

Vchitect/Vchitect-2.0 is ranked 12,621 with 921 stars.

Same-category comparison

Vchitect/Vchitect-2.0 is ranked 12,621 among these 8 peers; 360CVGroup/FancyVideo is ranked 12,628.

Same-category comparison
NameRankMetrics
NVlabs/FasterViT12,592
Language:
Python
Stars:
926
Forks:
72
Description:
[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention.
instadeepai/nucleotide-transformer12,594
Language:
Jupyter Notebook
Stars:
926
Forks:
103
Description:
Foundation Models for Genomics & Transcriptomics.
AMAP-ML/FluxText12,602
Language:
Python
Stars:
924
Forks:
33
Description:
Implementation of "FLUX-Text: A Simple and Advanced Diffusion Transformer Baseline for Scene Text Editing".
facebookresearch/mobile-vision12,613
Language:
Python
Stars:
922
Forks:
168
Description:
Mobile vision models and code.
360CVGroup/FancyVideo12,628
Language:
Python
Stars:
920
Forks:
51
Description:
Video generation from text&image, 1st-gen.
huggingface/torchMoji12,636
Language:
Python
Stars:
920
Forks:
185
Description:
😇A pyTorch implementation of the DeepMoji model: state-of-the-art deep learning model for analyzing sentiment, emotion, sarcasm etc.
sangyun884/HR-VITON12,656
Language:
Python
Stars:
917
Forks:
192
Description:
Official PyTorch implementation for the paper High-Resolution Virtual Try-On with Misalignment and Occlusion-Handled Conditions (ECCV 2022).
xuelunshen/gim12,688
Language:
Python
Stars:
912
Forks:
63
Description:
GIM: Learning Generalizable Image Matcher From Internet Videos (ICLR 2024 Spotlight).
Key parameters and specifications
Key parameters and specifications
ParameterValue
LanguagePython
CategoryModels
SubcategoryVision models
KeywordsDatasets, Model architecture, Video production
Stars921
Forks22
Contributors2
Created date2024-09-09
Updated date2026-09-09
Stars in 1 day0
Stars in 7 days0
Rank12,621
Previous rank12,536
Rank change-85
7-day stars rank13,515
Previous 7-day stars rank13,523
7-day stars rank change8
Total stars rank11,848
Previous total stars rank11,828
Total stars rank change-20
CountryChina
README summary

17] 🔥 Our Vchitect-T2V-Dataverse is released. 14] Inference code and checkpoint are released. Create a conda environment and install PyTorch Note: You may want to adjust the CUDA version according to your driver version. Install dependencies Inference **First download the checkpoint. py, arguments for inference: **num_inference_steps**: Denoising steps, default is 100 **guidance_scale**: CFG scale to use, default is 7. 5 **width**: The width of the output video, default is 768 **height**: The height of the output

video, default is 432 **frames**: The number of frames, default is 40 The results below were generated using the example prompt. The road is flanked by trees covered in snow, and the ground is also covered in snow. The sun is shining, creating a bright and serene atmosphere. The road appears to be empty, and there are no people or animals visible in the video. The video opens with a breathtaking view of a starry sky and vibrant auroras. The

camera pans to reveal a glowing black hole surrounded by swirling, luminescent gas and dust. Below, an enchanted forest of bioluminescent trees glows softly. The scene is a mesmerizing blend of cosmic wonder and magical landscape. The base T2V model supports generating videos with resolutions up to 720x480 and 8fps. Then,VEnhancer is used to upscale the resolution to 2K and interpolate the frame rate to 24fps. BibTex 🔑 License This code is licensed under Apache-2. The framework is fully

open for academic research and also allows free commercial usage. Disclaimer We disclaim responsibility for user-generated content. The model was not trained to realistically represent people or events, so using it to generate such content is beyond the model's capabilities. It is prohibited for pornographic, violent and bloody content generation, and to generate content that is demeaning or harmful to people or their environment, culture, religion, etc. Users are solely liable for their actions. The project contributors are not

legally affiliated with, nor accountable for users' behaviors. Use the generative model responsibly, adhering to ethical and legal standards.

Frequently asked questions

How many stars and forks are recorded?

Vchitect/Vchitect-2.0 has 921 stars and 22 forks.

What is the repository rank?

Vchitect/Vchitect-2.0 is ranked 12,621.

What language and category are recorded?

Vchitect/Vchitect-2.0 has 921 stars, uses Python and belongs to Models.

Which repository is closest in rank?

Vchitect/Vchitect-2.0 is compared with 360CVGroup/FancyVideo, ranked 12,628 with 920 stars.

README

Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Models

[Vchitect Team1](https://vchitect.intern-ai.org.cn/) 






1Shanghai Artificial Intelligence Laboratory 






                  [Paper](https://arxiv.org/abs/2501.08453) | 
                  [Project Page](https://vchitect.intern-ai.org.cn/) |
                  [Dataset](https://huggingface.co/datasets/Vchitect/Vchitect_T2V_DataVerse)

🔥 Update and News

:astonished: Gallery

Installation

1. Create a conda environment and install PyTorch

Note: You may want to adjust the CUDA version according to your driver version.

conda create -n VchitectXL -y
conda activate VchitectXL
conda install python=3.11 pytorch==2.1.0 torchvision==0.16.0 torchaudio==2.1.0 pytorch-cuda=12.1 -c pytorch -c nvidia -y

2. Install dependencies

pip install -r requirements.txt

Inference

First download the checkpoint.


save_dir=$1
ckpt_path=$2

python inference.py --test_file assets/test.txt --save_dir "${save_dir}" --ckpt_path "${ckpt_path}"

In inference.py, arguments for inference:

  • num_inference_steps: Denoising steps, default is 100
  • guidance_scale: CFG scale to use, default is 7.5
  • width: The width of the output video, default is 768
  • height: The height of the output video, default is 432
  • frames: The number of frames, default is 40

The results below were generated using the example prompt.

A snowy forest landscape with a dirt road running through it. The road is flanked by trees covered in snow, and the ground is also covered in snow. The sun is shining, creating a bright and serene atmosphere. The road appears to be empty, and there are no people or animals visible in the video.

The video opens with a breathtaking view of a starry sky and vibrant auroras. The camera pans to reveal a glowing black hole surrounded by swirling, luminescent gas and dust. Below, an enchanted forest of bioluminescent trees glows softly. The scene is a mesmerizing blend of cosmic wonder and magical landscape.

The base T2V model supports generating videos with resolutions up to 720x480 and 8fps. Then,VEnhancer is used to upscale the resolution to 2K and interpolate the frame rate to 24fps.

BibTex

@article{fan2025vchitect,
  title={Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Models},
  author={Fan, Weichen and Si, Chenyang and Song, Junhao and Yang, Zhenyu and He, Yinan and Zhuo, Long and Huang, Ziqi and Dong, Ziyue and He, Jingwen and Pan, Dongwei and others},
  journal={arXiv preprint arXiv:2501.08453},
  year={2025}
}

🔑 License

This code is licensed under Apache-2.0. The framework is fully open for academic research and also allows free commercial usage.

Disclaimer

We disclaim responsibility for user-generated content. The model was not trained to realistically represent people or events, so using it to generate such content is beyond the model's capabilities. It is prohibited for pornographic, violent and bloody content generation, and to generate content that is demeaning or harmful to people or their environment, culture, religion, etc. Users are solely liable for their actions. The project contributors are not legally affiliated with, nor accountable for users' behaviors. Use the generative model responsibly, adhering to ethical and legal standards.

Nearby in the ranking
Similar items