AI Rank
EN
← 开源
KangLiao929

Puffin

Puffin Series: Towards Unified Multimodal 3D World Models

ModelsFoundation modelsVision modelsPython
在 GitHub 打开
增长势头
+024 小时新增 Star0.0%
515
Star
23
Fork
+6
本周
1
贡献者
创建于 2025-10-07 · 更新于 2026-10-13 · 今日第 17962 名
主要开发者
KangLiao929

KangLiao929/Puffin 排名第 17,962，有 515 个星标。

同类别比较

KangLiao929/Puffin 排名第 17,962，此处有 8 个同类条目；Atten4Vis/LW-DETR 排名第 17,980。

同类别比较
名称排名指标
r9y9/gantts17,903
语言:
Jupyter Notebook
星标数:
518
分叉数:
116
简介:
PyTorch implementation of GAN-based text-to-speech synthesis and voice conversion (VC)
acids-ircam/ddsp_pytorch17,922
语言:
C
星标数:
517
分叉数:
62
简介:
Implementation of Differentiable Digital Signal Processing (DDSP) in Pytorch
zhuyu-cs/MeanFlow17,938
语言:
Python
星标数:
517
分叉数:
38
简介:
Pytorch implementation of MeanFlow on ImageNet and CIFAR10
MAGICS-LAB/DNABERT_217,942
语言:
Shell
星标数:
516
分叉数:
103
简介:
[ICLR 2024] DNABERT-2: Efficient Foundation Model and Benchmark for Multi-Species Genome
Atten4Vis/LW-DETR17,980
语言:
Python
星标数:
514
分叉数:
47
简介:
This repository is an official implementation of the paper "LW-DETR: A Transformer Replacement to YOLO for Real-Time Detection".
baidu/ERNIE-Image17,994
语言:
Python
星标数:
514
分叉数:
37
简介:
ERNIE-Image is an open text-to-image generation model developed by the ERNIE-Image team at Baidu. It is built on a single-stream Diffusion Transformer (DiT), with only 8B DiT parameters, it reaches state-of-the-art performance among open-weight text-to-image models.
facebookresearch/AudioDec17,998
语言:
Python
星标数:
514
分叉数:
33
简介:
An Open-source Streaming High-fidelity Neural Audio Codec
shansongliu/MuMu-LLaMA18,005
语言:
Jupyter Notebook
星标数:
514
分叉数:
42
简介:
This is the official repository for M2UGen
关键参数与规格
关键参数与规格
参数值
语言Python
类别Models
子类别Foundation models,Vision models
关键词3D, Multimodal, Physics, Visual understanding
星标数515
分叉数23
贡献者1
创建日期2025-10-07
更新日期2026-10-13
1 天星标数0
7 天星标数6
排名17,962
上次排名17,740
排名变化-222
7 天星标排名5,336
上次 7 天星标排名4,922
7 天星标排名变化-414
总星标排名18,924
上次总星标排名18,897
总星标排名变化-27
国家Singapore
README 摘录

Puffin Series: Towards Unified Multimodal 3D World Models **Puffin** is a series of unified multimodal models advancing toward 3D world modeling. 04: The paper of **Puffin-World** is released on arXiv. 23: The model weights of **Puffin-World** (Base / Pro / Caption) are released on Hugging Face. 23: The scripts of the dataset construction pipeline have been released. 23: The camera captions (by our method) of the commonly used large-scale text-to-image datasets, such as megalith-10m, have been

released. 22: The training and evaluation code of **Puffin-World** is released. 26: Puffin has been accepted at ICLR 2026. 15: Puffin-4M dataset reached 20,000 downloads on Hugging Face within three months of release. 10: The scripts of the camera-centric evaluation has been released. 10: The paper, project page, code, model, dataset, and demo of Puffin are online. 08673 (ICLR 2026) | Page | 🤗 KangLiao/Puffin | 🤗 Puffin-4M | | | **Puffin-World** *Native 3D World States* | arXiv:2609. 04196 | Page | 🤗 KangLiao

/Puffin-World | 🤗 Puffin-16M | | 🗞️ License This project is licensed under NTU S-Lab License 1. 📚 Citation If you find Puffin useful for your research or applications, please cite our papers using the following BibTeX:

常见问题

记录了多少星标和分叉？

KangLiao929/Puffin 有 515 个星标和 23 个分叉。

仓库排名是多少？

KangLiao929/Puffin 排名第 17,962。

记录的语言和类别是什么？

KangLiao929/Puffin 有 515 个星标，语言为 Python，类别为 Models。

哪个仓库排名最接近？

KangLiao929/Puffin 与 Atten4Vis/LW-DETR 比较，后者排名第 17,980，有 514 个星标。

README

Puffin Series: Towards Unified Multimodal 3D World Models

Puffin is a series of unified multimodal models advancing toward 3D world modeling. It starts from camera-centric spatial intelligence — understanding and generating the world from arbitrary viewpoints and orientations — and scales to a world model that represents worlds through three complementary native 3D world states (physics, geometry, and appearance), supporting camera-to-world understanding, camera-controllable generation, and image-/text-to-3D world generation without external perception or reconstruction modules. Each release lives in its own subdirectory of this repository:

  • Puffin/ — Thinking with Camera: A Unified Multimodal Model for Camera-Centric Understanding and Generation (ICLR 2026)

  • Puffin-World/ — Puffin-World: Scaling a Unified Multimodal Model with Native 3D World States (2026)

📝 Changelog & News

  • [x] 2026.09.04: The paper of Puffin-World is released on arXiv.
  • [x] 2026.08.23: The model weights of Puffin-World (Base / Pro / Caption) are released on Hugging Face.
  • [x] 2026.08.23: The scripts of the dataset construction pipeline have been released.
  • [x] 2026.08.23: The camera captions (by our method) of the commonly used large-scale text-to-image datasets, such as megalith-10m, have been released.
  • [x] 2026.08.22: The training and evaluation code of Puffin-World is released.
  • [x] 2026.01.26: Puffin has been accepted at ICLR 2026.
  • [x] 2026.01.15: Puffin-4M dataset reached 20,000 downloads on Hugging Face within three months of release.
  • [x] 2026.01.10: The scripts of the camera-centric evaluation has been released.
  • [x] 2025.10.10: The paper, project page, code, model, dataset, and demo of Puffin are online.

📖 Overview

Project Paper Project Page Model Dataset Code
Puffin
Thinking with Camera arXiv:2510.08673
(ICLR 2026) Page 🤗 KangLiao/Puffin 🤗 Puffin-4M Puffin/
Puffin-World
Native 3D World States arXiv:2609.04196 Page 🤗 KangLiao/Puffin-World 🤗 Puffin-16M Puffin-World/

🗞️ License

This project is licensed under NTU S-Lab License 1.0.

📚 Citation

If you find Puffin useful for your research or applications, please cite our papers using the following BibTeX:

@article{liao2025puffin,
  title={Thinking with Camera: A Unified Multimodal Model for Camera-Centric Understanding and Generation},
  author={Liao, Kang and Wu, Size and Wu, Zhonghua and Jin, Linyi and Wang, Chao and Wang, Yikai and Wang, Fei and Li, Wei and Loy, Chen Change},
  journal={arXiv preprint arXiv:2510.08673},
  year={2025}
}

@article{liao2026puffinworld,
  title={Puffin-World: Scaling a Unified Multimodal Model with Native 3D World States},
  author={Liao, Kang and Luo, Yihang and Wu, Xiao-Ming and Jin, Linyi and Wu, Size and Lin, Chunyu and Zhao, Yao and Wang, Fei and Li, Wei and Loy, Chen Change},
  journal={arXiv preprint arXiv:2609.04196},
  year={2026}
}
排名相邻
同类项目