← 开源
USTC3DV

NDR-code

【NeurIPS 2022 Spotlight】Neural Surface Reconstruction of Dynamic Scenes with Monocular RGB-D Camera

Model DevelopmentArchitecturePython
在 GitHub 打开
增长势头
+024 小时新增 Star0.0%
564
Star
60
Fork
+0
本周
3
贡献者
创建于 2022-10-14 · 更新于 2026-09-29 · 今日第 16940 名
主要开发者
RainbowRuiUSTC3DVWanquanF

USTC3DV/NDR-code 排名第 16,940,有 564 个星标。

同类别比较

USTC3DV/NDR-code 排名第 16,940,此处有 8 个同类条目;dgriff777/rl_a3c_pytorch 排名第 16,944。

同类别比较
名称排名指标
movehand/raisr16,925
语言:
Python
星标数:
565
分叉数:
154
简介:
A Python implementation of RAISR
thuml/OpenLTM16,929
语言:
Jupyter Notebook
星标数:
565
分叉数:
64
简介:
Implementations, Pre-training Code and Datasets of Large Time-Series Models
voidful/TextRL16,931
语言:
Python
星标数:
565
分叉数:
61
简介:
Implementation of ChatGPT RLHF (Reinforcement Learning with Human Feedback) on any generation model in huggingface's transformer (blommz-176B/bloom/gpt/bart/T5/MetaICL)
wengong-jin/icml18-jtnn16,932
语言:
Python
星标数:
565
分叉数:
196
简介:
Junction Tree Variational Autoencoder for Molecular Graph Generation (ICML 2018)
dgriff777/rl_a3c_pytorch16,944
语言:
Python
星标数:
564
分叉数:
115
简介:
A3C LSTM Atari with Pytorch plus A3G design
flyyufelix/DenseNet-Keras16,945
语言:
Python
星标数:
564
分叉数:
256
简介:
DenseNet Implementation in Keras with ImageNet Pretrained Models
the-matter-lab/chemical_vae16,950
语言:
Python
星标数:
564
分叉数:
191
简介:
Code for 10.1021/acscentsci.7b00572, now running on Keras 2.0 and Tensorflow
YixuanLi/densenet-tensorflow16,957
语言:
Python
星标数:
563
分叉数:
193
简介:
DenseNet Implementation in Tensorflow
关键参数与规格
关键参数与规格
参数值
语言Python
类别Model Development
子类别Architecture
关键词3D, Computer vision
星标数564
分叉数60
贡献者3
创建日期2022-10-14
更新日期2026-09-29
1 天星标数0
7 天星标数0
排名16,940
上次排名16,728
排名变化-212
7 天星标排名15,815
上次 7 天星标排名15,823
7 天星标排名变化8
总星标排名17,628
上次总星标排名17,599
总星标排名变化-29
国家China
README 摘录

Neural Surface Reconstruction of Dynamic Scenes with Monocular RGB-D Camera NeurIPS 2022 (Spotlight) Paper | Project Page | OpenReview | Poster We propose Neural-DynamicReconstruction (NDR), a template-free method to recover high-fidelity geometry, motions and appearance of a dynamic scene from a monocular RGB-D camera. Usage Data Convention The data is organized as NeuS Here follows the data format in IDR, where denotes the world-to-image projection matrix, and denotes the normalization matrix. Pre-processed Data You can

download a part of pre-processed KillingFusion data here and unzip it into . Important Tips: If the pre-processed data is useful, please cite the related paper(s) and strictly abide by related open-source license(s). Setup Clone this repository and create the environment (please notice CUDA version) Dependencies (click to expand) torch==1. 2 Running **Training** **Evaluating pre-trained model** Data Pre-processing To prepare your own data for experiments, please refer to pose initialization. Geometric Projection **Compiling

renderer** **Rendering meshes** Input path of original data, path of results, and iteration number, e. Some code snippets are also borrowed from IDR and NeRF-pytorch. The pre-processing code for camera pose initialization is borrowed from Fast-Robust-ICP. The evaluation code for geometry rendering is borrowed from StereoPIFu_Code. We thank all the authors for their great work and repos. Contact If you have questions, please contact Hongrui Cai. Citation If you find our code or paper useful

, please cite If you find our pre-processed data useful, please cite the related paper(s) and strictly abide by related open-source license(s).

常见问题

记录了多少星标和分叉?

USTC3DV/NDR-code 有 564 个星标和 60 个分叉。

仓库排名是多少?

USTC3DV/NDR-code 排名第 16,940。

记录的语言和类别是什么?

USTC3DV/NDR-code 有 564 个星标,语言为 Python,类别为 Model Development。

哪个仓库排名最接近?

USTC3DV/NDR-code 与 dgriff777/rl_a3c_pytorch 比较,后者排名第 16,944,有 564 个星标。

README

Neural Surface Reconstruction of Dynamic Scenes with Monocular RGB-D Camera

[Hongrui Cai](https://rainbowrui.github.io/)
·
[Wanquan Feng](https://wanquanf.github.io/)
·
[Xuetao Feng](https://scholar.google.com/citations?hl=en&user=5G-2EFcAAAAJ)
·
Yan Wang
·
[Juyong Zhang](http://staff.ustc.edu.cn/~juyong/)

NeurIPS 2022 (Spotlight)

Paper | Project Page | OpenReview | Poster

We propose Neural-DynamicReconstruction (NDR), a template-free method to recover high-fidelity geometry, motions and appearance of a dynamic scene from a monocular RGB-D camera.

Usage

Data Convention

The data is organized as NeuS


|-- cameras_sphere.npz    # camera parameters
|-- depth
    |-- # target depth for each view
    ...
|-- image
    |-- # target RGB each view
    ...
|-- mask
    |-- # target mask each view (For unmasked setting, set all pixels as 255)
    ...

Here cameras_sphere.npz follows the data format in IDR, where world_mat_xx denotes the world-to-image projection matrix, and scale_mat_xx denotes the normalization matrix.

Pre-processed Data

You can download a part of pre-processed KillingFusion data here and unzip it into ./.

Important Tips: If the pre-processed data is useful, please cite the related paper(s) and strictly abide by related open-source license(s).

Setup

Clone this repository and create the environment (please notice CUDA version)

git clone https://github.com/USTC3DV/NDR-code.git
cd NDR-code
conda env create -f environment.yml
conda activate ndr

Dependencies (click to expand)

  • torch==1.8.0
  • opencv_python==4.5.2.52
  • trimesh==3.9.8
  • numpy==1.21.2
  • scipy==1.7.0
  • PyMCubes==0.1.2

Running

  • Training
python train_eval.py
  • Evaluating pre-trained model
python pretrained_eval.py

Data Pre-processing

To prepare your own data for experiments, please refer to pose initialization.

Geometric Projection

  • Compiling renderer
cd renderer && bash build.sh && cd ..
  • Rendering meshes

Input path of original data, path of results, and iteration number, e.g.

python geo_render.py ./datasets/kfusion_frog/ ./exp/kfusion_frog/result/ 120000

The rendered results will be put in dir [path_of_results]/validations_geo/

Todo List

  • [x] Configure Files for DeepDeform Human Sequences and KillingFusion
  • [x] Code of Data Pre-processing
  • [x] Code of Geometric Projection
  • [x] Pre-trained Models and Evaluation Code
  • [x] Training Code

Acknowledgements

This project is built upon NeuS. Some code snippets are also borrowed from IDR and NeRF-pytorch. The pre-processing code for camera pose initialization is borrowed from Fast-Robust-ICP. The evaluation code for geometry rendering is borrowed from StereoPIFu_Code. Thanks for these great projects. We thank all the authors for their great work and repos.

Contact

If you have questions, please contact Hongrui Cai.

Citation

If you find our code or paper useful, please cite

@inproceedings{Cai2022NDR,
  author    = {Hongrui Cai and Wanquan Feng and Xuetao Feng and Yan Wang and Juyong Zhang},
  title     = {Neural Surface Reconstruction of Dynamic Scenes with Monocular RGB-D Camera},
  booktitle = {Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS)},
  year      = {2022}
}

If you find our pre-processed data useful, please cite the related paper(s) and strictly abide by related open-source license(s).

排名相邻
同类项目