Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rendering using your pre-trained checkpoints #6

Open
oferidan1 opened this issue Mar 17, 2024 · 0 comments
Open

Rendering using your pre-trained checkpoints #6

oferidan1 opened this issue Mar 17, 2024 · 0 comments

Comments

@oferidan1
Copy link

Hi,
Thanks for sharing your great paper and code.
I wish running your pre-trained checkpoint from: https://drive.google.com/drive/folders/15I7z7qjBL6rQ3z91_rzhR284L1vfxxOX
which step does this checkpoint belongs to? is it step 3 (3rd_Complete_HOSNeRF)?
can you please provide an example script for rendering a scene (preferbly with human+background) using your checkpoint?

I tried to modify the code of 3rd_Complete_HOSNeRF/run.py to load Backpack.cpkt checkpoint (not sure what I do is correct) but I am getting below error:
self._restore_modules_and_callbacks(ckpt_path)
File "/home/ofer/miniconda3/lib/python3.11/site-packages/pytorch_lightning/trainer/trainer.py", line 1142, in _restore_modules_and_callbacks
self._checkpoint_connector.restore_model()
File "/home/ofer/miniconda3/lib/python3.11/site-packages/pytorch_lightning/trainer/connectors/checkpoint_connector.py", line 179, in restore_model
self.trainer.strategy.load_model_state_dict(self._loaded_checkpoint)
File "/home/ofer/miniconda3/lib/python3.11/site-packages/pytorch_lightning/strategies/strategy.py", line 319, in load_model_state_dict
self.lightning_module.load_state_dict(checkpoint["state_dict"])
File "/home/ofer/miniconda3/lib/python3.11/site-packages/torch/nn/modules/module.py", line 2153, in load_state_dict
raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format(
RuntimeError: Error(s) in loading state_dict for LitMipNeRF360:
Unexpected key(s) in state_dict: "human.human_stateembeds.1", "human.human_stateembeds.2".
In call to configurable 'run' (<function run at 0x7f7f934b5bc0>)

can you please assist?

thanks alot,
Ofer

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant