Git Product home page Git Product logo

portrait3d's Introduction

bar

Email scholar orcid website github

Hi there ! 1f47b

I am Yiqian Wu (吴奕谦), now serving as an academic guest at ETH Zurich (May 2024 - Feb 2025), working with Prof. Siyu Tang. Concurrently, I am a CS Ph.D. candidate (since 2021) at the State Key Lab of CAD&CG, Zhejiang University, under the supervision of Prof. Xiaogang Jin. Prior to this, I accomplished my Bachelor's degree in Computer Science and Technology, graduating from the Chu Kochen College at Zhejiang University in 2021.

portrait3d's People

Contributors

onethousand1000 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar

portrait3d's Issues

Inference related Queries

Hi, Great Work you guys have done!
I have some questions regarding the steps to run inference

Currently, I have set up environment till this point, and now doing this part:
https://github.com/oneThousand1000/Portrait3D?tab=readme-ov-file#image-generation

  1. However, I want to confirm if I have to clone this whole Realistic_Vision_V5.1_noVAE repo or download some specific weights like Realistic_Vision_V5.1.ckpt and Realistic_Vision_V5.1.safetensors as shown in the image?

image

  1. Secondly, to completely run the inference till the very last, where we acquire a 3D generated high quality portrait (like you showed in Gallery), do we have to run these as well? E.g.
  1. Last, is it possible to train/test your model for other objects, which are not human?

KeyError: 'state_dict'

seed_everything(opt.seed) │

config = OmegaConf.load(f"{opt.config}") │
model = load_model_from_config(config, f"{opt.ckpt}") │

device = torch.device("cuda") if torch.cuda.is_available() else torch.device("cpu") │
model = model.to(device) │

/datasets/Portrait3D/stable-diffusion/scripts/txt2realistic_human.py:53 in │
load_model_from_config │

pl_sd = torch.load(ckpt, map_location="cpu") │
if "global_step" in pl_sd: │
print(f"Global Step: {pl_sd['global_step']}") │
sd = pl_sd["state_dict"] │
model = instantiate_from_config(config.model) │
m, u = model.load_state_dict(sd, strict=False) │
if len(m) > 0 and verbose:

KeyError: 'state_dict'

No such file or directory: '../test_data/2/samples/2d_pose_result_hrnet.json'

Hello, when I run

python preprocess_img_for_inversion.py --test_data_dir=$PROJECT_ROOT$/test_data

I get the following errors:

Traceback (most recent call last):
  File "tools/get_keypoints.py", line 264, in <module>
    main()
  File "tools/get_keypoints.py", line 248, in main
    with open(json_save_path, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '../test_data/2/samples/2d_pose_result_hrnet.json'

Looks like I'm missing json file but I followed everything as instruction says. How can I solve this problem?

No such file or directory: 'transfer_data/smpl_joint_regressor.npy'

Thanks for your impressive work! When I try to re-implment the work. It raise the error of

FileNotFoundError: [Errno 2] No such file or directory: 'transfer_data/smpl_joint_regressor.npy'

in

File "Portrait3D/3DPortraitGAN_pyramid/training/aligned_smpl.py", line 26, in __init__
    np.load('transfer_data/smpl_joint_regressor.npy')).float().cuda().contiguous()

Can u provide some hint of where to download the file? Thanks!

OSError: ("/home/jeonguk/miniconda3/envs/text_to_3dportrait/bin/../lib/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by /lib/x86_64-linux-gnu/libLLVM-15.so.1)", 'libOSMesa.so.8', 'libOSMesa.so.8')

Hello when I run the following command

python run_trigrid_gen.py  \
    --network=./models/model_512.pkl \
    --inversion_name=final_inversion

I get these errors:

Loading networks from "./models/model_512.pkl"...
Traceback (most recent call last):
  File "/home/jeonguk/miniconda3/envs/text_to_3dportrait/lib/python3.8/site-packages/OpenGL/platform/osmesa.py", line 22, in GL
    return ctypesloader.loadLibrary(
  File "/home/jeonguk/miniconda3/envs/text_to_3dportrait/lib/python3.8/site-packages/OpenGL/platform/ctypesloader.py", line 45, in loadLibrary
    return dllType( name, mode )
  File "/home/jeonguk/miniconda3/envs/text_to_3dportrait/lib/python3.8/ctypes/__init__.py", line 381, in __init__
    self._handle = _dlopen(self._name, mode)
OSError: ("/home/jeonguk/miniconda3/envs/text_to_3dportrait/bin/../lib/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by /lib/x86_64-linux-gnu/libLLVM-15.so.1)", 'libOSMesa.so.8', 'libOSMesa.so.8')

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "run_trigrid_gen.py", line 262, in <module>
    generate_images() # pylint: disable=no-value-for-parameter
  File "/home/jeonguk/miniconda3/envs/text_to_3dportrait/lib/python3.8/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "/home/jeonguk/miniconda3/envs/text_to_3dportrait/lib/python3.8/site-packages/click/core.py", line 1078, in main
    rv = self.invoke(ctx)
  File "/home/jeonguk/miniconda3/envs/text_to_3dportrait/lib/python3.8/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/home/jeonguk/miniconda3/envs/text_to_3dportrait/lib/python3.8/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
  File "run_trigrid_gen.py", line 212, in generate_images
    G = legacy.load_network_pkl(f)['G_ema'].to(device) # type: ignore
  File "/home/jeonguk/Portrait3D/3DPortraitGAN_pyramid/legacy.py", line 25, in load_network_pkl
    data = _LegacyUnpickler(f).load()
  File "/home/jeonguk/Portrait3D/3DPortraitGAN_pyramid/legacy.py", line 71, in find_class
    return super().find_class(module, name)
  File "/home/jeonguk/Portrait3D/3DPortraitGAN_pyramid/training/volumetric_rendering/renderer.py", line 22, in <module>
    from training.aligned_smpl import AlignedSMPL
  File "/home/jeonguk/Portrait3D/3DPortraitGAN_pyramid/training/aligned_smpl.py", line 19, in <module>
    import pyrender
  File "/home/jeonguk/miniconda3/envs/text_to_3dportrait/lib/python3.8/site-packages/pyrender/__init__.py", line 3, in <module>
    from .light import Light, PointLight, DirectionalLight, SpotLight
  File "/home/jeonguk/miniconda3/envs/text_to_3dportrait/lib/python3.8/site-packages/pyrender/light.py", line 10, in <module>
    from OpenGL.GL import *
  File "/home/jeonguk/miniconda3/envs/text_to_3dportrait/lib/python3.8/site-packages/OpenGL/GL/__init__.py", line 3, in <module>
    from OpenGL import error as _error
  File "/home/jeonguk/miniconda3/envs/text_to_3dportrait/lib/python3.8/site-packages/OpenGL/error.py", line 12, in <module>
    from OpenGL import platform, _configflags
  File "/home/jeonguk/miniconda3/envs/text_to_3dportrait/lib/python3.8/site-packages/OpenGL/platform/__init__.py", line 35, in <module>
    _load()
  File "/home/jeonguk/miniconda3/envs/text_to_3dportrait/lib/python3.8/site-packages/OpenGL/platform/__init__.py", line 32, in _load
    plugin.install(globals())
  File "/home/jeonguk/miniconda3/envs/text_to_3dportrait/lib/python3.8/site-packages/OpenGL/platform/baseplatform.py", line 92, in install
    namespace[ name ] = getattr(self,name,None)
  File "/home/jeonguk/miniconda3/envs/text_to_3dportrait/lib/python3.8/site-packages/OpenGL/platform/baseplatform.py", line 14, in __get__
    value = self.fget( obj )
  File "/home/jeonguk/miniconda3/envs/text_to_3dportrait/lib/python3.8/site-packages/OpenGL/platform/osmesa.py", line 66, in GetCurrentContext
    function = self.OSMesa.OSMesaGetCurrentContext
  File "/home/jeonguk/miniconda3/envs/text_to_3dportrait/lib/python3.8/site-packages/OpenGL/platform/baseplatform.py", line 14, in __get__
    value = self.fget( obj )
  File "/home/jeonguk/miniconda3/envs/text_to_3dportrait/lib/python3.8/site-packages/OpenGL/platform/osmesa.py", line 60, in OSMesa
    def OSMesa( self ): return self.GL
  File "/home/jeonguk/miniconda3/envs/text_to_3dportrait/lib/python3.8/site-packages/OpenGL/platform/baseplatform.py", line 14, in __get__
    value = self.fget( obj )
  File "/home/jeonguk/miniconda3/envs/text_to_3dportrait/lib/python3.8/site-packages/OpenGL/platform/osmesa.py", line 28, in GL
    raise ImportError("Unable to load OpenGL library", *err.args)
ImportError: ('Unable to load OpenGL library', "/home/jeonguk/miniconda3/envs/text_to_3dportrait/bin/../lib/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by /lib/x86_64-linux-gnu/libLLVM-15.so.1)", 'libOSMesa.so.8', 'libOSMesa.so.8')

How do I solve this issue?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.