Comments (7)
@w-hc @duxiaodan thank you for your feedback. I'll try with seed as 0 and check for the package version.
from sjc.
Thank you for reporting it. I checked and I found one also needs an additional argument --var_red False
for the Obama experiment. I've updated the README page too. Could you please give it a try and let me know if you are able to reproduce our results?
from sjc.
SJC can be quite sensitive to random seed for certrain prompts. All results we have shown are obtained using the default seed, which is 0. Also, version of packages that will cause stochasticity during training can also be the reason. For example, make sure you are using kornia==0.6.0
from sjc.
@vishalghor let us know if u can reproduce it. There should be no problem.
from sjc.
@duxiaodan @w-hc I tried with seed 0 and checking the package version for irregularities but still encountered the janus issue
I have attached the video. Here is the package list with versions:
absl-py==1.3.0 aiohttp==3.8.3 aiosignal==1.3.1 antlr4-python3-runtime==4.8 async-timeout==4.0.2 attrs==22.1.0 av==9.2.0 cachetools==5.2.0 certifi==2022.9.24 charset-normalizer==2.1.1 click==8.1.3 clip @ git+https:///github.com/openai/CLIP.git@d50d76daa670286dd6cacf3bcd80b5e4823fc8e1 contourpy==1.0.6 cycler==0.11.0 easydict==1.10 einops==0.6.0 filelock==3.8.0 fonttools==4.38.0 frozenlist==1.3.3 fsspec==2022.11.0 ftfy==6.1.1 future==0.18.2 google-auth==2.15.0 google-auth-oauthlib==0.4.6 grpcio==1.51.1 huggingface-hub==0.11.1 idna==3.4 imageio==2.22.4 imageio-ffmpeg==0.4.7 importlib-metadata==5.1.0 kiwisolver==1.4.4 kornia==0.6.0 Markdown==3.4.1 MarkupSafe==2.1.1 matplotlib==3.6.2 multidict==6.0.3 numpy==1.23.5 oauthlib==3.2.2 omegaconf==2.1.1 packaging==21.3 Pillow==9.3.0 protobuf==3.20.3 psutil==5.9.4 pyasn1==0.4.8 pyasn1-modules==0.2.8 pydantic==1.10.2 pyDeprecate==0.3.1 pyparsing==3.0.9 python-dateutil==2.8.2 pytorch-lightning==1.4.2 PyYAML==6.0 regex==2022.10.31 requests==2.28.1 requests-oauthlib==1.3.1 rsa==4.9 six==1.16.0 tabulate==0.9.0 -e git+https://github.com/CompVis/taming-transformers.git@3ba01b241669f5ade541ce990f7650a3b8f65318#egg=taming_transformers tensorboard==2.11.0 tensorboard-data-server==0.6.1 tensorboard-plugin-wit==1.8.1 tokenizers==0.13.2 torch==1.13.0+cu116 torchaudio==0.13.0+cu116 torchmetrics==0.6.0 torchvision==0.14.0+cu116 tqdm==4.64.1 transformers==4.25.1 typing_extensions==4.4.0 urllib3==1.26.13 wcwidth==0.2.5 Werkzeug==2.2.2 yarl==1.8.2 zipp==3.11.0
https://user-images.githubusercontent.com/23045660/206251946-c89f7463-3c58-4630-9a3a-b0b959f20d3b.mp4
from sjc.
@vishalghor sry we are also verifying other prompts. They are all reproducible; we just need to make sure this public repo matches with our internal one.
from sjc.
I am closing it for now since we do believe it should work this time. Feel free to re-open if it doesn't.
We are acutely aware of the limitation of this technology so far, and are working to improve it.
We (mostly under Xiaodan's lead) tried all of our stuff with seed 0, and did not try seed tuning. Out of the prompts we have tried there's roughly a 25% success rate. Far from ideal but somewhat usable. Also there are some general guidelines that we will write up (e.g. first try the prompt on 2D, and only use those that work well there before going to 3D).
from sjc.
Related Issues (20)
- Different angles in SD HOT 1
- The next SD version could speed up the generation of 3d models ? "Stable Diffusion will generate 30 images per second instead of one image in 5.6 seconds" HOT 1
- Drop the duplicate running process in the queue on Hugging Face
- Another viewpoint to interpret the score HOT 5
- Details about the eq19 HOT 2
- About bs=1 and the use of the Monte-Carlo estimate HOT 4
- question of the provement of the formula17 HOT 3
- Question about train_eye_with_prompts HOT 3
- scripts for figure 4 HOT 2
- Can you provide the rendered videos for better comparison?
- About OOD issues. HOT 2
- Questions about center depth loss in the paper HOT 5
- Where is the jacobian implementation for the backpropogation?
- Bibtex not up to date HOT 1
- noisy_x scaling before diffusion models HOT 1
- Query : 4 channels in nerf output HOT 5
- Question about paper
- How to train the model with a new dataset? HOT 1
- Colab ModuleNotFoundError: No module named 'torchtext.legacy' HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sjc.