darglein / adop Goto Github PK
View Code? Open in Web Editor NEWLicense: MIT License
adop's People
Contributors
Stargazers
Watchers
Forkers
cuulee dejer mrcodechef miguelbandera rhinojosa zbhit123 francescoyang kanamu skywcd robotpin woniupapa bonevays ywxhz zhuomingliang fly1008 darkpumpkinai zhanghongyong123456 golfapipol voroninvisuals caumaker michael-f-chen johnnyvr smalldog124 vishal2241 kmyface yannnnnnnnnnnn hoanbi1812000 leelcn kennyglacier wf-hahaha mikuhime xuliangcs matxp zhxhdreams faisalshahbaz martincastellano kiku-jw avatarchik homgorn olbychos impossibilitylabs frankgoto lessthan12parsecs hybridherbst henk911 krasin hradec charlie-x denshlk fcarsten criticalpulsar sehav cavitas sylvia6 siliconvalleypilot zeroizehd tvhstudio nikhilkodilkar windclient audyzhu hadryan leoluopy asdlei99 sandutsar chrisxnz stjordanis linecode xgenietony feiyunwill kishorchauhan yes-jumby nklvdm xinruozhishui201314 pmoulon cgus sky3 yht98 fhchina shreyachauhan13 peterzhousz liweixiang0222 oathkeeper2x mohan-zhang-u web-stormtrooper morhaliukol vikwin knut0815 lianjifei tlow22 leerw maciejmacko elkolako bruinxiong hkmtechnology laxmikant-ainapure jimwangzx steventhegeek jaedukseo gigizzz infinite-c-appadop's Issues
poses.txt file missing
Hi thanks for the awesome work!
I was trying to run ./bin/colmap2adop on my reconstruction, and pointed --sparse_dir --image_dir --point_cloud_file to the correct locations, but I still got the following error:
Assertion 'the pose file is required!' failed!
File: ADOP/src/lib/data/SceneData.cpp:125
Function: SceneData::SceneData(std::string)
Aborted
I tried the given boat sample data, still same problem. Could you give more context on how to obtain the poses.txt file?
Thank you!
Train on other scenes
Hi, thank you for the great project.
I noticed what you described in Custom Datasets.
Here I have some questions about my dataset scenes.
- Must I use dataset generated by COLMAP? I have collected kitti dataset and processed their pose data into adop format and verified it.
- But here remains something wrong with my point cloud file. I noticed that the input point cloud must have the info of positions, colors and normals, but in my kitti data I only have the position info. Can I initialize it with zero value mapped colors and zeros value mapped normals?( colors = np.zeros(point.shape), normals = np.zeros(point.shape))
- Furthermore, does the normal of point make a great role in adop function?
- Can I use the normal calculated from range-view?
Will Windows support be added, if so, when?
pytorch wrapper please
Super cool work! would be great to have a pytorch wrapper. Thanks!
[Question] running with custom images on pre-trained model
Thanks for releasing ADOP. If I want to test ADOP on my own image dataset, I'll need to
a) pre-process them with Colmap (do I need a dense reconstruction, a sparse reconstruction or just the camera poses?)
b) convert them to ADOP format via colmap2adop
c) load them into the ADOP/scenes folder
before running ADOP?
How to generate a video from a given trajectory?
Hi, I saw you provided some videos for the trained models on the different scenes. I was wondering how you generated them? Is it possible to generate them with the viewer?
Can't Build VR Viewer
I've followed the instructions but I don't see ./build/bin/adop_vr_viewer
I did run conda install -y -c schrodinger openvr and compiled ADOP again.
Any suggestions here would be appreciated, thank you!
How to optimize for rendering
Hi I have a question regarding the adop_viewer. l tried the adop_viewer with pretrained models on tanks and temples dataset, it works perfectly on a laptop with a 3080 GPU (8GB VRAM) on all scenes.
I guess you are using the 40GB A100 ini files for training these models, so I also tried training my data on a GPU with similar VRAM using exact settings from train_tank_and_temples_multi.ini. However, when I attempt to visualize my checkpoints on the 3080 GPU it shows CUDA out of memory for all my scenes.
My question is: for rendering, did you make some optimizations to make the trained models fit in a GPU with less VRAM? Or is there certain configurations/arguments that allows the adop_viewer to take a model trained with high-end GPUs and render on low-end GPUs? Thanks in advance!
How to train with your own data?
What are the inputs for training? Say I go outside and want to do the same for new places or buldings/objects. Do I need to take a series of images or a video? How do I provide or get the initial pointcloud data?
Also, is there a way to train this on a GPU without the memory that you use? I've got a GTX 1070 Ti with like 8 GB of ram. Is there a setting I can use to make that work?
libjpeg dependency
You need to install libjpeg:
sudo apt install libjpeg-dev
Run on WSL2
Hello.
It was not until I compiled ADOP in VirtualBox that I found virtual machine cannot use GPU of my computer. adop_viewer crashed while I tried to run ADOP on pretrained models.
I don't have computers with Ubuntu system. So my question is, is it possible to compile the ADOP on WSL? And more importantly, will adop_viewer shows GUI while running in WSL?
Thanks.
Something worry in PointRenderer.cu & PointRenderer.h
Can not Build CUDA object src/lib/CMakeFiles/NeuralPoints.dir/rendering/PointRenderer.cu.o
/home/xgenie/projectfold/ADOP/src/lib/./config.h(25): error: inline specifier allowed on function declarations only
/home/xgenie/projectfold/ADOP/src/lib/./config.h(25): error: inline specifier allowed on function declarations only
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.h(37): error: qualified name is not allowed
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.h(39): error: Function is not a template
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.h(39): error: not a class or struct name
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.h(42): error: identifier "variable_list" is undefined
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.h(42): error: identifier "AutogradContext" is undefined
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.h(42): error: identifier "Variable" is undefined
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.h(42): error: identifier "Variable" is undefined
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.h(42): error: identifier "Variable" is undefined
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.h(43): error: identifier "Variable" is undefined
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.h(43): error: identifier "Variable" is undefined
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.h(43): error: identifier "IValue" is undefined
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.h(45): error: identifier "variable_list" is undefined
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.h(45): error: identifier "AutogradContext" is undefined
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.h(45): error: identifier "variable_list" is undefined
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(422): error: expected an identifier
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(422): error: identifier "K" is undefined
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(422): error: expected a "]"
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(422): warning: nonstandard use of "auto" to both deduce the type from an initializer and to announce a trailing return type
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(422): error: cannot deduce "auto" type (initializer required)
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(422): error: expected a ";"
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(429): error: expected an identifier
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(429): error: identifier "aff" is undefined
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(429): error: expected a "]"
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(429): warning: nonstandard use of "auto" to both deduce the type from an initializer and to announce a trailing return type
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(429): error: cannot deduce "auto" type (initializer required)
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(429): error: expected a ";"
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(621): error: expected an identifier
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(621): error: identifier "K" is undefined
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(621): error: expected a "]"
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(621): warning: nonstandard use of "auto" to both deduce the type from an initializer and to announce a trailing return type
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(621): error: cannot deduce "auto" type (initializer required)
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(621): error: expected a ";"
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(622): error: expected an identifier
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(622): error: identifier "g_point" is undefined
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(622): error: expected a "]"
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(622): warning: nonstandard use of "auto" to both deduce the type from an initializer and to announce a trailing return type
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(622): error: cannot deduce "auto" type (initializer required)
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(622): error: expected a ";"
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(686): error: expected an identifier
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(686): error: identifier "aff" is undefined
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(686): error: expected a "]"
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(686): warning: nonstandard use of "auto" to both deduce the type from an initializer and to announce a trailing return type
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(686): error: cannot deduce "auto" type (initializer required)
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(686): error: expected a ";"
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(687): error: expected an identifier
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(687): error: identifier "g_point" is undefined
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(687): error: expected a "]"
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(687): warning: nonstandard use of "auto" to both deduce the type from an initializer and to announce a trailing return type
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(687): error: cannot deduce "auto" type (initializer required)
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(687): error: expected a ";"
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(527): warning: variable "iw" was declared but never referenced
/home/xgenie/projectfold/ADOP/src/lib/rendering/PointRenderer.cu(615): warning: variable "cam2" was set but never used
Is it possible to import generated scene in Unity or UnrealEngine VR app?
Im working on project for interaction with customs scenes for further analysis. And I want to upload generated model into my app to manipulate with it, if it`s possible.
Fail to run Viewer in Docker container
Hi congrats on the awesome work !
We've been working on reproducing ADOP on our datasets for a few weeks now. The data conversion and training part went flawlessly. We have a harder time using the visualization tool ADOP_VIEWER.
To allow for a seamless integration across our systems we've worked on the containerization of the environment with docker. The compilation works well but we struggle in using the viewer. Here is the Dockerfile :
ARG CUDA_VERSION=11.1
ARG UBUNTU_VERSION=20.04
FROM nvidia/cudagl:${CUDA_VERSION}-devel-ubuntu${UBUNTU_VERSION}
ARG CPU_SIZE=4
ARG PYTHON_VERSION=3.9
USER root
ENV DEPENDENCIES="/dependencies"
WORKDIR ${DEPENDENCIES}
ENV DEBIAN_FRONTEND noninteractive
#----------------------------------------------
# Dependencies
#----------------------------------------------
RUN apt-get -y update && \
apt-get -y upgrade && \
apt-get install -y \
software-properties-common \
sudo \
cmake \
build-essential \
wget \
curl \
git \
swig \
bzip2 \
xorg-dev \
x11-apps \
mesa-utils
# CMAKE
RUN apt purge -y --auto-remove cmake && \
wget -O - https://apt.kitware.com/keys/kitware-archive-latest.asc 2>/dev/null | gpg --dearmor - | sudo tee /etc/apt/trusted.gpg.d/kitware.gpg >/dev/null && \
apt-add-repository 'deb https://apt.kitware.com/ubuntu/ bionic main' && \
apt-get update && \
apt-get install -y cmake
# C++ 20
RUN add-apt-repository ppa:ubuntu-toolchain-r/test && \
apt update && \
apt-get install -y gcc-9 g++-9 && \
update-alternatives --install /usr/bin/gcc gcc /usr/bin/gcc-9 60 --slave /usr/bin/g++ g++ /usr/bin/g++-9 && \
update-alternatives --config gcc
# TBB
RUN cd ${DEPENDENCIES} && \
git clone https://github.com/wjakob/tbb.git && \
cd tbb/build && \
cmake .. && \
make -j${CPU_SIZE} && \
make install
ENV CUDA_ROOT /usr/local/cuda-${CUDA_VERSION}
ENV PATH $PATH:$CUDA_ROOT/bin
ENV LD_LIBRARY_PATH $LD_LIBRARY_PATH:$CUDA_ROOT/lib64:$CUDA_ROOT/lib:/usr/local/nvidia/lib64:/usr/local/nvidia/lib
ENV LIBRARY_PATH /usr/local/nvidia/lib64:/usr/local/nvidia/lib:/usr/local/cuda/lib64/stubs:/usr/local/cuda/lib64:/usr/local/cuda/lib$LIBRARY_PATH
# Anaconda
ENV PATH=/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
RUN /bin/sh -c set -x && apt-get update --fix-missing && apt-get install -y --no-install-recommends bzip2 ca-certificates git libglib2.0-0 libsm6 libxcomposite1 libxcursor1 libxdamage1 libxext6 libxfixes3 libxi6 libxinerama1 libxrandr2 libxrender1 mercurial openssh-client procps subversion wget && apt-get clean && rm -rf /var/lib/apt/lists/* && UNAME_M="$(uname -m)" && if [ "${UNAME_M}" = "x86_64" ]; then ANACONDA_URL="https://repo.anaconda.com/archive/Anaconda3-2021.11-Linux-x86_64.sh"; SHA256SUM="fedf9e340039557f7b5e8a8a86affa9d299f5e9820144bd7b92ae9f7ee08ac60"; elif [ "${UNAME_M}" = "s390x" ]; then ANACONDA_URL="https://repo.anaconda.com/archive/Anaconda3-2021.11-Linux-s390x.sh"; SHA256SUM="1504e9259816c5804eff1304fe7e339517b9fc1a08bfd991bc525a7efb6568f1"; elif [ "${UNAME_M}" = "aarch64" ]; then ANACONDA_URL="https://repo.anaconda.com/archive/Anaconda3-2021.11-Linux-aarch64.sh"; SHA256SUM="4daacb88fbd3a6c14e28cd3b37004ed4c2643e2b187302e927eb81a074e837bc"; elif [ "${UNAME_M}" = "ppc64le" ]; then ANACONDA_URL="https://repo.anaconda.com/archive/Anaconda3-2021.11-Linux-ppc64le.sh"; SHA256SUM="7eb6a95925ee756240818599f8dcbba7a155adfb05ef6cd5336aa3c083de65f3"; fi && wget "${ANACONDA_URL}" -O anaconda.sh -q && echo "${SHA256SUM} anaconda.sh" > shasum && sha256sum --check --status shasum && /bin/bash anaconda.sh -b -p /opt/conda && rm anaconda.sh shasum && ln -s /opt/conda/etc/profile.d/conda.sh /etc/profile.d/conda.sh && echo ". /opt/conda/etc/profile.d/conda.sh" >> ~/.bashrc && echo "conda activate base" >> ~/.bashrc && find /opt/conda/ -follow -type f -name '*.a' -delete && find /opt/conda/ -follow -type f -name '*.js.map' -delete && /opt/conda/bin/conda clean -afy # buildkit
ENV CC=gcc-9
ENV CXX=g++-9
ENV CUDAHOSTCXX=g++-9
#----------------------------------------------
# ADOP
#----------------------------------------------
ENV WORKSPACES="/workspaces"
ENV PROJECT="ADOP"
RUN mkdir ${WORKSPACES} && \
cd ${WORKSPACES} && \
git clone https://github.com/darglein/${PROJECT}.git && \
cd ${PROJECT} && \
git submodule update --init --recursive --jobs 0
WORKDIR ${WORKSPACES}/${PROJECT}
RUN ./create_environment.sh
RUN echo "source activate adop" > ~/.bashrc
ENV PATH ${CONDA}/bin:$PATH
RUN ./install_pytorch.sh
ENV CONDA=/opt/conda/envs/adop
RUN mkdir build && \
cd build && \
cmake -DCMAKE_PREFIX_PATH="${CONDA}/lib/python${PYTHON_VERSION}/site-packages/torch/;${CONDA}" \
-DCMAKE_CUDA_COMPILER=${CONDA}/bin/nvcc .. && \
make -j${CPU_SIZE}
#-------------------------------------------------------------
# Post Processing
#-------------------------------------------------------------
ENV USER=dock
ENV GROUP=sudo
RUN useradd -ms /bin/bash ${USER} && \
usermod -aG ${GROUP} ${USER}
RUN cd ${WORKSPACES} && \
chown -R dock:dock ./ADOP
USER root
RUN apt-get autoremove -y && \
apt-get autoclean -y && \
rm -rf /var/lib/apt/lists/*
# Resolve authorization problem
RUN echo "${USER} ALL=(ALL) NOPASSWD: ALL" \
>/etc/sudoers.d/${USER} && \
chmod 0440 /etc/sudoers.d/${USER}
USER dock
Trying to open the viewer on one of your scenes leads to "CUDA out of memory" Error (using a GeForce RTX 2060 6GB).
Trying to open the viewer with a scene trained on our data leads to :
Assertion 'cudaDeviceSynchronize() == cudaSuccess' failed!
File: /dependencies/ADOP/src/lib/rendering/PointRenderer.cu:1333
Function: void PointRendererCache::RenderForwardMulti(int, NeuralPointCloudCuda)
Message: device-side assert triggered
Why does this error pop up ? Do you know how we should go about this error ?
Thanks for your help !
Mention nvidia-cuda-toolkit as a dependency in compilation instructions
As the title says, not everyone has that dependency installed and will receive this error during compilation:
Could not find nvcc, please set CUDAToolkit_ROOT.
colmap2adop crashes on assertion: info.ExposureBiasValue == 0
Hi,
I'm trying to learn how to use ADOP for my own set of images. I've never really used colmap before but using audomatic reconstruction in the GUI, was able to produce a dense and sparse reconstruction. Note that my .ply point cloud file is located in $SCENE_BASE/dense/0 rather than $SCENE_BASE as in the usage example in README.md.
I get tripped up by some assertion and I'm not sure if there is a workaround. Here is my output:
bart@Technodrome:~/projects/ADOP$ build/bin/colmap2adop --sparse_dir $SCENE_BASE/sparse/0 --image_dir scenes/lakeridge_pool/images --point_cloud_file $SCENE_BASE/dense/0/fused.ply --output_path scenes/lakeridge_pool --scale_intrinsics 1 --render_scale 1
register neural render info
Preprocessing Colmap scene /home/bart/projects/lakeridge/sparse/0 -> scenes/lakeridge_pool
Num cameras 1
id: 0 camera model: 2 K: 3088.08 3088.08 2016 1512 0 Dis: 0.0116571 0 0 0 0 0 0 0
Num images 186
IMG_3136.JPG 4 -> 0 0 Position: -1.89089 -0.234411 4.52033
IMG_3137.JPG 3 -> 1 0 Position: 0.378659 -0.451968 4.87581
IMG_3138.JPG 2 -> 2 0 Position: 0.564876 0.873621 4.80398
IMG_3139.JPG 1 -> 3 0 Position: 1.16454 1.5363 4.52841
IMG_3140.JPG 6 -> 4 0 Position: 1.55933 -0.558918 4.64452
IMG_3141.JPG 7 -> 5 0 Position: 3.61732 -0.505346 3.36747
IMG_3142.JPG 9 -> 6 0 Position: 4.8889 -0.0918832 0.448115
IMG_3143.JPG 5 -> 7 0 Position: 4.18467 0.241358 -2.47252
IMG_3144.JPG 8 -> 8 0 Position: 2.62575 0.569915 -3.71823
IMG_3145.JPG 13 -> 9 0 Position: 2.57384 -0.831334 -3.69662
IMG_3146.JPG 17 -> 10 0 Position: 2.10184 -0.460205 -3.96549
IMG_3147.JPG 11 -> 11 0 Position: 2.1416 1.04326 -3.8367
IMG_3148.JPG 12 -> 12 0 Position: 0.958832 1.39273 -4.15396
IMG_3149.JPG 10 -> 13 0 Position: -1.41954 1.28613 -4.09003
IMG_3150.JPG 18 -> 14 0 Position: -1.41911 -0.200994 -4.27028
IMG_3151.JPG 32 -> 15 0 Position: -1.43549 -1.36029 -4.03637
IMG_3152.JPG 14 -> 16 0 Position: -3.59765 0.939916 -2.84264
IMG_3153.JPG 15 -> 17 0 Position: -4.34177 0.0643341 -2.28495
IMG_3154.JPG 16 -> 18 0 Position: -4.42102 0.787602 -1.9721
IMG_3155.JPG 23 -> 19 0 Position: -4.39101 1.30871 -1.75209
IMG_3156.JPG 31 -> 20 0 Position: -4.43574 -0.345473 -2.06734
IMG_3157.JPG 19 -> 21 0 Position: -4.68322 -0.326334 2.6192
IMG_3158.JPG 22 -> 22 0 Position: -2.70991 -1.00033 4.86697
IMG_3159.JPG 24 -> 23 0 Position: -0.464814 -1.40312 5.64586
IMG_3160.JPG 20 -> 24 0 Position: -0.494801 0.529923 5.788
IMG_3161.JPG 25 -> 25 0 Position: 2.23685 -0.164267 5.4254
IMG_3162.JPG 26 -> 26 0 Position: 0.75389 -2.9956 4.9654
IMG_3163.JPG 21 -> 27 0 Position: -1.58557 -3.04788 4.72871
IMG_3164.JPG 27 -> 28 0 Position: 1.2923 -0.726255 5.60195
IMG_3165.JPG 29 -> 29 0 Position: 0.175207 -0.805053 4.98503
IMG_3166.JPG 28 -> 30 0 Position: 0.196862 -0.519683 4.44226
IMG_3167.JPG 30 -> 31 0 Position: 0.0440985 -0.300632 4.44549
IMG_3168.JPG 38 -> 32 0 Position: -1.78238 0.238353 4.06945
IMG_3169.JPG 34 -> 33 0 Position: -3.69564 -0.224309 2.50958
IMG_3170.JPG 33 -> 34 0 Position: -4.4071 -0.138796 0.465772
IMG_3171.JPG 37 -> 35 0 Position: -3.78188 0.115589 -2.40882
IMG_3172.JPG 39 -> 36 0 Position: -3.00593 0.199341 -3.37477
IMG_3174.JPG 36 -> 37 0 Position: 3.94743 0.290594 -2.36559
IMG_3175.JPG 51 -> 38 0 Position: 4.51454 -0.0414131 0.474309
IMG_3176.JPG 50 -> 39 0 Position: 3.83682 -0.215717 2.33619
IMG_3177.JPG 41 -> 40 0 Position: 1.98051 -0.429242 3.94924
IMG_3178.JPG 40 -> 41 0 Position: -2.96871 -0.633854 3.862
IMG_3179.JPG 46 -> 42 0 Position: -2.08799 -0.930789 4.06483
IMG_3180.JPG 43 -> 43 0 Position: -2.26218 0.23649 4.02214
IMG_3181.JPG 48 -> 44 0 Position: -2.81931 -0.922176 2.96086
IMG_3182.JPG 44 -> 45 0 Position: -2.9285 -0.3508 2.18193
IMG_3183.JPG 42 -> 46 0 Position: -3.69997 0.0438288 0.069077
IMG_3184.JPG 47 -> 47 0 Position: -2.31767 -0.330573 1.94316
IMG_3185.JPG 49 -> 48 0 Position: -3.05043 -0.0346761 0.242605
IMG_3186.JPG 45 -> 49 0 Position: -2.99199 0.0809456 -0.701316
IMG_3187.JPG 55 -> 50 0 Position: -1.43001 -0.253776 1.97616
IMG_3188.JPG 53 -> 51 0 Position: -2.33605 -0.0550523 0.811886
IMG_3189.JPG 52 -> 52 0 Position: -2.49588 0.0490388 -0.164555
IMG_3190.JPG 57 -> 53 0 Position: -2.26337 0.328444 0.917239
IMG_3191.JPG 56 -> 54 0 Position: -0.957613 0.458248 2.18509
IMG_3192.JPG 54 -> 55 0 Position: 0.5938 0.158907 2.33484
IMG_3193.JPG 59 -> 56 0 Position: -0.144778 -0.327327 1.8413
IMG_3194.JPG 60 -> 57 0 Position: -1.1909 -0.174417 1.45126
IMG_3195.JPG 58 -> 58 0 Position: -1.82146 -0.0557306 0.614374
IMG_3196.JPG 61 -> 59 0 Position: 0.607432 -0.40251 1.86614
IMG_3197.JPG 63 -> 60 0 Position: 0.568675 0.173578 1.91622
IMG_3198.JPG 62 -> 61 0 Position: -0.681502 -0.0274086 1.87494
IMG_3199.JPG 65 -> 62 0 Position: -1.32193 -0.513084 1.44523
IMG_3200.JPG 68 -> 63 0 Position: -1.74884 -0.233343 1.00627
IMG_3201.JPG 64 -> 64 0 Position: 1.86615 -0.17015 0.804502
IMG_3202.JPG 67 -> 65 0 Position: 2.02134 0.00520135 -0.556621
IMG_3203.JPG 66 -> 66 0 Position: 1.66071 -0.422608 1.70771
IMG_3204.JPG 70 -> 67 0 Position: -0.0469477 -0.34337 2.35263
IMG_3205.JPG 71 -> 68 0 Position: -1.29148 -0.222989 2.00191
IMG_3206.JPG 74 -> 69 0 Position: -0.0463777 0.565541 2.32211
IMG_3207.JPG 75 -> 70 0 Position: 1.38704 0.369775 1.94309
IMG_3208.JPG 69 -> 71 0 Position: 2.40951 0.127066 0.556516
IMG_3209.JPG 73 -> 72 0 Position: 2.58436 -0.545839 1.7431
IMG_3210.JPG 76 -> 73 0 Position: 2.99488 0.231932 -1.2595
IMG_3211.JPG 72 -> 74 0 Position: 2.37329 -1.04808 1.80903
IMG_3212.JPG 81 -> 75 0 Position: 2.24534 0.17835 2.21718
IMG_3213.JPG 79 -> 76 0 Position: 0.198279 0.165949 3.10946
IMG_3214.JPG 77 -> 77 0 Position: -0.820161 -0.694361 2.92618
IMG_3215.JPG 78 -> 78 0 Position: 2.04264 -0.991337 2.92062
IMG_3216.JPG 84 -> 79 0 Position: 1.90179 -0.872609 3.38771
IMG_3217.JPG 82 -> 80 0 Position: 1.58835 0.27918 3.63485
IMG_3218.JPG 80 -> 81 0 Position: -0.248228 0.0619577 3.95284
IMG_3219.JPG 91 -> 82 0 Position: -1.12198 -0.701833 3.73063
IMG_3220.JPG 83 -> 83 0 Position: 3.45532 -0.377205 2.01011
IMG_3221.JPG 87 -> 84 0 Position: 4.01337 -0.0581364 -0.0796334
IMG_3222.JPG 86 -> 85 0 Position: 3.43061 0.0834168 -2.13259
IMG_3223.JPG 88 -> 86 0 Position: 2.00401 0.306856 -3.51632
IMG_3224.JPG 90 -> 87 0 Position: -0.804239 0.594517 -3.76472
IMG_3225.JPG 85 -> 88 0 Position: -0.981489 -1.12208 -3.57139
IMG_3226.JPG 89 -> 89 0 Position: -2.60022 -0.455816 -2.81094
IMG_3227.JPG 92 -> 90 0 Position: -2.88278 0.45049 -2.52193
IMG_3228.JPG 99 -> 91 0 Position: -3.7234 0.289773 -0.708272
IMG_3229.JPG 102 -> 92 0 Position: -3.39322 -0.326944 1.69969
IMG_3230.JPG 104 -> 93 0 Position: -2.3301 -0.304962 2.97787
IMG_3231.JPG 93 -> 94 0 Position: -0.46139 -0.942099 3.84172
IMG_3232.JPG 94 -> 95 0 Position: -0.737662 -1.00345 3.63189
IMG_3233.JPG 96 -> 96 0 Position: -0.557072 0.502447 3.76734
IMG_3234.JPG 106 -> 97 0 Position: -2.90301 -0.56731 2.45789
IMG_3235.JPG 98 -> 98 0 Position: -0.579748 -1.42758 3.29721
IMG_3236.JPG 95 -> 99 0 Position: -0.577174 -0.379586 3.54844
IMG_3237.JPG 97 -> 100 0 Position: -0.0801768 -1.9624 2.95499
IMG_3238.JPG 100 -> 101 0 Position: -0.0536503 -0.911851 3.43921
IMG_3239.JPG 103 -> 102 0 Position: 0.306203 -1.803 3.03705
IMG_3240.JPG 101 -> 103 0 Position: 0.315391 -0.353755 3.51598
IMG_3241.JPG 105 -> 104 0 Position: -1.51136 -0.26495 3.19468
IMG_3242.JPG 110 -> 105 0 Position: -3.32458 -0.0798645 1.3056
IMG_3243.JPG 114 -> 106 0 Position: -3.59386 0.0584838 -0.273204
IMG_3244.JPG 107 -> 107 0 Position: 1.58976 -0.519914 3.11205
IMG_3245.JPG 109 -> 108 0 Position: 1.81496 0.630129 2.9771
IMG_3246.JPG 125 -> 109 0 Position: 3.58685 -0.213295 0.248723
IMG_3247.JPG 108 -> 110 0 Position: 0.578744 -0.702924 3.54497
IMG_3248.JPG 111 -> 111 0 Position: -1.51073 -0.50643 3.28996
IMG_3249.JPG 161 -> 112 0 Position: -3.03582 -0.338988 2.03637
IMG_3250.JPG 119 -> 113 0 Position: -0.0891438 -0.95233 3.84892
IMG_3251.JPG 120 -> 114 0 Position: -2.42481 -0.551758 3.07371
IMG_3252.JPG 115 -> 115 0 Position: -3.44133 -0.26377 1.96637
IMG_3253.JPG 113 -> 116 0 Position: -3.81353 0.0840584 0.114018
IMG_3254.JPG 121 -> 117 0 Position: -3.80079 0.190982 -0.012798
IMG_3255.JPG 124 -> 118 0 Position: -3.08865 1.00493 -1.54941
IMG_3256.JPG 117 -> 119 0 Position: -1.97813 0.847976 -2.73495
IMG_3257.JPG 123 -> 120 0 Position: -3.12077 0.521545 -1.32637
IMG_3258.JPG 118 -> 121 0 Position: -3.32749 0.122532 -0.715027
IMG_3259.JPG 116 -> 122 0 Position: -3.20416 -0.348489 -1.07578
IMG_3260.JPG 126 -> 123 0 Position: -2.43969 -0.804677 -2.25519
IMG_3261.JPG 128 -> 124 0 Position: -1.3174 -0.434298 -3.15965
IMG_3262.JPG 122 -> 125 0 Position: -0.849994 -1.30582 -3.07265
IMG_3263.JPG 129 -> 126 0 Position: -0.885687 0.671677 -3.29061
IMG_3264.JPG 127 -> 127 0 Position: 0.365474 -0.413718 -3.43778
IMG_3265.JPG 132 -> 128 0 Position: 1.23839 1.08666 -3.22921
IMG_3266.JPG 131 -> 129 0 Position: 2.83986 0.00887473 -2.47471
IMG_3267.JPG 130 -> 130 0 Position: 3.03524 -0.799983 -2.07262
IMG_3268.JPG 134 -> 131 0 Position: 3.79573 -0.14781 0.358945
IMG_3269.JPG 140 -> 132 0 Position: 3.51369 -0.907138 1.35246
IMG_3270.JPG 135 -> 133 0 Position: 1.62936 -1.42592 3.18173
IMG_3271.JPG 136 -> 134 0 Position: -1.34075 -0.954256 3.42907
IMG_3272.JPG 133 -> 135 0 Position: -1.78598 0.0683145 3.36795
IMG_3273.JPG 137 -> 136 0 Position: -3.12549 -0.145547 2.23101
IMG_3274.JPG 138 -> 137 0 Position: -2.50854 -0.590182 2.52826
IMG_3275.JPG 139 -> 138 0 Position: -2.44068 0.406285 2.63433
IMG_3276.JPG 141 -> 139 0 Position: -2.61895 -0.47884 1.89863
IMG_3277.JPG 150 -> 140 0 Position: -0.918677 -0.535889 3.07764
IMG_3278.JPG 148 -> 141 0 Position: 1.09713 -0.501156 3.03876
IMG_3279.JPG 112 -> 142 0 Position: -2.15122 -0.520614 1.77558
IMG_3280.JPG 151 -> 143 0 Position: -2.25433 0.0936165 1.7139
IMG_3281.JPG 142 -> 144 0 Position: -2.8706 0.0356229 -0.35274
IMG_3282.JPG 143 -> 145 0 Position: -2.4946 0.166674 -1.52057
IMG_3283.JPG 149 -> 146 0 Position: -1.422 -0.208194 1.71032
IMG_3284.JPG 145 -> 147 0 Position: -2.16418 -0.0856412 0.663179
IMG_3285.JPG 144 -> 148 0 Position: -2.25847 0.0249366 -0.395638
IMG_3286.JPG 147 -> 149 0 Position: -1.98711 0.46558 0.968542
IMG_3287.JPG 160 -> 150 0 Position: -0.780502 0.538116 2.01135
IMG_3288.JPG 153 -> 151 0 Position: 0.69962 0.137278 2.09652
IMG_3289.JPG 156 -> 152 0 Position: -0.393177 -0.466306 1.63222
IMG_3290.JPG 152 -> 153 0 Position: -1.41748 -0.245603 1.01653
IMG_3291.JPG 146 -> 154 0 Position: -1.7934 -0.0421622 0.214654
IMG_3292.JPG 159 -> 155 0 Position: 0.986653 -0.228469 1.42069
IMG_3293.JPG 155 -> 156 0 Position: 1.50458 -0.180417 0.925178
IMG_3294.JPG 154 -> 157 0 Position: 0.627464 0.616862 1.51369
IMG_3295.JPG 158 -> 158 0 Position: -0.524347 -0.216598 1.63262
IMG_3296.JPG 157 -> 159 0 Position: 1.11296 -0.280754 1.37764
IMG_3297.JPG 162 -> 160 0 Position: -0.786466 -0.469594 1.51335
IMG_3298.JPG 163 -> 161 0 Position: -1.56089 -0.298944 0.81789
IMG_3299.JPG 171 -> 162 0 Position: -0.801103 -0.672253 1.43576
IMG_3300.JPG 167 -> 163 0 Position: 1.4354 -0.476129 0.947525
IMG_3301.JPG 165 -> 164 0 Position: 1.80069 -0.14865 0.143556
IMG_3302.JPG 173 -> 165 0 Position: 1.62079 -0.235785 1.60708
IMG_3303.JPG 164 -> 166 0 Position: 0.601838 -0.402867 2.13718
IMG_3304.JPG 168 -> 167 0 Position: -0.729843 -0.336501 2.08777
IMG_3305.JPG 166 -> 168 0 Position: -1.28517 -0.287689 1.80982
IMG_3306.JPG 172 -> 169 0 Position: 2.31573 -0.0237463 -0.472049
IMG_3307.JPG 170 -> 170 0 Position: 2.03769 0.0716046 -1.23635
IMG_3308.JPG 169 -> 171 0 Position: 2.10588 -0.304728 -1.05297
IMG_3309.JPG 174 -> 172 0 Position: 2.09343 0.255348 0.97111
IMG_3310.JPG 177 -> 173 0 Position: 0.757424 0.386501 2.11794
IMG_3311.JPG 179 -> 174 0 Position: 1.64078 -0.313315 1.89945
IMG_3312.JPG 184 -> 175 0 Position: 2.34001 -0.54194 2.5011
IMG_3313.JPG 176 -> 176 0 Position: 0.73436 -0.774305 3.25724
IMG_3314.JPG 178 -> 177 0 Position: 0.526748 -0.65837 3.5036
IMG_3315.JPG 180 -> 178 0 Position: 1.5262 0.718477 3.89047
IMG_3316.JPG 185 -> 179 0 Position: 3.78793 0.12256 2.04468
IMG_3317.JPG 181 -> 180 0 Position: 3.68765 -1.03554 1.99838
IMG_3319.JPG 175 -> 181 0 Position: 1.22199 -0.547814 4.36642
IMG_3320.JPG 187 -> 182 0 Position: 2.65601 -0.501892 3.7226
IMG_3321.JPG 183 -> 183 0 Position: 3.79009 -0.295224 2.64246
IMG_3322.JPG 182 -> 184 0 Position: 1.56691 1.42827 4.07817
IMG_3323.JPG 186 -> 185 0 Position: 1.32505 0.706109 4.32447
Num Point3D 68636
Assertion 'info.ExposureBiasValue == 0' failed!
File: /home/bart/projects/ADOP/src/apps/colmap2adop.cpp:44
Function: std::vector<float, std::allocator<float> > ExposureValuesFromImages(std::vector<std::__cxx11::basic_string<char> >, std::string)
Aborted (core dumped)
Any help would be appreciated.
Thank you,
Bart
Saiga::CUDA::CudaEvent::create() error after compiling
I managed to successfully compile ADOP. However, when trying to run the scene viewer, there is a Saiga::CUDA::CudaEvent::create() error, but with no interpretable error message. Do you have any ideas on how to resolve this?
Thank you!
/build/bin/adop_viewer --scene_dir scenes/tt_train
register neural render info
Git ref: 33bed24450829a7a87e98a8438141a21d2a19499
Ref.
=============== Saiga ===============
| Saiga Version 1.3.2 |
| Eigen Version 3.3.91 |
| Compiler GNU |
| -> Version 7.5.0 |
| Build Type RelWithDebInfo |
| Debug 0 |
| Eigen Debug 0 |
| ASAN 0 |
| Asserts 1 |
| Optimizations 0 |
=====================================
Initializing GLFW.
Initializing GLFW sucessfull!
Creating GLFW Window. 1920x1080 Mode=3 Fullscreen=1 Borderless=0
=========================== OpenGL ===========================
| OpenGL Version 4.5 (Core Profile) Mesa 21.0.3 |
| GLSL Version 4.50 |
| Renderer llvmpipe (LLVM 12.0.0, 256 bits) |
| Vendor Mesa/X.org |
==============================================================
[Renderer] Target resized to 1848x1016
loading shader /home/jack/Documents/ADOP/External/saiga/shader/imgui_gl.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/tone_map.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/tone_map_linear.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/compute/bloom_extract_bright.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/compute/bloom_downsample.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/compute/bloom_upsample.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/compute/bloom_combine_simple.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/compute/copy_image.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/compute/compute_blur.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/compute/compute_blur.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/lighting/light_directional.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/lighting/light_directional.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/lighting/light_point.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/lighting/light_point.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/lighting/light_spot.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/lighting/light_spot.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/lighting/light_point.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/lighting/light_spot.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/lighting/stenciltest.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/post_processing/post_processing.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/lighting/blitDepth.glsl
Deferred Renderer initialized. Render resolution: 1848x1016
loading shader /home/jack/Documents/ADOP/External/saiga/shader/post_processing/imagedisplay.glsl
Program Initialized!
Loading Scene scenes/tt_train
====================================
Scene Loaded
Name tt_train
Path /home/jack/Documents/ADOP/scenes/tt_train
Image Size 1920x1080
Aspect 1.77778
K 1159.63 1166.22 960 540 0
ocam 1920x1080 affine(1, 0, 0, 0, 0) cam2world() world2cam()
ocam cut 1
normalized center 0 0
dist -0.0634429 0.0416044 0 0 0 0 -0.000792661 -0.000517484
Points 11818812
Colors 1
Normals 1
Avg. EV -0.0733786
Num Images 301
Num Cameras 1
====================================
loading shader /home/jack/Documents/ADOP/External/saiga/shader/asset/ColoredAsset.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/asset/ColoredAsset.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/asset/ColoredAsset.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/asset/LineVertexColoredAsset.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/asset/LineVertexColoredAsset.glsl
loading shader /home/jack/Documents/ADOP/External/saiga/shader/asset/LineVertexColoredAsset.glsl
Assertion 'cudaEventCreate(&event) == cudaSuccess' failed!
File: /home/jack/Documents/ADOP/External/saiga/src/saiga/cuda/event.h:51
Function: void Saiga::CUDA::CudaEvent::create()
Message: unknown error
Aborted (core dumped)
Cannot run ADOP_TRAIN
When I started adop_train, the program reported the following error:
terminate called after throwing an instance of 'std::runtime_error'
what(): nvrtc: error: failed to open libnvrtc-builtins.so.11.2.
Make sure that libnvrtc-builtins.so.11.2 is installed correctly.
nvrtc comilation failed:
#define NAN __int_as_float(0x7fffffff)
......
libnvToolsExt.so.1: cannot open shared object file: No such file or directory
Even after adding the directory path to the LD_LIBRARY_PATH the error still persists.
Image to Point Cloud Alignment Dataset and Experiments
Thank you for the great project.
In the paper you mentioned the network has an application of Image to Point Cloud Alignment. Can you share the Dataset and Experiments of that part for evaluation?
PS:
There is a small typo, In Table II, NBPG should be NPBG.
In my opinion LiDaR usually write as lidar, LIDAR or LiDAR.
Assertion 'idx != i' failed!
i use COLMAPY autoreconstruction my scene and run colmap2adop tool,after a long time i got:
Loading initial PLY point cloud and preprocessing it (done only once)
Node Trans: 0 0 0 1(almost 5 hours for 102MB .ply file)
Starting Build KDTree... Done in 2582.41ms.
Starting RemoveLonelyPoints...Assertion 'idx != i' failed!
File: /home/lpa/ADOP/src/lib/data/SceneData.cpp:Assertion 'idx != i' failed!
File: /home/lpa/ADOP/src/lib/data/SceneData.cpp:552
Function: void SceneData::RemoveLonelyPoints(int, float)
Cmake runs to 100% but gets stuck on last file
Installation runs great up until the very end
[ 100%] Building CUDA object src/lib/CMakeFiles/NeuralPoints.dir/rendering/PointRenderer.cu.o
where it will hang for at least 3 hours. Making no progress but uses a single core at 100% using only a tiny fraction of ram and no swap. A100 gpu, 12 cpu cores, debain.
Anyone else had this issue?
Train on other dataset.
Thank you for the great project.
When I run adop_train with other data processed in adop data format, I get an error showing that (Note that my image data is PNG file format):
libpng error: Not a PNG file
Can anyone help me with this issue?
data download too slow...
Have other download link？
How can I get the 3-channel (RGB) picture of point-descriptors rasterizer result?
Hello, I want to get the RGB rendered picture of points descriptors rasterizer result. Can U tell me how to get it? Can I just map 8-channel descriptor to 3-channel colorplattes just like the visualization process in the semantic segmentation job?
Unable to get output in the neural view
Hello, thanks for releasing your code!
I tried running the program (the compilation was successful) but I am unable to obtain any output in the neural view.
This is the output I get from the terminal. I am using Ubuntu 20.04.3 LTS.
(base) jeremy@jeremy-ubuntu:~/Documents/ADOP$ ./build/bin/adop_viewer --scene_dir scenes/tt_lighthouse/
register neural render info
Ref.
=============== Saiga ===============
| Saiga Version 1.3.2 |
| Eigen Version 3.3.91 |
| Compiler GNU |
| -> Version 9.3.0 |
| Build Type RelWithDebInfo |
| Debug 0 |
| Eigen Debug 0 |
| ASAN 0 |
| Asserts 1 |
| Optimizations 0 |
=====================================
Initializing GLFW.
Initializing GLFW sucessfull!
Creating GLFW Window. 1920x1080 Mode=3 Fullscreen=1 Borderless=0
=========================== OpenGL ===========================
| OpenGL Version 3.2.0 NVIDIA 495.29.05 |
| GLSL Version 1.50 NVIDIA via Cg compiler |
| Renderer NVIDIA GeForce GTX 1660 SUPER/PCIe/SSE2 |
| Vendor NVIDIA Corporation |
==============================================================
[Renderer] Target resized to 1848x1016
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/imgui_gl.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/tone_map.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/tone_map_linear.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/compute/bloom_extract_bright.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/compute/bloom_downsample.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/compute/bloom_upsample.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/compute/bloom_combine_simple.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/compute/copy_image.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/compute/compute_blur.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/compute/compute_blur.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/lighting/light_directional.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/lighting/light_directional.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/lighting/light_point.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/lighting/light_point.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/lighting/light_spot.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/lighting/light_spot.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/lighting/light_point.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/lighting/light_spot.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/lighting/stenciltest.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/post_processing/post_processing.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/lighting/blitDepth.glsl
Deferred Renderer initialized. Render resolution: 1848x1016
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/post_processing/imagedisplay.glsl
Program Initialized!
Loading Scene scenes/tt_lighthouse/
====================================
Scene Loaded
Name tt_lighthouse
Path /home/jeremy/Documents/ADOP/scenes/tt_lighthouse
Image Size 2048x1080
Aspect 1.8963
K 1666.68 1661.18 1024 540 0
ocam 2048x1080 affine(1, 0, 0, 0, 0) cam2world() world2cam()
ocam cut 1
normalized center 0 0
dist -0.126731 0.0217503 0 0 0 0 0.000406465 0.000123456
Points 12313620
Colors 1
Normals 1
Num Images 309
Num Cameras 1
====================================
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/asset/ColoredAsset.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/asset/ColoredAsset.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/asset/ColoredAsset.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/asset/LineVertexColoredAsset.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/asset/LineVertexColoredAsset.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/asset/LineVertexColoredAsset.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/tone_map.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/tone_map_linear.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/compute/bloom_extract_bright.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/compute/bloom_downsample.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/compute/bloom_upsample.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/compute/bloom_combine_simple.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/compute/copy_image.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/compute/compute_blur.glsl
loading shader /home/jeremy/Documents/ADOP/External/saiga/shader/compute/compute_blur.glsl
Found experiment experiments//2021-10-30_09:17:38_multi_scene_pose/ with 1 epochs
Found experiment experiments//2021-10-30_09:14:22_boat/ with 1 epochs
loading checkpoint 2021-10-30_09:17:38_multi_scene_pose -> ep0400
Load Checkpoint render
Total Model Params: 574651
> Reset cuda cache
GPU memory - Point Cloud: 295.527MB
Pinhole Intrinsics:
Tensor [1, 13] float cuda:0 Min/Max -0.126731 1666.68 Mean 376.289 Sum 4891.75 req-grad 1
GPU memory - Texture: 197.018MB
Load Checkpoint points 12313620 max uv: 12313619
Load Checkpoint texture. Texels: 12313620 Channels: 4
Load Checkpoint pose
First pose before SE3(Quatwxyz(0.990142,-0.0887136,0.107975,0.00948205),Vec3(0.115149,0.198961,4.53537))
First pose after SE3(Quatwxyz(0.990146,-0.0887041,0.107948,0.00948975),Vec3(0.114891,0.198873,4.53539))
Load Checkpoint intrinsics
Load Checkpoint environment_map
Load Checkpoint vignette
Load Checkpoint response
Load Checkpoint exposures_values
Using Adam texture optimzier
optimizing texture with lr 0.08/0.004
optimizing environment_map with lr 0.02
optimizing response with lr 0.001
optimizing exposure with lr 0.0005
optimizing vignette with lr 5e-06
optimizing poses with lr 0.005
GPU memory - Texture: 197.018MB
Current Best (img,cam) = (0,0) EV: -0.239136
[Renderer] Target resized to 733x354
[DeferredRenderer] Resize 733x354
loading shader shader//point_render.glsl
[Renderer] Target resized to 545x249
[DeferredRenderer] Resize 545x249
loading checkpoint 2021-10-30_09:17:38_multi_scene_pose -> ep0400
Load Checkpoint render
Total Model Params: 574651
> Reset cuda cache
GPU memory - Point Cloud: 295.527MB
Pinhole Intrinsics:
Tensor [1, 13] float cuda:0 Min/Max -0.126731 1666.68 Mean 376.289 Sum 4891.75 req-grad 1
GPU memory - Texture: 197.018MB
Load Checkpoint points 12313620 max uv: 12313619
Load Checkpoint texture. Texels: 12313620 Channels: 4
Load Checkpoint pose
First pose before SE3(Quatwxyz(0.990146,-0.0887041,0.107948,0.00948975),Vec3(0.114891,0.198873,4.53539))
First pose after SE3(Quatwxyz(0.990146,-0.0887041,0.107948,0.00948975),Vec3(0.114891,0.198873,4.53539))
Load Checkpoint intrinsics
Load Checkpoint environment_map
Load Checkpoint vignette
Load Checkpoint response
Load Checkpoint exposures_values
Using Adam texture optimzier
optimizing texture with lr 0.08/0.004
optimizing environment_map with lr 0.02
optimizing response with lr 0.001
optimizing exposure with lr 0.0005
optimizing vignette with lr 5e-06
optimizing poses with lr 0.005
GPU memory - Texture: 197.018MB
Current Best (img,cam) = (0,0) EV: -0.239136
Any help would be greatly appreciated! Thank you!
unsupported GNU version! gcc versions later than 8 are not supported!
build follow src/README but error occured!
gcc=9.3,g++=9.3
ubuntu=20.04
can someone help me make this work on wsl 2? right now i am at 4. Build ADOP and i am failing at it. No CMAKE_CUDA_COMPILER could be found.
oh and btw a 3d model and texture exporter would be good
The output of eval_mask and Groundtruth is abnormal
Very high RAM usage, unable to proceed beyond 10 epochs on boat scene training
Hi,
I believe I may be seeing something similar to what another user has encountered. I can successfully build and run the viewer on the example boat scene but I wanted to try to run training myself.
System details:
- Ubuntu 20.04.3-LTS
- 128 GB RAM
- Nvidia 3090 RTX w/ 24GB VRAM
Below is a screenshot of nvidia-smi and top during epoch 9 just before it crashes. If I'm interpreting correctly, physical RAM usage is nearly at 128GB and a few moments after the screenshot was produced, the application was terminated. I'm not sure whether this indicates a memory leak in the program or whether there is a system setting that governs swap behavior.
Config file below.
[TrainParams]
random_seed = 3746934646
do_train = true
do_eval = true
batch_size = 2
inner_batch_size = 4
inner_sample_size = 3
num_epochs = 100
save_checkpoints_its = 100
eval_only_on_checkpoint = true
name = boat
debug = false
output_file_type = .jpg
split_method =
max_images = -1
duplicate_train_factor = 1
shuffle_initial_indices = false
shuffle_train_indices = true
split_remove_neighbors = 0
split_index_file_train =
split_index_file_test =
train_on_eval = true
train_factor = 0.0000000000
num_workers_train = 4
num_workers_eval = 2
train_crop_size = 256
train_mask_border = 16
reduced_check_point = false
write_images_at_checkpoint = false
keep_all_scenes_in_memory = false
use_image_masks = false
write_test_images = true
texture_random_init = true
texture_color_init = false
train_use_crop = true
experiment_dir = experiments/
scene_base_dir = scenes/
scene_names = boat
checkpoint_directory = default_checkpoint/
loss_vgg = 1.0000000000
loss_l1 = 1.0000000000
loss_mse = 0.0000000000
min_zoom = 0.7500000000
max_zoom = 1.5000000000
crop_prefere_border = true
optimize_eval_camera = false
interpolate_eval_settings = false
noise_pose_r = 0.0000000000
noise_pose_t = 0.0000000000
noise_intr_k = 0.0000000000
noise_intr_d = 0.0000000000
noise_point = 0.0000000000
point_duplicate_factor = 1
lr_decay_factor = 0.7500000000
lr_decay_patience = 10
lock_camera_params_epochs = 50
lock_structure_params_epochs = 50
[RenderParams]
render_outliers = false
check_normal = true
ghost_gradients = true
drop_out_points_by_radius = true
outlier_count = 1000000
drop_out_radius_threshold = 0.6000000238
dropout = 0.2500000000
depth_accept = 0.0099999998
test_backward_mode = 0
distortion_gradient_factor = 0.0099999998
K_gradient_factor = 0.5000000000
[PipelineParams]
train = true
verbose_eval = false
log_render = false
log_texture = true
skip_neural_render_network = false
enable_environment_map = true
env_map_w = 1024
env_map_h = 512
env_map_channels = 4
num_texture_channels = 4
cat_env_to_color = false
cat_masks_to_color = false
[OptimizerParams]
texture_optimizer = adam
fix_render_network = false
fix_texture = false
fix_environment_map = false
fix_points = true
fix_poses = false
fix_intrinsics = true
fix_vignette = false
fix_response = false
fix_wb = true
fix_exposure = true
fix_motion_blur = true
fix_rolling_shutter = true
lr_render_network = 0.0004000000
lr_texture = 0.0100000000
lr_background_color = 0.0002000000
lr_environment_map = 0.0020000000
lr_points = 0.0001000000
lr_poses = 0.0050000000
lr_intrinsics = 0.0100000000
response_smoothness = 1.0000000000
lr_vignette = 0.0000050000
lr_response = 0.0010000000
lr_wb = 0.0010000000
lr_exposure = 0.0005000000
lr_motion_blur = 0.0050000000
lr_rolling_shutter = 0.0000020000
[NeuralCameraParams]
enable_vignette = true
enable_exposure = true
enable_response = true
enable_white_balance = false
enable_motion_blur = false
enable_rolling_shutter = false
response_params = 25
response_gamma = 0.4545454681
response_leak_factor = 0.0099999998
[MultiScaleUnet2dParams]
num_input_layers = 4
num_input_channels = 4
num_output_channels = 3
feature_factor = 4
num_layers = 4
add_input_to_filters = false
channels_last = false
half_float = false
upsample_mode = bilinear
norm_layer_down = id
norm_layer_up = id
last_act =
conv_block = gated
conv_block_up = gated
pooling = average
Any help would be appreciated. Thank you!
Training stuck at 40% on epoch one
Hi,
I am running the training of Boat example on a 12G RTX3060LHR which is a rather low end card compare to the hardware the model been tested with.
I managed to run training without dump core but the it stuck at around 40% at epoch 1 without improvement.
Setting i tried:
Inner batch size : 4 or 8
Batch size: 2
Train crop size: 256 or 128
Google Colab
I would be very grateful if Colab Notebook were also made using this code
Can't complie install_pytorch on Manjaro
Hi.
I'm trying to get it to work on my Manjaro with freshly installed conda.
And when I try to ./install_pytorch.sh it doesn't compile and falls with an error
FAILED: caffe2/CMakeFiles/torch_cuda.dir/utils/torch_cuda_generated_math_gpu.cu.o
cd /run/media/metya/B634BE3A34BDFE05/Projects/ADOP/External/pytorch/build/caffe2/CMakeFiles/torch_cuda.dir/utils && /home/metya/.conda/envs/adop/bin/cmake -E make_directory /run/media/metya/B634BE3A34BDFE05/Projects/ADOP/External/pytorch/build/caffe2/CMakeFiles/torch_cuda.dir/utils/. && /home/metya/.conda/envs/adop/bin/cmake -D verbose:BOOL=OFF -D build_configuration:STRING=Release -D generated_file:STRING=/run/media/metya/B634BE3A34BDFE05/Projects/ADOP/External/pytorch/build/caffe2/CMakeFiles/torch_cuda.dir/utils/./torch_cuda_generated_math_gpu.cu.o -D generated_cubin_file:STRING=/run/media/metya/B634BE3A34BDFE05/Projects/ADOP/External/pytorch/build/caffe2/CMakeFiles/torch_cuda.dir/utils/./torch_cuda_generated_math_gpu.cu.o.cubin.txt -P /run/media/metya/B634BE3A34BDFE05/Projects/ADOP/External/pytorch/build/caffe2/CMakeFiles/torch_cuda.dir/utils/torch_cuda_generated_math_gpu.cu.o.Release.cmake
/home/metya/ADOP/External/pytorch/caffe2/utils/math_gpu.cu(149): warning: the "__visibility__" attribute can only appear on functions and variables with external linkage /home/metya/ADOP/External/pytorch/caffe2/utils/math_gpu.cu(200): warning: the "__visibility__" attribute can only appear on functions and variables with external linkage
/home/metya/ADOP/External/pytorch/caffe2/utils/math_gpu.cu(236): warning: the "__visibility__" attribute can only appear on functions and variables with external linkage
/home/metya/ADOP/External/pytorch/caffe2/utils/math_gpu.cu(908): error: namespace "thrust" has no member "host_vector"
/home/metya/ADOP/External/pytorch/caffe2/utils/math_gpu.cu(908): error: expected an expression
/home/metya/ADOP/External/pytorch/caffe2/utils/math_gpu.cu(909): error: namespace "thrust" has no member "host_vector"
/home/metya/ADOP/External/pytorch/caffe2/utils/math_gpu.cu(909): error: expected an expression
/home/metya/ADOP/External/pytorch/caffe2/utils/math_gpu.cu(910): error: namespace "thrust" has no member "host_vector"
/home/metya/ADOP/External/pytorch/caffe2/utils/math_gpu.cu(910): error: type name is not allowed
/home/metya/ADOP/External/pytorch/caffe2/utils/math_gpu.cu(910): error: expected an expression
/home/metya/ADOP/External/pytorch/caffe2/utils/math_gpu.cu(912): error: identifier "A_array" is undefined
/home/metya/ADOP/External/pytorch/caffe2/utils/math_gpu.cu(913): error: identifier "B_array" is undefined
/home/metya/ADOP/External/pytorch/caffe2/utils/math_gpu.cu(914): error: identifier "C_array" is undefined
/home/metya/ADOP/External/pytorch/caffe2/utils/math_gpu.cu(917): error: identifier "A_array" is undefined
/home/metya/ADOP/External/pytorch/caffe2/utils/math_gpu.cu(919): error: identifier "B_array" is undefined
/home/metya/ADOP/External/pytorch/caffe2/utils/math_gpu.cu(920): error: identifier "C_array" is undefined
/home/metya/ADOP/External/pytorch/caffe2/utils/math_gpu.cu(1763): warning: the "__visibility__" attribute can only appear on functions and variables with external linkage
/home/metya/ADOP/External/pytorch/caffe2/utils/math_gpu.cu(2234): warning: the "__visibility__" attribute can only appear on functions and variables with external linkage
/home/metya/ADOP/External/pytorch/caffe2/utils/math_gpu.cu(2282): warning: the "__visibility__" attribute can only appear on functions and variables with external linkage
/home/metya/ADOP/External/pytorch/caffe2/utils/math_gpu.cu(2846): warning: the "__visibility__" attribute can only appear on functions and variables with external linkage
13 errors detected in the compilation of "/home/metya/ADOP/External/pytorch/caffe2/utils/math_gpu.cu".
CMake Error at torch_cuda_generated_math_gpu.cu.o.Release.cmake:281 (message):
Error generating file
/home/metya/ADOP/External/pytorch/build/caffe2/CMakeFiles/torch_cuda.dir/utils/./torch_cuda_generated_math_gpu.cu.o
[5182/6125] Building NVCC (Device) object caffe2/CMakeFiles/torch_cuda.dir/__/aten/src/ATen/native/cuda/torch_cuda_generated_UniqueCub.cu.o
ninja: build stopped: subcommand failed.
Then I follow the instructions from here #6 like said @blurgyy, i.e. install cuda-11.1 from Aur and prepend it to CUDA_PATH in cuda.sh. And it didn't work again.
Complitations of install_pytorch.sh falling with the same error all the times.
I have Manjaro on 15.4.10 kernel
My conda env installed by instruction:
# packages in environment at /home/metya/.conda/envs/adop:
#
# Name Version Build Channel
_libgcc_mutex 0.1 main
_openmp_mutex 4.5 1_gnu
astunparse 1.6.3 py_0
blas 1.0 mkl
brotlipy 0.7.0 py39h27cfd23_1003
bzip2 1.0.8 h7b6447c_0
c-ares 1.17.1 h27cfd23_0
ca-certificates 2021.10.26 h06a4308_2
certifi 2021.10.8 py39h06a4308_0
cffi 1.14.6 py39h400218f_0
charset-normalizer 2.0.4 pyhd3eb1b0_0
cmake 3.19.6 h973ab73_0
cryptography 35.0.0 py39hd23ed53_0
cudatoolkit 11.2.72 h2bc3f7f_0 nvidia
cudatoolkit-dev 11.2.2 py39h3811e60_0 conda-forge
cudnn 8.2.1.32 h86fa8c9_0 conda-forge
dataclasses 0.8 pyh6d0b6a4_7
expat 2.4.1 h2531618_2
freeimage 3.17.0 0 conda-forge
future 0.18.2 py39h06a4308_1
idna 3.2 pyhd3eb1b0_0
intel-openmp 2021.4.0 h06a4308_3561
jpeg 9d h36c2ea0_0 conda-forge
krb5 1.19.2 hac12032_0
ld_impl_linux-64 2.35.1 h7274673_9
libcurl 7.78.0 h0b77cf5_0
libedit 3.1.20210910 h7f8727e_0
libev 4.33 h7f8727e_1
libffi 3.3 he6710b0_2
libgcc-ng 9.3.0 h5101ec6_17
libgomp 9.3.0 h5101ec6_17
libnghttp2 1.41.0 hf8bcb03_2
libssh2 1.9.0 h1ba5d50_1
libstdcxx-ng 9.3.0 hd4cf53a_17
libuv 1.40.0 h7b6447c_0
lz4-c 1.9.3 h295c915_1
magma-cuda110 2.5.2 1 pytorch
mkl 2021.4.0 h06a4308_640
mkl-include 2021.4.0 h06a4308_640
mkl-service 2.4.0 py39h7f8727e_0
mkl_fft 1.3.1 py39hd3c417c_0
mkl_random 1.2.2 py39h51133e4_0
ncurses 6.3 h7f8727e_2
ninja 1.10.2 py39hd09550d_3
numpy 1.21.2 py39h20f2e39_0
numpy-base 1.21.2 py39h79a1101_0
openssl 1.1.1l h7f8727e_0
pip 21.2.4 py39h06a4308_0
pybind11 2.6.2 py39hff7bd54_1
pycparser 2.21 pyhd3eb1b0_0
pyopenssl 21.0.0 pyhd3eb1b0_1
pysocks 1.7.1 py39h06a4308_0
python 3.9.7 h12debd9_1
python_abi 3.9 2_cp39 conda-forge
pyyaml 6.0 py39h7f8727e_1
readline 8.1 h27cfd23_0
requests 2.26.0 pyhd3eb1b0_0
rhash 1.4.1 h3c74f83_1
setuptools 58.0.4 py39h06a4308_0
six 1.16.0 pyhd3eb1b0_0
sqlite 3.36.0 hc218d9a_0
tk 8.6.11 h1ccaba5_0
typing_extensions 3.10.0.2 pyh06a4308_0
tzdata 2021e hda174b7_0
urllib3 1.26.7 pyhd3eb1b0_0
wheel 0.37.0 pyhd3eb1b0_1
xz 5.2.5 h7b6447c_0
yaml 0.2.5 h7b6447c_0
zlib 1.2.11 h7b6447c_3
zstd 1.4.9 haebb681_0
Switching to Neural View (F2) leads to crash
Switching to Neural View (F2) leads to crash on all scenes except of the boat scene:
(adop) creiser@creiser-home:~/ADOP$ ./build/bin/adop_viewer --scene_dir scenes/tt_lighthouse/
register neural render info
Ref.
=============== Saiga ===============
| Saiga Version 1.3.2 |
| Eigen Version 3.3.91 |
| Compiler GNU |
| -> Version 9.3.0 |
| Build Type RelWithDebInfo |
| Debug 0 |
| Eigen Debug 0 |
| ASAN 0 |
| Asserts 1 |
| Optimizations 0 |
=====================================
Initializing GLFW.
Initializing GLFW sucessfull!
Creating GLFW Window. 2560x1440 Mode=3 Fullscreen=1 Borderless=0
=========================== OpenGL ===========================
| OpenGL Version 3.2.0 NVIDIA 470.74 |
| GLSL Version 1.50 NVIDIA via Cg compiler |
| Renderer NVIDIA GeForce GTX 1080 Ti/PCIe/SSE2 |
| Vendor NVIDIA Corporation |
==============================================================
[Renderer] Target resized to 2488x1369
loading shader /home/creiser/ADOP/External/saiga/shader/imgui_gl.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/tone_map.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/tone_map_linear.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/compute/bloom_extract_bright.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/compute/bloom_downsample.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/compute/bloom_upsample.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/compute/bloom_combine_simple.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/compute/copy_image.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/compute/compute_blur.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/compute/compute_blur.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/lighting/light_directional.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/lighting/light_directional.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/lighting/light_point.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/lighting/light_point.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/lighting/light_spot.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/lighting/light_spot.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/lighting/light_point.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/lighting/light_spot.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/lighting/stenciltest.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/post_processing/post_processing.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/lighting/blitDepth.glsl
Deferred Renderer initialized. Render resolution: 2488x1369
loading shader /home/creiser/ADOP/External/saiga/shader/post_processing/imagedisplay.glsl
Program Initialized!
Loading Scene scenes/tt_lighthouse/
====================================
Scene Loaded
Name
Path scenes/tt_lighthouse/
Image Size 2048x1080
Aspect 1.8963
K 1666.68 1661.18 1024 540 0
ocam 2048x1080 affine(1, 0, 0, 0, 0) cam2world() world2cam()
ocam cut 1
normalized center 0 0
dist -0.126731 0.0217503 0 0 0 0 0.000406465 0.000123456
Points 12313620
Colors 12313620
Num Images 309
Num Cameras 1
====================================
loading shader /home/creiser/ADOP/External/saiga/shader/asset/ColoredAsset.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/asset/ColoredAsset.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/asset/ColoredAsset.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/asset/LineVertexColoredAsset.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/asset/LineVertexColoredAsset.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/asset/LineVertexColoredAsset.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/tone_map.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/tone_map_linear.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/compute/bloom_extract_bright.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/compute/bloom_downsample.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/compute/bloom_upsample.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/compute/bloom_combine_simple.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/compute/copy_image.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/compute/compute_blur.glsl
loading shader /home/creiser/ADOP/External/saiga/shader/compute/compute_blur.glsl
Found experiment experiments//2021-10-30_09:17:38_multi_scene_pose/ with 1 epochs
Found experiment experiments//2021-10-30_09:14:22_boat/ with 1 epochs
[Renderer] Target resized to 2004x1030
[DeferredRenderer] Resize 2004x1030
loading shader shader//point_render.glsl
terminate called after throwing an instance of 'c10::Error'
what(): Accessing empty ModuleHolder
Exception raised from get at /home/creiser/miniconda3/envs/adop/lib/python3.9/site-packages/torch/include/torch/csrc/api/include/torch/nn/pimpl.h:108 (most recent call first):
frame #0: c10::Error::Error(c10::SourceLocation, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >) + 0x6c (0x7f610508f7ac in /home/creiser/miniconda3/envs/adop/lib/python3.9/site-packages/torch/lib/libc10.so)
frame #1: c10::detail::torchCheckFail(char const*, char const*, unsigned int, char const*) + 0xf5 (0x7f610505b9b1 in /home/creiser/miniconda3/envs/adop/lib/python3.9/site-packages/torch/lib/libc10.so)
frame #2: RealTimeRenderer::Render(ImageInfo) + 0x143d (0x7f612669bd1d in /home/creiser/ADOP/build/bin/libNeuralPoints.so)
frame #3: <unknown function> + 0x1d847 (0x55fbca82d847 in ./build/bin/adop_viewer)
frame #4: Saiga::DeferredRenderer::renderGL(Saiga::Framebuffer*, Saiga::ViewPort, Saiga::Camera*) + 0xaf5 (0x7f6126322575 in /home/creiser/ADOP/build/External/saiga/lib/libsaiga_opengl.so)
frame #5: Saiga::OpenGLRenderer::render(Saiga::RenderInfo const&) + 0x150 (0x7f612636b430 in /home/creiser/ADOP/build/External/saiga/lib/libsaiga_opengl.so)
frame #6: Saiga::WindowBase::render() + 0x4c (0x7f612577c19c in /home/creiser/ADOP/build/External/saiga/lib/libsaiga_core.so)
frame #7: Saiga::MainLoop::render(float, float) + 0x7a (0x7f612577a87a in /home/creiser/ADOP/build/External/saiga/lib/libsaiga_core.so)
frame #8: Saiga::MainLoop::startMainLoop(Saiga::MainLoopParameters) + 0x25c (0x7f612577ac5c in /home/creiser/ADOP/build/External/saiga/lib/libsaiga_core.so)
frame #9: Saiga::WindowBase::startMainLoop(Saiga::MainLoopParameters) + 0x2b (0x7f612577c5cb in /home/creiser/ADOP/build/External/saiga/lib/libsaiga_core.so)
frame #10: <unknown function> + 0x1945c (0x55fbca82945c in ./build/bin/adop_viewer)
frame #11: __libc_start_main + 0xf3 (0x7f6104ce80b3 in /lib/x86_64-linux-gnu/libc.so.6)
frame #12: <unknown function> + 0x1986e (0x55fbca82986e in ./build/bin/adop_viewer)
Aborted (core dumped)
can this tool export the mesh and textures?
Video rendering throw error when the image dimension is odd!
video rendering show the below error when one of image dimension is odd (render_scale is 1.0)
RAM usage when training dataset
Through a lot of trial and error I managed to get both the ADOP viewer and trainer set up on Ubuntu 20.04.
SETUP
I'm trying to run my own dataset through the trainer to see how it is. I only have an Nvidia GTX 1070 card with 8GB of VRAM, 16GB of physical RAM but plenty of hard disk space. I've gotten to the point that the trainer runs without crashing. My dataset is 175 images, downscaled to 1000x562, converted from a ~7M point-cloud project in COLMAP.
PROBLEM
However, running the trainer seems to take up over 1GB per epoch on top of the base amount. This quickly sends my RAM usage to
near full. Luckily I have a large swap partition but that too fills up over hundreds of epochs. Is this expected behaviour or a memory leak? Or could it be because my install or conda environment might be faulty? Or is it my incapable hardware? In any case, once all my swap space gets filled the program is unfortunately killed on its own.
If tweaking any of the training config or dataset parameters could potentially fix or mitigate this issue, please do let me know. Thank you for your work on this, I find this to be a very interesting project.
Question regarding the high level mechanics of ADOP
Hi Darius, very impressive work!
I'd like to understand better where this fits in in the overall landscape and therefore have some questions:
a) The way I understand it ADOP needs to be trained individually per dataset, correct? If so, how long does such training take, roughly, as a function of # of input points or images?
b) Once trained how large (GBs) will the resulting trained model, descriptors etc. be?
c) If novel views are desired, does each novel view have to be pre-specified at training-time? Or can novel views be synthesized on-the-fly based on user input/navigation and the trained model?
Again, great work and super exciting stuff!
Kind regards
Render PNGs with headless build
Hi thanks for the awesome work. I was able to render very realistic scenes using my own captured data.
I have a question regarding rendering the video (PNG sequences). Is it possible to render a video interpolating between all captured (colmap) camera poses on a GPU server (with headless build)? For example NeRF and similar work would render such a video with the camera moving across all captured colmap poses, the video is very helpful for debugging/parameter tuning purposes.
I understand the current viewer is awesome with free view and mouse/keyboard control, but it would be great if you could show how to render the above video as it helps in batch processing a lot of scenes where interactive viewer does not scale.
Thank you very much!
Encouragement to publish the code for public review
Hi, I'm a reader from arxiv. Arxiv lists this repo as replication code for the paper. But there is no code.
One way to fix that is to remove the repo from the arxiv listing. When you share the replication code, you would link the repo back to the paper.
However, I would encourage you to share the code as is!
Pros:
- Supports open & replicable science.
- Allows arxiv members to run tests and send PRs.
- PR contributors don't need credit in the paper, since they get credit in the repo.
Cons:
- Public PRs can be low quality.
- PR reviews require time and effort.
- A competitor could plagiarize your code? (Is this a concern?)
A question about CmakeList.txt
Hello, I am a beginner of neural network. I want to run your program on my computer, but when I Compiling ADOP,in the command "cmake -DCMAKE_PREFIX_PATH="${CONDA}/lib/python3.8/site-packages/torch/;${CONDA}" ..",there was an error,it was "The source directory XXXXdoes not appear to contain CMakeLists.txt."How can i solve this problem?Should i write the CmakeList on myself ?Is there sth wrong in other parts ?this may easy for most people,but i sincerely hope you can answer me,thank you!
Error with submodules
How to reproduce:
$ git submodule update --init --recursive --jobs 0
fatal: remote error: upload-pack: not our ref 5de5a4409794620035dfc27128daf2c6aa915f18
Fetched in submodule path 'External/saiga', but it did not contain 5de5a4409794620035dfc27128daf2c6aa915f18. Direct fetching of that commit failed.
Guide on exporting scene from COLMAP
Hi! I have some troubles exporting point cloud from COLMAP to compatible with ADOP format.
Here is what I did:
- Autoreconstruction in COLMAP (both sparse and dense)
- File > Export As > as .ply
- preprocessed it with colmap2adop tool
- started training
- got an error that my point cloud file does not contain normal data
- I checked that your .ply files have normal data in headers, but I struggle to make COLMAP include it in mine
Can not show any result.
i run ./build/bin/adop_viewer --scene_dir /media/xgenie/新加卷/docker/scenes/boat but can not show any result.
The output like this:
register neural render info
Ref.
=============== Saiga ===============
| Saiga Version 1.3.2 |
| Eigen Version 3.4.0 |
| Compiler GNU |
| -> Version 7.5.0 |
| Build Type RelWithDebInfo |
| Debug 0 |
| Eigen Debug 0 |
| ASAN 0 |
| Asserts 1 |
| Optimizations 0 |
=====================================
Initializing GLFW.
Initializing GLFW sucessfull!
Creating GLFW Window. 1920x1080 Mode=3 Fullscreen=1 Borderless=0
=========================== OpenGL ===========================
| OpenGL Version 3.3 (Core Profile) Mesa 20.0.8 |
| GLSL Version 3.30 |
| Renderer llvmpipe (LLVM 10.0.0, 256 bits) |
| Vendor VMware, Inc. |
==============================================================
Initializing FFMPEG... done
[Renderer] Target resized to 1853x1025
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/imgui_gl.glsl
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/tone_map.glsl
GL ERROR : [ID,type,source,severity] [1,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL ERROR : [ID,type,source,severity] [2,Error,Shader Compiler,High]
Message : [0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10]
GL_COMPUTE_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/tone_map_linear.glsl
GL ERROR : [ID,type,source,severity] [3,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL ERROR : [ID,type,source,severity] [4,Error,Shader Compiler,High]
Message : [0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10]
GL_COMPUTE_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/compute/bloom_extract_bright.glsl
GL ERROR : [ID,type,source,severity] [5,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL ERROR : [ID,type,source,severity] [6,Error,Shader Compiler,High]
Message : [0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10]
GL_COMPUTE_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/compute/bloom_downsample.glsl
GL ERROR : [ID,type,source,severity] [7,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL ERROR : [ID,type,source,severity] [8,Error,Shader Compiler,High]
Message : [0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10]
GL_COMPUTE_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/compute/bloom_upsample.glsl
GL ERROR : [ID,type,source,severity] [9,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL ERROR : [ID,type,source,severity] [10,Error,Shader Compiler,High]
Message : [0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10]
GL_COMPUTE_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/compute/bloom_combine_simple.glsl
GL ERROR : [ID,type,source,severity] [11,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL ERROR : [ID,type,source,severity] [12,Error,Shader Compiler,High]
Message : [0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10]
GL_COMPUTE_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/compute/copy_image.glsl
GL ERROR : [ID,type,source,severity] [13,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL ERROR : [ID,type,source,severity] [14,Error,Shader Compiler,High]
Message : [0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10]
GL_COMPUTE_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/compute/compute_blur.glsl
GL ERROR : [ID,type,source,severity] [15,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL ERROR : [ID,type,source,severity] [16,Error,Shader Compiler,High]
Message : [0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10]
GL_COMPUTE_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/compute/compute_blur.glsl
GL ERROR : [ID,type,source,severity] [17,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL ERROR : [ID,type,source,severity] [18,Error,Shader Compiler,High]
Message : [0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10]
GL_COMPUTE_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/lighting/light_directional.glsl
GL ERROR : [ID,type,source,severity] [19,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL_FRAGMENT_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/lighting/light_directional.glsl
GL ERROR : [ID,type,source,severity] [20,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL_FRAGMENT_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/lighting/light_point.glsl
GL ERROR : [ID,type,source,severity] [21,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL_FRAGMENT_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/lighting/light_point.glsl
GL ERROR : [ID,type,source,severity] [22,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL_FRAGMENT_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/lighting/light_spot.glsl
GL ERROR : [ID,type,source,severity] [23,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL_FRAGMENT_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/lighting/light_spot.glsl
GL ERROR : [ID,type,source,severity] [24,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL_FRAGMENT_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/lighting/light_point.glsl
GL ERROR : [ID,type,source,severity] [25,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL_FRAGMENT_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/lighting/light_spot.glsl
GL ERROR : [ID,type,source,severity] [26,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL_FRAGMENT_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/lighting/stenciltest.glsl
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/post_processing/post_processing.glsl
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/lighting/blitDepth.glsl
Deferred Renderer initialized. Render resolution: 1853x1025
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/post_processing/imagedisplay.glsl
Program Initialized!
Loading Scene /media/xgenie/新加卷/docker/scenes/boat
====================================
Scene Loaded
Name boat
Path /media/xgenie/新加卷/docker/scenes/boat
Image Size 2880x1920
Aspect 1.5
K 2772.2 2775.23 1435.08 944.767 0
ocam 2880x1920 affine(1, 0, 0, 0, 0) cam2world() world2cam()
ocam cut 1
normalized center -0.00170931 -0.00793403
dist -0.0756776 0.0746716 0 0 0 0 -0.000658676 -0.00050782
Points 53036216
Colors 53036216
Num Images 742
Num Cameras 1
====================================
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/asset/ColoredAsset.glsl
GL ERROR : [ID,type,source,severity] [27,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL_FRAGMENT_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/asset/ColoredAsset.glsl
GL ERROR : [ID,type,source,severity] [28,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL_FRAGMENT_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/asset/ColoredAsset.glsl
GL ERROR : [ID,type,source,severity] [29,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL_FRAGMENT_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/asset/LineVertexColoredAsset.glsl
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/asset/LineVertexColoredAsset.glsl
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/asset/LineVertexColoredAsset.glsl
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/tone_map.glsl
GL ERROR : [ID,type,source,severity] [30,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL ERROR : [ID,type,source,severity] [31,Error,Shader Compiler,High]
Message : [0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10]
GL_COMPUTE_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/tone_map_linear.glsl
GL ERROR : [ID,type,source,severity] [32,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL ERROR : [ID,type,source,severity] [33,Error,Shader Compiler,High]
Message : [0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10]
GL_COMPUTE_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/compute/bloom_extract_bright.glsl
GL ERROR : [ID,type,source,severity] [34,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL ERROR : [ID,type,source,severity] [35,Error,Shader Compiler,High]
Message : [0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10]
GL_COMPUTE_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/compute/bloom_downsample.glsl
GL ERROR : [ID,type,source,severity] [36,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL ERROR : [ID,type,source,severity] [37,Error,Shader Compiler,High]
Message : [0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10]
GL_COMPUTE_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/compute/bloom_upsample.glsl
GL ERROR : [ID,type,source,severity] [38,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL ERROR : [ID,type,source,severity] [39,Error,Shader Compiler,High]
Message : [0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10]
GL_COMPUTE_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/compute/bloom_combine_simple.glsl
GL ERROR : [ID,type,source,severity] [40,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL ERROR : [ID,type,source,severity] [41,Error,Shader Compiler,High]
Message : [0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10]
GL_COMPUTE_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/compute/copy_image.glsl
GL ERROR : [ID,type,source,severity] [42,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL ERROR : [ID,type,source,severity] [43,Error,Shader Compiler,High]
Message : [0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10]
GL_COMPUTE_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/compute/compute_blur.glsl
GL ERROR : [ID,type,source,severity] [44,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL ERROR : [ID,type,source,severity] [45,Error,Shader Compiler,High]
Message : [0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10]
GL_COMPUTE_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/compute/compute_blur.glsl
GL ERROR : [ID,type,source,severity] [46,Error,Shader Compiler,High]
Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES]
GL ERROR : [ID,type,source,severity] [47,Error,Shader Compiler,High]
Message : [0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10]
GL_COMPUTE_SHADER info log:
0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES
0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10
Found experiment experiments//2021-10-30_09:17:38_multi_scene_pose/ with 1 epochs
Found experiment experiments//2021-10-30_09:14:22_boat/ with 1 epochs
loading checkpoint 2021-10-30_09:14:22_boat -> ep0600
Load Checkpoint render
Total Model Params: 574651
> Reset cuda cache
GPU memory - Point Cloud: 1272.87MB
Pinhole Intrinsics:
Tensor [1, 13] float cuda:0 Min/Max -0.0756776 2775.23 Mean 609.79 Sum 7927.27 req-grad 1
GPU memory - Texture: 848.579MB
Load Checkpoint points 53036216 max uv: 53036215
Load Checkpoint texture. Texels: 53036216 Channels: 4
Load Checkpoint pose
First pose before SE3(Quatwxyz(0.62515,-0.0614666,-0.771622,-0.100041),Vec3(2.91385,-0.583296,3.46712))
First pose after SE3(Quatwxyz(0.625108,-0.0614356,-0.771651,-0.100102),Vec3(2.91339,-0.583797,3.46737))
Load Checkpoint intrinsics
Load Checkpoint environment_map
Load Checkpoint vignette
Load Checkpoint response
Load Checkpoint exposures_values
Using Adam texture optimzier
optimizing texture with lr 0.01/0.0002
optimizing environment_map with lr 0.002
optimizing response with lr 0.001
optimizing vignette with lr 5e-06
optimizing poses with lr 0.005
Assertion 'cudaGraphicsGLRegisterImage(&graphic_resource, gl_buffer, gl_target, cudaGraphicsRegisterFlagsSurfaceLoadStore) == cudaSuccess' failed!
File: /home/xgenie/projectfold/ADOP/External/saiga/src/saiga/cuda/interop.h:73
Function: void Saiga::CUDA::Interop::initImage(unsigned int, gl::GLenum)
Message: unknown error
Maybe the problem is
loading shader /home/xgenie/projectfold/ADOP/External/saiga/shader/compute/bloom_upsample.glsl GL ERROR : [ID,type,source,severity] [38,Error,Shader Compiler,High] Message : [0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES] GL ERROR : [ID,type,source,severity] [39,Error,Shader Compiler,High] Message : [0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10] GL_COMPUTE_SHADER info log: 0:1(10): error: GLSL 4.30 is not supported. Supported versions are: 1.10, 1.20, 1.30, 1.40, 1.50, 3.30, 1.00 ES, and 3.00 ES 0:0(0): error: Compute shaders require GLSL 4.30 or GLSL ES 3.10
How to compile ADOP for an specific CUDA ARCH
First I would like to thank you for your greate work and making it public!
I have already build and run it sucessfully in my own machine and it works fine.
And I want to build a version to support both NVIDIA Tesla T4 (sm_75) and Tesla V100 (sm_70) to train adop. I wonder how to compile a version to support both sm_75 and sm_70. Or how to compile a version to support sm_70 on a sm_75 device?
adop_viewer exists with an error when starting nural view.
After successfully compiling and running the demo with the provided pre-trained models adop_viewer shows the point cloud rendering of the examples just fine. But when trying to switch to neural view it halts and exits with an error message. I have attached the screenshot of the error message below.
Error caused by libtorchvision.so while building ADOP
Hi:
I am trying to build ADOP. An error about libtorchvision.so was reported after command:
make -j10
The output:
[ 15%] Building CXX object External/torchvision/CMakeFiles/torchvision.dir/torchvision/csrc/vision.cpp.o
[ 15%] Linking CXX shared library libtorchvision.so
[ 15%] Built target torchvision
Makefile:170: recipe for target 'all' failed
It seems like the libtorchvision.so doesnt exit.
Ignoring the error above, another similar came out:
[ 46%] Built target assimp
[ 51%] Built target torchvision
[ 51%] Linking CXX static library ../../../../../lib/libgmock_main.a
[ 51%] Built target gmock_main
Makefile:170: recipe for target 'all' failed
make: *** [all] Error 2
Any help would be appreciated, thanks.
adop_viewer exists with an error when starting recording
Running only on point cloud
The adop_viewer has not generated
Have anyone encountered this situation?
By the way, I already installed the xorg-dev as the README.md show.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.