Comments (2)
Hi David, thanks for the response! I really appreciate it!
It took a while for me to look at the example_co3d_challenge_submission.py
and see how the query image is rendered and pasted onto the original image.
Some notes in case it may be helpful for future readers:
- When we are loading pytorch3d cameras and cropped images with the training data loader, the cameras intrinsic parameters are adjusted according to the object bounding box detected from the foreground mask.
- When we load the
fewview_dev/fewvew_test
sets, the query image is not given; thus, we are given unadjusted intrinsic parameters. This may result in different focal length than we are used to seeing for views with box crop.
from co3d.
Hi, the focal lengths within a scene are different because we let COLMAP to extract an image-specific (as opposed to a camera-specific) focal length. The main reason is that the consumer smartphones used to capture the videos often automatically change focus during the capture, which effectively leads to a varying focal length of the video frames.
In terms of example_co3d_challenge_submission.py
, we did several unit tests that ensure that the focal length is correctly adjusted when cropping the image around a segmentation mask. The algorithm does not handle samples from different sets (fewview_dev/fewvew_test
) differently so there should not be an issue.
Please note that, for the test
subset (i.e. fewvew_test/manyview_test
), all depth maps and all test images are redacted (i.e. these are blank black images). Hence, example_co3d_challenge_submission.py
produces non-sensical results for fewvew_test/manyview_test
since the DBIR renderer generates an invalid point cloud from the redacted depth maps of the source views.
from co3d.
Related Issues (20)
- Pytorch independent usage convention HOT 2
- Is it possible to download only one category? HOT 2
- Camera Position Plots Don't Seem to Match Expected Circular Motion HOT 3
- Missing depth information for apple HOT 1
- Difference between v1 and v2 HOT 1
- How to only get 3d point Cloud? HOT 1
- Camera Intrinsic parameter HOT 2
- Filter accurate pointclouds HOT 6
- CO3D Depth Unit HOT 1
- Confusion about the camera extrinsics HOT 2
- How can i get distortion coefficient? HOT 1
- Dataset index sequence_frames_in_order HOT 3
- Co3D depth warping HOT 1
- Contents of Single-Sequence Subset Compared to Full Dataset
- Generating camera poses using Colmap
- Format of camera poses listed in frame_annotations.jgz HOT 1
- Scale in co3d annotation file HOT 1
- Predicted camera poses evaluation HOT 2
- How to compute the rescale_factor when we zero-centered every point ?
- dataset/links.txt
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from co3d.