Git Product home page Git Product logo

Comments (7)

onpix avatar onpix commented on August 27, 2024

Yeah, I use colmap. Please note that the camera poses from colmap are not GT and you may need to tune the colmap and image settings to get good colmap results, as SFM in low-light conditions remains a problem.

from llnerf.

Haru2022 avatar Haru2022 commented on August 27, 2024

Thanks for you response. Do you enlight the raw low-light image first and then implement colmap for the camera pose estimation?

from llnerf.

onpix avatar onpix commented on August 27, 2024

My solution is to export both RAW and jpeg outputs produced by the camera. The RAW output is not processed and will be processed by the simple ISP of rawpy to generate low-quality inputs for the NeRF. The jpegs - usually already processed by the camera, typically have minimal noise and is well-lit, which is used as input of colmap to get camera poses.

from llnerf.

Haru2022 avatar Haru2022 commented on August 27, 2024

many thanks! I tried to collect my own dataset and found that the colmap result based on the output of D455 color camera is very unsatisfying. Maybe I should further fine-tune the colmap parameters for a good result according to your suggestions. Thanks again.

from llnerf.

Haru2022 avatar Haru2022 commented on August 27, 2024

Hello, may I ask how do you generate the jpegs for estimating the camera poses in detail? Cuz I find that using the low-light images you provide cannot generate good poses in some scene (like still2, white chair) with few feature points.
You said that the jpegs is proceesed by the camera, does it means the jpegs are automatically processed by the camera without any post-processing using your own program? Or did you design some simple post-processing program to process the raw images to make them have minimal noise and be well-lit as you said before?
Looking forward to your response very much! Thanks!

from llnerf.

onpix avatar onpix commented on August 27, 2024

For example, I use my mobile phone to capture images while turning RAW mode on, so it will produce:

  1. RAW images, which will be processed by rawpy to generate low-quality training images
  2. and JPGs for running colmap, which are already processed by the camera ISP of the phone, typically including denoise, auto white balance, and other enhancement methods. Thus the quality is relatively high and can be used for getting camera poses.

from llnerf.

Haru2022 avatar Haru2022 commented on August 27, 2024

Got it. Thank you.

from llnerf.

Related Issues (17)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.