Comments (3)
Thank @JiamingSuen @zehongs for your quick and detailed response. I'm gonna have a look at GIFT and LISRD.
I have checked GIFT, it outperformed Superpoint all the cases I tested.
from loftr.
Hi, I believe the reason is that we didn't train LoFTR with pairs that exhibit extreme rotation. We only downsampled the image pairs from MegaDepth and ScanNet, and the purpose of which was to reduce GPU memory.
By the way, for matching pairs with extreme rotation and scaling, you can refer to our Neurips'19 work GIFT.
from loftr.
Hi, I believe the reason is that we didn't train LoFTR with pairs that exhibit extreme rotation. We only downsampled the image pairs from MegaDepth and ScanNet, and the purpose of which was to reduce GPU memory.
By the way, for matching pairs with extreme rotation and scaling, you can refer to our Neurips'19 work GIFT.
In addition to Zehong's reply, I would like to point out that LoFTR (and SuperGlue) learns the matching priors (i.e., the distribution of matches between the image pair) from the training data, which means that it can only handle rotations exhibited in the training set. In most real-world scenarios like in ScanNet and MegaDepth, there won't be many extreme rotation variations like the image pair given (over 90 degrees). With that being said, handling extreme rotation changes is indeed another interesting research topic beyond the major focus of LoFTR. We recommend you to check out our work GIFT and more recent work LISRD for this purpose.
from loftr.
Related Issues (20)
- Code about Visual Localization
- training of smaller model
- Tensorboard visualization - are the indices correct?
- About train with fp16
- About the dataset indices of Megadepth HOT 2
- How to train the model for HPatches
- train model for image matching
- training on custom dataset HOT 4
- Can the model be limited to detecting key points in a region of interest?
- h5py can't read data
- meet an error when training loftr: EOFError: Ran out of input HOT 3
- image size
- Bug found in supervision process
- main_cfg problem
- How to train LoFTR on custom dataset?
- megadepth_indices下载不下来 HOT 1
- How to get image feature maps from the pretrained model?
- My dataset is only RGB, can I use it for training?
- ScanNet Training Pairs
- File "h5py\h5f.pyx", line 96, in h5py.h5f.open OSError: Unable to open file
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from loftr.