Git Product home page Git Product logo

awesome-deep-camera-calibration's Introduction

Awesome-Deep-Camera-Calibration

arXiv Survey Maintenance PR's Welcome GitHub license

Deep Learning for Camera Calibration: A Survey

This repository provides：

1) a unified online platform 2) a new dataset 3) collects deep learning-based camera calibration methods, datasets, and evaluation metrics.

More content and details can be found in our Survey Paper: Deep Learning for Camera Calibration: A Survey.

📣News

  1. The survey is submitted.

🌱Contents

  1. Basics
  2. Methods
  3. Datasets
  4. Metrics
  5. Citation

📋Basics

📋Methods

Overview

Year Publication Title Abbreviation Objective Platform Network
2015 ICIP Deepfocal: A method for direct focal length estimation DeepFocal Intrinsics Caffe AlexNet
2015 ICCV Posenet: A convolutional network for real-time 6-dof camera relocalization PoseNet Extrinsics Caffe GoogLeNet
2016 BMVC Horizon lines in the wild DeepHorizon Extrinsics Caffe GoogLeNet
2016 CVPR Detecting vanishing points using global image context in a non-manhattan world DeepVP Extrinsics Caffe AlexNet
2016 ACCV Radial lens distortion correction using convolutional neural networks trained with synthesized images Rong et al. Distortion coefficients Caffe AlexNet
2016 RSSW Deep image homography estimation DHN Projection matrixs Caffe VGG
2017 CVPR Clkn: Cascaded lucas-kanade networks for image alignment CLKN Projection matrixs Torch CNN + Lucas-Kanade layer
2017 ICCVW Homography estimation from image pairs with hierarchical convolutional networks HierarchicalNet Projection matrixs TensorFlow VGG
2018 CVPR A perceptual measure for deep single image camera calibration Hold-Geoffroy et al. Intrinsics + Extrinsics DenseNet
2018 CVMP DeepCalib: a deep learning approach for automatic intrinsic calibration of wide field-of-view cameras DeepCalib Intrinsics + Distortion coefficients TensorFlow Inception-V3
2018 ECCV Fisheyerecnet: A multi-context collaborative deep network for fisheye image rectification FishEyeRecNet Distortion coefficients Caffe VGG
2018 ICPR Radial lens distortion correction by adding a weight layer with inverted foveal models to convolutional neural networks Shi et al. Distortion coefficients PyTorch ResNet
2018 ECCV Deep fundamental matrix estimation DeepFM Projection matrixs PyTorch ResNet
2018 ECCVW Deep fundamental matrix estimation without correspondences Poursaeed et al. Projection matrixs CNNs
2018 RAL Unsupervised deep homography: A fast and robust homography estimation model UDHN Projection matrixs TensorFlow VGG
2018 ACCV Rethinking planar homography estimation using perspective fields PFNet Projection matrixs TensorFlow FCN
2019 CVPR Deep single image camera calibration with radial distortion Lopez et al. Intrinsics + Extrinsics + Distortion coefficients PyTorch DenseNet
2019 ICCV UprightNet: geometry-aware camera orientation estimation from single images UprightNet Extrinsics PyTorch U-Net
2019 IROS Degeneracy in self-calibration revisited and a deep learning solution for uncalibrated slam Zhuang et al. Intrinsics + Distortion coefficients PyTorch ResNet
2019 PRL Self-Supervised deep homography estimation with invertibility constraints SSR-Net Projection matrixs PyTorch ResNet
2019 ICCVW A geometric approach to obtain a bird's eye view from an image Abbas et al. Projection matrixs TensorFlow CNNs
2019 TCSVT DR-GAN: Automatic radial distortion rectification using conditional GAN in real-time DR-GAN Undistortion TensorFlow GANs
2019 TCSVT Distortion rectification from static to dynamic: A distortion sequence construction perspective STD Undistortion TensorFlow GANs
2019 VR Deep360Up: A deep learning-based approach for automatic VR image upright adjustment Deep360Up Extrinsics CNNs
2019 JVCIR Unsupervised fisheye image correction through bidirectional loss with geometric prior UnFishCor Distortion coefficients TensorFlow VGG
2019 CVPR Blind geometric distortion correction on images through deep learning BlindCor Undistortion PyTorch U-Net
2019 CVPR Learning structure-and-motion-aware rolling shutter correction RSC-Net Undistortion PyTorch ResNet
2019 CVPR Learning to calibrate straight lines for fisheye image rectification Xue et al. Distortion coefficients PyTorch ResNet
2019 ICCV Learning perspective undistortion of portraits Zhao et al. Intrinsics + Undistortion VGG + U-Net
2020 CVPR End-to-end camera calibration for broadcast videos Sha et al. Projection matrixs TensorFlow Siamese-Net + U-Net
2020 ECCV Neural geometric parser for single image camera calibration Lee et al. Intrinsics + Extrinsics PointNet + CNNs
2020 ICRA Learning camera miscalibration detection MisCaliDet Average pixel position difference CNNs
2020 WACV DeepPTZ: deep self-calibration for PTZ cameras DeepPTZ Intrinsics + Extrinsics + Distortion coefficients PyTorch Inception-V3
2020 CVPR Deep homography estimation for dynamic scenes MHN Projection matrixs TensorFlow VGG
2020 ECCV 360∘ camera alignment via segmentation Davidson et al. Extrinsics FCN
2020 ECCV Content-aware unsupervised deep homography estimation CA-UDHN Projection matrixs PyTorch FCN + ResNet
2020 IROS Deep keypoint-based camera pose estimation with geometric constraints DeepFEPE Extrinsics PyTorch VGG + PointNet
2020 TIP Model-free distortion rectification framework bridged by distortion distribution map DDM Undistortion Tensorflow GANs
2020 TIP Deep face rectification for 360° dual-fisheye cameras Li et al. Undistortion CNNs
2020 ICPR Position-aware and symmetry enhanced GAN for radial distortion correction PSE-GAN Undistortion GANs
2020 ICIP A simple yet effective pipeline for radial distortion correction RDC-Net Undistortion PyTorch ResNet
2020 ICASSP Self-supervised deep learning for fisheye image rectification FE-GAN Undistortion PyTorch GANs
2020 CVPR RDCFace: radial distortion correction for face recognition RDCFace Undistortion ResNet
2020 arXiv Fisheye distortion rectification from deep straight lines LaRecNet Distortion coefficients PyTorch ResNet
2020 CVPR Height and uprightness invariance for 3d prediction from a single view Baradad et al. Intrinsics + Extrinsics PyTorch CNNs
2020 CVPR What does plate glass reveal about camera calibration? Zheng et al. Intrinsics + Extrinsics CNNs
2020 ECCV Single view metrology in the wild Zhu et al. Intrinsics + Extrinsics PyTorch CNNs + PointNet
2021 TCI Online training of stereo self-calibration using monocular depth estimation StereoCaliNet Extrinsics PyTorch U-Net
2021 ICCV CTRL-C: Camera calibration TRansformer with Line-Classification CTRL-C Intrinsics + Extrinsics PyTorch Transformer
2021 ICCVW Deep single fisheye image camera calibration for over 180-degree projection of field of view Wakai et al. Intrinsics + Extrinsics DenseNet
2021 arXiv Rethinking generic camera models for deep single image camera calibration to recover rotation and fisheye distortion GenCaliNet Intrinsics + Extrinsics + Distortion coefficients DenseNet
2021 TIP A deep ordinal distortion estimation approach for distortion rectification OrdianlDistortion Distortion coefficients TensorFlow CNNs
2021 TCSVT Revisiting radial distortion rectification in polar-coordinates: A new and efficient learning perspective PolarRecNet Undistortion PyTorch VGG + U-Net
2021 PRL DQN-based gradual fisheye image rectification DQN-RecNet Undistortion PyTorch VGG
2021 CVPR Practical wide-angle portraits correction with deep structured models Tan et al. Undistortion PyTorch U-Net
2021 CVPR Progressively complementary network for fisheye image rectification using appearance flow PCN Undistortion PyTorch U-Net
2021 arXiv SIR: Self-supervised image rectification via seeing the same scene from multiple different lenses SIR Undistortion PyTorch ResNet
2021 ICCV Multi-level curriculum for training a distortion-aware barrel distortion rectification model DaRecNet Undistortion TensorFlow U-Net
2021 CVPR Deep Lucas-Kanade homography for multimodal image alignment DLKFM Projection matrixs TensorFlow Siamese-Net
2021 ICCV LocalTrans: A multiscale local transformer network for cross-resolution homography estimation LocalTrans Projection matrixs PyTorch Transformer
2021 ICCV Motion basis learning for unsupervised deep homography estimation with subspace projection BasesHomo Projection matrixs PyTorch ResNet
2021 ICIP Fast and accurate homography estimation using extendable compression network ShuffleHomoNet Projection matrixs TensorFlow ShuffleNet
2021 TCSVT Depth-aware multi-grid deep homography estimation with contextual correlation DAMG-Homo Projection matrixs TensorFlow CNNs
2021 BMVC A simple approach to image tilt correction with self-attention MobileNet for smartphones SA-MobileNet Extrinsics TensorFlow MobileNet
2021 ICCV SPEC: Seeing people in the wild with an estimated camera SPEC Intrinsics + Extrinsics PyTorch ResNet
2021 CVPR Wide-Baseline Relative Camera Pose Estimation with Directional Learning DirectionNet Extrinsics TensorFlow U-Net
2022 ICRA Self-supervised camera self-calibration from video Fang et al. Intrinsics + Extrinsics PyTorch CNNs
2022 ICASSP Camera calibration through camera projection loss CPL Intrinsics + Extrinsics TensorFlow Inception-V3
2022 CVPR Iterative Deep Homography Estimation IHN Projection matrixs PyTorch Siamese-Net
2022 CVPR Unsupervised Homography Estimation with Coplanarity-Aware GAN HomoGAN Projection matrixs PyTorch GANs
2022 PAMI Content-Aware Unsupervised Deep Homography Estimation and Beyond Liu et al. Projection matrixs PyTorch ResNet

📋Datasets

Abbreviation Number Format Real/Synetic Video Paired/Unpaired/Application Dataset
LOL paper 500 RGB Real No Paired Dataset

📋Metrics

Abbreviation Full-/Non-Reference Platform Code
MAE (Mean Absolute Error) Full-Reference
MSE (Mean Square Error) Full-Reference
PSNR (Peak Signal-to-Noise Ratio) Full-Reference
SSIM (Structural Similarity Index Measurement) Full-Reference MATLAB Code
LPIPS (Learned Perceptual Image Patch Similarity) Full-Reference PyTorch Code
LOE (Lightness Order Error) Non-Reference MATLAB Code
NIQE (Naturalness Image Quality Evaluator) Non-Reference MATLAB Code
PI (Perceptual Index) Non-Reference MATLAB Code
SPAQ (Smartphone Photography Attribute and Quality) Non-Reference PyTorch Code
NIMA (Neural Image Assessment) Non-Reference PyTorch/TensorFlow Code/Code
MUSIQ (Multi-scale Image Quality Transformer) Non-Reference TensorFlow Code

📜License

The code, platform, and dataset are made available for academic research purpose only.

📚Citation

If you find the repository helpful in your resarch, please cite the following paper.

@article{Kang,
  title={Deep Learning for Camera Calibration: A Survey},
  author={Kang Liao, Chunyu Lin, Yunchao Wei, Yao Zhao},
  journal={},
  year={2022}
}

📋Paper

Official Version

arXiv Version

📭Contact

[email protected]

awesome-deep-camera-calibration's People

Contributors

kangliao929 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.