Calibration techniques are increasingly applied in the fields of computation advertising，medical diagnosis and meteorological forecasting etc. This is a collection of research and application papers of (uncertainty) calibration techniques. These works are summarized from the public website. If any authors do not want their paper to be listed here, please feel free to contact me（email:[email protected], Wechat:hsg_coder_2）.

• Platt scaling: Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods[J]. by Platt J. Advances in large margin classifiers, 1999.
• Temperature scaling: On calibration of modern neural networks. by Chuan Guo et al. ICML, 2017.
• Beta calibration: A well-founded and easily implemented improvement on logistic calibration for binary classifiers. by Meelis Kull et al. In Artificial Intelligence and Statistics, 2017.
• Attended temperature scaling: Attended temperature scaling: a practical approach for calibrating deep neural networks. by AzadehSadatMozafari et al. arXiv , 2018.
• Dirichlet scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibration. by Meelis Kull et al. arXiv, 2019.

• Hisogram Binning: Obtaining calibrated probability estimates from decision trees and naive bayesian classifiers. by Bianca Zadrozny et al. ICML, 2001.

• Bayesian Binning: Obtaining well calibrated probabilities using bayesian binning. by MahdiPakdamanNaeini et al. AAAI, 2015.

• Isotonic Regression: Transforming classifier scores into accurate multiclass probability estimates. by Bianca Zadrozny et al. KDD, 2002.

• Scaling-binning:Verified Uncertainty Calibration. by Ananya Kumar et al. NeurIPS, 2020.
• Mix-n-Match:Ensemble and Compositional Methods for Uncertainty Calibration in Deep Learning. by Jize Zhang et al. ICML 2020.
• SIR:Calibrating User Response Predictions in Online Advertising. by Chao Deng et al. PKKDD, 2020. (Our work)

• Binary Classifier Calibration: Non-parametric approach. by Mahdi Pakdaman Naeini et al. arXiv 2014.
• Verified Uncertainty Calibration. by Ananya Kumar et al. NeurIPS, 2020.
• Distribution-free binary classification: prediction sets, confidence intervals and calibration. by Chirag Gupta et al. NeurIPS, 2020.
• Ensemble and Compositional Methods for Uncertainty Calibration in Deep Learning. by Jize Zhang et al. ICML 2020.
• Individual Calibration with Randomized Forecasting. by Shengjia Zhao et al. ICML, 2020.
• Post-hoc Calibration of Neural Networks. by Amir Rahimi et al. arXiv 2020.(Google)
• Non-Parametric Calibration for Classification. by Jonathan Wenger et al. AISTATS 2020.
• Don’t Just Blame Over-parametrization for Over-confidence: Theoretical Analysis of Calibration in Binary Classification by Yu Bai et al. ICML, 2021.

• Field-aware Calibration: A Simple and Empirically Strong Method for Reliable Probabilistic Predictions. by Feiyang Pan et al. WWW 2020 (Tencent).
• Calibrating User Response Predictions in Online Advertising. by Chao Deng et al. PKKDD, 2020 (Alibaba).

• Mitigating bias in calibration error estimation by Rebecca Roelofs et al. arXiv 2020.(Google)
• Measuring Calibration in Deep Learning by Jeremy Nixon et al. arXiv 2020.(Google)
• Calibration of Neural Networks using Splines by Kartik Gupta et al. arXiv 2020.(Google)

• Alibaba Pctr Calibration Data Set by Chao Deng. 2019
• Alibaba Pcvr Calibration Data Set by Chao Deng. 2019

• Research Track
  • ICML: Trustworthy Machine Learning (accountability, causality, fairness, privacy, robustness, etc.)
    • ICML 2021 Accepted List

• Meta-Cal: Well-controlled Post-hoc Calibration by Ranking by Xingchen Ma et al. ICML, 2021.
• Distribution-free calibration guarantees for histogram binning without sample splitting by Chirag Gupta et al. ICML, 2021.

• 梳理中