pqy000 / bhwangfy.github.io Goto Github PK

Hi, I am a Ph.D. student of the joint Ph.D. Program of USTC and Microsoft Research (Asia). I am very fortunate to be advised by Professor Wei Chen and Professor Zhi-Ming Ma. I also work closely with Professor Ruoyu Sun.

The linear span of optimization, generalization and representation in deep learning.

• Momentum Doesn't Change the Implicit Bias
  Bohan Wang, Qi Meng, Huishuai Zhang, Ruoyu Sun, Wei Chen, Zhi-Ming Ma
• Creating Training Sets via Weak Indirect Supervision
  Jieyu Zhang, Bohan Wang, Xiangchen Song, Yujing Wang, Yaming Yang, Jing Bai, Alexander Ratner
• Machine-Learning Non-Conservative Dynamics for New-Physics Detection
  Ziming Liu, Bohan Wang, Qi Meng, Wei Chen, Max Tegmark, Tie-Yan Liu

• Optimizing Information-theoretical Generalization Bound via Anisotropic Noise in SGLD.
  Bohan Wang, Huishuai Zhang, Jieyu Zhang, Qi Meng, Wei Chen, Tie-Yan Liu.
  NeurIPS 2021.
• The Implicit Bias for Adaptive Optimization Algorithms on Homogeneous Neural Networks
  Bohan Wang, Qi Meng, Wei Chen, Tie-Yan Liu.
  ICML 2021 (Long Presentation).
• Tighter generalization bounds for iterative differentially private learning algorithms
  *Fengxiang He, *Bohan Wang, Dacheng Tao.
  UAI 2021.
• Piecewise linear activations substantially shape the loss surfaces of neural networks
  *Fengxiang He, *Bohan Wang, Dacheng Tao.
  ICLR 2020.

• University of Science and Technology of China - Joint Ph.D. Program of USTC & MSR (Asia) (2021 - Present).
  Supervised by Prof. Wei Chen and Prof. Zhi-Ming Ma.
• University of Science and Technology of China - Sc.B in Computational Mathematics.
  Supervised by Prof. Jie Wang.

• Research Assistant - University of Sydney (2019.06-2019.09).
  Supervised by Prof. Dacheng Tao
• Star Bridge Research Assistant - Microsoft Research (Asia) (2020.09-2021.08)
  Supervised by Prof. Wei Chen.

The photo is taken by my girl friend Xianyi Tao. We have met since we were high school classmates.

Email: [email protected]