Dr. Jianfei Yang
Assistant Professor

Director of Multimodal AI and RoboticS <MARS> Lab
School of Mechanical and Aerospace Engineering
School of Electrical and Electronic Engineering
Nanyang Technological University, Singapore

North Spine (N3), 50 Nanyang Avenue, 639798

jianfei.yang (at) ntu.edu.sg

About Me

I will join Nanyang Technological University as a tenure-track Assistant Professor with a joint appointment in the School of Mechanical and Aerospace Engineering and School of Electrical and Electronic Engineering in 2024 Fall. My primary research endeavors lie in the domain of Artificial Intelligence of Things (AIoT), Multimodal AI, and Embodied AI, where I am committed to advancing the intelligence, robustness, and security of edge devices and robotics through cutting-edge AI models. My research works are published in ICLR, NeurIPS, CVPR, ICCV, ECCV, ACL, ICRA, IROS, Mobicom, AAAI, etc. I am recognized as the World’s Top 2% Scientists compiled by Stanford University, and the Forbes Asia 30 Under 30 List (Class 2024).

I obtained my Ph.D. from NTU in 2020, receiving the prestigious Best Thesis Award under the supervision of Prof. Xie Lihua. I was a senior research engineer at BEARS, the University of California, Berkeley, in 2021, and a Presidential Postdoctoral Fellow at NTU from 2021 to 2023. Then I worked as a visiting scientist at the University of Tokyo working with Prof. Tatsuya Harada. Currently, I am a visiting scholar at Harvard University working with Prof. Vijay Janapa Reddi.

Besides research, I am keen on participating AI and data science challenges to deal with real-world interdisciplinary problems. I won first places in 10+ International AI challenges and hackathons, such as Microsoft/IEEE BOP-16, Buildathon of Singapore 2017, ACM ICMI-18 EmotiW, PHI-Net Challenge by Pacific Earthquake Engineering Research Center, IEEE CVPR-19 UG2+, and ICCV-21 Masked Face Recognition. Additionally, I lead Team 404 in an AI Talk Show “Fire, Talented Programmer” (燃烧吧,天才程序员!). During my spare time, I enjoy swimming, and music (saxophone and guitar).

You can find me on: [ Google Scholar | LinkedIn | ResearchGate | Web of Science | ORCID ]

Prospective PhD students and interns: please email me with your CV and research interests.

Prospective post-docs: please email me with your CV, representative papers, and a short research statement.


  • May 2024: (award) I have been selected in Forbes Asia 30 Under 30 List, Class 2024.
  • Apr 2024: (activity) I am happy to chair the “Transfer Learning” Session at ICRA-24. See you at Yokohama!
  • Apr 2024: (service) I am serving as an Associate Editor for Elsevier Neurocomputing.
  • Apr 2024: (activity) We are organizing IJCAI-24 Workshop on Deep Learning for Human Activity Recognition.
  • Apr 2024: (activity) I give a talk on multimodal transfer learning at the University of Tokyo and BeyondAI (Softbank).
  • Feb 2024: (activity) We are organizing UG2+ UAV Tracking and Estimation Challenge at CVPR-24.
  • Feb 2024: (activity) We are organizing the 1st workshop on Integrated Sensing, Communication, and Computing in IoT Systems at ICCCN-24.
  • Jan 2024: (paper) Two papers are accepted by ICRA-24.
  • Jan 2024: (paper) Our paper on unsupervised model evaluation, Transfer Score, has been accepted by ICLR-24.
  • Jan 2024: (service) I am serving as an Associate Editor for IEEE Transactions on Neural Networks and Learning Systems.
  • Jan 2024: (career) I will join NTU as a tenure-track Assistant Professor in mid 2024. I am hiring Ph.D. students with full scholarship and CSC visiting Ph.D. students.
  • Dec 2023: (paper) Two papers on time-series representation learning have been accepted by AAAI-2024.
  • Oct 2023: (honor) I have been listed in the latest Stanford World’s Top 2% Scientists based on standardized citation indicators.
  • Oct 2023: (activity) I have been selected as the Digileader by Digital Futures and will attend the Digitalize-23 event in Stockholm, Sweden.
  • Oct 2023: (paper) Our work on visual recognition in the dark has been accepted by IJCV (IF=19.5).
  • Sep 2023: (paper) Two papers have been accepted by NeurIPS-23. The MM-FI dataset is accepted by the NeurIPS Dataset and Benchmark track.
  • Jul 2023: (paper) Two papers on domain adaptation have been accepted by ICCV-2023.
  • Jun 2023: (data) We have released the first wireless multimodal human sensing dataset MM-FI including five synchronized sensor modalities.
  • Jun 2023 (book) Our paper on WiFi and IMU localization has been published by Springer Nature in the book “Machine Learning for Indoor Localization and Navigation”.
  • Jun 2023: (paper) Our work AV-PedAware has been accepted by IROS-23.
  • Feb 2023: (paper) Our WiFi sensing work SenseFi has been accepted by Patterns, Cell Press.
  • Jan 2023: (paper) Our transfer learning work BETA has been accepted by ICLR-23 (Spotlight, Top 7.8%).