Summary

Passionate about Machine Learning and its applications. Experienced in computer vision, retrieval systems and reinforcement learning. Actively involved in writing proposals as well as conducting research. Enthusiastic about transforming ideas into practice.

Education

• Ph.D. in Systems Engineering, University of Virginia, 2021
• M.E. in Systems Engineering, Univerisity of Virginia, 2016
• B.S. in Environmental Engineering, Beijing Institute of Technology, 2015

Work experience

• July 2021: Machine Learning Engineer @ JD Advertising (Business Growth BU), Beijing, China
  • Doctoral Management Trainee @ JD.com, Beijing, China
  • Work on the development of the next-gen matching system for JD.com’s display advertising system
• Spring 2021: Research Scientist Intern (Cooperative Automated Driving)
  • Toyota InfoTech Labs, Mountain View, CA
  • Build high fidelity highway on-ramp simulation based on SUMO
  • Propose and conduct research on deep-learning based cooperative autonomous driving methods for mixed-traffic
  • Communicate and work with the patent office to file patent applications
  • Supervisor: Dr. Rui Guo
  • Collaborator: Dr. Ziran Wang
• Summer 2019: Research Scientist Intern (Digital Twins Project)
  • Toyota InfoTech Labs, Mountain View, CA
  • Propose and conduct research in automated driving for connected vehicles
  • Communicate and work with the patent office to file patent applications
  • Supervisor: Dr. Kyungtae Han
• 2017-May 2021: Research Assistant
  • Professor Beling’s lab
  • Lead the writing of multiple proposals for external funding. One proposal was supported by UANGEL, Inc., a Korean IoT company, and funded through the Center for Visual and Decision Informatics, an NSF Industry University Cooperative Research Center
  • Collaborate with researchers from Civial Engineering, Mechanical Engineering, and Computer Engineering on Cyber-Physical Systems research
  • Supervisor: Professor Peter A. Beling

Skills

• Python, C++, Matlab.
• Pytorch, TensorFlow, Numpy.

Publications

• Value-Decomposition Multi-Agent Actor-Critics
  Jianyu Su, Stephen Adams, and Peter A. Beling. 2021. Proceedings of the AAAI Conference on Artificial Intelligence . AAAI 2021.

• Deep Multi-Agent Reinforcement Learning for Multi-Level Preventive Maintenance in Manufacturing Systems
  Jianyu Su, Jing Huang, Stephen Adams, Qing Chang, Peter A. Beling. Expert Systems with Applications (IF 6.95, SCI Computer Science Q1)

• Graph Convolution Networks for Probabilistic Modeling of Driving Acceleration
  Jianyu Su, Peter A. Beling, Rui Guo, and Kyungtae Han. The 23rd IEEE International Conference on Intelligent Transportation Systems. ITSC 2020.

• Graph Neural Network and Multi-Agent Reinforcement Learning for Machine-Process-System Integrated Control to Optimize Production Line Yield
  Jing Huang, Jianyu Su, Qing Chang. Journal of Manufacturing Systems (IF 8.63, SCI Q1)

• Is my sensor sleeping, hibernating, or broken? A data-driven monitoring system for indoor energy harvesting sensors
  Alan Wang, Jianyu Su, Arsalan Heydarian, Bradford Campbell, and Peter A. Beling. The 7th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation. BuildSys 2020.

• The Standby Energy of Smart Devices: Problems, Progress, & Potential
  Wenpeng Wang, Jianyu Su, Zackary Hicks, Bradford Campbell. 2020 IEEE/ACM Fifth International Conference on Internet-of-Things Design and Implementation. IoTDI.

ArXiv

• Counterfactual Multi-agent Reinforcement Learning with Graph Convolution Communication
  Jianyu Su, Stephen Adams, Peter A. Beling. arXiv:2004.00470.

Work In Progress

• Smart Index: A Hybrid Approach that Unifies Rule-based and Model-based Retrieval in Display Advertising System at JD.com
  Jianyu Su, et al.

Patents

• Su, Jianyu, Kyungtae Han, Rui Guo, and Roger D. Melen. “Systems and methods for providing driving recommendations.” U.S. Patent 11,315,421, issued April 26, 2022.

• Su, Jianyu, Rui Guo, Ziran Wang. “Cooperative Artificial Intelligent Assisted Driving”. US Patent 17/475,306, filed Sep 14, 2021.

• Arsalan Heydarian, Brad J. Campbell, Peter Beling, Alan Wang and Jianyu Su. “Data-Driving Monitoring System for Energy Harvesting Sensors and Related Methods thereof”. U.S. Provisional Patent 63/107,204, filed on October 29, 2020.

Teaching

I have been a teaching assitant for multiple courses

• Graduate-level: Data Mining
• Undergraduate-level: Risk Analysis, Data and Information Engineering, and Deterministic Decision Models