Mastodon Mastodon

Chengkun (Charlie) Li

PhD Student in Computer Science

Swiss Federal Institute of Technology Lausanne (EPFL)

Brief Bio

I’m a PhD student in Computer Science at , working with Prof. Alexander Mathis in the Mathis Group for Computational Neuroscience and AI. My research focuses on multimodal and continual learning for embodied systems, connecting perception, reasoning, and motor control.

Before my PhD, I completed an MSc in Robotics at EPFL and a master’s thesis at on continual skill learning for ANYmal, supervised by Prof. Marco Hutter and Prof. Caglar Gulcehre. I was also a student researcher at Zurich, where I worked on InkSight, an open-source system for converting images of handwriting into digital ink.

Earlier, I worked at EPFL CVLab on efficient 6D object pose estimation with modular quantization-aware training, at ByteDance AI Lab on multimodal representation learning, and on projects in 3D perception and Cryo-ET generative modeling.

Outside of research, I enjoy board games 🎲, soccer ⚽, tennis 🎾, and music 🎶. Feel free to reach out to me if you want to join in on a hike or play some board games.

Work with me

I’m open to collaborations with doctoral students and motivated Master’s students interested in continual learning, multimodal systems, embodied AI, and computational neuroscience.

If you have a solid deep learning foundation and want to work on these topics, I’d love to chat about potential research projects. EPFL Master’s students should also follow the instructions on our lab website.


Research Interests

  • Multimodal and Embodied Learning
  • Continual / Open-Ended Learning
  • Motor Control, Perception, and Reasoning

Industry Experience

  • Student Researcher, 2023 - 2024

    Google Research

  • Computer Vision Research Intern, 2021

    ByteDance AI Lab

Recent News

All news →

Experience

 
 
 
 
 
 
 
 
 
 

Thesis Student

Robotics Systems Lab, ETH Zürich

Robotics Systems Lab, ETH Zürich

Apr 2024 – Sep 2024

Thesis Title: Continuous Skill Learning For ANYmal Robot

Supervisors: Chenhao Li, Nikita Rudin, Skander Moalla, Marco Hutter, Caglar Gulcehre (hosting supervisors from CLAIRE, EPFL)

 
 
 
 
 

Student Researcher

Google Research, Zürich

Google Research, Zürich

Aug 2023 – Feb 2024

Worked on extending Vision-Language Model with ink modality.

Supervisors: Andrii Maksai, Claudiu Musat, Jesse Berent, Henry Rowley.

Google Research Blog | GitHub | HuggingFace | Project page

 
 
 
 
 

Semester Project Student

CVLab, EPFL

CVLab, EPFL

Dec 2022 – Aug 2023

Worked on modular quantization-aware training.

Supervisors: Saqib Javed, Mathieu Salzmann

 
 
 
 
 

MSc in Robotics

École Polytechnique Fédérale de Lausanne (EPFL)

École Polytechnique Fédérale de Lausanne (EPFL)

Sep 2021 – Oct 2024
Enrolled in MSc in Robotics program.
 
 
 
 
 

Research Intern

ByteDance Inc.

ByteDance Inc.

Mar 2021 – Jul 2021 Beijing, China
Research Intern at AI Lab Visual Computing group working on Multimodal Representation Learning.

Contact

..feel free to reach out to me