Profile
I’m currently a second-year PhD student at the University of Tokyo, advised by Prof. Jun Rekimoto. My research interests lie primarily in the topic of voice user interaction, silent speech recognition, and multimodal input technologies. My educational background and work experience span electrical and electronics engineering (B.S., four years at UESTC) and applied computer science (M.S., two years at the University of Tokyo). Since September 2023, I have been visiting HiLab at UCLA under the supervision of Prof. Yang Zhang.
Email: zxsu [at] g.ecc.u-tokyo.ac.jp
Address: Room A102, Daiwa Ubiquitous Computing Research Building, 7-3-1, Hongo, Bunkyo-ku, Tokyo 113-8654, Japan.
News
Oct 14, 2023: Thrilled to share that I have been selected for the 2023 Google PhD Fellowship!
Sep 28, 2023: Selected for the JSPS DC2 Research Fellowship (Japan Society for the Promotion of Science Research Fellowship for Young Scientists)!
June 30, 2023: Our project on creative support for anime has been selected as part of the MITOU advanced program.
May 26, 2023: Recognized as Super Creator in the MITOU program!
May 12, 2023: Received the UTokyo-TOYOTA Study Abroad Scholarship to support my visit at UCLA.
Apr 4, 2023: 🏆 LipLearner won Best Paper award at CHI 2023!
Feb 24, 2023: Our work LipLearner was featured by ITmedia News.
Feb 15, 2023: Released training scrips, pre-trained model, and iOS app source code of LipLearner!
Jan 14, 2023: 1 full paper got accepted to CHI 2023. Can't wait to see everyone in Hamburg!
Jan 1, 2023: Started working as a Research Assistant at RIISE.
Oct 29, 2022: Attending UIST 2022 in Bend, Oregon. It is my first-ever in-person conference!
Aug 18, 2022: Our work-in-progress got accepted to the UIST 2022 poster session!
Aug 3, 2022: Secured a grant from the IIW program of UToyko!
Jun 3, 2022: Our project has been selected for the MITOU program!
Apr 23, 2022: 1 paper accepted to LREC 2022.
Apr 1, 2022: Received UTokyo PhD Fellowship to support my research.
Mar 14, 2022: Received my Master’s from the University of Tokyo with a department award. Incoming PhD student from April, 2022.
Feb 17, 2022: 2 papers accepted at CHI 2022. Big thanks to Xinlei and Naoki. (Press release 1 2)
Mar 20, 2021: 1 paper accepted as a short paper at ETRA 2021.
Apr 1, 2020: Joined Rekimoto Lab as a master’s student.
Conference Publications
LipLearner: Customizable Silent Speech Interactions on Mobile Devices
CHI '23 CHI Conference on Human Factors in Computing Systems 2022
🏆 Best paper award, top 1%
Zixiong Su, Shitao Fang, Jun Rekimoto
GitHub (Source code)
Customizing Silent Speech Commands from Voice Input using One-shot Lipreading
UIST '22 Poster Adjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology 2021
Zixiong Su, Shitao Fang, Jun Rekimoto
SSR7000: A Synchronized Corpus of Ultrasound Tongue Imaging for End-to-End Silent Speech Recognition
LREC'22 The International Conference on Language Resources and Evaluation 2022
Naoki Kimura, Zixiong Su, Takaaki Saeki and Jun Rekimoto.
GitHub (Dataset)
Aware: Intuitive Device Activation Using Prosody for Natural Voice Interactions
CHI '22 CHI Conference on Human Factors in Computing Systems 2022
Xinlei Zhang*, Zixiong Su* (equally contributed), and Jun Rekimoto.
GitHub (Dataset)
SilentSpeller: Towards mobile, hands-free, silent speech text entry using electropalatography
CHI '22 CHI Conference on Human Factors in Computing Systems 2022
Naoki Kimura, Tan Gemicioglu, Jonathan Womack, Richard Li, Yuhui Zhao, Abdelkareem Bedri, Zixiong Su, Alex Olwal, Jun Rekimoto, and Thad Starner.
Gaze+Lip: Rapid, Expressive interactions Combining Gaze Input and Silent Speech Commands for Hands-free Smart TV Control
ETRA '21 2022 ACM Symposium of Eye Tracking Research & Applications
Zixiong Su, Xinlei Zhang, Naoki Kimura, and Jun Rekimoto
Awards & Honors
Google PhD Fellowship
JSPS DC2 Research Fellowship
UTokyo-TOYOTA Study Abroad Scholarship
Telecommunications Advancement Foundation, Telecommunication Interdisciplinary Research Award
Information-technology Promotion Agency (IPA) MITOU Super Creator
Leave a nest, Incu-be Award
The Univerisity of Tokyo PhD Fellowship
The Univerisity of Tokyo, GSII, Best Master's Thesis
The University of Tokyo, World-leading Innovative Graduate Study Co-Designing Future Program
Japan Student Services Organization (JASSO), MEXT Scholarship
University of Electronic Science and Technology of China, Best Bachelor's Degree Thesis
China Scholarship Council (CSC) State Scholarship
Oct. 2023
Sep. 2023
Aug. 2023
Mar. 2023
June 2022 - Mar. 2023
Apr. 2022
Apr. 2022 - Mar. 2025
Mar. 2022
Oct. 2020 - Mar. 2025
Oct. 2020
July 2019
Oct. 2017 - Sept. 2018
Experience
Research Institute for an Inclusive Society through Engineering(RIISE), Value EXchange Engineering RA
Japan Science and Technology Agency (JST), Research Assistant
Research on ECoG-based brain-computer communication in the Moonshot Research and Development Program
Sony Computer Science Laboratories, Inc. (Kyoto), Research Assistant
Research on 3D mesh authoring using natural language
Neural Pocket Inc., Software Engineer Internship
Development of an indoor autonomous driving robot
Jan. 2023 - Present
Apr. 2022 - Present
Nov. 2021 - Nov. 2022
July 2020 - July 2021