Joanna Hong

Ph.D. candidate at Korea Advanced Institute of Science and Technology

About Me

Hello, my name is Joanna Hong, a Ph.D. candidate in Electrical Engineering at Korea Advanced Institute of Science and Technology. I am researching in Image and Video Systems Lab., under the supervision of Professor Yong Man Ro. I have experiences with mainly machine learning, especially in facial expression analysis, human interactive learning, and multi-modal learning. Now I am more focusing on visual-text and visual-audio multi-modal learning.


Ph.D. candidate

Electrical Engineering

2019 - present

Korea Advanced Institute of Science and Technology

B.S. degree, Electrical Engineering

2014 - 2019

Korea Advanced Institute of Science and Technology


International Journal

  • Speech Reconstruction with Reminiscent Sound via Visual Voice Memory [link]

    Joanna Hong, Minsu Kim, Se Jin Park, Yong Man Ro

    IEEE/ACM Transactions on Audio, Speech, and Language Processing (TASLP), 2021

  • Cromm-vsr: Cross-modal memory augmented visual speech recognition [link]

    Minsu Kim, Joanna Hong, Se Jin Park, Yong Man Ro

    IEEE Transactions on Multimedia (TMM), 2021

International Conference

  • VisageSynTalk: Unseen Speaker Video-to-Speech Synthesis via Speech-Visage Feature Selection

    Joanna Hong, Minsu Kim, Yong Man Ro

    European Conference on Computer Vision (ECCV), 2022

  • Visual Context-driven Audio Feature Enhancement for Robust End-to-End Audio-Visual Speech Recognition

    Joanna Hong*, Minsu Kim*, Daehun Yoo, and Yong Man Ro (* equally contributed)

    Interspeech, 2022

  • SyncTalkFace: Talking Face Generation with Precise Lip-syncing via Audio-Lip Memory [link]

    Se Jin Park, Minsu Kim, Joanna Hong, Jeongsoo Choi, and Yong Man Ro

    AAAI Conference on Artificial Intelligence (AAAI), 2022 (Oral)

  • Lip to Speech Synthesis with Visual Context Attentional GAN [link]

    Minsu Kim, Joanna Hong, Yong Man Ro

    Conference on Neural Information Processing Systems (NeuIPS), 2021

  • Multi-Modality Associative Bridging Through Memory: Speech Sound Recollected From Face Video [link]

    Minsu Kim*, Joanna Hong*, Yong Man Ro (* equally contributed)

    IEEE/CVF International Conference on Computer Vision (ICCV), 2021

  • Unsupervised Disentangling of Viewpoint and Residues Variations by Substituting Representations for Robust Face Recognition [link]

    Minsu Kim, Joanna Hong, Junho Kim, Hong Joo Lee, and Yong Man Ro

    International Conference on Pattern Recognition (ICPR), 2021

  • Comprehensive Facial Expression Synthesis Using Human-Interpretable Language [link]

    Joanna Hong, Jung Uk Kim, Sangmin Lee, Yong Man Ro

    IEEE International Conference on Image Processing (ICIP), 2020

  • Learning Style Correlation For Elaborate Few-Shot Classification [link]

    Junho Kim, Minsu Kim, Jung Uk Kim, Hong Joo Lee, Sangmin Lee, Joanna Hong, Yong Man Ro

    IEEE International Conference on Image Processing (ICIP), 2020

  • Face Tells Detailed Expression: Generating Comprehensive Facial Expression Sentence Through Facial Action Units [link]

    Joanna Hong, Hong Joo Lee, Yelin Kim, and Yong Man Ro

    International Conference on Multimedia Modeling (MMM), 2020


AI World Cup 2018

Organizing Committee

June 2018

Emerging Industry 4.0 is rooted in various technologies, including IoT, big data, bio-chips, and AI. Among these technologies, AI technology is considered as the most powerful and influential technology with regard to Industry 4.0. The AI World Cup will be the proper venue for competition with AI technology. The scope of the AI World Cup competition covers AI soccer, AI commentator, and AI reporter.

Koh Young Technology, Inc.


September 2017 - February 2018

True 3D Smart Factory Solutions, Powered by Artificial Intelligence

Koh Young is a world leader in 3D measurement and inspection technology used in the production of electronic assemblies. Using patented Shadow-Free Moire’ 3D measurement technology, Koh Young provide best-in-class Solder Paste Inspection (SPI) and Automated Optical Inspection (AOI) for electronics manufacturers worldwide.


US/European/ Chinese/Korean Patent

Duk Young Lee, Chan Woo Park, Tae Min Choi, Joanna Hong

Koh Young Technology, Inc.

"Apparatus and Method of Generating Control Parameter of Screen Printer"

The apparatus includes a memory that stores a simulation model configured to derive predictive inspection information on a printed state of solder paste based on a plurality of control parameters of the screen printer.

Professional Activities

  • Outstanding Teaching Assistant Award (2021)

    Korea Advanced Institute of Science and Technology (KAIST)

  • National Government Fellowship (2014 - Present)

    Government of South Korea

Professional Activities


  • Conference

    European Conference on Machine Learning (2022)

    International Conference on Machine Learning (2021, 2022)

    Neural Information Processing Systems (2020, 2022)


  • EE474 Introduction to Multimedia, KAIST (2020, 2021, 2022)

    Programming Lecturer & Teaching Assistant

  • EE534 Pattern Recognition, KAIST (2021)

    Teaching Assistant