Joanna Hong

Ph.D. candidate at Korea Advanced Institute of Science and Technology

About Me

Hello, my name is Joanna Hong, a Ph.D. candidate in Electrical Engineering at Korea Advanced Institute of Science and Technology. I am researching in Image and Video Systems Lab., under the supervision of Professor Yong Man Ro. I have experiences with mainly machine learning, especially in facial expression analysis, human interactive learning, and multi-modal learning. Now I am more focusing on visual-text and visual-audio multi-modal learning.

Education

Ph.D. candidate

Electrical Engineering

2019 - present

Korea Advanced Institute of Science and Technology

B.S. degree, Electrical Engineering

2014 - 2019

Korea Advanced Institute of Science and Technology

Publications

International Journal

  • Speech Reconstruction with Reminiscent Sound via Visual Voice Memory

    Joanna Hong, Minsu Kim, Se Jin Park, Yong Man Ro

    IEEE/ACM Transactions on Audio, Speech, and Language Processing (TASLP), 2021

  • Cromm-vsr: Cross-modal memory augmented visual speech recognition

    Minsu Kim, Joanna Hong, Se Jin Park, Yong Man Ro

    IEEE Transactions on Multimedia (TMM), 2021

International Conference

  • SyncTalkFace: Talking Face Generation with Precise Lip-syncing via Audio-Lip Memory

    Se Jin Park, Minsu Kim, Joanna Hong, Jeongsoo Choi, and Yong Man Ro

    AAAI Conference on Artificial Intelligence (AAAI), 2022

  • Lip to Speech Synthesis with Visual Context Attentional GAN

    Minsu Kim, Joanna Hong, Yong Man Ro

    Conference on Neural Information Processing Systems (NeuIPS), 2021

  • Multi-Modality Associative Bridging Through Memory: Speech Sound Recollected From Face Video

    Minsu Kim*, Joanna Hong*, Yong Man Ro (* equally contributed)

    IEEE/CVF International Conference on Computer Vision (ICCV), 2021

  • Unsupervised Disentangling of Viewpoint and Residues Variations by Substituting Representations for Robust Face Recognition

    Minsu Kim, Joanna Hong, Junho Kim, Hong Joo Lee, and Yong Man Ro

    International Conference on Pattern Recognition (ICPR), 2021

  • Comprehensive Facial Expression Synthesis Using Human-Interpretable Language

    Joanna Hong, Jung Uk Kim, Sangmin Lee, Yong Man Ro

    IEEE International Conference on Image Processing (ICIP), 2020

  • Learning Style Correlation For Elaborate Few-Shot Classification

    Junho Kim, Minsu Kim, Jung Uk Kim, Hong Joo Lee, Sangmin Lee, Joanna Hong, Yong Man Ro

    IEEE International Conference on Image Processing (ICIP), 2020

  • Face Tells Detailed Expression: Generating Comprehensive Facial Expression Sentence Through Facial Action Units

    Joanna Hong, Hong Joo Lee, Yelin Kim, and Yong Man Ro

    International Conference on Multimedia Modeling (MMM), 2020

Experience

AI World Cup 2018

Organizing Committee

June 2018

http://aiworldcup.org/

Emerging Industry 4.0 is rooted in various technologies, including IoT, big data, bio-chips, and AI. Among these technologies, AI technology is considered as the most powerful and influential technology with regard to Industry 4.0. The AI World Cup will be the proper venue for competition with AI technology. The scope of the AI World Cup competition covers AI soccer, AI commentator, and AI reporter.

Koh Young Technology, Inc.

Intern

September 2017 - February 2018

https://www.kohyoung.com/

True 3D Smart Factory Solutions, Powered by Artificial Intelligence

Koh Young is a world leader in 3D measurement and inspection technology used in the production of electronic assemblies. Using patented Shadow-Free Moire’ 3D measurement technology, Koh Young provide best-in-class Solder Paste Inspection (SPI) and Automated Optical Inspection (AOI) for electronics manufacturers worldwide.

Patent

US/European/ Chinese/Korean Patent

Duk Young Lee, Chan Woo Park, Tae Min Choi, Joanna Hong

Koh Young Technology, Inc.

"Apparatus and Method of Generating Control Parameter of Screen Printer"

The apparatus includes a memory that stores a simulation model configured to derive predictive inspection information on a printed state of solder paste based on a plurality of control parameters of the screen printer.

Professional Activities

  • Outstanding Teaching Assistant Award (2021)

    Korea Advanced Institute of Science and Technology (KAIST)

  • National Government Fellowship (2014 - Present)

    Government of South Korea

Professional Activities

Reviews

  • Conference

    International Conference on Machine Learning (2021)

    Neural Information Processing Systems (2020)

Teaching

  • EE474 Introduction to Multimedia, KAIST (2020, 2021, 2022)

    Programming Lecturer & Teaching Assistant

  • EE534 Pattern Recognition, KAIST (2021)

    Teaching Assistant