Publications

Preprints

Long-Tailed Recognition on Binary Networks by Calibrating A Pre-trained Model

Jihun Kim, Dahyun Kim, Hyungrok Jung, Taeil Oh, Jonghyun Choi

arXiv 2404
PDF

Just Say the Name: Online Continual Learning with Category Names Only via Data Generation

Minhyuk Seo, Diganta Misra, Seongwon Cho, Minjae Lee, Jonghyun Choi

arXiv 2403
PDF
2024

Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback

Daechul Ahn, Yura Choi, Youngjae Yu, Dongyeop Kang, Jonghyun Choi

ACL 2024 (To appear)
PDF

Learning Equi-angular Representations for Online Continual Learning

Minhyuk Seo, Hyunseo Koh, Wonje Jeung, Min Jae Lee, San Kim, Hankook Lee, Sungjun Cho, Sungik Choi, Hyunwoo Kim, Jonghyun Choi

CVPR 2024 (To appear)
PDF

Online Continual Learning for Interactive Instruction Following Agents

Byeonghwi Kim*, Minhyuk Seo*, Jonghyun Choi

ICLR 2024
PDF · Project Page

PAC-FNO: Parallel-Structured All-Component Fourier Neural Operators for Recognizing Low-Quality Images

Jinsung Jeon, Hyundong Jin, Jonghyun Choi, Sanghyun Hong, Dongeun Lee, Kookjin Lee, Noseong Park

ICLR 2024
PDF

Operator-learning-inspired Modeling of Neural Ordinary Differential Equations

Woojin Cho, Seunghyeon Cho, Hyundong Jin, Jinsung Jeon, Kookjin Lee, Sanghyun Hong, Dongeun Lee, Jonghyun Choi, Noseong Park

AAAI 2024
PDF
2023

Context-Aware Planning and Environment-Aware Memory for Instruction Following Embodied Agents

Byeonghwi Kim, Jinyeon Kim, Yuyeong Kim, Cheolhong Min, Jonghyun Choi

ICCV 2023
(CVPR 2023 Embodied AI Workshop - 1st Place Winner)
PDF · Supp · Project Page · CVPR 2023 Workshop Challenge Page

Story Visualization by Online Text Augmentation with Context Memory

Daechul Ahn, Daneul Kim, Gwangmo Song, Seung Hwan Kim, Honglak Lee, Dongyeop Kang, Jonghyun Choi

ICCV 2023
PDF · Supp · Project Page · Code

Online Continual Learning on Hierarchical Label Expansion

Byung Hyun Lee, Okchul Jung, Jonghyun Choi, Se Young Chun

ICCV 2023
PDF · Supp · Project Page · Code

Cost-effective On-device Continual Learning over Memory Hierarchy with Miro

Xinyue Ma, Suyeon Jeong, Minjia Zhang, Di Wang, Jonghyun Choi, Myeongjae Jeon

MobiCom 2023
PDF (arXiv), (in ACM)

MEnsA: Mix-up Ensemble Average for Unsupervised Multi Target Domain Adaptation on 3D Point Clouds

Ashish Sinha, Jonghyun Choi

CVPR 2023 - Workshop on Continual Learning in Computer Vision
PDF

Online Boundary-Free Continual Learning by Scheduled Data Prior

Hyunseo Koh, Minhyuk Seo, Jihwan Bang, Hwanjun Song, Deokki Hong, Seulki Park, Jung-Woo Ha, Jonghyun Choi

ICLR 2023
PDF · Code

Multi-level Compositional Reasoning for Interactive Instruction Following

Suvaansh Bhambri*, Byeonghwi Kim*, Jonghyun Choi

AAAI 2023
PDF · Code
2022

Ask4Help: Learning to Leverage an Expert for Embodied Tasks

Kunal Pratap Singh, Luca Weihs, Alvaro Herrasti, Jonghyun Choi, Aniruddha Kembhavi, Roozbeh Mottaghi

NeurIPS 2022
PDF · Conference page

Learning visual representations for transfer learning by suppressing texture

Shlok Mishra, Anshul Shah, Ankan Bansal, Janit Anjaria, Jonghyun Choi, Abhinav Shrivastava, Abhishek Sharma, David Jacobs

BMVC 2022
PDF · Poster · Video

CarM: Hierarchical Episodic Memory for Continual Learning

Soobee Lee, Minindu Weerakoon, Jonghyun Choi, Minjia Zhang, Di Wang, Myeongjae Jeon

DAC 2022
PDF · Code

Unsupervised Representation Learning for Binary Networks by Joint Classifier Learning

Dahyun Kim, Jonghyun Choi

CVPR 2022
PDF · Supp · Code

Online Continual Learning on a Contaminated Data Stream with Blurry Task Boundaries

Jihwan Bang, Hyunseo Koh, Seulki Park, Hwanjun Song, Jung-Woo Ha, Jonghyun Choi

CVPR 2022
PDF · Supp · Code

Stereo Depth from Events Cameras: Concentrate and Focus on the Future

YeongWoo Nam, Mohammad Mostafavi, Kuk-Jin Yoon, Jonghyun Choi

CVPR 2022
PDF · Supp · Code

Attentive Fine-Grained Structured Sparsity for Image Restoration

Junghun Oh, Heewon Kim, Seungjun Nah, Cheeun Hong, Jonghyun Choi, Kyoung Mu Lee

CVPR 2022
PDF · Supp · Code

Language Guided Meta-Control for Embodied Instruction Following

Divyam Goel, Kunal Pratap Singh, Jonghyun Choi

CVPR 2022 - Workshop on Embodied AI (EAI-2022)
PDF

Online Continual Learning on Class Incremental Blurry Task Configuration with Anytime Inference

Hyunseo Koh, Dahyun Kim, Jung-Woo Ha, Jonghyun Choi

ICLR 2022
PDF
2021

Iconary: A Pictionary-based Game for Testing Multimodal Communication with Drawings and Text

Christopher Clark, Jordi Salvador, Dustin Schwenk, Derrick Bonafilia, Mark Yatskar, Eric Kolve, Alvaro Herrasti, Jonghyun Choi, Sachin Mehta, Sam Skjonsberg, Carissa Schoenick, Aaron Sarnat, Hannaneh Hajishirzi, Aniruddha Kembhavi, Oren Etzioni and Ali Farhadi

EMNLP 2021 - Oral
Paper coming soon

Zero-Shot Natural Language Video Localization

Jinwoo Nam*, Daechul Ahn*, Dongyeop Kang, Seong Jong Ha, Jonghyun Choi

ICCV 2021 - Oral
PDF SuppMat

Factorizing Perception and Policy for Interactive Instruction Following

Kunal Pratap Singh*, Suvaansh Bhambri*, Byeonghwi Kim*, Roozbeh Mottaghi, Jonghyun Choi

ICCV 2021
(CVPR Embodied AI Workshop 2021 - 2nd Place winner)
PDF SuppMat Code Project Page (Previous version: MOCA: A Modular Object-Centric Approach for Interactive Instruction Following)

Rethinking Deep Image Prior for Denoising

Yeonsik Jo, Se Young Chun, Jonghyun Choi

ICCV 2021
PDF SuppMat

Event-Intensity Stereo: Estimating Depth by the Best of Both Worlds

S. Mohammad Mostafavi I., Kuk-Jin Yoon, Jonghyun Choi

ICCV 2021
(CVPR Event Vision Workshop 2021 - 1st Place winner)
PDF

E2SRI: Learning to Super Resolve Intensity Images from Events

S. Mohammad Mostafavi I., Yeong-woo Nam, Jonghyun Choi, Kuk-Jin Yoon

IEEE Transactions on Pattern Analysis and Machine Intelligence
PDF

Rainbow Memory: Continual Learning with a Memory of Diverse Samples

Jihwan Bang*, Heesu Kim*, Youngjoon Yoo, Jung-Woo Ha, Jonghyun Choi

CVPR 2021
PDF SuppMat Code

BNAS v2: Learning Architectures for Binary Networks with Empirical Improvements

Dahyun Kim, Kunal Pratap Singh, Jonghyun Choi

CVPR 2021 Workshop for Binary Networks for Computer Vision
PDF

Acceleration of Semiconductor Device Simulation With Approximate Solutions Predicted by Trained Neural Networks

Seung-Cheol Han, Jonghyun Choi, Sung-Min Hong

IEEE Transactions on Electron Devices 2021
PDF
2020

Learning Architectures for Binary Networks

Dahyun Kim*, Kunal Pratap Singh*, Jonghyun Choi

ECCV 2020
Samsung Humantech Paper Award 2020 - Bronze
PDF Supp-Mat Code

Learning to Super Resolve Intensity Images from Events

S. Mohammad Mostafavi I., Jonghyun Choi, Kuk-Jin Yoon

CVPR 2020 - Oral
PDF Supp-Mat. Code (in prep.) Video

Confidence Calibration for Incremental Learning

Dongmin Kang, Yeonsik Jo , Yeongwoo Nam, Jonghyun Choi

IEEE Access
PDF
2019

Event-based High Dynamic Range Image and Very High Frame Rate Video Generation using Conditional Generative Adversarial Networks

S. Mohammad Mostafavi I., Lin Wang, Yo-Sung Ho, Kuk-Jin Yoon

CVPR 2019
PDF
2018

Structured Set Matching Networks for One-Shot Part Labeling

Jonghyun Choi, Jayant Krishnamurthy, Aniruddha Kembhavi, Ali Farhadi

CVPR 2018 - Spotlight
PDF SuppMat Project Page Talk
2017

Are You Smarter Than A Sixth Grader? Textbook Question Answering for Multimodal Machine Comprehension

Aniruddha Kembhavi, Minjoon Seo, Dustin Schwenk, Jonghyun Choi, Ali Farhadi, Hannaneh Hajishirzi

CVPR 2017 - Spotlight
PDF · Talk · Dataset Explorer
2016

Learning Temporal Regularity in Video Sequences

Mahmudul Hasan, Jonghyun Choi, Jan Neumann, Amit K. Roy-Chowdhury, Larry S. Davis

CVPR 2016
PDF · Supplementary · Code · Video1 · Video2 · Poster

Mining Discriminative Triplets of Patches for Fine-Grained Classification

Yaming Wang, Jonghyun Choi, Vlad I. Morariu, Larry S. Davis

CVPR 2016
PDF · Poster

Knowledge Transfer with Interactive Learning of Semantic Relationships

Jonghyun Choi, Sung Ju Hwang, Leonid Sigal, Larry S. Davis

AAAI 2016
PDF · Slides