Publications
i-SRT: Aligning Large Multimodal Models for Videos by Iterative Self-Retrospective Judgment
Daechul Ahn, Yura Choi, San Kim, Youngjae Yu, Dongyeop Kang, Jonghyun Choi
arXiv 2406
PDF
An Information Theoretic Metric for Evaluating Unlearning Models
Dongjae Jeon, Wonje Jeung, Taeheon Kim. Albert No, Jonghyun Choi
arXiv 2405
PDF
Long-Tailed Recognition on Binary Networks by Calibrating A Pre-trained Model
Jihun Kim, Dahyun Kim, Hyungrok Jung, Taeil Oh, Jonghyun Choi
arXiv 2404
PDF
Just Say the Name: Online Continual Learning with Category Names Only via Data Generation
Minhyuk Seo, Diganta Misra, Seongwon Cho, Minjae Lee, Jonghyun Choi
arXiv 2403
PDF
ReALFRED: An Embodied Instruction Following Benchmark in Photo-Realistic Environments
Taewoong Kim, Cheolhong Min, Byeonghwi Kim, Jinyeon Kim, Wonje Jeung, Jonghyun Choi
ECCV 2024
PDF · Project Page · Code · Data-1 · Data-2
Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
Daechul Ahn, Yura Choi, Youngjae Yu, Dongyeop Kang, Jonghyun Choi
ACL 2024 - Oral
PDF · Project Page · Code · Demo (Running per request)
DataFreeShield: Defending Adversarial Attacks without Training Data
Hyeyoon Lee, Kanghyun Choi, Dain Kwon, SunJong Park, Mayoore Selvarasa Jaiswal, Noseong Park, Jonghyun Choi, Jinho Lee
ICML 2024
PDF
Online Continual Learning for Interactive Instruction Following Agents
Byeonghwi Kim*, Minhyuk Seo*, Jonghyun Choi
ICLR 2024
PDF · Project Page
PAC-FNO: Parallel-Structured All-Component Fourier Neural Operators for Recognizing Low-Quality Images
Jinsung Jeon, Hyundong Jin, Jonghyun Choi, Sanghyun Hong, Dongeun Lee, Kookjin Lee, Noseong Park
ICLR 2024
PDF
Operator-learning-inspired Modeling of Neural Ordinary Differential Equations
Woojin Cho, Seunghyeon Cho, Hyundong Jin, Jinsung Jeon, Kookjin Lee, Sanghyun Hong, Dongeun Lee, Jonghyun Choi, Noseong Park
AAAI 2024
PDF
Context-Aware Planning and Environment-Aware Memory for Instruction Following Embodied Agents
Byeonghwi Kim, Jinyeon Kim, Yuyeong Kim, Cheolhong Min, Jonghyun Choi
ICCV 2023
(CVPR 2023 Embodied AI Workshop - 1st Place Winner)
PDF ·
Supp ·
Project Page ·
CVPR 2023 Workshop Challenge Page
Story Visualization by Online Text Augmentation with Context Memory
Daechul Ahn, Daneul Kim, Gwangmo Song, Seung Hwan Kim, Honglak Lee, Dongyeop Kang, Jonghyun Choi
ICCV 2023
PDF · Supp · Project Page · Code
Online Continual Learning on Hierarchical Label Expansion
Byung Hyun Lee, Okchul Jung, Jonghyun Choi, Se Young Chun
ICCV 2023
PDF · Supp · Project Page · Code
Cost-effective On-device Continual Learning over Memory Hierarchy with Miro
Xinyue Ma, Suyeon Jeong, Minjia Zhang, Di Wang, Jonghyun Choi, Myeongjae Jeon
MobiCom 2023
PDF (arXiv), (in ACM)
MEnsA: Mix-up Ensemble Average for Unsupervised Multi Target Domain Adaptation on 3D Point Clouds
Ashish Sinha, Jonghyun Choi
CVPR 2023 - Workshop on Continual Learning in Computer Vision
PDF
Ask4Help: Learning to Leverage an Expert for Embodied Tasks
Kunal Pratap Singh, Luca Weihs, Alvaro Herrasti, Jonghyun Choi, Aniruddha Kembhavi, Roozbeh Mottaghi
NeurIPS 2022
PDF · Conference page
Language Guided Meta-Control for Embodied Instruction Following
Divyam Goel, Kunal Pratap Singh, Jonghyun Choi
CVPR 2022 - Workshop on Embodied AI (EAI-2022)
PDF
Online Continual Learning on Class Incremental Blurry Task Configuration with Anytime Inference
Hyunseo Koh, Dahyun Kim, Jung-Woo Ha, Jonghyun Choi
ICLR 2022
PDF
Iconary: A Pictionary-based Game for Testing Multimodal Communication with Drawings and Text
Christopher Clark, Jordi Salvador, Dustin Schwenk, Derrick Bonafilia, Mark Yatskar, Eric Kolve, Alvaro Herrasti, Jonghyun Choi, Sachin Mehta, Sam Skjonsberg, Carissa Schoenick, Aaron Sarnat, Hannaneh Hajishirzi, Aniruddha Kembhavi, Oren Etzioni and Ali Farhadi
EMNLP 2021 - Oral
Paper coming soon
Factorizing Perception and Policy for Interactive Instruction Following
Kunal Pratap Singh*, Suvaansh Bhambri*, Byeonghwi Kim*, Roozbeh Mottaghi, Jonghyun Choi
ICCV 2021
(CVPR Embodied AI Workshop 2021 - 2nd Place winner)
PDF
SuppMat
Code
Project Page
(Previous version: MOCA: A Modular Object-Centric Approach for Interactive Instruction Following)
Event-Intensity Stereo: Estimating Depth by the Best of Both Worlds
S. Mohammad Mostafavi I., Kuk-Jin Yoon, Jonghyun Choi
ICCV 2021
(CVPR Event Vision Workshop 2021 - 1st Place winner)
PDF
E2SRI: Learning to Super Resolve Intensity Images from Events
S. Mohammad Mostafavi I., Yeong-woo Nam, Jonghyun Choi, Kuk-Jin Yoon
IEEE Transactions on Pattern Analysis and Machine Intelligence
PDF
BNAS v2: Learning Architectures for Binary Networks with Empirical Improvements
Dahyun Kim, Kunal Pratap Singh, Jonghyun Choi
CVPR 2021 Workshop for Binary Networks for Computer Vision
PDF
Acceleration of Semiconductor Device Simulation With Approximate Solutions Predicted by Trained Neural Networks
Seung-Cheol Han, Jonghyun Choi, Sung-Min Hong
IEEE Transactions on Electron Devices 2021
PDF
Learning to Super Resolve Intensity Images from Events
S. Mohammad Mostafavi I., Jonghyun Choi, Kuk-Jin Yoon
CVPR 2020 - Oral
PDF Supp-Mat. Code (in prep.) Video
Confidence Calibration for Incremental Learning
Dongmin Kang, Yeonsik Jo , Yeongwoo Nam, Jonghyun Choi
IEEE Access
PDF
Event-based High Dynamic Range Image and Very High Frame Rate Video Generation using Conditional Generative Adversarial Networks
S. Mohammad Mostafavi I., Lin Wang, Yo-Sung Ho, Kuk-Jin Yoon
CVPR 2019
PDF
Structured Set Matching Networks for One-Shot Part Labeling
Jonghyun Choi, Jayant Krishnamurthy, Aniruddha Kembhavi, Ali Farhadi
CVPR 2018 - Spotlight
PDF SuppMat Project Page Talk
Are You Smarter Than A Sixth Grader? Textbook Question Answering for Multimodal Machine Comprehension
Aniruddha Kembhavi, Minjoon Seo, Dustin Schwenk, Jonghyun Choi, Ali Farhadi, Hannaneh Hajishirzi
