Research

Old photo before and after modernization
Modernizing Old Photos Using Multiple References via Photorealistic Style Transfer

Agus Gunawan, Soo Ye Kim, Hyeonjun Sim, Jae-Ho Lee, Munchurl Kim
CVPR, 2023
paper / arXiv / project page / code / video

We present old photo modernization using multiple references by performing stylization and enhancement in a unified manner. In order to modernize old photos, we propose a novel multi-reference-based old photo modernization (MROPM) framework consisting of a network MROPM-Net and a novel synthetic data generation scheme.

Group normalization training behavior comparison
Understanding and Improving Group Normalization

Agus Gunawan, Xu Yin, Kang Zhang
Preprint, 2022
arXiv / code

We find that GN’s inferior performance against Batch normalization (BN) is caused by: unstable training performance and sensitivity to distortion, whether it comes from external noise or perturbations introduced by the regularization. In addition, we found that GN can only help the neural network training in some specific period, unlike BN, which helps the network throughout the training. To solve these issues, we propose a new normalization layer by combining the benefit of GN and BN.

Real image denoising before and after test-time adaptation
Test-time Adaptation for Real Image Denoising via Meta-transfer Learning

Agus Gunawan*, Muhammad Adi Nugroho*, Se Jin Park*
Preprint, 2022
arXiv / code

We propose to improve real image denoising performance through a better learning strategy that can enable test-time adaptation on the multi-task network using two-stage learning. The first stage pre-train the network using meta-auxiliary learning to get better meta-initialization. Meanwhile, the second stage is a meta-learning strategy to fine-tune (meta-transfer learning) the network to enable test-time adaptation on real noisy images.

Experience

Date Company Role
Sembly Machine Learning Engineer (Search - NLP)
Airy Software Engineer (Data - NLP)
GLAIR AI Engineer Intern (Recommendation)
Bukalapak Machine Learning Engineer Intern (NLP)

Projects

Government Project on Colorization

  • Exemplar-based Image Colorization via Local Photorealistic Style Transfer
  • Any-scale Colorization using Implicit Representation
  • Diffusion-based Conditional Image Colorization
  • Colorization
  • Style Transfer
  • Implicit Representation
  • Diffusion