publications

2025

1. 

   RestoreAnyone: Identity-consistent Face Video Restoration with Reference Guidance

   Ziyan Chen, Liangbin Xie, Yihao Liu, Zheyuan Li, Fanghua Yu, and 1 more author

   Under Review of AAAI 2026, 2025

   PDF

2. 

   DiffVSR: Enhancing Real-world Video Super-resolution with Diffusion Models for Advanced Visual Quality and Temporal Consistency

   Xiaohui Li, Yihao Liu, Shuo Cao, Ziyan Chen, Shaobin Zhuang, and 4 more authors

   In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2025

   HTML PDF Video

   

2024

1. 

   DiffBIR: Toward Blind Image Restoration with Generative Diffusion Prior

   Xinqi Lin^*, Jingwen He^*, Ziyan Chen, Zhaoyang Lyu, Bo Dai, and 4 more authors

   In Proceedings of the European Conference on Computer Vision (ECCV), 2024

   Abs HTML PDF

   

   We present DiffBIR, a general restoration pipeline that could handle different blind image restoration tasks in a unified framework. DiffBIR decouples blind image restoration problem into two stages: 1) degradation removal: removing image-independent content; 2) information regeneration: generating the lost image content. Each stage is developed independently but they work seamlessly in a cascaded manner. In the first stage, we use restoration modules to remove degradations and obtain high-fidelity restored results. For the second stage, we propose IRControlNet that leverages the generative ability of latent diffusion models to generate realistic details. Specifically, IRControlNet is trained based on specially produced condition images without distracting noisy content for stable generation performance. Moreover, we design a region-adaptive restoration guidance that can modify the denoising process during inference without model re-training, allowing users to balance quality and fidelity through a tunable guidance scale. Extensive experiments have demonstrated DiffBIR’s superiority over state-of-the-art approaches for blind image super-resolution, blind face restoration and blind image denoising tasks on both synthetic and real-world datasets. The code is available at https://github.com/XPixelGroup/DiffBIR.

2. 

   Towards real-world video face restoration: A new benchmark

   Ziyan Chen^*, Jingwen He^*, Xinqi Lin, Yu Qiao, and Chao Dong

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2024

   Abs HTML PDF

   Blind image face restoration (BFR) has significantly progressed over the last several years while the real-world video face restoration (VFR) which is more challenging for more complex face motions such as moving gaze directions and facial orientations involved remains unsolved. Typical BFR methods are evaluated on privately synthesized datasets or self-collected real-world low-quality face images which are limited in their coverage of real-world video frames. In this work we introduce a new benchmark dataset named FOS with a taxonomy of Full Occluded and Side faces from both video frames and images with not only synthetic and real-world degradations covered but also rich facial data contents such as various expressions poses and ethnicity involved. Given the established datasets we benchmark both the state-of-the-art BFR methods and the video super resolution (VSR) methods to comprehensively study current approaches revealing their potential and limitations in VFR tasks. For performance assessment we not only employ the commonly used general image quality assessment (IQA) metrics but also explore face IQA metrics by leveraging an elaborately designed user study. With extensive experimental results and detailed analysis provided we gain insights from the successes and failures of current methods. In addition these studies also pose challenges in current BFR approaches and shed light on future VFR research.

2023

1. 

   T-SEA: Transfer-Based Self-Ensemble Attack on Object Detection

   Huang Hao^*, Ziyan Chen^*, Huanran Chen^*, Yongtao Wang, and Kevin Zhang

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Jun 2023

   Abs PDF Video

   

   Compared to query-based black-box attacks, transfer-based black-box attacks do not require any information of the attacked models, which ensures their secrecy. However, most existing transfer-based approaches rely on ensembling multiple models to boost the attack transferability, which is time-and resource-intensive, not to mention the difficulty of obtaining diverse models on the same task. To address this limitation, in this work, we focus on the single-model transfer-based black-box attack on object detection, utilizing only one model to achieve a high-transferability adversarial attack on multiple black-box detectors. Specifically, we first make observations on the patch optimization process of the existing method and propose an enhanced attack framework by slightly adjusting its training strategies. Then, we analogize patch optimization with regular model optimization, proposing a series of self-ensemble approaches on the input data, the attacked model, and the adversarial patch to efficiently make use of the limited information and prevent the patch from overfitting. The experimental results show that the proposed framework can be applied with multiple classical base attack methods (eg, PGD and MIM) to greatly improve the black-box transferability of the well-optimized patch on multiple mainstream detectors, meanwhile boosting white-box performance.