Yuqi Sun (孙玉齐)

Hi! My name is Yuqi Sun. I am currently a 5-th PhD candidate in School of Computer Science, Fudan University and under the supervision of Dr.Bo Yan. I received my B.Sc also from Fudan University in 2020.

My research interest lies in leveraging artificial intelligence techniques for data governance (AI for data)—including, but not limited to, data management, data filtering, and data synthesis—to establish a data foundation for building low-cost, high-performing AI models. My previous research focused on multi-view imaging, face images, and rendered images, with a recent shift toward scientific fields such as medical imaging. I strongly believe that data governance is one of the most critical directions for AI innovation, essential for reducing model training costs, and I aim to extend its application to more scientific domains in the future.

Email  /  CV  /  Google Scholar  /  Github

2025-03: Our new work has been published in Nature Biomedical Engineering (IF: 28.0)!
2024-07: Two paper are accepted for ACM MM24
2023-09: One paper is accepted for AAAI-24

I represent some of my publication here, and more works are ongoing. (*Equal contribution)

Medical Foundation models typically require massive datasets, but medical data collection is costly, slow, and privacy-sensitive. We demonstrate that synthetic data, generated with disease labels, can effectively pretrain medical foundation models. Our retinal model, pretrained on one million synthetic retinal images and just 16.7% of the real-world data used by RETFound (904,170 images), matches or exceeds RETFound’s performance across nine public datasets and four diagnostic tasks. We also validate this data-efficient approach by building a tuberculosis classifier on chest X-rays. Text-conditioned synthetic data boosts medical model performance and generalizability with less real data.

Our main insight is that a person's voice carries distinct identity markers, such as age and gender, which provide an essential supplement for identity-aware face inpainting. By extracting identity information from audio as guidance, our method can naturally support tasks of identity preservation and identity swapping in face inpainting.

This paper introduces a comprehensive benchmark specifically for evaluating data-effective learning in the medical field. This benchmark includes a dataset with millions of data samples from 31 medical centers (DataDEL), a baseline method for comparison (MedDEL), and a new evaluation metric (NormDEL) to objectively measure data-effective learning performance.

We recognize the shared context and mechanisms between frame supersampling and extrapolation, and present a novel framework, Space-time Supersampling (STSS). By integrating them into a unified framework, STSS can improve the overall quality with lower latency. Notably, the performance is achieved within only 4ms, saving up to 75% of time against the conventional two-stage pipeline that necessitates 17ms.

We propose Instruct-NeuralTalker, the first interactive framework to semantically edit the audio-driven talking radiance fields with simple human instructions. It supports various taking face editing tasks, including instruction-based editing, novel view synthesis, and background replacement. In addition, Instruct-NeuralTalker enables real-time rendering on consumer hardware.

This paper proposes a Multi-View Image SuperResolution (MVISR) task. It aims to increase the resolution of multiview images captured from the same scene. One solution is to apply image or video super-resolution (SR) methods to reconstruct HR results from the low-resolution (LR) input view.

Recent image-based rendering (IBR) methods usually adopt plenty of views to reconstruct dense scene geometry. However, the number of available views is limited in practice. When only few views are provided, the performance of these methods drops off significantly, as the scene geometry becomes sparse as well. Therefore, in this paper, we propose Sparse-IBRNet (SIBRNet) to perform robust IBR on sparse scene geometry by depth completion.

The limited spatial and angular resolutions in multi-view multimedia applications restrict their visual experience in practical use. In this paper, we first argue the space-angle super-resolution (SASR) problem for irregular arranged multi-view images. It aims to increase the spatial resolution of source views and synthesize arbitrary virtual high resolution (HR) views between them jointly.

Some internship experiences

• Dynamic scene sensing
• Simulator data processing and driving trajectory prediction

• Research on face skin health detection algorithm

I will upload some personal photography, videos and articles on my social media.

• Personal Photography Rednote
• DeepSeek-R1应用 Github
• Build Pre-Training Model (in medical) Github
• AIGC-3D Bilibili
• NeRF及其发展 Zhihu