AlbumVSR: Identity-Preserving Face Video Super-Resolution from a Personal Photo Album
Abstract
Severe blur, downsampling, noise, and compression can erase the identity cues needed to faithfully restore a person's face. We therefore use photographs of the same person as an external source of identity. AlbumVSR conditions a frozen, one-step streaming diffusion transformer on a personal album. We use four MagFace/CLIP set tokens to encode the album, and 64 texture tokens which come from a fused UV atlas rendered at the current window's estimated face pose. These tokens are appended to the tr...
Description / Details
Severe blur, downsampling, noise, and compression can erase the identity cues needed to faithfully restore a person's face. We therefore use photographs of the same person as an external source of identity. AlbumVSR conditions a frozen, one-step streaming diffusion transformer on a personal album. We use four MagFace/CLIP set tokens to encode the album, and 64 texture tokens which come from a fused UV atlas rendered at the current window's estimated face pose. These tokens are appended to the transformer's cached cross-attention context. On an identity-disjoint VoxCeleb2 benchmark with heavy synthetic degradation, AlbumVSR raises ArcFace similarity to the ground truth from 0.586 to 0.670 and face PSNR from 24.98 to 26.71 dB. On the 91 test identities, its mean identity similarity is higher than that of all 14 baselines.
Source: arXiv:2610.39001v1 - http://arxiv.org/abs/2610.39001v1 PDF: https://arxiv.org/pdf/2610.39001v1 Original Link: http://arxiv.org/abs/2610.39001v1
Please sign in to join the discussion.
No comments yet. Be the first to share your thoughts!
Oct 30, 2026
Biomedical Engineering
Engineering
0