OmniTransfer

All-in-one Framework for Spatio-temporal Video Transfer

Pengze Zhang Yanze Wu^* Mengtian Li Xu Bai Songtao Zhao^†
Fulong Ye Chong Mou Xinghui Li Zhuowei Chen Qian He Mingyuan Gao

^* Corresponding author, ^† Project leader,

This work is purely academic and non-commercial.
Demo reference images/videos are from public domains or AI-generated.
For copyright concerns, please contact us for the removal of relevant content.

Research Paper GitHub

Demo Video

Built upon Wan 2.1, OmniTransfer seamlessly unifies spatial appearance (ID and style) and temporal video transfer tasks (effect, motion and camera movement) within a single framework, and exhibits strong generalization across unseen task combinations.

Effect Video Transfer

Zero-Shot Prompt-Free VFX Mastery: Replicate intricate visual effects from unseen videos directly onto your images with seamless temporal consistency.

Reference Image

Reference Video

☕

OmniTransfer

☕

Reference Image

Reference Video

☕

OmniTransfer

☕

Reference Image

Reference Video

☕

OmniTransfer

☕

Reference Image

Reference Video

☕

OmniTransfer

☕

Reference Image

Reference Video

☕

OmniTransfer

☕

Reference Image

Reference Video

☕

OmniTransfer

☕

Motion Video Transfer

Pose-Free Animation: Driven static images by directly injecting fluid, complex motion from unseen sources without explicit pose extraction.

Reference Image

Reference Video

☕

OmniTransfer

☕

Reference Image

Reference Video

☕

OmniTransfer

☕

Reference Image

Reference Video

☕

OmniTransfer

☕

Reference Image

Reference Video

☕

OmniTransfer

☕

Reference Image

Reference Video

☕

OmniTransfer

☕

Reference Image

Reference Video

☕

OmniTransfer

☕

Camera Video Transfer

Trajectory-Free Camera Control: Mirror master-class cinematography from unseen clips onto static landscapes without explicit trajectory or parameter estimation.

Reference Image

Reference Video

☕

OmniTransfer

☕

Reference Image

Reference Video

☕

OmniTransfer

☕

Reference Image

Reference Video

☕

OmniTransfer

☕

Reference Image

Reference Video

☕

OmniTransfer

☕

Reference Image

Reference Video

☕

OmniTransfer

☕

Reference Image

Reference Video

☕

OmniTransfer

☕

ID Video Transfer

Dynamic Identity Anchoring: Synthesize consistent personas by distilling cross-temporal and multi-angle ID cues from reference videos.

Reference Video

☕

OmniTransfer

a blonde-haired woman in a black top, gently touches and bends down to the flowers picturesque background of more greenery and white flowers

☕

Reference Video

☕

OmniTransfer

a man with a rugged beard, wearing a leather jacket, riding a vintage motorcycle along a desert highway.

☕

Reference Video

☕

OmniTransfer

Sitting on a comfortable beige upholstered sofa in a room with a gray-blue background wall, a figure wearing a green plaid shirt has white round table in front of them, holding a piece of paper in one hand and supporting their head with the other, showing a slightly distressed expression, the tables are adorned with notebooks, pens, and small black objects, the figure makes slight movements throughout the scene, occasionally flipping through the paper and fidgeting with items on the table, with a green potted plant standing quietly beside the sofa.

☕

Reference Video

☕

OmniTransfer

A person in a light blue denim jacket and white pants sits on a beach chair at sunset, reading a book and occasionally looking up to watch the sun dip below the horizon, with the sky turning shades of orange, and the sound of waves crashing on the shore.

☕

Reference Video

☕

OmniTransfer

At a desk, a figure sits with an open book in front of them, surrounded by notebooks, colored pencils, and a pencil holder filled with vibrant colors. The figure's hands move gently as they read, shifting the pencils or flipping through pages. In the background, a figure wearing an apron moves casually through the kitchen, completing the warm, homey scene with a quiet energy.

☕

Reference Video

☕

OmniTransfer

A person wearing a light brown leather jacket and dark jeans sat on a park bench, playing guitar and singing a soft folk song. There are two boxes next to me with some coins, and some people stop to listen.

☕

Style Video Transfer

Temporal-Style Distillation: Generate consistent stylized videos by inheriting cross-frame aesthetic cues from reference clips.

Reference Video

☕

OmniTransfer

A curly - haired person in a white short - sleeved shirt stands in front of a pink background. At first, the eyes are closed and the expression looks a bit sleepy. Then the mouth slowly opens wide as if yawning, and the hand raises to cover the mouth. During the yawn, the body posture remains basically stable.

☕

Reference Video

☕

OmniTransfer

The picture shows a metallic arched passage. The setting - sun shines through the grids on the side of the passage, creating a warm - yellow halo. Several pedestrians are walking inside the passage, and their figures are slightly blurred due to the light and movement. The ground of the passage is flat, and there is a railing on one side. As the picture progresses, a person wearing red clothes and carrying a backpack enters the passage. The overall atmosphere is tranquil and a bit warm.

☕

Reference Video

☕

OmniTransfer

A woman sits on the stairs, wearing a white patterned - top and dark pants. The staircase handrail is faintly visible in the background. There is a lit candle behind, giving off a soft light. At first, the woman looks sad with her eyes slightly closed. Then she slowly raises her hand to touch her face and hold her head, seemingly immersed in painful emotions. The overall atmosphere is somewhat depressing.

☕

Reference Video

☕

OmniTransfer

Indoors, a black Mercedes - Benz sedan is parked on a metal platform. Behind the car are several motorcycles in colors like red and blue. A man wearing a black top and jeans, holding a piece of paper. Then the trunk of the car slowly opens. The man stands still and looks away. The whole scene seems to be a vehicle display or inspection.

☕

Reference Video

☕

OmniTransfer

The video shows a person watering a row of plants on a balcony, tilting the watering can slowly over each pot.

☕

Reference Video

☕

Reading book under the tree

OmniTransfer

☕

X Video Transfer

Beyond Observed Boundaries: OmniTransfer generalizes to unprecedented scenarios from multi-person motion synchronization to unseen task combinations.

Reference Image

Reference Video

☕

OmniTransfer

☕

Reference Image

Reference Video

☕

OmniTransfer

☕

Reference Video (Style)

☕

Reference Video (ID)

☕

OmniTransfer

Playing the guitar.

☕

Reference Video (ID)

☕

Reference Video (Effect)

☕

OmniTransfer

☕

OmniTransfer with Seedance 1.0

OmniTransfer now supports Seedance 1.0, enabling the delivery of more intricate and high-impact visual effects.

Reference Image

Reference Video

☕

OmniTransfer

☕

Reference Image

Reference Video

☕

OmniTransfer

☕

Reference Image

Reference Video

☕

OmniTransfer

☕

Reference Image

Reference Video

☕

OmniTransfer

☕

Reference Image

Reference Video

☕

OmniTransfer

☕

Reference Image

Reference Video

☕

OmniTransfer

☕

Video Transfer Comparisons

Effect Video Transfer

Motion Video Transfer

Camera Video Transfer

ID Video Transfer

Style Video Transfer

Acknowledgements

We would like to thank Junjie Luo, Pengqi Tu, Qi Chen, Qichao Sun and Wanquan Feng for their insightful discussions and valuable data contributions.

Ethical Considerations

The reference images and videos adopted in these demo videos are either sourced from public domains or generated by AI models. As this is a purely academic research project, these materials are used solely for academic demonstration to verify the technical capabilities of this research. If there are any concerns, please contact us and we will delete the relevant content in time.

BibTeX

@misc{zhang2026omnitransfer,
            title={OmniTransfer: OmniTransfer: All-in-one Framework for Spatio-temporal Video Transfer}, 
            author={Pengze Zhang, Yanze Wu, Mengtian Li, Xu Bai, Songtao Zhao, Fulong Ye, Chong Mou, Xinghui Li, Zhuowei Chen, Qian He and Mingyuan Gao},
            year={2026},
            eprint={2601.14250},
            archivePrefix={arXiv},
            primaryClass={cs.CV},
            url={https://arxiv.org/abs/2601.14250}, 
        }