SEGUE: Visual Signal as Exclusive Guidance for One-Shot Transition Effect Generation (results gallery)

Transition effect generation

Transition-effect-generation results from SEGUE, grouped by transition class and reference effect video. Each cell shows the given start and end endpoints (stacked) and the generated transition.

Shadow smoke

reference

start

end

endpoint

SEGUE

start

end

endpoint

SEGUE

Fire lava

ref 1/2

reference

start

end

endpoint

SEGUE

start

end

endpoint

SEGUE

ref 2/2

reference

start

end

endpoint

SEGUE

start

end

endpoint

SEGUE

Display transition

reference

start

end

endpoint

SEGUE

start

end

endpoint

SEGUE

Melt transition

ref 1/2

reference

start

end

endpoint

SEGUE

start

end

endpoint

SEGUE

ref 2/2

reference

start

end

endpoint

SEGUE

start

end

endpoint

SEGUE

Flame

reference

start

end

endpoint

SEGUE

start

end

endpoint

SEGUE

Water bending

reference

start

end

endpoint

SEGUE

start

end

endpoint

SEGUE

Flying camera transition

reference

start

end

endpoint

SEGUE

start

end

endpoint

SEGUE

Earth wave

reference

start

end

endpoint

SEGUE

start

end

endpoint

SEGUE

Air bending

reference

start

end

endpoint

SEGUE

start

end

endpoint

SEGUE

Giant grab

reference

start

end

endpoint

SEGUE

start

end

endpoint

SEGUE

Transition effect generation: comparison with previous work

Both endpoint frames and a reference effect video are given. Left: the reference effect video, then the given start and end endpoints (stacked). Right: the generated transition from SEGUE and the two prior-work systems it was compared against.

Flame

reference

start

end

endpoints

SEGUE

Base LTX-2

refVFX

Display transition

reference

start

end

endpoints

SEGUE

Base LTX-2

refVFX

Earth wave

reference

start

end

endpoints

SEGUE

Base LTX-2

refVFX

Air bending

reference

start

end

endpoints

SEGUE

Base LTX-2

refVFX

Shadow smoke

reference

start

end

endpoints

SEGUE

Base LTX-2

refVFX

Fire lava

reference

start

end

endpoints

SEGUE

Base LTX-2

refVFX

Water bending

reference

start

end

endpoints

SEGUE

Base LTX-2

refVFX

Visual effect transfer

Visual-effect-transfer results from SEGUE, grouped by transition class and reference effect video. Each cell shows the given start endpoint (no end endpoint is given) and the generated result.

Chest burst ribbons

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Avocado pulp aura

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Body meteorite crystal

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Chest light field

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Fist heat blast

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Northern lights

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Amethyst sword from palm

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Dark mist wings from back

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Arm chip serpent

reference

start

no endno end given

endpoint

SEGUE

Portal

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Earth element

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Animalization

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Gas transformation

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Color rain

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Luminous gaze

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Explosion

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Wireframe

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Cotton cloud

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Saint glow

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Train rush

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Amber roots from feet

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Bile aura hands

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Amber crystal wings on back

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Super fast run

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Chest erupting shield

reference

start

no endno end given

endpoint

SEGUE

start

no endno end given

endpoint

SEGUE

Visual effect transfer: comparison with previous work

One endpoint frame and a reference effect video are given. Left: the reference effect video and the given start endpoint. Right: the generated result from SEGUE and the three prior-work systems it was compared against.

Train rush