Gemini Omni turns rough doodles into physically realistic scenes
A rough sketch plus a ion of what should happen allowed to add realistic lighting, materials, motion, and physical around the drawing. The original doodle stayed flat and simple instead of being redrawn in a polished style.
Successful examples included a die smashing through an adventure-film temple ruin, a fork sword-fighting a giant octopus, and a stick-figure superhero flying through flaming hoops from a realistic slingshot. Other scenes showed a cassette tape unfolding into a roller coaster and a cowboy riding an exploding soda can like a mechanical bull.
Details such as dust rising behind the die, fire catching on the hoops, and the can bending under the cowboy's weight made the surroundings feel real. The effect depended on the contrast between the unchanged doodle and the realistic chaos reacting to it.
Key points
- The input combined a rough doodle with a ion of the desired action.
- The original doodle remained visible instead of being polished or replaced.
- Realistic lighting, materials, dust, fire, and object damage were added around it.
- The test covered five playful combinations, including a die and temple, a fork and octopus, and a cassette-tape roller coaster.