2026 · Conference paper
SPRITE: From Static Mockups to Engine-Ready Game UI
Transforms game-interface screenshots into editable engine assets through hierarchical YAML, visual grounding, asset extraction, and Unity UXML/USS synthesis, with evaluation on a curated game-UI benchmark and review by three senior UI/UX designers.
Scope and limitations
The generated interactions cover basic hover, toggle, and click behavior. Complex temporal and drag-and-drop logic remain outside scope, and translucent overlap or ambiguous diegetic layouts can fail. This is game-UI prototyping, not complete gameplay reconstruction; the official page still labels code as coming soon.
Why it fits this collection
Adds game-specific screenshot-to-engine reconstruction while distinguishing visual and structural recovery from full game behavior.
Publication and review details
- Venue
- CHI EA 2026 (poster/extended abstract)
- Status
- Conference paper
- Publication / posting date
- April 13, 2026
- Date source
- Crossref publisher-deposited online publication date
- First arXiv submission
- March 18, 2026
- arXiv
- 2604.18591
- Reviewed arXiv version
- v1
- DOI
- 10.1145/3772363.3798742
Published as a CHI 2026 poster/extended abstract. The publisher title has “SPRITE:From” and “GameUI”; arXiv and the project page normalize these spaces. arXiv/Hugging Face report a March 18 first submission despite the 2604 identifier; the April 13 publication date is independently verified in Crossref. No implementation link is verified.
Sources reviewed
Reviewed against the paper and its primary sources. Cite the original authors using the linked paper or BibTeX.