Star on GitHubStar1.1k stars

2026 · Conference paper

SPRITE: From Static Mockups to Engine-Ready Game UI

Transforms game-interface screenshots into editable engine assets through hierarchical YAML, visual grounding, asset extraction, and Unity UXML/USS synthesis, with evaluation on a curated game-UI benchmark and review by three senior UI/UX designers.

Scope and limitations

The generated interactions cover basic hover, toggle, and click behavior. Complex temporal and drag-and-drop logic remain outside scope, and translucent overlap or ambiguous diegetic layouts can fail. This is game-UI prototyping, not complete gameplay reconstruction; the official page still labels code as coming soon.

Why it fits this collection

Adds game-specific screenshot-to-engine reconstruction while distinguishing visual and structural recovery from full game behavior.

Publication and review details

Venue
CHI EA 2026 (poster/extended abstract)
Status
Conference paper
Publication / posting date
April 13, 2026
Date source
Crossref publisher-deposited online publication date
First arXiv submission
March 18, 2026
arXiv
2604.18591
Reviewed arXiv version
v1
DOI
10.1145/3772363.3798742

Published as a CHI 2026 poster/extended abstract. The publisher title has “SPRITE:From” and “GameUI”; arXiv and the project page normalize these spaces. arXiv/Hugging Face report a March 18 first submission despite the 2604 identifier; the April 13 publication date is independently verified in Crossref. No implementation link is verified.

Sources reviewed

Reviewed against the paper and its primary sources. Cite the original authors using the linked paper or BibTeX.

Report an outdated entry Suggest a translation fix

Discussed in the survey

Primary sources

  1. https://arxiv.org/abs/2604.18591
  2. https://arxiv.org/html/2604.18591v1
  3. https://api.crossref.org/works/10.1145/3772363.3798742
  4. https://baiyunshu.github.io/sprite.github.io/
↑↓ move↵ open⌘↵ new tab