# SPRITE: From Static Mockups to Engine-Ready Game UI

> Transforms game-interface screenshots into editable engine assets through hierarchical YAML, visual grounding, asset extraction, and Unity UXML/USS synthesis, with evaluation on a curated game-UI benchmark and review by three senior UI/UX designers.

- Authors: Yunshu Bai; RuiHao Li; Hao Zhang; Chien Her Lim; Ming Yan; Mengtian Li
- Venue: CHI EA 2026 (poster/extended abstract)
- Status: Conference paper
- Publication / posting date: April 13, 2026
- Date source: Crossref publisher-deposited online publication date
- First arXiv submission: March 18, 2026
- arXiv: 2604.18591
- Reviewed arXiv version: v1
- DOI: 10.1145/3772363.3798742
- Sources reviewed: 2026-10-16
- Added to the catalog: 2026-10-16
- Original paper: <https://doi.org/10.1145/3772363.3798742>
- PDF: <https://baiyunshu.github.io/sprite.github.io/Source/chiea26-516.pdf>
- Project: <https://baiyunshu.github.io/sprite.github.io/>
- BibTeX: <https://awesomerea.org/papers/citations/paper-sprite-game-ui.bib>
- Catalog page: <https://awesomerea.org/papers/paper-sprite-game-ui/>
- Record JSON: <https://awesomerea.org/papers/paper-sprite-game-ui/record.json>
- Chinese version: [简体中文](https://awesomerea.org/zh/papers/paper-sprite-game-ui/index.md)

## Scope and limitations

The generated interactions cover basic hover, toggle, and click behavior. Complex temporal and drag-and-drop logic remain outside scope, and translucent overlap or ambiguous diegetic layouts can fail. This is game-UI prototyping, not complete gameplay reconstruction; the official page still labels code as coming soon.

## Why it fits this collection

Adds game-specific screenshot-to-engine reconstruction while distinguishing visual and structural recovery from full game behavior.

## Publication and review notes

Published as a CHI 2026 poster/extended abstract. The publisher title has “SPRITE:From” and “GameUI”; arXiv and the project page normalize these spaces. arXiv/Hugging Face report a March 18 first submission despite the 2604 identifier; the April 13 publication date is independently verified in Crossref. No implementation link is verified.

## Primary sources

1. <https://arxiv.org/abs/2604.18591>
2. <https://arxiv.org/html/2604.18591v1>
3. <https://api.crossref.org/works/10.1145/3772363.3798742>
4. <https://baiyunshu.github.io/sprite.github.io/>

## About this entry

Reviewed against the paper and its primary sources. Cite the original authors using the linked paper or BibTeX.
Original editorial content: MIT. Linked projects, papers and assets retain their own rights and licenses.