# From Visual Widgets to UI Code: Efficient Tool-Grounded Generation

> WidgetGen reconstructs widget screenshots as React JSX. OCR text boxes and color palettes guide whole-widget layout reasoning and optional chart generation before one terminal render; generated render/code pairs also support model fine-tuning.

- Authors: Houston H. Zhang; Tao Zhang; Li Gu; Linfeng Ye; Yuanhao Yu; Xinxin Zuo; Yang Wang; Zhixiang Chi
- Venue: MUCG @ ECCV 2026
- Status: Conference accepted
- Publication / posting date: 2026 (exact date not verified)
- Date source: The official 2026 MUCG workshop program confirms inclusion; a proceedings publication date was not verified.
- First arXiv submission: August 12, 2026
- arXiv: 2608.12611
- Reviewed arXiv version: v1
- DOI: 10.48550/arXiv.2608.12611
- Sources reviewed: 2026-10-20
- Added to the catalog: 2026-10-20
- Original paper: <https://arxiv.org/abs/2608.12611>
- PDF: <https://arxiv.org/pdf/2608.12611v1>
- BibTeX: <https://awesomerea.org/papers/citations/paper-widgetgen.bib>
- Catalog page: <https://awesomerea.org/papers/paper-widgetgen/>
- Record JSON: <https://awesomerea.org/papers/paper-widgetgen/record.json>
- Chinese version: [简体中文](https://awesomerea.org/zh/papers/paper-widgetgen/index.md)

## Scope and limitations

The main comparison uses six models and 1,000 test widgets from one dataset. Its nine image-based metrics do not test interaction, accessibility or maintainability. The supervision experiment covers six Qwen-family checkpoints; broader UI and model-family generalization remains open.

## Why it fits this collection

Studies evidence-assisted recovery of executable interface code from compact visual references.

## Publication and review notes

The official MUCG 2026 program lists this paper; proceedings publication was not verified, and OpenReview required browser verification. The arXiv paper is CC BY 4.0. No dedicated implementation or weight link was found in the reviewed paper/program; Widget2Code is the separate benchmark source.

## Primary sources

1. <https://arxiv.org/abs/2608.12611v1>
2. <https://arxiv.org/html/2608.12611v1>
3. <https://mllm-mucg.github.io/ECCV2026/>

## About this entry

Reviewed against the paper and its primary sources. Cite the original authors using the linked paper or BibTeX.
Original editorial content: MIT. Linked projects, papers and assets retain their own rights and licenses.