2025 · Conference paper
DecompileBench: A Comprehensive Benchmark for Evaluating Decompilers in Real-World Scenarios
Evaluates traditional and LLM-based decompilers using functions from real programs, runtime behavioral checks, and an LLM-assisted assessment of analyst-facing code understandability.
Scope and limitations
The evaluated corpus has 23,400 functions from 130 programs. Fuzzing-based checks have finite coverage, and understandability scores depend partly on an LLM judge. The artifact warns that rebuilt OSS-Fuzz projects can differ from the paper's versions.
Why it fits this collection
Helps readers separate readable decompiler output from behaviorally faithful output when choosing or evaluating reverse-engineering tools.
Publication and review details
- Venue
- Findings of ACL 2025
- Status
- Conference paper
- Publication / posting date
- July 2025
- Date source
- ACL proceedings publication month
- First arXiv submission
- May 16, 2025
- arXiv
- 2505.11340
- Reviewed arXiv version
- v1
- DOI
- 10.18653/v1/2025.findings-acl.1194
The published ACL record and PDF use 'Zhang Bolun'; the arXiv record uses 'Bolun Zhang'. The paper's Jennieett/DecompileBench link now redirects to vul337/DecompileBench. This is distinct from Tan et al.'s Decompile-Bench (arXiv:2505.12668).
Sources reviewed
Reviewed against the paper and its primary sources. Cite the original authors using the linked paper or BibTeX.
Related entries
Matched by the same code repository or publication identifier.
- DecompileBench (Findings of ACL 2025) Curated resource
Discussed in the survey
Primary sources
- https://aclanthology.org/2025.findings-acl.1194/
- https://aclanthology.org/2025.findings-acl.1194.pdf
- https://arxiv.org/abs/2505.11340
- https://github.com/vul337/DecompileBench
- README.md GitHub · vul337/DecompileBench · Revision 761c651