Tool
web-crawler ReverseAgent
web-crawler includes ReverseAgent for investigating website JavaScript and request signing. It hooks fetch, XHR, cookies, crypto.subtle and webpack activity in a browser, captures traffic, separates webpack modules and uses an LLM to reimplement a discovered signature algorithm in Python.
- Targets
- Website
- Category
- Website analysis tools
- Relationship
- Foundation tool
- Sources reviewed
Requirements & limits
- Prerequisites: Python 3.10 or newer.
- Prerequisites: ReverseAgent uses CamoufoxFetcher and a compatible LLM service; optional browser dependencies are required for that path.
- License: MIT license.
About this entry
The description was reviewed against primary sources.
Primary sources
- README.md GitHub · xiaomaozjj666/web-crawler · Revision 36dca34
- docs/architecture.md GitHub · xiaomaozjj666/web-crawler · Revision 36dca34
More in Websites
- Mirrorframe · Tool
- unwebpack-sourcemap · Tool
- Wirebrowser · Tool
- Thug · Tool
- spy-debugger · Tool
- Dinosaur runner: recovering one acceleration rule · Case study