Browser & Desktop Automation

Automates web browsers and Windows desktop applications for testing, scraping, and security research.

You say
Install this skill Read the source first Free Written by zhaoxuya520 · unverified publisher
Context cost
4.3k tokensestimated from the bundle, loaded when it triggers
Bundle
2 files · 17.3 kBtext throughout, nothing executable
Licence
MITfree to use
Last change
no release on file
Servers it uses
Noneruns standalone

What it does

统一自动化入口。覆盖浏览器自动化(Playwright)和 Windows 桌面应用自动化(OpenReverse)。 浏览器场景:打开网页、点击、填表、爬取、截图、自动化登录、渗透页面交互。 桌面场景:操作 IDA/x64dbg 等 GUI 工具、Windows UI Automation、视觉驱动交互、桌面应用网络抓包。 触发关键词:浏览器自动化、桌面自动化、打开网页、填表、爬取、截图、自动化登录、Playwright、agent-browser、headless、OpenReverse、UIA、CUA、桌面操作、Windows 自动化。

Installed, it changes the agent in these ways.

What this skill changes about the agent is not written down here yet. The listing was collected from its source, and the description is in its own SKILL.md.

Workflow

Runs a procedure end to end.

browserautomationtestingsecurityresearch

The skill itself

This is the whole product. A skill is instructions the model reads, so there is nothing behind the listing you cannot see first — the front matter loads with every session, and the body below it loads when the skill triggers.

SKILL.md7.5 kB · 243 lines
--- name: browser-automation description: | 统一自动化入口。覆盖浏览器自动化(Playwright)和 Windows 桌面应用自动化(OpenReverse)。 浏览器场景:打开网页、点击、填表、爬取、截图、自动化登录、渗透页面交互。 桌面场景:操作 IDA/x64dbg 等 GUI 工具、Windows UI Automation、视觉驱动交互、桌面应用网络抓包。 触发关键词:浏览器自动化、桌面自动化、打开网页、填表、爬取、截图、自动化登录、Playwright、agent-browser、headless、OpenReverse、UIA、CUA、桌面操作、Windows 自动化。 ---
10# 自动化操作 (Desktop & Browser Automation)
11
12## ACTION REQUIRED(读完后立刻执行)
13
141. NOW:确认当前任务是否命中本 skill 的适用范围
152. NOW:读取 ../tool-index.md,校验工具可用性和实际路径
163. NEXT:缺工具时调用 bootstrap,不要猜路径
174. ACT:进入"工作流"第一步并执行,不要停在确认状态
18
19## 适用范围
20
21当任务属于以下场景时使用本 skill:
22
23### 浏览器场景(Playwright / agent-browser)
24- 打开网页并操作页面元素(点击、填表、提交)
25- 爬取页面内容或截图
26- 自动化登录流程
27- 渗透测试中与 Web 页面交互(提交 payload、触发 XSS)
28- 验证码页面的自动化处理
29- 批量表单提交
30
31### 桌面应用场景(OpenReverse)
32- 操作 Windows 桌面应用(IDA Pro、x64dbg、Wireshark 等)
33- 需要视觉驱动交互(CUA 模式)
34- 需要结构化 UI 操作(UIA 模式)
35- 桌面应用的网络流量观察(内置 mitmproxy)
36- 自动化逆向工具的 GUI 操作
37- 黑盒测试桌面软件
38
39### 与其他工具的分工
40
41| 场景 | 用什么 |
42|------|--------|
43| 操作网页(浏览器内) | **Playwright / agent-browser** |
44| 操作桌面应用(Windows GUI) | **OpenReverse** |
45| 抓包分析、HTTP 请求捕获 | anything-analyzer 或 OpenReverse network lane |
46| JS 断点、Hook、CDP 调试 | jshookmcp |
47| 定位签名算法、补环境复现 | js-reverse |
48
49简单判断:
50- 目标是网页 → Playwright
51- 目标是 Windows 桌面应用 → OpenReverse
52- 两者都需要 → 组合使用
53
54---
55
56## Part 1: 浏览器自动化(Playwright / agent-browser)
57
58### 核心工作流
59
60```bash
61# 1. 打开页面
62agent-browser open <url>
63
64# 2. 获取可交互元素(返回 @e1, @e2... 引用)
65agent-browser snapshot -i
66
67# 3. 用引用操作元素
68agent-browser click @e1
69agent-browser fill @e2 "text"
70
71# 4. 完成后关闭
72agent-browser close
73```
74
75### 命令参考
76
77```bash
78# 导航
79agent-browser open <url>
80agent-browser close
81
82# 页面快照
83agent-browser snapshot # 完整无障碍树
84agent-browser snapshot -i # 仅可交互元素(推荐)
85
86# 交互操作
87agent-browser click @e1
88agent-browser fill @e2 "text"
89agent-browser type @e2 "text"
90agent-browser press Enter
91agent-browser scroll down 500
92
93# 获取信息
94agent-browser get text @e1
95agent-browser get title
96agent-browser get url
97
98# 等待
99agent-browser wait @e1
100agent-browser wait 2000
101agent-browser wait --load networkidle
102```
103
104### 注意事项
105- 必须执行 agent-browser close,否则进程泄漏
106- 操作前先 snapshot,不要猜元素引用
107- 提交表单后用 wait --load networkidle 等页面稳定
108
109---
110
111## Part 2: 桌面应用自动化(OpenReverse)
112
113### 概述
114
115[OpenReverse](https://github.com/zhexulong/openreverse) 是面向 AI Agent 的桌面交互与证据采集框架,支持:
116- **UIA 模式**:Windows UI Automation,结构化桌面控件操作
117- **CUA 模式**:视觉驱动交互(Computer Use Agent),适合复杂 GUI
118- **网络观察**:内置 mitmproxy 代理 + 本地抓取
119
120### 交互模式选择
121
122| 模式 | 适合场景 | 底层 |
123|------|---------|------|
124| UIA | 目标应用有标准 Windows 控件(按钮、文本框、列表) | Windows UI Automation API |
125| CUA | 目标应用 UI 复杂或非标准控件(IDA 的反汇编视图、自定义渲染界面) | 视觉识别 + 鼠标键盘 |
126
127### 网络观察模式
128
129| 模式 | 适合场景 |
130|------|---------|
131| Proxy Lane | 目标应用可以配置代理(推荐) |
132| Local Lane | 目标应用无法走代理,需要本地抓取 |
133
134### 安装与配置
135
136```bash
137# 1. Clone 项目
138git clone https://github.com/zhexulong/openreverse.git
139cd openreverse
140
141# 2. 安装依赖
142npm install
143
144# 3. 接入 Agent 宿主(Claude Code / Codex / Zed)
145npm run init:agents -- --target=all /path/to/project
146
147# 4. 安装 CUA runtime(如果需要视觉驱动模式)
148npm run install:cua-runtime
149npm run doctor:cua-runtime
150
151# 5. 安装网络观察依赖(如果需要抓包)
152npm run install:mitmproxy
153npm run doctor:network
154```
155
156### 常见组合
157
158| 需求 | 配置 |
159|------|------|
160| 只操作桌面应用 | UIA 或 CUA,不接网络 lane |
161| 操作桌面应用 + 抓包 | UIA/CUA + proxy lane |
162| 操作桌面应用 + 本地抓取 | UIA/CUA + local lane |
163
164### 逆向场景示例
165
166```text
167场景:自动化操作 IDA Pro 进行批量分析
168
1691. 用 OpenReverse CUA 模式打开 IDA Pro
1702. 自动加载目标二进制
1713. 等待分析完成
1724. 通过 UI 操作导出函数列表
1735. 同时用 network lane 观察 IDA 的网络行为(如 Lumina 请求)
174```
175
176```text
177场景:自动化操作 x64dbg 调试
178
1791. 用 OpenReverse UIA 模式启动 x64dbg
1802. 加载目标程序
1813. 设置断点
1824. 运行并观察寄存器/内存变化
1835. 截图保存证据
184```
185
186---
187
188## 按需自举(On-Demand Bootstrap)
189
190### 自动化能力边界
191
192| 工具 | 可自动安装 | 安装方式 | 说明 |
193|------|-----------|---------|------|
194| Playwright | ✓ | npm + npx playwright install | 浏览器自动化引擎 |
195| agent-browser CLI | ✓ | npm install -g agent-browser | 浏览器操作 CLI |
196| Node.js | ✓ | winget | 前置依赖 |
197| OpenReverse | ✗ | 手动 clone + npm install | 实验阶段,依赖较重 |
198| mitmproxy | ✗ | 手动安装 | OpenReverse 网络观察依赖 |
199
200### 自举触发
201
202- 浏览器操作缺 Playwright → 自动 bootstrap
203- 桌面操作需要 OpenReverse → 引导用户手动安装(给出完整步骤)
204
205### OpenReverse 手动安装引导
206
207如果 AI 检测到需要桌面应用自动化但 OpenReverse 未安装:
208
209```markdown
210⚠️ **需要 OpenReverse 进行桌面应用自动化**
211
212**安装步骤**:
2131. git clone https://github.com/zhexulong/openreverse.git
2142. cd openreverse && npm install
2153. npm run init:agents -- --target=all <你的项目路径>
2164. 如需视觉模式:npm run install:cua-runtime
2175. 如需网络观察:npm run install:mitmproxy
218
219**验证**:npm run doctor:cua-runtimenpm run doctor:network
220```
221
222---
223
224## 路由上下文
225
226**上游入口**: skills/SKILL.md(总控)、routing.md
227**适用场景**: 任何需要自动化操作浏览器或桌面应用的任务
228**下游出口**:
229- 抓到的请求需要分析 → anything-analyzerjs-reverse
230- 需要 JS 调试/Hook → jshookmcp
231- 需要还原签名算法 → js-reverse
232- 桌面应用是逆向工具 → ida-reverse/
233
234**同级关联模块**: js-reverse(浏览器操作后可能需要分析 JS)、ida-reverse(OpenReverse 可以自动化操作 IDA GUI)
235
236
237## 任务完成自检(声称完成前 MUST 通过)
238
239- [ ] 我是否执行了工作流中的每一步(而不是只阅读)?
240- [ ] 我是否基于 tool-index 使用了真实工具路径?
241- [ ] 我是否产出了可复现证据(命令/脚本/截图/报告)?
242- [ ] 我是否完成并回写了 RULES 要求的 Checklist 项?
243
In the file
SKILL.md688 words
Files2
LicenceMIT
Why you can read it

Nothing in a skill executes. The client loads the text and the model follows it, so a skill can be audited the way a runbook is — by reading it.

What it costs in context

Skills are not billed by the call. They are paid for in context: every token the instructions occupy is a token your code, your diff and your conversation cannot use. Here is what this one takes and when it takes it.

≈80
always loaded
The name and description, so the model knows the skill exists and when to reach for it.
4,245
on trigger
The instruction body and 1 supporting file, read only when the skill fires.
2.2%
of a 200k window
Ten skills this size would take about 22% of the window before you open a file.
050k100k150k200k context window

4.3k tokens, estimated from the bundle at four bytes to the token, held for the rest of the session once it triggers. Heavy. Teams tend to install this one per project rather than globally, and load it only when the job comes up.

Servers bill, skills cost

A server charges by the month. A skill charges once per session, in context, and then keeps charging it for as long as the session lives.

Before and after

The same question, put to the same model twice: once as it comes, and once with these instructions loaded.

No worked example has been published for this skill yet.

Adoption
Installsnone yet
Ratingno reviews yet

The procedure it runs

The procedure has not been published here. It is in the skill’s own SKILL.md, which its author has not sent to the marketplace yet.

Prose, not code

These steps are written for a model to follow, not executed by a runtime. It can still be told to skip one, and it will say so when it does.

Servers it uses

None. This skill calls no MCP servers at all.

Everything it needs is in the instructions, so it works in a project with nothing connected — the model reads the file and changes how it works with what it can already reach.

It writes no files and reaches no network. All it changes is how the model reasons and writes.

What it asks for
Writes filesno
Network accessno

Read from the allowed-tools line of this skill’s own SKILL.md. A skill grants no permissions of its own — it can only ask for tools your client already has.

What it will not do

Every skill is narrow, and the useful ones say where they stop. These are the jobs this one is the wrong tool for.

What this skill is not for has not been published here. Nothing is implied by that: it is a section the author has not filled in.

What is in the bundle

2 files, 17.3 kB on disk. A bundle is text throughout: the instructions the model reads, plus the templates it fills in.

  • SKILL.md7.5 kB
  • references/playwright-cheatsheet.md9.8 kB
What is not in it

No dependencies and nothing executable: a skill is text the agent reads, so the bundle is 2 files you can review in full before installing. The MIT licence covers the templates and examples as well as the instructions.

Install

Installing copies the bundle into your project. Nothing runs at install time — the files sit on disk until the model reads them.

# Browser & Desktop Automation · 4.3k tokens when loaded npx mcprush@latest skill add zhaoxuya520/browser-desktop-automation

Writes to .claude/skills/browser-desktop-automation/ in the current project. Add --global to put it in your home directory instead, for every project.

Which clients pick it up on their own

A skill is a folder of text. A client with a skills folder reads it without being told; everywhere else the same text works, it is just handed to the model rather than found.

Claude Code.claude/skills/
Claude Desktop
ChatGPT
Cursor.cursor/skills/
VS Code.github/skills/
Codex CLI.agents/skills/
Gemini CLI.gemini/skills/
Grok.grok/skills/
Zed.agents/skills/
Windsurf.windsurf/skills/
Agent SDK.claude/skills/
HTTP / API
This release
Versionnot versioned
Publishedno release date on file
PriceFree
Referencezhaoxuya520/browser-desktop-automation

Versions

Its author publishes no version number, so there is nothing here to pin to: what you install is the folder as it stands today. Instructions change more often than APIs do — a skill can be rewritten entirely without anything it depends on moving.

v
  • No earlier releases have been published to the marketplace.
Pinning

Nothing to pin to: this skill carries no version number of its own. What you install is what the folder holds on the day you install it.

Reviews

no reviews yet · no installs yet

Nobody has reviewed this skill yet. The rating is the mean of the reviews written here, so there is none until somebody writes the first.

Who can post

Only accounts that have had the skill installed for fourteen days, so a review is written after living with it rather than after reading it. Publishers may reply once.

Who wrote it

ZH
zhaoxuya520

Publishes on mcprush.

0 servers listed1 skill listednot claimed
Profile
Publisher
Servers0
Claim this skill