Arbor — Autonomous Optimization via Hypothesis Tree Agent Skill

Autonomously improve a real artifact (code, training recipe, agent harness, data pipeline, prompt) against an objective and an evaluator…

Context cost
8.1k tokensestimated from the bundle, loaded when it triggers
Bundle
6 files · 54.6 kB1 script among them — read before you run
Licence
MIT licensethe author’s own terms
Last change
—v1.1
Servers it uses
Noneruns standalone

What it does

Autonomously improve a real artifact (code, training recipe, agent harness, data pipeline, prompt) against an objective and an evaluator, using Hypothesis Tree Refinement (HTR) from the Arbor paper. Use this whenever someone wants to iteratively optimize something over many experiments without overfitting — e.g. "get my model's eval score up", "improve this agent/harness", "tune this pipeline", "beat the baseline on this benchmark", "run a search over approaches and keep the best", "do an MLE-bench / Kaggle-style optimization", or any long-horizon "make this artifact better and don't just…

What this skill changes about the agent has not been set out here as a list. Its SKILL.md, shown below, says it in the author’s own words.

agentdata scienceprompt

The skill itself

A skill is instructions the model reads, so you can see what you are getting: below is the start of its SKILL.md. The front matter loads with every session, the body loads when the skill triggers, and the whole file comes with the install.

SKILL.md13.7 kB · preview
--- name: arbor allowed-tools: Read Write Edit Bash Agent license: MIT license metadata: version: "1.1" skill-author: K-Dense Inc. ---
11# Arbor — Autonomous Optimization via Hypothesis Tree Refinement
12
13## Overview
14
15This skill runs an **Autonomous Optimization (AO)** loop: starting from an existing artifact and a measurable objective, improve it through many rounds of experiment and evaluation — without step-by-step human supervision and without overfitting to the feedback signal. It's the right tool when the bottleneck isn't writing one good change, but *organizing dozens of trials* so that lessons accumulate instead of evaporating.
16
17It implements **Hypothesis Tree Refinement (HTR)** from *Arbor* (Jin et al., 2026). The key idea: keep the research state in a persistent **hypothesis tree** rather than in conversation history. Each node binds a hypothesis, the distilled insight it produced, and a pointer to the artifact version that realizes it. You play the long-lived **coordinator** that owns this tree and decides where to search; short-lived **executor** subagents test one hypothesis each in isolated git worktrees and report back. A **held-out merge gate** admits a change only when it improves on a *test* evaluator the search never optimized against. This is what turns trial-and-error into cumulative, auditable research.
18
19Use the scripts/tree.py state manager for all the bookkeeping (creating nodes, writing evidence, propagating insights, pruning, the merge gate, the Observe projection). It keeps the state consistent and frees you to spend judgment on what the evidence *means*.
20
21## When to use this skill
22
23Reach for Arbor when the task is **iterative improvement of a concrete artifact under an evaluator**:
24- Model training: optimizer/architecture/recipe changes to lower loss or hit a target in fewer steps.
25- Harness/agent engineering: raising pass rate or accuracy of an agent loop, search harness, or tool-use scaffold.
26- Data synthesis: improving a generation/filtering pipeline judged by downstream model behavior.
27- Benchmark optimization: MLE-bench / Kaggle-style "improve the submission" tasks.
28- Prompt/system optimization where you can score outputs automatically.
29
This is a preview of SKILL.md. Download or install the skill to get the whole thing.
In the file
SKILL.md2,032 words
Files6
LicenceMIT license
Why you can read it

Nothing in a skill executes. The client loads the text and the model follows it, so a skill can be audited the way a runbook is — by reading it.

What it costs in context

Skills are not billed by the call. They are paid for in context: every token the instructions occupy is a token your code, your diff and your conversation cannot use. Here is what this one takes and when it takes it.

≈280
always loaded
The name and description, so the model knows the skill exists and when to reach for it.
7,845
on trigger
The instruction body and 5 supporting files, read only when the skill fires.
4.1%
of a 200k window
Ten skills this size would take about 41% of the window before you open a file.
050k100k150k200k context window

8.1k tokens, estimated from the bundle at four bytes to the token, held for the rest of the session once it triggers. Heavy. Teams tend to install this one per project rather than globally, and load it only when the job comes up.

Servers bill, skills cost

A server charges by the month. A skill charges once per session, in context, and then keeps charging it for as long as the session lives.

Before and after

The same question, put to the same model twice: once as it comes, and once with these instructions loaded.

No worked example has been published for this skill yet.

The procedure it runs

The procedure has not been set out here step by step. It is in the body of its SKILL.md: the start of it is shown above, and the whole file comes with the install.

Prose, not code

These steps are written for a model to follow, not executed by a runtime. It can still be told to skip one, and it will say so when it does.

Servers it uses

None. This skill calls no MCP servers at all.

Everything it needs is in the instructions, so it works in a project with nothing connected — the model reads the file and changes how it works with what it can already reach.

It asks the agent to write files, using whatever file access your client already has. Whether it reaches the network is not declared.

What it asks for
Writes filesyes
Network accessnot declared

Read from the allowed-tools line of this skill’s own SKILL.md. It also asks for Bash, which could do either, so what is not named there is not ruled out. A skill grants no permissions of its own — it can only ask for tools your client already has.

What it will not do

Every skill is narrow, and the useful ones say where they stop. These are the jobs this one is the wrong tool for.

What this skill is not for has not been published here. Nothing is implied by that: it is a section the author has not filled in.

What is in the bundle

6 files, 54.6 kB on disk. Mostly text — the instructions the model reads — with 1 script in it that your client would run only if the instructions tell it to.

  • SKILL.md13.7 kB
  • references/arbor-upstream.md3.8 kB
  • references/executor-brief.md2.9 kB
  • references/htr-methodology.md10.5 kB
  • references/report-template.md1.6 kB
  • scripts/tree.py22.1 kB
What is not in it

A skill installs nothing and depends on nothing: it is a folder your client reads. This one carries 1 script beside the text, so the bundle is 6 files you can review in full before installing. The MIT license covers the templates and examples as well as the instructions.

Install

Installing copies the bundle into your project. Nothing runs at install time — the files sit on disk until the model reads them.

# Arbor — Autonomous Optimization via Hypothesis Tree · 8.1k tokens when loaded · macOS, Linux mkdir -p .claude/skills && t=$(mktemp -d) && curl -fsSL -o "$t/bundle.tar.gz" https://mcprush.com/api/skills/arbor-autonomous-optimization-via-hypothesis-tree/bundle.tar.gz && tar -xzf "$t/bundle.tar.gz" -C "$t" && [ -d "$t/arbor-autonomous-optimization-via-hypothesis-tree" ] && { [ ! -e .claude/skills/arbor-autonomous-optimization-via-hypothesis-tree ] || { mv .claude/skills/arbor-autonomous-optimization-via-hypothesis-tree "$t/.previous" && echo "Previous copy moved to $t/.previous"; }; } && mv "$t/arbor-autonomous-optimization-via-hypothesis-tree" .claude/skills/ && echo "Installed .claude/skills/arbor-autonomous-optimization-via-hypothesis-tree"
On Windows, or any OS with Node 20+
npx mcprush@latest skill add stephenokj78/arbor-autonomous-optimization-via-hypothesis-tree

Windows PowerShell says 'running scripts is disabled on this system'? Run Set-ExecutionPolicy -Scope CurrentUser RemoteSigned once, or type npx.cmd instead of npx (codex.cmd, gemini.cmd, grok.cmd likewise). PowerShell 7 needs neither. Writes to .claude/skills/arbor-autonomous-optimization-via-hypothesis-tree/ in the current project. For every project instead, run mkdir -p ~/.claude/skills && t=$(mktemp -d) && curl -fsSL -o "$t/bundle.tar.gz" https://mcprush.com/api/skills/arbor-autonomous-optimization-via-hypothesis-tree/bundle.tar.gz && tar -xzf "$t/bundle.tar.gz" -C "$t" && [ -d "$t/arbor-autonomous-optimization-via-hypothesis-tree" ] && { [ ! -e ~/.claude/skills/arbor-autonomous-optimization-via-hypothesis-tree ] || { mv ~/.claude/skills/arbor-autonomous-optimization-via-hypothesis-tree "$t/.previous" && echo "Previous copy moved to $t/.previous"; }; } && mv "$t/arbor-autonomous-optimization-via-hypothesis-tree" ~/.claude/skills/ && echo "Installed ~/.claude/skills/arbor-autonomous-optimization-via-hypothesis-tree" (macOS, Linux) — or add --global to the npx line. The curl line replaces .claude/skills/arbor-autonomous-optimization-via-hypothesis-tree/ only after the download succeeds, so files left there by another skill of the same name, or by an older release, do not mix in. A copy already there is moved aside, not deleted, and the line prints where. It appears as arbor in Gemini CLI, Codex, Copilot and Grok (its own name); Claude Code lists it by the folder name, arbor-autonomous-optimization-via-hypothesis-tree.

Which clients pick it up on their own

A skill is a folder of text. Most of these read a skills folder and pick it up without being told; the rest take the same folder another way — an upload in the app, a parameter on an API call — and then choose it by its description just the same.

Claude Code.claude/skills/
Claude DesktopCustomize › Skills
ChatGPTSkills › Create › Upload
Cursor.cursor/skills/
VS Code.github/skills/
Codex CLI.agents/skills/
Gemini CLI.gemini/skills/
Grok Build.grok/skills/
Microsoft CopilotSkills › Upload a skill
PerplexityComputer › Skills › Upload a skill
DeepSeek Harness.dsh/skills/
Zed.agents/skills/
Devin Desktop.devin/skills/
Windsurf (legacy).windsurf/skills/
OpenAI Agents SDKInstructions or sandbox Skills
HTTP / APIa request parameter
This release
Version1.1
Publishedno release date on file
PriceFree
Referencestephenokj78/arbor-autonomous-optimization-via-hypothesis-tree

Versions

v1.1 is what is on the shelf; no release here carries a date. Instructions change more often than APIs do — a skill can be rewritten entirely without anything it depends on moving.

v1.1
  • No earlier releases have been published to the marketplace.
Pinning

The install command always fetches the release that is current the day you run it — v1.1 today — and cannot ask for an earlier one. The copy on your disk does not change until you run it again.

Reviews

—no reviews yet

Nobody has reviewed this skill yet. The rating is the mean of the reviews written here, so there is none until somebody writes the first.

Sign in to review it

A review is tied to an account so it can be answered, edited and taken down by the person who wrote it.

Sign in
Who can post

Anybody with an account, one review each. It carries the version that was current when you wrote it, and the publisher may reply once.

Publisher
Servers0
Claim this skill