Metacognitive Monitoring in AI Contexts Agent Skill

Design metacognitive checkpoints that prevent AI-assisted learning from bypassing genuine understanding.

Context cost
6.5k tokensestimated from the bundle, loaded when it triggers
Bundle
1 file · 25.8 kBtext throughout, nothing executable
Licence
not declarednone named by its author
Last change
—v1.0
Servers it uses
Noneruns standalone

What it does

Design metacognitive checkpoints that prevent AI-assisted learning from bypassing genuine understanding. Use when students use AI tools and may overestimate their own comprehension.

What this skill changes about the agent has not been set out here as a list. Its SKILL.md, shown below, says it in the author’s own words.

ai-literacycalibrationdunning-krugermetacognitionoverconfidenceself-regulationthiedewinne

The skill itself

A skill is instructions the model reads, so you can see what you are getting: below is the start of its SKILL.md. The front matter loads with every session, the body loads when the skill triggers, and the whole file comes with the install.

SKILL.md25.8 kB · preview
--- # AGENT SKILLS STANDARD FIELDS (v2) name: metacognitive-monitoring-ai-contexts disable-model-invocation: false user-invocable: true effort: medium # EXISTING FIELDS skill_id: "ai-learning-science/metacognitive-monitoring-ai-contexts" skill_name: "Metacognitive Monitoring in AI Contexts" domain: "ai-learning-science" version: "1.0" evidence_strength: "moderate" evidence_sources: - "Thiede et al. (2003) — Summarizing can improve metacomprehension accuracy" - "Winne & Hadwin (1998) — Studying as self-regulated learning (SRL model)" - "Dunning et al. (2003) — Why people fail to recognize their own incompetence (Dunning-Kruger)" - "Bjork et al. (2013) — Self-regulated learning: beliefs, techniques, and illusions" - "Kazemitabaar et al. (2023) — Studying the effect of AI code generators on supporting novice learners in introductory programming" input_schema: required: - field: "ai_learning_context" type: "string" - field: "metacognitive_risk" type: "string" optional: - field: "student_level" type: "string" - field: "subject_area" type: "string" - field: "ai_tool" type: "string" - field: "assessment_context" type: "string" output_schema: type: "object" fields: - field: "metacognitive_diagnosis" type: "object" - field: "monitoring_interventions" type: "array" - field: "ai_usage_guidelines" type: "object" - field: "assessment_alignment" type: "object" chains_well_with: - "self-explanation-prompt-designer" - "ai-feedback-design-principles" - "productive-failure-desirable-difficulty-designer" - "formative-assessment-loop-designer" - "ai-learning-boundary-mapper" - "ai-output-critical-audit-designer" teacher_time: "4 minutes" tags: ["metacognition", "self-regulation", "Dunning-Kruger", "overconfidence", "AI-literacy", "Winne", "Thiede", "calibration"] ---
69# Metacognitive Monitoring in AI Contexts
70
71## What This Skill Does
72
73Analyses how AI tool use in a specific learning context might distort students' metacognitive monitoring — their ability to accurately assess what they know and don't know — and designs interventions to maintain metacognitive accuracy. This is one of the most urgent challenges in AI-enabled education. When a student uses an AI tool to complete work, they may experience a fluency illusion: the work looks good, the answers are correct, the text is fluent — and the student concludes "I understand this." But the STUDENT didn't do the cognitive work; the AI did. The student's sense of understanding is calibrated to the PRODUCT (which is good) rather than to their OWN knowledge (which may be unchanged). Bjork et al. (2013) showed that learners are systematically poor at judging their own learning — they confuse familiarity with understanding, and fluent performance with durable knowledge. AI tools dramatically amplify this miscalibration because they produce fluent, correct output that the student may mistake for evidence of their own competence. The output includes a metacognitive diagnosis (how AI use distorts self-assessment in this specific context), monitoring interventions (strategies to improve metacognitive accuracy), AI usage guidelines (when to use and when to restrict AI), and assessment alignment (ensuring tests measure student knowledge, not AI-assisted performance).
74
75## Evidence Foundation
76
77Winne & Hadwin (1998) developed the most comprehensive model of self-regulated learning (SRL), which places metacognitive monitoring at its centre. Their model describes a cycle: the learner sets goals, applies strategies, monitors whether the strategies are working, and adjusts. Effective learning depends critically on the MONITORING stage — the learner's ability to accurately judge whether they are understanding the material. When monitoring is inaccurate (the learner thinks they understand when they don't), the entire self-regulation cycle breaks down: they stop studying too early, choose inappropriate strategies, and are surprised by poor assessment results. Thiede et al. (2003) showed that metacomprehension accuracy (the correlation between judged and actual understanding) is typically very low — around r = 0.27. However, they found that certain activities dramatically improve accuracy: delayed summary writing, keyword generation, and any task that forces the learner to generate from memory rather than recognise from the text. The key principle: metacognitive accuracy improves when the monitoring task requires RETRIEVAL, not just recognition. Dunning et al. (2003) documented the Dunning-Kruger effect: the least competent individuals are the MOST overconfident in their abilities, because they lack the knowledge needed to recognise their own incompetence. In AI contexts, this effect may be amplified: a student who doesn't understand a concept cannot distinguish their own (poor) understanding from the AI's (excellent) output. Bjork et al. (2013) reviewed the psychology of self-regulated learning and identified several "illusions of competence" — conditions where learners feel they've learned more than they actually have. These include: familiarity (having seen something before feels like understanding it), fluency (material that's easy to process feels like it's well-learned), and performance (doing well now feels like permanent learning). AI tools can trigger all three illusions simultaneously: the AI-produced output is familiar (the student saw it being generated), fluent (LLMs produce polished text), and high-performing (the answers are correct). Kazemitabaar et al. (2023) studied how AI code generators (like Copilot) affect novice programming learners and found that while AI-assisted students completed tasks faster and with fewer errors, they showed weaker understanding on subsequent tasks without AI support. The students had learned to use the AI, not to program. This is a direct empirical demonstration of the metacognitive risk: AI assistance produced the ILLUSION of learning without the REALITY of learning.
78
79## Input Schema
80
81The teacher must provide:
82- **AI learning context:** How students are using AI. *e.g. "Year 12 students use ChatGPT to help write A-level English Literature essays. They paste in essay questions and use the AI output as a starting point, then edit and refine" / "Year 9 students use an AI maths tutor that solves equations step-by-step when they get stuck. They can ask for help at any point" / "Year 10 students use AI to generate revision notes from their textbook, then study from the AI-generated notes"*
83- **Metacognitive risk:** The specific concern. *e.g. "Students believe they 'understand' the literary analysis because the essay looks good, but when asked to discuss the text in class without AI, they can't articulate the argument" / "Students believe they 'can solve equations' because they get correct answers with AI help, but fail when the AI isn't available" / "Students believe they 'know' the content because they read well-organised AI revision notes, but the reading produced familiarity, not understanding"*
84
85Optional (injected by context engine if available):
86- **Student level:** Year group and proficiency
87- **Subject area:** The curriculum subject
This is a preview of SKILL.md. Download or install the skill to get the whole thing.
In the file
SKILL.md3,718 words
Files1
Licencenot declared
Why you can read it

Nothing in a skill executes. The client loads the text and the model follows it, so a skill can be audited the way a runbook is — by reading it.

What it costs in context

Skills are not billed by the call. They are paid for in context: every token the instructions occupy is a token your code, your diff and your conversation cannot use. Here is what this one takes and when it takes it.

≈810
always loaded
The name and description, so the model knows the skill exists and when to reach for it.
5,640
on trigger
The instruction body, read only when the skill fires.
3.2%
of a 200k window
Ten skills this size would take about 32% of the window before you open a file.
050k100k150k200k context window

6.5k tokens, estimated from the bundle at four bytes to the token, held for the rest of the session once it triggers. Heavy. Teams tend to install this one per project rather than globally, and load it only when the job comes up.

Servers bill, skills cost

A server charges by the month. A skill charges once per session, in context, and then keeps charging it for as long as the session lives.

Before and after

The same question, put to the same model twice: once as it comes, and once with these instructions loaded.

No worked example has been published for this skill yet.

The procedure it runs

The procedure has not been set out here step by step. It is in the body of its SKILL.md: the start of it is shown above, and the whole file comes with the install.

Prose, not code

These steps are written for a model to follow, not executed by a runtime. It can still be told to skip one, and it will say so when it does.

Servers it uses

None. This skill calls no MCP servers at all.

Everything it needs is in the instructions, so it works in a project with nothing connected — the model reads the file and changes how it works with what it can already reach.

Its SKILL.md does not declare which tools it asks the agent for, so what it touches is whatever the instructions themselves ask for — read them before you install it.

What it asks for
Writes filesnot declared
Network accessnot declared

This SKILL.md carries no allowed-tools line, so neither is declared. A skill grants no permissions of its own — it can only ask for tools your client already has.

What it will not do

Every skill is narrow, and the useful ones say where they stop. These are the jobs this one is the wrong tool for.

What this skill is not for has not been published here. Nothing is implied by that: it is a section the author has not filled in.

What is in the bundle

1 file, 25.8 kB on disk. A bundle is text throughout: the instructions the model reads, plus the templates it fills in.

  • SKILL.md25.8 kB
What is not in it

No dependencies and nothing executable: a skill is text the agent reads, so the bundle is 1 file you can review in full before installing.

Install

Installing copies the bundle into your project. Nothing runs at install time — the files sit on disk until the model reads them.

# Metacognitive Monitoring in AI Contexts · 6.5k tokens when loaded · macOS, Linux mkdir -p .claude/skills && t=$(mktemp -d) && curl -fsSL -o "$t/bundle.tar.gz" https://mcprush.com/api/skills/metacognitive-monitoring-in-ai-contexts/bundle.tar.gz && tar -xzf "$t/bundle.tar.gz" -C "$t" && [ -d "$t/metacognitive-monitoring-in-ai-contexts" ] && { [ ! -e .claude/skills/metacognitive-monitoring-in-ai-contexts ] || { mv .claude/skills/metacognitive-monitoring-in-ai-contexts "$t/.previous" && echo "Previous copy moved to $t/.previous"; }; } && mv "$t/metacognitive-monitoring-in-ai-contexts" .claude/skills/ && echo "Installed .claude/skills/metacognitive-monitoring-in-ai-contexts"
On Windows, or any OS with Node 20+
npx mcprush@latest skill add garethmanning/metacognitive-monitoring-in-ai-contexts

Windows PowerShell says 'running scripts is disabled on this system'? Run Set-ExecutionPolicy -Scope CurrentUser RemoteSigned once, or type npx.cmd instead of npx (codex.cmd, gemini.cmd, grok.cmd likewise). PowerShell 7 needs neither. Writes to .claude/skills/metacognitive-monitoring-in-ai-contexts/ in the current project. For every project instead, run mkdir -p ~/.claude/skills && t=$(mktemp -d) && curl -fsSL -o "$t/bundle.tar.gz" https://mcprush.com/api/skills/metacognitive-monitoring-in-ai-contexts/bundle.tar.gz && tar -xzf "$t/bundle.tar.gz" -C "$t" && [ -d "$t/metacognitive-monitoring-in-ai-contexts" ] && { [ ! -e ~/.claude/skills/metacognitive-monitoring-in-ai-contexts ] || { mv ~/.claude/skills/metacognitive-monitoring-in-ai-contexts "$t/.previous" && echo "Previous copy moved to $t/.previous"; }; } && mv "$t/metacognitive-monitoring-in-ai-contexts" ~/.claude/skills/ && echo "Installed ~/.claude/skills/metacognitive-monitoring-in-ai-contexts" (macOS, Linux) — or add --global to the npx line. The curl line replaces .claude/skills/metacognitive-monitoring-in-ai-contexts/ only after the download succeeds, so files left there by another skill of the same name, or by an older release, do not mix in. A copy already there is moved aside, not deleted, and the line prints where. It appears as metacognitive-monitoring-ai-contexts in Gemini CLI, Codex, Copilot and Grok (its own name); Claude Code lists it by the folder name, metacognitive-monitoring-in-ai-contexts.

Which clients pick it up on their own

A skill is a folder of text. Most of these read a skills folder and pick it up without being told; the rest take the same folder another way — an upload in the app, a parameter on an API call — and then choose it by its description just the same.

Claude Code.claude/skills/
Claude DesktopCustomize › Skills
ChatGPTSkills › Create › Upload
Cursor.cursor/skills/
VS Code.github/skills/
Codex CLI.agents/skills/
Gemini CLI.gemini/skills/
Grok Build.grok/skills/
Microsoft CopilotSkills › Upload a skill
PerplexityComputer › Skills › Upload a skill
DeepSeek Harness.dsh/skills/
Zed.agents/skills/
Devin Desktop.devin/skills/
Windsurf (legacy).windsurf/skills/
OpenAI Agents SDKInstructions or sandbox Skills
HTTP / APIa request parameter
This release
Version1.0
Publishedno release date on file
PriceFree
Referencegarethmanning/metacognitive-monitoring-in-ai-contexts

Versions

v1.0 is what is on the shelf; no release here carries a date. Instructions change more often than APIs do — a skill can be rewritten entirely without anything it depends on moving.

v1.0
  • No earlier releases have been published to the marketplace.
Pinning

The install command always fetches the release that is current the day you run it — v1.0 today — and cannot ask for an earlier one. The copy on your disk does not change until you run it again.

Reviews

—no reviews yet

Nobody has reviewed this skill yet. The rating is the mean of the reviews written here, so there is none until somebody writes the first.

Sign in to review it

A review is tied to an account so it can be answered, edited and taken down by the person who wrote it.

Sign in
Who can post

Anybody with an account, one review each. It carries the version that was current when you wrote it, and the publisher may reply once.

Publisher
Servers0
Claim this skill