Analytics & Monitoring Agent Skills

Wire LangSmith tracing and custom metric callbacks into a LangChain\

Manage LangChain 1.0 prompts like code \u2014 LangSmith prompt hub versioning,\n\

Plan and execute LangChain SDK upgrades and migrations.

Dispatch LangChain 1.0 chain/agent events to external systems \u2014\

Expert in Langfuse - the open-source LLM observability platform.

Execute Langfuse primary workflow: Tracing LLM calls and spans.

Configure Langfuse enterprise organization management and access control.

Create a minimal working Langfuse trace example.

Execute complex Langfuse migrations including data migration and platform

Optimize Langfuse tracing performance for high-throughput applications.

Implement Langfuse rate limiting, batching, and backoff patterns.

Langfuse SDK best practices, patterns, and idiomatic usage.

Persist LangGraph agent state correctly with MemorySaver and PostgresSaver\

Guide for using the langium-ai (LAI) CLI to generate language descriptors, synthesize system prompts, run evaluations, and iteratively…

LangSmith API for LLM observability, tracing, evaluation, and dataset management.

This skill should be used when the user asks to \"share memory between agents\", \"KV cache compaction for multi-agent\", \"orchestrator…

Guides services where a single logging call fans out to multiple side effects - error tracking (e.g.

Use when: (1) You have a strong hand-crafted baseline (heuristic, rule-based agent, domain-expert system) and want to improve it with ML…

Structured guide for setting up A/B tests with mandatory gates for hypothesis, metrics, and execution readiness.

This skill should be used when the user asks to "implement LLM-as-judge", "compare model outputs", "create evaluation rubrics", "mitigate…

This skill should be used when the user asks to "model agent mental states", "implement BDI architecture", "create belief-desire-intention…