Analytics & Monitoring Agent Skills for HTTP / API

Mixture of Agents - Use multiple AI models collaboratively to improve response quality.

End-to-end methodology for AI agents and software engineers to add machine learning algorithms to existing non-ML codebases.

Use when the user wants an autonomous ML research loop that does more than blindly try changes.

Guides ML experiment logging, versioning, and reproducibility using tools like MLflow, Weights & Biases, and DVC for systematic model…

Designs and implements production-grade ML pipeline infrastructure: configures experiment tracking with MLflow or Weights & Biases…

ML optimization sweet spot principle: "More is not always better".

When to activate: MLflow, experiment tracking, model registry, autologging, MLflow serving, artifact storage, model signatures, ML lifecycle

Configure MLflow tracing for Claude Code.

Show the current MLflow tracing configuration for Claude Code.

Design or audit a model-agnostic evaluation harness for an LLM or multimodal LLM on a clinical task (radiology report generation, visual…

MLOps and Platform: 23 concepts, no maths assumed.

When to activate: MLOps, DVC, model versioning, drift detection, Evidently, WhyLogs, retraining, ML CI/CD, model monitoring

Use when packaging an accepted MLSys paper's code, configs, and measurement scripts for the venue's post-acceptance artifact evaluation…

Use when deciding whether a project belongs at MLSys rather than OSDI, SOSP, NSDI, ASPLOS, ATC, EuroSys, or the ML conferences, testing…

Choose an ML model or provider when a user asks which checkpoint, router, local model, adapter, tokenizer, or inference backend fits a…

Generate the documentation an engineer-built medical-imaging model must carry — a Model Card (Mitchell et al. 2019), a Datasheet for its…

Compare AI models across benchmarks, pricing, and capabilities.

Avoid ensembling models with significantly different performance.

Build this skill allows AI assistant to evaluate machine learning models

Measure which capability tier a model can be trusted with and where its reasoning budget stops paying, then write it into the…

Save, load, inspect, minify, and share scvi-tools model artifacts