Orchestra-Research

Reserved and on-demand GPU cloud instances for ML training and inference.

Framework for building LLM-powered applications with agents, chains, and RAG.

LLM observability platform for tracing, evaluation, and monitoring.

Implements and trains LLMs using Lightning AI's LitGPT with 20+ pretrained architectures (Llama, Gemma, Phi, Qwen, Mistral).

Runs LLM inference on CPU, Apple Silicon, and consumer GPUs without NVIDIA hardware.

Expert guidance for fine-tuning LLMs with LLaMA-Factory - WebUI no-code, 100+ models, 2/3/4/5/6/8-bit QLoRA, multimodal support

Meta's 7-8B specialized moderation model for LLM input/output filtering. 6 safety categories - violence/hate, sexual content, weapons…

Data framework for building LLM applications with RAG.

Large Language and Vision Assistant. Enables visual instruction tuning and image-based conversations. Combines CLIP vision encoder with…

Extend context windows of transformer models using RoPE, YaRN, ALiBi, and position interpolation techniques.

State-space model with O(n) complexity vs Transformers' O(n²). 5× faster inference, million-token sequences, no KV cache.

Trains large language models (2B-462B parameters) using NVIDIA Megatron-Core with advanced parallelism strategies.