Skip to main content

🚅 LiteLLMDocs Enterprise 🚀 Hosted

LiteLLM - Getting Started
💥 OpenAI Proxy Server
Completion()
Embedding(), Image Generation(), Assistants(), Moderation(), Audio Transcriptions(), TTS()
Supported Models & Providers
Custom Pricing - Sagemaker, etc.
Router - Load Balancing, Fallbacks
[BETA] Request Prioritization
Rules
Setting API Keys, Base, Version
Budget Manager
Contributing - UI
Secret Manager
Completion Token Usage & Cost
🔥 Load Test LiteLLM
Logging & Observability
Caching - In-Memory, Redis, s3, Redis Semantic Cache, Disk
Tutorials
LangChain, LlamaIndex Integration
Extras
Migration Guide - LiteLLM v1.0.0+
Support & Talk with founders

Extras
❤️ 🚅 Projects built on LiteLLM
Langstream

Langstream

Build robust LLM applications with true composability 🔗 Github Docs

Docs

Tutorial

Community

Discord
Twitter

More

GitHub

Copyright © 2024 liteLLM