Unified LLM gateway with provider fallbacks, prompt routing, and spend observability.
Best match because its name, category, capabilities, or owner matches “gateway”. Adoption and trust break close ties.
Stars 27k
Downloads —
Updated 2026-10-23
Skill installs — Trust pending Momentum not matched
LLM Gateways
Portkey-AI ★ 13k Tool active Fast open-source AI gateway with automated retries, semantic caching, and budget rules.
Best match because its name, category, capabilities, or owner matches “gateway”. Adoption and trust break close ties.
Stars 13k
Downloads 4.1k
Updated 2026-05-25
Skill installs — Trust pending Momentum not matched
$ npm i @portkey-ai/gatewayCopy LLM Gateways
An AI gateway offering built in semantic and exact prompt caching for cost optimization.
Best match because its name, category, capabilities, or owner matches “gateway”. Adoption and trust break close ties.
Stars 9.0k
Downloads —
Updated 2026-10-23
Skill installs — Trust pending Momentum not matched
Prompt Caching
Call 100+ LLM APIs using OpenAI format with proxy cost tracking and budget caps.
Best match because its name, category, capabilities, or owner matches “gateway”. Adoption and trust break close ties.
Stars 62k
Downloads 661278k
Updated 2026-10-23
Skill installs — Trust pending Momentum not matched
$ pip install litellmCopy LLM Gateways
TensorOpsAI ★ 390 Tool experimental Gateway and management tool for calling, caching and monitoring multiple LLM providers.
Best match because its name, category, capabilities, or owner matches “gateway”. Adoption and trust break close ties.
Stars 390
Downloads —
Updated 2026-07-29
Skill installs — Trust pending Momentum not matched
$ pip install llmstudio-monorepoCopy LLM Gateways
tensorzero ★ 12k Tool active Open source LLM gateway and optimization framework unifying inference, observability and evals.
Best match because its name, category, capabilities, or owner matches “gateway”. Adoption and trust break close ties.
Stars 12k
Downloads —
Updated 2026-06-11
Skill installs — Trust pending Momentum not matched
LLM Gateways Observability & Cost
token-js ★ 313 Tool experimental Unified TypeScript SDK for calling over a hundred LLMs through one API.
Best match because its name, category, capabilities, or owner matches “gateway”. Adoption and trust break close ties.
Stars 313
Downloads 3.7k
Updated 2026-07-05
Skill installs — Trust pending Momentum not matched
$ npm i token.jsCopy LLM Gateways
codelion ★ 4.3k Tool experimental Optimizing inference proxy that applies techniques to improve accuracy and reduce LLM cost.
Best match because its name, category, capabilities, or owner matches “gateway”. Adoption and trust break close ties.
Stars 4.3k
Downloads —
Updated 2026-10-11
Skill installs — Trust pending Momentum not matched
$ pip install optillmCopy LLM Gateways
openrouter-ai Tool experimental Unified LLM gateway with dynamic price routing, prompt caching, and cost analytics.
Best match because its name, category, capabilities, or owner matches “gateway”. Adoption and trust break close ties.
Stars —
Downloads —
Updated —
Skill installs — Trust pending Momentum not matched
LLM Gateways Model Routing