Skip to main content
Relay is PipeLLM’s Auto Router. Keep the OpenAI, Anthropic, or Gemini SDK you already use. Relay authenticates the request, applies policy, and selects an approved route by protocol, provider health, and cost. The default path is OpenAI-compatible: point the OpenAI SDK at https://api.pipellm.ai/v1 and send a request.
Create a Relay API key in the console. Model IDs change over time — list the ones available to your account with GET /v1/models.

Next

Quickstart

Get a key, install the SDK, and send your first request.

Routing & Protocols

Native routes, converter routes, and when Relay switches protocols.

Authentication

API keys, headers, and base URLs.

Models

How to list models and pick an ID.