mirror of
https://github.com/enricoros/big-AGI.git
synced 2026-05-10 21:50:14 -07:00
Enrico Ros
7154db7f72
Closes #32. Enable Users / Deployments to change the host where OpenAI API calls are directed to. This enables project like [Helicone](https://www.helicone.ai/) (Observability of LLM ops) for tracking prompt/responses quality in real-time. Configuration: - User: App > Settings > Advanced > API host (e.g. "oai.hconeai.com") - Deployment: set the 'API_API_HOST=...' environment variable User takes precedence over deployment over api.openai.com. Realtime switching in chat apps works well. Note: the Helicone team is fixing dashboard reporting for 'streaming' over the /v1/chat/completions endpoint.
5 lines
232 B
Bash
5 lines
232 B
Bash
# [Recommended for local deployments] Backend API key for OpenAI, so that users don't have to provide one
|
|
OPENAI_API_KEY=
|
|
|
|
# [Not needed] Set the backend host for the OpenAI API, to enable platforms such as Helicone
|
|
OPENAI_API_HOST= |