user
496ec09905
Add v1alpha support (needed for 2.0 flash thinking with the new 'thought' parameter), already used by ST
2025-01-04 19:11:02 +00:00
user
6ea9235ff8
Actually camelCase is canon for Gemini, oops
2024-12-31 08:23:45 +00:00
user
372ad85283
Support camelCase Gemini params and validate vision
2024-12-31 10:16:04 +00:00
user
8d27082ad0
Fix formatting changes with upstream
2024-12-31 08:23:45 +00:00
user
8f4d00ed26
Init commit, some things:
...
- 'Transfer-Encoding: chunked' for o1 requests to prevent CF's 100 second limit
- Better tool/function call support
- Deepseek support
- Handling system as an array for AWS Claude
- Image support for Gemini
- Better o1 support (reasoning effort, developer role, context size)
2024-12-31 00:00:00 +00:00
nai-degen
28447d0811
resolves server-side error when a Gemini prompt is blocked due to safety
2024-12-07 00:54:13 -06:00
nai-degen
6d54cbc785
maybe handles gemini daily key block idk
2024-12-05 15:06:29 -06:00
nai-degen
9d7a4f4b51
maybe fixes gemini's fucked error messages idk
2024-12-05 14:54:35 -06:00
Nopm
8a325a1e0b
Add 2 million Google AI context ( khanon/oai-reverse-proxy!82 )
2024-12-04 01:27:21 +00:00
nai-degen
0bbdc0b841
fixes google ai language filter and updates readme
2024-10-18 23:15:02 -05:00
nai-degen
c4a633a5d6
fixes gcp oauth2 token refresh not updating cloned key instance
2024-10-18 22:41:24 -05:00
nai-degen
0c6ec3254f
finally DOES something about broken GCP streaming, boebeitfully
2024-10-12 20:10:59 -05:00
nai-degen
13aa55cd3d
handles gemini ai test message from sillytavern
2024-10-12 09:01:08 -05:00
nai-degen
b57627e69b
adds stripHeaders to global mutators in createQueuedProxyMiddleware
2024-10-09 16:59:12 -05:00
nai-degen
536803853a
uses removeHeader instead of setHeader to empty string
2024-10-09 16:44:53 -05:00
nai-degen
ad0a3c0936
removes cors/sec-fetch headers to fix venus chub with anthropic api
2024-10-09 16:33:54 -05:00
nai-degen
22d7f966c6
fixes for gemini api streaming
2024-09-29 12:44:18 -05:00
nai-degen
a7fed3136e
fixes google ai gemini
2024-09-25 15:58:52 -05:00
nai-degen
ff0d3dfdcd
prevents overwriting anthropic-version header if it's already provided
2024-09-19 00:55:17 -05:00
nai-degen
81a3ae1746
maybe fixes missing anthropic version header in some cases
2024-09-19 00:50:17 -05:00
nai-degen
4dfd57fcb4
updates render dockerfile to correctly copy patches dir into build context
2024-09-16 23:39:43 -05:00
khanon
d21e274358
Add configurable network interface or SOCKS/HTTP proxy for outgoing requests ( khanon/oai-reverse-proxy!80 )
2024-09-16 15:17:57 +00:00
nai-degen
f1cfa644c5
maybe fixes openai sk-svcacct keys
2024-09-13 00:55:29 -05:00
nai-degen
6a908b09cb
adds preliminary openai o1 support and some improvements to openai keychecker
2024-09-12 23:03:33 -05:00
nai-degen
ac1897fd17
returns more clear proxy_note hint on AWS 503 error
2024-09-09 09:56:18 -05:00
nai-degen
2a6f85e2e2
Revert "handles AWS HTTP 503 ServiceUnavailableException similarly to 429s"
...
This reverts commit ffcaa23511 .
2024-09-09 09:43:59 -05:00
nai-degen
ffcaa23511
handles AWS HTTP 503 ServiceUnavailableException similarly to 429s
2024-09-09 08:07:53 -05:00
khanon
96fe974ad0
Use AWS Inference Profiles for higher rate limits ( khanon/oai-reverse-proxy!78 )
2024-09-01 22:55:07 +00:00
nai-degen
51a9ccceb2
supports alternate claude system prompt format
2024-08-27 23:27:20 -05:00
nai-degen
5000e59a61
fix for google makersuite prompt validation/transformation
2024-08-22 14:19:48 -05:00
nai-degen
d54acad6ad
adds support for sonnet 8192 output tokens on anthropic api
2024-08-15 11:55:13 -05:00
nai-degen
5e1fffe07d
adds chatgpt-4o-latest
2024-08-15 11:54:42 -05:00
nai-degen
6d323f6ea1
do not transform mistral chat prompts to text when using la plateforme
2024-08-14 12:26:27 -05:00
nai-degen
b58e7cb830
always applies Mistral prompt fixes on messages input
2024-08-14 10:48:55 -05:00
khanon
f531272b00
Refactor AWS service code and add AWS Mistral support ( khanon/oai-reverse-proxy!75 )
2024-08-14 04:40:41 +00:00
nai-degen
b7cd326d2a
handles 'invalid subscription' 403 errors from Mistral API
2024-08-07 14:14:53 -05:00
nai-degen
6c9f302fb9
minor gultra fix
2024-08-06 18:46:49 -05:00
nai-degen
81f8dc2613
updates README.md
2024-08-05 11:33:16 -05:00
khanon
0c936e97fe
Merge GCP Vertex AI implementation from cg-dot/oai-reverse-proxy ( khanon/oai-reverse-proxy!72 )
2024-08-05 14:27:51 +00:00
nai-degen
29ed07492e
fixes info page display for gemini flash/ultra
2024-08-03 22:18:05 -05:00
nai-degen
2f7315379c
adds gemini/makersuite keychecker, native endpoint, and streaming fixes
2024-08-03 21:53:32 -05:00
nai-degen
e91532f4f7
handle dead makersuite keys triggering 400 error instead of 401/403
2024-08-03 19:09:50 -05:00
nai-degen
9a3cca6b80
adds new mistral models and updates older model lists/context limits
2024-07-28 13:15:03 -05:00
nai-degen
f242777596
fixes token index used as msg idx in anthropic chat-to-openai SSE transformer
2024-07-07 13:33:33 -05:00
nai-degen
edc0d094e2
tries to disable quarantined aws keys
2024-06-30 05:08:27 -05:00
nai-degen
7660ed8b94
allows enabling vision prompts on a per-service basis
2024-06-07 12:09:43 -05:00
nai-degen
57fd17ede0
makes it easier for clients to detect proxy errors programatically
2024-05-27 15:30:28 -05:00
scrappyanon
2d82e55d72
Sqlite backend with user event logging ( khanon/oai-reverse-proxy!69 )
2024-05-26 17:31:12 +00:00
nai-degen
6dabc82bcf
adds preliminary gpt4o
2024-05-13 12:43:39 -05:00
nai-degen
d3e7ef3c14
prevents leaking headers to upstream API when serving via Tailscale
2024-05-01 11:26:15 -05:00