82b88764ba
Fix Anthropic model list to be actually compatible with Anthropic API (required by some frontends), remove old models
2025-01-03 04:50:55 +00:00
6ea9235ff8
Actually camelCase is canon for Gemini, oops
2024-12-31 08:23:45 +00:00
372ad85283
Support camelCase Gemini params and validate vision
2024-12-31 10:16:04 +00:00
c2f5d2fbf3
Add /v1/models to deepseek
2024-12-31 08:23:45 +00:00
c264413495
Leave a comment about concurrency for "special" user tokens
2024-12-31 08:23:45 +00:00
8d27082ad0
Fix formatting changes with upstream
2024-12-31 08:23:45 +00:00
e2b602fd52
Adjust chunked transfer to send 4KB (CF's buffer size) of data every 49 seconds
2024-12-31 08:23:45 +00:00
b00fb88cab
Don't overwrite the reasoning effort by default
2024-12-31 07:45:11 +00:00
1cc281f6fe
Add automatic prefill for Deepseek - works the same way as with Claude
2024-12-31 07:45:11 +00:00
8f4d00ed26
Init commit, some things:
...
- 'Transfer-Encoding: chunked' for o1 requests to prevent CF's 100 second limit
- Better tool/function call support
- Deepseek support
- Handling system as an array for AWS Claude
- Image support for Gemini
- Better o1 support (reasoning effort, developer role, context size)
2024-12-31 00:00:00 +00:00
28447d0811
resolves server-side error when a Gemini prompt is blocked due to safety
2024-12-07 00:54:13 -06:00
6d54cbc785
maybe handles gemini daily key block idk
2024-12-05 15:06:29 -06:00
9d7a4f4b51
maybe fixes gemini's fucked error messages idk
2024-12-05 14:54:35 -06:00
3496a2a9bd
fixes incorrect 3.5 sonnet v2 model id in gcp model reassignment
2024-12-03 19:53:56 -06:00
8a325a1e0b
Add 2 million Google AI context ( khanon/oai-reverse-proxy!82 )
2024-12-04 01:27:21 +00:00
5eeb2875b4
adds haiku 3.5
2024-11-04 18:20:19 +00:00
c67dad1617
fixes AWS claude v2
2024-10-25 18:10:26 +00:00
fe61745e24
fixes issue with AWS model assignment when requesting legacy claude (claude-2.1, etc)
2024-10-25 17:49:24 +00:00
f3b876887e
fixes issue with AWS model name reassignment
2024-10-23 13:59:10 -05:00
49c578f4dc
adds Sonnet 3.5v2 AWS model ID and adjusts AWS model assignment to raise error on no match
2024-10-23 13:39:34 -05:00
4190d5fef6
fixes missing comma.......
2024-10-22 16:06:39 +00:00
1644e82f25
adds Sonnet 20241022 snapshot IDs
2024-10-22 15:52:52 +00:00
0bbdc0b841
fixes google ai language filter and updates readme
2024-10-18 23:15:02 -05:00
c4a633a5d6
fixes gcp oauth2 token refresh not updating cloned key instance
2024-10-18 22:41:24 -05:00
0c6ec3254f
finally DOES something about broken GCP streaming, boebeitfully
2024-10-12 20:10:59 -05:00
13aa55cd3d
handles gemini ai test message from sillytavern
2024-10-12 09:01:08 -05:00
b57627e69b
adds stripHeaders to global mutators in createQueuedProxyMiddleware
2024-10-09 16:59:12 -05:00
536803853a
uses removeHeader instead of setHeader to empty string
2024-10-09 16:44:53 -05:00
ad0a3c0936
removes cors/sec-fetch headers to fix venus chub with anthropic api
2024-10-09 16:33:54 -05:00
514d1b7e31
fixes azure
2024-10-01 16:15:04 -05:00
22d7f966c6
fixes for gemini api streaming
2024-09-29 12:44:18 -05:00
a7fed3136e
fixes google ai gemini
2024-09-25 15:58:52 -05:00
ff0d3dfdcd
prevents overwriting anthropic-version header if it's already provided
2024-09-19 00:55:17 -05:00
81a3ae1746
maybe fixes missing anthropic version header in some cases
2024-09-19 00:50:17 -05:00
4dfd57fcb4
updates render dockerfile to correctly copy patches dir into build context
2024-09-16 23:39:43 -05:00
d21e274358
Add configurable network interface or SOCKS/HTTP proxy for outgoing requests ( khanon/oai-reverse-proxy!80 )
2024-09-16 15:17:57 +00:00
7a4a16dd2f
fixes chatgpt-latest missing from models endpoint
2024-09-15 06:02:35 -05:00
f1cfa644c5
maybe fixes openai sk-svcacct keys
2024-09-13 00:55:29 -05:00
6a908b09cb
adds preliminary openai o1 support and some improvements to openai keychecker
2024-09-12 23:03:33 -05:00
bd87ca60f7
Implement priority queue by tokens ( khanon/oai-reverse-proxy!79 )
2024-09-09 16:48:46 +00:00
ac1897fd17
returns more clear proxy_note hint on AWS 503 error
2024-09-09 09:56:18 -05:00
2a6f85e2e2
Revert "handles AWS HTTP 503 ServiceUnavailableException similarly to 429s"
...
This reverts commit ffcaa23511
2024-09-09 09:43:59 -05:00
ffcaa23511
handles AWS HTTP 503 ServiceUnavailableException similarly to 429s
2024-09-09 08:07:53 -05:00
96fe974ad0
Use AWS Inference Profiles for higher rate limits ( khanon/oai-reverse-proxy!78 )
2024-09-01 22:55:07 +00:00
ee61f9be2b
removes unnecessary log from last commit
2024-08-27 23:58:32 -05:00
0c448cb59d
fixes azure dalle using wrong rate limit and out-of-spec Retry-After header
2024-08-27 23:53:28 -05:00
51a9ccceb2
supports alternate claude system prompt format
2024-08-27 23:27:20 -05:00
5000e59a61
fix for google makersuite prompt validation/transformation
2024-08-22 14:19:48 -05:00
d54acad6ad
adds support for sonnet 8192 output tokens on anthropic api
2024-08-15 11:55:13 -05:00
5e1fffe07d
adds chatgpt-4o-latest
2024-08-15 11:54:42 -05:00
user