 nai-degen
|
7f92565739
|
SSE queueing adjustments, untested
|
2024-01-07 16:19:22 -06:00 |
|
|
twinkletoes
|
4a823b216f
|
Mistral AI support (khanon/oai-reverse-proxy!58)
|
2023-12-25 18:33:16 +00:00 |
|
|
nai-degen
|
5599a83ae4
|
improves streaming error handling
|
2023-12-14 05:01:10 -06:00 |
|
|
nai-degen
|
c5cd90dcef
|
adjusts prompt transform to discourage Gemini from speaking for user
|
2023-12-13 23:03:57 -06:00 |
|
|
khanon
|
fad16cc268
|
Add Google AI API (khanon/oai-reverse-proxy!57)
|
2023-12-13 21:56:07 +00:00 |
|
|
nai-degen
|
0d3682197c
|
treats 403 from anthropic as key dead
|
2023-12-11 09:13:53 -06:00 |
|
|
valadaptive
|
e0624e30fd
|
Fix some corner cases in SSE parsing (khanon/oai-reverse-proxy!56)
|
2023-12-09 06:18:01 +00:00 |
|
|
nai-degen
|
94d4efe9bb
|
properly enforce allowedModelFamilies; refactor HPM proxyReq handlers
|
2023-12-05 22:07:56 -06:00 |
|
|
nai-degen
|
fdd824f0e4
|
adds azure rate limit auto-retry
|
2023-12-04 01:24:33 -06:00 |
|
|
khanon
|
fbdea30264
|
Azure OpenAI suport (khanon/oai-reverse-proxy!48)
|
2023-12-04 04:21:18 +00:00 |
|
|
khanon
|
f29049f993
|
Support for GPT-4-Vision (khanon/oai-reverse-proxy!54)
|
2023-11-19 05:06:21 +00:00 |
|
|
khanon
|
20c064394a
|
OpenAI DALL-E Image Generation (khanon/oai-reverse-proxy!52)
|
2023-11-14 05:41:19 +00:00 |
|
|
nai-degen
|
b6f8f15a1f
|
tries to prevent per-day rate limited keys from bricking the queue
|
2023-11-06 21:16:36 -06:00 |
|
|
nai-degen
|
26dc79c8f1
|
fixes broken AWS rate limit backoff
|
2023-10-24 09:19:46 -05:00 |
|
|
nai-degen
|
89e9b67f3f
|
fixes AWS mid-stream rate limits not actually marking key as rate-limited
|
2023-10-23 22:47:29 -05:00 |
|
|
nai-degen
|
52ec2ec265
|
fixes blank AWS responses due to reqs sometimes using wrong handler
|
2023-10-23 22:23:06 -05:00 |
|
|
nai-degen
|
3f7e50f87e
|
follow-up 'fixes empty AWS streaming responses when under heavy load'
|
2023-10-15 00:06:38 -05:00 |
|
|
nai-degen
|
f6cfc6e882
|
fixes empty AWS streaming responses when under heavy load
|
2023-10-15 00:05:36 -05:00 |
|
|
nai-degen
|
5033d00444
|
improves clarity of errors sent back to streaming clients
|
2023-10-03 19:45:15 -05:00 |
|
|
khanon
|
ecf897e685
|
Refactor handleStreamingResponse to make it less shit (khanon/oai-reverse-proxy!46)
|
2023-10-03 06:14:19 +00:00 |
|
|
nai-degen
|
ede274c117
|
disables AWS key on AccessDeniedException
|
2023-10-02 11:18:08 -05:00 |
|
|
khanon
|
fa4bf468d2
|
Implement AWS Bedrock support (khanon/oai-reverse-proxy!45)
|
2023-10-01 01:40:18 +00:00 |
|
|
khanon
|
35a6c393ed
|
Add support for Google PaLM and OpenAI Turbo Instruct (khanon/oai-reverse-proxy!44)
|
2023-09-19 23:13:08 +00:00 |
|
|
khanon
|
f05e196994
|
Refactor project structure and add user self-serve UI (khanon/oai-reverse-proxy!41)
|
2023-09-02 19:36:44 +00:00 |
|
|
nai-degen
|
2c0a659b2d
|
adds token consumption stats to infopage
|
2023-08-30 20:40:40 -05:00 |
|
|
khanon
|
4d781e1720
|
Add GPT-4-32k support (khanon/oai-reverse-proxy!39)
|
2023-08-29 22:56:54 +00:00 |
|
|
khanon
|
cb780e85da
|
Per-user token quotas and automatic quota refreshing (khanon/oai-reverse-proxy!37)
|
2023-08-28 19:33:14 +00:00 |
|
|
nai-degen
|
6bb67281d9
|
removes QUEUE_MODE config (now always enabled)
|
2023-08-09 18:29:34 -05:00 |
|
|
khanon
|
aa5380d2ef
|
Rework OpenAIKeyChecker to remove usage tracking and test all keys for liveness (khanon/oai-reverse-proxy!29)
|
2023-07-21 04:00:12 +00:00 |
|
|
breathingmanually
|
576423d1f8
|
Fix JSON parse exception when Claude finishes streaming (khanon/oai-reverse-proxy!25)
|
2023-07-20 01:57:50 +00:00 |
|
|
nai-degen
|
d7a4829d13
|
handles keys which have been banned (but not revoked) by openai
|
2023-07-19 10:28:38 -05:00 |
|
|
khanon
|
96cf4a0e2d
|
Automatically add Anthropic "\n\nHuman:" preamble when necessary (khanon/oai-reverse-proxy!23)
|
2023-06-09 07:16:40 +00:00 |
|
|
nai-degen
|
38ff0e3f3b
|
fixes prompt logging for streamed Claude requests
|
2023-06-04 12:16:29 -05:00 |
|
|
khanon
|
dae1262f7a
|
Refactor request middleware (khanon/oai-reverse-proxy!18)
|
2023-06-02 04:03:16 +00:00 |
|
|
nai-degen
|
a6c6e4c694
|
allows KeyPool.available to be scoped per-service
|
2023-06-01 08:31:41 -05:00 |
|
|
khanon
|
6723cbf662
|
Anthropic endpoint improvements (khanon/oai-reverse-proxy!16)
|
2023-05-30 03:13:17 +00:00 |
|
|
khanon
|
2d93463247
|
Implement support for Anthropic keys and Claude API (khanon/oai-reverse-proxy!15)
|
2023-05-29 17:08:08 +00:00 |
|
|
nai-degen
|
13b6a3d7b8
|
adds header to improve nginx compatibility
|
2023-05-23 11:57:14 -05:00 |
|
|
nai-degen
|
977247d7a2
|
User authentication (khanon/oai-reverse-proxy!7)
|
2023-05-13 00:58:15 +00:00 |
|
|
nai-degen
|
e03f3d48dd
|
Implements request queueing (khanon/oai-reverse-proxy!6)
|
2023-05-09 23:11:57 +00:00 |
|
|
nai-degen
|
e9e9f1f8b6
|
corrects openai incorrectly referred to as 'downstream'
|
2023-05-06 10:07:09 -05:00 |
|
|
nai-degen
|
e541a7b892
|
forgot string.replace doesn't actually mutate the string
|
2023-05-06 09:55:59 -05:00 |
|
|
nai-degen
|
119c2f827a
|
fixes org-ID redaction on errors which don't include one
|
2023-05-06 09:51:18 -05:00 |
|
|
gronon
|
e0529197cd
|
Prevent leaking OpenAI organization-ids in error responses (khanon/oai-reverse-proxy!5)
|
2023-05-06 12:22:05 +00:00 |
|
|
nai-degen
|
432023f875
|
cycles out keys which have been disabled
|
2023-05-05 09:50:43 -05:00 |
|
|
nai-degen
|
4dc9c649d8
|
fixes server blowing up when a streaming request drops out
|
2023-05-04 16:37:16 -05:00 |
|
|
nai-degen
|
176a37928d
|
Implement support for streamed OpenAI responses (khanon/oai-reverse-proxy!4)
|
2023-05-01 22:01:47 +00:00 |
|
|
nai-degen
|
2b783e0f2b
|
improves model_not_found error message
|
2023-04-30 22:01:45 -07:00 |
|
|
nai-degen
|
16b5ccb977
|
disables key downgrade feature to prevent abuse
|
2023-04-30 21:30:42 -07:00 |
|
|
nai-degen
|
673f6f6185
|
actually fixes prompt logger path detection
|
2023-04-14 20:54:55 -07:00 |
|