 khanon
|
96cf4a0e2d
|
Automatically add Anthropic "\n\nHuman:" preamble when necessary (khanon/oai-reverse-proxy!23)
|
2023-06-09 07:16:40 +00:00 |
|
|
khanon
|
4f2a12ef14
|
Show per-model queues and keys on info page (khanon/oai-reverse-proxy!22)
|
2023-06-08 18:50:04 +00:00 |
|
|
khanon
|
120040c028
|
Separate MAX_OUTPUT_TOKENS config for OpenAI/Claude (khanon/oai-reverse-proxy!21)
|
2023-06-08 00:58:57 +00:00 |
|
|
nai-degen
|
a6a0c21f7d
|
makes gatekeeper compatible with sillytavern claude impl
|
2023-06-06 20:53:50 -05:00 |
|
|
khanon
|
7b5e612921
|
Workaround for Anthropic requiring some prompts to start with Human: (khanon/oai-reverse-proxy!20)
|
2023-06-05 21:55:59 +00:00 |
|
|
khanon
|
cd754bd601
|
Allow overriding default Claude model selection (khanon/oai-reverse-proxy!19)
|
2023-06-05 03:12:34 +00:00 |
|
|
nai-degen
|
38ff0e3f3b
|
fixes prompt logging for streamed Claude requests
|
2023-06-04 12:16:29 -05:00 |
|
|
khanon
|
dae1262f7a
|
Refactor request middleware (khanon/oai-reverse-proxy!18)
|
2023-06-02 04:03:16 +00:00 |
|
|
nai-degen
|
a26979f7bc
|
returns static model list instead of proxying
|
2023-06-01 20:17:09 -05:00 |
|
|
nai-degen
|
a6c6e4c694
|
allows KeyPool.available to be scoped per-service
|
2023-06-01 08:31:41 -05:00 |
|
|
nai-degen
|
b7fa65d9f9
|
fixes dumb /v1/models bug affecting sillytavern again
|
2023-05-31 13:53:24 -05:00 |
|
|
nai-degen
|
f621031ec1
|
fixes circluar dependency that broke tsc but not esbuild
|
2023-05-30 04:01:03 -05:00 |
|
|
khanon
|
6723cbf662
|
Anthropic endpoint improvements (khanon/oai-reverse-proxy!16)
|
2023-05-30 03:13:17 +00:00 |
|
|
nai-degen
|
30bdc7cd5e
|
shitty quick fix for tavern+openai not working properly
|
2023-05-29 13:23:38 -05:00 |
|
|
nai-degen
|
f102f02a65
|
adds stop sequences for better UJB/group chat behavior on claude
|
2023-05-29 13:07:15 -05:00 |
|
|
nai-degen
|
304893e13d
|
uses claude v1.2 instead of v1.1
|
2023-05-29 12:39:45 -05:00 |
|
|
khanon
|
2d93463247
|
Implement support for Anthropic keys and Claude API (khanon/oai-reverse-proxy!15)
|
2023-05-29 17:08:08 +00:00 |
|
|
nai-degen
|
03aaa6daad
|
wraps SSE error responses in code block backticks
|
2023-05-23 12:28:06 -05:00 |
|
|
nai-degen
|
13b6a3d7b8
|
adds header to improve nginx compatibility
|
2023-05-23 11:57:14 -05:00 |
|
|
nai-degen
|
03616f4bbc
|
increases wait time estimation window to 5min
|
2023-05-23 11:26:40 -05:00 |
|
|
nai-degen
|
01eee61e8b
|
checks the request content-type instead...
|
2023-05-22 21:14:58 -05:00 |
|
|
nai-degen
|
e3603a60e9
|
follow-up to Accept header adjustment
|
2023-05-22 21:02:11 -05:00 |
|
|
nai-degen
|
b24894d98f
|
fixes origin block response to account for clients sending bad headers
|
2023-05-22 20:29:49 -05:00 |
|
|
nai-degen
|
26a6e4cadb
|
increases wait time calculation window
|
2023-05-22 19:33:03 -05:00 |
|
|
nai-degen
|
a61fa04fbf
|
Implements origin/referrer block (khanon/oai-reverse-proxy!13)
|
2023-05-22 21:08:20 +00:00 |
|
|
nai-degen
|
2bad644772
|
Prefer user tokens as rate-limit/queue keys when available (khanon/oai-reverse-proxy!10)
|
2023-05-19 04:33:20 +00:00 |
|
|
nai-degen
|
3f46d132f7
|
disables per-user IP limit by default
|
2023-05-14 14:46:14 -05:00 |
|
|
nai-degen
|
9ff7381f31
|
exempts 'special' user role from auto-ban
|
2023-05-14 14:37:50 -05:00 |
|
|
nai-degen
|
6eb121ac66
|
disables keys shared between too many IP addresses
|
2023-05-14 14:30:32 -05:00 |
|
|
nai-degen
|
285186d70e
|
fixes keys being lost if not used at least once
|
2023-05-14 13:32:41 -05:00 |
|
|
nai-degen
|
f1ac64fa12
|
Implement user persistence via Firebase (khanon/oai-reverse-proxy!8)
|
2023-05-14 04:26:08 +00:00 |
|
|
nai-degen
|
546b28cca6
|
increases wait time calc window to 90sec
|
2023-05-13 13:32:37 -05:00 |
|
|
nai-degen
|
977247d7a2
|
User authentication (khanon/oai-reverse-proxy!7)
|
2023-05-13 00:58:15 +00:00 |
|
|
nai-degen
|
5238aff378
|
reverts default quotaDisplay to partial; removes rejectSampleRate
|
2023-05-11 20:35:28 -05:00 |
|
|
nai-degen
|
7382bdc92e
|
cleans up ratelimit table more frequently to smooth proompters display
|
2023-05-11 11:50:44 -05:00 |
|
|
nai-degen
|
09184079af
|
reduces wait time window from 2min to 1min
|
2023-05-11 11:45:15 -05:00 |
|
|
nai-degen
|
8ff43aef1a
|
disables kobold endpoint when queueing is enabled
|
2023-05-10 11:44:03 -05:00 |
|
|
nai-degen
|
e03f3d48dd
|
Implements request queueing (khanon/oai-reverse-proxy!6)
|
2023-05-09 23:11:57 +00:00 |
|
|
nai-degen
|
e9e9f1f8b6
|
corrects openai incorrectly referred to as 'downstream'
|
2023-05-06 10:07:09 -05:00 |
|
|
nai-degen
|
e541a7b892
|
forgot string.replace doesn't actually mutate the string
|
2023-05-06 09:55:59 -05:00 |
|
|
nai-degen
|
119c2f827a
|
fixes org-ID redaction on errors which don't include one
|
2023-05-06 09:51:18 -05:00 |
|
|
gronon
|
e0529197cd
|
Prevent leaking OpenAI organization-ids in error responses (khanon/oai-reverse-proxy!5)
|
2023-05-06 12:22:05 +00:00 |
|
|
nai-degen
|
432023f875
|
cycles out keys which have been disabled
|
2023-05-05 09:50:43 -05:00 |
|
|
nai-degen
|
4dc9c649d8
|
fixes server blowing up when a streaming request drops out
|
2023-05-04 16:37:16 -05:00 |
|
|
nai-degen
|
176a37928d
|
Implement support for streamed OpenAI responses (khanon/oai-reverse-proxy!4)
|
2023-05-01 22:01:47 +00:00 |
|
|
nai-degen
|
2b783e0f2b
|
improves model_not_found error message
|
2023-04-30 22:01:45 -07:00 |
|
|
nai-degen
|
16b5ccb977
|
disables key downgrade feature to prevent abuse
|
2023-04-30 21:30:42 -07:00 |
|
|
nai-degen
|
673f6f6185
|
actually fixes prompt logger path detection
|
2023-04-14 20:54:55 -07:00 |
|
|
nai-degen
|
5e046b9060
|
fixes bug introduced in previous commit which prevented logging
|
2023-04-14 20:19:26 -07:00 |
|
|
nai-degen
|
34ed165a6f
|
fixes issue with attempting to log non-completion endpoints
|
2023-04-14 20:10:14 -07:00 |
|