 nai-degen
|
e2bd8a6b86
|
extracts Risu auth into new middleware so queue can use it too
|
2023-07-22 13:48:02 -05:00 |
|
|
khanon
|
56a4902599
|
Add tokenizers and configurable context size limits (khanon/oai-reverse-proxy!28)
|
2023-07-22 00:11:32 +00:00 |
|
|
khanon
|
7634afeea4
|
Implement rate limit for risuai.xyz (khanon/oai-reverse-proxy!31)
|
2023-07-21 21:48:07 +00:00 |
|
|
khanon
|
aa5380d2ef
|
Rework OpenAIKeyChecker to remove usage tracking and test all keys for liveness (khanon/oai-reverse-proxy!29)
|
2023-07-21 04:00:12 +00:00 |
|
|
breathingmanually
|
576423d1f8
|
Fix JSON parse exception when Claude finishes streaming (khanon/oai-reverse-proxy!25)
|
2023-07-20 01:57:50 +00:00 |
|
|
Xrystallized
|
120b7da340
|
Include non /v1 url in check (khanon/oai-reverse-proxy!27)
|
2023-07-19 16:00:29 +00:00 |
|
|
nai-degen
|
d7a4829d13
|
handles keys which have been banned (but not revoked) by openai
|
2023-07-19 10:28:38 -05:00 |
|
|
nai-degen
|
efa1b03570
|
uses claude-v1 by default as anthropic seems to be turning off v1.2
|
2023-07-19 01:48:57 -05:00 |
|
|
khanon
|
7478112077
|
fixes embarrassing auth oversight
|
2023-07-16 07:31:44 +00:00 |
|
|
nai-degen
|
aee382c84e
|
adds claude-2 to supported models
|
2023-07-11 09:14:46 -05:00 |
|
|
nai-degen
|
6598b4df0d
|
requests old version of Anthropic API due to breaking SSE changes
|
2023-06-24 14:50:48 -05:00 |
|
|
nai-degen
|
6a7f64b037
|
adds missed change from origin header adjustment
|
2023-06-24 14:25:30 -05:00 |
|
|
nai-degen
|
c8b3238398
|
reorganizes origin header middleware
|
2023-06-24 14:25:01 -05:00 |
|
|
nai-degen
|
602931bf7f
|
removes origin/referer headers from proxied request
|
2023-06-23 00:08:09 -05:00 |
|
|
khanon
|
43359779e7
|
Implements more robust anti-zoomer functionality (khanon/oai-reverse-proxy!24)
|
2023-06-14 04:05:51 +00:00 |
|
|
nai-degen
|
3a2a6e96fd
|
adds new OpenAI June 2023 models
|
2023-06-13 16:24:34 -05:00 |
|
|
khanon
|
96cf4a0e2d
|
Automatically add Anthropic "\n\nHuman:" preamble when necessary (khanon/oai-reverse-proxy!23)
|
2023-06-09 07:16:40 +00:00 |
|
|
khanon
|
4f2a12ef14
|
Show per-model queues and keys on info page (khanon/oai-reverse-proxy!22)
|
2023-06-08 18:50:04 +00:00 |
|
|
khanon
|
120040c028
|
Separate MAX_OUTPUT_TOKENS config for OpenAI/Claude (khanon/oai-reverse-proxy!21)
|
2023-06-08 00:58:57 +00:00 |
|
|
nai-degen
|
a6a0c21f7d
|
makes gatekeeper compatible with sillytavern claude impl
|
2023-06-06 20:53:50 -05:00 |
|
|
khanon
|
7b5e612921
|
Workaround for Anthropic requiring some prompts to start with Human: (khanon/oai-reverse-proxy!20)
|
2023-06-05 21:55:59 +00:00 |
|
|
khanon
|
cd754bd601
|
Allow overriding default Claude model selection (khanon/oai-reverse-proxy!19)
|
2023-06-05 03:12:34 +00:00 |
|
|
nai-degen
|
38ff0e3f3b
|
fixes prompt logging for streamed Claude requests
|
2023-06-04 12:16:29 -05:00 |
|
|
khanon
|
dae1262f7a
|
Refactor request middleware (khanon/oai-reverse-proxy!18)
|
2023-06-02 04:03:16 +00:00 |
|
|
nai-degen
|
a26979f7bc
|
returns static model list instead of proxying
|
2023-06-01 20:17:09 -05:00 |
|
|
nai-degen
|
a6c6e4c694
|
allows KeyPool.available to be scoped per-service
|
2023-06-01 08:31:41 -05:00 |
|
|
nai-degen
|
b7fa65d9f9
|
fixes dumb /v1/models bug affecting sillytavern again
|
2023-05-31 13:53:24 -05:00 |
|
|
nai-degen
|
f621031ec1
|
fixes circluar dependency that broke tsc but not esbuild
|
2023-05-30 04:01:03 -05:00 |
|
|
khanon
|
6723cbf662
|
Anthropic endpoint improvements (khanon/oai-reverse-proxy!16)
|
2023-05-30 03:13:17 +00:00 |
|
|
nai-degen
|
30bdc7cd5e
|
shitty quick fix for tavern+openai not working properly
|
2023-05-29 13:23:38 -05:00 |
|
|
nai-degen
|
f102f02a65
|
adds stop sequences for better UJB/group chat behavior on claude
|
2023-05-29 13:07:15 -05:00 |
|
|
nai-degen
|
304893e13d
|
uses claude v1.2 instead of v1.1
|
2023-05-29 12:39:45 -05:00 |
|
|
khanon
|
2d93463247
|
Implement support for Anthropic keys and Claude API (khanon/oai-reverse-proxy!15)
|
2023-05-29 17:08:08 +00:00 |
|
|
nai-degen
|
03aaa6daad
|
wraps SSE error responses in code block backticks
|
2023-05-23 12:28:06 -05:00 |
|
|
nai-degen
|
13b6a3d7b8
|
adds header to improve nginx compatibility
|
2023-05-23 11:57:14 -05:00 |
|
|
nai-degen
|
03616f4bbc
|
increases wait time estimation window to 5min
|
2023-05-23 11:26:40 -05:00 |
|
|
nai-degen
|
01eee61e8b
|
checks the request content-type instead...
|
2023-05-22 21:14:58 -05:00 |
|
|
nai-degen
|
e3603a60e9
|
follow-up to Accept header adjustment
|
2023-05-22 21:02:11 -05:00 |
|
|
nai-degen
|
b24894d98f
|
fixes origin block response to account for clients sending bad headers
|
2023-05-22 20:29:49 -05:00 |
|
|
nai-degen
|
26a6e4cadb
|
increases wait time calculation window
|
2023-05-22 19:33:03 -05:00 |
|
|
nai-degen
|
a61fa04fbf
|
Implements origin/referrer block (khanon/oai-reverse-proxy!13)
|
2023-05-22 21:08:20 +00:00 |
|
|
nai-degen
|
2bad644772
|
Prefer user tokens as rate-limit/queue keys when available (khanon/oai-reverse-proxy!10)
|
2023-05-19 04:33:20 +00:00 |
|
|
nai-degen
|
3f46d132f7
|
disables per-user IP limit by default
|
2023-05-14 14:46:14 -05:00 |
|
|
nai-degen
|
9ff7381f31
|
exempts 'special' user role from auto-ban
|
2023-05-14 14:37:50 -05:00 |
|
|
nai-degen
|
6eb121ac66
|
disables keys shared between too many IP addresses
|
2023-05-14 14:30:32 -05:00 |
|
|
nai-degen
|
285186d70e
|
fixes keys being lost if not used at least once
|
2023-05-14 13:32:41 -05:00 |
|
|
nai-degen
|
f1ac64fa12
|
Implement user persistence via Firebase (khanon/oai-reverse-proxy!8)
|
2023-05-14 04:26:08 +00:00 |
|
|
nai-degen
|
546b28cca6
|
increases wait time calc window to 90sec
|
2023-05-13 13:32:37 -05:00 |
|
|
nai-degen
|
977247d7a2
|
User authentication (khanon/oai-reverse-proxy!7)
|
2023-05-13 00:58:15 +00:00 |
|
|
nai-degen
|
5238aff378
|
reverts default quotaDisplay to partial; removes rejectSampleRate
|
2023-05-11 20:35:28 -05:00 |
|