 nai-degen
|
2c0a659b2d
|
adds token consumption stats to infopage
|
2023-08-30 20:40:40 -05:00 |
|
|
nai-degen
|
7cab0a5c52
|
fixes tsc issue breaking build
|
2023-08-30 14:31:47 -05:00 |
|
|
nai-degen
|
27a1181752
|
adds optional token quota limits for gpt4-32k
|
2023-08-30 13:57:10 -05:00 |
|
|
khanon
|
4d781e1720
|
Add GPT-4-32k support (khanon/oai-reverse-proxy!39)
|
2023-08-29 22:56:54 +00:00 |
|
|
nai-degen
|
3c56103de0
|
adds optional user_token nicknames
|
2023-08-29 14:20:28 -05:00 |
|
|
khanon
|
6833736392
|
Clone keys assigned to multiple organizations (khanon/oai-reverse-proxy!38)
|
2023-08-28 21:11:49 +00:00 |
|
|
nai-degen
|
7c9c3a640c
|
minor cleanup for user quota docs/examples
|
2023-08-28 14:51:28 -05:00 |
|
|
khanon
|
cb780e85da
|
Per-user token quotas and automatic quota refreshing (khanon/oai-reverse-proxy!37)
|
2023-08-28 19:33:14 +00:00 |
|
|
nai-degen
|
785b1f69f3
|
implements new local risu validation (via @kwaroran)
|
2023-08-28 05:28:58 -05:00 |
|
|
nai-degen
|
6bb67281d9
|
removes QUEUE_MODE config (now always enabled)
|
2023-08-09 18:29:34 -05:00 |
|
|
nai-degen
|
d1d83b41fa
|
uses accurate Claude tokenization
|
2023-08-08 17:29:36 -05:00 |
|
|
nai-degen
|
125bbe6441
|
fixes issue with writeErrorResponse
|
2023-08-04 13:49:11 -05:00 |
|
|
nai-degen
|
00346360af
|
fixes turbo-16k incompatibility
|
2023-07-23 20:13:38 -05:00 |
|
|
nai-degen
|
e2bd8a6b86
|
extracts Risu auth into new middleware so queue can use it too
|
2023-07-22 13:48:02 -05:00 |
|
|
khanon
|
56a4902599
|
Add tokenizers and configurable context size limits (khanon/oai-reverse-proxy!28)
|
2023-07-22 00:11:32 +00:00 |
|
|
khanon
|
7634afeea4
|
Implement rate limit for risuai.xyz (khanon/oai-reverse-proxy!31)
|
2023-07-21 21:48:07 +00:00 |
|
|
khanon
|
aa5380d2ef
|
Rework OpenAIKeyChecker to remove usage tracking and test all keys for liveness (khanon/oai-reverse-proxy!29)
|
2023-07-21 04:00:12 +00:00 |
|
|
breathingmanually
|
576423d1f8
|
Fix JSON parse exception when Claude finishes streaming (khanon/oai-reverse-proxy!25)
|
2023-07-20 01:57:50 +00:00 |
|
|
Xrystallized
|
120b7da340
|
Include non /v1 url in check (khanon/oai-reverse-proxy!27)
|
2023-07-19 16:00:29 +00:00 |
|
|
nai-degen
|
d7a4829d13
|
handles keys which have been banned (but not revoked) by openai
|
2023-07-19 10:28:38 -05:00 |
|
|
nai-degen
|
efa1b03570
|
uses claude-v1 by default as anthropic seems to be turning off v1.2
|
2023-07-19 01:48:57 -05:00 |
|
|
khanon
|
7478112077
|
fixes embarrassing auth oversight
|
2023-07-16 07:31:44 +00:00 |
|
|
nai-degen
|
aee382c84e
|
adds claude-2 to supported models
|
2023-07-11 09:14:46 -05:00 |
|
|
nai-degen
|
6598b4df0d
|
requests old version of Anthropic API due to breaking SSE changes
|
2023-06-24 14:50:48 -05:00 |
|
|
nai-degen
|
6a7f64b037
|
adds missed change from origin header adjustment
|
2023-06-24 14:25:30 -05:00 |
|
|
nai-degen
|
c8b3238398
|
reorganizes origin header middleware
|
2023-06-24 14:25:01 -05:00 |
|
|
nai-degen
|
602931bf7f
|
removes origin/referer headers from proxied request
|
2023-06-23 00:08:09 -05:00 |
|
|
khanon
|
43359779e7
|
Implements more robust anti-zoomer functionality (khanon/oai-reverse-proxy!24)
|
2023-06-14 04:05:51 +00:00 |
|
|
nai-degen
|
3a2a6e96fd
|
adds new OpenAI June 2023 models
|
2023-06-13 16:24:34 -05:00 |
|
|
khanon
|
96cf4a0e2d
|
Automatically add Anthropic "\n\nHuman:" preamble when necessary (khanon/oai-reverse-proxy!23)
|
2023-06-09 07:16:40 +00:00 |
|
|
khanon
|
4f2a12ef14
|
Show per-model queues and keys on info page (khanon/oai-reverse-proxy!22)
|
2023-06-08 18:50:04 +00:00 |
|
|
khanon
|
120040c028
|
Separate MAX_OUTPUT_TOKENS config for OpenAI/Claude (khanon/oai-reverse-proxy!21)
|
2023-06-08 00:58:57 +00:00 |
|
|
nai-degen
|
a6a0c21f7d
|
makes gatekeeper compatible with sillytavern claude impl
|
2023-06-06 20:53:50 -05:00 |
|
|
khanon
|
7b5e612921
|
Workaround for Anthropic requiring some prompts to start with Human: (khanon/oai-reverse-proxy!20)
|
2023-06-05 21:55:59 +00:00 |
|
|
khanon
|
cd754bd601
|
Allow overriding default Claude model selection (khanon/oai-reverse-proxy!19)
|
2023-06-05 03:12:34 +00:00 |
|
|
nai-degen
|
38ff0e3f3b
|
fixes prompt logging for streamed Claude requests
|
2023-06-04 12:16:29 -05:00 |
|
|
khanon
|
dae1262f7a
|
Refactor request middleware (khanon/oai-reverse-proxy!18)
|
2023-06-02 04:03:16 +00:00 |
|
|
nai-degen
|
a26979f7bc
|
returns static model list instead of proxying
|
2023-06-01 20:17:09 -05:00 |
|
|
nai-degen
|
a6c6e4c694
|
allows KeyPool.available to be scoped per-service
|
2023-06-01 08:31:41 -05:00 |
|
|
nai-degen
|
b7fa65d9f9
|
fixes dumb /v1/models bug affecting sillytavern again
|
2023-05-31 13:53:24 -05:00 |
|
|
nai-degen
|
f621031ec1
|
fixes circluar dependency that broke tsc but not esbuild
|
2023-05-30 04:01:03 -05:00 |
|
|
khanon
|
6723cbf662
|
Anthropic endpoint improvements (khanon/oai-reverse-proxy!16)
|
2023-05-30 03:13:17 +00:00 |
|
|
nai-degen
|
30bdc7cd5e
|
shitty quick fix for tavern+openai not working properly
|
2023-05-29 13:23:38 -05:00 |
|
|
nai-degen
|
f102f02a65
|
adds stop sequences for better UJB/group chat behavior on claude
|
2023-05-29 13:07:15 -05:00 |
|
|
nai-degen
|
304893e13d
|
uses claude v1.2 instead of v1.1
|
2023-05-29 12:39:45 -05:00 |
|
|
khanon
|
2d93463247
|
Implement support for Anthropic keys and Claude API (khanon/oai-reverse-proxy!15)
|
2023-05-29 17:08:08 +00:00 |
|
|
nai-degen
|
03aaa6daad
|
wraps SSE error responses in code block backticks
|
2023-05-23 12:28:06 -05:00 |
|
|
nai-degen
|
13b6a3d7b8
|
adds header to improve nginx compatibility
|
2023-05-23 11:57:14 -05:00 |
|
|
nai-degen
|
03616f4bbc
|
increases wait time estimation window to 5min
|
2023-05-23 11:26:40 -05:00 |
|
|
nai-degen
|
01eee61e8b
|
checks the request content-type instead...
|
2023-05-22 21:14:58 -05:00 |
|