 nai-degen
|
30bdc7cd5e
|
shitty quick fix for tavern+openai not working properly
|
2023-05-29 13:23:38 -05:00 |
|
|
nai-degen
|
f102f02a65
|
adds stop sequences for better UJB/group chat behavior on claude
|
2023-05-29 13:07:15 -05:00 |
|
|
nai-degen
|
304893e13d
|
uses claude v1.2 instead of v1.1
|
2023-05-29 12:39:45 -05:00 |
|
|
khanon
|
2d93463247
|
Implement support for Anthropic keys and Claude API (khanon/oai-reverse-proxy!15)
|
2023-05-29 17:08:08 +00:00 |
|
|
nai-degen
|
03aaa6daad
|
wraps SSE error responses in code block backticks
|
2023-05-23 12:28:06 -05:00 |
|
|
nai-degen
|
13b6a3d7b8
|
adds header to improve nginx compatibility
|
2023-05-23 11:57:14 -05:00 |
|
|
nai-degen
|
03616f4bbc
|
increases wait time estimation window to 5min
|
2023-05-23 11:26:40 -05:00 |
|
|
nai-degen
|
01eee61e8b
|
checks the request content-type instead...
|
2023-05-22 21:14:58 -05:00 |
|
|
nai-degen
|
e3603a60e9
|
follow-up to Accept header adjustment
|
2023-05-22 21:02:11 -05:00 |
|
|
nai-degen
|
b24894d98f
|
fixes origin block response to account for clients sending bad headers
|
2023-05-22 20:29:49 -05:00 |
|
|
nai-degen
|
26a6e4cadb
|
increases wait time calculation window
|
2023-05-22 19:33:03 -05:00 |
|
|
nai-degen
|
a61fa04fbf
|
Implements origin/referrer block (khanon/oai-reverse-proxy!13)
|
2023-05-22 21:08:20 +00:00 |
|
|
nai-degen
|
2bad644772
|
Prefer user tokens as rate-limit/queue keys when available (khanon/oai-reverse-proxy!10)
|
2023-05-19 04:33:20 +00:00 |
|
|
nai-degen
|
3f46d132f7
|
disables per-user IP limit by default
|
2023-05-14 14:46:14 -05:00 |
|
|
nai-degen
|
9ff7381f31
|
exempts 'special' user role from auto-ban
|
2023-05-14 14:37:50 -05:00 |
|
|
nai-degen
|
6eb121ac66
|
disables keys shared between too many IP addresses
|
2023-05-14 14:30:32 -05:00 |
|
|
nai-degen
|
285186d70e
|
fixes keys being lost if not used at least once
|
2023-05-14 13:32:41 -05:00 |
|
|
nai-degen
|
f1ac64fa12
|
Implement user persistence via Firebase (khanon/oai-reverse-proxy!8)
|
2023-05-14 04:26:08 +00:00 |
|
|
nai-degen
|
546b28cca6
|
increases wait time calc window to 90sec
|
2023-05-13 13:32:37 -05:00 |
|
|
nai-degen
|
977247d7a2
|
User authentication (khanon/oai-reverse-proxy!7)
|
2023-05-13 00:58:15 +00:00 |
|
|
nai-degen
|
5238aff378
|
reverts default quotaDisplay to partial; removes rejectSampleRate
|
2023-05-11 20:35:28 -05:00 |
|
|
nai-degen
|
7382bdc92e
|
cleans up ratelimit table more frequently to smooth proompters display
|
2023-05-11 11:50:44 -05:00 |
|
|
nai-degen
|
09184079af
|
reduces wait time window from 2min to 1min
|
2023-05-11 11:45:15 -05:00 |
|
|
nai-degen
|
8ff43aef1a
|
disables kobold endpoint when queueing is enabled
|
2023-05-10 11:44:03 -05:00 |
|
|
nai-degen
|
e03f3d48dd
|
Implements request queueing (khanon/oai-reverse-proxy!6)
|
2023-05-09 23:11:57 +00:00 |
|
|
nai-degen
|
e9e9f1f8b6
|
corrects openai incorrectly referred to as 'downstream'
|
2023-05-06 10:07:09 -05:00 |
|
|
nai-degen
|
e541a7b892
|
forgot string.replace doesn't actually mutate the string
|
2023-05-06 09:55:59 -05:00 |
|
|
nai-degen
|
119c2f827a
|
fixes org-ID redaction on errors which don't include one
|
2023-05-06 09:51:18 -05:00 |
|
|
gronon
|
e0529197cd
|
Prevent leaking OpenAI organization-ids in error responses (khanon/oai-reverse-proxy!5)
|
2023-05-06 12:22:05 +00:00 |
|
|
nai-degen
|
432023f875
|
cycles out keys which have been disabled
|
2023-05-05 09:50:43 -05:00 |
|
|
nai-degen
|
4dc9c649d8
|
fixes server blowing up when a streaming request drops out
|
2023-05-04 16:37:16 -05:00 |
|
|
nai-degen
|
176a37928d
|
Implement support for streamed OpenAI responses (khanon/oai-reverse-proxy!4)
|
2023-05-01 22:01:47 +00:00 |
|
|
nai-degen
|
2b783e0f2b
|
improves model_not_found error message
|
2023-04-30 22:01:45 -07:00 |
|
|
nai-degen
|
16b5ccb977
|
disables key downgrade feature to prevent abuse
|
2023-04-30 21:30:42 -07:00 |
|
|
nai-degen
|
673f6f6185
|
actually fixes prompt logger path detection
|
2023-04-14 20:54:55 -07:00 |
|
|
nai-degen
|
5e046b9060
|
fixes bug introduced in previous commit which prevented logging
|
2023-04-14 20:19:26 -07:00 |
|
|
nai-degen
|
34ed165a6f
|
fixes issue with attempting to log non-completion endpoints
|
2023-04-14 20:10:14 -07:00 |
|
|
nai-degen
|
fc3043dad0
|
Implements prompt logging via Google Sheets (khanon/oai-reverse-proxy!1)
|
2023-04-15 01:21:04 +00:00 |
|
|
nai-degen
|
a767044850
|
Refactor onProxyRes handlers to use middleware stack (khanon/oai-reverse-proxy!2)
|
2023-04-14 15:29:11 +00:00 |
|
|
nai-degen
|
bbcc76266f
|
improves downstream API error handling
|
2023-04-11 05:01:35 -07:00 |
|
|
nai-degen
|
920612f1ce
|
rewrites urls to deal with client idiosyncrasies
|
2023-04-11 03:20:19 -07:00 |
|
|
nai-degen
|
15ed8e7c25
|
adds TODOs so I don't forget
|
2023-04-10 20:02:48 -07:00 |
|
|
nai-degen
|
885487a61d
|
fixes kobold key selection, I think
|
2023-04-10 19:50:42 -07:00 |
|
|
nai-degen
|
f37a2fa7fa
|
temporarily disable gpt-4 for kobold as it is broken
|
2023-04-10 04:56:04 -07:00 |
|
|
nai-degen
|
f0afc8c420
|
fixes kobold endpoint not actually being rate-limited
|
2023-04-10 06:42:12 -05:00 |
|
|
nai-degen
|
91cba67650
|
fixes kobold content-encoding
|
2023-04-10 00:53:27 -07:00 |
|
|
nai-degen
|
14c890f268
|
refactors keypool and implements key health checks
|
2023-04-10 00:27:45 -07:00 |
|
|
nai-degen
|
39cdb2e1e8
|
moves keys.ts into keys/key-pool.ts
|
2023-04-09 21:26:58 -07:00 |
|
|
nai-degen
|
7bb70ddfdc
|
correctly decompresses gzip/deflate payloads
|
2023-04-09 02:30:59 -05:00 |
|
|
nai-degen
|
326def06a3
|
adjusts logging to troubleshoot errors from openai
|
2023-04-09 01:13:41 -05:00 |
|