zack3d/simple-proxy
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Commit Graph

  • 6f4e581bf2 fixes forgotten http=true on admin cookie nai-degen 2023-08-09 11:01:30 -05:00
  • 358339d48b fixes issue with Claude <EOT> token disallowed nai-degen 2023-08-08 17:43:12 -05:00
  • c8d8e2e58f avoids instantiating new Claude tiktoken on every call nai-degen 2023-08-08 17:38:03 -05:00
  • d1d83b41fa uses accurate Claude tokenization nai-degen 2023-08-08 17:29:36 -05:00
  • 81ceee7897 adds pagination info below user table nai-degen 2023-08-05 23:49:14 -05:00
  • dc32e41ab5 updates user management docs nai-degen 2023-08-05 23:48:33 -05:00
  • 21ee00f057 fixes issue with IP count sorting nai-degen 2023-08-05 23:26:15 -05:00
  • 97a2b6b479 fixes build issue with missing EJS templates nai-degen 2023-08-05 23:01:58 -05:00
  • 61d90f3f3a fixes admin ui sort during pagination nai-degen 2023-08-05 21:16:44 -05:00
  • bb230469b2 Admin user management UI (khanon/oai-reverse-proxy!32) khanon 2023-08-06 00:58:33 +00:00
  • 125bbe6441 fixes issue with writeErrorResponse nai-degen 2023-08-04 13:49:11 -05:00
  • d29c304d5a increases tokenizer failsafe to 500000 characters nai-degen 2023-07-27 15:21:06 -05:00
  • addfa7c57b restores trial key detection via workaround nai-degen 2023-07-24 14:06:55 -05:00
  • e5b4c7bc9e removes key limit/trial status from infopage nai-degen 2023-07-24 13:11:59 -05:00
  • 51503dec14 disables key checker, mostly nai-degen 2023-07-24 13:11:45 -05:00
  • 00346360af fixes turbo-16k incompatibility nai-degen 2023-07-23 20:13:38 -05:00
  • e2bd8a6b86 extracts Risu auth into new middleware so queue can use it too nai-degen 2023-07-22 13:48:02 -05:00
  • b8534dafae reduces default MAX_OUTPUT_TOKENS_ANTHROPIC nai-degen 2023-07-21 19:18:21 -05:00
  • 56a4902599 Add tokenizers and configurable context size limits (khanon/oai-reverse-proxy!28) khanon 2023-07-22 00:11:32 +00:00
  • 7634afeea4 Implement rate limit for risuai.xyz (khanon/oai-reverse-proxy!31) khanon 2023-07-21 21:48:07 +00:00
  • 77c2309b52 correctly flags trial keys during startup even if over quota nai-degen 2023-07-20 23:06:37 -05:00
  • aa5380d2ef Rework OpenAIKeyChecker to remove usage tracking and test all keys for liveness (khanon/oai-reverse-proxy!29) khanon 2023-07-21 04:00:12 +00:00
  • cbf9f16108 removes clamp on quota display to better show glitched keys nai-degen 2023-07-19 23:34:09 -05:00
  • 576423d1f8 Fix JSON parse exception when Claude finishes streaming (khanon/oai-reverse-proxy!25) breathingmanually 2023-07-20 01:57:50 +00:00
  • c31540e54e bumps deps to address npm audit advisories nai-degen 2023-07-19 11:52:58 -05:00
  • 120b7da340 Include non /v1 url in check (khanon/oai-reverse-proxy!27) Xrystallized 2023-07-19 16:00:29 +00:00
  • d7a4829d13 handles keys which have been banned (but not revoked) by openai nai-degen 2023-07-19 10:28:38 -05:00
  • c749e2d57d adjusts claude rate limit handling to retry more aggressively nai-degen 2023-07-19 01:58:44 -05:00
  • efa1b03570 uses claude-v1 by default as anthropic seems to be turning off v1.2 nai-degen 2023-07-19 01:48:57 -05:00
  • f6f13f7955 Fix cell size error in sheets (khanon/oai-reverse-proxy!26) goanon016 2023-07-16 08:35:42 +00:00
  • 7478112077 fixes embarrassing auth oversight khanon 2023-07-16 07:31:44 +00:00
  • aee382c84e adds claude-2 to supported models nai-degen 2023-07-11 09:14:46 -05:00
  • 32605fff53 fixes infopage regression when CHECK_KEYS=false nai-degen 2023-07-08 15:29:43 -05:00
  • 71882b18ae adds feature to prevent GPT-4 model selection (default off) nai-degen 2023-07-06 16:09:30 -05:00
  • 561c063d90 assumes keys are GPT-4 by default since it's now GA nai-degen 2023-07-06 15:06:31 -05:00
  • 2a7efc8d42 cleans up minor pm audit items nai-degen 2023-07-06 07:26:52 -05:00
  • 327e860967 fixes wrong/misleading error msg when no Turbo keys available nai-degen 2023-07-04 11:49:12 -05:00
  • 6598b4df0d requests old version of Anthropic API due to breaking SSE changes nai-degen 2023-06-24 14:50:48 -05:00
  • 6a7f64b037 adds missed change from origin header adjustment nai-degen 2023-06-24 14:25:30 -05:00
  • c8b3238398 reorganizes origin header middleware nai-degen 2023-06-24 14:25:01 -05:00
  • 602931bf7f removes origin/referer headers from proxied request nai-degen 2023-06-23 00:08:09 -05:00
  • db034a51b3 prevents crash on startup when git is not installed nai-degen 2023-06-21 01:24:35 -05:00
  • 43359779e7 Implements more robust anti-zoomer functionality (khanon/oai-reverse-proxy!24) khanon 2023-06-14 04:05:51 +00:00
  • c0ac69df27 adjusts default origin block nai-degen 2023-06-13 21:18:31 -05:00
  • 3a2a6e96fd adds new OpenAI June 2023 models nai-degen 2023-06-13 16:24:34 -05:00
  • 96cf4a0e2d Automatically add Anthropic "\n\nHuman:" preamble when necessary (khanon/oai-reverse-proxy!23) khanon 2023-06-09 07:16:40 +00:00
  • 4f2a12ef14 Show per-model queues and keys on info page (khanon/oai-reverse-proxy!22) khanon 2023-06-08 18:50:04 +00:00
  • 120040c028 Separate MAX_OUTPUT_TOKENS config for OpenAI/Claude (khanon/oai-reverse-proxy!21) khanon 2023-06-08 00:58:57 +00:00
  • a6a0c21f7d makes gatekeeper compatible with sillytavern claude impl nai-degen 2023-06-06 20:53:50 -05:00
  • ace32c7e6e fix for huggingface not sending x-forwarded-host anymore nai-degen 2023-06-06 20:47:45 -05:00
  • 7b5e612921 Workaround for Anthropic requiring some prompts to start with Human: (khanon/oai-reverse-proxy!20) khanon 2023-06-05 21:55:59 +00:00
  • cd754bd601 Allow overriding default Claude model selection (khanon/oai-reverse-proxy!19) khanon 2023-06-05 03:12:34 +00:00
  • e6a8c548c2 reduces max log batch size to account for claude 100k prompts nai-degen 2023-06-04 12:42:12 -05:00
  • 176eef34db makes log queue backoff on errors rather than stop nai-degen 2023-06-04 12:40:57 -05:00
  • 38ff0e3f3b fixes prompt logging for streamed Claude requests nai-degen 2023-06-04 12:16:29 -05:00
  • dae1262f7a Refactor request middleware (khanon/oai-reverse-proxy!18) khanon 2023-06-02 04:03:16 +00:00
  • a26979f7bc returns static model list instead of proxying nai-degen 2023-06-01 20:17:09 -05:00
  • a6c6e4c694 allows KeyPool.available to be scoped per-service nai-degen 2023-06-01 08:31:41 -05:00
  • b7fa65d9f9 fixes dumb /v1/models bug affecting sillytavern again nai-degen 2023-05-31 13:53:24 -05:00
  • f621031ec1 fixes circluar dependency that broke tsc but not esbuild nai-degen 2023-05-30 04:01:03 -05:00
  • 6723cbf662 Anthropic endpoint improvements (khanon/oai-reverse-proxy!16) khanon 2023-05-30 03:13:17 +00:00
  • 2c8c81e6dd notes kobold endpoint as being deprecated nai-degen 2023-05-29 19:43:43 -05:00
  • 30bdc7cd5e shitty quick fix for tavern+openai not working properly nai-degen 2023-05-29 13:23:38 -05:00
  • f102f02a65 adds stop sequences for better UJB/group chat behavior on claude nai-degen 2023-05-29 13:06:17 -05:00
  • 304893e13d uses claude v1.2 instead of v1.1 nai-degen 2023-05-29 12:39:45 -05:00
  • dc43183353 adds anthropic endpoint to info page nai-degen 2023-05-29 12:21:39 -05:00
  • d7ddbeea54 shortens backoff on claude rate limit nai-degen 2023-05-29 12:16:46 -05:00
  • 2d93463247 Implement support for Anthropic keys and Claude API (khanon/oai-reverse-proxy!15) khanon 2023-05-29 17:08:08 +00:00
  • 03aaa6daad wraps SSE error responses in code block backticks nai-degen 2023-05-23 12:28:06 -05:00
  • 13b6a3d7b8 adds header to improve nginx compatibility nai-degen 2023-05-23 11:57:14 -05:00
  • 03616f4bbc increases wait time estimation window to 5min nai-degen 2023-05-23 11:26:40 -05:00
  • 01eee61e8b checks the request content-type instead... nai-degen 2023-05-22 21:14:58 -05:00
  • e3603a60e9 follow-up to Accept header adjustment nai-degen 2023-05-22 21:02:11 -05:00
  • b24894d98f fixes origin block response to account for clients sending bad headers nai-degen 2023-05-22 20:29:49 -05:00
  • 26a6e4cadb increases wait time calculation window nai-degen 2023-05-22 19:33:03 -05:00
  • a61fa04fbf Implements origin/referrer block (khanon/oai-reverse-proxy!13) nai-degen 2023-05-22 21:08:20 +00:00
  • a3620db591 Implement Test Generation for Trial Keys (khanon/oai-reverse-proxy!12) yukianon 2023-05-20 19:10:21 +00:00
  • fe305bee98 shows more detailed build info nai-degen 2023-05-19 20:53:13 -05:00
  • 5be848d0d1 removes Render queue note as Tavern bug is now fixed nai-degen 2023-05-19 09:34:56 -05:00
  • 2bad644772 Prefer user tokens as rate-limit/queue keys when available (khanon/oai-reverse-proxy!10) nai-degen 2023-05-19 04:33:20 +00:00
  • dfd8f0cc97 fixes missing closing bracket in infopage html nai-degen 2023-05-16 15:42:49 -05:00
  • 27caf1ff06 adds temporary disclaimer about streaming issues on Render nai-degen 2023-05-16 01:19:13 -05:00
  • 1f113b9150 updates render docs nai-degen 2023-05-15 17:05:12 -05:00
  • b4d8ebca4e adds noindex tag to infopage nai-degen 2023-05-15 17:05:04 -05:00
  • ec4e7a3671 Add docs and support for Render.com deployments (khanon/oai-reverse-proxy!9) nai-degen 2023-05-15 21:47:30 +00:00
  • 7f202dc9ef cleans up configs shown on info page nai-degen 2023-05-14 15:45:30 -05:00
  • 3f46d132f7 disables per-user IP limit by default nai-degen 2023-05-14 14:42:56 -05:00
  • 9ff7381f31 exempts 'special' user role from auto-ban nai-degen 2023-05-14 14:37:50 -05:00
  • 6eb121ac66 disables keys shared between too many IP addresses nai-degen 2023-05-14 14:30:32 -05:00
  • 285186d70e fixes keys being lost if not used at least once nai-degen 2023-05-14 13:32:41 -05:00
  • f1ac64fa12 Implement user persistence via Firebase (khanon/oai-reverse-proxy!8) nai-degen 2023-05-14 04:26:08 +00:00
  • 7126fb6c6c adds unhandled promise rejection listener just in case nai-degen 2023-05-13 13:37:42 -05:00
  • a7514e594d displays wait times more prominently on infopage nai-degen 2023-05-13 13:33:05 -05:00
  • 546b28cca6 increases wait time calc window to 90sec nai-degen 2023-05-13 13:32:37 -05:00
  • 977247d7a2 User authentication (khanon/oai-reverse-proxy!7) nai-degen 2023-05-13 00:58:15 +00:00
  • 5238aff378 reverts default quotaDisplay to partial; removes rejectSampleRate nai-degen 2023-05-11 20:35:28 -05:00
  • 7382bdc92e cleans up ratelimit table more frequently to smooth proompters display nai-degen 2023-05-11 11:50:44 -05:00
  • 09184079af reduces wait time window from 2min to 1min nai-degen 2023-05-11 11:45:07 -05:00
  • 8ff43aef1a disables kobold endpoint when queueing is enabled nai-degen 2023-05-09 19:17:00 -05:00
  • e03f3d48dd Implements request queueing (khanon/oai-reverse-proxy!6) nai-degen 2023-05-09 23:11:57 +00:00