Commit Graph

32 Commits

Author SHA1 Message Date
nai-degen 075e415343 makes incoming model name validation less strict for PaLM endpoint 2023-09-20 23:55:53 -05:00
khanon 35a6c393ed Add support for Google PaLM and OpenAI Turbo Instruct (khanon/oai-reverse-proxy!44) 2023-09-19 23:13:08 +00:00
nai-degen 5e57dbb8f1 attempts to improve compatibility with BetterGPT frontend 2023-09-16 11:04:40 -05:00
nai-degen 7b3d6efb02 reverts anthropic-version change as it breaks some frontends 2023-09-07 22:01:19 -05:00
nai-degen 63542bfabb adds anthropic-version header in all cases 2023-09-07 20:23:34 -05:00
khanon f05e196994 Refactor project structure and add user self-serve UI (khanon/oai-reverse-proxy!41) 2023-09-02 19:36:44 +00:00
khanon 4d781e1720 Add GPT-4-32k support (khanon/oai-reverse-proxy!39) 2023-08-29 22:56:54 +00:00
khanon 6833736392 Clone keys assigned to multiple organizations (khanon/oai-reverse-proxy!38) 2023-08-28 21:11:49 +00:00
khanon cb780e85da Per-user token quotas and automatic quota refreshing (khanon/oai-reverse-proxy!37) 2023-08-28 19:33:14 +00:00
nai-degen d1d83b41fa uses accurate Claude tokenization 2023-08-08 17:29:36 -05:00
nai-degen 00346360af fixes turbo-16k incompatibility 2023-07-23 20:13:38 -05:00
khanon 56a4902599 Add tokenizers and configurable context size limits (khanon/oai-reverse-proxy!28) 2023-07-22 00:11:32 +00:00
nai-degen efa1b03570 uses claude-v1 by default as anthropic seems to be turning off v1.2 2023-07-19 01:48:57 -05:00
nai-degen 6598b4df0d requests old version of Anthropic API due to breaking SSE changes 2023-06-24 14:50:48 -05:00
nai-degen c8b3238398 reorganizes origin header middleware 2023-06-24 14:25:01 -05:00
nai-degen 602931bf7f removes origin/referer headers from proxied request 2023-06-23 00:08:09 -05:00
khanon 43359779e7 Implements more robust anti-zoomer functionality (khanon/oai-reverse-proxy!24) 2023-06-14 04:05:51 +00:00
khanon 96cf4a0e2d Automatically add Anthropic "\n\nHuman:" preamble when necessary (khanon/oai-reverse-proxy!23) 2023-06-09 07:16:40 +00:00
khanon 120040c028 Separate MAX_OUTPUT_TOKENS config for OpenAI/Claude (khanon/oai-reverse-proxy!21) 2023-06-08 00:58:57 +00:00
khanon 7b5e612921 Workaround for Anthropic requiring some prompts to start with Human: (khanon/oai-reverse-proxy!20) 2023-06-05 21:55:59 +00:00
khanon cd754bd601 Allow overriding default Claude model selection (khanon/oai-reverse-proxy!19) 2023-06-05 03:12:34 +00:00
khanon dae1262f7a Refactor request middleware (khanon/oai-reverse-proxy!18) 2023-06-02 04:03:16 +00:00
nai-degen f621031ec1 fixes circluar dependency that broke tsc but not esbuild 2023-05-30 04:01:03 -05:00
khanon 6723cbf662 Anthropic endpoint improvements (khanon/oai-reverse-proxy!16) 2023-05-30 03:13:17 +00:00
nai-degen 30bdc7cd5e shitty quick fix for tavern+openai not working properly 2023-05-29 13:23:38 -05:00
nai-degen f102f02a65 adds stop sequences for better UJB/group chat behavior on claude 2023-05-29 13:07:15 -05:00
nai-degen 304893e13d uses claude v1.2 instead of v1.1 2023-05-29 12:39:45 -05:00
khanon 2d93463247 Implement support for Anthropic keys and Claude API (khanon/oai-reverse-proxy!15) 2023-05-29 17:08:08 +00:00
nai-degen 5238aff378 reverts default quotaDisplay to partial; removes rejectSampleRate 2023-05-11 20:35:28 -05:00
nai-degen e03f3d48dd Implements request queueing (khanon/oai-reverse-proxy!6) 2023-05-09 23:11:57 +00:00
nai-degen 176a37928d Implement support for streamed OpenAI responses (khanon/oai-reverse-proxy!4) 2023-05-01 22:01:47 +00:00
nai-degen fc3043dad0 Implements prompt logging via Google Sheets (khanon/oai-reverse-proxy!1) 2023-04-15 01:21:04 +00:00