Commit Graph

33 Commits

Author SHA1 Message Date
khanon fbdea30264 Azure OpenAI suport (khanon/oai-reverse-proxy!48) 2023-12-04 04:21:18 +00:00
khanon 20c064394a OpenAI DALL-E Image Generation (khanon/oai-reverse-proxy!52) 2023-11-14 05:41:19 +00:00
nai-degen b6f8f15a1f tries to prevent per-day rate limited keys from bricking the queue 2023-11-06 21:16:36 -06:00
nai-degen 52ec2ec265 fixes blank AWS responses due to reqs sometimes using wrong handler 2023-10-23 22:23:06 -05:00
nai-degen 3f7e50f87e follow-up 'fixes empty AWS streaming responses when under heavy load' 2023-10-15 00:06:38 -05:00
khanon ecf897e685 Refactor handleStreamingResponse to make it less shit (khanon/oai-reverse-proxy!46) 2023-10-03 06:14:19 +00:00
nai-degen ede274c117 disables AWS key on AccessDeniedException 2023-10-02 11:18:08 -05:00
khanon fa4bf468d2 Implement AWS Bedrock support (khanon/oai-reverse-proxy!45) 2023-10-01 01:40:18 +00:00
khanon 35a6c393ed Add support for Google PaLM and OpenAI Turbo Instruct (khanon/oai-reverse-proxy!44) 2023-09-19 23:13:08 +00:00
khanon f05e196994 Refactor project structure and add user self-serve UI (khanon/oai-reverse-proxy!41) 2023-09-02 19:36:44 +00:00
nai-degen 2c0a659b2d adds token consumption stats to infopage 2023-08-30 20:40:40 -05:00
khanon 4d781e1720 Add GPT-4-32k support (khanon/oai-reverse-proxy!39) 2023-08-29 22:56:54 +00:00
khanon cb780e85da Per-user token quotas and automatic quota refreshing (khanon/oai-reverse-proxy!37) 2023-08-28 19:33:14 +00:00
nai-degen 6bb67281d9 removes QUEUE_MODE config (now always enabled) 2023-08-09 18:29:34 -05:00
khanon aa5380d2ef Rework OpenAIKeyChecker to remove usage tracking and test all keys for liveness (khanon/oai-reverse-proxy!29) 2023-07-21 04:00:12 +00:00
nai-degen d7a4829d13 handles keys which have been banned (but not revoked) by openai 2023-07-19 10:28:38 -05:00
khanon 96cf4a0e2d Automatically add Anthropic "\n\nHuman:" preamble when necessary (khanon/oai-reverse-proxy!23) 2023-06-09 07:16:40 +00:00
khanon dae1262f7a Refactor request middleware (khanon/oai-reverse-proxy!18) 2023-06-02 04:03:16 +00:00
nai-degen a6c6e4c694 allows KeyPool.available to be scoped per-service 2023-06-01 08:31:41 -05:00
khanon 6723cbf662 Anthropic endpoint improvements (khanon/oai-reverse-proxy!16) 2023-05-30 03:13:17 +00:00
khanon 2d93463247 Implement support for Anthropic keys and Claude API (khanon/oai-reverse-proxy!15) 2023-05-29 17:08:08 +00:00
nai-degen 977247d7a2 User authentication (khanon/oai-reverse-proxy!7) 2023-05-13 00:58:15 +00:00
nai-degen e03f3d48dd Implements request queueing (khanon/oai-reverse-proxy!6) 2023-05-09 23:11:57 +00:00
nai-degen e9e9f1f8b6 corrects openai incorrectly referred to as 'downstream' 2023-05-06 10:07:09 -05:00
nai-degen e541a7b892 forgot string.replace doesn't actually mutate the string 2023-05-06 09:55:59 -05:00
nai-degen 119c2f827a fixes org-ID redaction on errors which don't include one 2023-05-06 09:51:18 -05:00
gronon e0529197cd Prevent leaking OpenAI organization-ids in error responses (khanon/oai-reverse-proxy!5) 2023-05-06 12:22:05 +00:00
nai-degen 432023f875 cycles out keys which have been disabled 2023-05-05 09:50:43 -05:00
nai-degen 4dc9c649d8 fixes server blowing up when a streaming request drops out 2023-05-04 16:37:16 -05:00
nai-degen 176a37928d Implement support for streamed OpenAI responses (khanon/oai-reverse-proxy!4) 2023-05-01 22:01:47 +00:00
nai-degen 2b783e0f2b improves model_not_found error message 2023-04-30 22:01:45 -07:00
nai-degen 16b5ccb977 disables key downgrade feature to prevent abuse 2023-04-30 21:30:42 -07:00
nai-degen fc3043dad0 Implements prompt logging via Google Sheets (khanon/oai-reverse-proxy!1) 2023-04-15 01:21:04 +00:00