Commit Graph

Select branches

Hide Pull Requests

main

Mono Color

• b90abbda88 spoofs response for SillyTavern test messages nai-degen 2024-02-28 15:57:18 -06:00
• 93cee1db9b removes claude v1 from AWS keychecker as it has been retired nai-degen 2024-02-27 15:52:09 -06:00
• bd15728743 uses explicitly set keyprovider rather than inferring via requested model nai-degen 2024-02-27 10:56:40 -06:00
• 627559b729 updates mistral modelids nai-degen 2024-02-26 23:55:03 -06:00
• 428e103323 allows customizing the /proxy endpoint prefix nai-degen 2024-02-26 18:20:34 -06:00
• fd742fc0cb Merge remote-tracking branch 'origin/main' nai-degen 2024-02-26 18:12:23 -06:00
• 5e19e2756a adds mistral-large model family, untested nai-degen 2024-02-26 18:12:08 -06:00
• d3f7c675e3 add pricing for Azure GPT counterparts and update Claude pricing (khanon/oai-reverse-proxy!65) devvnull 2024-02-20 03:53:26 +00:00
• 59bda40bbc handles google streaming json response format variation nai-degen 2024-02-19 00:12:09 -06:00
• 68d829bceb adds Claude over-quota detection nai-degen 2024-02-17 15:56:22 -06:00
• 9c03290a3d detects anthropic copyright prefill pozzing nai-degen 2024-02-16 10:22:45 -06:00
• 3498584a1f removes forceModel on Google AI endpoint nai-degen 2024-02-15 11:41:34 -06:00
• 21d61da62b increases max image payload size for gpt4v nai-degen 2024-02-12 21:58:46 -06:00
• 35dc0f4826 fixes 'Premature close' caused by fucked up AWS unmarshaller errors nai-degen 2024-02-10 14:47:14 -06:00
• a2ae9f32db handles OpenAI organization check failures due to missing API scopes nai-degen 2024-02-09 00:18:21 -06:00
• 0ce4582f3b Improve "\n\nHuman" prefix requirement detection for Anthropic (khanon/oai-reverse-proxy!63) devvnull 2024-02-08 16:28:11 +00:00
• bbee056114 fixes Force Key Recheck admin function for azure/aws nai-degen 2024-02-07 19:54:40 -06:00
• ecc804887b uses EventStreamMarshaller from AWS SDK to hopefully handle split messages nai-degen 2024-02-05 19:56:41 -06:00
• a8fd3c7240 fixes AWS Claude throttlingException handling nai-degen 2024-02-04 20:48:20 -06:00
• 40240601f5 refactors SSEStreamAdapter to fix leaking decoder streams nai-degen 2024-02-04 18:38:06 -06:00
• 98cea2da02 replaces eventstream lib to (hopefully) fix interrupted AWS streams nai-degen 2024-02-04 17:18:28 -06:00
• c88f47d0ed fixes middleware order breaking /proxy endpoint nai-degen 2024-02-04 16:21:44 -06:00
• 43106d9c7f tracks Risu userid rather than IP address on usertokens nai-degen 2024-02-04 14:14:36 -06:00
• fe429a7610 adds SERVICE_INFO_PASSWORD to gate infopage behind a password nai-degen 2024-02-04 14:04:46 -06:00
• 235510e588 fixes incorrect AWS Claude 2.1 max context limit nai-degen 2024-02-01 20:40:15 -06:00
• 7eb6eb90ad moves api schema validators from transform-outbound-payload into shared nai-degen 2024-01-29 19:38:22 -06:00
• 924db33f7e attempts to auto-convert Mistral prompts for its more strict rules nai-degen 2024-01-28 17:42:23 -06:00
• 3f2f30e605 updates gpt4-v tokenizer for previous Risu change nai-degen 2024-01-27 13:35:46 -06:00
• c9791acd85 makes gpt4-v input validation less strict to accomodate Risu nai-degen 2024-01-27 13:24:11 -06:00
• e871b8ecf1 removes logprobs default value since it breaks gpt-4-vision nai-degen 2024-01-27 12:19:24 -06:00
• 37ca98ad30 adds dark mode (infopage only currently) nai-degen 2024-01-25 16:24:11 -06:00
• e6dc4475e6 fixes max context size for nu-gpt4-turbo nai-degen 2024-01-25 14:07:42 -06:00
• 5e646b1c86 adds gpt-4-0125-preview and gpt-4-turbo-preview alias nai-degen 2024-01-25 13:27:03 -06:00
• 6f626e623e fixes OAI trial keys bricking the dall-e queue nai-degen 2024-01-25 01:47:51 -06:00
• 02a54bf4e3 fixes azure openai logprobs (actually tested this time) nai-degen 2024-01-25 01:17:18 -06:00
• 79b2e5b6fd adds very basic support for OpenAI function calling nai-degen 2024-01-24 16:42:26 -06:00
• 935a633325 fixes typo in Azure logprob adjustment nai-degen 2024-01-24 16:03:26 -06:00
• 4a4b60ebcd handles Azure deviation from OpenAI spec on logprobs param nai-degen 2024-01-24 16:01:19 -06:00
• ad465be363 fixes logprobs schema validation for turbo instruct endpoint nai-degen 2024-01-24 14:31:10 -06:00
• c7a351baa8 adds support for requesting logprobs from OpenAI Chat Completions API nai-degen 2024-01-24 11:46:09 -06:00
• ba8b052b17 adds bindAddress to omitted config keys nai-degen 2024-01-17 02:31:30 -06:00
• e813cd9d22 default claude 2.1 instead of 1.3 in openai compat endpoint since 1.3 is not accessible on all keys nai-degen 2024-01-17 02:36:21 -06:00
• 4c2a2c1e6c improves handle-streamed-response comments/docs [skip-ci] nai-degen 2024-01-17 11:23:08 -06:00
• f1d927fa62 updates README with building/forking info [skip-ci] nai-degen 2024-01-15 11:46:05 -06:00
• ad6e5224e3 allows binding to loopback interface via app config instead of only docker nai-degen 2024-01-15 11:32:26 -06:00
• 85d89bdb9f fixes CI image tagging on main branch nai-degen 2024-01-15 01:37:50 -06:00
• f5e7195cc9 Add Gitlab CI and self-hosting instructions (khanon/oai-reverse-proxy!61) khanon 2024-01-15 06:51:12 +00:00
• 81f1e2bc37 fixes broken GET models endpoint for openai/mistral nai-degen 2024-01-14 05:33:24 -06:00
• c2a686f229 Revert "reduces max request body size for now" nai-degen 2024-01-13 18:12:16 -06:00
• 96a0f94041 Fix Mistral safe_prompt schema property (khanon/oai-reverse-proxy!60) twinkletoes 2024-01-14 00:11:39 +00:00
• d56043616e adds keychecker workaround for OpenAI API bug falsely returning gpt4-32k nai-degen 2024-01-12 10:33:48 -06:00
• e3e06b065d fixes sourcemap dependency in package.json nai-degen 2024-01-09 00:32:34 -06:00
• 1bbb515200 updates static service info nai-degen 2024-01-08 23:32:25 -06:00
• a57cc4e8d4 updates dotenv nai-degen 2024-01-08 23:25:02 -06:00
• 2239bead2c updates README.md nai-degen 2024-01-08 19:36:01 -06:00
• 1a585ddd32 adds TRUSTED_PROXIES to .env.example nai-degen 2024-01-08 16:41:30 -06:00
• be731691a1 allows configurable trust proxy setting for Render deployments nai-degen 2024-01-08 16:39:28 -06:00
• c2e442e030 long overdue removal of tired in-joke nai-degen 2024-01-08 11:01:44 -06:00
• d3ac3b362b trusts only one proxy hop (AWS WAF in huggingface's case) nai-degen 2024-01-07 19:17:37 -06:00
• 7b0892ddae fixes unawaited call to async enqueue nai-degen 2024-01-07 16:23:43 -06:00
• 7f92565739 SSE queueing adjustments, untested nai-degen 2024-01-07 16:19:22 -06:00
• 936d3c0721 corrects nodejs max heap memory config nai-degen 2024-01-07 16:16:27 -06:00
• 4ffa7fb12b reduces max request body size for now nai-degen 2024-01-07 13:03:24 -06:00
• 8dc7464381 strips extraneous properties on zod schemas nai-degen 2024-01-07 13:00:36 -06:00
• d2cd24bfd2 suggest larger nodejs max heap nai-degen 2024-01-07 12:58:50 -06:00
• e33f778192 Change mistral-medium friendly name (khanon/oai-reverse-proxy!59) twinkletoes 2023-12-26 00:27:17 +00:00
• 4a823b216f Mistral AI support (khanon/oai-reverse-proxy!58) twinkletoes 2023-12-25 18:33:16 +00:00
• 01e76cbb1c restores accidentally deleted line breaking infopage stats nai-degen 2023-12-17 00:25:58 -06:00
• 655703e680 refactors infopage nai-degen 2023-12-16 20:30:20 -06:00
• 3be2687793 tries to detect Azure GPT4-Turbo deployments more reliably nai-degen 2023-12-15 12:14:23 -06:00
• 5599a83ae4 improves streaming error handling nai-degen 2023-12-14 04:39:06 -06:00
• de34d41918 fixes gemini name prefixing when 'Add character names' is disabled in ST nai-degen 2023-12-13 23:21:30 -06:00
• c5cd90dcef adjusts prompt transform to discourage Gemini from speaking for user nai-degen 2023-12-13 23:03:57 -06:00
• 8a135a960d fixes gemini prompt reformatting for jbs; adds stop sequences nai-degen 2023-12-13 21:45:53 -06:00
• 707cbbce16 fixes gemini throwing an error on JB prompts nai-degen 2023-12-13 19:14:31 -06:00
• fad16cc268 Add Google AI API (khanon/oai-reverse-proxy!57) khanon 2023-12-13 21:56:07 +00:00
• 0d3682197c treats 403 from anthropic as key dead nai-degen 2023-12-11 09:13:53 -06:00
• e0624e30fd Fix some corner cases in SSE parsing (khanon/oai-reverse-proxy!56) valadaptive 2023-12-09 06:18:01 +00:00
• 94d4efe9bb properly enforce allowedModelFamilies; refactor HPM proxyReq handlers nai-degen 2023-12-05 21:41:04 -06:00
• 12276a1f59 Fix AWS Claude Model Reassigning (khanon/oai-reverse-proxy!55) random-username-423 2023-12-06 03:21:27 +00:00
• fdd824f0e4 adds azure rate limit auto-retry nai-degen 2023-12-04 01:23:55 -06:00
• fbdea30264 Azure OpenAI suport (khanon/oai-reverse-proxy!48) khanon 2023-12-04 04:21:18 +00:00
• cd1b9d0e0c don't print google api key to container logs on error nai-degen 2023-12-01 11:23:56 -06:00
• 9e61d9029f adds claude-2.1 (untested) nai-degen 2023-11-21 11:32:43 -06:00
• f95e24afbb fixes incorrect max model size for gpt4-v nai-degen 2023-11-19 02:23:41 -06:00
• f29049f993 Support for GPT-4-Vision (khanon/oai-reverse-proxy!54) khanon 2023-11-19 05:06:21 +00:00
• 7f2f324e26 fixes render dockerfile and dalle3 model detection nai-degen 2023-11-18 12:27:14 -06:00
• dc61291933 adds temporary keychecker var to treat dall-e-2 the same as dall-e-3 nai-degen 2023-11-17 20:24:36 -06:00
• 6c02e9b265 don't enqueue requests which fail stream check nai-degen 2023-11-17 14:36:47 -06:00
• e018672968 re-adds keychecker info to STATIC_INFO_PAGE nai-degen 2023-11-16 02:16:24 -06:00
• bfd7e23124 encodes queue payload nai-degen 2023-11-16 01:18:55 -06:00
• 6aa6bebf08 Scale SSE heartbeat size with traffic (khanon/oai-reverse-proxy!53) khanon 2023-11-16 05:45:35 +00:00
• 6acdf35914 removes length from stalled request error message nai-degen 2023-11-15 17:18:51 -06:00
• 3de79873e9 adds STATIC_SERVICE_INFO config nai-degen 2023-11-15 17:12:07 -06:00
• 3aca9e90f0 fixes rate limiter always using IMAGE_MODEL_RATE_LIMIT nai-degen 2023-11-15 13:07:58 -06:00
• 5fabe1d1f8 uses exponential moving average for wait time calculation nai-degen 2023-11-14 01:28:59 -06:00
• 4a68c14477 further increases OpenAI rate limit backoff nai-degen 2023-11-14 01:28:28 -06:00
• 20c064394a OpenAI DALL-E Image Generation (khanon/oai-reverse-proxy!52) khanon 2023-11-14 05:41:19 +00:00
• 3ea23760c3 adjusts prompt logging to truncate huge prompts from the end nai-degen 2023-11-11 20:14:32 -06:00
• 5db07404f2 fixes infopage crash when check_keys is disabled nai-degen 2023-11-10 22:41:57 -06:00