Commit Graph

  • bace589984 Fix provider model inventories main Your Name 2026-04-06 04:26:43 -07:00
  • 8662eadea7 Update proxy for modern model APIs Your Name 2026-04-06 03:59:37 -07:00
  • 824adfbbb2 Show more detailed error in GCP checker Cg 2024-07-22 14:15:10 +00:00
  • 86d54fe5de Add AWS/GCP Sonnet 3.5 keys to info page Cg 2024-07-19 05:05:52 +00:00
  • b21219ff97 Minor changes Cg. 2024-07-17 13:27:04 +09:00
  • 011ee94cbf Update GCP configuration docs Cg. 2024-07-16 18:22:07 +09:00
  • 2096be43b9 fixes token index used as msg idx in anthropic chat-to-openai SSE transformer nai-degen 2024-07-07 13:33:33 -05:00
  • 2b4c2d1157 Fix GCP checker Cg. 2024-07-05 13:43:12 +09:00
  • eb5019cce1 Fix incorrect model family Cg. 2024-07-04 16:45:50 +09:00
  • 515c719b8f Minor fix of GCP docs Cg. 2024-06-29 17:40:22 +09:00
  • 962143d315 Add GCP configuration docs Cg. 2024-06-29 17:21:13 +09:00
  • 253cc37509 Fix error of GCP not being recognized Cg. 2024-06-29 16:45:31 +09:00
  • 02d3e4457b Implement GCP Claude support Cg. 2024-06-29 16:07:42 +09:00
  • 994b30dcce adjusts gemini pro model assignment nai-degen 2024-06-26 13:37:23 -05:00
  • e3d1ab51d1 improves handling of AWS regions with Sonnet 3.5 enabled but Sonnet 3.0 disabled nai-degen 2024-06-20 12:20:38 -05:00
  • ff38eda066 improves model detection for AWS Sydney region nai-degen 2024-06-20 12:15:18 -05:00
  • 84b917f726 fixes AWS Sonnet 3.5 key assignment bug nai-degen 2024-06-20 12:00:08 -05:00
  • 5871025245 fixes AWS keychecker failure caused by Sonnet 3.5 gradual rollout nai-degen 2024-06-20 11:24:26 -05:00
  • b4fb97ca5c fixes model id typo nai-degen 2024-06-20 10:42:48 -05:00
  • eb700d3da6 adds untested claude 3.5 model ids and model assignment nai-degen 2024-06-20 10:34:48 -05:00
  • d706d4c59d adds USER_CONCURRENCY_LIMIT environment variable nai-degen 2024-06-14 22:52:16 -05:00
  • 0ea43f61c2 fixes incorrect variable name in .env.example docs nai-degen 2024-06-09 11:36:20 -05:00
  • ca4321b4cb adjusts openai schema validation to allow ull stop sequence nai-degen 2024-06-07 14:29:18 -05:00
  • 7660ed8b94 allows enabling vision prompts on a per-service basis nai-degen 2024-06-07 12:09:43 -05:00
  • 55f1bbed3b adds ipv6 mask to default ADMIN_WHITELIST nai-degen 2024-06-02 20:49:18 -05:00
  • 57fd17ede0 makes it easier for clients to detect proxy errors programatically nai-degen 2024-05-27 15:30:28 -05:00
  • 9d00b8a9de adjusts max IP error message wording nai-degen 2024-05-27 08:24:56 -05:00
  • 155e185c6e fixes shutdown handler fuckup nai-degen 2024-05-26 15:36:54 -05:00
  • a59b6555e7 redacts de3u api-key from diagnostic logs nai-degen 2024-05-26 15:13:21 -05:00
  • 2d82e55d72 Sqlite backend with user event logging (khanon/oai-reverse-proxy!69) scrappyanon 2024-05-26 17:31:12 +00:00
  • 6352df5d5a fixes mixed ipv4-ipv6 handling in cidr module nai-degen 2024-05-24 02:02:21 -05:00
  • 7d517a4c5f fixes Refresh Token UI incorrectly discarding expired (but refreshable) temp tokens nai-degen 2024-05-22 22:18:23 -05:00
  • 0418951928 tries to provide better guidance on CSRF errors nai-degen 2024-05-21 13:10:54 -05:00
  • 3012aa651e adds slightly less-ugly global stylesheet; improves mobile compat nai-degen 2024-05-21 12:56:25 -05:00
  • 1b68ad7c6f docs update nai-degen 2024-05-21 12:46:51 -05:00
  • 68b48428de adjusts gatekeeper module to send auth errors as fake chat completions nai-degen 2024-05-21 12:39:07 -05:00
  • b76db652e0 adds configurable PoW timeout and iteration count nai-degen 2024-05-21 12:38:41 -05:00
  • 63ab1a7685 reverts debug change that broke info page nai-degen 2024-05-20 07:47:46 -05:00
  • a3462e21bc adds config setting for PoW verification timeout nai-degen 2024-05-19 15:17:25 -05:00
  • 8d2ed23522 fixes inverted refreshtoken logic nai-degen 2024-05-19 12:35:15 -05:00
  • 205ffa69ce Temporary usertokens via proof-of-work challenge (khanon/oai-reverse-proxy!68) khanon 2024-05-19 16:31:56 +00:00
  • 930bac0072 bumps ejs package version nai-degen 2024-05-17 21:46:27 -05:00
  • 3ad826851c adds proper GPT4o model family for separate cost/quota tracking nai-degen 2024-05-14 13:51:19 -05:00
  • 6dabc82bcf adds preliminary gpt4o nai-degen 2024-05-13 12:43:39 -05:00
  • d3e7ef3c14 prevents leaking headers to upstream API when serving via Tailscale nai-degen 2024-05-01 11:26:15 -05:00
  • b1062dc9b3 minor adjustments to jsonl log backend to reduce filesize nai-degen 2024-04-26 15:06:12 -05:00
  • 32b623d6bc partial googleai fixes; adds jsonl file backend for promptlogger stolen from fiz nai-degen 2024-04-23 03:43:38 -05:00
  • 0a27345c29 upgrades firebase-admin from 11.10.1 to 12.1.0 nai-degen 2024-04-22 12:36:41 -05:00
  • c15f07c0d8 adds OpenAI-to-AWS Claude3 compat endpoint nai-degen 2024-04-17 21:23:30 -05:00
  • db28e90c51 adds proper Opus model check to aws claude keychecker nai-degen 2024-04-17 21:09:00 -05:00
  • c0cd2c7549 adds aws opus maybe, idk cannot test nai-degen 2024-04-16 11:33:44 -05:00
  • 9445110727 adds gpt-4-turbo stable nai-degen 2024-04-09 16:31:42 -05:00
  • 34a673a80a adds option to disable multimodal prompts nai-degen 2024-03-23 14:30:08 -05:00
  • 8cb960e174 fixes incorrect model assignment when requesting Haiku from AWS nai-degen 2024-03-21 23:21:27 -05:00
  • 32fea30c91 handles Anthropic keys which cannot support multimodal requests nai-degen 2024-03-20 00:03:10 -05:00
  • 3f9fd25004 exempt 'special' token type from context size limits nai-degen 2024-03-19 11:14:51 -05:00
  • e068edcf48 adds Anthropic key tier detection and trial key display nai-degen 2024-03-18 15:20:34 -05:00
  • 2098948b7a reduces Anthropic keychecker frequency nai-degen 2024-03-18 15:19:41 -05:00
  • 7705ee58a0 minor cleanup of error-generator.ts nai-degen 2024-03-18 15:18:18 -05:00
  • 7c64d9209e minor refactoring of response middleware handlers nai-degen 2024-03-17 22:20:39 -05:00
  • 59107af3d6 minor fixes for google sheets backend for anthropic-chat nai-degen 2024-03-17 12:08:11 -05:00
  • 435280fa04 fixes missing system prompt on AWS anthropic-chat schema nai-degen 2024-03-16 16:00:59 -05:00
  • d9117bf08e fixes AWS debug log nai-degen 2024-03-14 21:34:07 -05:00
  • 57d9791270 fixes uncounted tokens when Response stream is prematurely closed nai-degen 2024-03-14 21:32:20 -05:00
  • 367ac3d075 adds ?debug=true query param to have proxy respond with transformed prompt nai-degen 2024-03-14 08:16:38 -05:00
  • 276a1a1d44 small fix for recurring AWS logging check nai-degen 2024-03-13 20:53:21 -05:00
  • 6cf029112e adds Anthropic's SOTA Haiku model; misc code cleanup nai-degen 2024-03-13 20:47:57 -05:00
  • 4b86802eb2 adds separate model detection for gpt-4-32k-0314 nai-degen 2024-03-10 19:16:11 -05:00
  • 7f431de98e sets cache-control on static user images nai-degen 2024-03-10 15:50:40 -05:00
  • e0bf10626e removes .reverse() from image history to avoid thumbnails shifting as users browse nai-degen 2024-03-10 15:12:20 -05:00
  • eb55f30414 adds input prompt to imagehistory nai-degen 2024-03-10 15:08:44 -05:00
  • e1fb53b461 pretty-prints dall-e image metadata JSON download nai-degen 2024-03-10 15:04:44 -05:00
  • 7610369c6d adds dall-e full history page and metadata downloader nai-degen 2024-03-10 14:53:11 -05:00
  • 37f17ded60 removes OpenAI max_tokens default as that isn't aligned with the real API nai-degen 2024-03-10 12:32:15 -05:00
  • 96b6ea9568 adds azure-image endpoint to service info; hides unavailable endpoints nai-degen 2024-03-09 13:25:50 -06:00
  • cec39328a2 adds azure dall-e support nai-degen 2024-03-09 13:03:50 -06:00
  • cab346787c fixes regression in anthropic text > anthropic chat api translation nai-degen 2024-03-08 21:16:25 -06:00
  • fab404b232 refactors api transformers and adds oai->anthropic chat api translation nai-degen 2024-03-08 20:59:19 -06:00
  • 8d84f289b2 fixes issue with mistral-large model family not being detected nai-degen 2024-03-08 17:07:25 -06:00
  • 9ce10b4f6a shows more helpful errors when users' prefills are invalid during AWS streaming nai-degen 2024-03-07 13:28:23 -06:00
  • 96756d32f3 fixes handling of DALL-E content_policy_violation errors nai-degen 2024-03-07 12:56:35 -06:00
  • 1fb3eac154 maybe shows clearer AWS ValidationExceptions when users have bad prefills nai-degen 2024-03-06 05:12:47 -06:00
  • 8f46bd4397 handles 'this organization is disabled' error from anthropic nai-degen 2024-03-06 00:42:10 -06:00
  • ddf34685df adds Claude 3 Vision support nai-degen 2024-03-05 18:34:10 -06:00
  • ea3aae5da6 allows selecting compat model via endpoint name and makes errors less confusing nai-degen 2024-03-05 05:13:17 -06:00
  • 055d650c5d fixes legacy compat endpoint nai-degen 2024-03-05 01:38:39 -06:00
  • 2643dfea61 improves aws sonnet key detection and no keys available error messaging nai-degen 2024-03-05 00:18:48 -06:00
  • 434445797a fixes bad handleCompatibilityRequest middleware fallthrough nai-degen 2024-03-04 23:53:13 -06:00
  • 03c5c473e1 improves error handling for sillytavern nai-degen 2024-03-04 22:54:21 -06:00
  • 068e7a834f fixes AWS legacy models for non-streaming requests nai-degen 2024-03-04 21:22:43 -06:00
  • 736803ad92 enables opus by default nai-degen 2024-03-04 21:11:32 -06:00
  • 6b22d17c50 fixes claude-opus token usage being attributed to regular claude nai-degen 2024-03-04 17:03:02 -06:00
  • 51ffca480a adds AWS Claude Chat Completions and Claude 3 Sonnet support nai-degen 2024-03-04 16:25:06 -06:00
  • 802d847cc6 enables Claude opus by default nai-degen 2024-03-04 16:21:40 -06:00
  • 90ddcac55b makes claude3 compat model customizable via environment variable nai-degen 2024-03-04 14:17:29 -06:00
  • 36923686f6 shows claude-opus key count on service info page nai-degen 2024-03-04 14:12:38 -06:00
  • 1edc93dc72 adds claude-opus model family nai-degen 2024-03-04 14:08:59 -06:00
  • f6c124c1d3 fixes issue with preamble-required claude keys and anthropic chat nai-degen 2024-03-04 14:00:25 -06:00
  • 90a053d0e0 detects and removes over-quota claude keys from keypool nai-degen 2024-03-04 13:42:05 -06:00
  • db318ec237 Implement Anthropic Chat Completions endpoint and Claude 3 (khanon/oai-reverse-proxy!64) khanon 2024-03-04 19:06:46 +00:00