Commit Graph

  • 2fe6e07cf5 error better nai-degen 2024-08-12 20:49:21 -05:00
  • bc340c1be6 non-streaming aws mistral works nai-degen 2024-08-12 20:37:14 -05:00
  • 45c5d3d338 fixes aws mistral keychecker model invocation nai-degen 2024-08-12 19:32:26 -05:00
  • 3032ae3198 express route matching is a pain in the ass nai-degen 2024-08-12 19:31:53 -05:00
  • 49a89122f5 fixes aws models endpoint nai-degen 2024-08-12 19:26:55 -05:00
  • 2d8e1dac13 adds /aws/mistral endpoint nai-degen 2024-08-11 13:09:08 -05:00
  • 9e5a660ef5 refactors aws endpoint router to split claude/mistral nai-degen 2024-08-11 12:39:01 -05:00
  • 6cf8c09fad removes 'server greeting' header from info page nai-degen 2024-08-11 12:37:27 -05:00
  • dc1b573020 small KeyProvider#get refactor nai-degen 2024-08-11 12:21:28 -05:00
  • 3ff771d945 fix gcp rebase issue nai-degen 2024-08-11 12:18:38 -05:00
  • 985035fe80 adds old test script to repo nai-degen 2024-08-10 16:25:20 -05:00
  • 442f9529de comments nai-degen 2024-08-10 16:10:48 -05:00
  • 598ac8e4e1 tries to unfuck service info stat aggregation slightly nai-degen 2024-08-10 16:05:07 -05:00
  • 750dbee483 adds support for non-Anthropic models to AWS key manager nai-degen 2024-08-10 16:04:03 -05:00
  • a2d64e281e minor KeyProvider#getLockoutPeriod refactor nai-degen 2024-08-10 14:42:52 -05:00
  • c6467b02f3 adds AWS mistral model families and checker IDs nai-degen 2024-08-10 14:41:25 -05:00
  • 6c45c92ea0 updates dependencies nai-degen 2024-08-12 19:10:15 -05:00
  • b7cd326d2a handles 'invalid subscription' 403 errors from Mistral API nai-degen 2024-08-07 14:14:53 -05:00
  • 6c9f302fb9 minor gultra fix nai-degen 2024-08-06 18:46:49 -05:00
  • 9ab1e7d0ce adds new gpt4o id nai-degen 2024-08-06 13:08:25 -05:00
  • 81f8dc2613 updates README.md nai-degen 2024-08-05 11:33:16 -05:00
  • 0c936e97fe Merge GCP Vertex AI implementation from cg-dot/oai-reverse-proxy (khanon/oai-reverse-proxy!72) khanon 2024-08-05 14:27:51 +00:00
  • 29ed07492e fixes info page display for gemini flash/ultra nai-degen 2024-08-03 22:18:05 -05:00
  • 2f7315379c adds gemini/makersuite keychecker, native endpoint, and streaming fixes nai-degen 2024-08-03 21:53:32 -05:00
  • e91532f4f7 handle dead makersuite keys triggering 400 error instead of 401/403 nai-degen 2024-08-03 19:09:50 -05:00
  • ca58770458 fixes issue with PROXY_KEY when used together with proof-of-work captcha nai-degen 2024-07-29 19:41:57 -05:00
  • 9a3cca6b80 adds new mistral models and updates older model lists/context limits nai-degen 2024-07-28 13:15:03 -05:00
  • 584bb3fbc7 addresses minor issue with quota refresh UI nai-degen 2024-07-28 11:54:38 -05:00
  • 2aa19e5b09 adds user-specific overrides for daily quota refresh nai-degen 2024-07-27 14:25:53 -05:00
  • f242777596 fixes token index used as msg idx in anthropic chat-to-openai SSE transformer nai-degen 2024-07-07 13:33:33 -05:00
  • edc0d094e2 tries to disable quarantined aws keys nai-degen 2024-06-30 05:08:27 -05:00
  • 994b30dcce adjusts gemini pro model assignment nai-degen 2024-06-26 13:37:23 -05:00
  • e3d1ab51d1 improves handling of AWS regions with Sonnet 3.5 enabled but Sonnet 3.0 disabled nai-degen 2024-06-20 12:20:38 -05:00
  • ff38eda066 improves model detection for AWS Sydney region nai-degen 2024-06-20 12:15:18 -05:00
  • 84b917f726 fixes AWS Sonnet 3.5 key assignment bug nai-degen 2024-06-20 12:00:08 -05:00
  • 5871025245 fixes AWS keychecker failure caused by Sonnet 3.5 gradual rollout nai-degen 2024-06-20 11:24:26 -05:00
  • b4fb97ca5c fixes model id typo nai-degen 2024-06-20 10:42:48 -05:00
  • eb700d3da6 adds untested claude 3.5 model ids and model assignment nai-degen 2024-06-20 10:34:48 -05:00
  • d706d4c59d adds USER_CONCURRENCY_LIMIT environment variable nai-degen 2024-06-14 22:52:16 -05:00
  • 8d5059534a starts adding cohere api format and schemas cohere nai-degen 2024-06-09 12:46:02 -05:00
  • 0ea43f61c2 fixes incorrect variable name in .env.example docs nai-degen 2024-06-09 11:36:20 -05:00
  • ca4321b4cb adjusts openai schema validation to allow ull stop sequence nai-degen 2024-06-07 14:29:18 -05:00
  • 7660ed8b94 allows enabling vision prompts on a per-service basis nai-degen 2024-06-07 12:09:43 -05:00
  • 55f1bbed3b adds ipv6 mask to default ADMIN_WHITELIST nai-degen 2024-06-02 20:49:18 -05:00
  • 57fd17ede0 makes it easier for clients to detect proxy errors programatically nai-degen 2024-05-27 15:30:28 -05:00
  • 9d00b8a9de adjusts max IP error message wording nai-degen 2024-05-27 08:24:56 -05:00
  • 15f697aa6e adds users sqlite migration and WIP repository sqlite-users nai-degen 2024-05-26 19:51:47 -05:00
  • 155e185c6e fixes shutdown handler fuckup nai-degen 2024-05-26 15:36:54 -05:00
  • a59b6555e7 redacts de3u api-key from diagnostic logs nai-degen 2024-05-26 15:13:21 -05:00
  • 2d82e55d72 Sqlite backend with user event logging (khanon/oai-reverse-proxy!69) scrappyanon 2024-05-26 17:31:12 +00:00
  • 6352df5d5a fixes mixed ipv4-ipv6 handling in cidr module nai-degen 2024-05-24 02:02:21 -05:00
  • 7d517a4c5f fixes Refresh Token UI incorrectly discarding expired (but refreshable) temp tokens nai-degen 2024-05-22 22:18:23 -05:00
  • 0418951928 tries to provide better guidance on CSRF errors nai-degen 2024-05-21 13:10:54 -05:00
  • 3012aa651e adds slightly less-ugly global stylesheet; improves mobile compat nai-degen 2024-05-21 12:56:25 -05:00
  • 1b68ad7c6f docs update nai-degen 2024-05-21 12:46:51 -05:00
  • 68b48428de adjusts gatekeeper module to send auth errors as fake chat completions nai-degen 2024-05-21 12:39:07 -05:00
  • b76db652e0 adds configurable PoW timeout and iteration count nai-degen 2024-05-21 12:38:41 -05:00
  • 63ab1a7685 reverts debug change that broke info page nai-degen 2024-05-20 07:47:46 -05:00
  • a3462e21bc adds config setting for PoW verification timeout nai-degen 2024-05-19 15:17:25 -05:00
  • 8d2ed23522 fixes inverted refreshtoken logic nai-degen 2024-05-19 12:35:15 -05:00
  • 205ffa69ce Temporary usertokens via proof-of-work challenge (khanon/oai-reverse-proxy!68) khanon 2024-05-19 16:31:56 +00:00
  • 930bac0072 bumps ejs package version nai-degen 2024-05-17 21:46:27 -05:00
  • 3ad826851c adds proper GPT4o model family for separate cost/quota tracking nai-degen 2024-05-14 13:51:19 -05:00
  • 6dabc82bcf adds preliminary gpt4o nai-degen 2024-05-13 12:43:39 -05:00
  • d3e7ef3c14 prevents leaking headers to upstream API when serving via Tailscale nai-degen 2024-05-01 11:26:15 -05:00
  • b1062dc9b3 minor adjustments to jsonl log backend to reduce filesize nai-degen 2024-04-26 15:06:12 -05:00
  • 32b623d6bc partial googleai fixes; adds jsonl file backend for promptlogger stolen from fiz nai-degen 2024-04-23 03:43:38 -05:00
  • 0a27345c29 upgrades firebase-admin from 11.10.1 to 12.1.0 nai-degen 2024-04-22 12:36:41 -05:00
  • c15f07c0d8 adds OpenAI-to-AWS Claude3 compat endpoint nai-degen 2024-04-17 21:23:30 -05:00
  • db28e90c51 adds proper Opus model check to aws claude keychecker nai-degen 2024-04-17 21:09:00 -05:00
  • c0cd2c7549 adds aws opus maybe, idk cannot test nai-degen 2024-04-16 11:33:44 -05:00
  • 9445110727 adds gpt-4-turbo stable nai-degen 2024-04-09 16:31:42 -05:00
  • 34a673a80a adds option to disable multimodal prompts nai-degen 2024-03-23 14:30:08 -05:00
  • 8cb960e174 fixes incorrect model assignment when requesting Haiku from AWS nai-degen 2024-03-21 23:21:27 -05:00
  • 32fea30c91 handles Anthropic keys which cannot support multimodal requests nai-degen 2024-03-20 00:03:10 -05:00
  • 3f9fd25004 exempt 'special' token type from context size limits nai-degen 2024-03-19 11:14:51 -05:00
  • e068edcf48 adds Anthropic key tier detection and trial key display nai-degen 2024-03-18 15:20:34 -05:00
  • 2098948b7a reduces Anthropic keychecker frequency nai-degen 2024-03-18 15:19:41 -05:00
  • 7705ee58a0 minor cleanup of error-generator.ts nai-degen 2024-03-18 15:18:18 -05:00
  • 7c64d9209e minor refactoring of response middleware handlers nai-degen 2024-03-17 22:20:39 -05:00
  • 59107af3d6 minor fixes for google sheets backend for anthropic-chat nai-degen 2024-03-17 12:08:11 -05:00
  • 435280fa04 fixes missing system prompt on AWS anthropic-chat schema nai-degen 2024-03-16 16:00:59 -05:00
  • 84acc429d7 wip api-support-refactor nai-degen 2024-03-16 00:04:27 -05:00
  • d9117bf08e fixes AWS debug log nai-degen 2024-03-14 21:34:07 -05:00
  • 57d9791270 fixes uncounted tokens when Response stream is prematurely closed nai-degen 2024-03-14 21:32:20 -05:00
  • 367ac3d075 adds ?debug=true query param to have proxy respond with transformed prompt nai-degen 2024-03-14 08:16:38 -05:00
  • 276a1a1d44 small fix for recurring AWS logging check nai-degen 2024-03-13 20:53:21 -05:00
  • 6cf029112e adds Anthropic's SOTA Haiku model; misc code cleanup nai-degen 2024-03-13 20:47:57 -05:00
  • 4b86802eb2 adds separate model detection for gpt-4-32k-0314 nai-degen 2024-03-10 19:16:11 -05:00
  • 7f431de98e sets cache-control on static user images nai-degen 2024-03-10 15:50:40 -05:00
  • e0bf10626e removes .reverse() from image history to avoid thumbnails shifting as users browse nai-degen 2024-03-10 15:12:20 -05:00
  • eb55f30414 adds input prompt to imagehistory nai-degen 2024-03-10 15:08:44 -05:00
  • e1fb53b461 pretty-prints dall-e image metadata JSON download nai-degen 2024-03-10 15:04:44 -05:00
  • 7610369c6d adds dall-e full history page and metadata downloader nai-degen 2024-03-10 14:53:11 -05:00
  • 37f17ded60 removes OpenAI max_tokens default as that isn't aligned with the real API nai-degen 2024-03-10 12:32:15 -05:00
  • 96b6ea9568 adds azure-image endpoint to service info; hides unavailable endpoints nai-degen 2024-03-09 13:25:50 -06:00
  • cec39328a2 adds azure dall-e support nai-degen 2024-03-09 13:03:50 -06:00
  • cab346787c fixes regression in anthropic text > anthropic chat api translation nai-degen 2024-03-08 21:16:25 -06:00
  • fab404b232 refactors api transformers and adds oai->anthropic chat api translation nai-degen 2024-03-08 20:59:19 -06:00
  • 8d84f289b2 fixes issue with mistral-large model family not being detected nai-degen 2024-03-08 17:07:25 -06:00