zack3d/simple-proxy
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Commit Graph

  • c453a5f2ad logs usertoken lookup attempts nai-degen 2023-11-10 22:41:36 -06:00
  • c7a095d345 removes debug log nai-degen 2023-11-09 16:25:57 -06:00
  • e9110611fa adds REJECT_PHRASES configuration setting nai-degen 2023-11-09 16:24:49 -06:00
  • 79e1fe09e4 fixes multiple enumeration on infopage nai-degen 2023-11-08 12:02:23 -06:00
  • 08b2196bfb Update .env.example to include MAX_CONTEXT_TOKENS_OPENAI (khanon/oai-reverse-proxy!50) dllt98 2023-11-08 02:50:19 +00:00
  • 350d6542cf fixes stats for non-openai models nai-degen 2023-11-06 22:41:48 -06:00
  • c9c24f86bb improvements to infopage key categorization nai-degen 2023-11-06 22:13:34 -06:00
  • b6f8f15a1f tries to prevent per-day rate limited keys from bricking the queue nai-degen 2023-11-06 21:16:36 -06:00
  • 5467136c1a adds gpt4-turbo to userschema; updates docs nai-degen 2023-11-06 16:35:35 -06:00
  • 0d5dfeccf8 adds gpt4-turbo model family and support for gpt-4-1106-preview model nai-degen 2023-11-06 15:29:43 -06:00
  • b615ffa433 fixes issue with local development cookies nai-degen 2023-11-06 10:28:27 -06:00
  • a27163a629 adds option to not disable keys when reaching IP limit nai-degen 2023-11-05 11:49:20 -06:00
  • 5a8fb3aff6 adds USE_INSECURE_COOKIES for hosts without SSL support nai-degen 2023-11-03 15:24:53 -05:00
  • 51dd0c71ba removes unused import in openai proxy nai-degen 2023-10-24 13:17:46 -05:00
  • 89e1ed46d5 re-signs AWS requests on every attempt to fix fucked up queueing nai-degen 2023-10-24 13:06:10 -05:00
  • 26dc79c8f1 fixes broken AWS rate limit backoff nai-degen 2023-10-24 09:19:46 -05:00
  • 89e9b67f3f fixes AWS mid-stream rate limits not actually marking key as rate-limited nai-degen 2023-10-23 22:46:31 -05:00
  • 52ec2ec265 fixes blank AWS responses due to reqs sometimes using wrong handler nai-degen 2023-10-23 22:23:06 -05:00
  • 8bd2f749c1 reduces logging severity of prompt validation errors nai-degen 2023-10-23 20:15:02 -05:00
  • ff27ca3780 Update info-page.ts khanon 2023-10-20 00:33:57 +00:00
  • 41a463d2c8 possibly fix issue with AWS keychecker due to amazon API change nai-degen 2023-10-16 12:17:02 -05:00
  • 3f7e50f87e follow-up 'fixes empty AWS streaming responses when under heavy load' nai-degen 2023-10-15 00:06:38 -05:00
  • f6cfc6e882 fixes empty AWS streaming responses when under heavy load nai-degen 2023-10-15 00:05:36 -05:00
  • af4d8dae40 changes default AMZ_HOST to bedrock-runtime.region.amazonaws.com nai-degen 2023-10-12 15:39:06 -05:00
  • 725fd6e6f1 deprioritizes queued Agnai.chat requests and limits concurrency to five across all shared IPs nai-degen 2023-10-09 12:36:54 -05:00
  • c87484f1ff adds AWS console screenshot to docs nai-degen 2023-10-07 21:33:53 -05:00
  • 15a2cb5a26 another docs correction nai-degen 2023-10-07 21:10:18 -05:00
  • c8182cea17 docs correction nai-degen 2023-10-07 21:08:40 -05:00
  • b06d48e1f8 adds better AWS docs nai-degen 2023-10-07 20:58:04 -05:00
  • 140bdea14e Implement AWS KeyChecker and auto-disable AWS logged keys (khanon/oai-reverse-proxy!47) khanon 2023-10-08 01:17:09 +00:00
  • 12f78fa1f2 exempts 'special' role from rate limiting nai-degen 2023-10-06 20:29:28 -05:00
  • daf6a123d5 adjusts Agnai.chat and RisuAI rate limiting nai-degen 2023-10-04 09:39:59 -05:00
  • 4e05b01e90 improves AWS .env.example and config.ts docs nai-degen 2023-10-03 20:29:42 -05:00
  • 5033d00444 improves clarity of errors sent back to streaming clients nai-degen 2023-10-03 19:45:15 -05:00
  • ba0b20617e ensures AWS always uses anthropic-version 2023-06-01 parser nai-degen 2023-10-03 19:43:30 -05:00
  • 4a5fd91da3 address npm audit; adds zod-error package nai-degen 2023-10-03 19:05:46 -05:00
  • ecf897e685 Refactor handleStreamingResponse to make it less shit (khanon/oai-reverse-proxy!46) khanon 2023-10-03 06:14:19 +00:00
  • 6a3d753f0d fixes anthropic keychecker for some keys nai-degen 2023-10-02 20:31:03 -05:00
  • 0bf2f5c123 fixes typo in .env.example khanon 2023-10-02 20:39:30 +00:00
  • ede274c117 disables AWS key on AccessDeniedException nai-degen 2023-10-02 11:18:08 -05:00
  • d2267beb18 adds aws-claude token cost nai-degen 2023-10-02 09:43:26 -05:00
  • 0837c89a42 fixes incorrect context size limit for aws claude v1 nai-degen 2023-10-02 03:53:04 -05:00
  • f67560a17b refactors proxy routing nai-degen 2023-10-01 12:12:28 -05:00
  • e13361a323 removes dead koboldai code nai-degen 2023-10-01 11:27:11 -05:00
  • fa4bf468d2 Implement AWS Bedrock support (khanon/oai-reverse-proxy!45) khanon 2023-10-01 01:40:18 +00:00
  • 7e681a7bef strips OAI request parameters when translating to Claude format nai-degen 2023-09-29 03:01:39 -05:00
  • 1b0106a1ea strips reverse proxy originating IP headers nai-degen 2023-09-29 03:00:55 -05:00
  • f5521aa6c3 prevents selecting trial keys for embeddings requests due to rate limits nai-degen 2023-09-26 01:26:07 -05:00
  • f8b480f4c2 adds support for proxying text-embedding-ada-002 requests nai-degen 2023-09-26 00:58:38 -05:00
  • 1f35fe1ae1 updates huggingface docs to clarify gatekeeper khanon 2023-09-24 11:00:25 +00:00
  • 35b44e1c6b fixes issue with OpenAIV1ChatCompletionSchema and PaLM compat khanon 2023-09-24 10:48:56 +00:00
  • 075e415343 makes incoming model name validation less strict for PaLM endpoint nai-degen 2023-09-20 23:55:53 -05:00
  • ec4f7e845b triggers automatic OAI key recheck three times a day nai-degen 2023-09-19 21:43:16 -05:00
  • 8923bb76a0 adds turbo-instruct endpoint to info page nai-degen 2023-09-19 21:10:29 -05:00
  • 35a6c393ed Add support for Google PaLM and OpenAI Turbo Instruct (khanon/oai-reverse-proxy!44) khanon 2023-09-19 23:13:08 +00:00
  • ef554f8e06 fixes user edit modal for null values nai-degen 2023-09-18 23:42:08 -05:00
  • 624973fc82 adds admin note nai-degen 2023-09-18 23:35:29 -05:00
  • c6453638e9 makes max IP limit configurable per-user nai-degen 2023-09-18 23:16:06 -05:00
  • 40e71435f0 partially redacts IP address on token lookup page nai-degen 2023-09-17 17:53:29 -05:00
  • 5e57dbb8f1 attempts to improve compatibility with BetterGPT frontend nai-degen 2023-09-16 11:04:40 -05:00
  • 201f71a989 corrects typo in anthropic key liveness test payload khanon 2023-09-15 16:50:35 +00:00
  • 66f1d809ec minor html cleanup nai-degen 2023-09-10 13:30:23 -05:00
  • 437fe1e720 improves rentry leaderboard function nai-degen 2023-09-10 13:24:39 -05:00
  • 404ce4fc80 adds ranking to markdown stats nai-degen 2023-09-09 19:31:38 -05:00
  • 95d2369acc adds option to anonymize rentry stats nai-degen 2023-09-09 18:35:59 -05:00
  • 2a453ab657 Add temporary user tokens (khanon/oai-reverse-proxy!42) khanon 2023-09-09 22:21:38 +00:00
  • 5728e235dc prioritizes unpozzed keys in key selection when possible nai-degen 2023-09-09 13:10:33 -05:00
  • 7b3d6efb02 reverts anthropic-version change as it breaks some frontends nai-degen 2023-09-07 22:01:19 -05:00
  • 63542bfabb adds anthropic-version header in all cases nai-degen 2023-09-07 20:23:34 -05:00
  • a558920ccf fixes tookens counter on infopage nai-degen 2023-09-02 18:49:14 -05:00
  • 6afb62fef6 opens user lookup in new tab for cookie samesite restrictions nai-degen 2023-09-02 15:23:30 -05:00
  • 0e325e89e0 adjusts user self-service link presentation nai-degen 2023-09-02 15:09:11 -05:00
  • f05e196994 Refactor project structure and add user self-serve UI (khanon/oai-reverse-proxy!41) khanon 2023-09-02 19:36:44 +00:00
  • 435b46ad4d adds anthropic key checker and pozzed key detection nai-degen 2023-09-01 10:38:12 -05:00
  • 980abcc01f fixes tsc build nai-degen 2023-08-31 13:50:16 -05:00
  • fe0f04ceb8 improves display of large token numbers nai-degen 2023-08-31 13:23:36 -05:00
  • 4b32130eaa adds maintenance function to clear all users' token records nai-degen 2023-08-30 22:38:33 -05:00
  • ffc0c6472e fixes claude tokens not correctly being accumulated nai-degen 2023-08-30 20:48:45 -05:00
  • 2c0a659b2d adds token consumption stats to infopage nai-degen 2023-08-30 20:40:40 -05:00
  • bed275a195 partial refactor/optimization of infopage nai-degen 2023-08-30 19:20:29 -05:00
  • 7cab0a5c52 fixes tsc issue breaking build nai-degen 2023-08-30 14:31:47 -05:00
  • 27a1181752 adds optional token quota limits for gpt4-32k nai-degen 2023-08-30 13:57:10 -05:00
  • 85aeeb2c05 adds unique openaiOrgs to infopage nai-degen 2023-08-30 12:42:28 -05:00
  • 8d557c844e adds a bunch more logging to keychecker nai-degen 2023-08-30 12:30:41 -05:00
  • 0a52ec478f maybe fixes keychecker bricking on disabled org keys nai-degen 2023-08-30 12:29:58 -05:00
  • e462ad585e improves keychecker stability with rate-limited trial keys nai-degen 2023-08-30 08:33:00 -05:00
  • 4d781e1720 Add GPT-4-32k support (khanon/oai-reverse-proxy!39) khanon 2023-08-29 22:56:54 +00:00
  • 3c56103de0 adds optional user_token nicknames nai-degen 2023-08-29 14:20:28 -05:00
  • bb78a399eb fixes organization key issue (via Drago/oai-reverse-proxy@714292ed) nai-degen 2023-08-29 04:13:12 -05:00
  • 09416c0b90 automatically rechecks keys on the 1st of every month nai-degen 2023-08-29 04:07:50 -05:00
  • abb30d3608 admin ui improvements; adds Force Recheck feature nai-degen 2023-08-29 03:49:08 -05:00
  • 6833736392 Clone keys assigned to multiple organizations (khanon/oai-reverse-proxy!38) khanon 2023-08-28 21:11:49 +00:00
  • 7c9c3a640c minor cleanup for user quota docs/examples nai-degen 2023-08-28 14:51:28 -05:00
  • cb780e85da Per-user token quotas and automatic quota refreshing (khanon/oai-reverse-proxy!37) khanon 2023-08-28 19:33:14 +00:00
  • 785b1f69f3 implements new local risu validation (via @kwaroran) nai-degen 2023-08-28 05:28:58 -05:00
  • c05bfefba4 fixes incorrectly applied doubleCsrf to REST routes nai-degen 2023-08-10 15:54:01 -05:00
  • 9b184ab245 removes QUOTA_DISPLAY_MODE config as OpenAI no longer supports it nai-degen 2023-08-09 18:28:45 -05:00
  • 6bb67281d9 removes QUEUE_MODE config (now always enabled) nai-degen 2023-08-09 18:20:19 -05:00
  • 5d3fb6af3a removes IP redaction from pino nai-degen 2023-08-09 18:15:28 -05:00
  • 268165e2be Add CSRF protection to server-rendered views (khanon/oai-reverse-proxy!34) khanon 2023-08-09 23:11:26 +00:00