follow-up 'fixes empty AWS streaming responses when under heavy load'

2023-10-15 00:06:38 -05:00
parent f6cfc6e882
commit 3f7e50f87e
2 changed files with 2 additions and 2 deletions
@@ -37,7 +37,7 @@ export interface AwsBedrockKey extends Key, AwsBedrockKeyUsage {
 * Upon being rate limited, a key will be locked out for this many milliseconds
 * while we wait for other concurrent requests to finish.
 */
-const RATE_LIMIT_LOCKOUT = 300;
+const RATE_LIMIT_LOCKOUT = 1000;
 /**
 * Upon assigning a key, we will wait this many milliseconds before allowing it
 * to be used again. This is to prevent the queue from flooding a key with too