Minor changes
This commit is contained in:
@@ -20,7 +20,7 @@ This project allows you to run a reverse proxy server for various LLM APIs.
|
|||||||
- [x] [OpenAI](https://openai.com/)
|
- [x] [OpenAI](https://openai.com/)
|
||||||
- [x] [Anthropic](https://www.anthropic.com/)
|
- [x] [Anthropic](https://www.anthropic.com/)
|
||||||
- [x] [AWS Bedrock](https://aws.amazon.com/bedrock/)
|
- [x] [AWS Bedrock](https://aws.amazon.com/bedrock/)
|
||||||
- [x] [Vertex AI](https://cloud.google.com/vertex-ai/)
|
- [x] [Vertex AI (GCP)](https://cloud.google.com/vertex-ai/)
|
||||||
- [x] [Google MakerSuite/Gemini API](https://ai.google.dev/)
|
- [x] [Google MakerSuite/Gemini API](https://ai.google.dev/)
|
||||||
- [x] [Azure OpenAI](https://azure.microsoft.com/en-us/products/ai-services/openai-service)
|
- [x] [Azure OpenAI](https://azure.microsoft.com/en-us/products/ai-services/openai-service)
|
||||||
- [x] Translation from OpenAI-formatted prompts to any other API, including streaming responses
|
- [x] Translation from OpenAI-formatted prompts to any other API, including streaming responses
|
||||||
|
|||||||
@@ -19,9 +19,9 @@ GCP_CREDENTIALS=my-first-project:xxx@yyy.com:us-east5:-----BEGIN PRIVATE KEY----
|
|||||||
```
|
```
|
||||||
|
|
||||||
## Setup Vertex AI
|
## Setup Vertex AI
|
||||||
1. Go to [https://cloud.google.com/vertex-ai](https://cloud.google.com/vertex-ai) and sign up for a GCP account. ($150 free credits without credit card, $300 free credits with credit card, credits expire in 90 days)
|
1. Go to [https://cloud.google.com/vertex-ai](https://cloud.google.com/vertex-ai) and sign up for a GCP account. ($150 free credits without credit card or $300 free credits with credit card, credits expire in 90 days)
|
||||||
2. Go to [https://console.cloud.google.com/marketplace/product/google/aiplatform.googleapis.com](https://console.cloud.google.com/marketplace/product/google/aiplatform.googleapis.com) to enable Vertex AI API.
|
2. Go to [https://console.cloud.google.com/marketplace/product/google/aiplatform.googleapis.com](https://console.cloud.google.com/marketplace/product/google/aiplatform.googleapis.com) to enable Vertex AI API.
|
||||||
3. Go to [https://console.cloud.google.com/vertex-ai](https://console.cloud.google.com/vertex-ai) to apply for the Claude models.
|
3. Go to [https://console.cloud.google.com/vertex-ai](https://console.cloud.google.com/vertex-ai) and navigate to Model Garden to apply for access to the Claude models.
|
||||||
4. Create a [Service Account](https://console.cloud.google.com/projectselector/iam-admin/serviceaccounts/create?walkthrough_id=iam--create-service-account#step_index=1) , and make sure to grant the role of "Vertex AI User" or "Vertex AI Administrator".
|
4. Create a [Service Account](https://console.cloud.google.com/projectselector/iam-admin/serviceaccounts/create?walkthrough_id=iam--create-service-account#step_index=1) , and make sure to grant the role of "Vertex AI User" or "Vertex AI Administrator".
|
||||||
5. On the service account page you just created, create a new key and select "JSON". The JSON file will be downloaded automatically.
|
5. On the service account page you just created, create a new key and select "JSON". The JSON file will be downloaded automatically.
|
||||||
6. The required credential is in the JSON file you just downloaded.
|
6. The required credential is in the JSON file you just downloaded.
|
||||||
|
|||||||
Reference in New Issue
Block a user