zack3d/OAI-Proxy
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

tries to fix huggingface docker build issues

Browse Source
This commit is contained in:
nai-degen
2023-06-02 22:55:11 -05:00
parent f76e0d5519
commit 83f16c7ec8
3 changed files with 6 additions and 9 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+3 -3
View File
@@ -46,17 +46,17 @@ As Anthropic does not ship a NodeJS tokenizer, the server includes a small Pytho
Note: On Windows, a Windows Firewall prompt may appear when the Claude tokenizer is started. This is normal and is caused by the Python process attempting to open a socket to communicate with the NodeJS server. You can safely allow the connection. Note: On Windows, a Windows Firewall prompt may appear when the Claude tokenizer is started. This is normal and is caused by the Python process attempting to open a socket to communicate with the NodeJS server. You can safely allow the connection.
#### Automatic installation ### Automatic installation (local development)
This will create a venv and install the required dependencies. You still need to activate the venv when running the server, and you must have Python >= 3.8.0 installed. This will create a venv and install the required dependencies. You still need to activate the venv when running the server, and you must have Python >= 3.8.0 installed.
1. Install Python >= 3.8.0 1. Install Python >= 3.8.0
2. Run `npm run install:claude:unix` (Linux/Mac) or `npm run install:claude:win` (Windows) 2. Run `npm run install:claude:unix` (Linux/Mac) or `npm run install:claude:win` (Windows)
#### Manual installation ### Manual installation (local development)
1. Install Python >= 3.8.0 1. Install Python >= 3.8.0
2. Create a virtual environment in the `claude` directory with `python -m venv venv` 2. Create a virtual environment in the `claude` directory with `python -m venv venv`
3. Activate the virtual environment with `source venv/bin/activate` (Linux/Mac) or `.\venv\Scripts\activate` (PowerShell/Windows) 3. Activate the virtual environment with `source venv/bin/activate` (Linux/Mac) or `.\venv\Scripts\activate` (PowerShell/Windows)
4. Install dependencies with `pip install -r requirements.txt` 4. Install dependencies with `pip install -r requirements.txt`
5. Provided you have the virtual environment activated, the server will automatically start the tokenizer when it is launched. 5. Provided you have the virtual environment activated, the server will automatically start the tokenizer when it is launched.
#### Deploying ### Docker (production deployment)
Refer to the reference Dockerfiles for examples on how to install the tokenizer. The Huggingface and Render Dockerfiles both include the tokenizer. Refer to the reference Dockerfiles for examples on how to install the tokenizer. The Huggingface and Render Dockerfiles both include the tokenizer.
docker/huggingface/Dockerfile
+3 -3
View File
@@ -1,10 +1,10 @@
FROM node:18-bullseye-slim FROM node:18-bullseye
RUN apt-get update && \ RUN apt-get update && \
apt-get install -y git python3 python3-pip libzmq3-dev apt-get install -y git python3 python3-pip libzmq3-dev curl cmake g++ libsodium-dev pkg-config
RUN git clone https://gitgud.io/khanon/oai-reverse-proxy.git /app RUN git clone https://gitgud.io/khanon/oai-reverse-proxy.git /app
WORKDIR /app WORKDIR /app
RUN pip3 install --no-cache-dir -r requirements.txt RUN pip3 install --no-cache-dir -r requirements.txt
RUN npm install RUN npm ci --loglevel=verbose
COPY Dockerfile greeting.md* .env* ./ COPY Dockerfile greeting.md* .env* ./
RUN npm run build RUN npm run build
EXPOSE 7860 EXPOSE 7860
esbuild.js
-3
View File
@@ -22,9 +22,6 @@ const config = {
}, },
}), }),
], ],
// "src/tokenization/claude_tokenizer.py":
// "build/tokenization/claude_tokenizer.py",
}; };
function createBundler() { function createBundler() {