diff --git a/README.md b/README.md index 334556c..93ab036 100644 --- a/README.md +++ b/README.md @@ -46,17 +46,17 @@ As Anthropic does not ship a NodeJS tokenizer, the server includes a small Pytho Note: On Windows, a Windows Firewall prompt may appear when the Claude tokenizer is started. This is normal and is caused by the Python process attempting to open a socket to communicate with the NodeJS server. You can safely allow the connection. -#### Automatic installation +### Automatic installation (local development) This will create a venv and install the required dependencies. You still need to activate the venv when running the server, and you must have Python >= 3.8.0 installed. 1. Install Python >= 3.8.0 2. Run `npm run install:claude:unix` (Linux/Mac) or `npm run install:claude:win` (Windows) -#### Manual installation +### Manual installation (local development) 1. Install Python >= 3.8.0 2. Create a virtual environment in the `claude` directory with `python -m venv venv` 3. Activate the virtual environment with `source venv/bin/activate` (Linux/Mac) or `.\venv\Scripts\activate` (PowerShell/Windows) 4. Install dependencies with `pip install -r requirements.txt` 5. Provided you have the virtual environment activated, the server will automatically start the tokenizer when it is launched. -#### Deploying +### Docker (production deployment) Refer to the reference Dockerfiles for examples on how to install the tokenizer. The Huggingface and Render Dockerfiles both include the tokenizer. diff --git a/docker/huggingface/Dockerfile b/docker/huggingface/Dockerfile index 2d280de..425a29f 100644 --- a/docker/huggingface/Dockerfile +++ b/docker/huggingface/Dockerfile @@ -1,10 +1,10 @@ -FROM node:18-bullseye-slim +FROM node:18-bullseye RUN apt-get update && \ - apt-get install -y git python3 python3-pip libzmq3-dev + apt-get install -y git python3 python3-pip libzmq3-dev curl cmake g++ libsodium-dev pkg-config RUN git clone https://gitgud.io/khanon/oai-reverse-proxy.git /app WORKDIR /app RUN pip3 install --no-cache-dir -r requirements.txt -RUN npm install +RUN npm ci --loglevel=verbose COPY Dockerfile greeting.md* .env* ./ RUN npm run build EXPOSE 7860 diff --git a/esbuild.js b/esbuild.js index 3437e3c..c207ada 100644 --- a/esbuild.js +++ b/esbuild.js @@ -22,9 +22,6 @@ const config = { }, }), ], - - // "src/tokenization/claude_tokenizer.py": - // "build/tokenization/claude_tokenizer.py", }; function createBundler() {