tries to fix huggingface docker build issues

README.md

@@ -46,17 +46,17 @@ As Anthropic does not ship a NodeJS tokenizer, the server includes a small Pytho
 
 Note: On Windows, a Windows Firewall prompt may appear when the Claude tokenizer is started. This is normal and is caused by the Python process attempting to open a socket to communicate with the NodeJS server. You can safely allow the connection.
 
-#### Automatic installation
+### Automatic installation (local development)
 This will create a venv and install the required dependencies. You still need to activate the venv when running the server, and you must have Python >= 3.8.0 installed.
 1. Install Python >= 3.8.0
 2. Run `npm run install:claude:unix` (Linux/Mac) or `npm run install:claude:win` (Windows)
 
-#### Manual installation
+### Manual installation (local development)
 1. Install Python >= 3.8.0
 2. Create a virtual environment in the `claude` directory with `python -m venv venv`
 3. Activate the virtual environment with `source venv/bin/activate` (Linux/Mac) or `.\venv\Scripts\activate` (PowerShell/Windows)
 4. Install dependencies with `pip install -r requirements.txt`
 5. Provided you have the virtual environment activated, the server will automatically start the tokenizer when it is launched.
 
-#### Deploying
+### Docker (production deployment)
 Refer to the reference Dockerfiles for examples on how to install the tokenizer. The Huggingface and Render Dockerfiles both include the tokenizer.

docker/huggingface/Dockerfile

@@ -1,10 +1,10 @@
-FROM node:18-bullseye-slim
+FROM node:18-bullseye
 RUN apt-get update && \
-    apt-get install -y git python3 python3-pip libzmq3-dev
+    apt-get install -y git python3 python3-pip libzmq3-dev curl cmake g++ libsodium-dev pkg-config
 RUN git clone https://gitgud.io/khanon/oai-reverse-proxy.git /app
 WORKDIR /app
 RUN pip3 install --no-cache-dir -r requirements.txt
-RUN npm install
+RUN npm ci --loglevel=verbose
 COPY Dockerfile greeting.md* .env* ./
 RUN npm run build
 EXPOSE 7860

esbuild.js

@@ -22,9 +22,6 @@ const config = {
       },
     }),
   ],
-
-  // "src/tokenization/claude_tokenizer.py":
-  //   "build/tokenization/claude_tokenizer.py",
 };
 
 function createBundler() {