Integrating LM Studio with big-AGI

Quickly set up LM Studio with big-AGI to run local and open LLMs on your computer for enhanced privacy and control over AI interactions.

Video Tutorial

For a visual step-by-step guide, watch our YouTube tutorial.

Quick Setup Guide

Installing big-AGI

Clone and set up big-AGI:

git clone https://github.com/enricoros/big-agi.git && cd big-agi
npm install # Or: yarn install
npm run dev # Or: yarn dev
# If missing dependencies:
npm install @mui/material # Or: yarn add @mui/material

Configuring LM Studio

Ensure LM Studio is running (default: http://localhost:1234). Check the URL and modify if different.

Download local models in LM Studio
Start the LM Studio server
Optionally. Check the logs

Integration in big-AGI

In big-AGI, navigate to Models > Add > LM Studio
Enter the API URL: http://localhost:1234 (modify if different)
Refresh by clicking on the Models button to load models from LM Studio

In addition to using the UI, configuration can also be done using environment variables.

Troubleshooting

Missing @mui/material: Execute npm install @mui/material or yarn add @mui/material
Connection Issues: Check LM Studio's URL and ensure it's operational

Further Assistance

Advanced configurations and more:

big-AGI Community: Discord
LM Studio: LM Studio home page

1.7 KiB Raw Blame History