Add docker-compose setup for OrbStack/Docker + a local OpenAI-compatible LLM - #3
Open
stanleyu911 wants to merge 1 commit into
Open
Add docker-compose setup for OrbStack/Docker + a local OpenAI-compatible LLM#3stanleyu911 wants to merge 1 commit into
stanleyu911 wants to merge 1 commit into
Conversation
…ble LLM Adds a docker-compose.yml running two services: - pgvector: Postgres with the pgvector extension, for the vector store - rag-api: built from the existing Dockerfile, with local-documents/ bind-mounted in for local knowledge-base ingestion, and host.docker.internal wired up so the container can reach an OpenAI-compatible LLM server (e.g. LM Studio, or any other OpenAI-compatible local server) running natively on the host. resources/application.env and resources/definition.json are project-specific (real tokens, DB credentials, model names) and are gitignored. resources/application.env.example and resources/definition.json.example are added instead, as copy-and-fill-in templates so the compose build works out of the box - the .example files use langchain_openai.ChatOpenAI/OpenAIEmbeddings pointed at a generic OpenAI-compatible endpoint. resources/certs/.gitkeep keeps the otherwise-empty directory present, since the Dockerfile's "COPY ./resources/certs ./certs" step requires it to exist. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_012uwq94g5qTJmrQyRnib67P
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
docker-compose.ymlwith two services:pgvector(Postgres + pgvector) andrag-api(built from the existingDockerfile), withlocal-documents/bind-mounted for local ingestion andhost.docker.internalwired up to reach an OpenAI-compatible LLM server (e.g. LM Studio) running natively on the host.resources/application.env/definition.jsonare project-specific and gitignored; adds.exampletemplates instead so the compose build works out of the box.resources/certs/.gitkeepkeeps the directory theDockerfile'sCOPYstep requires present.Test plan
docker compose up -d --buildagainst local pgvector + a local OpenAI-compatible LLM server./completion//search//historyrequests.