RUNTIME / MEDIUM

LocalAI

One OpenAI-compatible endpoint for text, vision, speech and image models, GPU optional

Primaire bron

DifficultyMediumSetup profile

Platforms5cpu · apple · nvidia · amd · intel

APIOpenAI + Anthropic + ElevenLabs-compatible:8080

01 / INSTALL & RUN

Installation depends on your OS. These commands are examples or templates: replace placeholders and verify quantization, file format, drivers and runtime support. Memory fit does not guarantee deployment.

1
Installdocker run -ti --name local-ai -p 8080:8080 localai/localai:latest
2
Start a modellocal-ai run <verified-gallery-or-Hugging-Face-model-name>
3
Connect your app
OpenAI + Anthropic + ElevenLabs-compatible · :8080. Keep the service bound to localhost unless you add authentication and network controls.

Let op

Backends are separate images pulled on demand, so the first run needs network access and disk. Pick the image tag for your accelerator; the CPU image does not silently enable a GPU.

02 / COMPATIBLE MODELS