LocalAI

localai

OpenAI alternative.

Runs as local-ai|macOS, Linux, Windows|localai.io

Command form

ai-draft · 1 task · 5 fields

Start the LocalAI API server. Only a few commonly used flags from the official CLI reference are included.

Opens the form; the finished command lands at your prompt, unrun

Run in Otty

otty gui localai

Run the server

Run the serverExample values, fixed in this page — nothing here reaches a terminal

Basic

Models directory*

directory

Bind address

string

TasksEach one presets the form for one job

Serve models

models_pathaddress

ParametersOnly these flags are editable in the form

Models directory

path

--models-path

Bind address

string

--address:8080

Threads

integer

--threads-t

Context size

integer

--context-size

Log level

enum

--log-levelerrorwarninfodebugtrace

SourcesEvery flag above is checked against these

ref

manual2026-10-27

Before it fills your prompt, Otty checks the installed local-ai against its version. A form that does not match your version is not offered.