Documentation

Settings and appearance

The Settings window is organized into Model, Context length, Behavior, Connections, Remote Endpoints, and Appearance sections. It scrolls on smaller displays so lower sections remain accessible.

Applies to LlamaBoss v0.1.9 ยท Updated 2026-07-12

Model

  • Select an installed local model or a configured remote model.
  • Download models: open the curated download catalog.
  • Manage models: inspect and remove managed downloads.
  • Open folder: open the active model directory in File Explorer.
  • Change / Reset: use a custom model folder or return to the default.

Context length

Choose 4K, 8K, 16K, 32K, 64K, 128K, or 256K tokens. Enable 8-bit KV cache (recommended) to reduce context memory use. Context or KV changes reload the current local model.

Behavior

  • Start new chats with agent mode enabled: controls the default state of the robot button for new conversations.
  • Show context meter in the top bar: displays estimated tokens used versus the selected context size.

These defaults affect new chats; an existing chat can still be changed directly from its controls.

Connections and Remote Endpoints

Connections manage API keys and environment-variable references used by remote endpoints and Skill scripts. Remote Endpoints manage OpenAI-compatible inference servers and their model lists.

See Remote endpoints before storing a direct secret.

Appearance

Select a theme and a chat font size from 10pt through 24pt. Theme choices include dark, light, and curated developer-oriented palettes. The selected theme applies across the main window and themed dialogs.

The settings window can be resized and scrolls vertically when its content is taller than the current display. This prevents the Appearance and endpoint sections from being cut off on shorter screens.