DreamServer — What is it?

ODS, formerly DreamServer, v2.6.0 is an installation and control layer for a local AI server. It selects an inference path for the detected hardware and combines Open WebUI, LiteLLM, agents, workflows, RAG, voice, image, and observability services.

⭐ 1,750 Stars 🍴 268 Forks Shell Apache-2.0 Author: Light-Heart-Labs
Source: github.com/Osmantic/ODS/tree/v2.6.0 View on GitHub →

Why it matters

The installer selects an inference backend, GGUF model, and context profile from the machine platform, GPU, and memory tier. It then connects inference, Open WebUI, LiteLLM, n8n, agents, RAG, speech, image, and observability components behind one control path.

Source: github.com/Osmantic/ODS/tree/v2.6.0

Core Features

Hardware detection and model selection

The installer selects an inference backend, GGUF file, and context configuration from the platform, GPU, and memory tier.

Source: github.com/Osmantic/ODS/tree/v2.6.0
Full service orchestration

It connects inference, Open WebUI, LiteLLM, n8n, agents, RAG, voice, image, and observability components.

Source: github.com/Osmantic/ODS/tree/v2.6.0
Local, cloud, and hybrid modes

Local mode is the default. Users can explicitly switch to cloud or hybrid mode and configure an external provider.

Source: github.com/Osmantic/ODS/tree/v2.6.0

Architecture

The platform installer creates the.env file and credentials, while control scripts manage containers and native inference services. Open WebUI reaches local or cloud models through LiteLLM and the selected route. Each extension service retains its own network and credential boundary.

Source: github.com/Osmantic/ODS/tree/v2.6.0

Project Knowledge Graph

Knowledge graph: project (center) + core features (inner hexagons) + key dependencies (outer chips) Docker Windows WSL2, Apple Silicon, or a supported Linux GPUWindows WSL2,… Disk space for models and imagesDisk space for… Hardware detection and model selectionHardware detection… Full service orchestrationFull service orches… Local, cloud, and hybrid modesLocal, cloud, and h… DreamServer Project Core feature Key dependency

Tech Stack

LanguageShell, PowerShell, Python, and Docker ComposeFrameworkllama-server + Open WebUI + LiteLLM + n8n and related services
DockerWindows WSL2, Apple Silicon, or a su…Disk space for models and images
WebUI on port 3000; Linux host inference on port 11434; native macOS and Windows inference usually on port 8080
Source: github.com/Osmantic/ODS/tree/v2.6.0

Quick Start

Path one is to clone the repository, check out v2.6.0, review install.sh, and then run it. Path two uses the official quick installer; on Windows, run install.ps1 from a regular PowerShell session. After installation, verify the platform status, complete a first chat at localhost:3000, and check the inference port.
Source: github.com/Osmantic/ODS/tree/v2.6.0

Use Cases

ODS suits users who want to install and maintain inference, a WebUI, workflows, and agents together on one workstation. A narrower tool is a better fit when the only need is document chat, container orchestration already exists, or the user does not want the upgrade surface of a multi-service stack.

Source: github.com/Osmantic/ODS;https://github.com/Mintplex-Labs/anything-llm

Strengths & Limitations

Strengths

  • Platform paths for Linux, Windows, and Apple Silicon
  • Centralized hardware detection and service orchestration
  • Clear local, cloud, and hybrid routing modes

Limitations

  • Installation creates multiple containers, volumes, ports, and credentials
  • The quick curl path requires accepting the trust boundary of a network-delivered script
  • Official Release validation does not replace local GPU and long-term stability testing
Source: github.com/Osmantic/ODS/tree/v2.6.0

Latest Release

v2.6.0 was published on 2026-07-28. Its changes include remote providers, model switching, rollback for GPU reassignment, rootless fixes, native Windows and macOS paths, and DNS rebinding and SSRF hardening.

Source: github.com/Osmantic/ODS/releases/tag/v2.6.0

Verification and evidence

status: docs-only  |  checked_at: 2026-09-23  |  environment: Docs only. Performed a static review of the v2.6.0 release, README, Installer Trust notes, and platform and port documentation.  |  limitations: Installation, image pulls, GPU inference startup, and data-volume behavior were not tested.  |  observed_output: Official documentation defines the status command, WebUI port 3000, platform inference ports, and green validation across six hosts. It also states that the long-running six-round model matrix is exempt.

Source: github.com/Osmantic/ODS/releases/tag/v2.6.0

Comparison

AnythingLLM is an end-user application centered on documents, workspaces, chat, and agents. ODS is a broader local AI server stack and control layer that also orchestrates inference, workflows, speech, images, and operations components.

Source: github.com/Mintplex-Labs/anything-llm;https://github.com/Osmantic/ODS…

Verdict

The project is now published as ODS, so older DreamServer instructions may point to outdated paths. For a long-lived machine, pin v2.6.0 and review the installer. Verify the first chat, restart recovery, and actual routing before enabling cloud services or third-party integrations.

Source: github.com/Osmantic/ODS/tree/v2.6.0

Frequently Asked Questions

Are DreamServer and ODS the same project?

Yes. The old repository now redirects to Osmantic/ODS, and the current project name, documentation, and commands use ODS. New installations should pin a stable ODS tag.

What are the minimum prerequisites for ODS v2.6.0?

Docker must be installed and running. Windows requires the WSL2 backend in Docker Desktop; macOS supports Apple Silicon; Linux GPU and distribution support must be checked against the official matrix.

Does ODS send prompts to the cloud by default?

Local mode is the default, and cloud access is not required. Requests leave the machine through LiteLLM only after cloud or hybrid mode and an external provider are configured.

How can I tell whether ODS works after installation?

Run the platform-specific status command, open localhost:3000 for a short chat, and check the inference port.

Sources and review scope
This review is based on the project's public documentation. Versions, installation commands, and feature boundaries can change upstream; check the cited sources and current release before use. Sources checked on: 2026-09-23 13:55.

Reference materials: README, GitHub API, dependency files