Skip to main content

What is Lattice?

Lattice vs Lattice Cloud: Lattice is the local daemon that runs on your machine — managing agents, sessions, and LLM provider connections locally. Lattice Cloud is a separate product: a distributed-compute coordination layer and inference marketplace that routes requests across many machines. Lattice Cloud operates independently; you do not need Lattice installed to use it.

The Mental Model

Think of Lattice as your personal AI infrastructure running on your machine—everything you'd get from a cloud AI platform, but running entirely on your machine.

Just like how a laptop gives you computing power without renting server space, Lattice gives you an AI agent platform without renting cloud services. You own the infrastructure, the data, and the models.

Three Core Principles

1. Local-First

By default, everything happens on your machine:

  • ✅ Your data stays local in SQLite
  • ✅ Your agents run locally
  • ✅ Your sessions are stored locally
  • ✅ Cloud features are optional add-ons

You explicitly choose what leaves your machine.

2. Daemon-Based

Lattice runs as a background service (daemon) that:

  • Manages all agents and sessions
  • Handles LLM provider connections
  • Stores data in local SQLite database
  • Communicates with clients via Unix sockets

This is why agents can keep running even if you close your terminal.

3. Provider Flexibility

You choose which LLM providers to use:

  • Local models: Ollama, LM Studio (free, private)
  • Cloud models: Anthropic Claude, OpenAI, Google Gemini (powerful)
  • Multiple providers: Switch between them on the fly

Same agent code works with any provider.

Key Concepts

Daemon

The background process running on your machine. It:

  • Listens for commands from the Ada CLI
  • Manages agents and sessions
  • Routes to configured LLM providers
  • Stores data in SQLite
  • Communicates via Unix sockets

Start it with:

bash
lattice-ctl daemon start

Agents

Autonomous AI workers that execute tasks you assign:

bash
ada agents start "Analyze my code and find issues"

Agent runs in background, you can:

  • Check status: ada agents status <agent-id>
  • Stop it: ada agents stop <agent-id>
  • View results: stored in local database

Sessions

Chat conversation history with context:

bash
ada chat  # Create new session
# [conversation happens]
# Session saved automatically

ada sessions list  # See all sessions
ada sessions resume <session-id>  # Continue a conversation

Sessions remember context, so the AI understands your previous messages.

Providers

LLM services you configure:

bash
# Anthropic Claude
ada config provider set anthropic --api-key sk-...

# OpenAI
ada config provider set openai --api-key sk-...

# Ollama (local)
ada config provider set ollama --base-url http://localhost:11434

Agents and sessions use the active provider automatically.

How It Works: The Stack

Loading diagram…

Data stays local in the daemon's SQLite database unless you explicitly configure cloud sync.

Why Daemon-Based?

You might wonder: "Why not just run agents directly?"

The daemon solves real problems:

  1. Persistence - Agents keep running even if you close your terminal
  2. Session management - Conversations survive computer restarts
  3. Multiple clients - Multiple CLI instances share the same agents
  4. Resource efficiency - One daemon, one connection to each LLM provider
  5. Background execution - Agents work while you do other things

Without a daemon, each terminal would create its own agent, wasting resources.

Agents vs Sessions: Key Difference

AspectAgentsSessions
PurposeAutonomous workers executing tasksInteractive conversations
How createdada agents start <TASK>ada chat
ExecutionBackground, runs to completionInteractive, user-driven
InteractionCheck status, stop, view resultsType messages, get responses
Use caseAnalysis, automation, batch workReal-time conversation

Example:

Agents: "Analyze all my files and generate a report" (runs in background)

Sessions: "Let's chat about my code" (interactive back-and-forth)

Privacy and Data

What Stays Local

  • ✅ All agent data
  • ✅ All conversation history
  • ✅ All session data
  • ✅ Configuration files
  • ✅ Your LLM provider credentials (stored encrypted)

What Can Go to Cloud

  • Optionally: Backed-up sessions (if enabled)
  • Optionally: Synced agent data (if enabled)
  • Never: Credentials (API keys, tokens)

You explicitly enable cloud sync; it's off by default.

What Goes to LLM Providers

Only what you send to them:

  • Your task/message (goes to provider)
  • Provider response (comes back to you)
  • Everything else (your files, other conversations, system data) - stays local

Offline Capability

With local models (Ollama):

bash
# No internet needed
ollama pull mistral
ada config provider set ollama --base-url http://localhost:11434
ada agents start "Analyze this locally"  # Works offline

With cloud models:

  • Need internet to call the API
  • But all results stored locally
  • Can browse local history offline

Comparing to Alternatives

Traditional Cloud Platform

Loading diagram…

Lattice (Local-First)

Loading diagram…

Philosophy: Ownership and Simplicity

Lattice is built on two principles:

  1. You own your infrastructure

    • Not locked into a vendor
    • Can migrate or stop using lattice anytime
    • Data export/import fully supported
    • Make privacy decisions yourself
  2. Simple beats complex

    • One daemon per machine
    • No distributed systems complexity
    • Direct Unix socket communication
    • SQLite for storage (proven, reliable)

When Lattice is Right

Perfect For:

  • Privacy work - Healthcare, legal, financial, research
  • Offline development - No internet required
  • Cost-sensitive - No per-API-call charges for local models
  • Learning - Experiment without subscriptions
  • Control - Full infrastructure ownership

Consider Platform Services For:

  • Team collaboration - Shared workspaces (Lovelace platform)
  • Managed compute - Distributed inference without managing hardware (Lattice Cloud)
  • High compute - Need more power than your machine (Lattice Cloud)
  • Scaling - Distributed agent execution at scale

Or Use Both:

  • Develop locally, sync to cloud for team
  • Run private agents locally, share results
  • Use local models for privacy, cloud for power

The Vision: Decentralized Agentic Mesh

Lattice's future direction:

  • Agents on your laptop
  • Agents on your phone
  • Agents on your home server
  • All coordinating directly without cloud intermediaries

This is the "decentralized agentic mesh"—agents working together across your personal devices, with full privacy and no vendor lock-in.

Key Takeaways

Lattice is your personal AI infrastructureData stays local by defaultWorks offline with local modelsDaemon manages agents and sessionsYou control which providers to useSimple, proven architecture (SQLite + Unix sockets)Designed for privacy-first applications

Next Steps