19ad0057c8
- header.svg rebuilt blue-dominant (gold demoted to accent) - new assets: desktop-preview.svg, architecture.svg, os-screenshot.png (real render) - README: blue badges, embedded hero + diagram, wiki link - fix dead Tabler icon-font CDN (cdnjs 404 -> jsdelivr) in live + repo OS desktop - fix broken ./docs/ai-stack.md badge link (file now exists) - add docs/academy.md, docs/islamic-layer.md, docs/ai-stack.md - SERVICES.md: Academy + Islamic layer sections Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
69 lines
2.9 KiB
Markdown
69 lines
2.9 KiB
Markdown
# AI Stack
|
|
|
|
Atlas OS routes every AI task by cost and complexity. The rule: **never burn paid tokens on work a free or local model can handle.** Free tier first, escalate only when it can't cope.
|
|
|
|
## Tier 0 — Zero-cost local (`localhost:8888/v1`, RTX A2000)
|
|
|
|
An OpenAI-compatible router exposes local Ollama models. Used for all non-critical subagent work, copy, summaries, translations, and classification.
|
|
|
|
| Alias | Backing | Use for |
|
|
|-------|---------|---------|
|
|
| `atlas-fast` | LLaMA 1B | Ultra-fast classification, routing, labels |
|
|
| `atlas-free` | Hermes3 | Dutch copy, summaries, FAQ, product descriptions |
|
|
| `atlas-code` | Qwen Coder | Code completion, simple fixes, boilerplate |
|
|
| `atlas-qwen` | qwen2.5 | General Dutch content, emails |
|
|
| `atlas-phi3` | qwen2.5:7b | Reasoning, analysis, comparisons |
|
|
| `atlas-auto` | smart router | Auto-picks the best free local model |
|
|
|
|
```python
|
|
import openai
|
|
client = openai.OpenAI(base_url="http://localhost:8888/v1", api_key="atlas")
|
|
client.chat.completions.create(model="atlas-auto", messages=[{"role":"user","content":"..."}])
|
|
```
|
|
|
|
## Tier 1 — Free cloud APIs
|
|
|
|
| Provider | Models | Best for |
|
|
|----------|--------|----------|
|
|
| Groq | llama-3.3-70b-versatile, mixtral-8x7b | Fast 70B reasoning, bulk tasks |
|
|
| Cerebras | llama-3.1-70b | Fastest inference, free tier |
|
|
| OpenRouter | 50+ free models incl. Gemini | Multi-model fallback |
|
|
| Gemini (via OpenRouter) | gemini-2.5-pro / 3.5-flash | 1M context, vision, PDF |
|
|
|
|
## Tier 2 — Paid Anthropic (only when free tiers can't cope)
|
|
|
|
| Task | Model |
|
|
|------|-------|
|
|
| Simple classification, short copy | `claude-haiku-4-5` |
|
|
| Code, multi-step reasoning, planning | `claude-sonnet-4-6` |
|
|
| Deep research, architecture, complex builds | `claude-opus-4-8` |
|
|
|
|
## Routing decision tree
|
|
|
|
```
|
|
copy / text / translation / summary / Dutch content
|
|
→ atlas-free (local) or Groq llama-3.3-70b (free cloud)
|
|
simple code / boilerplate / fix
|
|
→ atlas-code (local) or Cerebras (free cloud)
|
|
non-critical workflow subagent
|
|
→ atlas-auto or Groq (never Claude)
|
|
multi-step code / planning / complex reasoning
|
|
→ claude-sonnet-4-6
|
|
deep architecture / research / competitive analysis
|
|
→ claude-opus-4-8 or gemini-2.5-pro (free)
|
|
1M context / vision / PDF
|
|
→ Gemini via OpenRouter
|
|
```
|
|
|
|
## Always-on AI services
|
|
|
|
| Service | What it does |
|
|
|---------|-------------|
|
|
| `atlas-brain` | Collects mail + CRM + bank every 15 min → synthesizes the daily brief |
|
|
| `atlas-loop` | Background signal loop — publishes nudges to NATS |
|
|
| `atlas-meridian` | Autonomous decision engine / battle responder |
|
|
| `atlas-litellm` | Unified LLM proxy (OpenAI-compat API for all models above) |
|
|
| NATS mesh | Real-time event bus across all devices on the tailnet |
|
|
| Langfuse | Full LLM observability — every call traced with latency, cost, tokens |
|
|
|
|
All model calls flow through the LiteLLM proxy so cost and latency are traced centrally in Langfuse, regardless of which tier served the request.
|