Skip to content
PrivateAI
← Back to Home
Privacy Stack

How to Replace ChatGPT With a Private AI Stack (That Costs Less)

9 min read min readBy PrivateAI Team

Why ChatGPT's Privacy Settings Don't Fully Protect You

Before building the alternative, it's worth understanding what you're actually opting out of — and what you aren't.

OpenAI offers "Temporary Chat" mode and a setting to disable conversation history. These prevent prompts from being saved to your account. They do not prevent OpenAI from logging queries for safety monitoring, abuse detection, or legal compliance. Enterprise plans add stricter contractual guarantees around data handling, but they start at $30 per user per month — most developers aren't paying for Enterprise.

If you're on a standard ChatGPT Plus account, the practical reality is: OpenAI has technical access to every prompt you've ever sent, regardless of your training data preferences.

For most casual use cases, that's an acceptable trade-off. For developers handling client code under NDA, security researchers, or anyone working with proprietary data, it isn't.

The Private AI Stack: Four Layers, Four Jobs

The stack below replaces ChatGPT's core functions with tools that either process data locally or operate under significantly stricter data policies:

| Layer | Function | Tool | Cost |

|-------|----------|------|------|

| Core AI | Daily writing, code, summarization | Ollama + Open WebUI | Free |

| Web Research | Real-time info, fact-checking | Perplexity Pro | $20/mo |

| File Storage | AI outputs, context documents | Tresorit | ~$15/mo |

| Communications | Email, project file sharing | Proton | Free–$10/mo |

Total: roughly $35–$45/month versus ChatGPT Plus at $20/month. You're paying a bit more — but you get full local AI capability, private web research, zero-knowledge file storage, and encrypted email. The capability jump is substantial.

Layer 1: Ollama + Open WebUI for Daily AI Work

For the 80% of tasks people use ChatGPT for — writing, code review, summarization, brainstorming — a local LLM is faster, free, and completely private. Your prompts never leave your machine.

What you need:

  • A machine with at least 8GB RAM (16GB recommended for larger models)
  • Ollama — open source local LLM runtime
  • Open WebUI — a ChatGPT-style browser interface for local models

Setup in under 15 minutes:

```bash

Install Ollama

curl -fsSL https://ollama.ai/install.sh | sh

Pull a model (Llama 3.1 8B — 4.7GB, runs on 8GB RAM)

ollama pull llama3.1:8b

Launch Open WebUI via Docker

docker run -d -p 3000:80 --add-host=host.docker.internal:host-gateway \

-v open-webui:/app/backend/data \

ghcr.io/open-webui/open-webui:main

```

Open localhost:3000 and you have a functional ChatGPT interface backed by a model that runs entirely on your hardware.

Which model to run:

  • Llama 3.1 8B — Best all-around for 8GB RAM. Strong at writing, coding, and summarization.
  • Qwen2.5 14B — Step up in quality if you have 16GB RAM. Excellent at structured data and reasoning tasks.
  • DeepSeek-Coder-V2 — Purpose-built for code. Competitive with GPT-4o on many benchmark coding tasks.

The limitation local LLMs can't solve: they don't know what happened after their training cutoff. For anything requiring current information, that's what Layer 2 is for.

Layer 2: Perplexity for Web-Aware Research

When you need current information — a newly published CVE, today's framework release notes, recent case law — a local LLM will either hallucinate or admit it doesn't know. Neither is useful.

Perplexity Pro is a research-focused AI that retrieves and synthesizes information from the live web, then cites every source. You get a direct answer with verifiable links rather than ten blue links to sort through yourself.

From a privacy standpoint, Perplexity is meaningfully better than using Google plus ChatGPT together:

  • No advertising business model. Perplexity doesn't sell your queries to ad networks. Their revenue comes from subscriptions, not behavioral targeting.
  • Source transparency. Every answer includes citations, so you can verify claims rather than trusting a black box.
  • Focus modes. You can restrict searches to academic papers, Reddit, GitHub, YouTube, or news sources, which reduces noise and keeps queries more contained.

Perplexity does log queries for abuse prevention — it's not zero-knowledge like a local LLM. But for research into technical topics, it's far more contained than pasting your questions into Google's search bar, where they feed directly into your advertising profile.

Use Perplexity for: real-time technical research, security vulnerability checks, scanning industry news, and any task that requires knowing what happened in the last 90 days.

Use your local LLM for: everything that doesn't require current events.

Affiliate Disclosure: This article may contain affiliate links. If you make a purchase through these links, we may earn a small commission at no extra cost to you. We only recommend products we genuinely believe in. This helps support our work and allows us to continue providing free content.

Layer 4: Proton for Project Communications

The final piece is communications. If you collaborate with clients or teammates on AI-assisted work, email is a significant exposure surface. Standard Gmail routes through servers Google can read and uses your email content to inform its advertising and AI training systems.

Proton Mail provides end-to-end encrypted email hosted under Swiss privacy law. Proton cannot read your emails — messages between Proton users are automatically end-to-end encrypted. Messages to non-Proton users are encrypted at rest on Proton's servers and can be sent with optional password protection.

For this stack, Proton's role is:

  • Sending AI-generated deliverables to clients without those emails routing through Google's infrastructure
  • Using Proton Drive (included with paid plans) as a secondary file exchange when clients can't use Tresorit
  • Keeping AI project communications separate from your personal or employer-monitored email account

Proton's free tier covers basic email. Proton Plus at $9.99/month adds 15GB storage, custom domains, and Proton Drive — a reasonable option if you prefer consolidating storage and email with one privacy-focused provider. For heavier file sync needs, the combination of Proton Mail and Tresorit is more capable than either alone.

Affiliate Disclosure: This article may contain affiliate links. If you make a purchase through these links, we may earn a small commission at no extra cost to you. We only recommend products we genuinely believe in. This helps support our work and allows us to continue providing free content.