Carlos Galarza
Shipping local AI and making it run efficiently.
I learn, research, experiment, and build things I find useful. Mostly AI these days. Right now I'm building Sevra, a private AI app that picks the best local models for your computer and tunes the whole stack around them. Its open-source engine, slotstream, runs a 125B model at about 13 tokens per second on a Mac with 48 GB of memory.
Say hiplaying with
Sevra
A private AI app for your files and tools. It picks the best local models your computer can run, keeps them updated, and tunes the whole stack around them. In development, Mac first, built on the open-source slotstream engine.
slotstream
Run a 104 GB model on a Mac that holds 48. It streams a 125B mixture-of-experts model off the SSD instead of loading it, so it runs in whatever memory you give it. One Swift binary. Every number in it ships with its measurement, including the experiments that failed.
Launch: #1 Show HN · #8 on Hacker NewsVibeCraft
A complete computer for AI agents: dedicated machines where agents used real browsers, terminals, and filesystems.
Math a Server Can't See
Encrypt two numbers in your browser, watch a server compute on them without ever seeing them, then decrypt the answer. Real fully homomorphic encryption with live metrics, and the privacy boundary drawn on screen.
Zero to GPT-2
An interactive walkthrough of GPT-2 from first principles. Built so I could finally understand transformers properly.
The Essence of GraphRAG
A visual, interactive walkthrough of the core idea behind GraphRAG and why it works differently.
Aven
Claude Computer Use as a desktop app. Built with Tauri and the Vercel AI SDK.
AI Therapist (ASMR)
An AI therapist with a whispering voice. A demo using the OpenAI Realtime API, ElevenLabs, and Fal.ai.
Make Your Own JS Runtime
How to build a JavaScript runtime on top of Deno Core and Rust.
Tauri + Deno PoC
Running multiple Deno tasks safely inside a Tauri app. Permissions, IO, and lifecycle.
CodePortal
An earlier platform for building apps with natural language. Predates a lot of what's happening now.
Figma app for Linux
Unofficial Figma desktop app for Linux, with local font support. Built it because I needed it.
Blocklify
JavaScript to Blockly blocks. Parses code and imports it into the visual block editor.
work with me
Most of my week goes into Sevra. I also work with a small number of AI companies on production-agent reliability: one live workflow, one measurable failure, an implemented fix, and evidence that it works.
professional work
A few of the people and places along the way.
Will McLellarn
Founder, General Dev · Stanford alum
“Stop considering and work with Carlos. He’s been an incredible asset to my business, clear on strategy, excellent communicator, and the rare kind of builder who can actually ship. He led, contributed, and taught along the way, and brought real passion to every project.”
Naveed Hedayati
Head of Product, Co-Intelligence Labs
“Highly recommend Carlos – he helped unblock me and gave me a path forward in my MVP with Bolt, and then he even provided suggestions for ways to streamline the process as I moved forward.”
Randall Reilly
Trucking & Logistics
Years of trucking-industry hiring data spread across three dashboards. Clients needed training to run even basic queries. Most of the data went unused.
I built a chat interface that unified all three systems. Ask about hiring costs in Texas and you get the number, how it compares to neighboring states, and whether it’s trending up or down.