Hi, I'm karutoil

Agents that actually work.

I build the scaffolding around AI models: the gateway every request routes through, the tool runtime an agent calls, and the diagnostics that catch its mistakes before they ship.

Available for contracts Located Remote · UTC-7 Focus agents · LLM infra · automation
Portrait of karutoil
  • LLM Gateways
  • Agent Tooling
  • Platform Ops
  • Open Source

Shipping daily

Production-grade

13

Public repositories

agent tooling, gateways, and developer tools

6

Languages in production

TypeScript, Go, Rust, Python, JavaScript, Shell

5 +

Years in production

Linux, virtualization, and network operations

500 +

Servers managed

across game, hosting, and lab environments

Selected Projects

Gateways, agent runtimes, and platforms — each one built to hold up under real traffic.

View all projects
infrastructure

AI Gateway

A Go gateway that fronts OpenAI, Anthropic, Azure, and any OpenAI-compatible provider — exposing a single OpenAI/Anthropic/Responses-compatible surface with routing, budgets, caching, and an embedded admin UI.

Problem Every provider speaks a different protocol, so each product re-implements auth, routing, and retries — and provider keys end up scattered across services.
Solution One Go binary that normalises OpenAI, Anthropic, Azure, and Responses behind a single surface, with strategy-based routing, budgets, and encrypted keys.
Tech go · gateway · routing · openai · anthropic
Results Six provider surfaces collapse into one endpoint; routing, failover, and per-key cost control are configured instead of coded.
Catalyst — interface preview catalystctl

Catalyst

The modern open-source alternative to Pterodactyl: a Rust core with native containerd integration, multi-node lifecycle management, live console access, and one-line install for enterprise game hosts.

Problem Existing game-server panels carry a separate daemon per node, so console latency, upgrades, and multi-node operations all become their own failure mode.
Solution A Rust core that drives containerd directly, with a WebSocket console, multi-node lifecycle management, RBAC, and a one-line installer.
Tech rust · typescript · containerd · react · websocket
Results Sub-10ms console round-trips; a single install brings up panel, database, and reverse proxy in about a minute.
agent tooling

PI Web

A real-time browser interface for the PI coding agent — project and session management, streamed chat, and live visibility into every tool call and reasoning step.

Problem A coding agent runs in a terminal, so long sessions are invisible: no way to see tool calls as they happen, steer mid-run, or total up what a project costs.
Solution A real-time browser front end over the agent's native RPC mode — project and session management, streamed chat, live tool-call display, and in-stream steering.
Tech bun · hono · react · websocket · agent-ui
Results Every reasoning step and tool call is visible while it runs, with token and cost roll-up per project and per model.

Tech Stack

The tools I reach for daily, grouped by the layer they live in.

See how it fits together

Languages

Go
Rust
TypeScript
Python
JavaScript
Bash
SQL

AI / ML

LLM gateways
Agent runtimes
MCP servers
Embeddings
Semantic search
Tree-sitter
Vision handoff
Agent memory

Infrastructure

Linux
Proxmox
Docker
containerd
Ansible
nginx
Cloudflare
Bare metal

Databases

PostgreSQL
SQLite
Redis
Ceph
Vector stores

Observability

Prometheus
Audit trails
Cost tracking
Tracing
Structured logs
Metrics

Frontend & Tooling

React
Astro
Node
Bun
Hono
xterm.js
WebSocket
WebAuthn

Open Source

Public repos I maintain — from LLM infrastructure to agent code intelligence.

All 13 repositories

One self-contained Go binary fronting every model provider — routing, budgets, caching, and an embedded admin UI.

Active

Open-source game-server platform: Rust core, native containerd, live console, and multi-node lifecycle management.

Active

Real-time browser interface for a coding agent, with streamed chat and live visibility into every tool call.

9 stars Active

In-process tree-sitter diagnostics and compiler-backed type checking, so an agent sees its own errors early.

2 stars Active