Selected projects

Reinforcement learning systems, research implementations, and products I've built.

RL Snake agent playing on a 10 by 10 board

RL Snake

Applying reinforcement learning to the game of Snake.

Live demo GitHub
CFR blueprint and real-time endgame solver architecture for a poker agent

RL Poker

Replicating poker research to build state-of-the-art poker agents.

GitHub
TasteBento login page and product overview

TasteBento

Your taste profile, served in a bento box. A social discovery app for finding taste twins.

Live app

Other projects

Content Moderation Env

OpenEnv for user-generated content moderation.

GitHub

RL Notebooks

A 17-notebook journey from Bellman equations to AlphaZero and RLHF.

GitHub

Pick Pocket

A minimal web clipper with source tracing.

GitHub

Nutrient Risk Profiler

An application for checking the risk profile of food items, inspired by Yuka.

GitHub

Health Metrics Local Extractor

An offline-first app that extracts health metrics from medical PDFs using a local LLM.

GitHub

X Bookmark Manager

A Chrome extension for syncing and managing X bookmarks offline.

GitHub

Ancient / college projects (before 2014)