Projects
Things I have built.
Parallel Constrained Decoding
pcd: a Python library that fills closed JSON schemas (booleans and enums) with open LLMs in one batched forward pass instead of writing the JSON token by token. Output is schema-valid by construction, with per-field probabilities. Runs on MLX and PyTorch, with a CLI for checking models and benchmarking.
Learn more →