Engineering

AI & Software

I work on document intelligence, retrieval, and evaluation. Here are some of the questions I’m building around.

Projects

Things I’m building.

Kit AI

IndexedDB · TTS · Llama 3

An offline-first emergency first-aid PWA built with a hackathon team, with local retrieval and online/offline text-to-speech.

Read about the project

Nova

Solana Pay

A Solana Pay invoicing app with QR payments, transaction tracking, and dashboards. It won Best Use of Solana at SwampHacks.

Read about the project

Open source

Contributions to the tools I use.

Selected merged contributions

  1. custom preset dicts validated into real options models

  2. new BoxNote document backend

  3. unpitched grace notes exported schema-invalid MusicXML

  4. Core-14 font aliases no longer fall back to flat glyph widths

  5. deterministic crash recovery for multi-agent solvers

More contributions (19)

  1. image processor registration crash on transformers 5.13

  2. form clusters no longer swallow tables

  3. composed tool-call and response-format grammar for structured outputs

  4. vision model support through mlx-vlm

  5. JSON tool-call fallback for llama4 pythonic parsing, both paths

  6. route the local converter through the VLM pipeline

  7. recover table text orphaned by the reading order model

  8. opt-in provenance on the chunk endpoints

  9. recovery hook for invalid structured output, maintainer shipped the same design

  10. structured outputs fix for newer vLLM servers

  11. mime type registration unblocking the BoxNote backend

  12. double onerror on transport close, ported to v2 with a reconnect fix

  13. msgpack round-trip for customized_info without the pickle wrap

  14. response_format no longer suppresses tool calls when tool_choice is auto

  15. allOf and oneOf rendering in tool forms, deferred to Inspector V2

  16. code language detection for parsed code blocks

  17. clear error for a misconfigured docling-serve URL

  18. optional-dependency imports broke the core converter in slim installs

  19. table recognition inside pictures, waiting on an architecture change

Technical notes

Decisions, experiments, and things I’ve learned.

I’m preparing notes on retrieval, evaluation, and the systems I’m working on. You can explore the projects above in the meantime.

All writing