A small parser experiment
Generic placeholder copy for testing a fuller writing index without inventing a public article.
ReadConstrained Decoding with Weighted Automata
A tiny counterexample, a debugger, and a simple rule for avoiding awkward greedy-lexer boundaries.
ReadThe difference between remembering the last match and merely following the last live prefix.
ReadA tiny counterexample, a debugger, and a simple rule for avoiding awkward greedy-lexer boundaries.
ReadThe difference between remembering the last match and merely following the last live prefix.
ReadA tiny lexer failure and the simple boundary rule that predicts it.
ReadA six-byte counterexample, the lost lexer boundary behind it, and an opt-in repair.
ReadA tiny grammar, a strange rejection, and a byte-by-byte look at why it happens.
ReadA tiny grammar that exposes a strange edge case in llguidance's greedy lexer.
ReadGLRMask vs llguidance, token by token
Readllguidance skips dead token-trie subtrees and fills broad lexer regions with precomputed token slices.
ReadWhy I spent years building a general grammar-constrained decoder when most people needed JSON.
ReadConstrained Decoding with Weighted Automata
ReadWhy one model token can hide a long lexer and parser execution, and how GLRMask compiles that work into a weighted automaton over GLR stacks.
ReadA Rust and Python library for fast grammar-constrained LLM decoding over JSON Schema and general context-free grammars.
ReadHow llguidance's one-byte lexer lookahead can lose a valid token boundary.
ReadRebuilding llguidance's token-trie, lexer, and Earley-parser loop in miniature.
ReadA persistent compressed map from stacks to weights, extracted from glrmask.
ReadTinyStories-1M runs locally; glrmask WebAssembly applies an exact JSON mask to its BPE logits before sampling.
ReadA 2023 SvelteKit chat client with streamed responses, rich Markdown messages, and a live deployment.
ReadAn experimental Python library for named tensor dimensions and Einstein-style array programming.
ReadMy 2019 honours thesis on variational inference for finite mixtures of gamma distributions.
Read