LLGuidance: Making Structured Outputs Go Brrr
LLGuidance is a high-performance library for constrained decoding that ensures LLM outputs are syntactically valid. Now used by OpenAI and integrated into major LLM frameworks.
Michał Moskal, Harsha Nori, Hudson Cooper, Loc Huynh
technical performance llguidance research