Commit Graph

3 Commits

Author SHA1 Message Date
projectmoon de2fcdbd6c Only compute GBNF grammar once. 2024-02-05 21:19:49 +01:00
projectmoon f7df8af068 Remove some unnecessary clones in the GBNF derive macro. 2024-02-05 16:33:53 +01:00
projectmoon 1e80ae508e Implement derive macro to convert structs to GBNF rules.
This is the initial implementation of a derive macro implementation
that converts structs into GBNF grammars. This simplies the code by
allowing us to get rid of all the hardcoded GBNF strings, prevents
errors from manually editing or copying said strings, and other
benefits.

The main purpose of this implementation is to lay the foundation for
generating hyper-specific GBNF rules that will allow us to limit LLM
output to specific UUIDs. LLM can't generate a weird response for an
exit or entity ID if it is only allowed to generate a specific list of
UUIDs in its response.
2024-02-05 16:12:05 +01:00