projectmoon
/
ai-game
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
ai-game/gbnf_derive/Cargo.toml

17 lines
368 B
TOML
Raw Normal View History

Implement derive macro to convert structs to GBNF rules. This is the initial implementation of a derive macro implementation that converts structs into GBNF grammars. This simplies the code by allowing us to get rid of all the hardcoded GBNF strings, prevents errors from manually editing or copying said strings, and other benefits. The main purpose of this implementation is to lay the foundation for generating hyper-specific GBNF rules that will allow us to limit LLM output to specific UUIDs. LLM can't generate a weird response for an exit or entity ID if it is only allowed to generate a specific list of UUIDs in its response.
2024-02-01 11:41:08 +00:00
[package]
name = "gbnf_derive"
version = "0.1.0"
edition = "2021"
[lib]
proc-macro = true
[dependencies]
auto_impl = "1.1.2"
syn = { version = "2.0", features = [ "derive", "full", "parsing", "printing", "visit", "visit-mut", "clone-impls", "proc-macro" ] }
quote = "1.0.35"
itertools = "0.12.0"
Allow limiting of values on derive(Gbnf) structs. With the new helper attribute #[gbnf_limit] on a field of a struct that has #[derive(Gbnf)], it is now possible to constrain the output of the LLM to a specific set of values for that field. This is extremely useful, for example, when asking the LLM to put a specific ID in a field. This commit also addresses numerous shortcomings of the original implementation of the derive macro. Deserialization of certain LLM responses currently broken as of this commit, due to different field names in the LLM output vs what serde expects (camelCase vs snake_case issues).
2024-02-07 11:01:47 +00:00
gbnf = { path = "../gbnf" }
proc-macro2 = "1.0.78"
darling = "0.20.5"