projectmoon
6fff4ecacd
With the new helper attribute #[gbnf_limit] on a field of a struct that has #[derive(Gbnf)], it is now possible to constrain the output of the LLM to a specific set of values for that field. This is extremely useful, for example, when asking the LLM to put a specific ID in a field. This commit also addresses numerous shortcomings of the original implementation of the derive macro. Deserialization of certain LLM responses currently broken as of this commit, due to different field names in the LLM output vs what serde expects (camelCase vs snake_case issues). |
||
|---|---|---|
| .. | ||
| src | ||
| Cargo.lock | ||
| Cargo.toml | ||
| build.rs | ||
| koboldcpp.json | ||