Announcing our BFCL benchmark results for OpenAI's structured output, which also tests the *contents* of generated outputs.
1.
@OpenAI
"strict" function-calling (FC) is slightly worse on the 2024-08-06 model, but better on every prior model.
2. OpenAI handedly beats Anthropic
BAML now supports Gemini ✨, with both Image and Audio inputs. Here is Gemini classifying a sound into bowling / swiming / soccer /tennis category.
Demo link
Announcing structured output support in all languages + tool-calling for every model.
Declare a prompt in a BAML file, and our tooling generates an SDK in the language of your choice.
1. Leverage our SOTA results in structured output parsing
2. Support complex schemas, even