Skip to content

Hotfixes for a couple bugs

Choose a tag to compare

@mikegros mikegros released this 29 May 18:24
· 27 commits to main since this release
d32bf43

There was a structured output bug for specific endpoints that emerged when the previous output bug was fixed. Missed testing on the last release.

Also two other important fixes:

  • Context summarization had a bug that could inflate the number of tokens sent to the summarizing invoke. This could hit context limits and crash runs. It is now fixed by proper handling of the messages object in that function.
  • The dashboard had a couple places where model kwargs, api_key and base_url, were being handled in a manner that didnt generalize to multiple endpoints well. This is now fixed.