0.10.9

What's Changed

CLI updates

• add new models to benchmark_models by @wenzhe-log10 in #265
• add log10 tags of the completions into the output by @wenzhe-log10 in #267

Full Changelog: 0.10.8...0.10.9

0.10.8

What's Changed

CLI

• update feedback download cli with filter option by @wenzhe-log10 in #251
• update doc: log10 feedback download --help by @wenzhe-log10 in #262

Update dependencies

• Dependency update by @wenzhe-log10 in #263
  • openai -> 1.40.6
  • anthropic -> 0.33.1
  • magentic -> 0.31.0

Full Changelog: 0.10.7...0.10.8

0.10.7

What's Changed

Log19 CLI

• allow benchmark_models --id to take a json file of completion ids by @wenzhe-log10 in #250
  Example:

log10 completions benchmark_models --ids list_comp_ids.json --models=gpt-4o-mini -f benchmark_summ_test_gpt4o_mini.jsonl

JSON file examples:

[
    "545ab06c-07b0-4720-bce8-68df8201dbcc",
    "c01e663f-cd8a-4cd8-8aa8-6b6ef8966b4d",
    "c450eb50-5e0f-4bcc-9faf-3a1d4183f41a"
]

Full Changelog: 0.10.6...0.10.7

0.10.6

What's Changed

Maintenance

• update console message with status update instead of console print by @wenzhe-log10 in #242
• Update cli_docs.md pip install 'log10-io[cli]' by @wenzhe-log10 in #243
• Bump anthropic to 0.32.0 by @wenzhe-log10 in #244

Full Changelog: 0.10.5...0.10.6

0.10.5

What's Changed

Bug fixes

• Fix listing and download completions cli bug by @kxtran in #240

Chores

• Bump openai to 1.37.1 by @wenzhe-log10 in #236

Full Changelog: 0.10.4...0.10.5

0.10.4

What's Changed

CLI Features

• Implement feedback filtering in CLI & SDK by @nullfox @wenzhe-log10 in #206
• update cli doc feedback filter by @wenzhe-log10 in #237
• add --save_all_results_to_dataframe to benchmark_models cli by @wenzhe-log10 in #233
• update benchmark_models cli using --file to save to CSV, JSONL, or Markdown files by @wenzhe-log10 in #238

Full Changelog: 0.10.3...0.10.4

0.10.3

What's Changed

• bump openai and anthropic version by @wenzhe-log10 in #220
• Update README.md by @wenzhe-log10 in #225
• add gpt-4o-mini in cli model benchmark by @wenzhe-log10 in #230

Full Changelog: 0.10.2...0.10.3

0.10.2

What's Changed

Bug Fixes

• ENG-900 Return early when completion_id is not set by @kxtran in #213

Chores

• docs: update README.md by @eltociear in #204
• Add exception information to failed logging message by @kxtran in #212
• Support customize httpx timeout config by @kxtran in #216

New Contributors

• @eltociear made their first contribution in #204

Full Changelog: 0.10.1...0.10.2

0.10.1

What's Changed

Bug fixes

• Fix missing request's system message in anthropic by @kxtran in #208

Chores

• ENG-879 ENG-882 Move cli logic into its own folder by @kxtran in #198

Full Changelog: 0.10.0...0.10.1

0.10.0

What's Changed

New

• Support Anthropic claude-3-5-sonnet-20240620 model
• Support magentic version 0.27.0
• Support anthropic version 0.29.0

Fixes

• Update Anthropic function call output parsing logic to display messages properly in log10 platform

Chores

• ENG-849 ENG-819 Refactor Anthropic parsing code for async and sync with httpx client by @kxtran in #183

Full Changelog: 0.9.2...0.10.0