v1.5.4

What's Changed

• add weaviate retrieval step by @akshat-g in #94

Full Changelog: v1.5.3...v1.5.4

v1.5.3

What's Changed

• ATH-1806 by @akshat-g in #90
• API step improved by @vivek-athina in #92
• Upgrades to API step and version bump by @vivek-athina in #93

Full Changelog: v1.5.0...v1.5.3

v1.5.0

What's Changed

• Added JsonEval by @vivek-athina in #65
• Added reason to JsonEval validations by @vivek-athina in #67
• Add retrieval nodes by @akshat-g in #62
• Fix/json eval text validation reason by @vivek-athina in #68
• remove supported models check by @akshat-g in #69
• Added support to pass dataset id in run eval suite flow by @vivek-athina in #70
• Fix/add conversation coherence eval by @akshat-g in #71
• fix logger issues by @akshat-g in #72
• add chat history to faifulness by @akshat-g in #73
• Added code execution and jsonpath extract steps by @vivek-athina in #74
• Custom code eval by @vivek-athina in #75
• JsonEval split into two evals by @vivek-athina in #76
• Minor fixes in import by @vivek-athina in #77
• Improved custom code handling by @vivek-athina in #79
• Fix ragas aspect critque metrics by @akshat-g in #78
• Added re package support in custom code. Bumped version by @vivek-athina in #81
• bump json schema version by @akshat-g in #83
• Fix/litellm version specified by @vivek-athina in #84
• Version fixes by @vivek-athina in #85
• non boolean custom evals by @akshat-g in #82
• fix ragas aspect critique issues ATH-1641 by @akshat-g in #86
• Minor fix for error message in JSONSchema Eval by @vivek-athina in #87
• Tools support in evals by @vivek-athina in #88
• Error handling in dynamic columns by @vivek-athina in #89

Full Changelog: v1.4.3...v1.5.0

v1.4.3

What's Changed

• Fix for boolean evals to return 0 or 1 by @vivek-athina in #66
• modify prompt execution step by @akshat-g in #64

Full Changelog: v1.4.0...v1.4.3

v1.2.15

What's Changed

• add chat history to context contains enough information evaluator ATH-1029 by @akshat-g in #52

Full Changelog: v1.2.14...v1.2.15

Release v1.2.14

Fix context similarity grounded eval

v1.2.13

• Adds Groundedness Eval to LLM EvalType enum

v1.2.12

What's Changed

• Vivek/ath 1124 bug fixes in safety evals by @vivek-athina in #50

Full Changelog: v1.2.11...v1.2.12

v1.2.11

What's Changed

• mistral large model name fixed and version bump by @vivek-athina in #49

Full Changelog: v1.2.10...v1.2.11

v1.2.10

What's Changed

• added newer models by @vivek-athina in #47

Full Changelog: v1.2.9...v1.2.10