Changelog

​

Bug fixes

• hotfixed ci (evals) (663083c)

​

New features

• introduction of tag filters (evals) (6f71580)

​

Bug fixes

• datasets now accept top level and filter (evals) (0c110fa)

​

Improvements

• update import paths to use .js extensions for consistency (97e481c)
• update import paths to use .js extensions for consistency (evals) (6dc73ac)

​

New features

• introduced sampling (evals) (4fd81ac)

​

New features

• introduced grouped test case export (evals) (0505039)

​

New features

• introduced triggeredAt (evals) (6258460)
• introduced trigger timestamp (evals) (e0cabeb)

​

New features

• introduced test case name in meta (evals) (a7959dc)
• introduced experiment name (evals) (c2bf0d7)
• adjustment of dataset and test case naming (evals) (f941bd7)
• introduction of ci mode (evals) (3aa1ec1)
• introduction of tags (evals) (3b82060)
• new naming convention (evals) (24f2dd9)
• new run structure with run configs (evals) (65e46db)

​

New features

• new features and project restructure (c5bdf34)

​

New features

• removed cpu concurrency defintion (evals) (189299e)
• improved concurrency for evals (evals) (50c3bcf)

​

Bug fixes

• replaced the json diff package due to invalid package hashes (evals) (7a12092)

​

New features

• integrate json-diff for enhanced diff logging and evaluation (evals) (0050228)
• enhance RunDetailsView and RunView for better score and metric display (evals) (5bf9416)
• update dependencies and enhance CLI functionality (evals) (2d29850)

​

New features

• enhance test case handling with reruns and aggregation support (evals) (fb4cfb2)
• improved cli (evals) (471394a)
• improved cli (evals) (5f077da)

​

New features

• improved cli (evals) (a94da38)
• added diffing (evals) (9a9263f)

​

New features

• update version to 0.7.0, add output handling in evaluator, and enhance test case structure (#27) (evals) (eaf9d8f)
• first version (#26) (evals) (9146b35)