Comparing Batch Runs

BotDojo offers a feature to compare multiple batch runs, helping you analyze the impact of different configurations on your AI application's performance. This is useful for evaluating various scenarios and configurations.

To start a comparison, go to the Batch Grid in the View Batch section, select the batches you want to compare, and click "Compare Batches." BotDojo will then create a comparison report showing the selected batch runs side by side, providing insights into how different settings affect your application.

The report includes:

1. Evaluation Metrics: Displays metrics like accuracy and precision for each batch, helping you determine the most effective configuration.
2. Speed: Compares the execution speed of each batch, which is crucial for optimizing application efficiency.
3. Cost: If cost tracking is enabled, the report will compare the costs associated with each batch run.

This comparison helps identify the best prompts, models, and indexing strategies for your needs. Additionally, you can access detailed views of each batch run from the report for further analysis.

By using BotDojo’s comparison feature, you can make informed decisions to enhance your AI application's performance, ensuring it operates efficiently and cost-effectively.