Contents Menu Expand Light mode Dark mode Auto light/dark, in light mode Auto light/dark, in dark mode Skip to content
Eval-Framework v0.26.0
Eval-Framework v0.26.0

Getting Started

  • Installation
  • Using the CLI

User Guides

  • Task naming convention
  • Controlling HuggingFace Upload Results Guide
  • Model Arguments
  • Overview Dataloading
  • Understanding Evaluation Results Guide
  • Utils in eval-framework
  • Weights and Biases Integration with Eval-Framework

Testing Guidelines

  • Testing

API Reference

  • API Reference
    • eval_framework package
      • eval_framework.benchmarks package
        • eval_framework.benchmarks.utils package
      • eval_framework.llm package
      • eval_framework.metrics package
        • eval_framework.metrics.aggregators package
        • eval_framework.metrics.completion package
        • eval_framework.metrics.efficiency package
        • eval_framework.metrics.llm package
        • eval_framework.metrics.loglikelihood package
      • eval_framework.result_processors package
      • eval_framework.tasks package
    • eval_framework.benchmarks package
      • eval_framework.benchmarks.utils package
    • eval_framework.benchmarks.utils package
    • eval_framework.llm package
    • eval_framework.metrics package
      • eval_framework.metrics.aggregators package
      • eval_framework.metrics.completion package
      • eval_framework.metrics.efficiency package
      • eval_framework.metrics.llm package
      • eval_framework.metrics.loglikelihood package
    • eval_framework.metrics.aggregators package
    • eval_framework.metrics.completion package
    • eval_framework.metrics.efficiency package
    • eval_framework.metrics.llm package
    • eval_framework.metrics.loglikelihood package
    • eval_framework.result_processors package
    • eval_framework.tasks package
    • eval_framework
      • eval_framework package
        • eval_framework.benchmarks package
          • eval_framework.benchmarks.utils package
        • eval_framework.llm package
        • eval_framework.metrics package
          • eval_framework.metrics.aggregators package
          • eval_framework.metrics.completion package
          • eval_framework.metrics.efficiency package
          • eval_framework.metrics.llm package
          • eval_framework.metrics.loglikelihood package
        • eval_framework.result_processors package
        • eval_framework.tasks package
Back to top
Copyright © 2025, Aleph Alpha Research
Made with Sphinx and @pradyunsg's Furo