eval_framework.metrics.llm package

Submodules

eval_framework.metrics.llm.base module

class eval_framework.metrics.llm.base.BaseLLMJudgeMetric(llm_judge, randomize_order=False)[source]

Bases: BaseMetric[Completion]

Parameters:
  • llm_judge (BaseLLM)

  • randomize_order (bool)

MAX_WORKERS: int = 100

Module contents