eval_framework.metrics.efficiency package¶
Submodules¶
eval_framework.metrics.efficiency.bytes_per_sequence_position module¶
- class eval_framework.metrics.efficiency.bytes_per_sequence_position.BytesCompletion[source]¶
Bases:
BaseMetric[Completion]- NAME: str = 'Bytes'¶
- calculate(response)[source]¶
- Return type:
list[MetricResult]- Parameters:
response (Completion)
- class eval_framework.metrics.efficiency.bytes_per_sequence_position.BytesLoglikelihood[source]¶
Bases:
BaseMetric[Loglikelihood]- NAME: str = 'Bytes'¶
- calculate(response)[source]¶
- Return type:
list[MetricResult]- Parameters:
response (Loglikelihood)
- class eval_framework.metrics.efficiency.bytes_per_sequence_position.SequencePositionsCompletion[source]¶
Bases:
BaseMetric[Completion]- NAME: str = 'SequencePositions'¶
- calculate(response)[source]¶
- Return type:
list[MetricResult]- Parameters:
response (Completion)
- class eval_framework.metrics.efficiency.bytes_per_sequence_position.SequencePositionsLoglikelihood[source]¶
Bases:
BaseMetric[Loglikelihood]- NAME: str = 'SequencePositions'¶
- calculate(response)[source]¶
- Return type:
list[MetricResult]- Parameters:
response (Loglikelihood)