Benchmark config

EvaluationConfig

class src.config.runs.benchmark.evaluation.EvaluationConfig(_case_sensitive: bool | None = None, _env_prefix: str | None = None, _env_file: DotenvType | None = PosixPath('.'), _env_file_encoding: str | None = None, _env_nested_delimiter: str | None = None, _secrets_dir: str | Path | None = None, *, type: str = 'multi', with_threshold: bool = True, overview_plot: bool = True, confusion_matrix: bool = True, precision_recall_plot: bool = True, classification_report: bool = True, log_artifacts: bool = True)

Bases: Settings

class Config

Bases: object

env_prefix = 'runs_benchmark_evaluation_'

_abc_impl = <_abc._abc_data object>

classification_report: bool

confusion_matrix: bool

log_artifacts: bool

model_config: ClassVar[SettingsConfigDict] = {'arbitrary_types_allowed': True, 'case_sensitive': False, 'env_file': '.env', 'env_file_encoding': 'utf-8', 'env_nested_delimiter': None, 'env_prefix': 'runs_benchmark_evaluation_', 'extra': 'ignore', 'protected_namespaces': ('model_', 'settings_'), 'secrets_dir': None, 'validate_default': True}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].

model_fields: ClassVar[dict[str, FieldInfo]] = {'classification_report': FieldInfo(annotation=bool, required=False, default=True), 'confusion_matrix': FieldInfo(annotation=bool, required=False, default=True), 'log_artifacts': FieldInfo(annotation=bool, required=False, default=True), 'overview_plot': FieldInfo(annotation=bool, required=False, default=True), 'precision_recall_plot': FieldInfo(annotation=bool, required=False, default=True), 'type': FieldInfo(annotation=str, required=False, default='multi'), 'with_threshold': FieldInfo(annotation=bool, required=False, default=True)}

Metadata about the fields defined on the model, mapping of field names to [FieldInfo][pydantic.fields.FieldInfo].

This replaces Model.__fields__ from Pydantic V1.

overview_plot: bool

precision_recall_plot: bool

type: str

with_threshold: bool

HybridConfig

class src.config.runs.benchmark.hybrid.HybridConfig(_case_sensitive: bool | None = None, _env_prefix: str | None = None, _env_file: DotenvType | None = PosixPath('.'), _env_file_encoding: str | None = None, _env_nested_delimiter: str | None = None, _secrets_dir: str | Path | None = None, *, minimum_threshold: float = 0.0)

Bases: Settings

class Config

Bases: object

env_prefix = 'runs_benchmark_hybrid_'

_abc_impl = <_abc._abc_data object>

minimum_threshold: float

model_config: ClassVar[SettingsConfigDict] = {'arbitrary_types_allowed': True, 'case_sensitive': False, 'env_file': '.env', 'env_file_encoding': 'utf-8', 'env_nested_delimiter': None, 'env_prefix': 'runs_benchmark_hybrid_', 'extra': 'ignore', 'protected_namespaces': ('model_', 'settings_'), 'secrets_dir': None, 'validate_default': True}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].

model_fields: ClassVar[dict[str, FieldInfo]] = {'minimum_threshold': FieldInfo(annotation=float, required=False, default=0.0)}

Metadata about the fields defined on the model, mapping of field names to [FieldInfo][pydantic.fields.FieldInfo].

This replaces Model.__fields__ from Pydantic V1.

MetricsConfig

class src.config.runs.benchmark.metrics.MetricsConfig(_case_sensitive: bool | None = None, _env_prefix: str | None = None, _env_file: DotenvType | None = PosixPath('.'), _env_file_encoding: str | None = None, _env_nested_delimiter: str | None = None, _secrets_dir: str | Path | None = None, *, f1: bool = True, precision: bool = True, recall: bool = True, hamming: bool = False, zero_division_default: float = 0.0)

Bases: Settings

class Config

Bases: object

env_prefix = 'runs_benchmark_metrics_'

_abc_impl = <_abc._abc_data object>

f1: bool

hamming: bool

model_config: ClassVar[SettingsConfigDict] = {'arbitrary_types_allowed': True, 'case_sensitive': False, 'env_file': '.env', 'env_file_encoding': 'utf-8', 'env_nested_delimiter': None, 'env_prefix': 'runs_benchmark_metrics_', 'extra': 'ignore', 'protected_namespaces': ('model_', 'settings_'), 'secrets_dir': None, 'validate_default': True}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].

model_fields: ClassVar[dict[str, FieldInfo]] = {'f1': FieldInfo(annotation=bool, required=False, default=True), 'hamming': FieldInfo(annotation=bool, required=False, default=False), 'precision': FieldInfo(annotation=bool, required=False, default=True), 'recall': FieldInfo(annotation=bool, required=False, default=True), 'zero_division_default': FieldInfo(annotation=float, required=False, default=0.0)}

Metadata about the fields defined on the model, mapping of field names to [FieldInfo][pydantic.fields.FieldInfo].

This replaces Model.__fields__ from Pydantic V1.

precision: bool

recall: bool

zero_division_default: float