hyrax.verbs.test

Attributes

logger

Classes

Test	Test verb - evaluates a trained model on test data

Module Contents

logger

class Test(config)

Bases: hyrax.verbs.verb_registry.Verb

Test verb - evaluates a trained model on test data

__init__()

Overall initialization for all verbs that saves the config

cli_name = 'test'

add_parser_kwargs

description = 'Evaluate a trained model on test data.'

REQUIRED_DATA_GROUPS = ('test',)

OPTIONAL_DATA_GROUPS = ()

static setup_parser(parser)

We don’t need any parser setup for CLI opts

run_cli(args=None)

CLI stub for Test verb

run()

Run the test process for the configured model on test data. This evaluates a trained model, saves outputs, and returns metrics.

Note: The configuration dictionary will be updated with the full path to the model weights file that is loaded into the model (config[“test”][“model_weights_file”]).

Returns:

Dataset containing test results that can be used for further analysis

Return type:

InferenceDataset

static _log_params(config, results_dir)

Log the various parameters to mlflow from the config file.

Parameters:

• config (dict) – The main configuration dictionary

• results_dir (str) – The full path to the results sub-directory