hyrax.verbs.engine

Attributes

logger

Classes

Engine

This verb drives inference with an ONNX model in production.

Module Contents

logger

class Engine(config)

Bases: hyrax.verbs.verb_registry.Verb

This verb drives inference with an ONNX model in production.

__init__()

Overall initialization for all verbs that saves the config

cli_name = 'engine'

add_parser_kwargs

static setup_parser(parser)

Setup parser for engine verb

run_cli(args=None)

CLI stub for Engine verb

run(model_directory: str = None)

[x] Read in the user config [x] Prepare all the datasets requested [x] Implement a simple strategy for reading in batches of data samples [x] Process the samples with any custom collate functions as well as a default collate function [x] Pass the collated batch to the appropriate to_tensor function [x] Send that output to the ONNX-ified model [x] Persist the results of inference.