cars.orchestrator.cluster.abstract_cluster

Contains abstract function for Abstract Cluster

Classes

AbstractCluster

AbstractCluster

Functions

cars_profile_wrapper(*argv, **kwargs)

Create a wrapper for cars_profile to be used in cluster tasks

Module Contents

class cars.orchestrator.cluster.abstract_cluster.AbstractCluster(conf_cluster, out_dir, log_dir, launch_worker=True, data_to_propagate=None)

AbstractCluster

available_modes: Dict

out_dir: str

classmethod register_subclass(*short_names: str)

Allows to register the subclass with its short name :param short_names: the subclasses to be registered :type short_names: string

data_to_propagate = None

worker_log_dir

log_level = 0

checked_conf_cluster

abstract get_delayed_type()

Get delayed type

abstract cleanup(**kwargs)

Cleanup cluster

abstract check_conf(conf)

Check configuration

Parameters:

conf (dict) – configuration to check

Returns:

overloaded configuration

Return type:

dict

get_conf()

Get overriden configuration

Returns:

overriden configuration

create_task(func, nout=1)

Create task

Parameters:

• func – function

• nout – number of outputs

abstract create_task_wrapped(func, nout=1)

Create task

Parameters:

• func – function

• nout – number of outputs

abstract start_tasks(task_list)

Start all tasks

Parameters:

task_list – task list

abstract scatter(data, broadcast=True)

Distribute data through workers

Parameters:

data – task data

abstract future_iterator(future_list, timeout=None)

Iterator, iterating on computed futures

Parameters:

• future_list – future_list list

• timeout – time to wait for next job

cars.orchestrator.cluster.abstract_cluster.cars_profile_wrapper(*argv, **kwargs)

Create a wrapper for cars_profile to be used in cluster tasks

Parameters:

• argv – args of func

• kwargs – kwargs of func