cars.orchestrator.cluster.abstract_cluster
Contains abstract function for Abstract Cluster
Module Contents
Classes
AbstractCluster |
- class cars.orchestrator.cluster.abstract_cluster.AbstractCluster(conf_cluster, out_dir, launch_worker=True)
AbstractCluster
- available_modes :Dict
- profiling :cars.conf.input_parameters.ConfigType
- out_dir :str
- classmethod register_subclass(short_name: str)
Allows to register the subclass with its short name :param short_name: the subclass to be registered :type short_name: string
- abstract cleanup()
Cleanup cluster
- abstract check_conf(conf)
Check configuration
- Parameters
conf (dict) – configuration to check
- Returns
overloaded configuration
- Return type
dict
- get_conf()
Get overriden configuration
- Returns
overriden configuration
- create_task(func, nout=1)
Create task
- Parameters
func – function
nout – number of outputs
- abstract create_task_wrapped(func, nout=1)
Create task
- Parameters
func – function
nout – number of outputs
- abstract start_tasks(task_list)
Start all tasks
- Parameters
task_list – task list
- abstract scatter(data, broadcast=True)
Distribute data through workers
- Parameters
data – task data
- abstract future_iterator(future_list)
Iterator, iterating on computed futures
- Parameters
future_list – future_list list