MCPcopy Create free account

hub / github.com/BSC-ES/autosubmit / functions

Functions2,688 in github.com/BSC-ES/autosubmit

↓ 3 callersMethodget_notifications
Returns if the user has enabled the notifications from autosubmit's config file. :return: if notifications :rtype: string
autosubmit/config/configcommon.py:2564
↓ 3 callersMethodget_partition_directive
Returns partition directive for the specified job :param job: job to create partition directive for :type job: Job :param het
autosubmit/platforms/headers/slurm_header.py:78
↓ 3 callersMethodget_processors_directive
Returns processors directive for the specified job :param job: job to create processors directive for :type job: Job :param h
autosubmit/platforms/headers/slurm_header.py:50
↓ 3 callersMethodget_pscall
Gets command to check if a job is running given process identifier :param job_id: process identifier :type job_id: int :retur
autosubmit/platforms/paramiko_platform.py:1508
↓ 3 callersMethodget_queue_status_cmd
Get queue generating squeue command to the job selected. :param job_id: ID of a job. :param job_id: str :return: Gets estimat
autosubmit/platforms/slurmplatform.py:526
↓ 3 callersMethodget_reservation_directive
Returns reservation directive for the specified job :param job: :param parameters: :param het: :return:
autosubmit/platforms/headers/slurm_header.py:210
↓ 3 callersFunctionget_ssh_container
Get a running SSH container, its port, and an SSH config. NOTE: Different from its sibling functions in this module, this function may
test/integration/test_utils/docker.py:308
↓ 3 callersMethodget_status_counts_from_job_list
Return dict with keys COMPLETED, FAILED, QUEUING, SUBMITTED, RUNNING, SUSPENDED, TOTAL.
autosubmit/history/experiment_history.py:373
↓ 3 callersMethodget_subjoblist
Returns the list of SubJob objects with their corrected queue times in the case of jobs that belong to a wrapper.
autosubmit/job/job_utils.py:423
↓ 3 callersMethodget_submitted
Returns a list of submitted jobs. :param wrapper: :param hold: :param platform: job platform :type platform: HPCPlatf
autosubmit/job/job_list.py:1894
↓ 3 callersMethodget_wrapper_policy
Returns what kind of policy (flexible, strict, mixed ) the user has configured in the autosubmit's config. :return: wrapper type (or none)
autosubmit/config/configcommon.py:2645
↓ 3 callersMethodget_yaml_filenames_to_load
Get all yaml files in a folder and return a list with the filenames :param yaml_folder: folder to search for yaml files :param ignore_
autosubmit/config/configcommon.py:746
↓ 3 callersFunctiongit_clone_repository
Clone a Git repository into the given path.
test/integration/test_utils/git.py:89
↓ 3 callersMethodhas_children
Returns true if job has any children, else return false :return: true if job has any children, otherwise return false :rtype
autosubmit/job/job.py:1085
↓ 3 callersMethodheaders
()
autosubmit/monitor/diagram.py:106
↓ 3 callersMethodinc_fail_count
Increments fail count
autosubmit/job/job.py:1019
↓ 3 callersMethodinsert_statement_with_arguments
Insert statement with arguments into path
autosubmit/history/database_managers/database_manager.py:123
↓ 3 callersMethodis_current_version
(self)
autosubmit/history/database_managers/experiment_history_db_manager.py:81
↓ 3 callersMethodis_deadlock
Check if the current state is a deadlock. :param any_simple_packages: Flag indicating if there are any simple packages. :par
autosubmit/job/job_packager.py:291
↓ 3 callersFunctionis_gzip_file
(filepath: Union[Path, str])
autosubmit/log/utils.py:97
↓ 3 callersMethodis_over_wallclock
Check if the job is over the wallclock time, it is an alternative method to avoid platform issues.
autosubmit/job/job.py:1432
↓ 3 callersMethodis_there_a_last_experiment_run
(self)
autosubmit/history/database_managers/experiment_history_db_manager.py:216
↓ 3 callersMethodload_current_hpcarch_parameters
Load custom HPCARCH parameters. :param parameters: Dictionary to populate with HPC values. If None, use self.experiment_data.
autosubmit/config/configcommon.py:1920
↓ 3 callersMethodneeds_reload
Check if any configuration file has been modified and needs to be reloaded. Returns: bool: True if a reload is needed, F
autosubmit/config/configcommon.py:1798
↓ 3 callersFunctionnew_experiment
Stores a new experiment on the database and generates its identifier :param description: description of the experiment :param version: v
autosubmit/experiment/experiment_common.py:49
↓ 3 callersMethodparse_jobs_by_filter
(self, unparsed_jobs, two_step_start=True)
autosubmit/job/job_list.py:2012
↓ 3 callersMethodparse_queue_reason
Parses the queue reason from the output of the command. :param output: output of the command. :param job_id: job id :return:
autosubmit/platforms/slurmplatform.py:569
↓ 3 callersFunctionprepare_and_test_ssh_container
( container: DockerContainer, ssh_port: int, ssh_path: Path, mocker: 'MockerFixture')
test/integration/test_utils/docker.py:251
↓ 3 callersMethodprepare_run
Prepare the run of the experiment. :param expid: a string with the experiment id. :param start_time: a string with the starting time
autosubmit/autosubmit.py:1841
↓ 3 callersMethodprocess_job_list_changes_to_experiment_totals
Updates current experiment_run row with totals calculated from job_list.
autosubmit/history/experiment_history.py:263
↓ 3 callersMethodprocess_jobs_to_submit
(self, job_id: str, hold: bool = False)
autosubmit/job/job_packages.py:252
↓ 3 callersMethodprocess_not_wrappeable_packages
Process the not wrappable packages based on the policy. :param not_wrappeable_package_info: List of not wrappable package informatio
autosubmit/job/job_packager.py:382
↓ 3 callersMethodprocess_scheduler_parameters
Parsers yaml data stored in the dictionary and calculates the components of the heterogeneous job if any.
autosubmit/job/job.py:1617
↓ 3 callersMethodread_header_tailer_script
Opens and reads a script. If it is not a BASH script it will fail :( Will strip away the line with the hash bang (#!) :para
autosubmit/job/job.py:693
↓ 3 callersMethodremove_multiple_files
Creates a shell script to remove multiple files in the remote and sets the appropriate permissions. :param filenames: A string containing the
autosubmit/platforms/locplatform.py:206
↓ 3 callersMethodreset
(self)
autosubmit/platforms/paramiko_platform.py:194
↓ 3 callersMethodreset_logs
(self, as_conf: AutosubmitConfig)
autosubmit/job/job.py:2203
↓ 3 callersMethodrestore_connection
Restores the SSH connection to the platform. This is where the first connection to a remote platform normally starts in an Autosubmit
autosubmit/platforms/paramiko_platform.py:242
↓ 3 callersMethodretrieve_logfiles
Retrieves log files from the remote host. :param raise_error: If True, raises an error if the log files are not retrieved.
autosubmit/job/job.py:1356
↓ 3 callersMethodselect_all
(self, table_name: str)
autosubmit/database/db_manager.py:81
↓ 3 callersMethodset_version
Sets autosubmit's version in autosubmit's config file :param autosubmit_version: autosubmit's version :type autosubmit_version: str
autosubmit/config/configcommon.py:2458
↓ 3 callersMethodstatus
Sends status of jobs to the log. It will be shown in white in the console. :param msg: message to show :param args: arguments for mes
autosubmit/log/log.py:416
↓ 3 callersMethodstatus_failed
Sends failed status of jobs to the log. It will be shown in white in the console. :param msg: message to show :param args: arguments
autosubmit/log/log.py:426
↓ 3 callersMethodsteps_plus_extern_approximate_header_energy
(self)
autosubmit/history/platform_monitor/slurm_monitor.py:75
↓ 3 callersFunctionstrtobool
Convert a string representation of truth to ``True`` or ``False``. True values are 'y', 'yes', 't', 'true', 'on', and '1'; false values are '
autosubmit/helpers/utils.py:271
↓ 3 callersMethodsubmit
:param hold: :param configuration: Autosubmit basic configuration :type configuration: AutosubmitConfig object :param
autosubmit/job/job_packages.py:181
↓ 3 callersMethodsubmit_error
Check if the output of the submit command contains an error message. :param output: output of the submit cmd :return: boolean
autosubmit/platforms/pjmplatform.py:82
↓ 3 callersMethodupdate_cmds
Updates commands for platforms
autosubmit/platforms/ecplatform.py:94
↓ 3 callersMethodupdate_experiment_run_dc_by_id
Requires ExperimentRun data class.
autosubmit/history/database_managers/experiment_history_db_manager.py:203
↓ 3 callersMethodupdate_failed_jobs
Check all jobs associated, and update their status either to complete or to Failed, and if job is still running appends it to they inner jobs
autosubmit/job/job.py:3164
↓ 3 callersMethodupdate_job_data_dc_by_job_id_name
Update JobData data class. Returns the latest row from job_data by job_name. :param job_data_dc: The JobData data class instance con
autosubmit/history/database_managers/experiment_history_db_manager.py:246
↓ 3 callersMethodupdate_stat_file
(self)
autosubmit/job/job.py:1329
↓ 3 callersMethodupsert_details
Upsert the details of an experiment. :param exp_id: The ID of the experiment. :param user: The user that created the experim
autosubmit/experiment/detail_updater.py:56
↓ 3 callersMethodwrapper_header
(self, **kwargs)
autosubmit/platforms/headers/slurm_header.py:264
↓ 3 callersMethodwrite_end_time
Writes end timestamp to TOTAL_STATS file and jobs_data.db :param completed: True if the job has been completed, False otherwise
autosubmit/job/job.py:2680
↓ 3 callersMethodwrite_submit_time
Writes submit date and time to the ``TOTAL_STATS`` file. It doesn't write if hold is True.
autosubmit/job/job.py:2585
↓ 3 callersMethodwrite_submit_time
(self, job_name, submit=0, status="UNKNOWN", ncpus=0, wallclock="00:00", qos="debug", date="",
autosubmit/history/experiment_history.py:75
↓ 2 callersMethod__add_child
Adds a new child to the job :param new_child: new child to add :type new_child: Job
autosubmit/job/job.py:1053
↓ 2 callersFunction_assert_does_not_contain_zip
(zip_path: Path)
test/integration/provenance/test_rocrate.py:410
↓ 2 callersFunction_build_db_mock
(current_experiment_id, mock_db_common, mocker)
test/integration/test_expid.py:557
↓ 2 callersFunction_calculate_processing_elements
(nodes, processors, tasks, processors_per_node, exclusive)
autosubmit/statistics/jobs_stat.py:56
↓ 2 callersFunction_check_final_status
(job: Job, child: Job)
autosubmit/monitor/monitor.py:226
↓ 2 callersFunction_check_mail_address
(mail_to: list[str])
autosubmit/notifications/mail_notifier.py:144
↓ 2 callersFunction_check_metadata
( emails: list[dict], expected_subject: str, expid: str, sender: str,
test/integration/test_mail.py:73
↓ 2 callersFunction_check_node_exists
Check if a node exists and if it must be skipped or not. If the list of ``groups`` is empty, or if the given ``job`` name is not listed in th
autosubmit/monitor/monitor.py:135
↓ 2 callersFunction_check_structures_path
(db_path: Path)
autosubmit/database/db_structure.py:36
↓ 2 callersMethod_check_time
Generate the starting time of a job found by a generated command. :param output: The output of a CMD command executed :param index: l
autosubmit/job/job.py:3243
↓ 2 callersMethod_chunked_md5
Calculate the MD5 checksum of a file in chunks to avoid high memory usage. :param file: A file-like object opened in binary mode. :re
autosubmit/platforms/paramiko_platform.py:542
↓ 2 callersMethod_common_script_content
(self)
autosubmit/job/job_packages.py:693
↓ 2 callersFunction_create_csv
Creates a CSV file with the table of the jobs aggregated by section or the jobs list. :param jobs_data: jobs data for the table :type jo
autosubmit/monitor/diagram.py:629
↓ 2 callersMethod_create_jobs
(dic_jobs, priority, default_job_type)
autosubmit/job/job_list.py:1603
↓ 2 callersMethod_create_jobs_member
Create jobs to be run once per member :param section: section to read :type section: str :param priority: priority f
autosubmit/job/job_dict.py:120
↓ 2 callersMethod_create_jobs_startdate
Create jobs to be run once per start date :param section: section to read :type section: str :param priority: priori
autosubmit/job/job_dict.py:99
↓ 2 callersFunction_create_node
Create a node object for a graph. If the list of ``groups`` is provided, and contains only the ``job`` and no other elements, then unless ``h
autosubmit/monitor/monitor.py:187
↓ 2 callersFunction_create_nodelist
(num_cores)
test/unit/test_machinefiles_wrapper.py:31
↓ 2 callersFunction_create_parameter
(crate, parameter_name, parameter_value, formal_parameter, _type='PropertyValue', **kwargs)
autosubmit/provenance/rocrate.py:274
↓ 2 callersMethod_create_project_associated_conf
(as_conf: AutosubmitConfig, force_model_conf: bool, force_jobs_conf: b
autosubmit/autosubmit.py:4257
↓ 2 callersMethod_create_scripts
(self, configuration: 'AutosubmitConfig')
autosubmit/job/job_packages.py:242
↓ 2 callersFunction_create_ssh_client
Create a Paramiko SSH Client. Sets up all the attributes required by Autosubmit in the :class:`paramiko.SSHClient`. This code is in a separat
autosubmit/platforms/paramiko_platform.py:65
↓ 2 callersFunction_create_table
Creates a pdf with the table of the jobs aggregated by section or the jobs list. :param jobs_data: jobs data for the table :type jobs_da
autosubmit/monitor/diagram.py:544
↓ 2 callersMethod_deep_map_dependencies
Recursive function to map dependencies of dependencies
autosubmit/job/job_list.py:335
↓ 2 callersMethod_delete_edgeless_jobs
(self)
autosubmit/job/job_list.py:135
↓ 2 callersFunction_delete_stats_files_but_two_newest
Function to clean space on ``BasicConfig.LOCAL_ROOT_DIR/plot`` directory. Removes all plots that pass the filter, keeping the newest two files on
autosubmit/monitor/monitor.py:245
↓ 2 callersMethod_do_submission
Submit package to the platform.
autosubmit/job/job_packages.py:248
↓ 2 callersFunction_estimate_requested_nodes
Estimates the number of requested nodes. In the past we had ``ZeroDivisionError`` due to the number of ``tasks`` being set to ``0`` by defaul
autosubmit/statistics/jobs_stat.py:26
↓ 2 callersFunction_fn
()
test/unit/test_lockfile.py:39
↓ 2 callersFunction_generate_title
Generates a title banner with the specified text. :param title: The title that will be shown in the banner. :type title: str :return
autosubmit/profiler/profiler.py:141
↓ 2 callersFunction_get_action_status
Get the status of the workflow action. :param jobs: list of jobs, used to infer the current workflow/action status. :return: a valid RO-Crate
autosubmit/provenance/rocrate.py:165
↓ 2 callersMethod_get_all_children
(self, job_data_dcs_in_wrapper)
autosubmit/history/strategies.py:200
↓ 2 callersMethod_get_built_list_of_changes
Return: List of (current timestamp, current datetime str, status, rowstatus, id in job_data). One tuple per change.
autosubmit/history/experiment_history.py:258
↓ 2 callersFunction_get_code_not_pushed
Return any code not pushed to remotes in the given Git repository or submodules. If there are no code not pushed changes, return None. :para
autosubmit/git/autosubmit_git.py:69
↓ 2 callersFunction_get_current_memory
Return the current memory consumption of the process in Bytes. :return: The current memory used by the process (Bytes). :rtype: int
autosubmit/profiler/profiler.py:156
↓ 2 callersMethod_get_date
Parses a user defined Date (from [experiment] DATELIST) to return a special String representation of that Date. :param date: String r
autosubmit/job/job_list.py:1773
↓ 2 callersMethod_get_date_member_completed_count
Each item in the job_list must have attributes: date, member, status_str.
autosubmit/history/experiment_history.py:367
↓ 2 callersFunction_get_db_manager
Create a ``db_manager`` with the given parameters.
autosubmit/database/db_structure.py:41
↓ 2 callersMethod_get_defined_queue_name
(self, wrapper_queue, wrapper_code, qos)
autosubmit/history/experiment_history.py:353
↓ 2 callersMethod_get_defined_rowtype
(self, code)
autosubmit/history/experiment_history.py:347
↓ 2 callersMethod_get_job_data_last_by_name
(self, job_name)
autosubmit/history/database_managers/experiment_history_db_manager.py:680
↓ 2 callersMethod_get_jobs_by_name
Return jobs filtered by status and/or platform as names or Job objects. :param status: Optional list of job statuses to filter by. :p
autosubmit/job/job_list.py:3440
↓ 2 callersMethod_get_paramiko_template
(self, snippet: 'TemplateSnippet', template, parameters)
autosubmit/job/job.py:2370
← previousnext →401–500 of 2,688, ranked by callers