MCPcopy Create free account

hub / github.com/BSC-ES/autosubmit / functions

Functions2,688 in github.com/BSC-ES/autosubmit

↓ 2 callersFunction_get_uncommitted_code
Return any uncommitted changes in the given Git repository or submodules. If there are no uncommitted changes, return None. :param git_repo:
autosubmit/git/autosubmit_git.py:49
↓ 2 callersMethod_initialize_variables
Initialize dynamic variables. :returns: A tuple containing the dynamic variables, the regex pattern, and the start index. :r
autosubmit/config/configcommon.py:979
↓ 2 callersMethod_insert_experiment_run
Insert data class ExperimentRun into database
autosubmit/history/database_managers/experiment_history_db_manager.py:327
↓ 2 callersMethod_insert_job_data
Insert data class JobData into job_data table.
autosubmit/history/database_managers/experiment_history_db_manager.py:307
↓ 2 callersMethod_manage_dependencies
(self, sections_dict)
test/unit/test_wrappers.py:2057
↓ 2 callersFunction_match_autosubmit_cmdline
Guess if the command line is for ``autosubmit <COMMAND> <EXPID>``. The function tries to guess it by iterating the list of tokens produced by
autosubmit/helpers/processes.py:53
↓ 2 callersFunction_perform_deletion
Perform the deletion of an experiment, including its directory, structure database, and job data database. :param experiment_path: Path to the ex
autosubmit/experiment/experiment_common.py:233
↓ 2 callersMethod_propagate_inner_jobs_ready_date
Propagate the ready date of the inner jobs to the wrapper job. :param built_packages_tmp: List of built packages.
autosubmit/job/job_packager.py:643
↓ 2 callersMethod_recursion_print
Returns the list of children in a recursive way Traverses the dependency tree :param job: Job object :type job: Job
autosubmit/job/job_list.py:3069
↓ 2 callersMethod_remove_job
Remove a job from the list. :param job: job to remove :type job: Job
autosubmit/job/job_list.py:2907
↓ 2 callersMethod_send_files
Send local files to the platform.
autosubmit/job/job_packages.py:245
↓ 2 callersMethod_send_message
(self, mail_to: list[str], mail_from: str, message)
autosubmit/notifications/mail_notifier.py:219
↓ 2 callersFunction_send_messages
(msg: str)
test/unit/log/test_log.py:352
↓ 2 callersFunction_seq
From: https://pynative.com/python-range-for-float-numbers/
autosubmit/monitor/diagram.py:120
↓ 2 callersMethod_set_historical_pragma_version
Sets the pragma version.
autosubmit/history/database_managers/experiment_history_db_manager.py:426
↓ 2 callersMethod_split_match
Check if job split matches
autosubmit/autosubmit.py:4933
↓ 2 callersMethod_substitute_placeholders
Replace placeholders in the template content. :param content: Template content with placeholders. :type content: str
autosubmit/job/job.py:2439
↓ 2 callersMethod_sync_retrieve_logfiles
Synchronizes the log files. It prepares the log files to be retrieved by writing the jobid to them and compressing them if en
autosubmit/job/job.py:1241
↓ 2 callersMethod_update_config
Updates commonly used composed paths
autosubmit/config/basicconfig.py:88
↓ 2 callersFunction_write_authorized_keys
Write an SSH public key into an ``authorized_keys`` directory inside a container.
test/integration/test_utils/docker.py:241
↓ 2 callersMethodadd_children
Add children for the job. It also adds current job as a parent for all the new children :param children: job's children to add
autosubmit/job/job.py:1042
↓ 2 callersMethodadd_edge_info
Adds edge information to the job :param parent: parent job :type parent: Job :param special_conditions: special vari
autosubmit/job/job.py:1062
↓ 2 callersMethodapply_distribution
(self, job_data_dc, job_data_dcs_in_wrapper, slurm_monitor)
autosubmit/history/strategies.py:75
↓ 2 callersMethodapply_distribution
autosubmit/history/strategies.py:100
↓ 2 callersFunctionas_conf_default_values
Replace default values in as_conf files. :param autosubmit_version: autosubmit version :param exp_id: experiment id :param hpc: platform
autosubmit/utils.py:25
↓ 2 callersMethodbuild_imports
(self)
autosubmit/platforms/wrappers/wrapper_builder.py:73
↓ 2 callersFunctionbuild_legends
build_legends Function :param plot: Subplot arrangement part of a figure :type plot: Any :param rects: A string that contains the legends
autosubmit/monitor/diagram.py:357
↓ 2 callersMethodbuild_message
(self, main_msg, traceback_msg)
autosubmit/history/internal_logging.py:42
↓ 2 callersMethodbuild_vertical_package
Goes through the job and all the related jobs (children, or part of the same date member ordered group), finds those suitable and gro
autosubmit/job/job_packager.py:835
↓ 2 callersMethodcalculate_job_limits
(self,platform,job=None)
autosubmit/job/job_packager.py:498
↓ 2 callersFunctioncalendar_get_month_days
Get the number of days in a month :param date_str: Date in string format (YYYYMMDD) :return: int
autosubmit/job/job_utils.py:73
↓ 2 callersMethodcancel_job
Command to cancel a job. :param job_id: ID of a job. :param job_id: str :return: Cancel job command. :rtype: str
autosubmit/platforms/slurmplatform.py:547
↓ 2 callersMethodcheck_completed_files
Checks for completed files in the remote log directory. This function is used to check inner_jobs of a wrapper. :param sections: Spac
autosubmit/platforms/locplatform.py:323
↓ 2 callersMethodcheck_compressed_local_logs
Checks if the current local log files are compressed versions (.gz or .xz) and updates the local_logs attribute accordingly.
autosubmit/job/job.py:2569
↓ 2 callersMethodcheck_expdef_conf
Checks experiment's experiment configuration file. :param no_log: if True, it doesn't print any log message :type no_log: bool
autosubmit/config/configcommon.py:1497
↓ 2 callersFunctioncheck_experiment_exists
Checks if exist an experiment with the given name. Anti-lock version. :param error_on_inexistence: if True, adds an error log if experime
autosubmit/database/db_common.py:169
↓ 2 callersMethodcheck_remote_log_exists
(self)
autosubmit/job/job.py:1228
↓ 2 callersMethodcheck_scripts
When we have created the scripts, all parameters should have been substituted. %PARAMETER% handlers not allowed. :param as_conf: expe
autosubmit/job/job_list.py:2873
↓ 2 callersMethodcheck_wrapper_stored_status
Check if the wrapper job has been submitted and the inner jobs are in the queue after a load. :param as_conf: A BasicConfig object. :
autosubmit/autosubmit.py:1752
↓ 2 callersMethodcheck_wrappers
Check wrappers and inner jobs status also order the non-wrapped jobs to be submitted by active platforms. :param as_conf: a AutosubmitConfig
autosubmit/autosubmit.py:1710
↓ 2 callersMethodchildren
Returns a list containing all children of the job :return: child jobs :rtype: set
autosubmit/job/job.py:914
↓ 2 callersMethodclean
Clean the experiment directory to save storage space. It removes project directory and outdated plots or stats. When it deletes plot
autosubmit/autosubmit.py:2763
↓ 2 callersMethodclean_dynamic_variables
Resets the local variable of dynamic (or special) variables. The ``pattern`` is used to search for dynamic or special variables (they vary
autosubmit/config/configcommon.py:897
↓ 2 callersMethodclean_log_recovery_process
Cleans the log recovery process variables. This method sets the cleanup event to signal the log recovery process to finish, waits for
autosubmit/platforms/platform.py:836
↓ 2 callersFunctionclean_plot
Function to clean space on BasicConfig.LOCAL_ROOT_DIR/plot directory. Removes all plots except the last two. :param expid: experiment's iden
autosubmit/monitor/monitor.py:270
↓ 2 callersFunctionclean_stats
Function to clean space on BasicConfig.LOCAL_ROOT_DIR/plot directory. Removes all stats' plots except the last two. :param expid: experi
autosubmit/monitor/monitor.py:281
↓ 2 callersMethodclear_generate
(self)
autosubmit/job/job_list.py:304
↓ 2 callersMethodclose_connection
(self)
autosubmit/platforms/paramiko_platform.py:1607
↓ 2 callersMethodcompress_file
Compress a file. :param file_path: file path :return: The path to the compressed file. None if compression failed.
autosubmit/platforms/platform.py:1089
↓ 2 callersMethodconvert_list_to_string
Convert a list to a string
autosubmit/config/configcommon.py:711
↓ 2 callersMethodcopy_as_config
(exp_id, copy_id)
autosubmit/autosubmit.py:1076
↓ 2 callersFunctioncopy_experiment
Creates a new experiment by copying an existing experiment :param version: experiment's associated autosubmit version :type version: str
autosubmit/experiment/experiment_common.py:277
↓ 2 callersFunctioncreate_bar_diagram
create_bar_diagram Function :param expid: str with the id of an experiment :param exp_stats: Statistics of the jobs of the experiment :pa
autosubmit/monitor/diagram.py:212
↓ 2 callersFunctioncreate_csv_stats
create_csv_stats Function :param exp_stats: Statistics of the jobs of the experiment :param jobs_list: List[Job] of jobs in the experiment
autosubmit/monitor/diagram.py:332
↓ 2 callersFunctioncreate_db
Creates a new database for autosubmit :param qry: query to create the new database :type qry: str
autosubmit/database/db_common.py:41
↓ 2 callersMethodcreate_dictionary
(self, date_list, member_list, num_chunks, chunk_ini, date_format, default_retrials,
autosubmit/job/job_list.py:121
↓ 2 callersMethodcreate_exp_status
Create experiment status.
autosubmit/history/database_managers/experiment_status_db_manager.py:97
↓ 2 callersFunctioncreate_job_package_wrapper
(jobs, as_conf)
test/unit/test_job_package.py:85
↓ 2 callersFunctioncreate_job_parameters_platform
( autosubmit_exp, get_next_expid: Callable[[], str])
test/integration/test_paramiko_platform.py:132
↓ 2 callersMethodcreate_new_experiment_run
Also writes the finish timestamp of the previous run.
autosubmit/history/experiment_history.py:309
↓ 2 callersFunctioncreate_required_folders
Create the minimum set of required folders for an Autosubmit experiment. The newly created folders will be relative to the given experiment folde
autosubmit/experiment/experiment_common.py:382
↓ 2 callersFunctioncreate_ssh_keypair_and_config
Sets up ``$HOME/.ssh/config`` file for SSH. Previously, Autosubmit fixtures for containers would mock calls in Autosubmit with ``mocker`` or
test/integration/test_utils/ssh.py:149
↓ 2 callersFunctiondeep_check_all_keys_uppercase
Recursively check if all keys in the nested dictionary are uppercase. :param data: The dictionary to check. :return: True if all keys ar
test/regression/config/test_reload.py:100
↓ 2 callersMethoddelete_details
Delete the details of the experiment from the database.
autosubmit/experiment/detail_updater.py:273
↓ 2 callersMethoddelete_file
Deletes a file from this platform :param filename: file name :type filename: str :return: True if successful or file does not
autosubmit/platforms/paramiko_platform.py:625
↓ 2 callersMethoddelete_parent
Remove a parent from the job :param parent: parent to remove :type parent: Job
autosubmit/job/job.py:1076
↓ 2 callersMethoddelete_where
(self, table_name: str, where: dict[str, Any])
autosubmit/database/db_manager.py:100
↓ 2 callersMethoddetail
(job_list)
autosubmit/autosubmit.py:4495
↓ 2 callersMethoddetect_changes_in_job_list
Detect changes in job_list compared to the current contents of job_data table. Returns a list of JobData data classes where the status of each item i
autosubmit/history/experiment_history.py:332
↓ 2 callersMethodexpid
Creates a new experiment for given HPC. :param description: description of the experiment :type description: str :param hpc:
autosubmit/autosubmit.py:1274
↓ 2 callersMethodexpid_tmp_dir
(exp_id)
autosubmit/config/basicconfig.py:76
↓ 2 callersFunctionfind_uncompressed_files
Return all files that are not compressed with xz in a directory and match the filename with the given regex pattern.
autosubmit/log/utils.py:103
↓ 2 callersFunctionfn
()
test/unit/test_job_list.py:152
↓ 2 callersMethodgenerate_output_stats
Plots stats for joblist and stores it in a file. :param queue_time_fixes: :param expid: experiment's identifier :type expid:
autosubmit/monitor/monitor.py:598
↓ 2 callersMethodgenerate_submit_script
Opens Submit script file.
autosubmit/platforms/platform.py:800
↓ 2 callersMethodget_account_directive
Returns account directive for the specified job :param job: job to create account directive for :type job: Job :param paramet
autosubmit/platforms/headers/slurm_header.py:96
↓ 2 callersMethodget_as_list
(self)
autosubmit/statistics/stats_summary.py:26
↓ 2 callersFunctionget_autosubmit_version
Get the minimum autosubmit version needed for the experiment. Anti-lock version. :param expid: Experiment name :type expid: str :ret
autosubmit/database/db_common.py:229
↓ 2 callersMethodget_checkpoint_files
Check if there is a file on the remote host that contains the checkpoint
autosubmit/job/job.py:465
↓ 2 callersMethodget_chunk_list
Get inner chunk list. :return: chunk list :rtype: list
autosubmit/job/job_list.py:1809
↓ 2 callersMethodget_custom_directives
Returns custom directives for the specified job :param job: job to create custom directive for :type job: Job :param paramete
autosubmit/platforms/headers/slurm_header.py:227
↓ 2 callersMethodget_date_format
(self)
autosubmit/job/job_list.py:1825
↓ 2 callersMethodget_delayed
Returns a list of delayed jobs. :param platform: job platform :type platform: HPCPlatform :return: delayed jobs :rtyp
autosubmit/job/job_list.py:2159
↓ 2 callersMethodget_executable
(language: 'Language')
autosubmit/job/template/__init__.py:40
↓ 2 callersMethodget_git_project_commit
Returns git commit from experiment's config file :return: git commit :rtype: str
autosubmit/config/configcommon.py:2199
↓ 2 callersMethodget_in_queue_grouped_id
Gets the queued jobs, grouped by their IDs. Same ID, same dictionary key. Each dictionary value is a list. :param platform: Optional
autosubmit/job/job_list.py:2308
↓ 2 callersMethodget_job_data_dcs_last_by_wrapper_code
(self, wrapper_code)
autosubmit/history/database_managers/experiment_history_db_manager.py:283
↓ 2 callersMethodget_job_related
:param two_step_start: :param select_jobs_by_name: job name :param select_all_jobs_by_section: section name :param fi
autosubmit/job/job_list.py:2052
↓ 2 callersMethodget_jobs_data_last_row
(self, job_names)
autosubmit/history/database_managers/experiment_history_db_manager.py:859
↓ 2 callersMethodget_jobs_filtered
(self, section, job, filters_to, natural_date, natural_member, natural_chunk, filter
autosubmit/job/job_dict.py:236
↓ 2 callersMethodget_jobs_per_level
List of Lists, index of list is the level.
autosubmit/history/strategies.py:184
↓ 2 callersMethodget_last_retrials
Returns the retrials of a job, including the last COMPLETED run. The selection stops, and does not include when the previous COMPLETED job
autosubmit/job/job.py:1186
↓ 2 callersMethodget_mails_to
Returns the address where notifications will be sent from autosubmit's config file :return: mail address
autosubmit/config/configcommon.py:2752
↓ 2 callersMethodget_max_processors
Returns max processors from autosubmit's config file :rtype: str
autosubmit/config/configcommon.py:2517
↓ 2 callersMethodget_max_waiting_jobs
Returns max number of waiting jobs from autosubmit's config file :return: main platforms :rtype: int
autosubmit/config/configcommon.py:2524
↓ 2 callersMethodget_memory_directive
Returns memory directive for the specified job :param job: job to create memory directive for :type job: Job :param parameter
autosubmit/platforms/headers/slurm_header.py:152
↓ 2 callersMethodget_memory_per_task_directive
Returns memory per task directive for the specified job :param job: job to create memory per task directive for :type job: Job
autosubmit/platforms/headers/slurm_header.py:171
↓ 2 callersMethodget_mp_context
()
autosubmit/platforms/platform.py:908
↓ 2 callersMethodget_new_remotelog_name
Checks if remote log file exists on remote host if it exists, remote_log variable is updated :param
autosubmit/job/job.py:1213
↓ 2 callersMethodget_nodes_directive
Returns nodes directive for the specified job :param job: job to create nodes directive for :type job: Job :param parameters:
autosubmit/platforms/headers/slurm_header.py:133
← previousnext →501–600 of 2,688, ranked by callers