Build dependency maps and populate the dependency graph for all jobs. Iterate experiment `JOBS` sections to: - build deep dependency

Aggregate jobs by section.

Attach a file to a message. The attachment file name will be the same name of the ``file_path``. :param file_path: The path of the file to b

Calculate dependencies that has any kind of filter set and add them to the graph if they're necessary. :param filters_to_apply: Filters to ap

Calculate natural dependencies and add them to the graph if they're necessary. :param dic_jobs: JobList :param job: Current job

Check if a job has a checkpoint. :param job: The job to check.

Checks if exist an experiment with the given name. :param error_on_inexistence: if True, adds an error log if experiment does not exist

This will check if the job is running longer than the wallclock was set to be run. :param job: The inner job of a job. :type job: Job

Update previous status of a job and updating the job to a new status. If the platform being used is slurm the function will get the status of

:param ssh_output: ssh output :type ssh_output: str

Validates that the checksum of the local file matches the checksum of the remote file. :param local_path: Path to the local file. :pa

Compress a file. The file is created inside the given temporary directory. The function returns a ``Path`` of the archive file. :param

Copy YAML files used by this reStructuredText documentation into the Autosubmit experiment. This experiment is the one being currently used by th

Count the number of completed and non-completed parents. :param job: The job to check. :param target_status: The target stat

creates a database files with full permissions

Create the Postgres tables (not really the database). This function is the equivalent to the old ``create_db`` function for SQLite, with the

Using the list of jobs provided, creates clones of these jobs and modifies names conditioned on job.date, job.member values (testing None).

Start a Docker container with Git. The repository will be available with the base name of the path given, with the TCP/80 port mapped to the

Create a mocked job whose data is merged with the dict provided (as kwargs?). Similar to JavaScript's ``Object.assign()``. :param job_data:

Create jobs to be run once :param section: section to read :type section: str :param priority: priority for the jobs

Create new experiment_run row and return the new Models.ExperimentRun data class from database.

Create and start a Slurm container with TestContainers. The container is created with a label that can be used to later retrieve the containe

Create and start a Docker SSH container for SSH.

Deletes autosubmit calculated variables from a yaml data. :param yaml_data: dict with yaml data :return: None

Returns a dict() with as many keys as 'jobs_list' different sections The value for each key is a list() with all the jobs with the ke

Filter jobs by chunks. :param filter_chunk_str: filter chunks :param job_list: JobList object :param matching_jobs: list of j

Filter jobs by sections and splits. :param filter_section_splits: filter sections and splits :param jobs: list of jobs :return

Generate email body for the experiment status notification. :param exp_id: The experiment id. :type exp_id: str :param platform: The plat

Generate email body to notify about status change. :param exp_id: The experiment id. :type exp_id: str :param job_name: The name of the j

Generates an ed25519 private/public key pair and saves them as ``path{|.pub}``.

Get List of Models.JobDataRow for last=1.

Get List of Models.JobDataRow for last=1.

Function to get a list of chunks from json. :param out: json member definition :type out: str :return: list of chunks

Get the section host. If ``add_project_to_host`` is ``False`` we return the section host provided, stripping spaces (from head and tail).

Get List of Models.JobDataRow for last=1 and rowtype=wrapper_code

Get List of Models.JobDataRow for last=1 and rowtype=wrapper_code

Return a list of jobs data.

Retrieve keys for dynamic variable substitution. :param dynamic_var: The dynamic variable tuple containing the placeholder and its v

Function to get a list of members from json. :param out: json member definition :type out: str :return: list of members

Return the counter attribute from the latest job data row by job_name.

Traverse jobs defined in jobs configurations.

Traverse used platforms and then look for serial platforms.

Get the substituted value for a dynamic variable in the key. :param key: The key containing the dynamic variable. :type key:

Return a dictionary with the jobs grouped by section.

Initialize the platform file descriptor poller.

This calculates if the job is over its wallclock time, which indicates that a jobs is running for too long. :param start_time: When a job sta

Determines if a job is wrappable. Basically, the job shouldn't have been packed already and the status must be READY or WAITING, Its

Receives job data and returns the data from its TOTAL_STATS file in an ordered way. :param status_code: Status of job :type status_co

Load the SSH configuration for Paramiko. If the given path exists, the SSH configuration object is created and loaded from that file. Otherw

Manage job dependencies for a given job and update the dependency graph. :param dic_jobs: Helper containing generated jobs and configuration.

Match the expected experiment ID, or use a regex to match any. >>> _match_expid('123456') False >>> _match_expid('a000') True >>>

Moves latest image produced with the ``runcmd`` directive to the Sphinx build directory. In case an Autosubmit experiment ends up with many image

Normalize the dependencies to a consistent format. This function takes a string or dictionary of dependencies and normalizes them to

Normalize the JOBS_IN_WRAPPER field for a wrapper. Ensure the wrapper includes a non-empty list of valid job section names, optionall

Normalize the NOTIFY_ON section to a consistent format.

Normalize the wallclock time format in the job configuration. This method iterates through the jobs in the provided data dictionary

Parse a date from int to datetime. :param timestamp: time to be converted :return: return time converted

Print the database check results.

Process and substitute dynamic variables in the given parameters. This method iterates over the dynamic variables and substitutes th

Function return True if a job was cancelled for a listed reason. :param reason: Reason of a job to be cancelled :return: True if a jo

Recovers the log name for the job from the filesystem. :return: True if the log name was already recovered, False otherwise :

Function to print the final report into the stdout, log and filesystem.

Uses the existing ``runcmd`` directive to execute a command that produces images. :param command: Command to execute.