MCPcopy Create free account

hub / github.com/BSC-ES/autosubmit / functions

Functions2,688 in github.com/BSC-ES/autosubmit

↓ 6 callersFunctionpopulate_statistics
( jobs_list: List[Job], period_ini: datetime, period_fi: datetime, queue_time_
autosubmit/monitor/diagram.py:126
↓ 6 callersFunctionprepare_scratch
Create an isolated experiment using a temporary directory for each test. :param tmp_path: Temporary directory unique to the test. :type
test/integration/commands/run/conftest.py:43
↓ 6 callersMethodprocess_status_changes
Detect status differences between job_list and current job_data rows, and update. Creates a new run if necessary.
autosubmit/history/experiment_history.py:235
↓ 6 callersMethodread_section
Read a section from jobs conf and creates all jobs for it :param default_job_type: default type for jobs :type default_job_t
autosubmit/job/job_dict.py:68
↓ 6 callersMethodreset_status_file
Configure the file to store the log. If another file was specified earlier, new messages will only go to the new file. :para
autosubmit/log/log.py:299
↓ 6 callersMethodreset_table
Drops and recreates the database.
autosubmit/job/job_package_persistence.py:95
↓ 6 callersMethodts_to_datetime
(timestamp)
autosubmit/job/job_list.py:3397
↓ 5 callersMethod_check_dates
Check if the current_job_value is included in the filter_from and retrieve filter_to value :param relationships: Remaining filters to
autosubmit/job/job_list.py:691
↓ 5 callersFunction_check_parents_array
(job, assertions, jobs)
test/unit/test_job.py:1554
↓ 5 callersMethod_check_running_jobs
Get all jobs that are not "COMPLETED" or "FAILED". For each of the jobs still not completed that are still running a command will be
autosubmit/job/job.py:3046
↓ 5 callersFunction_delete_expid
Removes an experiment from the path and database. If the current user is eadmin and the -f flag has been sent, it deletes regardless of experiment
autosubmit/experiment/experiment_common.py:161
↓ 5 callersFunction_get_experiment_data
(tmp_path)
test/integration/test_expid.py:502
↓ 5 callersFunction_get_project_entity
Return a ``SoftwareSourceCode``, a specialized object from ``CreativeEntity`` that contains a ``codeRepository`` property that points to the l
autosubmit/provenance/rocrate.py:207
↓ 5 callersFunction_get_status
Return the status of the job.
autosubmit/monitor/diagram.py:440
↓ 5 callersMethod_init_local_x11_display
Initialize the X11 display on this platform.
autosubmit/platforms/paramiko_platform.py:1727
↓ 5 callersMethod_load_parameters
Add parameters from configuration files into platform objects, and into the job_list object. :param as_conf: Basic configuration handler.\n
autosubmit/autosubmit.py:1385
↓ 5 callersMethod_normalize_to_filters
Normalize filter_to filters to a single string or "all" :param filter_to: Unified filter_to dictionary :param filter_type: "D
autosubmit/job/job_list.py:835
↓ 5 callersMethod_parse_filters_to_check
(list_of_values_to_check, value_list=[], level_to_check="DATES_FROM")
autosubmit/job/job_list.py:512
↓ 5 callersMethod_update_job_data_by_id
Update job_data table with data class JobData. Update last, submit, start, finish, modified, job_id, status, energy, extra_data, nnod
autosubmit/history/database_managers/experiment_history_db_manager.py:349
↓ 5 callersMethodas_body
The script body. :param body: The script body. In a shell template, for instance, it would be the complete Bash script that the u
autosubmit/job/template/common.py:42
↓ 5 callersMethodas_header
The Autosubmit header. :param platform_header: The platform header. A platform such as Slurm, for instance, may offer extra heade
autosubmit/job/template/common.py:34
↓ 5 callersMethodas_tailer
The Autosubmit tailer. The tailer plays crucial role as it must create the ``_COMPLETED`` file. Tailer code is only executed
autosubmit/job/template/common.py:53
↓ 5 callersMethodbuild_nodes_list
(self)
autosubmit/platforms/wrappers/wrapper_builder.py:84
↓ 5 callersFunctioncancel_jobs
Cancel jobs on platforms. It receives a list ``active_jobs_filter`` of statuses to filter jobs for their statuses, and the ones that pass the
autosubmit/job/job_utils.py:432
↓ 5 callersFunctioncheck_ancestors_array
(job, assertions, jobs)
test/unit/test_job.py:1549
↓ 5 callersMethodcheck_packages_respect_wrapper_policy
Check if the packages respect the wrapper policy and act in base of it ( submit wrapper, submit sequential, wait for more jobs to form a wrap
autosubmit/job/job_packager.py:235
↓ 5 callersMethodclone_repository
Clones a specified git repository on the project folder :param as_conf: experiment configuration :type as_conf: autosubmit.c
autosubmit/git/autosubmit_git.py:156
↓ 5 callersFunctioncreate_git_repository
Creates a Git repository. Creates the directory if it does not exist. :param path: Path to the Git repository. :param bare: Flag to make
test/integration/test_utils/git.py:39
↓ 5 callersMethodcreate_parser
(self)
autosubmit/config/yamlparser.py:26
↓ 5 callersMethoddatabase_fix
Database methods. Performs a sql dump of the database and restores it. :param expid: experiment identifier :type expid: str :
autosubmit/autosubmit.py:3949
↓ 5 callersMethoddeep_parameters_export
Export all variables of this experiment. Resultant format will be Section.{subsections1...subsectionN} = Value. In other words, it pla
autosubmit/config/configcommon.py:2066
↓ 5 callersFunctiondelete_lock_file
Delete lock file if it exists. Suppresses permission errors raised. :param base_path: Base path to locate the lock file. Defaults to the experime
autosubmit/scripts/autosubmit.py:35
↓ 5 callersMethodgenerate_output_txt
Function that generates a representation of the jobs in a txt file :param classictxt: :param path: :param expid: expe
autosubmit/monitor/monitor.py:538
↓ 5 callersMethodgenerate_scripts_andor_wrappers
:param as_conf: Class that handles basic configuration parameters of Autosubmit. \n :type as_conf: AutosubmitConfig() Object \n
autosubmit/autosubmit.py:1581
↓ 5 callersMethodget_active
Returns a list of active jobs (In platforms queue + Ready). :param wrapper: :param platform: job platform :type platform: HPC
autosubmit/job/job_list.py:2241
↓ 5 callersMethodget_calculated_weights_of_jobs_in_wrapper
Based on computational weight: running time in seconds * number of cpus.
autosubmit/history/strategies.py:62
↓ 5 callersMethodget_check_job_cmd
Returns command to check job status on remote platforms. :param job_id: id of job to check :return: command to check job status
autosubmit/platforms/paramiko_platform.py:1079
↓ 5 callersMethodget_chunk_ini
Returns the first chunk from where the experiment will start :param default: :return: initial chunk :rtype: int
autosubmit/config/configcommon.py:2332
↓ 5 callersMethodget_completed
Returns a list of completed jobs :param wrapper: :param platform: job platform :type platform: HPCPlatform :return: c
autosubmit/job/job_list.py:1847
↓ 5 callersMethodget_experiment_status_row_by_exp_id
Get Models.ExperimentStatusRow from as_times.db by exp_id (int).
autosubmit/history/database_managers/experiment_status_db_manager.py:88
↓ 5 callersMethodget_job_data_max_counter
Get the maximum counter value from the `job_data` table. If a `job_name` is provided, the query will filter by that specific job name
autosubmit/history/database_managers/experiment_history_db_manager.py:402
↓ 5 callersMethodget_member_list
Returns members list from experiment's config file :return: experiment's members :rtype: list
autosubmit/config/configcommon.py:2363
↓ 5 callersMethodget_nodes
(self)
autosubmit/platforms/wrappers/wrapper_builder.py:773
↓ 5 callersMethodget_num_chunks
Returns number of chunks to run for each member :return: number of chunks :rtype: int
autosubmit/config/configcommon.py:2324
↓ 5 callersMethodget_prepared
Returns a list of prepared jobs. :param platform: job platform :type platform: HPCPlatform :return: prepared jobs :rt
autosubmit/job/job_list.py:2147
↓ 5 callersMethodget_safetysleeptime
Returns safety sleep time from autosubmit's config file. :return: safety sleep time :rtype: int
autosubmit/config/configcommon.py:2540
↓ 5 callersMethodget_submodules_list
Returns submodules list from experiment's config file. Default is --recursive. Can be disabled by setting the configuration k
autosubmit/config/configcommon.py:2215
↓ 5 callersMethodload_config_file
Load a config file and parse it :param current_folder_data: current folder data :param yaml_file: yaml file to load :param loa
autosubmit/config/configcommon.py:722
↓ 5 callersMethodmove_file
Moves a file on the platform. :param src: source name :type src: str :param dest: destination name :type dest: str
autosubmit/platforms/platform.py:594
↓ 5 callersMethodnotify_experiment_status
(implementation, exp_id, notify_to="",platform="")
autosubmit/notifications/notifier.py:28
↓ 5 callersMethodparse_all_jobs_output
(self, output, job_id)
autosubmit/platforms/ecplatform.py:45
↓ 5 callersMethodparse_data_loops
This function, looks for the FOR keyword, to generates N amount of subsections of the same section. Looks for the "NAME" keyword, inside this
autosubmit/config/configcommon.py:822
↓ 5 callersMethodprepare_process
(self)
autosubmit/platforms/platform.py:884
↓ 5 callersMethodprint_with_status
Returns the string representation of the dependency tree of the Job List. :param status_change: List of changes in the list, supplied in set
autosubmit/job/job_list.py:3004
↓ 5 callersMethodprovenance
Create the experiment provenance archive. :param expid: experiment identifier :type expid: str :param rocrate: flag to enable
autosubmit/autosubmit.py:4074
↓ 5 callersMethodrecovery
Recover job statuses for an experiment and update the job list. Return True when the recovery completed successfully. :param expid:
autosubmit/autosubmit.py:2844
↓ 5 callersMethodset_console_level
Sets log level for logging to console. Every output of level equal or higher to parameter level will be printed on console :param le
autosubmit/log/log.py:330
↓ 5 callersFunctionsetup_jobs
(dummy_jobs, new_platform_mock)
test/unit/test_overwallclock.py:93
↓ 5 callersFunctionuser_yes_no_query
Utility function to ask user a yes/no question. :param question: question to ask :return: True if answer is yes, False if it is no
autosubmit/helpers/utils.py:318
↓ 4 callersMethod__getstate__
(self)
autosubmit/job/job.py:163
↓ 4 callersMethod__init__
(self, historiclog_dir_path=DEFAULT_HISTORICAL_LOGS_DIR)
autosubmit/history/strategies.py:45
↓ 4 callersMethod__read_file_config
Reads configuration file. If configuration file dos not exist in given path, no error is raised. Configuration options also are not r
autosubmit/config/basicconfig.py:97
↓ 4 callersMethod_add_edges_map_info
Special relations to be check in the update_list method. :param job: Current job :param special_status: :return:
autosubmit/job/job_list.py:937
↓ 4 callersMethod_calculate_dependency_metadata
Compute the target chunk, member, and date for a dependency with a +/- distance. Compute the target chunk, member, and date for a dependency
autosubmit/job/job_list.py:1485
↓ 4 callersFunction_create_db_manager
(db_path: Path)
test/integration/database/test_db_manager.py:34
↓ 4 callersFunction_create_formal_parameter
Create a ``FormalParameter``. The ID's of ``FormalParameter``s must start with `#` since these are "internal" contextual entities.
autosubmit/provenance/rocrate.py:259
↓ 4 callersFunction_create_job_data_dc
(_id, name)
test/unit/history/test_strategies_straight_wrapper.py:30
↓ 4 callersFunction_create_job_data_dc
(_id, name)
test/unit/history/test_single_association_strategy.py:30
↓ 4 callersMethod_create_json
Function to parse rerun specification from json format. :param text: text to parse :type text: str :return: parsed output
autosubmit/autosubmit.py:5383
↓ 4 callersFunction_display_file
Display a file for the user. The file is displayed using the user-preferred application. This is achieved first checking if the user is on Li
autosubmit/monitor/monitor.py:98
↓ 4 callersMethod_filter_current_job
This function will filter the current job based on the relationships given. :param current_job: Current job to filter :param relation
autosubmit/job/job_list.py:886
↓ 4 callersFunction_get_experiment_data
(tmp_path)
test/integration/git/test_autosubmit_git.py:38
↓ 4 callersMethod_get_from_stat
Returns value from given row index position in STAT file associated to job. :param index: Row position to retrieve. :type in
autosubmit/job/job.py:1103
↓ 4 callersMethod_get_submitter
Returns the submitter corresponding to the communication defined on autosubmit's config file.
autosubmit/autosubmit.py:5378
↓ 4 callersMethod_insert_job_data
(self, job_data)
autosubmit/history/database_managers/experiment_history_db_manager.py:743
↓ 4 callersMethod_normalize_auto_keyword
Normalize the 'auto' keyword in the dependency relationships for a job. This function adjusts the 'SPLITS_TO' value in the dependency relatio
autosubmit/job/job_list.py:1263
↓ 4 callersMethod_normalize_wrappers_section
Normalize the WRAPPERS section to a consistent format so there is no issues during runtime. :param data_fixed: The input data dictionary to no
autosubmit/config/configcommon.py:575
↓ 4 callersMethod_requested_exit
(code, d)
autosubmit/autosubmit.py:3619
↓ 4 callersMethod_unify_to_filters
Unify all filter_to filters into a single dictionary ( of current selection ). :param filter_to_apply: Filters to apply :return: Sing
autosubmit/job/job_list.py:855
↓ 4 callersMethodbuild_horizontal_package
(self, horizontal_vertical=False,wrapper_info=[])
autosubmit/job/job_packager.py:991
↓ 4 callersMethodbuild_job
(self, section, priority, date, member, chunk, default_job_type, section_data, splits=1, split=-1)
autosubmit/job/job_dict.py:553
↓ 4 callersMethodcalculate_statistics
(self)
autosubmit/statistics/statistics.py:62
↓ 4 callersMethodcalculate_summary
(self)
autosubmit/statistics/statistics.py:94
↓ 4 callersMethodcheck_absolute_file_exists
(self, src)
autosubmit/platforms/paramiko_platform.py:1674
↓ 4 callersMethodcheck_completion
Fetches the COMPLETED file from the platform and to COMPLETED if *COMPLETED* file exists and to FAILED otherwise. :param over_wallclock:
autosubmit/job/job.py:1518
↓ 4 callersMethodcheck_jobs_conf
Checks experiment's jobs configuration file. :param no_log: if True, it doesn't print any log message :type no_log: bool :retu
autosubmit/config/configcommon.py:1429
↓ 4 callersMethodcheck_logs_status
(job_list: "JobList", as_conf, new_run)
autosubmit/autosubmit.py:2043
↓ 4 callersMethodcheck_remote_log_dir
Creates log dir on remote host
autosubmit/platforms/pjmplatform.py:229
↓ 4 callersMethodconstruct_real_additional_file_name
Constructs the real name of the file to be sent to the platform. :param file_name: The name of the file to be sent. :type fi
autosubmit/job/job.py:2497
↓ 4 callersFunctioncreate_experiment_status_db_manager
Creates a Postgres or SQLite database manager based on the Autosubmit configuration. Note that you must provide the options even if they are opti
autosubmit/history/database_managers/experiment_status_db_manager.py:216
↓ 4 callersFunctioncreate_job_and_update_parameters
(autosubmit_config, experiment_data, platform_type="ps")
test/unit/test_job.py:1143
↓ 4 callersFunctioncreate_job_list
Create a mocked job list for the job_utils tests.
test/unit/job/test_job_utils.py:51
↓ 4 callersFunctionfilter_by_time_period
Filter the list of jobs using the specified time period. The time period is used to compute the start time. It subtracts the given time perio
autosubmit/statistics/utils.py:46
↓ 4 callersMethodget_all
Returns a list of all jobs. :param wrapper: :param platform: job platform :type platform: HPCPlatform :return: all jo
autosubmit/job/job_list.py:1980
↓ 4 callersMethodget_call
Gets execution command for given job. :param job_script: script to run :param job: job :param export: :param timeout:
autosubmit/platforms/paramiko_platform.py:1474
↓ 4 callersMethodget_completed_failed_without_logs
Returns a list of completed or failed jobs without updated logs. :return: List of completed and failed jobs without updated logs.
autosubmit/job/job_list.py:1863
↓ 4 callersFunctionget_current_datetime_if_none
Returns the current time in format '%Y-%m-%d-%H:%M:%S' if the supplied argument is None, else return argument.
autosubmit/history/utils.py:50
↓ 4 callersMethodget_file_jobs_conf
Returns path to project config file from experiment config file :return: path to project config file :rtype: str
autosubmit/config/configcommon.py:2175
↓ 4 callersMethodget_file_project_conf
Returns path to project config file from experiment config file :return: path to project config file :rtype: str
autosubmit/config/configcommon.py:2167
↓ 4 callersMethodget_git_project_branch
Returns git branch from experiment's config file :return: git branch :rtype: str
autosubmit/config/configcommon.py:2191
← previousnext →201–300 of 2,688, ranked by callers