Wrap the given object :param wrapped: the object to wrap :param retry_if: a method that takes an exception, and returns whet

All runners take the following keyword arguments: :type mr_job_script: str :param mr_job_script: the path of the ``.py`` file contain

Entry point for running your job from other Python code. You can pass in command-line arguments, and the job will act the same way it

:py:class:`~mrjob.emr.EMRJobRunner` takes the same arguments as :py:class:`~mrjob.runner.MRJobRunner`, plus some additional options wh

Make an :py:class`UploadDirManager`. :param string prefix: The URI for the directory (e.g. `s3://bucket/dir/`).

:py:class:`~mrjob.dataproc.DataprocJobRunner` takes the same arguments as :py:class:`~mrjob.runner.MRJobRunner`, plus some additional

Create a Spark runner. :param max_output_files: limit on number of output files when running streaming jobs.

Create a Hadoop filesystem :param hadoop_bin: ``hadoop`` binary, as a list of args. If set to ``None``, we'll auto

:param ssh_bin: path to ``ssh`` binary :param ec2_key_pair_file: path to an SSH keyfile :param ssh_add_bin: path to ``ssh-add

Create a mock version boto3 EMR clients. By default, jobs will run to conclusion, and if their output dir is on S3, create a single e

Create a mock bucket with the given name and client

Mock out connection to IAM. mock_iam_instance_profiles maps profile name to a dict containing: create_date -- ISO creation dateti

Return a (possibly empty) list of parsed commands (in the same format as returned by parse_setup_cmd())

Add a custom check for S3 paths to ensure they're not in Glacier (which causes a cryptic error). See #1887.

Don't try to run steps that include commands.

Don't try to run steps that include commands or use manifests.

Return a copy of ``self._opts['cmdenv']``. This exists so we can instrument cmdenv in runner subclasses.

Blank out overriden *instance_fleets* and *instance_groups* Convert image_version of 4.x and later to release_label.

Propagate *instance_type* to other instance type opts, if not already set. Also propagate core instance type to task instance type, i

Blank out conflicts between *network*/*subnet* and *region*/*zone*.

Decorate a function used to call a command. If you don't set *description*, it won't be included in help (useful for deprecated commands).

In container IDs, a unique number for the task assigned to the container. Could be a map, a reduce, or part of a Spark task; YARN doesn't care

Always return *sys.executable*, if defined

Dump sys.stdin to a local file, and return the path to it.