Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/Yelp/mrjob
/ functions
Functions
4,468 in github.com/Yelp/mrjob
⨍
Functions
4,468
◇
Types & classes
673
↳
Endpoints
1
↓ 1 callers
Method
mock_path_matches
(self)
tests/logs/test_task.py:287
↓ 1 callers
Method
mock_path_matches
(self)
tests/logs/test_spark.py:214
↓ 1 callers
Method
monkey_patch_getuser
(self)
tests/test_runner.py:119
↓ 1 callers
Function
mrjob_packages
the mrjob package and its subpackage, in sorted order
tests/test_setup_dot_py.py:55
↓ 1 callers
Function
next_mock_hadoop_counters
Read the next set of counters from the filesystem, and delete it. If no counters available, return {}
tests/mockhadoop.py:169
↓ 1 callers
Function
populate_option_lists
(app, doctree, fromdocname)
docs/options_extension.py:309
↓ 1 callers
Function
pre_filter
(line)
mrjob/logs/step.py:233
↓ 1 callers
Method
put
(self, src, path)
mrjob/fs/composite.py:150
↓ 1 callers
Method
put
Uploads a local file to a specific destination. .. versionchanged:: 0.7.0 removed *chunk_size* arg (use *part_size* in
mrjob/fs/gcs.py:219
↓ 1 callers
Function
receive_poor_mans_scp
Mock SSH behavior for uploading SSH key with sh -c "cat ..."
tests/mockssh.py:126
↓ 1 callers
Method
remove_time_tzset
(self)
tests/test_job.py:213
↓ 1 callers
Method
render_combiner
(self)
mrjob/step.py:295
↓ 1 callers
Method
render_mapper
(self)
mrjob/step.py:292
↓ 1 callers
Method
render_reducer
(self)
mrjob/step.py:298
↓ 1 callers
Function
replace_optionlinks_with_links
(app, doctree, fromdocname)
docs/options_extension.py:406
↓ 1 callers
Function
resolve_pending_xref
(app, fromdocname, node)
docs/options_extension.py:92
↓ 1 callers
Method
resource
(self, service_name, **kwargs)
tests/mock_boto3/case.py:258
↓ 1 callers
Method
restore_environment
(self)
tests/test_runner.py:115
↓ 1 callers
Method
restore_getuser
(self)
tests/test_runner.py:131
↓ 1 callers
Method
restore_os_pathsep
(self)
tests/test_conf.py:621
↓ 1 callers
Method
restore_time_tzset
(self)
tests/test_job.py:218
↓ 1 callers
Method
rm_tmp_dir
(self)
tests/test_util.py:185
↓ 1 callers
Method
rm_tmp_dir
(self)
tests/tools/emr/test_s3_tmpwatch.py:39
↓ 1 callers
Function
run
Execute a command as a "host." Recursively call for worker if necessary.
tests/mockssh.py:177
↓ 1 callers
Method
run_combiner
Run the combiner for the given step. :type step_num: int :param step_num: which step to run (0-indexed) If we encounter a li
mrjob/job.py:763
↓ 1 callers
Method
run_job
Run the all steps of the job, logging errors (and debugging output if :option:`--verbose` is specified) to STDERR and streaming the ou
mrjob/job.py:618
↓ 1 callers
Method
run_spark
Run the Spark code for the given step. :type step_num: int :param step_num: which step to run (0-indexed) Called from :py:me
mrjob/job.py:896
↓ 1 callers
Method
setUp
(self)
tests/test_util.py:400
↓ 1 callers
Method
setUp
(self)
tests/test_sim.py:339
↓ 1 callers
Method
setUp
(self)
tests/test_pool.py:103
↓ 1 callers
Method
setUp
(self)
tests/test_compat.py:35
↓ 1 callers
Method
setUp
(self)
tests/logs/test_task.py:132
↓ 1 callers
Method
setUp
(self)
tests/tools/emr/test_report_long_jobs.py:238
↓ 1 callers
Method
setUp
(self)
tests/tools/emr/test_terminate_idle_clusters.py:45
↓ 1 callers
Method
setUp
(self)
tests/fs/test_hadoop.py:38
↓ 1 callers
Method
setUp
(self)
tests/fs/test_local.py:29
↓ 1 callers
Method
setUp
(self)
tests/fs/test_s3.py:32
↓ 1 callers
Method
set_os_pathsep
(self)
tests/test_conf.py:617
↓ 1 callers
Method
set_up_mock_ssh
(self)
tests/fs/test_ssh.py:36
↓ 1 callers
Function
setup
(app)
docs/options_extension.py:70
↓ 1 callers
Method
setup_tmp_dir
(self)
tests/test_util.py:162
↓ 1 callers
Method
spark_args
Redefine this to pass custom arguments to Spark.
mrjob/job.py:491
↓ 1 callers
Function
standardize_phone_number
put *number* in a standard format, and convert it to a :py:class:`str`.
mrjob/examples/mr_phone_to_url.py:55
↓ 1 callers
Method
steps
(self)
mrjob/examples/mr_phone_to_url.py:75
↓ 1 callers
Method
steps
(self)
tests/test_sim.py:57
↓ 1 callers
Method
steps
(self)
tests/mr_tower_of_powers.py:60
↓ 1 callers
Method
steps
(self)
tests/test_runner.py:1030
↓ 1 callers
Function
subcommand_line
(name)
mrjob/cmd.py:39
↓ 1 callers
Method
submit_job
(self, project_id, region, job)
tests/mock_google/dataproc.py:273
↓ 1 callers
Method
tearDown
(self)
tests/test_emr.py:1454
↓ 1 callers
Method
test_counters
(self)
tests/test_dataproc.py:1482
↓ 1 callers
Method
test_hadoop_anything_home
(self)
tests/test_hadoop.py:231
↓ 1 callers
Method
test_hadoop_anything_home
(self)
tests/fs/test_hadoop.py:300
↓ 1 callers
Method
test_hadoop_home
(self)
tests/test_hadoop.py:146
↓ 1 callers
Method
test_hadoop_home_envvar
(self)
tests/fs/test_hadoop.py:272
↓ 1 callers
Method
test_hadoop_install
(self)
tests/test_hadoop.py:159
↓ 1 callers
Method
test_hadoop_install
(self)
tests/fs/test_hadoop.py:275
↓ 1 callers
Method
test_hadoop_install_hadoop_subdir
(self)
tests/fs/test_hadoop.py:278
↓ 1 callers
Method
test_hadoop_mapred_home
(self)
tests/test_hadoop.py:172
↓ 1 callers
Method
test_hadoop_prefix
(self)
tests/test_hadoop.py:133
↓ 1 callers
Method
test_hadoop_prefix
(self)
tests/fs/test_hadoop.py:269
↓ 1 callers
Method
test_infer_from_hadoop_bin_parent_dir
(self)
tests/test_hadoop.py:189
↓ 1 callers
Method
test_path
(self)
tests/fs/test_hadoop.py:281
↓ 1 callers
Method
test_progress
(self)
tests/test_dataproc.py:1449
↓ 1 callers
Method
time_mock_cluster_idle
(self, mock_cluster)
tests/tools/emr/test_terminate_idle_clusters.py:357
↓ 1 callers
Function
to_dict_key
Recursively convert lists to tuples. This only looks into lists, which seems to be good enough for testing
tests/job.py:33
↓ 1 callers
Method
upload_file
(self, path, Config=None)
tests/mock_boto3/s3.py:332
↓ 1 callers
Method
upload_from_filename
(self, filename)
tests/mock_google/storage.py:176
↓ 1 callers
Function
yield_record_strings
(lines)
mrjob/logs/history.py:360
↓ 1 callers
Function
yield_records
()
mrjob/logs/step.py:236
↓ 1 callers
Function
yield_records
()
mrjob/logs/spark.py:32
↓ 1 callers
Function
zip_dir
Compress the given *dir* into a zip file at *out_path*. If we encounter symlinks, include the actual file, not the symlink. :type dir: str
mrjob/util.py:388
Function
_IDENTITY_MAPPER
(key, value)
mrjob/step.py:79
Function
_IDENTITY_REDUCER
(key, values)
mrjob/step.py:84
Method
__call__
(self, parser, namespace, value, option_string=None)
mrjob/options.py:97
Method
__call__
(self, parser, namespace, value, option_string=None)
mrjob/options.py:110
Method
__call__
(self, parser, namespace, value, option_string=None)
mrjob/options.py:118
Method
__call__
(self, parser, namespace, value, option_string=None)
mrjob/options.py:142
Method
__call__
(self, parser, namespace, value, option_string=None)
mrjob/options.py:154
Method
__call__
(self, parser, namespace, value, option_string=None)
mrjob/options.py:164
Method
__call__
(self, parser, namespace, value, option_string=None)
mrjob/options.py:174
Method
__call__
(self, parser, namespace, value, option_string=None)
mrjob/options.py:191
Method
__call__
(self, parser, namespace, value, option_string=None)
mrjob/options.py:212
Method
__call__
(self, parser, namespace, value, option_string=None)
mrjob/options.py:225
Method
__call__
(self, parser, namespace, values, option_string=None)
mrjob/options.py:1716
Method
__enter__
Don't do anything special at start of with block
mrjob/runner.py:671
Method
__eq__
(self, other)
mrjob/step.py:255
Method
__eq__
(self, other)
mrjob/step.py:397
Method
__eq__
(self, other)
mrjob/conf.py:98
Method
__exit__
Call self.cleanup() at end of with block.
mrjob/runner.py:675
Method
__getattr__
The glue that makes functions retriable, and returns other attributes from the wrapped object as-is.
mrjob/retry.py:87
Method
__getattr__
(self, name)
mrjob/fs/composite.py:42
Method
__getattr__
(self, key)
tests/mock_boto3/s3.py:355
Method
__getitem__
(self, key)
mrjob/step.py:258
Method
__hash__
(self)
mrjob/conf.py:104
Method
__init__
:py:class:`~mrjob.inline.InlineMRJobRunner` takes the same keyword args as :py:class:`~mrjob.runner.MRJobRunner`. However, please note
mrjob/inline.py:58
Method
__init__
(self, **kwargs)
mrjob/bin.py:97
Method
__init__
:py:class:`~mrjob.hadoop.HadoopJobRunner` takes the same arguments as :py:class:`~mrjob.runner.MRJobRunner`, plus some additional options
mrjob/hadoop.py:141
Method
__init__
Initialize a reason for step failure. :param string reason: brief explanation of which step failed :param int step_num: which step fa
mrjob/step.py:99
Method
__init__
(self, **kwargs)
mrjob/step.py:208
← previous
next →
1,201–1,300 of 4,468, ranked by callers