MCPcopy Create free account
hub / github.com/dask/dask / drop_duplicates

Method drop_duplicates

dask/dataframe/dask_expr/_collection.py:4322–4342  ·  view source on GitHub ↗
(
        self,
        ignore_index=False,
        split_every=None,
        split_out=True,
        shuffle_method=None,
        keep="first",
    )

Source from the content-addressed store, hash-verified

4320 return uniqs.size
4321
4322 def drop_duplicates(
4323 self,
4324 ignore_index=False,
4325 split_every=None,
4326 split_out=True,
4327 shuffle_method=None,
4328 keep="first",
4329 ):
4330 shuffle_method = _get_shuffle_preferring_order(shuffle_method)
4331 if keep is False:
4332 raise NotImplementedError("drop_duplicates with keep=False")
4333 return new_collection(
4334 DropDuplicates(
4335 self,
4336 ignore_index=ignore_index,
4337 split_out=split_out,
4338 split_every=split_every,
4339 shuffle_method=shuffle_method,
4340 keep=keep,
4341 )
4342 )
4343
4344 @insert_meta_param_description(pad=12)
4345 def apply(self, function, *args, meta=no_default, axis=0, **kwargs):

Callers 15

nuniqueMethod · 0.95
test_merge_after_renameFunction · 0.95
test_split_everyFunction · 0.95
merge_chunkFunction · 0.45
_get_categoriesFunction · 0.45
_get_categories_aggFunction · 0.45
_nunique_df_chunkFunction · 0.45
most_recent_tail_summaryFunction · 0.45
most_recent_head_summaryFunction · 0.45
_lowerMethod · 0.45
drop_duplicatesMethod · 0.45
test_disk_shuffleFunction · 0.45

Calls 3

new_collectionFunction · 0.90
DropDuplicatesClass · 0.90

Tested by 15

test_merge_after_renameFunction · 0.76
test_split_everyFunction · 0.76
test_disk_shuffleFunction · 0.36
test_task_shuffleFunction · 0.36
test_task_shuffle_indexFunction · 0.36
test_drop_duplicatesFunction · 0.36
test_drop_duplicatesFunction · 0.36