Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/Atomu2014/Ads-RecSys-Datasets
/ functions
Functions
40 in github.com/Atomu2014/Ads-RecSys-Datasets
⨍
Functions
40
◇
Types & classes
7
↓ 9 callers
Method
feature_to_hdf
convert lib-svm feature files into hdf5 files (tables). using static method is for consistence with multi-processing version, wh
datasets/Dataset.py:92
↓ 6 callers
Method
bin_count
count positive/negative samples :param hdf_data_dir: :param file_prefix: see this param in feature_to_hdf() :param n
datasets/Dataset.py:113
↓ 4 callers
Method
generator
should be accessed only in private :param X: :param y: :param batch_size: :param shuffle: :return
datasets/Dataset.py:312
↓ 3 callers
Method
batch_generator
(self, kwargs)
datasets/Dataset.py:213
↓ 2 callers
Method
_files_iter_
(self, gen_type='train', shuffle_block=False)
datasets/Criteo_all.py:264
↓ 2 callers
Method
_files_iter_
iterate among hdf files(blocks). when the whole data set is finished, the iterator restarts from the beginning, thus the data st
datasets/Dataset.py:155
↓ 2 callers
Method
get_length_and_feature_number
Get the min_length max_length and max_feature of data. :param file_name: The file name of input data. :return: the tuple (min
datasets/iPinYou.py:129
↓ 2 callers
Method
raw_to_feature
(self, raw_file, input_feat_file, output_feat_file)
datasets/Avazu.py:61
↓ 2 callers
Method
raw_to_feature
(self, key, input_feat_file, output_feat_file)
datasets/Criteo.py:77
↓ 2 callers
Method
raw_to_feature
Transfer the raw data to feature data. using static method is for consistence with multi-processing version, which can not be pa
datasets/iPinYou.py:75
↓ 1 callers
Method
__iter__
:param gen_type: 'train', 'valid', or 'test'. the valid set is partitioned from train set dynamically :param batch_size: :p
datasets/Dataset.py:216
↓ 1 callers
Method
down_sample
(self, f)
datasets/Criteo_all.py:217
↓ 1 callers
Method
load_data
(self, gen_type='train', num_workers=1, task_index=0)
datasets/Criteo_all.py:277
↓ 1 callers
Method
load_data
(self, gen_type='train', num_workers=1, task_index=0)
datasets/Dataset.py:176
↓ 1 callers
Function
multi_proc
(npart, pre_proc=null_func, part_job=null_func, post_proc=null_func, **kwargs)
datasets/multi_proc.py:8
↓ 1 callers
Function
pre_proc
(npart, **kwargs)
datasets/criteo_multi_proc.py:30
↓ 1 callers
Method
split_pos_neg
should be access only in private :param X: :param y: :return:
datasets/Dataset.py:333
Method
__init__
(self, initialized=True, num_of_days=9)
datasets/Criteo_all.py:31
Method
__init__
(self, initialized=True)
datasets/Avazu.py:34
Method
__init__
collect meta information, and produce hdf files if not exists :param initialized: write feature and hdf files if True
datasets/Criteo.py:36
Method
__init__
collect meta information, and produce hdf files if not exists :param initialized: write feature and hdf files if True
datasets/iPinYou.py:35
Method
__init__
(self, dataset, kwargs)
datasets/Dataset.py:10
Method
__init__
(self, initialized=True)
datasets/Criteo_Challenge.py:41
Method
__iter__
(self, gen_type='train', batch_size=None, shuffle_block=False, random_sample=False, split_fields=False,
datasets/Criteo_all.py:324
Method
__iter__
(self)
datasets/Dataset.py:14
Method
__str__
(self)
datasets/Dataset.py:345
Method
_iter_
()
datasets/Criteo_all.py:328
Method
_iter_
()
datasets/Dataset.py:232
Function
as_dataset
(data_name, initialized=True)
datasets/__init__.py:9
Method
batch_generator
(self, kwargs)
datasets/Criteo_all.py:321
Method
batch_size
(self)
datasets/Dataset.py:19
Method
gen_type
(self)
datasets/Dataset.py:23
Function
null_func
(npart, **kwargs)
datasets/multi_proc.py:4
Method
output
(cur_index, X, y)
datasets/Criteo_all.py:168
Method
output
(cur_index, X, y)
datasets/Criteo_Challenge.py:74
Function
part_job
(kwargs)
datasets/criteo_multi_proc.py:37
Method
raw_to_feature
this method should be override :return:
datasets/Dataset.py:84
Method
summary
(self)
datasets/Criteo_all.py:253
Method
summary
summarize the data set. :return:
datasets/Dataset.py:136
Method
val_ratio
(self)
datasets/Dataset.py:27