featurewiz

Featurewiz is a new python library for selecting the best features in your data set fast! (featurewiz logo created using Wix)

Two methods are used in this version of featurewiz:

1. SULOV -> SULOV means Searching for Uncorrelated List of Variables. The SULOV method is explained in this chart below

2. Recursive XGBoost: Once SULOV has selected variables that have high mutual information scores with least less correlation amongst them, we use XGBoost to repeatedly find best features among the remaining variables after SULOV.

3. Most variables are included: It automatically detects types of variables in your data set and converts them to numeric except date-time, NLP and large-text variables.

4. Feature Engineering: You can add as many variables as you want and as the last step before modeling, you can perform feature selection with featurewiz

To upgrade to the best, most stable and full-featured version always do the following:

Use $ pip install featurewiz --upgrade --ignore-installed

or pip install git+https://github.com/AutoViML/featurewiz.git

Table of Contents

• Background
• Install
• Usage
• Tips for using Auto_ViML
• API
• Maintainers
• Contributing
• License

Background

Watch this video video

featurewiz was designed for selecting High Performance variables with the fewest steps.

In most cases, featurewiz builds models with 20%-99% fewer features than your original data set with nearly the same or slightly lower performance (this is based on my trials. Your experience may vary).

featurewiz is every Data Scientist's feature wizard that will:

1. Automatically pre-process data: you can send in your entire dataframe as is and featurewiz will classify and change/label encode categorical variables changes to help XGBoost processing. That way, you don't have to preprocess your data before using featurewiz
2. Assists you with variable classification: featurewiz classifies variables automatically. This is very helpful when you have hundreds if not thousands of variables since it can readily identify which of those are numeric vs categorical vs NLP text vs date-time variables and so on.
3. Performs feature reduction automatically. When you have small data sets and you know your domain well, it is easy to perhaps do EDA and identify which variables are important. But when you have a very large data set with hundreds if not thousands of variables, selecting the best features from your model can mean the difference between a bloated and highly complex model or a simple model with the fewest and most information-rich features. featurewiz ViML uses XGBoost repeatedly to perform feature selection. You must try it on your large data sets and compare!
4. Produces SULOV method graphically using networkx library so you can see which variables are highly correlated to which ones and which of those have high or low mutual information scores automatically. Just set verbose = 2

featurewiz is built using xgboost, numpy, pandas and matplotlib. It should run on most Python 3 Anaconda installations. You won't have to import any special libraries other than "XGBoost" and "networkx" library. We use "networkx" library for interpretability. But if you don't have these libraries, featurewiz will install those for you automatically. ## Install **Prerequsites:** - [Anaconda](https://docs.anaconda.com/anaconda/install/) To clone featurewiz, it is better to create a new environment, and install the required dependencies: To install from PyPi:

conda create -n <your_env_name> python=3.7 anaconda
conda activate <your_env_name> # ON WINDOWS: `source activate <your_env_name>`
pip install autoviml
or
pip install git+https://github.com/AutoViML/featurewiz.git

To install from source:

cd <AutoVIML_Destination>
git clone git@github.com:AutoViML/featurewiz.git
# or download and unzip https://github.com/AutoViML/featurewiz/archive/master.zip
conda create -n <your_env_name> python=3.7 anaconda
conda activate <your_env_name> # ON WINDOWS: `source activate <your_env_name>`
cd Auto_ViML
pip install -r requirements.txt

## Usage In the same directory, open a Jupyter Notebook and use this line to import the .py file:

from featurewiz import featurewiz

Load a data set (any CSV or text file) into a Pandas dataframe and give it the name of the target(s) variable. If you have more than one target, it will handle multi-label targets too. Just give it a list of variables in that case. If you don't have a dataframe, you can simply enter the name and path of the file to load into featurewiz:

features = featurewiz(
    dataname,
    target,
    corr_limit=0.7,
    verbose=0,
)

Finally, it returns the list of variables selected. This list is ready for you to now to do further modeling. featurewiz works on any Multi-Class, Multi-Label Data Set. So you can have as many target labels as you want. You don't have to tell featurwiz whether it is a Regression or Classification problem. It will decide that automatically. ## API **Arguments** - `dataname`: could be a datapath+filename or a dataframe. It will detect whether your input is a filename or a dataframe and load it automatically. - `target`: name of the target variable in the data set. - `corr_limit`: if you want to set your own threshold for removing variables as highly correlated, then give it here. The default is 0.7 which means variables less than -0.7 and greater than 0.7 in pearson's correlation will be candidates for removal. - `verbose`: This has 3 possible states: - `0` limited output. Great for running this silently and getting fast results. - `1` more verbiage. Great for knowing how results were and making changes to flags in input. - `2` SULOV charts and output. Great for finding out what happens under the hood for SULOV method. **Return values** - `features`: the fewest number of features in your model to make it perform well ## Maintainers * [@AutoViML](https://github.com/AutoViML) ## Contributing See [the contributing file](CONTRIBUTING.md)! PRs accepted. ## License Apache License 2.0 © 2020 Ram Seshadri ## DISCLAIMER This project is not an official Google project. It is not supported by Google and Google specifically disclaims all warranties as to its quality, merchantability, or fitness for a particular purpose.