Method getSparsityStats

JSAT/src/jsat/DataSet.java:799–812

Returns statistics on the sparsity of the vectors in this data set. Vectors that are not considered sparse will be treated as completely dense, even if zero values exist in the data. @return an object containing the statistics of the vector sparsity

()

     * @return an object containing the statistics of the vector sparsity
     */
    public OnLineStatistics getSparsityStats()
    {
        OnLineStatistics stats = new OnLineStatistics();
        for(int i = 0; i < getSampleSize(); i++)
        {
            Vec v = getDataPoint(i).getNumericalValues();
            if(v.isSparse())
                stats.add(v.nnz() / (double)v.length());
            else
                stats.add(1.0);
        }
        
        return stats;
    }

    /**
     * This method returns the weight of each data point in a single Vector.