Question

I am using the explorer feature for classification. My .arff data file has 10 features of numeric and binary values; (only the ID of instances is nominal).I have abt 16 instances. The class to predict is Yes/No.i have used Naive bayes but i cantnot interpret the results,,does anyone know how to interpret results from naive Bayes classification?

Answer 1

Naive Bayes doesn’t select any important features. As you mentioned, the result of the training of a Naive Bayes classifier is the mean and variance for every feature. The classification of new samples into ‘Yes’ or ‘No’ is based on whether the values of features of the sample match best to the mean and variance of the trained features for either ‘Yes’ or ‘No’.

You could use others algorithms to find the most informative attributes. In that case you might want to use a decision tree classifier, e.g. J48 in WEKA (which is the open-source implementation of C4.5 decision tree algorithm). The first node in the resulting decision tree tells you which feature has the most predictive power.

Even better (as stated by Rushdi Shams in the other post); Weka’s Explorer offers purpose build options to find the most useful attributes in a dataset. These options can be found under the Select attributes tab.