I just wondered why is the % correctly classified differs from the Explorer and Experimenter aspects of Weka. I have checked to ensure I am employing 10-cross fold validation as well as all other paramaters!
Anyone have any ideas?
Thanks
Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
I have the solution, as provided by Mark Hall, as I emailed him on the Weka Mail list. Here is the difference between Explorer and Experimenter:
The Experimenter operates differently from the Explorer. The Explorer
sums evaluation metrics over the folds of the cross validation – e.g.
percent correct is computed by summing all the correctly classified
instances over the test folds and then dividing by the total number of
instances. The Experimenter, on the other hand, computes averages over
the folds. Furthermore, the default in the Experimenter is to run 10
repetitions of 10-fold cross-validation (so 100 folds are averaged over).