Question

I want to know whether Artificial Neural Networks can be applied to discrete values inputs? I know they can be applied to continuous valued inputs, but can they be applied to discrete valued ones? Also, will perform well for discrete valued inputs?

Answer 1

Well, good question let me say!

First of all let me answer directly yes to your question!

The answer implies to consider few aspects about the use and the implementation of the network itself.

Than let me explain why:

• The easiest way is to normalize input as usual, this is the first rule of thumb with NN,
  than let the neural network compute the task, and once you have your output, invert the normalization to get the output in the original range but still continuous, to get back descrete values just consider the integer part of your output. It is easy, it works and is fine, DONE! A good result just depends on the topology you design for you network.

As a plus you could consider the use of “step” transfer function, instead of “tan-sigmoid”, between layers just to strenght and mimic a sort of digitization forcing the output to be just 0 or 1. But you should reconsider also the starting normalization as well as the use of well tuned thresholds.

NB: this latter trick is not really necessary but could give some secondary benefits; maybe test it in a second stage of your development and look at the differences.

PS: Just let me suggest something that should apply to your issue; if you would be smart take into account the use of some fuzzy logic on your learning algorithm 😉

Cheers!