Question

Does anyone know of an available PHP function that takes a piece of text, with say a few hundreds of words long and produces an array of keywords? Ie. the most important, frequently occuring unique terms?

Thanks
Philip

Answer 1

No such function exists (would be magical if it did) but to start something off, you could do the following:

1. Split the text at the space,
   producing an array of words.
2. Remove stop-words and
   unnecessary punctuation and symbols (possibly using regular expressions – See preg_replace).
3. Count the number of occurences of
   each word in the remaining array,
   and sort it in order of frequency
   (so the most frequently occuring word is at the first offset, i.e. $words[0]).
4. Use array_unique to remove the
   duplicates, thus producing an array
   of unique keywords ordered by
   frequency of occurrence.