Question

Any ideas on how EdgeNgram treats numbers?

I’m running haystack with an ElasticSearch backend. I created an indexed field of type EdgeNgram. This field will contain a string that may contain words as well as numbers.

When I run a search against this field using a partial word, it works how it’s supposed to. But if I put in a partial number, I’m not getting the result that I want.

Example:

I search for the indexed field “EdgeNgram 12323” by typing “edgen” and I’ll get the index returned to me. If I search for that same index by typing “123” I get nothing.

Thoughts?

Answer 1

if you’re using the edgeNGram tokenizer, then it will treat “EdgeNGram 12323” as a single token and then apply the edgeNGram’ing process on it. For example, if min_grams=1 max_grams=4, you’ll get the following tokens indexed: [“E”, “Ed”, “Edg”, “Edge”]. So I guess this is not what you’re really looking for – consider using the edgeNGram token filter instead:

If you’re using the edgeNGram token filter, make sure you’re using a tokenizer that actually tokenizes the text “EdgeNGram 12323” to produce two tokens out of it: [“EdgeNGram”, “12323”] (standard or whitespace tokenizer will do the trick). Then apply the edgeNGram filter next to it.

In general, edgeNGram will take “12323” and produce tokens such as “1”, “12”, “123”, etc…