I’m making a wiki with Ruby and Sinatra and need to search the wiki’s that are stored as text files with markup in a few HTML-renderers (redcarpet, markdown, creole, slim, haml..).
You have a lot of options in Ruby like ferret, solr or lucene gems that handle structured data in a database but not for searching files with free text.
For now I open the text files and search with a regExp but as the wiki’s grow that will soon be too slow. Are there any gems that index all the text files in a map and which index I can then use to search the files? It needs to be a Ruby only solution or something that can be easily used from Ruby.
I’m not using one of the common wiki’s since none has the features I need.
I do use windows indexing service in a few old ASP apps but I’m far from satisfied with that solution.
My OS’es are Windows Vista, 7 and Windows Server 8.
EDIT: a no database installation needed/no keep server running solution is preferable, so eg with sqlite or file besed storage or something like that
Personally I would choose ElasticSearch: http://www.elasticsearch.org/
It’s very easy to get running, and there are some gems for which make it really easy to communicate with it from Ruby ( for instance tire)
I’m not aware of any performant text-file-based full-search engines, so I’d really think that you would be best of by looking for a simple server, which ElasticSearch provides imho.