Home/ Questions/Q 7850779
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-06-02T18:58:03+00:00

I have more then 100 CSV files which have 10000 row which I am

  • 0

I have more then 100 CSV files which have 10000 row which I am indexing. And then querying for spelling is similar spelling. While doing this Indexing is very slow.

I have found some good solutions

  1. Master-slave where master Index’s and slave is used for query. How to index records in Solr faster (and not impact ColdFusion web server)? Two JVM?

  2. Using Tri-Range http://www.lucidimagination.com/blog/2009/05/13/exploring-lucene-and-solrs-trierange-capabilities/

I know these two solutions are different I wanted some comments which should be higher priority ? Does the second solution fit to my problem ? And if there exits more solutions to my spell check problem.

Thanks in advance

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    Indexing will usually make queries slow. If you have fast disks, indexing will use 100% of CPU, otherwise, it will use 100% of disk bandwidth. Either way, queries will be slow.

    A master/slave configuration is the standard solution for this. The slave servers are dedicated to search queries. The only time they slow down is after a replication, when new Searchers with new caches are created.

    A master/slave configuration may not make indexing much faster, but it will avoid slow query performance. There has been work on making indexing multithreaded, so you may want to test multiple indexing tasks at once. This won’t help if the bottleneck is disk IO, only if it is using 100% of one CPU.

    Trie fields are great for range queries. I doubt they will have much affect on indexing speed.

    Finally, you may want to tune your spelling suggestion options. Spelling suggestion can be a lot of work, and you may be able to get good results with different, less expensive, options.

    • 0