Home/ Questions/Q 6679055
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-26T04:18:54+00:00

I am doing machine learning in java using GATE Learning. I have a huge

  • 0

I am doing machine learning in java using GATE Learning. I have a huge data set of documents to learn from. While using netbeans, I was getting java heap space error. So I provided 1600MB in the -Xmx parameter. Now, I do not get the heap space error but it takes ample of time to run!! (runs for 90 mins and I had to stop the process since I lost my patience!).

I do not understand whether I should increase my RAM(currently 4GB) or upgrade my OS(currently XP SP3, I have heard vista and win 7 better utilize RAM and Processor) or upgrade my processor(currently Dual Core E5500 2.80 GHz)?

Please throw some insight into what I can do to make this process run faster!

Thanks Rishabh

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    Before you can answer what will make it run faster, you have to find the bottleneck.

    I’m not very familiar with Windows, but there is some sort of system load monitoring widget, IIRC.

    What I would do is as follows:

    • Create some datasets of increasing sizes (more documents)
    • Run your program against those datasets
    • On each run, work out if the CPU maxes out, or if the memory maxes out and starts swapping, or if the whole thing is IO bound

    Then fix the one that is causing the problem.

    Just for context, it’s not that unusual for ML algorithms to take a long time to run on large data sets. You can use the above approach to plot out the run time as the size of the input datasets increase, at least then you’ll know if your program would have stopped in 100 minutes or 100 centuries.

    • 0