I had prepared a project on making a software application. It is complete and working fine except that the speed of execution is very slow.. I have taken several chunks of code and optimized it..
I tried psyco.. ie I installed psyco and added two lines on the top of my code
import psyco
psyco.full()
Don’t know whether this is the way using psyco.. if this is wrong. Please tell me how to use psyco.. because I added this and found no improvement..
I have tried profiling and I know the code lines taking time but these can’t be further optimized and are unavoidable line of code..
I also thought of option of rewriting the code in ‘c’ using some python package.. but I always had a very bad experience in using additional package of python which are not part of basic python..
I am using python 2.6 and windows vista.. please kindly tell methods method for increasing the speed of execution of the whole code significantly.. at least 5x times.. please..
I haven’t written my code in method, there few method in between thou.. there is no main..
Yes as few suggested my is an IO bound problem.. as I need to call the code some 500 times and this involves opening and closing of files of at least 2 per call..
And here when opening a .pm file, it has two columns and I need the first columns only, so I am copying the entire first columns into the list and passing it to a function to get its row number and then opening other file to get the elements of that row number into a list…
This is the task I wanted… I guess loading the elements of first columns into the list is time consuming any idea to rectify this..
How can I improve the performance for IO bound bottlenecks
Looking for help desperately
You could get a lot better performance if you could switch to binary file formats. Most of your code is doing parsing and string manipulation. You’re doing a lot of converting strings to floats, which is slower than you think.