Question

Basically I am not going to post all of the code here but I will provide a generic example. I have a class that has a function to run and create a large array of values. This array shouldn’t be much bigger than 10MB from my estimates. Within the functions it makes new and modifies arrays that should be collected up after the functions within train run. They are not used elsewhere besides the returned tempArray which is put into the large array. This is repeated. The memory used just keeps growing and growing. Is there an issue with my code or a way around this. I have read here about memory leaks with the malloc in Linux:
http://pushingtheweb.com/2010/06/python-and-tcmalloc/.

Answer 1

What are you trying to do?

temp = self.largeArray = zeros((1000,1000,10,20))
for y in temp.size:
    for x in temp1.size:
        self.largeArray[x,y] = train()

temp.size equals 200,000,000. How can you store anything into largeArray[x,y] if the second dimension of this array is only 1000?