Question

Here is the example:
I am trying to grab a series of XML pages, and then extract data from them.

It downloads each individual page, as the while loop was designed to do but the tester() function prints the data from the first file it downloads V number of times despite it downloading and clearing the file after each time it loops through.

This is killing me what am I doing wrong?

def tester():
    with open('raw.txt') as myFile:
        test = linecache.getline('raw.txt', 12)
        print test
        test = ""
        myFile.close

def grab_data(Year, rcvote):
    link = "XXX/%s/roll%s.xml" % (Year, rc)
    site = urllib2.urlopen(link)
    localFile = open('raw.txt', 'w')
    localFile.write(site.read(100000))
    localFile.close()
    tester()


while (V !=0):
    rc = str(V)
    if (len(rc) == 2):
        rc = "0%s" % (rc)
    elif (len(rc) == 1):
        rc = "00%s" % (rc)
    else:
        rc = rc
    grab_data(Year, rc)
    V = V - 1

Answer 1

The problem is the linecache module. It assumes that same-named files are the same.

But why write the data to a file just to read it again anyway?

def tester(text):
    line12 = text.splitlines()[11]
    print line12

def grab_data(year, rcvote):
    link = "XXX/%s/roll%03d.xml" % (year, rcvote)
    site = urllib2.urlopen(link)
    tester(site.read(100000))

while v:
    grab_data(year, rc)
    v -= 1