Question

I have a zillion files in a directory I want a script to run on. They all have a filename like: prefix_foo_123456_asdf_asdfasdf.csv. I know how to loop over files in a directory using a variable in the filename in shell but not python. Is there a corresponding way to do something like

$i=0

for $i<100

./process.py prefix_foo_$i_*

$i++

endloop

Answer 1

use the standard library glob. Assuming the functionality of process.py is in the function process_one_file:

from glob import glob
from process import process_one_file

for i in range(100):
    process_one_file(glob('prefix_foo_{}_*'.format(i)))