Question

Imagine several folders such as

d:\myfolder\abc
d:\myfolder\ard 
d:\myfolder\kjes
...

And in each folder, there are files such as

0023.txt, 0025.txt, 9932.txt in d:\myfolder\abc
2763.txt, 1872.txt, 0023.txt, 7623.txt in d:\myfolder\ard
2763.txt, 2873.txt, 0023.txt in d:\myfolder\kjes

So, there are three 0023.txt files, and two 2763.txt files.

I want to create a file (say, d:\myfolder\dup.txt) which contains the following information:

0023 3
0025 1
9932 1
2763 2
1872 1
7623 1
2873 1

How can I implement that in Python? Thanks.

Answer 1

Not extensively tested, but this works:

import os, os.path

dupnames={}
for root, dirs, files in os.walk('myfolder'):
    for file in files:
        fulpath=os.path.join(root,file)
        if file in dupnames:
            dupnames[file].append(fulpath)
        else:
            dupnames[file]=[fulpath]

for name in sorted(dupnames):
    print name, len(dupnames[name])

This works in the following way:

1. Creates an empty dict;
2. Walks the file hierarchy;
3. Creates a entries in a dict of lists (or append an existing list) with the base name: [path to file].

After the os.walk you will have a dict like so:

{0023.txt: ['d:\myfolder\abc', 'd:\myfolder\kjes'], 0025.txt: ['d:\myfolder\abc']}

So to get your output, just iterate over the sorted dict and count the entries in the list. You can either redirect the output of this to a file or open your output file directly in Python.

You show your output with the extension stripped — 0023 vs 0023.txt. What should happen if you have 0023.txt and 0023.py? Same file or different? To the OS they are different files so I kept the extension. It is easily stripped if that is your desired output.