Question

I have a CSV file containing some user data it looks like this:

"10333","","an.10","Kenyata","","Aaron","","","","","","","","","",""
"12222","","an.4","Wendy","","Aaron","","","","","","","","","",""
"14343","","aaron.5","Nanci","","Aaron","","","","","","","","","",""

I also have a file which has an item on each line like this:

an.10
arron.5

What I want is to find only the lines in the CSV file contained in the list file.

So desired output would be:

"10333","","an.10","Kenyata","","Aaron","","","","","","","","","",""
"14343","","aaron.5","Nanci","","Aaron","","","","","","","","","",""

(Note how an.4 is not contained in this new list.)

I have any environment available to me and am willing to try just about anything aside from manually doing so as this csv contains millions of records and there are about 100k entries in the list itself.

Answer 1

How unique are the identifiers an.10 and the like?

Maybe a very small *x shell script would be enough:

for i in $(uniq list.txt); do grep "\"$i\"" data.csv; done

That would, for every unique entry in the list, return all matching lines in the csv file. It does not match exclusively on the second column however. (That could be done with awk for example)