Question

I want to extract unique characters from files (UTF-8, contains asian characters)

I almost reach my goal but I still miss some points.

Step 1: Put everything in one file.

find ./ -name "*.ext" -exec cat {} > out.txt \;

Step 2: Delete line breaks:

cat out.txt |tr "\n" " ">i.txt

Step 3: ?

I think I should sort it by unique characters, but the sort function is only for lines and not characters.

Any help? Thanks

It could be great if I could write this command in one line!

Answer 1

This is a simple 1-liner in awk

awk '{for(i=1;i<=NF;i++)if(!a[$i]++)print $i}' ORS= FS= *.ext

Note: Remove the ORS= part if you want each character on its own line