Question

I’m using the following command to extract distinct urls that contain .com extension and may contain .us or whatever country extension.

 grep '\.com' source.txt -m 700 | uniq | sed -e 's/www.//' 
> dest.txt

The problem is that, it extracts urls in the same doamin, the thing tht I don’t want. Ex:
abc.yahoo.com
efg.yahoo.com

I only need the yahoo.com. How can I using grep or any other command extract distinct domain names only ?

Answer 1

Maybe something like this?

egrep -io '[a-z0-9\-]+\.[a-z]{2,3}(\.[a-z]{2})?' source.txt