Home/ Questions/Q 7686713
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-31T19:32:31+00:00

I used nutch 1.4 and crawled a website. I got the website crawled successfully

  • 0

I used nutch 1.4 and crawled a website.
I got the website crawled successfully and all the pages were dumped into segments.
I merged all the segments to one segment and then i used readseg command to obtain a text version of all the crawled pages.
Now I need to find out, URL of page and the meta data stored in that page.
I don’t know which command to use or shall i need to do something different.

Have made a lot of efforts on google Some people said that you have to write a separate plugin for it. Can someone tell me please.

Thanks a lot 🙂 🙂

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    Finally, I am able to do it. Sharing in case someone else needs it.
    You can use index-metatags plugin provided here:
    http://wiki.apache.org/nutch/IndexMetatags

    It will solve this problem
    Cheers 🙂

    • 0