Home/ Questions/Q 8039441
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-06-05T03:34:16+00:00

I’m interested in finding the subject or topic of random webpages and linking this

  • 0

I’m interested in finding the subject or topic of random webpages and linking this to an entity in an RDF database such as dbpedia. I wondered if there are any tools/libraries to do this or if anyone has tried to do anything like this before?

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    Finding the subject of a webpage is probably closest to Automatic Summarization (see the homonymous Wikipedia page). One of the subtasks used for that is Keyphrase Extraction (KE). KE will return substrings (phrases) from the input text that are important/prominent/relevant to that text item. If you assume that named entities are usually key to the subject of your input text, then Named Entity Recognition (NER) would be another possible subtask for what you want. NER will return the substrings that are names of entities, alongside the type of the entity.

    From your description, it seems that you are looking for more than just KE or NER, as you mention linking to a knowledge base (KB) such as DBpedia. A tool called DBpedia Spotlight does exactly that. You can configure it to find every DBpedia resource in the input text, or only keyphrases, only named entities, etc. All of that while linking to DBpedia in the end. Check it out: http://spotlight.dbpedia.org

    There are other tools like AlchemiAPI, Zemanta, WikiMachine, Evri, HeadUp, Enrycher, etc. But as far as I know, DBpedia Spotlight is the only one that is free, open source (Apache V2) and allows you to configure the behavior of the phrase recognition and disambiguation alike.
    (Disclaimer: I am co-creator of DBpedia Spotlight)

    • 0