Home/ Questions/Q 9012951
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-06-16T03:07:46+00:00

I’m attempting to scrape a page that has about 10 columns using Ruby and

  • 0

I’m attempting to scrape a page that has about 10 columns using Ruby and Nokogiri, with most of the columns being pretty straightforward by having unique class names. However, some of them have class ids that seem to have long number strings appended to what would be the standard class name.

For example, gametimes are all picked up with .eventLine-time, team names with .team-name, but this particular one has, for example: 

<div class="eventLine-book-value" id="eventLineOpener-118079-19-1522-1">-3&nbsp;-120</div>

.eventLine-book-value is not specific to this column, so it’s not useful. The 13 digits are different for every game, and trying something like:

def nodes_by_selector(filename,selector)
file = open(filename)
doc = Nokogiri::HTML(file)
doc.css(^selector)
end

Has left me with errors. I’ve seen ^ and ~ be used in other languages, but I’m new to this and I have tried searching for ways to pick up all data under id=eventLineOpener-XXXX to no avail.

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    To pick up all data under id=eventLineOpener-XXXX, you need to pass 'div[id*=eventLineOpener]' as the selector:

    def nodes_by_selector(filename,selector)
  file = open(filename)
  doc = Nokogiri::HTML(file)
  doc.css(selector)  #doc.css('div[id*=eventLineOpener]')
end

    The above method will return you an array of Nokogiri::XML::Element objects having id=eventLineOpener-XXXX.

    Further, to extract the content of each of these Nokogiri::XML::Element objects, you need to iterate over each of these objects and use the text method on those objects. For example:

    doc.css('div[id*=eventLineOpener]')[0].text
    • 0