Question

what is the best method using ruby/mechanize/nokogiri to go/click through all pages in case there is more than 1 page I need to access/click on? For example here Page 1 of 34 Should I click the page number or next? Or is out there any better solution?

Answer 1

It looks like the link “>” takes you to the next page, and it does not appear if you are on the last page. So:

page = ... # fetch the first page
loop do
  # process the page
  break unless link = page.link_with(:text=>'>')
  page = link.click
end