Home/ Questions/Q 794735
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-14T22:21:42+00:00

I am consuming various XML-over-HTTP web services returning large XML files (> 2MB). What

  • 0

I am consuming various XML-over-HTTP web services returning large XML files (> 2MB). What would be the fastest ruby http library to reduce the ‘downloading’ time?

Required features:

  • both GET and POST requests

  • gzip/deflate downloads (Accept-Encoding: deflate, gzip) – very important

I am thinking between:

  • open-uri

  • Net::HTTP

  • curb

but you can also come with other suggestions.

P.S. To parse the response, I am using a pull parser from Nokogiri, so I don’t need an integrated solution like rest-client or hpricot.

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    http://github.com/pauldix/typhoeus

    might be worth checking out. It’s designed for large and fast parallel downloads and is based on libcurl so it is pretty solid.

    That said, test Net::HTTP and see if the performance is acceptable before doing something more complicated.

    • 0