Home/ Questions/Q 419955
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-12T18:49:43+00:00

I am building out some reporting stuff for our website (a decent sized site

  • 0

I am building out some reporting stuff for our website (a decent sized site that gets several million pageviews a day), and am wondering if there are any good free/open source data warehousing systems out there.

Specifically, I am looking for only something to store the data–I plan to build a custom front end/UI to it so that it shows the information we care about. However, I don’t want to have to build a customized database for this, and while I’m pretty sure an SQL database would not work here, I’m not sure what to use exactly. Any pointers to helpful articles would also be appreciated.

Edit: I should mention–one DB I have looked at briefly was MongoDB. It seems like it might work, but their “Use Cases” specifically mention data warehousing as “Less Well Suited”: http://www.mongodb.org/display/DOCS/Use+Cases . Also, it doesn’t seem to be specifically targeted towards data warehousing.

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    http://www.hypertable.org/ might be what you are looking for is (and I’m going by your descriptions above here) something to store large amounts of logged data with normalization. i.e. a visitor log.

    Hypertable is based on google’s bigTable project.
    see http://code.google.com/p/hypertable/wiki/PerformanceTestAOLQueryLog for benchmarks

    you lose the relational capabilities of SQL based dbs but you gain a lot in performance. you could easily use hypertable to store millions of rows per hour (hard drive space withstanding).

    hope that helps

    • 0