Sign Up

Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.

Have an account? Sign In

Have an account? Sign In Now

Sign In

Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.

Sign Up Here

Forgot Password?

Don't have account, Sign Up Here

Forgot Password

Lost your password? Please enter your email address. You will receive a link and will create a new password via email.

Have an account? Sign In Now

You must login to ask a question.

Forgot Password?

Need An Account, Sign Up Here

Please briefly explain why you feel this question should be reported.

Please briefly explain why you feel this answer should be reported.

Please briefly explain why you feel this user should be reported.

Sign InSign Up

The Archive Base

The Archive Base Logo The Archive Base Logo

The Archive Base Navigation

  • Home
  • SEARCH
  • About Us
  • Blog
  • Contact Us
Search
Ask A Question

Mobile menu

Close
Ask a Question
  • Home
  • Add group
  • Groups page
  • Feed
  • User Profile
  • Communities
  • Questions
    • New Questions
    • Trending Questions
    • Must read Questions
    • Hot Questions
  • Polls
  • Tags
  • Badges
  • Buy Points
  • Users
  • Help
  • Buy Theme
  • SEARCH
Home/ Questions/Q 49159
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Editorial Team
Asked: May 10, 20262026-05-10T16:23:35+00:00 2026-05-10T16:23:35+00:00

We have some very large data files (5 gig to 1TB) where we need

  • 0

We have some very large data files (5 gig to 1TB) where we need quick read/write access. Since we have a fixed record size it seems like some form of ISAM would be the way to go. But would be happy to hear other suggestions.

Ideally the solution would have an Apache or LGPL style license but we will pay if we have to.

Must haves:

Scalable – over at least 1 TB files
Stable – either doesn’t corrupt data or has fast recovery process
Runs well on X64 Windows

Nice to have:

Can participate in 2 phase commits
Intrinsic compression facilities
Portable to *nix platforms
C# API or Java API

Thanks,

Terence

  • 1 1 Answer
  • 0 Views
  • 0 Followers
  • 0
Share
  • Facebook
  • Report

Leave an answer
Cancel reply

You must login to add an answer.

Forgot Password?

Need An Account, Sign Up Here

1 Answer

  • Voted
  • Oldest
  • Recent
  • Random
  1. 2026-05-10T16:23:35+00:00Added an answer on May 10, 2026 at 4:23 pm

    Give Berkeley DB a try. Opinions vary, but it’s scalable, stable (if you use all necessary layers) and AFAIK runs well on x64 windows. Also portable to *nix and has C and Java API. Don’t know about C# API.

    • 0
    • Reply
    • Share
      Share
      • Share on Facebook
      • Share on Twitter
      • Share on LinkedIn
      • Share on WhatsApp
      • Report

Sidebar

Related Questions

I need to pre-compress some very large html/xml/json files (large data dumps) using either
I've got some very large XML files which I read using a System.Xml.Serialization.XmlSerializer .
I am very interested in streaming data for web-applications. I have tried out some
Alright. So I have a very large amount of binary data (let's say, 10GB)
I have some very simple code to generate an assembly and invoke a method
I have no idea why this is happening. I have some very straightforward code,
I have seen some very weird for loops when reading other people's code. I
I have developed some custom DAO-like classes to meet some very specialized requirements for
I have been noticing some very strange usage of O(1) in discussion of algorithms
We have some software which relied on certain behavior from another ( very commonly

Explore

  • Home
  • Add group
  • Groups page
  • Communities
  • Questions
    • New Questions
    • Trending Questions
    • Must read Questions
    • Hot Questions
  • Polls
  • Tags
  • Badges
  • Users
  • Help
  • SEARCH

Footer

© 2021 The Archive Base. All Rights Reserved
With Love by The Archive Base

Insert/edit link

Enter the destination URL

Or link to existing content

    No search term specified. Showing recent items. Search or use up and down arrow keys to select an item.