Sign Up

Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.

Have an account? Sign In

Have an account? Sign In Now

Sign In

Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.

Sign Up Here

Forgot Password?

Don't have account, Sign Up Here

Forgot Password

Lost your password? Please enter your email address. You will receive a link and will create a new password via email.

Have an account? Sign In Now

You must login to ask a question.

Forgot Password?

Need An Account, Sign Up Here

Please briefly explain why you feel this question should be reported.

Please briefly explain why you feel this answer should be reported.

Please briefly explain why you feel this user should be reported.

Sign InSign Up

The Archive Base

The Archive Base Logo The Archive Base Logo

The Archive Base Navigation

  • SEARCH
  • Home
  • About Us
  • Blog
  • Contact Us
Search
Ask A Question

Mobile menu

Close
Ask a Question
  • Home
  • Add group
  • Groups page
  • Feed
  • User Profile
  • Communities
  • Questions
    • New Questions
    • Trending Questions
    • Must read Questions
    • Hot Questions
  • Polls
  • Tags
  • Badges
  • Buy Points
  • Users
  • Help
  • Buy Theme
  • SEARCH
Home/ Questions/Q 6131785
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Editorial Team
Asked: May 23, 20262026-05-23T17:01:17+00:00 2026-05-23T17:01:17+00:00

I store large Blobs in the datastore. These are XML files that can be

  • 0

I store large Blobs in the datastore. These are XML files that can be as large as 20mb. Storing a single 20mb XML file is fine, however the issue comes when I need to unserialize it.

There are all sorts of limitations to this:

  • I cannot read more than 1mb from Blobstore
  • even if I could I’m still confronted with the 5mb RAM limitation (since I need to put all the XML into RAM before unserializing it)

How would you say I can handle this? I’m open to all sorts of solutions, but hopefully not something that involves using another hosting provider.

  • 1 1 Answer
  • 0 Views
  • 0 Followers
  • 0
Share
  • Facebook
  • Report

Leave an answer
Cancel reply

You must login to add an answer.

Forgot Password?

Need An Account, Sign Up Here

1 Answer

  • Voted
  • Oldest
  • Recent
  • Random
  1. Editorial Team
    Editorial Team
    2026-05-23T17:01:17+00:00Added an answer on May 23, 2026 at 5:01 pm

    You should switch to a Sax Parser, streaming the data from the Blobstore with the BlobstoreInputStream class.
    These libraries should help you to avoid the GAE RAM restriction.

    • 0
    • Reply
    • Share
      Share
      • Share on Facebook
      • Share on Twitter
      • Share on LinkedIn
      • Share on WhatsApp
      • Report

Sidebar

Related Questions

I need a database that can store a large number of BLOBS. The BLOBs
This is the scenario: We store files, e.g. relatively large documents (10-300MB), in blobs
I want to store a large number of sound files in a database, but
I am trying to store a large amount of boolean information that is determined
I'm trying to zip a large number of pdf files (stored as BLOBs in
I have an MVC web app running in azure that serves up large files
I need a way to store large-numbers of variously sized XML data in a
I need to store large amounts of metering data in a database. A record
I would like to store large dataset generated in Python in a Django model.
What is the most efficient way to store large arrays (10000x100) in a database,

Explore

  • Home
  • Add group
  • Groups page
  • Communities
  • Questions
    • New Questions
    • Trending Questions
    • Must read Questions
    • Hot Questions
  • Polls
  • Tags
  • Badges
  • Users
  • Help
  • SEARCH

Footer

© 2021 The Archive Base. All Rights Reserved
With Love by The Archive Base

Insert/edit link

Enter the destination URL

Or link to existing content

    No search term specified. Showing recent items. Search or use up and down arrow keys to select an item.