Home/ Questions/Q 6571449
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-25T14:53:02+00:00

I’m facing a little problem of scalability. I’m using JDO to query my datastore.

  • 0

I’m facing a little problem of scalability. I’m using JDO to query my datastore.
I need to retrieve all the keys of a given entity (such keys are of type Long). Given that in my datastore such entity has 1.000.000 of records, I need to get them in a very efficient way, in order to loop over this set in a background task.

Which is the most efficient way to do this?

And what if I need not only the key, but also another field? Let’s say I’ve got an entity called TPImage:

    Long idPic; //this is my key
    String title; //this is the field I want to retrieve together with the key
    ... // other properties

How may I retrieve both idPic and title in a single efficient query?

Something like 

    Query q = new Query("select idPic, title from " + TPImage.class.getName());

but more efficient?

Thank you very much!

Bye
cghersi

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    The scaling problem you have is that you need all the keys – not that you can’t fetch them efficiently enough. No matter what system you use, this is always going to be at least O(n).

    Rather than trying to prefetch everything, you should do your work in batches, and use cursors to retrieve the next set of results efficiently.

    If you need a field from the model, you must retrieve the whole model instance – they’re stored as serialized blobs, so there’s no way to retrieve just one field.

    • 0