Home/ Questions/Q 9061291
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-06-16T15:26:47+00:00

Is it faster to programmatically join tables or use SQL Join statements when one

  • 0

Is it faster to programmatically join tables or use SQL Join statements when one table is much smaller?

More specifically, how does grabbing a string from a hashmap<int, string> of the smaller table and setting its value to the objects returned from the larger table compare to pre-joining the tables on the database? Does the relative sizes of the two tables make a difference?

Update: To rephrase my question. Does grabbing the subset of the larger table (the 5,000 – 20,000 records I care about) and then programmatically joining the smaller table (which I would cache locally) out perform an SQL join? Does the SQL join apply to the whole table or just the subset of the larger table that would be returned?

SQL Join Statement:

SELECT id, description
FROM values v, descriptions d
WHERE v.descID=d.descID
AND v.something = thingICareAbout;

Individual Statements:

SELECT id, descID
FROM values
WHERE v.something = thingICareAbout;

SELECT descID, description
FROM descriptions d;

Programmatic join:

for (value : values){
    value.setDescription(descriptions.get(value.getDescID))
}

Additional Info: There are a total of 800,000,000 records in the larger table that corresponding to 3,000 values in the smaller table. Most searches return between 5,000 – 20,000 results. This is an oracle DB.

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    In general, joining tables like this is the sort of operation that SQL databases are optimized for, so there is a good chance that they’re fairly hard to beat on this sort of operation.

    The relative size of the two tables might make a difference if you attempt to do the join “manually” as you have to factor in the additional memory consumption to hold the bigger table data in memory while you’re doing your processing.

    While this example is pretty easy to get right, by doing the join yourself you also lose a built-in data integrity check that the database would give you if you let it do the join.

    • 0