I know how to build table layout with div tags.
What I am looking for is an efficient way to build table with multiple rows against a single row using <div> tags as opposed to <table> tags as a large amount of data is going to be displayed.
Here is what I am looking to achieve:

You don’t need divs. Just use the rowspan property: Here is a pretty styled table to get you started: