it’s easier to explain with a schematic

I have main div, which contains another (gray) div inside, and several divs for video thumbs (which are clickable for full-sizer videos).
What I want is to make a button (white arrow on the scheme) that changes the div with thumbs (they are marked with frame) to next “page” – another div with another set of thumbs, tho allowing visitor to browse through several pages with more then 8 thumbs.
Big picture at the top is featured video, it shouldn’t change (so if think I can put it atop of everything, not inside the gray div, because it should be replaced with another div with different thumbs set when you click on the button)
I’m not a coder, just making my first steps in html/css and a bit of java, so any help will be appreciated.
Thanks in advance!
I did something similar yesterday with a twitter feed to achieve this:
HTML:
CSS:
jQuery
Obviously, you would have to tailor the CSS to fit your template. Should be pretty straight forward though.