As far as I know there are 343 Common/Skill Books in Skyrim (there are absolutely more, these are just the ones I know of). Not even counting the Journals and Miscellaneous logs which I know of (50). And counting the Spell Tomes I know of (89, and yes, I personally would love to have a collection of those too), there is an approximate total of 482 books in the whole game (surely more).
I have the house in Markarth which has 3 bookshelves with 3 shelves each, each one of those bookshelves can house a total of 54 books, so in total the house can have 162 books in display, this is the house with the most space for books (not counting the fact that you can save books in chests but thats not the point here).
So, in the end you are going to need some House mods when the creation kit comes out. I just hope you got the PC version, because when the kit comes out I will look forward to a "library in your house" mod.
P.S. I have the complete list of books I have knowledge of, if you want it feel free to send me an email (I put it as my website in my profile).