Reading is fundamental. Here are great resources for new Pagans, old Pagans and Pagans who want to share the gift of reading with their children.
If you are looking for books about Pagan history, The ADF Druidry website has an excellent list of recommended reading attached to their dedicate study program. I could hardly hope to compete so I will just reference it here. You can also find a TON of handy info, all cross indexed at the Witchipedia. You can also find book references there.
Also, I highly recommend you visit http://www.sacred-texts.com for more public domain reading material than you can handle.