Think "Learning"
Make your home a place of learning. Develop good attitudes about learning in your family. Books should be very accessible - more accessible than the television. Hang up beautiful art (even if it has to be with thumbtacks!) and play beautiful music. Don't be afraid to have a map of the world in the living room - it goes with any decor! Don't expect to have a perfect house, but let the children help out with what they can. Don't forget to have fun.
Read!
Read good books to yourself to continue your own education (no matter how much education you've had in the past). This will be useful to homeschooling in two particular ways. You will have increased your knowledge base (and of course given your brain a little more exercise) and you'll be able to discuss those books with your children when they reach the right age. Even if you read nothing else, be sure to delve into the Bible and The Catechism of the Catholic Church. Don't forget to look into a few of the subjects that aren't exactly your strong points.
Buy Stuff!
(Moms usually like this part, but we recommend a budget - especially when you're just getting started.) When my oldest was two we decided to set aside a small portion of our monthly budget to spend on educational materials. We're really saw the fruits of this decision by the time our oldest was doing *somewhat* more formal homeschool for Kindergarten. We had a very nice collection of books and manipulatives that would have been impossible to purchase in one big lump. Over the years, we've made a particular effort to buy things that will last for a long time (good quality) and are useful for a broad age range. Because we were serious about collecting good things for homeschooling we started reading many books about education, perusing catalogs and keeping our eyes out at garage sales and used bookstores ($20 a month goes a lot farther at a garage sale). Warning: I've heard that some people make the mistake of buying materials early that they never end up using. Use common sense here. You don't need to buy a first-grade curriculum when your child is two (your whole philosophy of education may have changed in that much time). But, you can begin filling your house with interesting books and toys and movies that will spark their imagination and satisfy their curiosity. Keeping a minimal budget wll help you to choose materials carefully and not overwhelm yourself with too many resources. We've also discovered over the years that getting involved in the local library - particularly to the extent of suggesting good non-fiction materials with broad interest (and low agenda!) can be really helpful and add a rewarding piece to the dynamics of your children's education.