Does the USA Vice President have to live at the Naval Observatory or can he live anywhere he wants?

I read through my other questions and I have asked some pretty goofy questions [Are there dog-sized cows? Why aren't there Tasmanian Devils in the pet trade? etc etc etc] so I thought I'd ask a less goofy question. I also don't understand how Vice Presidents even started living at what I think is just a place with a telescope. That sounds kinda goofy itself, ya know?