Based on the opening sequence, the Rushes live at 173 Buena Vista Avenue, East, in San Francisco's Buena Vista neighborhood. There's a view of the southern tower of the Golden Gate Bridge from their street, so they're southeast of the bridge. Yet the view from Henry and Muriel's bedroom window has the house sitting due east of the Golden Gate Bridge (you can see its entire span), which would place their house in the extreme northern part of the city, nowhere near Buena Vista Avenue.
The exterior shots of the house obviously does not match the inside.