The Taipei Guest House, located in Ketagalan Avenue, is not open to the public. It is used mainly by the President to entertain VIP guests or by the government to hold National Day receptions and other important functions. It was constructed from 1897 to 1901 and remained the governor's residence throughout the Japanese occupation, which ended in 1945.

The House is a rectangle oriented along an east-west axis, with a U-shaped two-story main structure. On the first floor, there is a reception room in the east wing and a banquet hall in the west. The second floor is also for receiving visitors. Inside, the ornately carved columns are ubiquitous. The whole space looks tasteful and imposing, thanks to the column tops with carving of spirals and leaves, the friezes, the nicely shaped crystal lamps and chandeliers hanging from the ceiling, and the delicate arches carved with deer heads or leaves.

The House is surrounded by gardens, in particular the backyard, where there are ponds and dense foliage, trying to portray the Chinese legendary abode of immortals. With all these, the Taipei Guest House may be rated as the most elegant baroque style architecture in contemporary Taiwan.