The house was built by William Walsh, a noted local lawyer who occupied a seat for two terms in the United States House of Representatives in the 1870s. A later occupant of the house, Bishop James Walsh, was a prisoner of Communist China for 12 years and a local school was named in his honor. The Walsh House is currently occupied by the Allegany County Board of Education.
The Walsh House is located at 106-108 Washington St., and is a contributing building to the Washington Street Historic District. The Board of Education offices are open during normal business hours.