The Probate Building is located at 234 Town Square. The building is listed on the National Register of Historic Places and is recognized as the oldest structure in Raymond's business district.

The Probate Building, an example of early 19th century Commercial Vernacular style architecture, was built, according to Mississippi Department of Archives and History research, in 1830 to serve as an annex to the original Hinds County Courthouse. It is believed that the old courthouse stood at the site of the present Town Square water tank and tower. The first courthouse was described as "a strangely constructed building with a spire running heavenward, with a bright tin roof that sparkled in the sun and fairly dimmed the eyes of those beholding it." The old courthouse was torn down prior to the erection of the new Hinds County Courthouse in 1857-1859.

In December of 1858, tragedy struck the Raymond business district when a massive fire destroyed twenty-one buildings in the business district and caused an estimated loss of $200,000. The Probate Building was one of the few structures to survive the fire. After the completion of the "New Courthouse", the Probate Building ceased to serve its original purpose, and ownership passed into private hands. The building served a number of functions, and from 1900-1924 the Probate Building served as a general mercantile store owned and operated by the Shearer family of Raymond. In 1926, the building was purchased by the Keith family of Utica. For fifty years the building served as the home of Keith Press where the Hinds County Gazette, one of the oldest weekly newspapers in the state, was published.

In 1991, Max and Isla Tullos, after spending several years looking for an antebellum house to restore, found the Probate Building and decided to purchase it after spending about 30 minutes inside the building. Charles (Chuck) C. Barlow, Jr., a Jackson architect, was retained to design and supervise the restoration of the building. As a child, Chuck lived across the street from the Tullos' first home in Jackson.

In the mid 1880's the building was extended to the north. Interestingly, the later construction was much inferior to the original antebellum construction. Under the Tullos' restoration, the building was completely gutted and a new building was built inside the old brick walls. On the lower floor, a portion of the original brick walls was left exposed to reveal the beauty of the original handmade brick, the "join" line of the two phases of construction, and to create a visual break between the living and dining spaces