Adam Ivy House was built about 1849–1850, and is a two-story, vernacular Greek Revival style frame dwelling. It has a full-width, one-story front porch. Adam Ivy built the house that still stands today replacing a log cabin that had once been on the property. Family tradition claims Ivy’s second wife helped finance the house with money from the sale of gold dust. 

In 1888, Ivy moved to Florida and sold the plantation to his step-daughter’s son, Dr. James D. Nisbet. Dr. Nisbet practiced medicine in New York City for 40 years, and his mother and brother resided at the home during this time. Additions and renovations took place around 1920 by Dr. Nisbet, including two contributing outbuildings, large and small barns located near the house.