On 25 Sep 1826, he married Dianah "Dicey" McQueen in Gallatin County, KY.  She was the daughter of John and Polly Allendale McQueen.  She died 19 May 1879 and is buried in the Hoover Cemetery near Daniel's grave.

Daniel and Dianah had the following children:  Mary, Eda (also known as Edith or Edah), Rachel, Rebecca Lou, Ari Edna, and John Andrew Jackson.

After Dianah's death, Daniel married Armilda Hubbard Blevins Brewer on 31 Aug 1879.  Armilda had previously been married to Eli Blevins and Enos Brewer.   She had been widowed by both.  Daniel and Armilda had no children.