- Joseph Bradford Sargent (b. 14 Dec 1822, d. 15 Jul 1907)
- Elizabeth Collier Lewis (b. 14 Jan 1829, m. 17 Jan 1848, d. 25 Sep 1874)
- Elizabeth Craft Sargent (b. 7 May 1849, d. 18 Apr 1904)
- Bruce Fenn (b. 7 Jan 1857, m. 29 Jun 1886, d. 16 May 1943)
- Henry Bradford Sargent (b. 4 Mar 1851, d. 3 Feb 1927)
- Laura Sargent (b. 18 Oct 1854, d. 23 Dec 1946)
- William Boggs Sargent (b. 28 Jan 1857, d. 24 Jun 1857)
- Edward Rupert Sargent (b. 9 Mar 1858, d. 20 Jun 1940)
- Joseph Denny Sargent (b. 8 Aug 1860, d. 8 Apr 1936)
- George Lewis Sargent (b. 26 Jul 1862, d. 5 Feb 1944)
- Russell Sargent (b. 31 Aug 1864, d. 16 Apr 1904)
- May Sargent (b. 15 Apr 1866, d. 4 Mar 1937)
- Ellen Page Sargent (b. 1 Feb 1868, d. 23 Oct 1930)
- Bruce Fenn (b. 7 Jan 1857, m. 12 Sep 1908, d. 16 May 1943)
- Margaret Sargent (b. 15 Sep 1870, d. 19 Mar 1949)
- John Sargent (b. 19 Nov 1872, d. 16 Sep 1966)
- Anne Hoyt (b. 16 Jan 1877, m. 19 Mar 1910, d. 31 Aug 1971)
- Florence Winchester von Karajan (b. 9 Feb 1848, m. 22 Apr 1878, d. 10 Jan 1938)