Personal life
On June 14, 1849, Sands was married to Eliza Dickson Aymar, a daughter of Benjamin Aymar, also a merchant, and Elizabeth (née Van Buren) Aymar. After her death in 1850, he married her sister, Mary Ellis Aymar on April 15, 1852. Their elder sister was married to John D. Van Buren Jr., the New York State Engineer and Surveyor. After his marriage he lived at 80 Fifth Avenue in New York City and, later, at 385 Fifth Avenue. Together, they were the parents of:
Benjamin Aymar Sands (1853–1917), who married Amy Kirby Akin, the daughter of William H. Akin.
Ledyard Sands (1854–1897), who married Sarah F. Thornton and died in Sri Lanka.
Samuel Stevens Sands Jr. (1856–1889), who married Anne Harriman (1861–1940), the daughter of banker Oliver Harriman and Laura (née Low) Harriman. He died from a fall during a hunt at Meadow Brook Golf Club in 1889. After his death, his widow remarried first to Lewis Morris Rutherfurd Jr., and after his death, William Kissam Vanderbilt in 1903.
Eliza Louise Sands (1858–1934), who was involved in the Social Service Committee of the Volunteer Hospital and did not marry.
Mary Emily Sands (1859–1863), who died young.
William Henry Sands (1861–1920), who married Frances Augusta Lorillard (August 8, 1864 – January 30, 1931), daughter of Jacob Lorillard and granddaughter of Pierre Lorillard III.
Anna Sands (1864–1932), a social leader in New York City and Newport, Rhode Island, who did not marry.
Charles Edward Sands (1865–1945), an Olympic tennis player who married Sarah Wilson Simonton in 1920.
Robert Cornell Sands (1867–1932), who did not marry.
Harold Cater Sands (1869–1881), who also died young.
Katharine Aymar Sands (1871–1951), who married Theodore Augustus Havemeyer Jr. (1868–1936), son of Theodore Havemeyer, in 1893.
He died on July 26, 1892, at his country home, "Elmhurst", near New Hamburg, New York. Sands was buried at Greenwood Cemetery, in Brooklyn.