Stewart Seger was born December 11, 1911 to George and Gertrude Seger. He grew up in Cheboygan, Michigan. In 1937, he married Charlotte Zadow. They raised their two boys in Detroit and then Ann Arbor, Michigan. Stewart left his wife to raise the two young boys when he moved to California in the mid 1950s.

He died in an apartment fire in Los Angeles on Feb 17, 1969 at the age of 57 and was buried with his parents in Evergreen Cemetery in Alpena, Michigan. Charlotte died on February 20, 1989 in Michigan.