Joseph's brother James who later followed him to the United States, is the grandfather of American art collector and socialite Peggy Guggenheim.
•
Among others the family of Joseph Seligman who emigrated to the United States and founded an international bank lived there.
Joseph's father wanted him to enter the family wool business, but circumstances made this difficult; in particular, migration of the peasant class (Seligman's father's customers) from rural areas to urban meant a loss of job opportunities and a shrinking economic base in Baiersdorf.
•
He was born in Baiersdorf, Germany, emigrating to the United States when he was 18.