In 1983, Patterson suffered a debilitating stroke and soon after, her son, J. David Patterson, relocated Elizabeth to Key West, Florida, where he and his wife owned a sportfishing charter business.
Being a licensed Private Pilot, Skydiver, Paraglider Pilot and Scuba Diver, he also engages in various outdoor activities such as Trail Riding, Climbing, Sailing and SportFishing.