Born around 1515 in Gascony, his father was Odet de Cardaillac, seigneur de Sarlabous, and his mother, Jeanne de Binos, heiress of Bize or Vize.