He was a delegate to the Pennsylvania Constitutional Convention in 1790, and was elected as a Federalist to the Fourth and Fifth Congresses, serving from March 4, 1795, until his resignation in 1798.
Tenney was elected as a Federalist to the 6th U.S. Congress to fill the vacancy caused by the resignation of William Gordon; he was reelected to the 7th, 8th, and 9th Congresses and served from December 8, 1800, to March 3, 1807.
He was elected as a Federalist to the 11th United States Congress, holding office from March 4, 1809 to March 3, 1811.