A member of the successful Barnsley U15 team, he signed for Barnsley despite the interest of a lot of other clubs. Kay made his first team debut against Norwich in August 2000 and made a number of additional appearances throughout the 2000/01 season.

His performances for both the reserves and the Academy saw him called up for England Under 18s, even though he was unfortunate not to get a game in their friendly with Belgium. He again won international recognition in May 2001, when he made his England U18 debut against Switzerland.

Originally a central midfield player, Antony switched to defence during the 2002/03 season and put in some assured performances.

2003/2004 was really the year where Antony came of age as a Barnsley star, making 51 first team appearances, netting four goals. He showed his versatility throughout the season, featuring in almost every outfield position. Swept the board at the end of season awards picking up the Reds Player Of The Year, Young Player Of The Year and Disabled Supporters Player Of The Year gongs.

Despite starting the 2004/2005 season out of favour after a host of new arrivals, Antony quickly re-established himself in the starting eleven with a string of fine displays both at the back and in midfield. It was again a season of flexibility for the youngster as he filled in both at the back and further forward as the need arose.

He hit several important goals along the way including a fine winner against Chesterfield and a double at Colchester to seal three vital points.

Antony firmly established himself as a hometown hero during the 2005/2006 promotion winning campaign as he finally found a settled position at the heart of defence. A newly found no-nonsense approach to defending meant consistently turned in outstanding displays as the Reds secured a top six finish and glory at the Millennium Stadium.

Antony was on target from the penalty spot in the historic shoot out against Swansea City.