Jimmy Smith is a midfielder who progressed through Chelsea's academy system, making his debut as substitute against Newcastle United on the last day of the 2005/6 season. He joined QPR on loan on September 27th 2006, initially for a month but it was extended until the end of the season. He made 29 appearances for QPR, scoring six goals.

On 19th July 2007, he joined Norwich City on loan until the end of December 2007. His first appearance in a City shirt was in the pre-season friendly against Dutch side AGOVV Apeldoorn which City won 2-0 on 21st July 2007.

On 25 July 2007, Smith sustained a worrying calf injury in Norwich's pre-season friendly with FC Zwolle, which kept him out of action for almost three months. He finally made his competitive debut for Norwich on 23 October 2007, as a substitute in a 2-1 defeat to Burnley at Turf Moor.

The final appearance of his loan spell with The Canaries came in their 1-1 home draw vs Wolverhampton Wanderers on December 29, 2008

Returning to Chelsea, Norwich hoped to extend his loan but with injuries and players away at the African Cup of Nations, Chelsea opted to keep Smith at Stamford Bridge.

In June 2008, Jimmy was linked with a loan move to Sheffield Wednesday. This materialised on 3rd July 2008 with Smith signing a 6 month loan deal. He returned to Chelsea at the beginning of January 2008. He made 13 appearances for Wednesday.

Jimmy was loaned out again on 2nd February 2009, this time joining Leyton Orient until the end of the 2008/9 season.

In July 2009, Jimmy made his switch to Leyton Orient permanent.

Smith returned to Carrow Road in January 2011 and scored the only goal of the game as Orient beat Norwich in the 3rd Round of the FA Cup.

Smith was told on 30 April 2013 that his contract would not be renewed by Orient when it expired at the end of June 2013. After nearly four years at the club, he had made 189 appearances and 22 goals in all competitions

Smith signed for Stevenage on 10th June 2013. He made 49 appearances for Stevenage, scoring 3 goals, in 2013/14 as the Hertfordshire side were relegated to League Two.

On 19th May 2014, Smith signed for League One side Crawley for an undisclosed fee.

On 9th September 2019, Smith signed for Yeovil Town on loan until January 2020. Jimmy was released by Crawley at the end of the 2019–20 season. He had played 169 games for Crawley. He returned to Yeovil on 27th August 2020 signing a one year deal.

On 27th May 2021 Smith announced his retirement aged 34. His final game against Stockport was his 513th professional appearance. He then rejoined Chelsea as a youth team coach and features occasionally for the U23 side