In February 2003, 14 year old central defender Rossi Jarvis made the record books when he became probably the youngest player to play for Norwich's Reserve team. A regular thenin the Under-15s, he was called up for the reserve team clash with Brentford on 5th February 2003 as Norwich's youth team were playing the same day against West Ham in the FA Youth Cup. Many of the regulars in the reserves were playing for the Under-19s whose side included Rossi's brother Ryan Jarvis.

Rossi signed for Norwich's Academy as a full-time scholar in July 2004. "Rossi is another exciting prospect from the Jarvis family," said Academy Director Ricky Martin. "Technically he's very gifted. He's very good on the ball, and likes to play out from the back, plus he's shown great attitude and determination to come back from serious injury, having not played a game all last year. He's one of those who set the standards for the other Academy boys to follow in that he's very comfortable on both sides of his body."

Rossi was called up to the Norwich City first team squad for the trip to Middlesbrough on 28th December 2004 as the Canaries had been plagued with injuries. After being on the bench for a number of games in the early part of the 2005/6 Championship season, Rossi made his debut on November 5th 2005 as a second half substitute in the 2-0 away defeat to Wolves.

Failure to sign the professional contract Norwich offered Rossi led to speculation on 11th January that Premiership sides Charlton and Portsmouth were watching events with interest, hoping to swoop for the latest product of Norwich's academy. Crystal Palace were also said to be interested. Nigel Worthington urged the young star to sign the contract that City were offering. “It's a very good offer, one that's been on the table for the last two weeks and one that we'd very much like the boy to sign,” said Worthington. In January 2006, Rossi signed his first professional contract that will keep him at Carrow Road until 2008.

On Easter Monday 2006, Rossi made his international debut, playing in England Under-18s 2-1 win over Slovenia, and providing the assist for the winning goal.

Jarvis and fellow Academy product Matthew Halliday joined Coca Cola League Two Torquay on a month's loan deal on 25th January 2007 in the hope of regular first team football. After making 4 appearances for the Gulls., he was injured and returned to Carrow Road. He was loaned out again on 12th March 2007- this time to Rotherham where he will be familiar with fellow loanee Ian Henderson and former captain Craig Fleming. Rossi played for England Under-19s in their 20th march 2007 clash againts Turkey at Doncastor's Keepmoat stadium before being replaced by Ipswich's Danny Haynes at half-term. England won 1-0 with a goal from Chris Martin.

Media speculation at the end of January 2008 suggested that Blackpool were keen to sign Rossi

Rossi, along with Ryan and seven other players, were informed on 6th May 2008 that Norwich would not be renewing their contracts. He had made five appearances during 2007/8 but hadn't found favour under Glenn Roeder. He complained that he had not had a fair chance under Roeder who had brought in young players from Premiership sides.

In late May 2008, Rossi was named as a target for League Two side Luton Town, and indeed Jarvis played for them in a pre-season friendly against Borehamwood in mid-July 2008. He was signed on a permanent basis on 8th August 2008 and scored his first goal for the Hatters in their 2-0 defeat of Plymouth in the Carling Cup the following week. Jarvis however could not prevent Luton from being relegated on 13th April 2009 into the Conference following a goalless draw with Chesterfield. The 30pts deduction that the club were given for financial misconduct was too great for the club to overcome. However Jarvis did play a key role as Luton won the Full Members Cup with a 3-2 win over Scunthorpe at Wembley.

At the end of the 2009/10 season, Jarvis along with keeper Shane Gore, midfielder Asa Hall and striker Steve Basham were released by the Hatters. Despite being without a club, he came on as substitute for the England "C" international squad for their win over Ireland at the end of May 2010

On 1st July 2010, Rossi signed for Mark Stimson's Barnet becoming his seventh signing of the 2010 summer. Stimson said: “Rossi will hopefully play an important role in the team. He has good passing ability and I am sure our fans will enjoy watching him.”

After Barnet's narrow escape from relegation to the Conference at the end of the 2010/11 season, Rossi was released by new Barnet manager Lawrie Sanchez

After a trial, he signed for Cambridge on a month long contract on 9th August 2011. Cambridge United manager Jez George said: “I’m delighted that we’ve agreed initially a short term contract with Rossi. He’s an excellent footballer and we feel that as he gets fitter he will have a lot to offer the team. In the mean time, this is a good arrangement for both parties.”

Rossi, who has been allocated number 16, said: “I’m also delighted to have signed a short term agreement and to be given the chance to get back into football and start enjoying myself again. I’m pleased with the set-up and the way things have gone to start with. Cambridge has a decent squad with decent staff and I’m looking forward to pushing on this season.” After impressing, this was extended on 31st August 2011 until the end of the season. It was then extended for the 2012/13 season

Released by Cambridge at the end of April 2013, Rossi joined Lowestoft on 10th October 2013, making his debut two days later in a 5-0 win over Carshalton.

Jarvis and Lowestoft won promotion to Conference South on Monday 5th May beating AFC Hornchurch.

Jarvis left Lowestoft at the end of March 2018, having made 159 appearances and scoring six goals. He then signed for Dereham. He returned to Lowestoft on 9th August 2018

Rossi left Lowestoft at the end of May 2021 and joined Dereham on 29th May 2021.

On 13th June 2022 Rossi followed his brother Ryan in signing for Leiston.