Apparently, the 30-year-old singer - who was paid an eye-watering $10 million to appear on the show - walked out of the auditions twice, leaving one insider to suggest that hiring Britney was "The biggest gamble Simon Cowell has ever made."
Apaz, Britters originally walked out when a hopeful butchered one of her songs, and missed a further four auditions while the restless audience chanted ‘Where’s Britney?’.
Britters did however reassure her fans on Twitter that nothing was wrong, tweeting: “LOL was just taking a little break people. I am having the best time.”
Hmmmm, we might try taking a 3-hour lunch break, then send that exact text to our boss. We don't think it would go down well.
Britney then left the set AGAIN – along with her fellow judges LA Reid, Demi Lovato and Louis Walsh (who was filling in for a poorly Simon Cowell) but failed to return when they did.
The judges walked when an auditionee claiming he was 'better than Chris Brown' turned abusive - but when Demi, Louis and LA resumed their places on the panel Britney was missing – and didn’t return for the rest of the day. UH OH.
A source told the Daily Mirror newspaper: "It's embarrassing to have an empty seat on the panel in filming sessions as the footage is almost totally wasted.
"If a great singer appears and producers want to use the audition, you have to tell viewers why Spears wasn't there. That's not easy.
"Britney is getting $15 million to appear and it could be the biggest gamble Simon Cowell has ever made."
However Britney's manager Larry Rudolph denied any problems saying: "What is everyone's problem? Everything is fine. Britney loves being on X Factor."
What do you think of all this X Factor based dramah?
IMAGES: WENN/@TheXFactorUSA twitter