Rumors swirl that Kendall Jenner is quitting E!'s Keeping Up With The Kardashians after rumors that she and Kourtney Kardashian's boyfriend Scott Discik are secret lovers hit the Internet. Now Jenner and her big sister Khloe Kardashian have broken their silence on the rumors.

Scott Disick On Marrying Kourtney Kardashian 'If It Ain't Broke Don't Fix It'

Khloe, who has also been rumored to be dating Disick recently, joked about reports via Twitter.

She wrote, "I'm really pissed about this whole @KendallJenner and @ScottDisick thing!! Scott, I thought it was you and I that was having the affair! Scott is such a THOT! These h*es really ain't loyal!! Huh?!?!"

Kim Possibly Pregnant On 'KUWTK', Kris Jenner Gets Extra Close To Corey Gamble 'I Heard Moaning'

Disick caught wind of the tweets and told Khloe, "Don't worry you will always be by number 1"

Jenner went not only retweet Khloe but add her own two cents after Disick joked Khloe was the one for him.

"excuse me?!" Jenner wrote.

Still, while Jenner is able to joke about affair rumors, she is reportedly ready to walk away from Keeping Up With The Kardashians because she wants to "be taken seriously."

An insider told Hollywood Life Thursday, "Kendall is now questioning whether or not she should remain on the show. Kris of course is like,'No way, don't be silly. There is no such thing as bad publicity.' But Kendall is not happy about this one bit."

They also added that Kendall wanted to speak up about the rumors previously, but her mother told her not to.

"Her sisters, including Kourtney, are telling her not to let it bother her, but she is just beside herself."

Disick is currently dating Kourtney. The two have three children together.