Simon Cowell is expecting a baby with his friend's wife. 

According to Us Weekly, the 53-year-old X Factor judge is having a baby with New York socialite Lauren Silverman, who is technically still married to Andrew Silverman.

Andrew, a real estate mogul is reportedly close friends with Cowell. 

"She's around 10 weeks along," a source said.

The source indicated that Lauren plans to leave Andrew and pursue a more serious relationship with Cowell now with the baby coming along. 

"Lauren and Andrew have been unhappy in their marriage for some time, and their divorce has been in the works for a while," a source told the magazine. "As their marriage deteriorated, she and Simon became close."

This could be a life-changing experience for the former American Idol judge who previously said he wasn't fit to be a father. 

"God, no. I couldn't have children. If I had them here drawing on the walls I'd go nuts," Cowell said in 2009. "With kids, you've got a routine you can't escape from. You've got to be up at a certain time. Got to listen. When all you want to do is sit in a corner thinking."

However, last year his views on fatherhood changed when interviewed by AOL Music, in which he said he hadn't ruled out the possibility to have children. 

When asked if he had changed his mind about children, he said, "Well, yes."

"And no. I do really, really like kids, because I can talk to them and listen to them. The problem has always been how much time you need to devote to bringing up kids. I've always dedicated all my life to work, and at 52, I've probably missed the opportunity," he said. 

Meanwhile, Cowell is set to return to X Factor UK to help boost ratings after quitting two years to join the USA show.

Tags: Simon Cowell The X Factor USA