Kourtney Kardashian and Justin Bieber have faced rumors of a pregnancy in recent months, and while that may not be the case, the two have been spotted together on an off and in a couple of recent posts, the reality star has hinted at trouble in paradise.

While Bieber has often gone back and forth between women, including Hailey Baldwin, Kardashian didn't appear to mind until earlier this week when she shared an odd post on Twitter referencing a song from Beyonce's new album.

Kardashian then posted a page from her daily devotional, which spoke of a problem.

In April, a source told PEOPLE Magazine that Kardashian and Bieber had been "hooking up on and off for a few months now."

"They have hooked up a few times, including recently," the source explained. "It happens in L.A. He has met her kids, but they don't hook up around the kids. It's on nights when she has help and is able to go out."

"Kourtney is great. Justin thinks it's cool that she is older and hot. She isn't clingy and has her own life," the source continued. "There are no bad consequences for Justin to hook up with her. She is very easy going and just makes it fun for him to be around her.”

Last year, around the time Kardashian and Bieber's romance reportedly began, another source claimed the relationship was a major ego boost for Bieber.

"He has had a huge ego boost from hooking up with Kourt. It's been going on for a few months," a source told PEOPLE at the time. "He is used to being swooned by young girls that have nothing else going on. Kourt is a hot mom with a career."

"He more thought, 'Wow,' and couldn't believe that she would go for him," the source said. "He brags about how hot she is. He is happy while it lasts. Even if she is using him to get back at Scott, he couldn't care less."

Tags: kourtney kardashian scott disick Justin Bieber