The rumor mill is swirling that Teresa Giudice's husband, Joe, shuts his family out as he deals with the possibility of both he and Teresa going to federal prison.

Teresa Giudice To 'Admit Everything' In Tell-All Book?

An insider told Radar Online Tuesday, that Joe is keeping his distance from her and their four daughters.

"Teresa feels like Joe should be spending every minute that he can with her and their four girls, but he's still doing his own thing, doing stuff with the guys and she's getting really frustrated. She doesn't understand why he can't just stay home with their girls and with her. She wants to know why he's ignoring them."

Joe Giudice Spotted At NY Nightclub Sans Teresa

The source continued and said while Teresa isn't worried about cheating, she doesn't like the fact that he's enjoying his last days as a free man for what could be 46 months, without their family.

"She knows that they just have DAYS left with Joe and the fact that he wants to spend time away from the girls is heartbreaking for Teresa. Teresa expects Joe will get sent to jail and be locked up for a long time and she's terrified of what she'll do when that happens."

On top of that, Joe could be deported back to his native country, Italy, after serving his sentence. Teresa is facing her own possible jail time of up to 27 months.

The source said, "It's getting closer and closer and she doesn't really want to be sentenced, she just wants everything to go away. Teresa really doesn't know what she's going to do without Joe."

Teresa and Joe's sentencing is set for July 8.