New reports claim that the election next week may have an even bigger impact than who takes over as President of the United States.

According to reports, Paul Ryan, who has served as the Speaker of The House of Representatives for the last year following John Boehner's retirement, is planning on stepping down from the position, which makes him second in the line of succession should anything ever happen to the President and Vice President.

Four House Republicans, including a senior lawmaker who is considered close to the leadership, told The Hill that they believe Ryan is going to step down after the Nov. 8 election, because he will have a hard time winning the 218 votes he needs to win the full term leading the GOP in the House.

His aides denied the claim, telling the publication that he was focusing on the Election itself right now, but still had plans to run for his position again.

"He is running. The Speaker's only focus until Election Day is defeatinf Democrats and protecting our majority, and nothing else," Spokeswoman AshLee Strong said.

The chatter over Ryan possibly stepping down comes after support for him waned when he stopped actively supporting GOP Presidential nominee Donald Trump, following a video of him talking about groping and kissing women from 2005 surfacing. On a House GOP Conference call, Ryan said he would no longer defend or campaign for and with Trump after the recording surfaced, and would instead focus on the down ballot races.

He has however reportedly cast an early vote for Trump.

A decision by Ryan to step down could be inevitable because he hasn't had much support for either major candidate. Aside from disliking Hillary Clinton because she is a Democrat, Ryan has been vocal about her using a private email server while serving as Secretary of State, saying she has no regard for how to properly handle classified documents, something he has even tweeted about as rumors flew about his status.

It is almost certain he would have a hard time ruling with her in the White House.

However, if his popularity has taken a hit because of his refusal to campaign for Trump, it could mean he is in a precarious position if he wins the White House as well, and it too could jeopardize his chances at winning his position again, which could prompt a decision to step down ahead of time.

Tags: Paul Ryan