Kiefer Sutherland won't return, but will the rest of the cast follow suit?