I don't think it hurts his legacy at all. If the coach lets him throw the ball on 4th and goal instead of kicking a field goal, we might be talking about him in the Super Bowl. Why a coach wouldn't put his faith in a guy like Rodgers I will never understand.
