Robustness of Rashba and Dirac Fermions against Strong Disorder