Paradoxes in dynamic stability of mechanical systems: investigating the causes and detecting the nonlinear behaviors