We show that the moduli space of metrics of nonnegative sectional curvature on a smooth closed manifold homotopy equivalent to RP^5 has infinitely many connected components. The proof involves Brieskorn spheres, the nonnegatively curved metrics constructed by Grove-Ziller and computations of eta invariants. We also discuss corresponding results in higher dimensions for the moduli space of metrics of positive Ricci curvature.