HYPRE is a high performance preconditioners library for solving large sparse linear systems on parallel computers. This paper analyzes the scalability of SMG and BoomerAMG, both are multigrid solvers in HYPRE, on massively parallel computer with thousands of processors. Based on the presented results, some conclusions are got to design scalable algorithms and their parallel implementation in real numerical applications.