Theory of matrix splittings is a useful tool for finding the solution of a rectangular linear system of equations, iteratively. The purpose of this paper is twofold. Firstly, we revisit the theory of weak regular splittings for rectangular matrices. Secondly, we propose an alternating iterative method for solving rectangular linear systems by using the Moore-Penrose inverse and discuss its convergence theory, by extending the work of Benzi and Szyld [Numererische Mathematik 76 (1997) 309-321; MR1452511]. Furthermore, a comparison result is obtained which ensures the faster convergence rate of the proposed alternating iterative scheme.