Systematic methods are presented for obtaining recurrence relations for coefficients in the Hermite series solution of linear differential equations with polynomial coefficients. The explicit form for the second order equation is given, and the numerical results illustrated by a fourth order initial value problem. The estimate of the error is obtained, as well.