Let $R$ be a completely primary finite ring with identity $1\neq 0$ in which the product of any two zero divisors lies in its coefficient subring. We determine the structure of the group of units $G_R$ of these rings in the case when $R$ is commutative and in some particular cases, obtain the structure and linearly independent generators of $G_R$.