In this paper we discuss properties of compactness and compact operator on $2$-normed space. Also we consider a result which is similar to Riesz Lemma and its applications in $2$-normed space. We introduce quotient space from the finite dimensional subspace of a $2$-normed space.