We define a linear operator on the class ${\cal A}(p)$ of $p$-valent analytic functions in the open unit disc involving Gauss hypergeometric functions and introduce certain new subclasses of ${\cal A}(p)$ using this operator. Some inclusion results, a radius problem and several other interesting properties of these classes are studied.