On an $N$-dimensional manifold with non-symmetric connection $L^i_{jk}$ four kinds of covariant derivative (1.1) are defined, and four curvature tensors are obtained. In the present paper specially the $3^\text{rd}$ and the $4^\text{th}$ kind of covariant derivative are studied, particularly their application on $\delta$-symbols.