The article discusses the matrices of the form A1n, Amn , AmN, whose inverses are: tridiagonal matrix A−1n (n - dimension of the A−mN matrix), banded matrix A −m n (m is the half-width band of the matrix) or block- tridiagonal matrix A−mN (N = n x m – full dimension of the block matrix; m - the dimension of the blocks) and their relationships with the covariance matrices of measurements with ordinary (simple) Markov Random Processes (MRP), multiconnected MRP and vector MRP, respectively. Such covariance matrices frequently occur in the problems of optimal filtering, extrapolation and interpolation of MRP and Markov Random Fields (MRF). It is shown, that the structures of the matrices A1n, Amn , AmN have the same form, but the matrix elements in the first case are scalar quantities; in the second case matrix elements represent a product of vectors of dimension m; and in the third case, the off-diagonal elements are the product of matrices and vectors of dimension m. The properties of such matrices were investigated and a simple formulas of their inverses were found. Also computational efficiency in the storage and the inverse of such matrices have been considered. To illustrate the acquired results, an example on the covariance matrix inversions of two-dimensional MRP is given