Rough set theory is a useful tool for knowledge discovery and data mining. Covering-based rough sets are important generalizations of the classical rough sets. Recently, the concept of the neighborhood has been applied to define different types of covering rough sets. In this paper, based on the notion of bi-neighborhood, four types of bi-neighborhoods related bi-covering rough sets were defined with their properties being discussed. We first show some basic properties of the introduced bi-neighborhoods. We then explore the relationships between the considered bi-covering rough sets and investigate the properties of them. Also, we show that new notions may be viewed as a generalization of the previous studies covering rough sets. Finally, figures are presented to show that the collection of all lower and upper approximations (bi-neighborhoods of all elements in the universe) introduced in this paper construct a lattice in terms of the inclusion relation ⊆.