The inconsistent accuracy and truncation error in the treatment of boundary usually leads to performance defects, such as decreased accuracy and even numerical instability, of the entire computational method, especially for higher order methods. In this work, we construct a consistent fourth-order compact finite difference scheme for solving two-dimensional incompressible Navier-Stokes (N-S) equations. In the proposed method, the main truncation error term of the boundary scheme is kept the same as that of the interior compact finite difference scheme. With such a feature, the numerical stability and accuracy of the entire computation can be maintained the same as the interior compact finite difference scheme. Numerical examples show the effectiveness and accuracy of the present consistent compact high order scheme in $L$^∞. Its application to two dimensional lid-driven cavity flow problem further exhibits that under the same condition, the computed solution with the present scheme is much close to the benchmark in comparison to those from the 4^$th$ order explicit scheme. The compact finite difference method equipped with the present consistent boundary technique improves much the stability of the whole computation and shows its potential application to incompressible flow of high Reynolds number.