This article is two fold. Firstly, we derive optimal order a priori error estimates
for Babuška's penalty method applied to inhomogeneous Dirichlet problem. Secondly, we derive
convergence of W-cycle and V-cycle multigrid algorithms for the resulting system. To this end, a
simple pre-conditioner is introduced to remedy the ill-condition due to over-penalty.