It has been shown in existing analysis that the Gauss Runge-Kutta (GRK) (also called Legendre-Gauss collocation) formulation is super-convergent when applied to the initial value problem of ordinary differential equations (ODEs) in that the discretization error is order 2s when s Gaussian nodes are used. Additionally, the discretized system can be solved accurately and efficiently using the spectral deferred correction (SDC) or Krylov deferred correction (KDC) method. In this paper, we combine the GRK formulation with the Method of Lines Transpose (MoL^T) to solve time-dependent parabolic partial differential equations (PDEs). For the GRK-MoL^T formulation, we show how the coupled spatial differential equations can be decoupled and efficiently solved using the SDC or KDC method. Preliminary analysis of the GRK-MoL^T algorithm reveals that the super-convergent property of the GRK formulation no longer holds in the PDE case for general boundary conditions, and there exists a new type of "stiffness" in the semi-discrete spatial elliptic differential equations. We present numerical experiments to validate the theoretical findings.