The lattice Boltzmann method is employed to simulate the steady flow in a two-dimensional lid-driven semi-elliptical cavity. Reynolds number (Re) and vertical-to-horizontal semi-axis ratio (D) are in the range of 500-5000 and 0.1-4, respectively. The effects of Re and D on the vortex structure and pressure field are investigated, and the evolutionary features of the vortex structure with Re and D are analyzed in detail. Simulation results show that the vortex structure and its evolutionary features significantly depend on Re and D. The steady flow is characterized by one vortex in the semi-elliptical cavity when both Re and D are small. As Re increases, the appearance of the vortex structure becomes more complex. When D is less than 1, increasing D makes the large vortexes more round, and the evolution of the vortexes with D becomes more complex with increasing Re. When D is greater than 1, the steady flow consists of a series of large vortexes which superimpose on each other. As Re and D increase, the number of the large vortexes increases. Additionally, a small vortex in the upper-left corner of the semi-elliptical cavity appears at a large Re and its size increases slowly as Re increases. The highest pressures appear in the upper-right corner and the pressure changes drastically in the upper-right region of the cavity. The total pressure differences in the semi-elliptical cavity with a fixed D decrease with increasing Re. In the region of the main vortex, the pressure contours nearly coincide with the streamlines, especially for the cavity flow with a large Re.