There is a singular integral operators $S_{\varphi}$ on the Fock space $\mathcal{F}^2(\mathbb{C}),$ which originated from the unitarily equivalent version of the Hilbert transform on $L^2(\mathbb{R}).$ In this paper, we give an analytic characterization of functions $\varphi$ with finite zeros such that the integral operator $S_{\varphi}$ is bounded on $\mathcal{F}^2(\mathbb{C})$ using Hadamardâ€™s factorization theorem. As an application, we obtain a complete characterization for such symbol functions $\varphi$ such that the Berezin transform of $S_{\varphi}$ is bounded while the operator $S_{\varphi}$ is not. Also, the corresponding problem in higher dimensions is considered.