The epicenter is always at the surface, by definition.
The epicenter is the point of the surface directly above the center of a quake.
However, not to split hairs, even if the center was thousands of meters below sea level, the resultant crustal motion can produce a tsunami. "Can" does not mean "will".