Can't they use a spaceship to explore the bottom of the ocean?

There is no pressure in space, so there is no force exerted on the outside of a spacecraft. Think about the pressure at the bottom of an ocean. Also, a rocket engine would be totally ineffective under water.

The ocean is harder because the weight of billions and billions gallons of water puts pressure on anything and get crushed. Though in space there is no gravity so it's safe.