Knowing where you're at is not enough.
You really need to know where you're going. And you need to know which way to point the boat to go there.
It is possible to determine compass direction at sea using purely astronomical methods, but it requires a cloud-free sky.
http://en.wikipedia.org/wiki/Astrocompass