Water was pretty dang lethal in the Alpha, unfortunately for aquatic enthusists it's a very nice developer tool for organically keeping players within the bounds of the map. Perhaps there will be some areas which will allow better water exploration? We'll see :)