The ladders in Sacra aren't reachable from the ground. If there's a ladder that's not yet accessible, it means that the region behind it hasn't been properly explored. It could be a locked door, a ...