After you've spoken to Delphine, you can actually find a shortcut out of Sky Haven Temple by going up the staircase to either side of the temple, and out of the door at the back. Fast travel back ...