Buy a ferry ticket on Citadel Island. Board ferry, even if it is raining. Press [Esc] you will automatically be on Desert Island.