Make sure you have a few extra lockpicks with you when you are exploring as you tend to find chests in the most random spaces and they are easy to loot once you get good at the lockpicking minigame.