The Wild Shards island can now have caves! I added this feature after fixing a lot of bugs my brother and I discovered recently. Some of them had pretty strange effects like turning every item in you inventory into water bottles.
Anyway, below are some more impressions of generated islands with caves!