In the rubble at the cliff base are a few structures, such as this propped boulder. It looks like someone carved a large gouge out of it to the right.
Here is a closer view of the stone work on the shelter. Since the stones aren't covered with lichens and leaf litter, they probably have not been stacked here very long.
And here's what is inside. I have a bowl just like that one.