A minimum raise from the button screams strength and he wants action.If he was holding A,K/A,Q he should be raising about 3xBB because they are only drawing hands.
This is ok if playing against a pedictable "book player"
Having no such read, I don't think it a fair assumption to make, and include AK, AQ and even possibly AJ in my opponents probable hand range.
Checking flop and giving up the betting initiative, then raising the turn, scream strength and you have due cause for concern.
I think you are strong enough, and chipped up enough, to make the call. Given that the pot is offering you just better than evens.
A fold is certainly not an awful play. Your read that his lack of continuation bet was unusual further goes to suggest his strength.
Given that he is short stacked, it could just be a desperation raise with a high pocket pair or wanky gutshot broadway draw so I c-c-c-call.