We have a paper in NeurIPS 24 on evaluating abstract shape recognition in vision-language models (uploading soon).