[2305.14381] Connecting Multi-modal Contrastive Representations