[2410.15060] BYOCL: Build Your Own Consistent Latent with Hierarchical Representative Latent Clustering