Challenging players

I want to reconnect with a previous player but when I try it tells me that player has too many opponents. I’m vip. Please tell me how I can reconnect