There couldn't have been a big issue because of handshaking with PM Modi but it is mainly because of the Telugu media which generally supports Chandrababu Naidu. The media was exaggerating about Chandra Babu before he went to Delhi saying that Modi is afraid of Chandra Babu and Chandra Babu is the only politician, who has the daring to say anything against Modi, etc. Even people of Andhra Pradesh also expected like that. And when he went to Delhi and did nothing except handshaking with the Prime Minister, not only the opposition parties, even people started trolling against Chandra Babu Naidu in the social media. It is not the problem of the people, it is the problem with Telugu media, which always boasts Chandra Babu Naidu. You can see the latest election survey by favouring media saying that Chandra Babu Naidu is going to win the AP elections in 2019 even though people are very much disappointed with Chandra Babu Naidu.