The Captive Animals' Protection Society (CAPS) spoke out after Mr Cameron raised the issue during his recent trip to China.
Craig Redmond, Campaigns Director for CAPS said: "If governments want to really support panda conservation they would offer practical and financial support for the ongoing work of the Chinese government and wildlife charities in protecting and restoring natural habitats. Keeping animals in zoos is a dangerous and expensive distraction from conservation."