negative regulation of cellular response to growth factor stimulus