Phrasal Verbs
to remind someone of something they have said or done in the past, especially to upset or annoy them His unwise remark was frequently thrown back at him by his colleagues.
Definition of throw back at phrasal verb from the Oxford Advanced American Dictionary