The TV and radio presenter says that over time the negative comments have upset him.