The control you've attempted to remove is currently being used on a form or designer that is in an invalid state.
To remove the control or reference, close all forms and designers and then re-open the form or designer in question and re-attempt to remove the control or reference.