You may not delete the last character set in a font list object.
To delete the font object, select it from the list and press the delete button that is with the list.