Deletion of Regexes which are already used in Regex Sets is not possible. The Delete button will be inactive, showing dependent items via tooltip on mouseover. You need to edit the Regex Sets first, removing the single Regex elements you want to delete.