Click the delete button in the left column and confirm removing. Operator will be removed from this permission matrix, but will still be stored in the Secure Access catalog (it won't be deleted).