rework ipset removal logic to only purge sets that are not in use by any family