gpio-button-hotplug: fix crash on remove