Even if xauth(1) fails before we get a $pid for cleanup, make sure to run xauth remove during cleanup.