Since rhs objects can contain collision counters, it means we need to be
able to update them, they cannot be const.