Reprocessing upload causes error "Package is already registered"

Attempting to reprocess an upload including a yaml schema

definitions:
  name: 'x'

results in the error

nomad.metainfo.metainfo.MetainfoError: Package x is already registered for package x:Package

changed the description

assigned to @mscheidg

https://gitlab.mpcdf.mpg.de/nomad-lab/nomad-FAIR/-/blob/develop/nomad/metainfo/metainfo.py?ref_type=heads#L4094

Three issues here:

1. As long as a custom package is required, it will be initialized from json, which causes this error. So the simple fix is either override existing package or ignore duplicates.
2. Custom packages could have identical names/alias, how can you tell which one is which, or even, which one is the newer version of the same package?
3. This registry concept effectively means that if a worker runs long enough, there will be memory issues as all visited packages will be loaded into memory and never destroyed. Workers will be killed/rebooted by the host. This sounds bad.

created branch 2066-reprocessing-upload-causes-error-package-is-already-registered to address this issue

mentioned in merge request !2054 (merged)

mentioned in commit eb4fe8ec

closed with merge request !2054 (merged)