Deal with calculations that are in the raw data, but not in the repository db
The plan with the migration is to have a migration program that assumes that all calcs are in the repo db. There are calculations that are not in the repository, because
-
they have not been parsed/detected by the repository parsers
-
they go for the wrong mainfile, e.g. OUTCAR vs .xml in vasp
-
Some of those will be detected by migration, because we use the whole uploads. -
Those data that was uploaded, but has no calculation might have an upload in the db (should also be part of migration) -
Or just be laying on the fs -
check if the old nomad CoE archive, contains calculations that are not found during migration