Add similarity to the encyclopedia
Here is similarity test data: https://gitlab.mpcdf.mpg.de/mkuban/calculate_dos_similarity_matrix/-/blob/talos/test_similarity_simat_nearest_neighbors.dat
Basically JSON one-liner in a huge file. The ids are upoad_id:calc_id:material_id
. We need a way make this data available.
Maybe as a piece of "user" metadata. We would add it to mongodb (nomad.processing.Calc
) and then reindex. This way the data is stored in datastore that has a backup and will "survive" any re-processing. The downside is that the data is not part of the encyclopedia section.
Another solution, we have this in a separate database and add it during processing.
Another solution, we have this in a separate collection/database (e.g. mongodb) and the API grabs it on the fly. Probably the most flexible and fastest solution. Hence preferable solution?
@Lauri can you decide and do this and test with the linked file?