Skip to content

GitLab

  • Menu
Projects Groups Snippets
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
  • nomad-FAIR nomad-FAIR
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 139
    • Issues 139
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 18
    • Merge requests 18
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Packages & Registries
    • Packages & Registries
    • Package Registry
    • Container Registry
    • Infrastructure Registry
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • nomad-lab
  • nomad-FAIRnomad-FAIR
  • Issues
  • #588

Closed
Open
Created Sep 04, 2021 by Markus Scheidgen@mscheidgOwner6 of 6 tasks completed6/6 tasks

Upload-based metadata editing and refactored upload and entry metadata.

This combines #580 (closed) with a new edit API.

There are lot of duplicated metadata in our mongo collections for processing.Upload and processing.Calc. Originally, the search index and archive is only updated from Calc.metadata and therefore, many upload properties are copied into Calc.metadata. This should be changed.

  • remove duplicated and redundant metadata from processing.Calc #580 (closed)
  • align metadata style of Upload and Calc. E.g. use metadata dict in both classes. Also #580 (closed)
  • add derived property or function (e.g. all_metadata) to processing.Calc that produces a merged dict of upload and entry metadata
  • create EntryMetadata (and search index indirectly) from these combined dicts in processing.data.py
  • replace all specific search index update operations with one function that is based on these merge metadata dicts
  • improve POST uploads/{id}/metadata. It should run a process that performs all necessary Upload/Calc and search index updates. This will later replace the existing edit API. This also needs to validate the metadata, have a respective pydantic model, etc.
Edited Nov 19, 2021 by David Sikter
Assignee
Assign to
Time tracking