Skip to content

GitLab

  • Menu
Projects Groups Snippets
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
  • nomad-FAIR nomad-FAIR
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 133
    • Issues 133
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 11
    • Merge requests 11
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Packages & Registries
    • Packages & Registries
    • Package Registry
    • Container Registry
    • Infrastructure Registry
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar

On Thursday, 7th July from 1 to 3 pm there will be a maintenance with a short downtime of GitLab.

  • nomad-lab
  • nomad-FAIRnomad-FAIR
  • Merge requests
  • !362

Merged
Created Jul 30, 2021 by David Sikter@dsikterDeveloper

New sync api

  • Overview 2
  • Commits 8
  • Pipelines 1
  • Changes 15

Introduces new functionality for downloading and uploading "upload bundles" from/to NOMAD deployments. Intended to replace existing CLI and publish-from-oasis functionality.

An "upload bundle" is a file bundle (a zipfile, normally) containing all information (raw files, archive files, metadata) needed for transferring an upload from one NOMAD deployment to another. They are also intended for internal operations and for future CLI commands for doing things like "pulling" all new uploads from the central NOMAD to an oasis.

The main methods for exporting and importing are defined in nomad.processing.Upload, named export_bundle and import_bundle, respectively. They are quite parametrized (maybe too parametrized?) to allow for flexibility. The import method does more extensive checking than the existing functionality for importing uploads from OASIS. In the future, we might also want to include code for conversion between different nomad versions.

Assignee
Assign to
Reviewer
Request review from
Time tracking
Source branch: new-sync-api