Issues · nomad-lab / nomad-FAIR · GitLab

Run processing tests with the internal celery test worker.

#1 · created Aug 20, 2018 by Markus Scheidgen feature ops
- CLOSED
- 1
updated Aug 23, 2018
GITLap QU/CI/CD pipeline

#17 · created Aug 24, 2018 by Markus Scheidgen 2 feature ops
- CLOSED
- 0
updated Dec 13, 2018
Some guidelines and fixes for logging in parsers, normalizers, processing

#38 · created Sep 18, 2018 by Markus Scheidgen 1 feature ops
- CLOSED
- 0
updated Dec 13, 2018
Logging and monitoring with kibana.

#10 · created Aug 24, 2018 by Markus Scheidgen 4 ops
- CLOSED
- 2
updated Dec 13, 2018
Show the nomad-xt version/ref/commit in the GUI.

#27 · created Aug 30, 2018 by Markus Scheidgen 1 feature ops
- CLOSED
- 0
updated Aug 30, 2018
Integration with NOMAD coe IDP

#87 · created Dec 23, 2018 by Markus Scheidgen repo/archive consolidation 2 ops
- CLOSED
- 2
updated Jan 18, 2019
A more flexible and more celery-tonic processing module 1 of 2 tasks completed

#319 · created Apr 17, 2020 by Markus Scheidgen backlog ops refactor
- 6
updated May 06, 2021
Implement mirror functions that are fit to be used with external NOMAD deployments 2 of 2 tasks completed

#288 · created Feb 21, 2020 by Markus Scheidgen NOMAD OASIS bugfixes feature ops
- CLOSED
- 0
updated Mar 25, 2020
Mirror deployments 1 of 5 tasks completed

#34 · created Sep 06, 2018 by Markus Scheidgen backlog ops
- CLOSED
- 2
updated May 13, 2022
Test and benchmark data

#46 · created Oct 01, 2018 by Markus Scheidgen backlog ops
- CLOSED
- 0
updated May 13, 2022
Configure Kubernetes to run elastic search, mongo, postgres as part of the nomad chart 1 of 4 tasks completed

#94 · created Jan 18, 2019 by Markus Scheidgen NOMAD OASIS backlog ops
- CLOSED
- 1
updated Apr 08, 2020
More granular configuration of webserver worker types, proxy buffering, etc.

#203 · created Aug 21, 2019 by Markus Scheidgen backlog ops
- CLOSED
- 0
updated May 13, 2022
Handle dependency evolution 0 of 6 tasks completed

#128 · created Mar 14, 2019 by Markus Scheidgen backlog feature ops refactor
- CLOSED
- 3
updated Apr 08, 2020
Enable send mails after finishing processing 1 of 2 tasks completed

#79 · created Dec 23, 2018 by Markus Scheidgen migration finished 1 ops
- CLOSED
- 3
updated Jul 11, 2019
Reduce the responsibilities of the repository db 0 of 4 tasks completed

#81 · created Dec 23, 2018 by Markus Scheidgen 8 backlog ops refactor
- CLOSED
- 1
updated Aug 09, 2019
Migration exceptions

#115 · created Feb 22, 2019 by Markus Scheidgen migration finished ops
- CLOSED
- 1
updated Jun 25, 2019
Integration tests 2 of 6 tasks completed

#106 · created Feb 04, 2019 by Markus Scheidgen 2 ops
- CLOSED
- 2
updated Aug 09, 2019
APM

#45 · created Sep 28, 2018 by Markus Scheidgen 2 ops
- CLOSED
- 2
updated Aug 20, 2019
Create a new user management based on keycloak (OAuth) 12 of 12 tasks completed

#195 · created Aug 08, 2019 by Markus Scheidgen A replacement for the NOMAD CoE Repository 4 current feature ops
- CLOSED
- 0
updated Sep 02, 2019
Admin user and restrictions for administrative API endpoints

#77 · created Dec 23, 2018 by Markus Scheidgen repo/archive consolidation 1 feature ops
- CLOSED
- 0
updated Dec 23, 2018
Support FTP for upload

#78 · created Dec 23, 2018 by Markus Scheidgen backlog feature ops
- CLOSED
- 2
updated May 13, 2022
coe->fairdi repository db and raw data migration functions 24 of 26 tasks completed

#84 · created Dec 23, 2018 by Markus Scheidgen repo/archive consolidation 8 ops
- CLOSED
- 1
updated Jan 27, 2019
Optimisations 9 of 11 tasks completed

#124 · created Mar 02, 2019 by Markus Scheidgen repo/archive consolidation 2 ops refactor
- CLOSED
- 0
updated Mar 14, 2019
Create "scripts" to run nomad@FAIR on the kubenetes cluster 1 of 1 task completed

#68 · created Nov 05, 2018 by Markus Scheidgen 4 ops
- CLOSED
- 1
updated Jan 18, 2019
CI/CD deployments on kubernetes cluster(s)

#86 · created Dec 23, 2018 by Markus Scheidgen repo/archive consolidation 2 ops
- CLOSED
- 0
updated Jan 29, 2019
Parser infrastructure logging without changing parsers

#107 · created Feb 04, 2019 by Markus Scheidgen 1 bugfixes ops refactor
- CLOSED
- 0
updated Feb 05, 2019
Remove staging elastic search

#88 · created Jan 04, 2019 by Markus Scheidgen repo/archive consolidation 2 ops refactor
- CLOSED
- 1
updated Jan 13, 2019
Upload administation commands 4 of 6 tasks completed

#166 · created Jul 02, 2019 by Markus Scheidgen baseline repository integration 1 feature ops
- CLOSED
- 1
updated Jul 04, 2019
A deployment to run alongside the old python API 5 of 5 tasks completed

#160 · created Jun 25, 2019 by Markus Scheidgen baseline repository integration 2 ops
- CLOSED
- 0
updated Jul 04, 2019
Cache bust on version change

#168 · created Jul 04, 2019 by Markus Scheidgen baseline repository integration 1 feature ops
- CLOSED
- 0
updated Jul 04, 2019
Improved integration tests 3 of 6 tasks completed

#165 · created Jul 01, 2019 by Markus Scheidgen 2 bugfixes ops
- CLOSED
- 1
- 1
updated Aug 19, 2019
Perform the migration 27 of 27 tasks completed

#110 · created Feb 18, 2019 by Markus Scheidgen 8 ops
- CLOSED
- 0
updated Aug 08, 2019
Configuration file based approach to config 0 of 3 tasks completed

#74 · created Dec 17, 2018 by Markus Scheidgen 1 ops refactor
- CLOSED
- 0
updated Mar 20, 2019
Use Elasticsearch curator to logrotate indices on the ELK stack

#69 · created Nov 13, 2018 by Markus Scheidgen 2 bugfixes ops
- CLOSED
- 0
updated Feb 01, 2019
Implement readiness/liveness probing for api, worker, gui

#103 · created Feb 01, 2019 by Markus Scheidgen repo/archive consolidation 1 bugfixes ops
- CLOSED
- 0
updated Feb 02, 2019
A single CLI command for running api+worker locally

#105 · created Feb 04, 2019 by Markus Scheidgen 1 bugfixes ops
- CLOSED
- 0
updated Feb 18, 2019
Limits of the Nomad Repo API

#123 · created Feb 28, 2019 by Nicolas Fabas ops
- CLOSED
- 1
updated Jan 28, 2020
A "script" that quickly allows to migrate new data to a certain deployment. 5 of 5 tasks completed

#161 · created Jun 25, 2019 by Markus Scheidgen migration finished 4 ops
- CLOSED
- 0
updated Aug 05, 2019
Setup for coe GUI

#140 · created Apr 01, 2019 by Markus Scheidgen migration finished 2 ops
- CLOSED
- 1
updated Jul 11, 2019
Create a deployment for experimental nomad.

#144 · created Apr 12, 2019 by Markus Scheidgen Experimental nomad 1 ops
- CLOSED
- 0
updated Apr 23, 2019
Remove the necessity to run gitinfo.sh

#156 · created May 07, 2019 by Markus Scheidgen 1 feature ops
- CLOSED
- 0
updated May 07, 2019
Improve admin commands 2 of 2 tasks completed

#167 · created Jul 03, 2019 by Markus Scheidgen 1 bugfixes feature ops
- CLOSED
- 0
updated Jul 31, 2019
Make nomad@fairdi production ready 15 of 15 tasks completed

#190 · created Aug 02, 2019 by Markus Scheidgen Production uploads 4 ops
- CLOSED
- 0
updated Aug 09, 2019
Add user email/name to processing log entries

#193 · created Aug 06, 2019 by Markus Scheidgen Production uploads 1 ops
- CLOSED
- 0
updated Aug 07, 2019
EU privacy friendly GUI Analytics tracking.

#199 · created Aug 08, 2019 by Markus Scheidgen Version 0.8.1 1 bugfixes feature ops
- CLOSED
- 2
updated Jun 18, 2020
v0.7.x to v0.8.x migration

#309 · created Mar 25, 2020 by Markus Scheidgen Version 0.8 4 current ops
- CLOSED
- 1
updated May 18, 2020
Refactor git project and pypi package structure 1 of 2 tasks completed

#59 · created Oct 11, 2018 by Markus Scheidgen 8 current ops refactor
- CLOSED
- 1
updated Apr 14, 2020
Consolidate everything into a single nomad image

#210 · created Sep 02, 2019 by Markus Scheidgen A replacement for the NOMAD CoE Repository 1 bugfixes ops
- CLOSED
- 1
updated Sep 02, 2019
Enabling gzip compression

#368 · created Jul 04, 2020 by Lauri Himanen Version 0.8.2 2 bugfixes ops
- CLOSED
- 3
updated Jul 10, 2020
Reprocessing fails on large uploads

#228 · created Nov 08, 2019 by Markus Scheidgen bugfixes ops
- CLOSED
- 1
updated Dec 17, 2019
Migration scripts for v0.6.x to v0.7.x 2 of 2 tasks completed

#231 · created Nov 13, 2019 by Markus Scheidgen A replacement for the NOMAD CoE Repository 2 current ops
- CLOSED
- 0
updated Nov 15, 2019
Updating Helm 3 on the cluster

#250 · created Jan 14, 2020 by Adam Fekete backlog feature ops
- CLOSED
- 1
updated Feb 03, 2020
Many features are pending a full re-processing

#264 · created Jan 31, 2020 by Markus Scheidgen bugfixes ops
- CLOSED
- 0
updated Mar 22, 2020
Find a way to securely use the central user management by external NOMAD deployments

#287 · created Feb 21, 2020 by Markus Scheidgen NOMAD OASIS bugfixes ops
- CLOSED
- 3
updated Feb 26, 2020
Add a test for extras_require 0 of 2 tasks completed

#344 · created May 11, 2020 by Markus Scheidgen Version 0.8 bugfixes ops
- CLOSED
- 0
updated May 11, 2020
Calcs not processed due to premature worker sig-9

#353 · created May 18, 2020 by Markus Scheidgen Version 0.8.2 bugfixes ops
- CLOSED
- 1
updated Jun 18, 2020
Remove the nomad-meta-info submodule

#374 · created Jul 10, 2020 by Markus Scheidgen Version 0.8.2 bugfixes ops
- CLOSED
- 0
updated Jul 14, 2020
Use master branch on all the parser submodules

#375 · created Jul 10, 2020 by Markus Scheidgen bugfixes ops
- CLOSED
- 7
updated Dec 18, 2020
Backend driven GUI artifacts

#393 · created Aug 13, 2020 by Markus Scheidgen 2 CLI bugfixes gui ops refactor
- CLOSED
- 1
updated Aug 17, 2020
Migration script for OASIS users

#395 · created Aug 13, 2020 by Markus Scheidgen 1 OASIS bugfixes ops
- CLOSED
- 1
updated Aug 14, 2020
Release pypi in CI/CD

#397 · created Aug 18, 2020 by Markus Scheidgen 1 bugfixes ops
- CLOSED
- 0
updated Aug 19, 2020
CI/CD and testing for parser projects 0 of 3 tasks completed

#409 · created Aug 28, 2020 by Markus Scheidgen backlog ops parsers
- CLOSED
- 1
updated Jan 11, 2021
GUI Tests

#304 · created Mar 17, 2020 by Markus Scheidgen v0.10.0 8 current gui ops refactor
- CLOSED
- 2
updated Jun 18, 2021
Pipeline failures due to github repos

#464 · created Jan 06, 2021 by Markus Scheidgen bugfixes conditionally-closed ops
- CLOSED
- 1
updated Jan 15, 2021
Configurable file name part for archive files to allow multiple archive versions

#466 · created Jan 11, 2021 by Markus Scheidgen 1 current data ops refactor
- CLOSED
- 0
updated Mar 02, 2021
Use a hash instead of digest to characterise exceptions in log entries.

#479 · created Jan 20, 2021 by Markus Scheidgen bug bugfixes ops processing
- CLOSED
- 0
updated Feb 09, 2021
Wrong log usage in new parsers

#483 · created Jan 21, 2021 by Markus Scheidgen bugfixes ops parsers refactor
- CLOSED
- 1
updated Feb 02, 2021
v1 materials API, entries API, supporting search, and metainfo extensions 2 of 8 tasks completed

#504 · created Mar 05, 2021 by Markus Scheidgen v1.0.0-beta API current data datamodel ops processing
- CLOSED
- 16
updated Sep 04, 2021
Create upgrade/data migration scripts

#578 · created Aug 26, 2021 by David Sikter v1.0.0-installation current data ops
- CLOSED
- 11
updated Nov 01, 2021
Prepare rawfiles for hardfork. 4 of 4 tasks completed

#590 · created Sep 04, 2021 by Markus Scheidgen v1.0.0-installation current data ops refactor
- CLOSED
- 0
updated Oct 13, 2021
More OASIS Documentation 0 of 6 tasks completed

#418 · created Sep 16, 2020 by Markus Scheidgen v0.10.0 OASIS current ops
- CLOSED
- 0
updated Mar 15, 2022
Hardfork and reprocessing 4 of 5 tasks completed

#594 · created Sep 04, 2021 by Markus Scheidgen v1.0.0-installation data ops
- 1
updated May 13, 2022
Elasticsearch going read-only depending on diskspace 2 of 2 tasks completed

#630 · created Oct 13, 2021 by Markus Scheidgen bugfixes documentation ops
- CLOSED
- 1
updated Oct 19, 2021
Refactor config "api" keys

#634 · created Oct 15, 2021 by Markus Scheidgen backlog ops refactor
- 0
updated Nov 16, 2021
NOMAD v1 (re-)processing causes elasticsearc client Out of Memory errors 6 of 7 tasks completed

#654 · created Nov 08, 2021 by Markus Scheidgen v1.0.0-beta bugfixes ops processing
- CLOSED
- 1
updated Dec 16, 2021
Updating the legacy Keycloak deployment

#845 · created May 17, 2022 by Adam Fekete OASIS feature ops shortlog
- 0
updated May 24, 2022
Add the "AI Toolkit" to the Oasis 4 of 6 tasks completed

#629 · created Oct 13, 2021 by Markus Scheidgen feature north ops shortlog
- 1
updated Dec 22, 2021
Automated deployment of Oasis installations at MPCDF including NORTH

#787 · created Apr 01, 2022 by Markus Scheidgen feature ops shortlog
- CLOSED
- 1
updated May 13, 2022
Deploy to dev with all plausible branch names

#817 · created Apr 27, 2022 by Markus Scheidgen bugfixes ops
- CLOSED
- 1
updated May 23, 2022