Issues · nomad-lab / nomad-FAIR

New issue

Run processing tests with the internal celery test worker.

#1 · created Aug 20, 2018 by Markus Scheidgen feature ops
- CLOSED
- 1
updated Aug 23, 2018
GITLap QU/CI/CD pipeline

#17 · created Aug 24, 2018 by Markus Scheidgen 2 feature ops
- CLOSED
- 0
updated Dec 13, 2018
Offline processing

#42 · created Sep 24, 2018 by Markus Scheidgen 4 feature
- CLOSED
- 1
updated Dec 13, 2018
Logs for parsing, normalizing (calc processing) should be made available.

#30 · created Sep 06, 2018 by Markus Scheidgen 2 feature
- CLOSED
- 0
updated Dec 13, 2018
Some guidelines and fixes for logging in parsers, normalizers, processing

#38 · created Sep 18, 2018 by Markus Scheidgen 1 feature ops
- CLOSED
- 0
updated Dec 13, 2018
A pagenated list of all repository entries.

#7 · created Aug 24, 2018 by Markus Scheidgen 1 feature
- CLOSED
- 0
updated Aug 25, 2018
Handle double uploads

#6 · created Aug 23, 2018 by Markus Scheidgen 1 feature
- CLOSED
- 0
updated Sep 06, 2018
Remove unwanted and failed uploads.

#13 · created Aug 24, 2018 by Markus Scheidgen 1 feature
- CLOSED
- 0
updated Sep 06, 2018
Decent error handling in GUI

#23 · created Aug 28, 2018 by Markus Scheidgen 1 feature refactor
- CLOSED
- 0
updated Sep 06, 2018
A suite of normal, large, broken, mixed, test calcs

#16 · created Aug 24, 2018 by Markus Scheidgen 2 feature
- CLOSED
- 0
updated Sep 06, 2018
Handle large uploads with more than 100 calcs

#5 · created Aug 23, 2018 by Markus Scheidgen 2 feature refactor
- CLOSED
- 2
updated Sep 18, 2018
Integrated documentation

#12 · created Aug 24, 2018 by Markus Scheidgen 1 feature
- CLOSED
- 1
updated Aug 25, 2018
Scale with calculations

#15 · created Aug 24, 2018 by Markus Scheidgen feature
- CLOSED
- 1
updated Dec 13, 2018
Fully intergated docker compose

#11 · created Aug 24, 2018 by Markus Scheidgen 1 feature
- CLOSED
- 1
updated Aug 28, 2018
Show the nomad-xt version/ref/commit in the GUI.

#27 · created Aug 30, 2018 by Markus Scheidgen 1 feature ops
- CLOSED
- 0
updated Aug 30, 2018
Progress on uploads

#28 · created Aug 30, 2018 by Markus Scheidgen 1 feature
- CLOSED
- 0
updated Sep 06, 2018
Uploads can be accepted into the public nomad

#33 · created Sep 06, 2018 by Markus Scheidgen 1 feature
- CLOSED
- 0
updated Sep 18, 2018
Sorting and filtering for upload calculations

#31 · created Sep 06, 2018 by Markus Scheidgen 1 feature
- CLOSED
- 1
updated Sep 18, 2018
File preview (for textfiles) in GUI

#209 · created Sep 02, 2019 by Markus Scheidgen 2 backlog feature
- CLOSED
- 0
updated Nov 14, 2019
Files card

#739 · created Feb 07, 2022 by Markus Scheidgen backlog feature gui
- 1
updated May 13, 2022
The archive browser must only load the necessary sections

#646 · created Oct 29, 2021 by Markus Scheidgen API backlog feature gui
- 0
updated May 13, 2022
GUI: lack of delete functionality in the table of uploads

#637 · created Oct 19, 2021 by Mohammad Nakhaee backlog feature gui
- 1
updated May 13, 2022
V1 API client library

#561 · created Jun 18, 2021 by Markus Scheidgen API backlog feature
- 0
updated Mar 15, 2022
Show experimental method"s" in the search GUI

#615 · created Sep 24, 2021 by Markus Scheidgen backlog feature gui
- CLOSED
- 3
updated Dec 22, 2021
Explicit datamodel support for external databases 2 of 3 tasks completed

#330 · created Apr 30, 2020 by Markus Scheidgen v0.10.0 2 backlog feature
- 1
updated Dec 22, 2021
Add categories for normalized metadata

#438 · created Oct 23, 2020 by Lauri Himanen backlog feature metainfo
- 0
updated Jun 17, 2021
Add Pandas object (datatype) support to NOMAD

#501 · created Feb 24, 2021 by Aviral Vaid 1 backlog feature metainfo
- 1
updated Jun 17, 2021
Parser telemetry for the new parser framework

#467 · created Jan 15, 2021 by Markus Scheidgen backlog feature
- 0
updated Jun 18, 2021
A fastapi re-implementation of the "encyclopedia" API

#454 · created Dec 03, 2020 by Markus Scheidgen API backlog encyclopedia feature refactor
- CLOSED
- 2
updated May 06, 2021
Automatically add handles to the mpg handle systems

#198 · created Aug 08, 2019 by Markus Scheidgen 4 backlog feature
- 0
updated Aug 13, 2020
Hierarchical or categorized repository metadata

#276 · created Feb 10, 2020 by Lauri Himanen 8 backlog feature gui metainfo
- CLOSED
- 0
updated Aug 13, 2020
Simulations dynamically handled by ASE

#289 · created Feb 21, 2020 by Cuauhtemoc Salazar 8 backlog feature metainfo parsers
- 0
updated Sep 16, 2020
Implement mirror functions that are fit to be used with external NOMAD deployments 2 of 2 tasks completed

#288 · created Feb 21, 2020 by Markus Scheidgen NOMAD OASIS bugfixes feature ops
- CLOSED
- 0
updated Mar 25, 2020
Overhaul the file handling 0 of 5 tasks completed

#208 · created Sep 02, 2019 by Markus Scheidgen 4 backlog feature refactor
- CLOSED
- 1
updated May 13, 2022
Handle dependency evolution 0 of 6 tasks completed

#128 · created Mar 14, 2019 by Markus Scheidgen backlog feature ops refactor
- CLOSED
- 3
updated Apr 08, 2020
Expect compressed main files

#55 · created Oct 04, 2018 by Markus Scheidgen 1 feature
- CLOSED
- 1
updated Feb 12, 2019
GUI elements should keep state

#32 · created Sep 06, 2018 by Markus Scheidgen 2 feature
- CLOSED
- 1
updated Aug 09, 2019
Adding users

#14 · created Aug 24, 2018 by Markus Scheidgen 8 feature
- CLOSED
- 1
updated Aug 09, 2019
Provide features for data "curation"

#58 · created Oct 08, 2018 by Markus Scheidgen 8 feature
- CLOSED
- 1
updated Aug 09, 2019
Redesign of "datasets"

#71 · created Dec 13, 2018 by Markus Scheidgen backlog feature
- CLOSED
- 5
updated Dec 20, 2019
Create a new user management based on keycloak (OAuth) 12 of 12 tasks completed

#195 · created Aug 08, 2019 by Markus Scheidgen A replacement for the NOMAD CoE Repository 4 current feature ops
- CLOSED
- 0
updated Sep 02, 2019
Create API editing capabilities for user metadata based on ES queries 4 of 4 tasks completed

#196 · created Aug 08, 2019 by Markus Scheidgen A replacement for the NOMAD CoE Repository 8 current feature
- CLOSED
- 0
updated Nov 04, 2019
Create API DOI assign capabilities

#197 · created Aug 08, 2019 by Markus Scheidgen A replacement for the NOMAD CoE Repository 4 current feature
- CLOSED
- 0
updated Nov 12, 2019
Next round of parsers and normalizers

#9 · created Aug 24, 2018 by Markus Scheidgen feature
- CLOSED
- 2
updated Dec 13, 2018
Adding *files* to nomad-xt

#8 · created Aug 24, 2018 by Markus Scheidgen 4 feature
- CLOSED
- 0
updated Dec 13, 2018
Add client functions to reproduce errors based on archive_id

#54 · created Oct 04, 2018 by Markus Scheidgen 1 feature
- CLOSED
- 0
updated Dec 13, 2018
Sanatizing events vs. messages in logs

#56 · created Oct 04, 2018 by Markus Scheidgen 1 feature
- CLOSED
- 0
updated Dec 13, 2018
Processing meta data in archive/metainfo

#50 · created Oct 02, 2018 by Markus Scheidgen 2 feature
- CLOSED
- 0
updated Nov 26, 2021
Search api (compatible with coe repository)

#62 · created Nov 02, 2018 by Markus Scheidgen 4 feature
- CLOSED
- 1
updated Dec 13, 2018
Add size metrics to processing APM

#53 · created Oct 03, 2018 by Markus Scheidgen 1 feature
- CLOSED
- 0
updated Dec 13, 2018
Bulk download API

#57 · created Oct 08, 2018 by Markus Scheidgen 2 feature
- CLOSED
- 1
updated Dec 13, 2018
Repo implementation that stores parsed in NOMAD-coe repository

#66 · created Nov 05, 2018 by Markus Scheidgen 4 feature
- CLOSED
- 2
updated Dec 13, 2018
Mimic repo upload url, if possible

#64 · created Nov 05, 2018 by Markus Scheidgen 1 feature
- CLOSED
- 0
updated Dec 13, 2018
Further abstraction for archive and repository

#67 · created Nov 05, 2018 by Markus Scheidgen 2 feature
- CLOSED
- 1
updated Dec 13, 2018
Use bag-it to persist raw data

#63 · created Nov 05, 2018 by Markus Scheidgen 4 feature
- CLOSED
- 0
updated Dec 13, 2018
Swagger API 4 of 4 tasks completed

#75 · created Dec 23, 2018 by Markus Scheidgen repo/archive consolidation 2 feature refactor
- CLOSED
- 0
updated Dec 23, 2018
Admin user and restrictions for administrative API endpoints

#77 · created Dec 23, 2018 by Markus Scheidgen repo/archive consolidation 1 feature ops
- CLOSED
- 0
updated Dec 23, 2018
Support FTP for upload

#78 · created Dec 23, 2018 by Markus Scheidgen backlog feature ops
- CLOSED
- 2
updated May 13, 2022
Parallelize migration

#120 · created Feb 27, 2019 by Markus Scheidgen repo/archive consolidation feature
- CLOSED
- 1
updated Mar 05, 2019
Check for RESTRICTED file in uploads

#113 · created Feb 20, 2019 by Markus Scheidgen repo/archive consolidation 1 feature
- CLOSED
- 0
updated Feb 27, 2019
Minimal vasp OUTCAR parser

#93 · created Jan 18, 2019 by Markus Scheidgen repo/archive consolidation 2 feature
- CLOSED
- 0
updated Feb 04, 2019
Adopt the nomad@FAIRDI prototype GUI to become the statging GUI 6 of 10 tasks completed

#89 · created Jan 04, 2019 by Markus Scheidgen repo/archive consolidation 8 feature refactor
- CLOSED
- 1
updated Jan 31, 2019
coe->fairdi parser integration

#85 · created Dec 23, 2018 by Markus Scheidgen repo/archive consolidation feature
- CLOSED
- 2
updated Apr 01, 2019
Allow to publish failed calcs.

#134 · created Mar 19, 2019 by Markus Scheidgen migration finished 1 feature
- CLOSED
- 0
updated Mar 25, 2019
Further parallise packaging to allow package of large aflowlib uploads

#136 · created Mar 28, 2019 by Markus Scheidgen migration finished 1 feature
- CLOSED
- 0
updated Apr 01, 2019
Make domain specific metadata configurable 4 of 4 tasks completed

#131 · created Mar 19, 2019 by Markus Scheidgen Experimental nomad 4 feature refactor
- CLOSED
- 0
updated Apr 12, 2019
Repository integration mode for mimicking old python API 3 of 3 tasks completed

#159 · created Jun 25, 2019 by Markus Scheidgen baseline repository integration 2 feature
- CLOSED
- 0
updated Jul 04, 2019
Limit of unpublished uploads

#163 · created Jun 25, 2019 by Markus Scheidgen 1 feature
- CLOSED
- 0
updated Jul 04, 2019
Upload administation commands 4 of 6 tasks completed

#166 · created Jul 02, 2019 by Markus Scheidgen baseline repository integration 1 feature ops
- CLOSED
- 1
updated Jul 04, 2019
Improved upload view 4 of 4 tasks completed

#164 · created Jun 25, 2019 by Markus Scheidgen 4 feature refactor
- CLOSED
- 0
updated Jul 04, 2019
Cache bust on version change

#168 · created Jul 04, 2019 by Markus Scheidgen baseline repository integration 1 feature ops
- CLOSED
- 0
updated Jul 04, 2019
Allow to update the coe db

#138 · created Apr 01, 2019 by Markus Scheidgen migration finished 2 feature
- CLOSED
- 1
updated Apr 26, 2019
Manage broken task via the nomad cli 3 of 6 tasks completed

#132 · created Mar 19, 2019 by Markus Scheidgen backlog feature
- CLOSED
- 2
updated Feb 21, 2020
Allow to reprocess calculations (via API)

#139 · created Apr 01, 2019 by Markus Scheidgen migration finished 2 feature
- CLOSED
- 0
updated May 03, 2019
Elastic aggregation based search interface

#18 · created Aug 24, 2018 by Markus Scheidgen backlog feature
- CLOSED
- 0
updated Mar 19, 2019
Migration based on extracted files 4 of 4 tasks completed

#111 · created Feb 20, 2019 by Markus Scheidgen repo/archive consolidation 2 feature
- CLOSED
- 0
updated Feb 27, 2019
Separate celery tasks for uploads and calcs

#121 · created Feb 27, 2019 by Markus Scheidgen repo/archive consolidation feature
- CLOSED
- 0
updated Mar 01, 2019
Dataset update with the Repo API

#122 · created Feb 27, 2019 by Nicolas Fabas feature
- CLOSED
- 1
updated Jan 28, 2020
Added parser/normalizer/nomad version+git hash to calc metadata

#135 · created Mar 19, 2019 by Markus Scheidgen migration finished 1 feature
- CLOSED
- 0
updated Apr 01, 2019
Integrate 'gang of 3' experimental parsers and metadata

#146 · created Apr 25, 2019 by Markus Scheidgen Experimental nomad 2 feature
- CLOSED
- 0
updated Jun 25, 2019
Strip POTCAR Vasp files

#150 · created Apr 29, 2019 by Markus Scheidgen migration finished 2 feature
- CLOSED
- 0
updated Apr 30, 2019
Remove the necessity to run gitinfo.sh

#156 · created May 07, 2019 by Markus Scheidgen 1 feature ops
- CLOSED
- 0
updated May 07, 2019
Improve admin commands 2 of 2 tasks completed

#167 · created Jul 03, 2019 by Markus Scheidgen 1 bugfixes feature ops
- CLOSED
- 0
updated Jul 31, 2019
The download command needs a copy button

#177 · created Jul 22, 2019 by Markus Scheidgen A replacement for the NOMAD CoE Repository feature gui
- CLOSED
- 1
- 0
updated Aug 08, 2019
Individual cookie-based anonymous accounts

#180 · created Jul 23, 2019 by Markus Scheidgen backlog feature
- CLOSED
- 1
updated Jan 11, 2021
Allow to search for authors and comments

#185 · created Jul 30, 2019 by Markus Scheidgen A replacement for the NOMAD CoE Repository 1 feature
- CLOSED
- 0
updated Jul 31, 2019
A better and more "standard" help system

#191 · created Aug 05, 2019 by Markus Scheidgen Production uploads 1 feature gui refactor
- CLOSED
- 0
updated Aug 07, 2019
EU cookie law thing

#192 · created Aug 05, 2019 by Markus Scheidgen Production uploads 1 feature gui
- CLOSED
- 0
updated Aug 06, 2019
Command that provides often requested statistics data 3 of 4 tasks completed

#194 · created Aug 07, 2019 by Markus Scheidgen 1 feature
- CLOSED
- 0
updated Aug 15, 2019
EU privacy friendly GUI Analytics tracking.

#199 · created Aug 08, 2019 by Markus Scheidgen Version 0.8.1 1 bugfixes feature ops
- CLOSED
- 2
updated Jun 18, 2020
Email cc to webmaster after processing/begin processing.

#202 · created Aug 20, 2019 by Markus Scheidgen 1 bugfixes feature
- CLOSED
- 0
updated Aug 26, 2019
A new archive format and query ("graphQL") support 5 of 5 tasks completed

#223 · created Oct 25, 2019 by Markus Scheidgen Version 0.8 8 current feature refactor
- CLOSED
- 5
updated Mar 02, 2020
Allow normalizer to access related calculations

#251 · created Jan 17, 2020 by Markus Scheidgen encyclopedia uses the archive 2 current feature
- CLOSED
- 1
updated Apr 30, 2020
Visual representation of user metadata and quantities in search

#232 · created Nov 14, 2019 by Markus Scheidgen Version 0.8 4 current feature gui
- CLOSED
- 0
updated Apr 06, 2020
Search and show datasets 0 of 3 tasks completed

#211 · created Sep 03, 2019 by Markus Scheidgen A replacement for the NOMAD CoE Repository 1 bugfixes feature
- CLOSED
- 0
updated Sep 13, 2019
Show calculation by PIDs 2 of 2 tasks completed

#212 · created Sep 03, 2019 by Markus Scheidgen A replacement for the NOMAD CoE Repository 2 bugfixes feature refactor
- CLOSED
- 1
- 0
updated Sep 10, 2019
Allow code based raw ids and use FHI uuid as example

#218 · created Oct 10, 2019 by Markus Scheidgen Optimade 1 bugfixes feature
- CLOSED
- 0
updated Oct 10, 2019
Only download certain files upon /raw/query

#220 · created Oct 25, 2019 by Markus Scheidgen 1 bugfixes feature
- CLOSED
- 0
updated Oct 25, 2019
Add a manifest to raw file downloads

#225 · created Oct 31, 2019 by Markus Scheidgen 1 bugfixes feature
- CLOSED
- 0
updated Oct 31, 2019
Optimade 1.0.0

#325 · created Apr 29, 2020 by Markus Scheidgen Version 0.8.2 bugfixes feature
- CLOSED
- 5
updated Jul 16, 2020