... | ... | @@ -2,39 +2,29 @@ |
|
|
|
|
|
This Wiki describes topics related to the development of the base Layer of the [NoMaD Laboratory](http://nomad-lab.eu/).
|
|
|
|
|
|
As described in the [Abstract for PsiK](Abstract for psik) the base layer tries to transfom the open access data of the [Nomad Repository](http://nomad-repository.eu/) in a normalized form suitable for analysis using flink.
|
|
|
|
|
|
The main Topics are
|
|
|
|
|
|
* [Infrastructure Hackathon][26]
|
|
|
* General development approach on the [public wiki][1]
|
|
|
* [Getting started][2] install, run,...
|
|
|
* [Work plan][3]
|
|
|
* [Code documentation][18] for core and the main libraries we use
|
|
|
* [GitLab gotchas][4]
|
|
|
* [Technology discussions][5] discussion of technological aspects sbt, scala, flink,...
|
|
|
* [NomadMetaInfo][6], the metadata used to describe the information stored in the laboratory
|
|
|
* [How to write a Parser][17], a description on how to get started with the simple_parser infrastructure
|
|
|
* [Writing Parsers using SmartParser][27], a document on how to use SmartParser, MetaInfoStorage and MDDataAccess packages to write flexible parsers.
|
|
|
* [Parser testing][25], discussion of ideas and tools for testing the parsers
|
|
|
* [Parsing][7], how do the parsers that normalize the calculation results work
|
|
|
* [Parser Assignment][8], who does which parser
|
|
|
* [Standard Json formats][9], the standarized formats to represent normalized data using json
|
|
|
* [Standard HDF5 formats][10], the standarized formats to represent normalized data using [HDF5](https://www.hdfgroup.org/HDF5)
|
|
|
* [Energy representation][11], how to have an energy that can be compared across codes/methods
|
|
|
* [Configuration representation][12], how to represent atomic configurations (structures)
|
|
|
* [Wave functions representation][13], how to represent wavefunctions in a code idependent way
|
|
|
* [NoMaD Base Layer][14], an overview of the base layer of the NoMaD Laboratory and its [hardware requirements][19].
|
|
|
As described in the [Abstract for PsiK](NOMAD/Abstract for psik) the base layer tries to transfom the open access data of the [Nomad Repository](http://nomad-repository.eu/) in a normalized form suitable for analysis using flink.
|
|
|
|
|
|
* [NOMAD](NOMAD/NOMAD_home) getting started and general information
|
|
|
|
|
|
* [Repository](Repository/Repository_home) the raw uploaded (zipped) data
|
|
|
|
|
|
* [Archive](Archive/Archive_home) the processed (parsed and normalized) data
|
|
|
|
|
|
* [Analytics](Analytics/Analytics_home) postprocessing of archive data
|
|
|
|
|
|
* [Internal](Internal/Internal_home)
|
|
|
|
|
|
* [Unsorted](Unsorted/Unsorted_home) Unsorted, everyone should move their pages here to the main structure; beware to not create duplicate information
|
|
|
|
|
|
* [DELETE](DELETE/DELETE_home) pages deemed outdated or useless, will be deleted soon, check if you need to keep something
|
|
|
|
|
|
* [Wiki](Wiki/Wiki_home)
|
|
|
|
|
|
* [Wiki Last Changes][16], last changes on this wiki
|
|
|
* [Raw data archive generation][20]
|
|
|
* [Nomad URIs][22]
|
|
|
* [Nomad archive for parser devs][21] , this describes access to labdev (useful for testing) amongst other things
|
|
|
* [Nomad query][23]
|
|
|
* Creating a [new Beaker image][24]
|
|
|
|
|
|
The work is still in an early phase, so expect outages and out of date information (which you are encouraged to fix).
|
|
|
# Disclaimer #
|
|
|
|
|
|
We try to announce plans and describe the current Status in [NoMaD Lab Base Status][15].
|
|
|
The work is still in an early phase, so expect outages and out of date information (which you are encouraged to fix).
|
|
|
|
|
|
# Mailing list #
|
|
|
|
... | ... | @@ -89,4 +79,4 @@ Use the edit button on this page or clone the wiki (See Git Access on page heade |
|
|
[24]:https://gitlab.mpcdf.mpg.de/nomad-lab/nomad-lab-base/wikis/beaker-image
|
|
|
[25]:https://gitlab.mpcdf.mpg.de/nomad-lab/nomad-lab-base/wikis/Parser-testing
|
|
|
[26]:https://gitlab.mpcdf.mpg.de/nomad-lab/nomad-lab-base/wikis/infra-hackathon
|
|
|
[27]:https://gitlab.mpcdf.mpg.de/nomad-lab/nomad-lab-base/wikis/Writing-parsers-using-SmartParser,-MetaInfoStorage,-and-MDDataAccess |
|
|
\ No newline at end of file |
|
|
[27]:https://gitlab.mpcdf.mpg.de/nomad-lab/nomad-lab-base/wikis/Writing-parsers-using-SmartParser,-MetaInfoStorage,-and-MDDataAccess |