-
- Downloads
Integrated Pipeline: CalculationParsingFlow extracts to be processed rawdata...
Integrated Pipeline: CalculationParsingFlow extracts to be processed rawdata archives to a temporary directory -intended to be used with with a RAMdisk filesystem in production, thus the entire archive (at most 30 GB) is extracted once and shared by all workers instead of extracting worker-private copies of the required file-trees
Showing
- integrated-pipeline/src/main/scala/eu/nomad_lab/integrated_pipeline/Main.scala 5 additions, 2 deletions...rc/main/scala/eu/nomad_lab/integrated_pipeline/Main.scala
- integrated-pipeline/src/main/scala/eu/nomad_lab/integrated_pipeline/stream_components/CalculationParsingFlow.scala 2 additions, 1 deletion...d_pipeline/stream_components/CalculationParsingFlow.scala
- integrated-pipeline/src/test/scala/integrated_pipeline_tests/CalculationParsingFlowSpec.scala 11 additions, 1 deletion...ntegrated_pipeline_tests/CalculationParsingFlowSpec.scala
Loading
Please register or sign in to comment