data_progs merge requestshttps://git.ufz.de/chs/data_progs/-/merge_requests2023-08-23T11:01:10+02:00https://git.ufz.de/chs/data_progs/-/merge_requests/37V32023-08-23T11:01:10+02:00Alexander HinzV3Alexander HinzAlexander Hinzhttps://git.ufz.de/chs/data_progs/-/merge_requests/36Reduce2023-08-21T11:14:38+02:00Alexander HinzReduceAlexander HinzAlexander Hinzhttps://git.ufz.de/chs/data_progs/-/merge_requests/35Dendro2023-05-22T14:14:35+02:00Alexander HinzDendroAlexander HinzAlexander Hinzhttps://git.ufz.de/chs/data_progs/-/merge_requests/34V32023-07-11T11:06:27+02:00Alexander HinzV3Alexander HinzAlexander Hinzhttps://git.ufz.de/chs/data_progs/-/merge_requests/33Dendro2023-05-04T16:32:38+02:00Alexander HinzDendroAlexander HinzAlexander Hinzhttps://git.ufz.de/chs/data_progs/-/merge_requests/32Storage2023-08-25T10:36:13+02:00Alexander HinzStorageAlexander HinzAlexander Hinzhttps://git.ufz.de/chs/data_progs/-/merge_requests/31Dendro2023-03-08T16:18:26+01:00Alexander HinzDendroDavid Schäferdavid.schaefer@ufz.deDavid Schäferdavid.schaefer@ufz.dehttps://git.ufz.de/chs/data_progs/-/merge_requests/30Storage2023-03-24T11:34:26+01:00Alexander HinzStorage@schaefed@schaefedhttps://git.ufz.de/chs/data_progs/-/merge_requests/29Aggregate2023-06-06T12:24:07+02:00Alexander HinzAggregate@schaefed@schaefedAlexander HinzAlexander Hinzhttps://git.ufz.de/chs/data_progs/-/merge_requests/28Dendro2023-03-06T11:21:30+01:00Alexander HinzDendro@schaefed@schaefedhttps://git.ufz.de/chs/data_progs/-/merge_requests/27update level1/do_aggregate_logger.py: insert new rules to generate a 91 flag2022-12-07T13:21:50+01:00Alexander Hinzupdate level1/do_aggregate_logger.py: insert new rules to generate a 91 flag@schaefed@schaefedAlexander HinzAlexander Hinzhttps://git.ufz.de/chs/data_progs/-/merge_requests/26aggregate_logger: fix bug with timestamp at beginning of the new year2022-02-07T11:56:12+01:00Alexander Hinzaggregate_logger: fix bug with timestamp at beginning of the new year@schaefed
The problem was, that a a aggregated year should start with the timestamp 00:30 when aggregated to 30 minutes and with the 01.01. when aggregated to a whole day.\
The new solution seems to be a bit hacky.\
In the `writeData` ...@schaefed
The problem was, that a a aggregated year should start with the timestamp 00:30 when aggregated to 30 minutes and with the 01.01. when aggregated to a whole day.\
The new solution seems to be a bit hacky.\
In the `writeData` function a `freq` is needed (I renamed is to `change_freq`) for the `iterDataFreq(data, change_freq)` function in _dacces.py_ Until now `change_freq=y`, that isn't even listed in `freqs` dictionary in the `iterDataFreq` function in _dacces.py_ , but it works only for aggregation for 1d, not for the 30min aggregation.\
For the 30min it works with `change_freq=yearly`.\
Maybe you have an idea how to solve this better.https://git.ufz.de/chs/data_progs/-/merge_requests/25dendro_calculation: fix writing process and improve calculation process2021-12-20T16:26:35+01:00Alexander Hinzdendro_calculation: fix writing process and improve calculation process@schaefed
- a fix in the writing process (now the timeindex of the old file is recognized as timestamp and not as string)
- a improve in the calculation process, a loop is formed in better way@schaefed
- a fix in the writing process (now the timeindex of the old file is recognized as timestamp and not as string)
- a improve in the calculation process, a loop is formed in better wayhttps://git.ufz.de/chs/data_progs/-/merge_requests/24Master2021-10-05T15:30:00+02:00Alexander HinzMaster@schaefed
Changes to make doall useable
and change the write Data function. It now reads the old file on the server and adds the new data to it.@schaefed
Changes to make doall useable
and change the write Data function. It now reads the old file on the server and adds the new data to it.https://git.ufz.de/chs/data_progs/-/merge_requests/23Major rework of the entire pipeline2023-08-25T11:43:19+02:00David Schäferdavid.schaefer@ufz.deMajor rework of the entire pipelinePre merge TODOs:
- [x] remove `lib.devices.Device.getL1DataOld`
- [x] remove `lib.tools.do_cache_meteo`
- [x] remove all unused/obsolete programs
- [x] remove all unused/obsolete methods and functions
- [ ] remove all unused/obsolete col...Pre merge TODOs:
- [x] remove `lib.devices.Device.getL1DataOld`
- [x] remove `lib.tools.do_cache_meteo`
- [x] remove all unused/obsolete programs
- [x] remove all unused/obsolete methods and functions
- [ ] remove all unused/obsolete column from the configuration files
- [x] run `black`
- [ ] some test (integration test, based on `snakemake` ?)David Schäferdavid.schaefer@ufz.deDavid Schäferdavid.schaefer@ufz.dehttps://git.ufz.de/chs/data_progs/-/merge_requests/22do_aggegrate_logger update for freq 1D2021-08-27T10:07:04+02:00Alexander Hinzdo_aggegrate_logger update for freq 1D@schaefed changes in do_aggegate_logger for the requested adaption of time index@schaefed changes in do_aggegate_logger for the requested adaption of time indexhttps://git.ufz.de/chs/data_progs/-/merge_requests/21Dendro2021-07-09T12:37:51+02:00Alexander HinzDendro@schaefed@schaefedhttps://git.ufz.de/chs/data_progs/-/merge_requests/20update readManflagsFile function to get more data2021-03-23T15:07:05+01:00Alexander Hinzupdate readManflagsFile function to get more dataMerge Request like described in Issue
@schaefedMerge Request like described in Issue
@schaefedhttps://git.ufz.de/chs/data_progs/-/merge_requests/19update requierements and add aggregation script2021-03-04T09:12:07+01:00Alexander Hinzupdate requierements and add aggregation script@schaefed@schaefedhttps://git.ufz.de/chs/data_progs/-/merge_requests/18Logger aggregation2020-11-23T11:29:27+01:00Alexander HinzLogger aggregation@schaefed@schaefed