Skip to content
Snippets Groups Projects
CHANGELOG.md 4.47 KiB
Newer Older
<!--
SPDX-FileCopyrightText: 2021 Helmholtz-Zentrum für Umweltforschung GmbH - UFZ

SPDX-License-Identifier: GPL-3.0-or-later
-->

David Schäfer's avatar
David Schäfer committed
# Changelog

This changelog starts with version 2.0.0. Basically all parts of the system, including the format of this changelog, have been reworked between the releases 1.4 and 2.0. Preceding the major breaking release 2.0, the maintenance of this file was rather sloppy, so we won't provide a detailed change history for early versions.
Norman Ziegner's avatar
Norman Ziegner committed
## Unreleased
[List of commits](https://git.ufz.de/rdm-software/saqc/-/compare/v2.0.1...develop)

David Schäfer's avatar
David Schäfer committed
### Added
Peter Lünenschloß's avatar
Peter Lünenschloß committed
- global keywords documentation resource added
Peter Lünenschloß's avatar
Peter Lünenschloß committed
- generic documentation module `docurator.py` added to `lib`
Peter Lünenschloß's avatar
Peter Lünenschloß committed
- flagging constants documentation resource added
Bert Palm's avatar
Bert Palm committed
- `pytest.ini`: to setup default path and markers for pytest
- new function `progagateFlags`
- *sphinx-doc*: automatically scrape typehints from signature and include those into the parameter section
### Changed
- renamed `History.max` to renamed `History.squeeze`
Peter Lünenschloß's avatar
Peter Lünenschloß committed
- documentation pipeline changed to base on methods decorators
Peter Lünenschloß's avatar
Peter Lünenschloß committed
- `flagOffsets` parameters `thresh` and `thresh_relative` now both are optional
- flags concatenation tasks (for squeezed and explicit histories) are now all channeled through the function `concatFlags`
- corrected false notion of *residual* concept (old notion: *residue* got replaced by *residual*)
- constants `FILTER_NONE` and `FILTER_ALL` are now imported to `saqc.__init__`
Peter Lünenschloß's avatar
Peter Lünenschloß committed
- renamed `maskTime` to `selectTime`
Bert Palm's avatar
Bert Palm committed
- `.gitlab-ci.py`: always run all pytest-tests in CI/CD pipelines
- `.gitlab-ci.py`: use reports to enable `Tests` in CI/CD pipeline results
- `procGeneric`: changed default `flag` value to `np.nan`
- `SaQC.data` returns `dios.DictOfSeries`
- `SaQC.flags` returns `dios.DictOfSeries` or `pd.DataFrame`
- `SaQC` data attributes are not mutated by method calls
### Removed
- data accessors `SaQC.result`, `SaQC.data_raw`, `SaQC.flags_raw`

### Fixed
Peter Lünenschloß's avatar
Peter Lünenschloß committed
- `flagOffset` bug with zero-valued threshold
- `flagCrossStatistics` bug with unaligned input variables
- `plot` fixed data loss when using *dfilter* kwarg
- `DmpScheme`: set `DFILTER_DEFAULT` to 1 in order to not mask the flag 'OK'
- `correctDrift`: fixed bug when correcting single value intervals
Peter Lünenschloß's avatar
Peter Lünenschloß committed
- `concatFlags`: fixed bug in context of squeezed history appending (UNTOUCHED vs UNFLAGGED information now doesnt get lost)
Peter Lünenschloß's avatar
Peter Lünenschloß committed
- `interpolateInvalid`: Fix: replacement of flags for interpolated values now works
Peter Lünenschloß's avatar
Peter Lünenschloß committed
- `resample`: resampling func now actually gets passed on to `history.appy()`
Peter Lünenschloß's avatar
Peter Lünenschloß committed
- `tools.seasonalMask`: fixed bug that swaps the entire mask upon `include_bounds=True`
- `flagGeneric`:
  - fixed inconsistent history meta writing
  - fixed handling of existing flags
- `proGeneeric`: fixed inconsistent history meta writing
Peter Lünenschloß's avatar
Peter Lünenschloß committed
- `sphinx-doc`: removed documentation of data/flags parameters from automatic sphinx doc
Norman Ziegner's avatar
Norman Ziegner committed
## [2.0.1](https://git.ufz.de/rdm-software/saqc/-/tags/v2.0.1) - 2021-12-20
[List of commits](https://git.ufz.de/rdm-software/saqc/-/compare/v2.0.0...v2.0.1)
### Added
- CLI now accepts remote configuration and data files as URL
- new function `transferFlags`
David Schäfer's avatar
David Schäfer committed
- improved error messages from `flagGeneric` and `processGeneric`
- new `ax_kwargs` keyword to `SaQC.plot` function
David Schäfer's avatar
David Schäfer committed
### Changed
- generate documentation from the `develop` branch
- doctest is now ran upon push to the `develop` branch, failing doc snippets cause CI-pipeline to fail
- renamed function `flagCrossStatistic` to `flagCrossStatistics`
David Schäfer's avatar
David Schäfer committed
### Removed
David Schäfer's avatar
David Schäfer committed
- removed function `flagDriftFromScaledNorm`
- removed `stats` keywords and functionality from `SaQC.plot` function
David Schäfer's avatar
David Schäfer committed
### Fixed
- RDM/UFZ logos:
  - use the English versions of the respective images
  - use full URLs instead of the repository local URLs in `README.md`
- fix code snippets in `README.md`
David Schäfer's avatar
David Schäfer committed
- fix version confusion
- `copyField`: fix misleading error message
David Schäfer's avatar
David Schäfer committed
- `flagGeneric`: fix failure on empty data
David Schäfer's avatar
David Schäfer committed
- existing `target` variables led to function calls on `target` instead of `field`
- the functions `flagDriftFromNorm`, `flagDriftFromReference`, `flagCrossStatistics` and `flagMVScores` now properly support the field-target workflow
David Schäfer's avatar
David Schäfer committed
- `field` was not masked for resampling functions
- allow custom registered functions to overwrite built-ins.
Norman Ziegner's avatar
Norman Ziegner committed
## [2.0.0](https://git.ufz.de/rdm-software/saqc/-/tags/v2.0.0) - 2021-11-25
[List of commits](https://git.ufz.de/rdm-software/saqc/-/compare/v1.5.0...v2.0.0)

David Schäfer's avatar
David Schäfer committed
This release marks the beginning of a new release cycle. Basically the entire system got reworked between versions 1.4 and 2.0, a detailed changelog is not recoverable and/or useful.