Dataprocessing features
Quite a lot minor movements/changes and some data processing tools
- introduced module
proc_functions, containing:
-
proc_interpolateMissing- a registered function for interpolation -
proc_resample- a resampler for timeseries, mimicing pandas .resample method, including parameters for "nan_control" -
proc_transform- function to apply timeseries transformations on the data
- trimmed down the
harm_functionsmodule:
- removed
from_merged/to_merged - removed
downsample(replaced byproc_functions.proc_resample) - moved/renamed its
_interpolatemethod tots_operators.interpolateNANs, since it is used now not only in harmonization context
- extended
ts_operatorsmodule:
-
interpolateNANsis a usual timeseries operator now and the strings '"linear"' and '"polynomial"', associated with wrappers ofinterpolateNANscan be passed as arguments to resampling/transformation procedures - extended transformation string syntax by the
$sign to allow parameter passing. passing"linear$3"refers to linear interpolation of up to 3 values and so on. (See details in doku -> doku comes soo)
- added test_module for processing functions
- its so boring to write tests