Follow-Up Translations

This merge requests incorporates the following changes/additions:

• Allow the use of translator specific keywords in function calls, e.g. comment and cause for the DmpTranslator
• Generate valid Historys from given input flags. The user flags usually lack information (i.e. concrete parameter values, order of function calls, ...) to infer a real history. I loosed the definition of the word valid, to 'rerunning the history inferred from a DataFrame of user flags on the same input data, needs to yield the same user flags again'
• Make the different translators available through the CLI (i.e. the exe)

mentioned in merge request !257 (closed)

added 14 commits

• 968f99c3 - fixed missing initial UNFLAGGED column on flags init
• 5a37213c - minor change
• 1bd36283 - fixed missing initial UNFLAGGED column on flags init
• a4c7491b - minor change
• 440adc21 - hardened flags and history
• b7e84d13 - accpet more argument types
• a14894f9 - usable defaults
• 69fd9a1d - fixed cyclic import
• 8f0efa65 - fixed positional translator, now that we have a stable init-column in History
• 842e521b - Merge remote-tracking branch 'origin/FlaxFix' into translations
• 96a668d4 - make translations runtrips reproducable
• 95f29b50 - Merge branch 'FlaxFix' of https://git.ufz.de/rdm-software/saqc into FlaxFix
• f3f9f096 - Merge branch 'FlaxFix' into translations
• 60dcc803 - fixed inconsistent dmp translation graph build

Compare with previous version

added 4 commits

• 4f492d52 - moved translator code into new core module
• 4452c3c4 - exclude translation arguments from function keyword checks
• 74326e3e - make translations available through the EXE
• 8edc193c - cleanups

Compare with previous version

added 18 commits

• 8edc193c...5c95fe4d - 16 commits from branch develop
• eeef7ee6 - Merge branch 'develop' into translations
• 2d9017e5 - Merge branch 'develop' into translations

Compare with previous version

added 2 commits

• 84e859b4 - [FIX] don't overwrite columns of input history
• 92c1a054 - [FIX] history merges in mapToOriginal may lead to an inconsistent history mask

Compare with previous version

added 5 commits

• 663155bd - undo broken [FIX]
• 01a73f0c - [FIX] history merges may lead to an inconsistent mask
• 0fc94e15 - [FIX] pass actual flags into generic
• 9d51a067 - [FIX] flagtools.flagUnflagged did not see the actual flags
• 5c97a4de - [FIX] breaks.flagIsolated was only flaggin nan values

Compare with previous version

added 1 commit

• 6143c92e - [FIX] excess history column for new variables through generic.flag

Compare with previous version

added 2 commits

• 3aa1804d - [FIX] outliers.flagOffset raises IndexError for all nan-data
• f454ae07 - [FIX] remove real-world memory usage by ~20% and runtime by ~3% through removal of Flags._cache

Compare with previous version

added 14 commits

• ea06005f - [FIX] don't overwrite columns of input history
• b3a98afe - [FIX] history merges may lead to an inconsistent mask
• 65cd7e30 - [FIX] pass actual flags into generic
• 1da172e8 - [FIX] flagtools.flagUnflagged did not see the actual flags
• 0119d7e1 - [FIX] breaks.flagIsolated was only flaggin nan values
• b2137c2a - [FIX] excess history column for new variables through generic.flag
• 734621f7 - [FIX] outliers.flagOffset raises IndexError for all nan-data
• e880fa7d - [FIX] remove real-world memory usage by ~20% and runtime by ~3% through removal of Flags._cache
• 8d2078d2 - [FIX] reduce runtime by ~45% (!) through the removal of builtins.any
• 0ffd8c04 - [FIX] reduce runtime by ~45% (!) through the removal of builtins.any
• 786ffd5e - Merge branch 'multifix' into translations
• 2f93f96a - [HACK] track variable renames
• 186188c9 - comments
• f0267bee - flags with type 'category' to heavily reduce memorey usage of saqc

Compare with previous version

added 1 commit

• 0618f5ee - trying to get the categoricals consistent (it's not going to be easy!)

Compare with previous version

added 1 commit

• 81cd2779 - backtrack variable naming changes through tools.rename

Compare with previous version

marked this merge request as ready

changed the description

assigned to @palmb

added 2 commits

• b52ff7b4 - DmpTranslator: enforce valid quality_cause
• d0a0d526 - Merge branch 'translations' of https://git.ufz.de/rdm-software/saqc into translations

Compare with previous version

resolved all threads

mentioned in merge request !269 (closed)

added 2 commits

• 758b26a3 - [FIX] reduce the memory consumption of SaQC by >50% through Histories of type pd.Categorical
• d2ae8d76 - changed SaQC parameter name

Compare with previous version