Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
SaQC
Manage
Activity
Members
Labels
Plan
Issues
36
Issue boards
Milestones
Wiki
Code
Merge requests
8
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Build
Pipelines
Jobs
Pipeline schedules
Artifacts
Deploy
Releases
Container Registry
Model registry
Operate
Environments
Monitor
Incidents
Service Desk
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Terms and privacy
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
rdm-software
SaQC
Commits
962087fe
Commit
962087fe
authored
1 year ago
by
David Schäfer
Browse files
Options
Downloads
Plain Diff
Merge branch 'breaks-docstrings' into 'develop'
Breaks docstrings See merge request
!720
parents
09e1d7d0
cc050f18
No related branches found
Branches containing commit
No related tags found
Tags containing commit
1 merge request
!720
Breaks docstrings
Pipeline
#185748
passed with stages
in 5 minutes and 18 seconds
Changes
1
Pipelines
4
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
saqc/funcs/breaks.py
+15
-16
15 additions, 16 deletions
saqc/funcs/breaks.py
with
15 additions
and
16 deletions
saqc/funcs/breaks.py
+
15
−
16
View file @
962087fe
...
...
@@ -83,7 +83,7 @@ class BreaksMixin:
group_window :
Maximum size of a data chunk to consider it a candidate for an isolated group.
Data chunks that are bigger than the
`
`group_window`
`
are ignored.
Data chunks that are bigger than the
:py:attr:
`group_window` are ignored.
This does not include the possible gaps surrounding it.
See condition (1).
...
...
@@ -143,11 +143,11 @@ class BreaksMixin:
"""
Flag jumps and drops in data.
Flag data where the mean of its values significantly changes (
,
where the data
"
jumps
"
from one
value level to
another).
Th
e changes
in value level
are detected by comparing the mean for two adjacent
ly
rolling windows.
Whenever
the difference between the mean in the two windows exceeds `thresh`, the value between
the windows
is flagged
a jump
.
Flag data where the mean of its values significantly changes (where the data
"
jumps
"
from one
value level to
another).
Valu
e changes are detected by comparing the mean for two adjacent rolling windows.
Whenever
the difference between the mean in the two windows exceeds
py:attr:
`thresh`, the value between
the windows
is flagged.
Parameters
----------
...
...
@@ -155,22 +155,21 @@ class BreaksMixin:
Threshold value by which the mean of data has to jump, to trigger flagging.
window :
Size of the two moving windows. This determines the number of observations used
for
calculating the mean in every window.
The window size should be big enough to yield enough samples for a reliable mean calculation,
but it should also not be arbitrarily big, since
it also limits the density of jumps that can be detected.
More precisely: Jumps that are not distanced to each other by more than three fourth (3/4)
of the
selected window size, will not be detected reliably.
Size of the two moving windows. This determines the number of observations used
for
calculating the mean in every window.
The window size should be big enough to yield enough
samples for a reliable mean calculation, but it should also not be arbitrarily big, since
it also limits the density of jumps that can be detected.
More precisely: Jumps that are not distanced to each other by more than three fourth (3/4)
of the
selected
py:attr:`
window
`
size, will not be detected reliably.
min_periods :
The minimum number of observations in window required to calculate a valid
mean value.
The minimum number of observations in py:attr:`window` required to calculate a valid mean value.
Examples
--------
Below picture gives an abstract interpretation of the parameter interplay in case of a positive
value jump,
initialising a new mean level.
Below picture gives an abstract interpretation of the parameter interplay in case of a positive
value jump,
initialising a new mean level.
.. figure:: /resources/images/flagJumpsPic.png
...
...
This diff is collapsed.
Click to expand it.
Preview
0%
Loading
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment