Add automated data cleaning. Modify SurveyItemValues class to use regex

instead of hard coded values.  Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
This commit is contained in:
rebuilt 2023-05-02 20:08:34 -07:00
parent 5cf5a5f383
commit 4509c157fa
20 changed files with 1148 additions and 154 deletions

View file

@ -394,6 +394,7 @@ GEM
actionpack (>= 5.2)
activesupport (>= 5.2)
sprockets (>= 3.0.0)
standard_deviation (1.0.3)
stimulus-rails (1.2.1)
railties (>= 6.0.0)
temple (0.10.0)
@ -485,6 +486,7 @@ DEPENDENCIES
solargraph-reek
spring
sprockets-rails
standard_deviation
stimulus-rails
timecop
turbo-rails