Add automated data cleaning. Modify SurveyItemValues class to use regex

instead of hard coded values.  Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
This commit is contained in:
rebuilt 2023-05-02 20:08:34 -07:00
parent 5cf5a5f383
commit 4509c157fa
20 changed files with 1148 additions and 154 deletions

View file

@ -59,6 +59,8 @@ gem 'net-sftp'
gem 'ed25519'
gem 'bcrypt_pbkdf'
gem 'standard_deviation'
group :development, :test do
# Call 'byebug' anywhere in the code to stop execution and get a debugger console
gem 'byebug', platform: :mri