0a2c5e02c5
feat: add ability to merge disaggregation data with raw survey data to
...
produce a cleaned csv with merged income disaggregation columns
3 years ago
e2d24a9bec
Fix: make sure values don't get reordered after copying over row values from survey item variants. This fixes a problem where cleaner would produce a row with likert scores that got shifted to align with the wrong column
3 years ago
ddf9a628d5
Fix: enable correct detection of student surveys types by rejecting any
...
headers ending with '-1' (the variants of standard questions)
3 years ago
abe7a8804c
Don't check standard deviation for early education surveys
3 years ago
9aeb5f92af
Missing progress or duration information does not result in a row removed in the cleaning process
3 years ago
e3ae12b425
update response_date to recorded_date
3 years ago
8ef8cfce58
Adjust valid duration threshold of short form items
3 years ago
4509c157fa
Add automated data cleaning. Modify SurveyItemValues class to use regex
...
instead of hard coded values. Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
3 years ago
b250ebe415
Memoize schools in SurveyItemValues and academic_years in AcademicYear
...
for performace improvement
3 years ago
c15cb7b483
Change survey data loader spec to use factorybot objects instead of loading seeds. Change databasecleaner to use transaction. Add back babel-preset dependency to fix failing javascript test in production.
3 years ago
01851d8527
Make sure blank grades in csv load as nils instead of zeros
3 years ago
3a744db975
Start adding kindergarten
3 years ago
03c6bff7bb
Load survey responses from sftp folder
3 years ago
eeeb4f5d14
Add Stoklosa survey responses
3 years ago
d5533bb756
Support survey item variants. Survey item id's in the format s-sbel-q1-1 will load into s-sbel-q1
3 years ago
a1b7db9b2e
Add ability to load student demographic information for only lowell
3 years ago
Nelson Jovel