Nelson Jovel
8bebe7db42
chore: since it's now possible for there to be multiple district and dese id columns separated by a dash and a number, be more explicit when we only want to filter out survey item ids that end in a -1
2023-11-06 14:52:21 -08:00
rebuilt
e3fbbabce5
feat: We no longer trust the progress number that gets exported from qualtrics. Instead during the cleaning progress, perform a manual count of the number of responses to filter out rows that don't meet the minimum threshold.
2023-10-27 15:12:24 -07:00
rebuilt
48e795fcfb
feat: add special education disaggregation
2023-10-06 11:41:52 -07:00
rebuilt
060d7aa55a
Add disaggregation by ELL
2023-09-29 19:29:23 -07:00
rebuilt
714b90b3eb
fix: ensure cleaner outputs columns for all survey items. Before the fix, if a survey item varient (ending in -1, ie s-tint-q1-1) did not have a matching survey item s-tint-q1, the resulting csv would not include that column
2023-08-23 15:30:47 -07:00
Nelson Jovel
0a2c5e02c5
feat: add ability to merge disaggregation data with raw survey data to
...
produce a cleaned csv with merged income disaggregation columns
2023-06-20 12:22:24 -07:00
rebuilt
896f0d9961
Don't write a file if there's an empty dataset
2023-06-07 12:38:44 -07:00
rebuilt
93d087a5de
Use short district name for cleaned csv
2023-05-28 17:11:27 -07:00
rebuilt
4509c157fa
Add automated data cleaning. Modify SurveyItemValues class to use regex
...
instead of hard coded values. Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
2023-05-16 13:38:29 -07:00
