Commit Graph

18 Commits (cf5c4f2d1328263b910a1d69b9f5035a9a5aefbe)

Author SHA1 Message Date
Nelson Jovel 2561fa28fc feat: Split academic year into seasons if the academic year's range is
2 years ago
Nelson Jovel 67ffc996a8 Revert "Split academic year into seasons if the academic year's range is"
2 years ago
Nelson Jovel a5d4cccb37 Split academic year into seasons if the academic year's range is
2 years ago
Gabe Farrell 6fac759ec2 Faster admin data loader + rename School.school_hash
2 years ago
Nelson Jovel be5b63637b chore: alphabetize districts when writing filename for cleaned files
2 years ago
Nelson Jovel cc8ed48204 fix: no longer support 'form' in filename when cleaning. Only look for 'part X' and add that to the filename if it exists
2 years ago
Nelson Jovel 3e4ef9cb08 chore: refactor Gender out out of survey_item_values row
2 years ago
Nelson Jovel f28713d1fe chore: remove unneeded comment
2 years ago
Nelson Jovel ce43f52bd5 feat: if the filename includes the words 'form' or 'part' add that to the resulting cleaned filename
2 years ago
Nelson Jovel f27a590c5a Convert gender and race text into qualtrics codes during cleaning. Abide by 'prefer not to disclose' for self reported race. Give priority to self reported data but use SIS information as backup
2 years ago
Nelson Jovel 123b570bb9 Detect and print message when there are duplicate headers during
2 years ago
Nelson Jovel 6d84204f83 Add race and gender columns to cleaned cvs files when those headers are
2 years ago
Nelson Jovel 1b82ff9413 chore: since it's now possible for there to be multiple district and dese id columns separated by a dash and a number, be more explicit when we only want to filter out survey item ids that end in a -1
2 years ago
rebuilt b2fdbe5756 feat: We no longer trust the progress number that gets exported from qualtrics. Instead during the cleaning progress, perform a manual count of the number of responses to filter out rows that don't meet the minimum threshold.
2 years ago
rebuilt 2fd56047d4 Add disaggregation by ELL
2 years ago
rebuilt 7bd7923d41 fix: ensure cleaner outputs columns for all survey items. Before the fix, if a survey item varient (ending in -1, ie s-tint-q1-1) did not have a matching survey item s-tint-q1, the resulting csv would not include that column
2 years ago
rebuilt 02a2c6cd97 Don't write a file if there's an empty dataset
3 years ago
rebuilt dbfc9d1d3a Add automated data cleaning. Modify SurveyItemValues class to use regex
3 years ago