8 Commits (123b570bb943cc43916a554ffc1ae66f63221efb)

Author	SHA1	Message	Date
Nelson Jovel	123b570bb9	Detect and print message when there are duplicate headers during ... cleaning process	2 years ago
Nelson Jovel	6d84204f83	Add race and gender columns to cleaned cvs files when those headers are ... missing	2 years ago
Nelson Jovel	1b82ff9413	chore: since it's now possible for there to be multiple district and dese id columns separated by a dash and a number, be more explicit when we only want to filter out survey item ids that end in a -1	2 years ago
rebuilt	b2fdbe5756	feat: We no longer trust the progress number that gets exported from qualtrics. Instead during the cleaning progress, perform a manual count of the number of responses to filter out rows that don't meet the minimum threshold.	2 years ago
rebuilt	2fd56047d4	Add disaggregation by ELL	2 years ago
rebuilt	7bd7923d41	fix: ensure cleaner outputs columns for all survey items. Before the fix, if a survey item varient (ending in -1, ie s-tint-q1-1) did not have a matching survey item s-tint-q1, the resulting csv would not include that column	2 years ago
rebuilt	02a2c6cd97	Don't write a file if there's an empty dataset	3 years ago
rebuilt	dbfc9d1d3a	Add automated data cleaning. Modify SurveyItemValues class to use regex ... instead of hard coded values. Produce a clean csv and a csv with all the removed values and columns with reason for removal. Add script for running cleaning for each project	3 years ago