9 Commits (a3f9e46414946dce0e3eee656f5f7013fd38c48e)

Author	SHA1	Message	Date
Nelson Jovel	a3f9e46414	chore: when searching for dese id, split up pattern so that to be more explicit about the order in which to search out the columns that might have the dese ID we're looking for.	2 years ago
rebuilt	b2fdbe5756	feat: We no longer trust the progress number that gets exported from qualtrics. Instead during the cleaning progress, perform a manual count of the number of responses to filter out rows that don't meet the minimum threshold.	2 years ago
rebuilt	ef44c41965	feat: add special education disaggregation	2 years ago
rebuilt	2fd56047d4	Add disaggregation by ELL	2 years ago
rebuilt	2ac30bb107	feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page	2 years ago
rebuilt	0f23053294	It's possible for admin data likert score values to be above 5. If that happens, we ... cap the likert score at 5. This was happening already at the scraper level but it's also now being done by the admin data loader for safety. Also make sure to just update admin data instead of deleting and reloading all values each load. Add tests to confirm this behavior	3 years ago
rebuilt	e058c523b6	Missing progress or duration information does not result in a row removed in the cleaning process	3 years ago
rebuilt	a71ebbc4e4	Add Overall Response Rate	3 years ago
rebuilt	dbfc9d1d3a	Add automated data cleaning. Modify SurveyItemValues class to use regex ... instead of hard coded values. Produce a clean csv and a csv with all the removed values and columns with reason for removal. Add script for running cleaning for each project	3 years ago