Commit Graph

32 Commits (5b00454a1bba2f0a5570711a1968aeba4748ca51)

Author SHA1 Message Date
rebuilt 5b00454a1b ECP-125 feat:
7 months ago
rebuilt 0f457becf0 feat: create a parents by language graph
7 months ago
Nelson Jovel 7e98f7446c fix: tests
1 year ago
Nelson Jovel beb93aa8e8 fix: make sure all likert scores get counted even when the survey item id has different capitalization. Add tests for uploading parent data. Change the parent response rate calcuation to count all students in the school instead of just for the grades that were given the student survey
1 year ago
Nelson Jovel 3ecc68edd0 chore: correct parsing for 'not sped' and 'lep not first year'
1 year ago
Nelson Jovel b1f942133b update parsing rules from glossary
2 years ago
Nelson Jovel ea2feb138b add disaggregation glossary
2 years ago
Nelson Jovel 927fae1afd chore: add a test for categorizing sped values of 1 and 0 as 'Special Education' and 'Not Special Education'
2 years ago
Nelson Jovel 8bb6f5e8f0 Add ell income and sped parsing rules for SIS data. Add tests for the
2 years ago
Nelson Jovel 33da0859b9 Split academic year into seasons if the academic year's range is
2 years ago
Gabe Farrell 5789ebf564 Faster admin data loader + rename School.school_hash
2 years ago
Nelson Jovel 289b04bc69 match an additional format for Dates. Supported dates are now '1/10/2022 14:21:45' '2022-1-10T14:21:45' '2022-1-10 14:21:45'
2 years ago
Nelson Jovel d6735d449d feat: Support two date formats: ISO 8601 and the standard US date format
2 years ago
Nelson Jovel ed07114a91 fix: fix failing tests
2 years ago
Nelson Jovel 36e21515c3 chore: refactor Race out of survey_item_values
2 years ago
Nelson Jovel e7fb009425 chore: refactor Gender out out of survey_item_values row
2 years ago
Nelson Jovel 41d942c214 chore: Make sure 'hispanic' column only gets applied when using SIS race information
2 years ago
Nelson Jovel d90a83e510 fix: instead of looking for 'asian' at the start of a word, look for it
2 years ago
Nelson Jovel 3f44613085 chore: various fixes for race and gender categorization during cleaning.
2 years ago
Nelson Jovel b7e670bb60 Lower threshold for the number of valid student responses from 17 to 11
2 years ago
Nelson Jovel e325f38c43 Convert gender and race text into qualtrics codes during cleaning. Abide by 'prefer not to disclose' for self reported race. Give priority to self reported data but use SIS information as backup
2 years ago
Nelson Jovel b63c327d33 chore: when searching for dese id, split up pattern so that to be more explicit about the order in which to search out the columns that might have the dese ID we're looking for.
2 years ago
rebuilt e3fbbabce5 feat: We no longer trust the progress number that gets exported from qualtrics. Instead during the cleaning progress, perform a manual count of the number of responses to filter out rows that don't meet the minimum threshold.
2 years ago
rebuilt 48e795fcfb feat: add special education disaggregation
2 years ago
rebuilt 060d7aa55a Add disaggregation by ELL
2 years ago
rebuilt a785c69c44 Add Overall Response Rate
2 years ago
rebuilt 4f035f6a63 feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page
2 years ago
Nelson Jovel 0a2c5e02c5 feat: add ability to merge disaggregation data with raw survey data to
3 years ago
rebuilt 9aeb5f92af Missing progress or duration information does not result in a row removed in the cleaning process
3 years ago
rebuilt e3ae12b425 update response_date to recorded_date
3 years ago
rebuilt 8ef8cfce58 Adjust valid duration threshold of short form items
3 years ago
rebuilt 4509c157fa Add automated data cleaning. Modify SurveyItemValues class to use regex
3 years ago