Commit graph

16 commits

Author SHA1 Message Date
rebuilt
6503d6444f chore: correctly detect missing grade header 2025-03-20 13:15:21 -07:00
Nelson Jovel
c85ddddd8d feat: add parent survey gauges 2024-09-27 13:50:30 -07:00
Nelson Jovel
66dda0d30d chore: During cleaning, stop execution if grade column isn't found. Also stop execution if a duplicate header is found. Turn off spec for duplicate header check 2024-05-23 12:52:47 -07:00
Nelson Jovel
5a1db34a18 chore: add a way to print out errors in dese id when cleaning files 2024-05-16 15:11:04 -07:00
Nelson Jovel
ac5c1edfbf feat: Split academic year into seasons if the academic year's range is
initialized with a season, i.e. "2024-25 Fall".  Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly.   Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year.  So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring".  Add tests
for the new range format.  Set the default cutoff for the start of Spring season will be the last Sunday in February
2024-04-27 14:24:05 -07:00
b3e6efdb2e Faster admin data loader + rename School.school_hash 2024-04-22 16:21:43 -04:00
Nelson Jovel
8d596faeeb chore: alphabetize districts when writing filename for cleaned files 2024-02-23 11:28:42 -08:00
Nelson Jovel
e97e7047b1 fix: no longer support 'form' in filename when cleaning. Only look for 'part X' and add that to the filename if it exists 2024-02-22 12:04:36 -08:00
Nelson Jovel
a295b8afb9 chore: refactor Gender out out of survey_item_values row 2023-12-20 12:33:18 -08:00
Nelson Jovel
6f265302ea feat: if the filename includes the words 'form' or 'part' add that to the resulting cleaned filename 2023-12-18 15:58:40 -08:00
rebuilt
a07728fcd6 feat: We no longer trust the progress number that gets exported from qualtrics. Instead during the cleaning progress, perform a manual count of the number of responses to filter out rows that don't meet the minimum threshold. 2023-10-27 15:13:17 -07:00
rebuilt
245cde85cd Add disaggregation by ELL 2023-10-17 11:18:47 -07:00
rebuilt
76ebcc6ef3 feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page 2023-08-08 15:52:12 -07:00
rebuilt
2445642586 Don't write a file if there's an empty dataset 2023-06-07 12:40:03 -07:00
rebuilt
6022739f07 use district short name when writing filename 2023-05-31 17:12:40 -07:00
rebuilt
0dfc9726d0 Add automated data cleaning. Modify SurveyItemValues class to use regex
instead of hard coded values.  Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
2023-05-24 11:59:53 -07:00