Commit graph

328 commits

Author SHA1 Message Date
Nelson Jovel
33da0859b9 Split academic year into seasons if the academic year's range is
initialized with a season, i.e. "2024-25 Fall".  Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly.   Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year.  So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring".  Add tests
for the new range format.  Set the default cutoff for the start of Spring season will be the last Sunday in February
2024-04-25 09:21:04 -07:00
5789ebf564 Faster admin data loader + rename School.school_hash 2024-04-22 14:46:37 -04:00
963d945eea Feat: Add item-level reporting by grade 2024-04-19 15:04:51 -04:00
37766e777d Fix: Isolate Report::SurveyItem 2024-04-10 17:06:48 -04:00
b08214fe10 rename SurveyItemResponse method for clarity 2024-04-10 14:39:19 -04:00
a085afb3b6 Feat: Add task to generate item-level survey report 2024-04-10 14:14:29 -04:00
Nelson Jovel
65d3733189 feat: ignore library survey items in csvs 2024-04-02 20:22:52 -07:00
Nelson Jovel
0864b6e901 fix: make sure averages for admin data scales are included in report 2024-03-19 08:16:07 -07:00
Nelson Jovel
e83865ad55 feat: create beyond learning loss report 2024-03-19 07:13:51 -07:00
Nelson Jovel
f15ea64dec fix: Correctly namespace models to avoid crashing the build process 2024-03-08 14:10:43 -08:00
Nelson Jovel
ee4343383c feat: create a score csv report for measures 2024-03-06 15:32:10 -08:00
Nelson Jovel
d6735d449d feat: Support two date formats: ISO 8601 and the standard US date format
used in google sheets
2024-02-27 11:55:47 -08:00
Nelson Jovel
725bef2a8f fix: Support true/false column values when categorizing income status. True is categorized as Economically Disadvantaged. False is categorized as Not Economically Disadvantaged 2024-02-20 21:26:02 -08:00
Nelson Jovel
48e1f941f5 fix: change the default to not an english language learner. Blank columns are treated as Not ELL. Only mark student as an english language learner if it's marked as such. Columns marked with 'NA' are treated as unknown 2024-02-20 21:24:14 -08:00
Nelson Jovel
6558ed491a perf: reduce number of calls for student and teacher survey items in response rate calculators 2023-12-27 07:37:03 -08:00
Nelson Jovel
ec53cc9ae4 fix: correct a problem where survey items with insufficient responses were contributing to the response rate calculation 2023-12-26 22:14:56 -08:00
Nelson Jovel
c0b8c408ea perf: reduce time spent in sql query for student response rate 2023-12-26 21:01:12 -08:00
Nelson Jovel
2f74153114 chore: refactor teacher response rate 2023-12-26 20:58:08 -08:00
Nelson Jovel
b0c9a0451e perf: reduce number of queries for teacher survey_items 2023-12-26 17:32:39 -08:00
Nelson Jovel
8fb0a280ca perf: reduce number of queries for respondents 2023-12-26 16:23:29 -08:00
Nelson Jovel
f026ea22ef perf: reduce number of queries by requesting grouped_responses once instead of for each measure 2023-12-23 21:18:09 -08:00
Nelson Jovel
ed8e621333 chore: remove method that wasn't needed 2023-12-21 20:29:18 -08:00
Nelson Jovel
9e8f917457 chore: performance fixes for response rate calculation 2023-12-21 20:15:11 -08:00
Nelson Jovel
6a283b1fc8 chore: prevent multiple lookups for the boston district by inlining the
sql
2023-12-21 13:54:54 -08:00
Nelson Jovel
cc5e0b142c chore: memoize grades for school 2023-12-21 13:44:07 -08:00
Nelson Jovel
60927e3271 fix: reduce number of n+1 queries 2023-12-21 13:34:16 -08:00
Nelson Jovel
ebf4ca4166 chore: move code that normalizes race data to the Race class 2023-12-20 19:07:16 -08:00
Nelson Jovel
f9717f80c7 chore: remove todo 2023-12-19 15:51:13 -08:00
Nelson Jovel
ea079e927b chore: rename counts_by_grade to enrollment_by_grade for clarity 2023-12-18 15:01:33 -08:00
Nelson Jovel
d90a83e510 fix: instead of looking for 'asian' at the start of a word, look for it
after a word boundary.  This means it still doesn't get confused with
caucasian and it's more flexible whan asian appears inside other text
such as 'Caucasian and Asian and Black'
2023-12-08 14:16:50 -08:00
Nelson Jovel
3f44613085 chore: various fixes for race and gender categorization during cleaning.
Also add tests for race and gender categorization
2023-12-08 13:12:19 -08:00
Nelson Jovel
e203be056a chore: refactor code so we use a hash instead of a switch statement for long-term performance 2023-12-06 15:00:33 -08:00
Nelson Jovel
7dc881f654 chore: refactor code to put logic into models 2023-12-06 14:14:56 -08:00
Nelson Jovel
6e05909423 chore: fix categorization of gender 2023-12-06 14:12:27 -08:00
Nelson Jovel
6776ec8e2c chore: add prefer not to disclose to gender. Add code of 7 as an option for prefer to self describe 2023-12-06 14:10:29 -08:00
Nelson Jovel
e325f38c43 Convert gender and race text into qualtrics codes during cleaning. Abide by 'prefer not to disclose' for self reported race. Give priority to self reported data but use SIS information as backup 2023-12-06 14:10:16 -08:00
rebuilt
83661540b7 chore: upgrade to rails 7.1.
upgrade rspec

fix failing tests

upgrade devise
2023-10-11 10:58:52 -07:00
rebuilt
48e795fcfb feat: add special education disaggregation 2023-10-06 11:41:52 -07:00
rebuilt
060d7aa55a Add disaggregation by ELL 2023-09-29 19:29:23 -07:00
rebuilt
463e4c9452 fix: hide scores on analyze page for scores that don't meet the student threshold of 25% 2023-08-23 15:56:46 -07:00
rebuilt
4afa030141 chore: remove precalculated race scores. Calculate race scores on every reload 2023-08-07 16:02:59 -07:00
rebuilt
f035c4d9ad fix: Filter out responses that don't correspond to the grades the school serves 2023-08-04 17:11:02 -07:00
rebuilt
5f49746bf4 feat: Rename income labels to 'Economically Disadvantaged' and 'Not Economically Disadvantaged' 2023-07-31 16:47:34 -07:00
rebuilt
1cb2bb9dc0 fix: zeitwork eager loads all require statements. I removed twilio from Gem dependencies so I had to remove it from code as well or it breaks deployments 2023-07-20 14:00:15 -07:00
rebuilt
6edc0db868 feat: Round up response rate. Survey response rates above 24.5 will now meet sufficiency 2023-07-14 11:43:15 -07:00
rebuilt
bec80b405a fix: revert rounding up the response rate so we can make sure to patch a bug first. Only show gender/race/grade/income graphs if the the school meets the minimum response rate of 25% 2023-07-13 13:04:11 -07:00
rebuilt
234eae6d3d feat: Round up response rate. Survey response rates above 24.5 will now meet sufficiency 2023-07-13 11:42:15 -07:00
rebuilt
4f035f6a63 feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page 2023-07-07 09:14:36 -07:00
rebuilt
703928c234 Add date range to subcategory report export 2023-06-23 11:46:08 -07:00
37013c4b12 Use weighted average instead of simple average when calculating response rates 2023-06-21 03:31:52 +00:00