Commit graph

1141 commits

Author SHA1 Message Date
Nelson Jovel
0c87e20095 perf: reduce number of calls for student and teacher survey items in response rate calculators 2024-01-12 13:41:26 -08:00
Nelson Jovel
978b69b095 fix: correct a problem where survey items with insufficient responses were contributing to the response rate calculation 2024-01-12 13:41:17 -08:00
Nelson Jovel
946b0833fd perf: reduce time spent in sql query for student response rate 2024-01-12 13:41:07 -08:00
Nelson Jovel
6bea0bc2d0 chore: refactor teacher response rate 2024-01-12 13:40:56 -08:00
Nelson Jovel
af82f6999a perf: reduce number of queries for teacher survey_items 2024-01-12 13:40:46 -08:00
Nelson Jovel
f3fddd67b0 perf: reduce number of queries for respondents 2024-01-12 13:40:35 -08:00
Nelson Jovel
2d40e483da perf: update to ruby 3.3.0 so I can enable yjit in prod 2024-01-12 13:40:23 -08:00
Nelson Jovel
b2e866a895 perf: reduce number of queries by requesting grouped_responses once instead of for each measure 2024-01-12 13:39:20 -08:00
Nelson Jovel
a14110b883 chore: performance fixes for response rate calculation 2024-01-12 13:38:43 -08:00
Nelson Jovel
77193cdf35 fix: reduce number of n+1 queries 2024-01-12 13:36:01 -08:00
Nelson Jovel
31c40297d3 chore: update rails and puma 2024-01-12 13:31:29 -08:00
Nelson Jovel
61f861a4f7 chore: remove method that wasn't needed 2024-01-12 13:31:19 -08:00
Nelson Jovel
6a2723af84 chore: performance fixes for response rate calculation 2024-01-12 13:31:09 -08:00
Nelson Jovel
7ba124ac91 chore: prevent multiple lookups for the boston district by inlining the
sql
2024-01-12 13:29:49 -08:00
Nelson Jovel
b29e6a75ec chore: memoize grades for school 2024-01-12 13:28:49 -08:00
Nelson Jovel
586c6f4b4c fix: reduce number of n+1 queries 2023-12-21 13:35:02 -08:00
Nelson Jovel
080a054cad chore: move code that normalizes race data to the Race class 2023-12-20 19:07:39 -08:00
Nelson Jovel
c565dbe46f chore: remove lowell seeding rules 2023-12-20 14:06:53 -08:00
Nelson Jovel
a0c0b1d01d chore: reenable test spec that tests data loader for races 2023-12-20 12:40:04 -08:00
Nelson Jovel
d4109fda6f chore: refactor Race out of survey_item_values 2023-12-20 12:27:53 -08:00
Nelson Jovel
3e4ef9cb08 chore: refactor Gender out out of survey_item_values row 2023-12-20 12:27:44 -08:00
Nelson Jovel
1a49975c0b chore: fix binstubs 2023-12-20 12:27:36 -08:00
Nelson Jovel
2aff49516b chore: remove todo 2023-12-20 12:27:26 -08:00
Nelson Jovel
511b86ff71 chore: slight improvement to test execution time by disabling all but the most fatal of logging 2023-12-20 12:27:16 -08:00
Nelson Jovel
0733eb410d chore: remove cypress 2023-12-19 14:09:09 -08:00
Nelson Jovel
e669ec59c4 fix: binstubs 2023-12-19 14:07:51 -08:00
Nelson Jovel
8ec9e98850 chore: update gem versions 2023-12-19 14:07:36 -08:00
Nelson Jovel
fb5531108d chore: install binstubs 2023-12-19 14:06:05 -08:00
Nelson Jovel
0ebaf77bbd feat: don't show collection date of response rate if there is no survey data 2023-12-18 15:28:39 -08:00
Nelson Jovel
6e7e64c039 chore: rename counts_by_grade to enrollment_by_grade for clarity 2023-12-18 15:28:29 -08:00
Nelson Jovel
b4e07434a1 feat: don't double count early ed students who are taking survey in parts 2023-12-18 15:28:19 -08:00
Nelson Jovel
ab8a3ebd98 chore: update devise 2023-12-18 15:28:08 -08:00
Nelson Jovel
197ccdfeb3 fix: Correctly navigate the user to the latest academic year when no data exists for the school 2023-12-18 15:26:43 -08:00
Nelson Jovel
6a24d4fa23 chore: Make sure 'hispanic' column only gets applied when using SIS race information 2023-12-18 15:26:21 -08:00
Nelson Jovel
f28713d1fe chore: remove unneeded comment 2023-12-18 15:25:46 -08:00
Nelson Jovel
ce43f52bd5 feat: if the filename includes the words 'form' or 'part' add that to the resulting cleaned filename 2023-12-18 15:25:36 -08:00
Nelson Jovel
a15b01a3e1 fix: instead of looking for 'asian' at the start of a word, look for it
after a word boundary.  This means it still doesn't get confused with
caucasian and it's more flexible whan asian appears inside other text
such as 'Caucasian and Asian and Black'
2023-12-08 14:22:43 -08:00
Nelson Jovel
8a0ba0dbea chore: various fixes for race and gender categorization during cleaning.
Also add tests for race and gender categorization
2023-12-08 14:22:33 -08:00
Nelson Jovel
8364d26e11 feat: Support SIS categories for race in the form of 'White and Asian'
or 'Black, Asian, and white'
2023-12-08 09:36:48 -08:00
Nelson Jovel
55b73279bf feat: add 2023-24 academic year and make sure previous year enrollment
and staffing data get loaded when missing
2023-12-08 09:35:53 -08:00
Nelson Jovel
ed755c6732 chore: refactor code so we use a hash instead of a switch statement for long-term performance 2023-12-06 14:58:56 -08:00
rebuilt
85ba1218e3 feat: Rename income labels to 'Economically Disadvantaged' and 'Not Economically Disadvantaged' 2023-12-06 14:57:51 -08:00
Nelson Jovel
20f391ce90 chore: turn off cypress tests in github actions 2023-12-06 14:02:00 -08:00
Nelson Jovel
2ef24caf70 Lower threshold for the number of valid student responses from 17 to 11 2023-12-06 13:56:14 -08:00
Nelson Jovel
6365cad71b chore: refactor code to put logic into models 2023-12-06 13:55:37 -08:00
Nelson Jovel
b983f1e144 chore: fix categorization of gender 2023-12-01 15:32:48 -08:00
Nelson Jovel
e7e2b801e9 chore: turn off journey spec 2023-12-01 15:09:20 -08:00
Nelson Jovel
3da6016635 chore: add prefer not to disclose to gender. Add code of 7 as an option for prefer to self describe 2023-12-01 09:05:57 -08:00
Nelson Jovel
f27a590c5a Convert gender and race text into qualtrics codes during cleaning. Abide by 'prefer not to disclose' for self reported race. Give priority to self reported data but use SIS information as backup 2023-11-30 20:57:04 -08:00
Nelson Jovel
97ddb09167 chore: add test for checking duplicate headers during cleaning process 2023-11-09 14:50:51 -08:00