Commit graph

1149 commits

Author SHA1 Message Date
Nelson Jovel
5b31fb9da1 feat: update staffing and enrollment numbers 2024-02-22 12:03:45 -08:00
Nelson Jovel
cc8ed48204 fix: no longer support 'form' in filename when cleaning. Only look for 'part X' and add that to the filename if it exists 2024-02-22 12:02:25 -08:00
Nelson Jovel
d907e2742e fix: fix failing tests 2024-02-22 12:02:15 -08:00
Nelson Jovel
1a6e03e243 feat: update framework with new teacher survey items 2024-02-22 12:02:04 -08:00
Nelson Jovel
de83154342 fix: Support true/false column values when categorizing income status. True is categorized as Economically Disadvantaged. False is categorized as Not Economically Disadvantaged 2024-02-20 21:26:58 -08:00
Nelson Jovel
8c458ae986 fix: change the default to not an english language learner. Blank columns are treated as Not ELL. Only mark student as an english language learner if it's marked as such. Columns marked with 'NA' are treated as unknown 2024-02-20 21:26:49 -08:00
Nelson Jovel
59b7416a3a feat: change 'school admin data' to 'school data' 2024-01-31 11:02:23 -08:00
Nelson Jovel
4c1713e538 perf: add pghero and implement pghero suggestions. Remove unneeded indexes 2024-01-12 13:42:25 -08:00
Nelson Jovel
0c87e20095 perf: reduce number of calls for student and teacher survey items in response rate calculators 2024-01-12 13:41:26 -08:00
Nelson Jovel
978b69b095 fix: correct a problem where survey items with insufficient responses were contributing to the response rate calculation 2024-01-12 13:41:17 -08:00
Nelson Jovel
946b0833fd perf: reduce time spent in sql query for student response rate 2024-01-12 13:41:07 -08:00
Nelson Jovel
6bea0bc2d0 chore: refactor teacher response rate 2024-01-12 13:40:56 -08:00
Nelson Jovel
af82f6999a perf: reduce number of queries for teacher survey_items 2024-01-12 13:40:46 -08:00
Nelson Jovel
f3fddd67b0 perf: reduce number of queries for respondents 2024-01-12 13:40:35 -08:00
Nelson Jovel
2d40e483da perf: update to ruby 3.3.0 so I can enable yjit in prod 2024-01-12 13:40:23 -08:00
Nelson Jovel
b2e866a895 perf: reduce number of queries by requesting grouped_responses once instead of for each measure 2024-01-12 13:39:20 -08:00
Nelson Jovel
a14110b883 chore: performance fixes for response rate calculation 2024-01-12 13:38:43 -08:00
Nelson Jovel
77193cdf35 fix: reduce number of n+1 queries 2024-01-12 13:36:01 -08:00
Nelson Jovel
31c40297d3 chore: update rails and puma 2024-01-12 13:31:29 -08:00
Nelson Jovel
61f861a4f7 chore: remove method that wasn't needed 2024-01-12 13:31:19 -08:00
Nelson Jovel
6a2723af84 chore: performance fixes for response rate calculation 2024-01-12 13:31:09 -08:00
Nelson Jovel
7ba124ac91 chore: prevent multiple lookups for the boston district by inlining the
sql
2024-01-12 13:29:49 -08:00
Nelson Jovel
b29e6a75ec chore: memoize grades for school 2024-01-12 13:28:49 -08:00
Nelson Jovel
586c6f4b4c fix: reduce number of n+1 queries 2023-12-21 13:35:02 -08:00
Nelson Jovel
080a054cad chore: move code that normalizes race data to the Race class 2023-12-20 19:07:39 -08:00
Nelson Jovel
c565dbe46f chore: remove lowell seeding rules 2023-12-20 14:06:53 -08:00
Nelson Jovel
a0c0b1d01d chore: reenable test spec that tests data loader for races 2023-12-20 12:40:04 -08:00
Nelson Jovel
d4109fda6f chore: refactor Race out of survey_item_values 2023-12-20 12:27:53 -08:00
Nelson Jovel
3e4ef9cb08 chore: refactor Gender out out of survey_item_values row 2023-12-20 12:27:44 -08:00
Nelson Jovel
1a49975c0b chore: fix binstubs 2023-12-20 12:27:36 -08:00
Nelson Jovel
2aff49516b chore: remove todo 2023-12-20 12:27:26 -08:00
Nelson Jovel
511b86ff71 chore: slight improvement to test execution time by disabling all but the most fatal of logging 2023-12-20 12:27:16 -08:00
Nelson Jovel
0733eb410d chore: remove cypress 2023-12-19 14:09:09 -08:00
Nelson Jovel
e669ec59c4 fix: binstubs 2023-12-19 14:07:51 -08:00
Nelson Jovel
8ec9e98850 chore: update gem versions 2023-12-19 14:07:36 -08:00
Nelson Jovel
fb5531108d chore: install binstubs 2023-12-19 14:06:05 -08:00
Nelson Jovel
0ebaf77bbd feat: don't show collection date of response rate if there is no survey data 2023-12-18 15:28:39 -08:00
Nelson Jovel
6e7e64c039 chore: rename counts_by_grade to enrollment_by_grade for clarity 2023-12-18 15:28:29 -08:00
Nelson Jovel
b4e07434a1 feat: don't double count early ed students who are taking survey in parts 2023-12-18 15:28:19 -08:00
Nelson Jovel
ab8a3ebd98 chore: update devise 2023-12-18 15:28:08 -08:00
Nelson Jovel
197ccdfeb3 fix: Correctly navigate the user to the latest academic year when no data exists for the school 2023-12-18 15:26:43 -08:00
Nelson Jovel
6a24d4fa23 chore: Make sure 'hispanic' column only gets applied when using SIS race information 2023-12-18 15:26:21 -08:00
Nelson Jovel
f28713d1fe chore: remove unneeded comment 2023-12-18 15:25:46 -08:00
Nelson Jovel
ce43f52bd5 feat: if the filename includes the words 'form' or 'part' add that to the resulting cleaned filename 2023-12-18 15:25:36 -08:00
Nelson Jovel
a15b01a3e1 fix: instead of looking for 'asian' at the start of a word, look for it
after a word boundary.  This means it still doesn't get confused with
caucasian and it's more flexible whan asian appears inside other text
such as 'Caucasian and Asian and Black'
2023-12-08 14:22:43 -08:00
Nelson Jovel
8a0ba0dbea chore: various fixes for race and gender categorization during cleaning.
Also add tests for race and gender categorization
2023-12-08 14:22:33 -08:00
Nelson Jovel
8364d26e11 feat: Support SIS categories for race in the form of 'White and Asian'
or 'Black, Asian, and white'
2023-12-08 09:36:48 -08:00
Nelson Jovel
55b73279bf feat: add 2023-24 academic year and make sure previous year enrollment
and staffing data get loaded when missing
2023-12-08 09:35:53 -08:00
Nelson Jovel
ed755c6732 chore: refactor code so we use a hash instead of a switch statement for long-term performance 2023-12-06 14:58:56 -08:00
rebuilt
85ba1218e3 feat: Rename income labels to 'Economically Disadvantaged' and 'Not Economically Disadvantaged' 2023-12-06 14:57:51 -08:00