Commit graph

1083 commits

Author SHA1 Message Date
Nelson Jovel
06cb494f45 fix: change the default to not an english language learner. Blank columns are treated as Not ELL. Only mark student as an english language learner if it's marked as such. Columns marked with 'NA' are treated as unknown 2024-02-20 21:27:21 -08:00
Nelson Jovel
e1fc5dbbaa feat: add 2023-24 academic year and make sure previous year enrollment
and staffing data get loaded when missing
2024-02-20 21:06:55 -08:00
Nelson Jovel
c6960c957d chore: rename admin data to school data on analyze page 2024-01-31 14:25:59 -08:00
Nelson Jovel
5fc5c21bcb feat: change 'school admin data' to 'school data' 2024-01-31 11:04:00 -08:00
Nelson Jovel
2e0cc3a4d8 fix: make sure response rate gets rounded to nearest integer 2024-01-12 14:18:39 -08:00
Nelson Jovel
978942ab34 perf: add pghero and implement pghero suggestions. Remove unneeded indexes 2024-01-12 14:01:22 -08:00
Nelson Jovel
edbb84334a perf: reduce number of calls for student and teacher survey items in response rate calculators 2024-01-12 13:55:14 -08:00
Nelson Jovel
ec5c1bd1ef fix: correct a problem where survey items with insufficient responses were contributing to the response rate calculation 2024-01-12 13:54:59 -08:00
Nelson Jovel
cf9dd9042d perf: reduce time spent in sql query for student response rate 2024-01-12 13:54:00 -08:00
Nelson Jovel
b70755aef1 chore: refactor teacher response rate 2024-01-12 13:53:51 -08:00
Nelson Jovel
45ea735fa5 perf: reduce number of queries for teacher survey_items 2024-01-12 13:53:41 -08:00
Nelson Jovel
3718d74e62 perf: reduce number of queries for respondents 2024-01-12 13:53:33 -08:00
Nelson Jovel
2cfa35534d perf: update to ruby 3.3.0 so I can enable yjit in prod 2024-01-12 13:53:21 -08:00
Nelson Jovel
277e36429a perf: reduce number of queries by requesting grouped_responses once instead of for each measure 2024-01-12 13:52:41 -08:00
Nelson Jovel
5b34c2257f chore: performance fixes for response rate calculation 2024-01-12 13:51:59 -08:00
Nelson Jovel
47cca3ce1f fix: reduce number of n+1 queries 2024-01-12 13:51:14 -08:00
Nelson Jovel
12d0591edc chore: update rails and puma 2024-01-12 13:50:10 -08:00
Nelson Jovel
2dd73f003c chore: remove method that wasn't needed 2024-01-12 13:49:11 -08:00
Nelson Jovel
a960202d66 chore: performance fixes for response rate calculation 2024-01-12 13:49:02 -08:00
Nelson Jovel
9e368ae47d chore: prevent multiple lookups for the boston district by inlining the
sql
2024-01-12 13:48:51 -08:00
Nelson Jovel
db7c74479d chore: memoize grades for school 2024-01-12 13:48:08 -08:00
Nelson Jovel
d2efec1574 fix: reduce number of n+1 queries 2023-12-21 13:35:48 -08:00
Nelson Jovel
2a125aa058 chore: bring in some refactoring changes that didn't get copied over from the main branch 2023-12-20 19:27:06 -08:00
Nelson Jovel
75451648e5 chore: move code that normalizes race data to the Race class 2023-12-20 19:07:52 -08:00
Nelson Jovel
7670246291 chore: remove reference to cypress test in ci 2023-12-20 14:14:56 -08:00
Nelson Jovel
e7f06ef4e9 chore: remove lowell seeding rules 2023-12-20 14:08:38 -08:00
Nelson Jovel
b88c4e0ab5 chore: remove unneeded student loader spec 2023-12-20 13:48:39 -08:00
Nelson Jovel
76bd79e8a2 chore: clean up rake tasks 2023-12-20 13:47:38 -08:00
Nelson Jovel
bbefdcb5bb chore: remove student loader since we load race information in data loader 2023-12-20 13:47:09 -08:00
Nelson Jovel
063810a9d7 chore: make sure to load races in data loader instead of student loader 2023-12-20 13:39:03 -08:00
Nelson Jovel
381625f58b chore: reenable test spec that tests data loader for races 2023-12-20 12:40:22 -08:00
Nelson Jovel
317fe3239a chore: refactor Race out of survey_item_values 2023-12-20 12:35:14 -08:00
Nelson Jovel
a295b8afb9 chore: refactor Gender out out of survey_item_values row 2023-12-20 12:33:18 -08:00
Nelson Jovel
e2f8cab06c chore: slight improvement to test execution time by disabling all but the most fatal of logging 2023-12-20 12:31:33 -08:00
Nelson Jovel
2f71cc1a90 chore: remove cypress 2023-12-20 12:31:21 -08:00
Nelson Jovel
465f1f61d3 chore: update gem versions 2023-12-20 12:30:45 -08:00
Nelson Jovel
abcd187733 chore: add binstubs 2023-12-20 12:30:29 -08:00
Nelson Jovel
f6853a2781 chore: install binstubs 2023-12-20 12:28:19 -08:00
Nelson Jovel
5514fef62c feat: don't show collection date of response rate if there is no survey data 2023-12-18 15:59:45 -08:00
Nelson Jovel
0359dae88a chore: rename counts_by_grade to enrollment_by_grade for clarity 2023-12-18 15:59:30 -08:00
Nelson Jovel
1d0bac126b feat: don't double count early ed students who are taking survey in parts 2023-12-18 15:59:19 -08:00
Nelson Jovel
32b05487a1 fix: Correctly navigate the user to the latest academic year when no data exists for the school 2023-12-18 15:59:08 -08:00
Nelson Jovel
ee5e53f992 chore: Make sure 'hispanic' column only gets applied when using SIS race information 2023-12-18 15:58:54 -08:00
Nelson Jovel
6f265302ea feat: if the filename includes the words 'form' or 'part' add that to the resulting cleaned filename 2023-12-18 15:58:40 -08:00
Nelson Jovel
d79635054c fix: instead of looking for 'asian' at the start of a word, look for it
after a word boundary.  This means it still doesn't get confused with
caucasian and it's more flexible whan asian appears inside other text
such as 'Caucasian and Asian and Black'
2023-12-18 15:44:51 -08:00
Nelson Jovel
fe039e3d04 chore: various fixes for race and gender categorization during cleaning.
Also add tests for race and gender categorization
2023-12-18 15:38:31 -08:00
Nelson Jovel
267319604c chore: add early ed survey items to framework 2023-12-18 15:34:41 -08:00
Nelson Jovel
054e5603b7 chore: fix failing legacy tests 2023-11-03 10:18:46 -07:00
rebuilt
79bc91d39f feat: add command for loading survey responses from arbitrary sftp directory 2023-10-30 19:44:52 -07:00
rebuilt
a07728fcd6 feat: We no longer trust the progress number that gets exported from qualtrics. Instead during the cleaning progress, perform a manual count of the number of responses to filter out rows that don't meet the minimum threshold. 2023-10-27 15:13:17 -07:00