Commit graph

310 commits

Author SHA1 Message Date
Nelson Jovel
de83154342 fix: Support true/false column values when categorizing income status. True is categorized as Economically Disadvantaged. False is categorized as Not Economically Disadvantaged 2024-02-20 21:26:58 -08:00
Nelson Jovel
8c458ae986 fix: change the default to not an english language learner. Blank columns are treated as Not ELL. Only mark student as an english language learner if it's marked as such. Columns marked with 'NA' are treated as unknown 2024-02-20 21:26:49 -08:00
Nelson Jovel
0c87e20095 perf: reduce number of calls for student and teacher survey items in response rate calculators 2024-01-12 13:41:26 -08:00
Nelson Jovel
978b69b095 fix: correct a problem where survey items with insufficient responses were contributing to the response rate calculation 2024-01-12 13:41:17 -08:00
Nelson Jovel
946b0833fd perf: reduce time spent in sql query for student response rate 2024-01-12 13:41:07 -08:00
Nelson Jovel
6bea0bc2d0 chore: refactor teacher response rate 2024-01-12 13:40:56 -08:00
Nelson Jovel
af82f6999a perf: reduce number of queries for teacher survey_items 2024-01-12 13:40:46 -08:00
Nelson Jovel
f3fddd67b0 perf: reduce number of queries for respondents 2024-01-12 13:40:35 -08:00
Nelson Jovel
b2e866a895 perf: reduce number of queries by requesting grouped_responses once instead of for each measure 2024-01-12 13:39:20 -08:00
Nelson Jovel
a14110b883 chore: performance fixes for response rate calculation 2024-01-12 13:38:43 -08:00
Nelson Jovel
77193cdf35 fix: reduce number of n+1 queries 2024-01-12 13:36:01 -08:00
Nelson Jovel
61f861a4f7 chore: remove method that wasn't needed 2024-01-12 13:31:19 -08:00
Nelson Jovel
6a2723af84 chore: performance fixes for response rate calculation 2024-01-12 13:31:09 -08:00
Nelson Jovel
7ba124ac91 chore: prevent multiple lookups for the boston district by inlining the
sql
2024-01-12 13:29:49 -08:00
Nelson Jovel
b29e6a75ec chore: memoize grades for school 2024-01-12 13:28:49 -08:00
Nelson Jovel
586c6f4b4c fix: reduce number of n+1 queries 2023-12-21 13:35:02 -08:00
Nelson Jovel
080a054cad chore: move code that normalizes race data to the Race class 2023-12-20 19:07:39 -08:00
Nelson Jovel
2aff49516b chore: remove todo 2023-12-20 12:27:26 -08:00
Nelson Jovel
6e7e64c039 chore: rename counts_by_grade to enrollment_by_grade for clarity 2023-12-18 15:28:29 -08:00
Nelson Jovel
a15b01a3e1 fix: instead of looking for 'asian' at the start of a word, look for it
after a word boundary.  This means it still doesn't get confused with
caucasian and it's more flexible whan asian appears inside other text
such as 'Caucasian and Asian and Black'
2023-12-08 14:22:43 -08:00
Nelson Jovel
8a0ba0dbea chore: various fixes for race and gender categorization during cleaning.
Also add tests for race and gender categorization
2023-12-08 14:22:33 -08:00
Nelson Jovel
ed755c6732 chore: refactor code so we use a hash instead of a switch statement for long-term performance 2023-12-06 14:58:56 -08:00
rebuilt
85ba1218e3 feat: Rename income labels to 'Economically Disadvantaged' and 'Not Economically Disadvantaged' 2023-12-06 14:57:51 -08:00
Nelson Jovel
6365cad71b chore: refactor code to put logic into models 2023-12-06 13:55:37 -08:00
Nelson Jovel
b983f1e144 chore: fix categorization of gender 2023-12-01 15:32:48 -08:00
Nelson Jovel
3da6016635 chore: add prefer not to disclose to gender. Add code of 7 as an option for prefer to self describe 2023-12-01 09:05:57 -08:00
Nelson Jovel
f27a590c5a Convert gender and race text into qualtrics codes during cleaning. Abide by 'prefer not to disclose' for self reported race. Give priority to self reported data but use SIS information as backup 2023-11-30 20:57:04 -08:00
Nelson Jovel
4c32b8f253 fix: catch null condition that was causing a crash 2023-11-06 22:23:01 -08:00
rebuilt
ef44c41965 feat: add special education disaggregation 2023-10-24 13:05:57 -07:00
rebuilt
4850f4a2f7 mergeable commit 2023-10-24 13:04:37 -07:00
rebuilt
18ab51c860 chore: upgrade to rails 7.1.
upgrade rspec

fix failing tests

upgrade devise
2023-10-24 13:04:05 -07:00
rebuilt
2fd56047d4 Add disaggregation by ELL 2023-10-24 12:51:12 -07:00
rebuilt
ce5340648f fix: hide scores on analyze page for scores that don't meet the student threshold of 25% 2023-10-24 10:27:25 -07:00
rebuilt
e58ea3f1af feat: Round up response rate. Survey response rates above 24.5 will now meet sufficiency 2023-10-24 09:07:47 -07:00
rebuilt
2ac30bb107 feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page 2023-10-24 09:05:27 -07:00
rebuilt
4450b5f331 chore: remove twilio require statement 2023-07-19 12:58:07 -07:00
rebuilt
60c04d768d Add date range to subcategory report export 2023-06-23 13:42:42 -07:00
rebuilt
46b5cbef2d perf: Reduce number of queries. Remove unneeded methods. Combine
subcategory and measure queries in controller
2023-06-19 20:51:54 -07:00
rebuilt
3dd8631083 perf: memoize function when calculating response rates 2023-06-10 11:39:19 -07:00
rebuilt
8a23296ca5 perf: Add another index to surveyitemresponses. Implement bullet suggestions. Memoize a function in measure.rb 2023-06-10 10:29:28 -07:00
rebuilt
7cf6c6cc24 Modify subcategory report to be threaded 2023-06-09 21:12:55 -07:00
rebuilt
f29d72abff Add District, School Code, and Grade columns to subcategory report 2023-06-09 15:29:12 -07:00
rebuilt
ed421ceea8 Fix: Ensure proper detection of survey type. Make sure to remove any survey item ids that end with the survey variant style of '-1' 2023-06-07 12:36:56 -07:00
8f0deab53b Use weighted average instead of simple average when calculating response rates 2023-06-07 03:38:56 +00:00
rebuilt
391cfdc49a specify that we are using the top level Subcategory class instead of the Report::Subcategory class 2023-05-23 20:19:53 -07:00
rebuilt
08c946a469 Add subcategory report 2023-05-23 18:59:05 -07:00
rebuilt
f590bc9dd5 Add subcategory report 2023-05-22 16:40:39 -07:00
rebuilt
dbfc9d1d3a Add automated data cleaning. Modify SurveyItemValues class to use regex
instead of hard coded values.  Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
2023-05-16 13:39:12 -07:00
rebuilt
1a27b980d0 Round all averages to two decimal places 2023-05-12 13:13:20 -07:00
rebuilt
9f21a76ba4 Fix response rates for small schools by accounting for expected minimum counts of responses less than 10 2023-05-12 12:34:42 -07:00