Nelson Jovel
6bea0bc2d0
chore: refactor teacher response rate
2024-01-12 13:40:56 -08:00
Nelson Jovel
af82f6999a
perf: reduce number of queries for teacher survey_items
2024-01-12 13:40:46 -08:00
Nelson Jovel
f3fddd67b0
perf: reduce number of queries for respondents
2024-01-12 13:40:35 -08:00
Nelson Jovel
b2e866a895
perf: reduce number of queries by requesting grouped_responses once instead of for each measure
2024-01-12 13:39:20 -08:00
Nelson Jovel
a14110b883
chore: performance fixes for response rate calculation
2024-01-12 13:38:43 -08:00
Nelson Jovel
77193cdf35
fix: reduce number of n+1 queries
2024-01-12 13:36:01 -08:00
Nelson Jovel
61f861a4f7
chore: remove method that wasn't needed
2024-01-12 13:31:19 -08:00
Nelson Jovel
6a2723af84
chore: performance fixes for response rate calculation
2024-01-12 13:31:09 -08:00
Nelson Jovel
7ba124ac91
chore: prevent multiple lookups for the boston district by inlining the
...
sql
2024-01-12 13:29:49 -08:00
Nelson Jovel
b29e6a75ec
chore: memoize grades for school
2024-01-12 13:28:49 -08:00
Nelson Jovel
586c6f4b4c
fix: reduce number of n+1 queries
2023-12-21 13:35:02 -08:00
Nelson Jovel
080a054cad
chore: move code that normalizes race data to the Race class
2023-12-20 19:07:39 -08:00
Nelson Jovel
2aff49516b
chore: remove todo
2023-12-20 12:27:26 -08:00
Nelson Jovel
6e7e64c039
chore: rename counts_by_grade to enrollment_by_grade for clarity
2023-12-18 15:28:29 -08:00
Nelson Jovel
a15b01a3e1
fix: instead of looking for 'asian' at the start of a word, look for it
...
after a word boundary. This means it still doesn't get confused with
caucasian and it's more flexible whan asian appears inside other text
such as 'Caucasian and Asian and Black'
2023-12-08 14:22:43 -08:00
Nelson Jovel
8a0ba0dbea
chore: various fixes for race and gender categorization during cleaning.
...
Also add tests for race and gender categorization
2023-12-08 14:22:33 -08:00
Nelson Jovel
ed755c6732
chore: refactor code so we use a hash instead of a switch statement for long-term performance
2023-12-06 14:58:56 -08:00
rebuilt
85ba1218e3
feat: Rename income labels to 'Economically Disadvantaged' and 'Not Economically Disadvantaged'
2023-12-06 14:57:51 -08:00
Nelson Jovel
6365cad71b
chore: refactor code to put logic into models
2023-12-06 13:55:37 -08:00
Nelson Jovel
b983f1e144
chore: fix categorization of gender
2023-12-01 15:32:48 -08:00
Nelson Jovel
3da6016635
chore: add prefer not to disclose to gender. Add code of 7 as an option for prefer to self describe
2023-12-01 09:05:57 -08:00
Nelson Jovel
f27a590c5a
Convert gender and race text into qualtrics codes during cleaning. Abide by 'prefer not to disclose' for self reported race. Give priority to self reported data but use SIS information as backup
2023-11-30 20:57:04 -08:00
Nelson Jovel
4c32b8f253
fix: catch null condition that was causing a crash
2023-11-06 22:23:01 -08:00
rebuilt
ef44c41965
feat: add special education disaggregation
2023-10-24 13:05:57 -07:00
rebuilt
4850f4a2f7
mergeable commit
2023-10-24 13:04:37 -07:00
rebuilt
18ab51c860
chore: upgrade to rails 7.1.
...
upgrade rspec
fix failing tests
upgrade devise
2023-10-24 13:04:05 -07:00
rebuilt
2fd56047d4
Add disaggregation by ELL
2023-10-24 12:51:12 -07:00
rebuilt
ce5340648f
fix: hide scores on analyze page for scores that don't meet the student threshold of 25%
2023-10-24 10:27:25 -07:00
rebuilt
e58ea3f1af
feat: Round up response rate. Survey response rates above 24.5 will now meet sufficiency
2023-10-24 09:07:47 -07:00
rebuilt
2ac30bb107
feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page
2023-10-24 09:05:27 -07:00
rebuilt
4450b5f331
chore: remove twilio require statement
2023-07-19 12:58:07 -07:00
rebuilt
60c04d768d
Add date range to subcategory report export
2023-06-23 13:42:42 -07:00
rebuilt
46b5cbef2d
perf: Reduce number of queries. Remove unneeded methods. Combine
...
subcategory and measure queries in controller
2023-06-19 20:51:54 -07:00
rebuilt
3dd8631083
perf: memoize function when calculating response rates
2023-06-10 11:39:19 -07:00
rebuilt
8a23296ca5
perf: Add another index to surveyitemresponses. Implement bullet suggestions. Memoize a function in measure.rb
2023-06-10 10:29:28 -07:00
rebuilt
7cf6c6cc24
Modify subcategory report to be threaded
2023-06-09 21:12:55 -07:00
rebuilt
f29d72abff
Add District, School Code, and Grade columns to subcategory report
2023-06-09 15:29:12 -07:00
rebuilt
ed421ceea8
Fix: Ensure proper detection of survey type. Make sure to remove any survey item ids that end with the survey variant style of '-1'
2023-06-07 12:36:56 -07:00
8f0deab53b
Use weighted average instead of simple average when calculating response rates
2023-06-07 03:38:56 +00:00
rebuilt
391cfdc49a
specify that we are using the top level Subcategory class instead of the Report::Subcategory class
2023-05-23 20:19:53 -07:00
rebuilt
08c946a469
Add subcategory report
2023-05-23 18:59:05 -07:00
rebuilt
f590bc9dd5
Add subcategory report
2023-05-22 16:40:39 -07:00
rebuilt
dbfc9d1d3a
Add automated data cleaning. Modify SurveyItemValues class to use regex
...
instead of hard coded values. Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
2023-05-16 13:39:12 -07:00
rebuilt
1a27b980d0
Round all averages to two decimal places
2023-05-12 13:13:20 -07:00
rebuilt
9f21a76ba4
Fix response rates for small schools by accounting for expected minimum counts of responses less than 10
2023-05-12 12:34:42 -07:00
rebuilt
c33c00b845
Rename DataAvailability to Summary
2023-04-22 10:44:06 -07:00
rebuilt
0bd70ca452
Remove surveys table from codebase since it's no longer needed after changing logic surrounding response rates and score calculations
2023-04-22 10:36:00 -07:00
rebuilt
aa3a67406b
Set a minimum threshold of 10 survey item responses to calculate scores per survey item
2023-04-17 15:18:10 -07:00
rebuilt
c14960517b
rename counts_by_grade method to the more descriptive enrollment_by_grade
2023-04-14 13:37:23 -07:00
rebuilt
65b8599c6e
Update logic for calculating student response rate. Remove references
...
to survey table. We no longer check or keep track of the survey type.
Instead we look in the database to see if a survey item has at least 10
responses. If it does, that survey item was presented to the respondent
and we count it, and all responses when calculating the response rate.
Remove response rate timestamp from caching logic because we no longer
add the response rate to the database. All response rates are calculated
on the fly
Update three_b_two scraper to use teacher only numbers
swap over to using https://profiles.doe.mass.edu/statereport/gradesubjectstaffing.aspx as the source of staffing information
2023-04-08 10:59:48 -07:00
