Commit graph

337 commits

Author SHA1 Message Date
Nelson Jovel
42fdf4a074 chore: update sped parsing to categorize SpecialEdStatus as unknown 2024-05-15 16:00:01 -07:00
Nelson Jovel
386cecf680 chore: account for #N/A when parsing income 2024-05-15 14:18:45 -07:00
Nelson Jovel
b1f942133b update parsing rules from glossary 2024-05-15 10:15:16 -07:00
Nelson Jovel
ea2feb138b add disaggregation glossary 2024-05-15 10:15:16 -07:00
2f1cf8b9fd Chore: Reduce queries 2024-05-10 14:00:31 -04:00
Nelson Jovel
e60a30911c chore: add more rules for finding disaggregation columns and parsing sped values 2024-05-09 12:53:13 -07:00
Nelson Jovel
b992a9412b chore: add new rules for sped parsing 2024-05-09 11:18:37 -07:00
Nelson Jovel
8bb6f5e8f0 Add ell income and sped parsing rules for SIS data. Add tests for the
new inputs.
2024-05-07 18:46:53 -07:00
40a35fff2d Bug Fix: survey item by grade report 2024-04-25 13:47:02 -04:00
Nelson Jovel
33da0859b9 Split academic year into seasons if the academic year's range is
initialized with a season, i.e. "2024-25 Fall".  Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly.   Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year.  So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring".  Add tests
for the new range format.  Set the default cutoff for the start of Spring season will be the last Sunday in February
2024-04-25 09:21:04 -07:00
5789ebf564 Faster admin data loader + rename School.school_hash 2024-04-22 14:46:37 -04:00
963d945eea Feat: Add item-level reporting by grade 2024-04-19 15:04:51 -04:00
37766e777d Fix: Isolate Report::SurveyItem 2024-04-10 17:06:48 -04:00
b08214fe10 rename SurveyItemResponse method for clarity 2024-04-10 14:39:19 -04:00
a085afb3b6 Feat: Add task to generate item-level survey report 2024-04-10 14:14:29 -04:00
Nelson Jovel
65d3733189 feat: ignore library survey items in csvs 2024-04-02 20:22:52 -07:00
Nelson Jovel
0864b6e901 fix: make sure averages for admin data scales are included in report 2024-03-19 08:16:07 -07:00
Nelson Jovel
e83865ad55 feat: create beyond learning loss report 2024-03-19 07:13:51 -07:00
Nelson Jovel
f15ea64dec fix: Correctly namespace models to avoid crashing the build process 2024-03-08 14:10:43 -08:00
Nelson Jovel
ee4343383c feat: create a score csv report for measures 2024-03-06 15:32:10 -08:00
Nelson Jovel
d6735d449d feat: Support two date formats: ISO 8601 and the standard US date format
used in google sheets
2024-02-27 11:55:47 -08:00
Nelson Jovel
725bef2a8f fix: Support true/false column values when categorizing income status. True is categorized as Economically Disadvantaged. False is categorized as Not Economically Disadvantaged 2024-02-20 21:26:02 -08:00
Nelson Jovel
48e1f941f5 fix: change the default to not an english language learner. Blank columns are treated as Not ELL. Only mark student as an english language learner if it's marked as such. Columns marked with 'NA' are treated as unknown 2024-02-20 21:24:14 -08:00
Nelson Jovel
6558ed491a perf: reduce number of calls for student and teacher survey items in response rate calculators 2023-12-27 07:37:03 -08:00
Nelson Jovel
ec53cc9ae4 fix: correct a problem where survey items with insufficient responses were contributing to the response rate calculation 2023-12-26 22:14:56 -08:00
Nelson Jovel
c0b8c408ea perf: reduce time spent in sql query for student response rate 2023-12-26 21:01:12 -08:00
Nelson Jovel
2f74153114 chore: refactor teacher response rate 2023-12-26 20:58:08 -08:00
Nelson Jovel
b0c9a0451e perf: reduce number of queries for teacher survey_items 2023-12-26 17:32:39 -08:00
Nelson Jovel
8fb0a280ca perf: reduce number of queries for respondents 2023-12-26 16:23:29 -08:00
Nelson Jovel
f026ea22ef perf: reduce number of queries by requesting grouped_responses once instead of for each measure 2023-12-23 21:18:09 -08:00
Nelson Jovel
ed8e621333 chore: remove method that wasn't needed 2023-12-21 20:29:18 -08:00
Nelson Jovel
9e8f917457 chore: performance fixes for response rate calculation 2023-12-21 20:15:11 -08:00
Nelson Jovel
6a283b1fc8 chore: prevent multiple lookups for the boston district by inlining the
sql
2023-12-21 13:54:54 -08:00
Nelson Jovel
cc5e0b142c chore: memoize grades for school 2023-12-21 13:44:07 -08:00
Nelson Jovel
60927e3271 fix: reduce number of n+1 queries 2023-12-21 13:34:16 -08:00
Nelson Jovel
ebf4ca4166 chore: move code that normalizes race data to the Race class 2023-12-20 19:07:16 -08:00
Nelson Jovel
f9717f80c7 chore: remove todo 2023-12-19 15:51:13 -08:00
Nelson Jovel
ea079e927b chore: rename counts_by_grade to enrollment_by_grade for clarity 2023-12-18 15:01:33 -08:00
Nelson Jovel
d90a83e510 fix: instead of looking for 'asian' at the start of a word, look for it
after a word boundary.  This means it still doesn't get confused with
caucasian and it's more flexible whan asian appears inside other text
such as 'Caucasian and Asian and Black'
2023-12-08 14:16:50 -08:00
Nelson Jovel
3f44613085 chore: various fixes for race and gender categorization during cleaning.
Also add tests for race and gender categorization
2023-12-08 13:12:19 -08:00
Nelson Jovel
e203be056a chore: refactor code so we use a hash instead of a switch statement for long-term performance 2023-12-06 15:00:33 -08:00
Nelson Jovel
7dc881f654 chore: refactor code to put logic into models 2023-12-06 14:14:56 -08:00
Nelson Jovel
6e05909423 chore: fix categorization of gender 2023-12-06 14:12:27 -08:00
Nelson Jovel
6776ec8e2c chore: add prefer not to disclose to gender. Add code of 7 as an option for prefer to self describe 2023-12-06 14:10:29 -08:00
Nelson Jovel
e325f38c43 Convert gender and race text into qualtrics codes during cleaning. Abide by 'prefer not to disclose' for self reported race. Give priority to self reported data but use SIS information as backup 2023-12-06 14:10:16 -08:00
rebuilt
83661540b7 chore: upgrade to rails 7.1.
upgrade rspec

fix failing tests

upgrade devise
2023-10-11 10:58:52 -07:00
rebuilt
48e795fcfb feat: add special education disaggregation 2023-10-06 11:41:52 -07:00
rebuilt
060d7aa55a Add disaggregation by ELL 2023-09-29 19:29:23 -07:00
rebuilt
463e4c9452 fix: hide scores on analyze page for scores that don't meet the student threshold of 25% 2023-08-23 15:56:46 -07:00
rebuilt
4afa030141 chore: remove precalculated race scores. Calculate race scores on every reload 2023-08-07 16:02:59 -07:00