Commit graph

346 commits

Author SHA1 Message Date
Nelson Jovel
ee41751f4e chore: correct parsing for 'not sped' and 'lep not first year' 2024-06-26 12:03:31 -07:00
Nelson Jovel
678dd5416e chore: handle cases where the pivot table inserts headers instead of actual values for gender and race 2024-06-24 19:09:43 -07:00
Nelson Jovel
33013e6716 chore: handle unknowns when parsing records 2024-06-24 13:48:00 -07:00
Nelson Jovel
294e9c5ce5 feat: stop processing race or gender column if we encounter values we don't know about 2024-06-20 12:49:01 -07:00
Nelson Jovel
9c9346f455 chore: add ability to filter survey item report by student survey type 2024-06-19 15:48:50 -07:00
Nelson Jovel
118938deeb chore: add report for listing district level averages for measure scores 2024-06-19 10:15:37 -07:00
Nelson Jovel
ebcb27ca6d fix: correctly memoize student_survey_items_with_sufficient_responses so that on the analyze page, when the first year has insufficient responses, it doesn't affect all subsequent years 2024-06-13 09:02:19 -07:00
Nelson Jovel
3ad47e6bd5 feat: switch analyze page to use hotwire. Fix n_size count for teacher 2024-06-12 10:43:48 -07:00
Nelson Jovel
051f156126 chore: add parsing rules for income: 'yes', 'no' and sped: 'No special needs' and ell: 'ELL' 2024-05-22 17:33:21 -07:00
Nelson Jovel
5c0851d4f9 feat: add measure name and id to the beginning of the csv report 2024-05-22 17:32:47 -07:00
Nelson Jovel
a4bc428633 chore: Only memoize functions primary functions, not every function in the
file.  This should reduce memory use
2024-05-17 11:02:15 -07:00
Nelson Jovel
74fdc89fc2 chore: update glossary values to include parsing rules for when we encounter headers 2024-05-16 17:07:46 -07:00
Nelson Jovel
499215f9b9 chore: parse disaggregation header values as 'unknown' since they are errors in the pivot table logic 2024-05-16 15:10:31 -07:00
Nelson Jovel
6e5baf0ba6 chore: update sped parsing to categorize SpecialEdStatus as unknown 2024-05-15 16:00:19 -07:00
Nelson Jovel
d9195dadff chore: account for #N/A when parsing income 2024-05-15 14:19:15 -07:00
Nelson Jovel
c4d4c35766 update parsing rules from glossary 2024-05-15 10:54:12 -07:00
Nelson Jovel
8e7fbdfb2c add disaggregation glossary 2024-05-15 10:53:59 -07:00
7373d8bae4 Chore: Reduce queries 2024-05-10 14:22:24 -04:00
Nelson Jovel
4c360c9e62 chore: add more rules for finding disaggregation columns and parsing sped values 2024-05-09 12:53:35 -07:00
Nelson Jovel
6fe565b636 chore: add new rules for sped parsing 2024-05-09 11:19:23 -07:00
Nelson Jovel
4c258f6cb3 fix: additional rules for SPED categorization 2024-05-07 18:51:13 -07:00
Nelson Jovel
65c25fc3c7 Add ell income and sped parsing rules for SIS data. Add tests for the
new inputs.
2024-05-07 17:18:59 -07:00
Nelson Jovel
2561fa28fc feat: Split academic year into seasons if the academic year's range is
initialized with a season, i.e. "2024-25 Fall".  Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly.   Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year.  So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring".  Add tests
for the new range format.  Set the default cutoff for the start of Spring season will be the last Sunday in February
2024-04-27 14:05:02 -07:00
Nelson Jovel
67ffc996a8 Revert "Split academic year into seasons if the academic year's range is"
This reverts commit a5d4cccb37.
2024-04-26 13:48:30 -07:00
Nelson Jovel
a5d4cccb37 Split academic year into seasons if the academic year's range is
initialized with a season, i.e. "2024-25 Fall".  Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly.   Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year.  So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring".  Add tests
for the new range format.  Set the default cutoff for the start of Spring season will be the last Sunday in February
2024-04-26 13:31:50 -07:00
f4dacf1a92 Bug Fix: survey item by grade report 2024-04-25 13:46:27 -04:00
6fac759ec2 Faster admin data loader + rename School.school_hash 2024-04-22 15:43:54 -04:00
e3bbf1353b Feat: Add item-level reporting by grade 2024-04-19 15:10:52 -04:00
a3854bcce9 Fix: Isolate Report::SurveyItem 2024-04-10 17:06:11 -04:00
bd42f25716 rename SurveyItemResponse method for clarity 2024-04-10 14:41:24 -04:00
deaae5cf65 Feat: Add task to generate item-level survey report 2024-04-10 14:24:30 -04:00
Nelson Jovel
274909dc9f feat: ignore library survey items in csvs 2024-04-02 20:45:40 -07:00
Nelson Jovel
9f5ca007a1 fix: make sure averages for admin data scales are included in report 2024-03-19 08:16:32 -07:00
Nelson Jovel
d90669b74d feat: create beyond learning loss report 2024-03-19 07:16:13 -07:00
Nelson Jovel
259ec29dc2 fix: Correctly namespace models to avoid crashing the build process 2024-03-08 14:17:57 -08:00
Nelson Jovel
c3cb05701f feat: Support two date formats: ISO 8601 and the standard US date format
used in google sheets
2024-02-27 11:57:20 -08:00
Nelson Jovel
de83154342 fix: Support true/false column values when categorizing income status. True is categorized as Economically Disadvantaged. False is categorized as Not Economically Disadvantaged 2024-02-20 21:26:58 -08:00
Nelson Jovel
8c458ae986 fix: change the default to not an english language learner. Blank columns are treated as Not ELL. Only mark student as an english language learner if it's marked as such. Columns marked with 'NA' are treated as unknown 2024-02-20 21:26:49 -08:00
Nelson Jovel
0c87e20095 perf: reduce number of calls for student and teacher survey items in response rate calculators 2024-01-12 13:41:26 -08:00
Nelson Jovel
978b69b095 fix: correct a problem where survey items with insufficient responses were contributing to the response rate calculation 2024-01-12 13:41:17 -08:00
Nelson Jovel
946b0833fd perf: reduce time spent in sql query for student response rate 2024-01-12 13:41:07 -08:00
Nelson Jovel
6bea0bc2d0 chore: refactor teacher response rate 2024-01-12 13:40:56 -08:00
Nelson Jovel
af82f6999a perf: reduce number of queries for teacher survey_items 2024-01-12 13:40:46 -08:00
Nelson Jovel
f3fddd67b0 perf: reduce number of queries for respondents 2024-01-12 13:40:35 -08:00
Nelson Jovel
b2e866a895 perf: reduce number of queries by requesting grouped_responses once instead of for each measure 2024-01-12 13:39:20 -08:00
Nelson Jovel
a14110b883 chore: performance fixes for response rate calculation 2024-01-12 13:38:43 -08:00
Nelson Jovel
77193cdf35 fix: reduce number of n+1 queries 2024-01-12 13:36:01 -08:00
Nelson Jovel
61f861a4f7 chore: remove method that wasn't needed 2024-01-12 13:31:19 -08:00
Nelson Jovel
6a2723af84 chore: performance fixes for response rate calculation 2024-01-12 13:31:09 -08:00
Nelson Jovel
7ba124ac91 chore: prevent multiple lookups for the boston district by inlining the
sql
2024-01-12 13:29:49 -08:00