Commit graph

800 commits

Author SHA1 Message Date
Nelson Jovel
4c360c9e62 chore: add more rules for finding disaggregation columns and parsing sped values 2024-05-09 12:53:35 -07:00
Nelson Jovel
fdc4c49bf0 chore: copy changes from main 2024-05-09 11:20:24 -07:00
Nelson Jovel
6fe565b636 chore: add new rules for sped parsing 2024-05-09 11:19:23 -07:00
Nelson Jovel
cf5c4f2d13 feat: add seasonal academic years 2024-05-08 15:22:26 -07:00
Nelson Jovel
4c258f6cb3 fix: additional rules for SPED categorization 2024-05-07 18:51:13 -07:00
Nelson Jovel
65c25fc3c7 Add ell income and sped parsing rules for SIS data. Add tests for the
new inputs.
2024-05-07 17:18:59 -07:00
Nelson Jovel
2561fa28fc feat: Split academic year into seasons if the academic year's range is
initialized with a season, i.e. "2024-25 Fall".  Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly.   Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year.  So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring".  Add tests
for the new range format.  Set the default cutoff for the start of Spring season will be the last Sunday in February
2024-04-27 14:05:02 -07:00
Nelson Jovel
67ffc996a8 Revert "Split academic year into seasons if the academic year's range is"
This reverts commit a5d4cccb37.
2024-04-26 13:48:30 -07:00
Nelson Jovel
a5d4cccb37 Split academic year into seasons if the academic year's range is
initialized with a season, i.e. "2024-25 Fall".  Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly.   Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year.  So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring".  Add tests
for the new range format.  Set the default cutoff for the start of Spring season will be the last Sunday in February
2024-04-26 13:31:50 -07:00
076be3b92d Fix: Lowell -> Amherst 2024-04-25 13:52:35 -04:00
f4dacf1a92 Bug Fix: survey item by grade report 2024-04-25 13:46:27 -04:00
6fac759ec2 Faster admin data loader + rename School.school_hash 2024-04-22 15:43:54 -04:00
e3bbf1353b Feat: Add item-level reporting by grade 2024-04-19 15:10:52 -04:00
deb70d4b88 Memoize admin data loader 2024-04-18 17:20:26 -04:00
a3854bcce9 Fix: Isolate Report::SurveyItem 2024-04-10 17:06:11 -04:00
bd42f25716 rename SurveyItemResponse method for clarity 2024-04-10 14:41:24 -04:00
deaae5cf65 Feat: Add task to generate item-level survey report 2024-04-10 14:24:30 -04:00
Nelson Jovel
274909dc9f feat: ignore library survey items in csvs 2024-04-02 20:45:40 -07:00
Nelson Jovel
cb37fcb760 fix: make sure staffing checks for zero 2024-04-01 09:53:19 -07:00
Nelson Jovel
f4a7ce03c2 fix:typo 2024-04-01 09:43:01 -07:00
Nelson Jovel
fc304f2d20 fix: If all respondents have total_teachers set to 0, that will trigger cloning previous year data 2024-04-01 09:37:23 -07:00
Nelson Jovel
e8cb2d7aa2 fix: make sure we are only reseeding staffing and demographic numbers if the data for that year is empty 2024-04-01 09:25:59 -07:00
Nelson Jovel
d52eebbc5c fix: Fixes #187294757. Data is hidden when selecting multiple years if the default year has no student data to show 2024-03-26 15:34:07 -07:00
Nelson Jovel
a191271504 Revert "fix: Fixes #187294757. Data is hidden when selecting multiple years if the default year has no student data to show"
This reverts commit b9bdd707b5.
2024-03-26 15:32:54 -07:00
Nelson Jovel
993fafcc0e Revert "fix: Makes visible the graphs by grade"
This reverts commit 455f716b6d.
2024-03-26 15:32:34 -07:00
Nelson Jovel
455f716b6d fix: Makes visible the graphs by grade 2024-03-26 14:54:37 -07:00
Nelson Jovel
b9bdd707b5 fix: Fixes #187294757. Data is hidden when selecting multiple years if the default year has no student data to show 2024-03-26 14:42:32 -07:00
Nelson Jovel
9f5ca007a1 fix: make sure averages for admin data scales are included in report 2024-03-19 08:16:32 -07:00
Nelson Jovel
d90669b74d feat: create beyond learning loss report 2024-03-19 07:16:13 -07:00
Nelson Jovel
f3dc21efa6 feat: change the text of the prompts for survey items 2024-03-14 12:49:09 -07:00
Nelson Jovel
259ec29dc2 fix: Correctly namespace models to avoid crashing the build process 2024-03-08 14:17:57 -08:00
Nelson Jovel
9f83b3dae4 fix: add pre-k to list of grades 2024-03-05 22:32:34 -08:00
Nelson Jovel
1e560294e1 fix: loosen restrictions on date format 2024-03-01 10:15:55 -08:00
Nelson Jovel
9bfb76db5a match an additional format for Dates. Supported dates are now '1/10/2022 14:21:45' '2022-1-10T14:21:45' '2022-1-10 14:21:45' 2024-03-01 09:30:43 -08:00
Nelson Jovel
c3cb05701f feat: Support two date formats: ISO 8601 and the standard US date format
used in google sheets
2024-02-27 11:57:20 -08:00
Nelson Jovel
23d23c4962 chore: support alternate format for recorded date 2024-02-23 14:21:53 -08:00
Nelson Jovel
be5b63637b chore: alphabetize districts when writing filename for cleaned files 2024-02-23 11:28:30 -08:00
Nelson Jovel
d2e1be948d fix: support alternate format for active admin data items. Support both 'True/False' and '1/0' 2024-02-23 08:58:34 -08:00
Nelson Jovel
cc8ed48204 fix: no longer support 'form' in filename when cleaning. Only look for 'part X' and add that to the filename if it exists 2024-02-22 12:02:25 -08:00
Nelson Jovel
de83154342 fix: Support true/false column values when categorizing income status. True is categorized as Economically Disadvantaged. False is categorized as Not Economically Disadvantaged 2024-02-20 21:26:58 -08:00
Nelson Jovel
8c458ae986 fix: change the default to not an english language learner. Blank columns are treated as Not ELL. Only mark student as an english language learner if it's marked as such. Columns marked with 'NA' are treated as unknown 2024-02-20 21:26:49 -08:00
Nelson Jovel
59b7416a3a feat: change 'school admin data' to 'school data' 2024-01-31 11:02:23 -08:00
Nelson Jovel
0c87e20095 perf: reduce number of calls for student and teacher survey items in response rate calculators 2024-01-12 13:41:26 -08:00
Nelson Jovel
978b69b095 fix: correct a problem where survey items with insufficient responses were contributing to the response rate calculation 2024-01-12 13:41:17 -08:00
Nelson Jovel
946b0833fd perf: reduce time spent in sql query for student response rate 2024-01-12 13:41:07 -08:00
Nelson Jovel
6bea0bc2d0 chore: refactor teacher response rate 2024-01-12 13:40:56 -08:00
Nelson Jovel
af82f6999a perf: reduce number of queries for teacher survey_items 2024-01-12 13:40:46 -08:00
Nelson Jovel
f3fddd67b0 perf: reduce number of queries for respondents 2024-01-12 13:40:35 -08:00
Nelson Jovel
b2e866a895 perf: reduce number of queries by requesting grouped_responses once instead of for each measure 2024-01-12 13:39:20 -08:00
Nelson Jovel
a14110b883 chore: performance fixes for response rate calculation 2024-01-12 13:38:43 -08:00