Commit graph

877 commits

Author SHA1 Message Date
Nelson Jovel
f6f0a45dd2 chore: update glossary values to include parsing rules for when we encounter headers 2024-05-16 17:07:24 -07:00
Nelson Jovel
28ac95d81d chore: parse disaggregation header values as 'unknown' since they are errors in the pivot table logic 2024-05-16 15:09:57 -07:00
Nelson Jovel
c2c8ce3b8d chore: add a way to print out errors in dese id when cleaning files 2024-05-16 15:09:14 -07:00
Nelson Jovel
42fdf4a074 chore: update sped parsing to categorize SpecialEdStatus as unknown 2024-05-15 16:00:01 -07:00
Nelson Jovel
386cecf680 chore: account for #N/A when parsing income 2024-05-15 14:18:45 -07:00
Nelson Jovel
b1f942133b update parsing rules from glossary 2024-05-15 10:15:16 -07:00
Nelson Jovel
ea2feb138b add disaggregation glossary 2024-05-15 10:15:16 -07:00
2f1cf8b9fd Chore: Reduce queries 2024-05-10 14:00:31 -04:00
Nelson Jovel
e60a30911c chore: add more rules for finding disaggregation columns and parsing sped values 2024-05-09 12:53:13 -07:00
Nelson Jovel
b992a9412b chore: add new rules for sped parsing 2024-05-09 11:18:37 -07:00
Nelson Jovel
8bb6f5e8f0 Add ell income and sped parsing rules for SIS data. Add tests for the
new inputs.
2024-05-07 18:46:53 -07:00
b257f9dff7 Fix: Lowell -> Amherst 2024-04-25 13:50:35 -04:00
40a35fff2d Bug Fix: survey item by grade report 2024-04-25 13:47:02 -04:00
Nelson Jovel
33da0859b9 Split academic year into seasons if the academic year's range is
initialized with a season, i.e. "2024-25 Fall".  Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly.   Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year.  So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring".  Add tests
for the new range format.  Set the default cutoff for the start of Spring season will be the last Sunday in February
2024-04-25 09:21:04 -07:00
5789ebf564 Faster admin data loader + rename School.school_hash 2024-04-22 14:46:37 -04:00
963d945eea Feat: Add item-level reporting by grade 2024-04-19 15:04:51 -04:00
04d61c0b1a Memoize admin data loader 2024-04-18 17:13:03 -04:00
37766e777d Fix: Isolate Report::SurveyItem 2024-04-10 17:06:48 -04:00
b08214fe10 rename SurveyItemResponse method for clarity 2024-04-10 14:39:19 -04:00
a085afb3b6 Feat: Add task to generate item-level survey report 2024-04-10 14:14:29 -04:00
Nelson Jovel
65d3733189 feat: ignore library survey items in csvs 2024-04-02 20:22:52 -07:00
Nelson Jovel
8a702efa51 fix: make sure staffing checks for zero 2024-04-01 09:52:41 -07:00
Nelson Jovel
ad23bb1816 fix:typo 2024-04-01 09:42:41 -07:00
Nelson Jovel
3106768175 fix: If all respondents have total_teachers set to 0, that will trigger cloning previous year data 2024-04-01 09:36:54 -07:00
Nelson Jovel
90363d8b86 fix: make sure we are only reseeding staffing and demographic numbers if the data for that year is empty 2024-04-01 09:21:33 -07:00
Nelson Jovel
51e71a7f83 fix: Fixes #187294757. Data is hidden when selecting multiple years if the default year has no student data to show 2024-03-26 15:31:48 -07:00
Nelson Jovel
0864b6e901 fix: make sure averages for admin data scales are included in report 2024-03-19 08:16:07 -07:00
Nelson Jovel
e83865ad55 feat: create beyond learning loss report 2024-03-19 07:13:51 -07:00
Nelson Jovel
7a4eb8302b feat: change the text of the prompts for survey items 2024-03-14 12:48:43 -07:00
Nelson Jovel
f15ea64dec fix: Correctly namespace models to avoid crashing the build process 2024-03-08 14:10:43 -08:00
Nelson Jovel
ee4343383c feat: create a score csv report for measures 2024-03-06 15:32:10 -08:00
Nelson Jovel
4c017cf857 fix: add pre-k to list of grades 2024-03-05 22:31:56 -08:00
Nelson Jovel
2cb43058a0 fix: loosen restrictions on date format 2024-03-01 10:15:32 -08:00
Nelson Jovel
289b04bc69 match an additional format for Dates. Supported dates are now '1/10/2022 14:21:45' '2022-1-10T14:21:45' '2022-1-10 14:21:45' 2024-03-01 09:30:23 -08:00
Nelson Jovel
d6735d449d feat: Support two date formats: ISO 8601 and the standard US date format
used in google sheets
2024-02-27 11:55:47 -08:00
Nelson Jovel
03349b0ed5 chore: support alternate format for recorded date 2024-02-23 14:21:16 -08:00
Nelson Jovel
37610e732f chore: alphabetize districts when writing filename for cleaned files 2024-02-23 11:27:59 -08:00
Nelson Jovel
b6de3349d6 fix: support alternate format for active admin data items. Support both 'True/False' and '1/0' 2024-02-23 08:57:35 -08:00
Nelson Jovel
0a32fb50ff fix: no longer support 'form' in filename when cleaning. Only look for 'part X' and add that to the filename if it exists 2024-02-22 10:55:48 -08:00
Nelson Jovel
725bef2a8f fix: Support true/false column values when categorizing income status. True is categorized as Economically Disadvantaged. False is categorized as Not Economically Disadvantaged 2024-02-20 21:26:02 -08:00
Nelson Jovel
48e1f941f5 fix: change the default to not an english language learner. Blank columns are treated as Not ELL. Only mark student as an english language learner if it's marked as such. Columns marked with 'NA' are treated as unknown 2024-02-20 21:24:14 -08:00
Nelson Jovel
3c210e0ab6 chore: rename admin data to school data on analyze page 2024-01-31 14:25:10 -08:00
Nelson Jovel
90d1419d9c feat: change 'school admin data' to 'school data' 2024-01-31 10:59:39 -08:00
Nelson Jovel
6558ed491a perf: reduce number of calls for student and teacher survey items in response rate calculators 2023-12-27 07:37:03 -08:00
Nelson Jovel
ec53cc9ae4 fix: correct a problem where survey items with insufficient responses were contributing to the response rate calculation 2023-12-26 22:14:56 -08:00
Nelson Jovel
c0b8c408ea perf: reduce time spent in sql query for student response rate 2023-12-26 21:01:12 -08:00
Nelson Jovel
2f74153114 chore: refactor teacher response rate 2023-12-26 20:58:08 -08:00
Nelson Jovel
b0c9a0451e perf: reduce number of queries for teacher survey_items 2023-12-26 17:32:39 -08:00
Nelson Jovel
8fb0a280ca perf: reduce number of queries for respondents 2023-12-26 16:23:29 -08:00
Nelson Jovel
f026ea22ef perf: reduce number of queries by requesting grouped_responses once instead of for each measure 2023-12-23 21:18:09 -08:00