Commit graph

1224 commits

Author SHA1 Message Date
Nelson Jovel
26bcc2c736 chore: speed up survey data loader 2024-05-23 12:24:27 -07:00
Nelson Jovel
051f156126 chore: add parsing rules for income: 'yes', 'no' and sped: 'No special needs' and ell: 'ELL' 2024-05-22 17:33:21 -07:00
Nelson Jovel
5c0851d4f9 feat: add measure name and id to the beginning of the csv report 2024-05-22 17:32:47 -07:00
Nelson Jovel
a4bc428633 chore: Only memoize functions primary functions, not every function in the
file.  This should reduce memory use
2024-05-17 11:02:15 -07:00
Nelson Jovel
0f2740f448 chore: update rexml to patch security vulnerability 2024-05-17 09:46:40 -07:00
Nelson Jovel
2c07ea6317 chore: Add 'English Learner' and 'DirectCert' as valid column headers 2024-05-17 09:42:22 -07:00
Nelson Jovel
c8fe940be2 fix: fix merge error 2024-05-17 08:58:13 -07:00
Nelson Jovel
c651cd0c25 fix: When multiple years were selected on the Analyze page, results were getting incorrectly filtered out when the first academic year did not have sufficient responses. Now all selected years with data are correctly displayed 2024-05-17 08:52:34 -07:00
Nelson Jovel
74fdc89fc2 chore: update glossary values to include parsing rules for when we encounter headers 2024-05-16 17:07:46 -07:00
Nelson Jovel
499215f9b9 chore: parse disaggregation header values as 'unknown' since they are errors in the pivot table logic 2024-05-16 15:10:31 -07:00
Nelson Jovel
2bf22758c1 chore: add a way to print out errors in dese id when cleaning files 2024-05-16 15:10:21 -07:00
Nelson Jovel
6e5baf0ba6 chore: update sped parsing to categorize SpecialEdStatus as unknown 2024-05-15 16:00:19 -07:00
Nelson Jovel
d9195dadff chore: account for #N/A when parsing income 2024-05-15 14:19:15 -07:00
Nelson Jovel
c4d4c35766 update parsing rules from glossary 2024-05-15 10:54:12 -07:00
Nelson Jovel
8e7fbdfb2c add disaggregation glossary 2024-05-15 10:53:59 -07:00
4b0525eb6a Repair Gemfile.lock 2024-05-14 16:30:15 -04:00
Gabe Farrell
178f066561 Merge pull request #6 from edcommonwealth/dependabot/bundler/yard-0.9.36
chore(deps-dev): bump yard from 0.9.34 to 0.9.36
2024-05-14 16:23:15 -04:00
Gabe Farrell
46006d35c6 Merge pull request #5 from edcommonwealth/dependabot/bundler/rails-7.1.3.1
chore(deps): bump rails from 7.1.2 to 7.1.3.1
2024-05-14 16:22:57 -04:00
Gabe Farrell
383c1059c3 Merge pull request #4 from edcommonwealth/dependabot/bundler/nokogiri-1.16.5
chore(deps): bump nokogiri from 1.15.5 to 1.16.5
2024-05-14 16:20:48 -04:00
rebuilt
4574ad6c49 Merge pull request #3 from edcommonwealth/dependabot/bundler/rdoc-6.6.3.1
chore(deps): bump rdoc from 6.6.2 to 6.6.3.1
2024-05-14 15:46:24 -04:00
7373d8bae4 Chore: Reduce queries 2024-05-10 14:22:24 -04:00
Nelson Jovel
9584068e11 chore: update changelog to match academic years for Lowell 2024-05-09 13:48:57 -07:00
Nelson Jovel
4c360c9e62 chore: add more rules for finding disaggregation columns and parsing sped values 2024-05-09 12:53:35 -07:00
Nelson Jovel
fdc4c49bf0 chore: copy changes from main 2024-05-09 11:20:24 -07:00
Nelson Jovel
6fe565b636 chore: add new rules for sped parsing 2024-05-09 11:19:23 -07:00
Nelson Jovel
e3c2188a04 revert 2022-23 to be a single survey administration year instead of a multiple one 2024-05-08 15:24:46 -07:00
Nelson Jovel
cf5c4f2d13 feat: add seasonal academic years 2024-05-08 15:22:26 -07:00
Nelson Jovel
0a27538747 chore: add a test for categorizing sped values of 1 and 0 as 'Special Education' and 'Not Special Education' 2024-05-07 19:38:26 -07:00
Nelson Jovel
4c258f6cb3 fix: additional rules for SPED categorization 2024-05-07 18:51:13 -07:00
Nelson Jovel
65c25fc3c7 Add ell income and sped parsing rules for SIS data. Add tests for the
new inputs.
2024-05-07 17:18:59 -07:00
Nelson Jovel
2561fa28fc feat: Split academic year into seasons if the academic year's range is
initialized with a season, i.e. "2024-25 Fall".  Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly.   Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year.  So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring".  Add tests
for the new range format.  Set the default cutoff for the start of Spring season will be the last Sunday in February
2024-04-27 14:05:02 -07:00
Nelson Jovel
67ffc996a8 Revert "Split academic year into seasons if the academic year's range is"
This reverts commit a5d4cccb37.
2024-04-26 13:48:30 -07:00
Nelson Jovel
a5d4cccb37 Split academic year into seasons if the academic year's range is
initialized with a season, i.e. "2024-25 Fall".  Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly.   Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year.  So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring".  Add tests
for the new range format.  Set the default cutoff for the start of Spring season will be the last Sunday in February
2024-04-26 13:31:50 -07:00
076be3b92d Fix: Lowell -> Amherst 2024-04-25 13:52:35 -04:00
f4dacf1a92 Bug Fix: survey item by grade report 2024-04-25 13:46:27 -04:00
5e76fdac68 Update ruby to 3.3.1 2024-04-24 19:28:47 -04:00
6fac759ec2 Faster admin data loader + rename School.school_hash 2024-04-22 15:43:54 -04:00
40aef35c2c Update README with report generation instructions 2024-04-19 15:28:51 -04:00
e3bbf1353b Feat: Add item-level reporting by grade 2024-04-19 15:10:52 -04:00
deb70d4b88 Memoize admin data loader 2024-04-18 17:20:26 -04:00
8356a2d2b7 Update README.md 2024-04-10 19:11:19 -04:00
a3854bcce9 Fix: Isolate Report::SurveyItem 2024-04-10 17:06:11 -04:00
bd42f25716 rename SurveyItemResponse method for clarity 2024-04-10 14:41:24 -04:00
deaae5cf65 Feat: Add task to generate item-level survey report 2024-04-10 14:24:30 -04:00
Nelson Jovel
a279509f00 feat: add 2024-25 2024-04-09 12:31:39 -07:00
Nelson Jovel
274909dc9f feat: ignore library survey items in csvs 2024-04-02 20:45:40 -07:00
Nelson Jovel
cb37fcb760 fix: make sure staffing checks for zero 2024-04-01 09:53:19 -07:00
Nelson Jovel
f4a7ce03c2 fix:typo 2024-04-01 09:43:01 -07:00
Nelson Jovel
fc304f2d20 fix: If all respondents have total_teachers set to 0, that will trigger cloning previous year data 2024-04-01 09:37:23 -07:00
Nelson Jovel
e8cb2d7aa2 fix: make sure we are only reseeding staffing and demographic numbers if the data for that year is empty 2024-04-01 09:25:59 -07:00