Commit graph

196 commits

Author SHA1 Message Date
nelson
0fd61e017a feat: update source of truth to add a-curv-i7 and disable other admin data items 2025-02-07 15:49:01 -08:00
nelson
83b426fbc9 feat: add scraper for 4D-ii 2025-02-06 21:09:56 -08:00
nelson
4c28b10bd4 feat: finish scraper for students of color in advanced courses 2025-02-06 13:08:04 -08:00
nelson
685bafd52c Fix hs only admin data item. Use alternate method to check if a school is a high school 2025-02-06 13:07:05 -08:00
rebuilt
abcb033f60 chore: update esp counts 2025-01-29 09:32:26 -08:00
rebuilt
f75f6d1293 chore: rescrape 5D-2 2025-01-27 15:13:52 -08:00
rebuilt
1de5d4d456 chore: fix problem with enrollment scraper 2025-01-27 15:13:25 -08:00
Nelson Jovel
f2160e4edf chore: remove test esp counts for Lee 2025-01-21 13:30:24 -08:00
Nelson Jovel
b1cdf3632e feat: add Newburyport schools to dashboard 2025-01-21 12:08:25 -08:00
Nelson Jovel
bf745dd1b0 chore: remove empty file 2025-01-17 18:52:55 -08:00
Nelson Jovel
28c6eb7fc0 chore: scrape new admin data; a-ovpe-i1 2025-01-17 18:32:00 -08:00
Nelson Jovel
2333e9c8c7 feat: add admin data item a-curv-i5 with temporary benchmark of 2 2025-01-15 16:32:22 -08:00
Nelson Jovel
02bcb2b75b feat: add esp counts when calculating teacher participation rates on overview page 2025-01-15 13:39:41 -08:00
Nelson Jovel
e5a336fcfe feat: add -Berlin-Boylston Regional School District: 06200000
-Masconomet Regional School District: 07050000
-Newburyport Public Schools:  02040000
2024-12-11 11:51:56 -08:00
rebuilt
1ada4a0bbd feat: add updated admin data 2024-11-22 12:50:16 -08:00
Nelson Jovel
beb93aa8e8 fix: make sure all likert scores get counted even when the survey item id has different capitalization. Add tests for uploading parent data. Change the parent response rate calcuation to count all students in the school instead of just for the grades that were given the student survey 2024-11-08 15:36:34 -08:00
Nelson Jovel
37042aead5 feat: Show parent scales on browse page 2024-09-25 11:45:16 -07:00
Nelson Jovel
521633457d feat: update source of truth 2024-08-27 13:12:21 -07:00
Nelson Jovel
cd91496279 feat: read and load parent survey items 2024-08-20 14:13:07 -07:00
Nelson Jovel
8d61eb242b feat: add wisconsin admin data 2024-08-16 13:09:50 -07:00
Nelson Jovel
e976d52300 feat: run scraper to get latest admin data 2024-05-29 14:41:05 -07:00
Nelson Jovel
33da0859b9 Split academic year into seasons if the academic year's range is
initialized with a season, i.e. "2024-25 Fall".  Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly.   Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year.  So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring".  Add tests
for the new range format.  Set the default cutoff for the start of Spring season will be the last Sunday in February
2024-04-25 09:21:04 -07:00
Nelson Jovel
928cf72cb8 feat: #187323204 Update staffing numbers for Massachusetts 2024-03-29 11:34:36 -07:00
Nelson Jovel
5d5bc310bf chore: update source of truth and add a way to delete 'Library Access' measure from database 2024-03-08 14:51:41 -08:00
Nelson Jovel
6ba367471b Revert "chore: update source of truth and add a way to delete 'Library Access' measure from database"
This reverts commit a030cb1811.
2024-03-08 14:49:12 -08:00
Nelson Jovel
a030cb1811 chore: update source of truth and add a way to delete 'Library Access' measure from database 2024-03-08 14:39:15 -08:00
Nelson Jovel
db90ce2ac1 feat: update staffing and enrollment numbers 2024-02-22 11:32:10 -08:00
Nelson Jovel
e48c95784c feat: update framework with new teacher survey items 2024-02-22 10:03:57 -08:00
Nelson Jovel
683ece6cf1 feat: add Triton and Tyngsborough districts and schools 2024-01-12 13:14:43 -08:00
Nelson Jovel
2d6bbe0e5a feat: add Hampden-Wilbraham schools 2023-12-12 10:29:08 -08:00
Nelson Jovel
242192e2f3 feat: add early ed survey items to the framework source of truth 2023-12-07 14:52:47 -08:00
rebuilt
48e795fcfb feat: add special education disaggregation 2023-10-06 11:41:52 -07:00
rebuilt
060d7aa55a Add disaggregation by ELL 2023-09-29 19:29:23 -07:00
rebuilt
b7494988d7 chore: removed tmp file 2023-07-21 10:30:35 -07:00
rebuilt
cbd5687ff0 feat: Add out of state admin data 2023-07-20 17:06:07 -07:00
rebuilt
4f035f6a63 feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page 2023-07-07 09:14:36 -07:00
rebuilt
d4f4b899f0 Scrape new admin data values 2023-06-06 18:25:18 -07:00
rebuilt
76b79b99c2 Fix: Parse headers when they are surrounded by quotes. This helps load recent csv files correctly 2023-06-06 18:18:52 -07:00
rebuilt
b57489a7b0 Scrape new admin data values 2023-06-03 17:14:56 -07:00
rebuilt
5fe0e07020 Add Wisconsin enrollment and staffing information 2023-06-02 15:49:50 -07:00
rebuilt
a30921ce06 Add New Jersey enrollment and staffing data 2023-05-28 17:11:52 -07:00
rebuilt
b5be86d74d Add Waupun and Dunellen school districts 2023-05-11 17:14:14 -07:00
rebuilt
c5373b5e99 Add most recent admin data 2023-04-27 15:44:56 -07:00
rebuilt
3f2a7dff50 Fix problem with dese scraper lumping in 2021-22 data as 2022-23 data.
Deleted unused csvs.  Turned off puts statements in admin loader.
Remove old, now unused admin data loader class.
2023-04-27 15:43:17 -07:00
rebuilt
df317d8ef6 Add updated admin data 2023-04-20 17:44:24 -07:00
rebuilt
1395d42848 Add older admin data file archive 2023-04-20 16:31:40 -07:00
rebuilt
128748addd Update logic for calculating student response rate. Remove references
to survey table.  We no longer check or keep track of the survey type.
Instead we look in the database to see if a survey item has at least 10
responses.  If it does, that survey item was presented to the respondent
and we count it, and all responses when calculating the response rate.

Remove response rate timestamp from caching logic because we no longer
add the response rate to the database. All response rates are calculated
on the fly

Update three_b_two scraper to use teacher only numbers

swap over to using https://profiles.doe.mass.edu/statereport/gradesubjectstaffing.aspx as the source of staffing information
2023-04-18 13:59:29 -07:00
rebuilt
56b55bf5b6 update framework to include early education survey items 2023-04-10 16:18:46 -07:00
rebuilt
fbfaafa996 Update school/framework files for ecp schools. Fix tests. Update fixture files with dese ids of schools in the consortium. 2023-03-15 18:04:09 -07:00
rebuilt
06f9d2f0e9 Scrape enrollment and staffing information. Seed enrollment and staffing information. Update DatabaseCleaner so it cleans up leftover information in the database. Remove old admin csvs from codebase. 2023-03-05 16:15:35 -08:00