Commit graph

181 commits

Author SHA1 Message Date
rebuilt
6b2d51c331 WIP: show language graph on analyze page 2025-04-25 16:22:22 -07:00
rebuilt
204e9c1b3a feat: pull down new admin data. Fix problems with some scrapers. For 5D-ii make sure the likert score is 1 if the nurse count is 0. Prevent devision by zero returning infinity. For 3A-ii make sure not to perform division by zero. Likert score will be 1 if the number of guidance couselors, psychologists, or paraprofessionals is zero. 2025-03-20 13:12:36 -07:00
nelson
9470e55701 feat: Add scraper for a-curv-i7. Scrape new admin data for that item 2025-02-13 12:10:30 -08:00
nelson
ee4fec12fa feat: update source of truth to add a-curv-i7 and disable other admin data items 2025-02-07 15:49:29 -08:00
nelson
29caf0904f feat: add scraper for 4D-ii 2025-02-06 21:11:45 -08:00
nelson
7c38d3faee feat: finish scraper for students of color in advanced courses 2025-02-06 13:51:22 -08:00
nelson
966e25c995 Fix hs only admin data item. Use alternate method to check if a school is a high school 2025-02-06 13:50:56 -08:00
rebuilt
d93e83aee1 chore: update esp counts 2025-02-06 13:49:08 -08:00
rebuilt
514c4516e1 chore: rescrape 5D-2 2025-01-28 12:04:47 -08:00
rebuilt
38cf38fdb5 chore: fix problem with enrollment scraper 2025-01-28 12:04:35 -08:00
Nelson Jovel
e09ae12004 chore: remove test esp counts for Lee 2025-01-23 11:45:54 -08:00
Nelson Jovel
dcae005420 chore: remove empty file 2025-01-23 11:44:49 -08:00
Nelson Jovel
b9a0016f14 chore: scrape new admin data; a-ovpe-i1 2025-01-23 11:44:36 -08:00
Nelson Jovel
8ab944acca feat: add admin data item a-curv-i5 with temporary benchmark of 2 2025-01-23 11:41:00 -08:00
Nelson Jovel
8303d3bfdc feat: add esp counts when calculating teacher participation rates on overview page 2025-01-23 11:35:20 -08:00
rebuilt
848fccf55f feat: add updated admin data 2024-11-22 14:16:53 -08:00
Nelson Jovel
67a9a96433 fix: make sure all likert scores get counted even when the survey item id has different capitalization. Add tests for uploading parent data. Change the parent response rate calcuation to count all students in the school instead of just for the grades that were given the student survey 2024-11-14 09:30:25 -08:00
Nelson Jovel
74bed5b090 feat: Show parent scales on browse page 2024-09-27 13:50:39 -07:00
Nelson Jovel
094aa93013 feat: update source of truth 2024-09-27 13:50:15 -07:00
Nelson Jovel
2b8eca44ae feat: read and load parent survey items 2024-09-27 13:43:26 -07:00
Nelson Jovel
6252cccdcb feat: run scraper to get latest admin data 2024-06-03 12:46:18 -07:00
Nelson Jovel
ac5c1edfbf feat: Split academic year into seasons if the academic year's range is
initialized with a season, i.e. "2024-25 Fall".  Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly.   Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year.  So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring".  Add tests
for the new range format.  Set the default cutoff for the start of Spring season will be the last Sunday in February
2024-04-27 14:24:05 -07:00
Nelson Jovel
e484984a6a feat: #187323204 Update staffing numbers for Massachusetts 2024-03-29 12:08:24 -07:00
Nelson Jovel
4da1aef59b Change 'Seacoast/City Lab' to 'City Lab High School' in Revere 2024-03-21 15:42:32 -07:00
Nelson Jovel
4082f2ad1c Revert "chore: update source of truth and add a way to delete 'Library Access' measure from database"
This reverts commit a70a6ae32c.
2024-03-08 14:53:40 -08:00
Nelson Jovel
31f42b3434 chore: update source of truth and add a way to delete 'Library Access' measure from database 2024-03-08 14:52:24 -08:00
Nelson Jovel
a70a6ae32c chore: update source of truth and add a way to delete 'Library Access' measure from database 2024-03-08 14:42:53 -08:00
Nelson Jovel
faeef0e0c2 feat: update staffing and enrollment numbers 2024-02-22 12:42:30 -08:00
Nelson Jovel
a901cb4945 feat: update framework with new teacher survey items 2024-02-22 12:04:12 -08:00
Nelson Jovel
267319604c chore: add early ed survey items to framework 2023-12-18 15:34:41 -08:00
rebuilt
acfdaf5587 feat: add special education disaggregation 2023-10-17 12:29:00 -07:00
rebuilt
245cde85cd Add disaggregation by ELL 2023-10-17 11:18:47 -07:00
rebuilt
76ebcc6ef3 feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page 2023-08-08 15:52:12 -07:00
rebuilt
ce76c979a4 Add scraper for 3B-i student/#courses ratio 2023-06-05 11:39:08 -07:00
rebuilt
bea9be2d76 Scrape new admin data values 2023-06-03 16:08:48 -07:00
rebuilt
28e7f1fcb2 Change Dese ID of Minot Forest in Wareham to 310001799. Change Dese ID of Wareham Elementary School to 3100017 2023-05-27 15:44:04 -07:00
rebuilt
80431e7660 Add most recent admin data 2023-04-30 12:04:36 -07:00
rebuilt
f1022728fa Fix problem with dese scraper lumping in 2021-22 data as 2022-23 data.
Deleted unused csvs.  Turned off puts statements in admin loader.
Remove old, now unused admin data loader class.
2023-04-30 12:04:20 -07:00
rebuilt
7f9b96fdb3 Add updated admin data 2023-04-22 14:03:00 -07:00
rebuilt
1f8aea31de Add older admin data file archive 2023-04-22 14:01:10 -07:00
rebuilt
07ed8dd259 Update logic for calculating student response rate. Remove references
to survey table.  We no longer check or keep track of the survey type.
Instead we look in the database to see if a survey item has at least 10
responses.  If it does, that survey item was presented to the respondent
and we count it, and all responses when calculating the response rate.

Remove response rate timestamp from caching logic because we no longer
add the response rate to the database. All response rates are calculated
on the fly

Update three_b_two scraper to use teacher only numbers

swap over to using https://profiles.doe.mass.edu/statereport/gradesubjectstaffing.aspx as the source of staffing information
2023-04-22 14:00:20 -07:00
rebuilt
36ea63332b Add 2022-23 survey results 2023-03-17 18:55:35 -07:00
rebuilt
380048f5cd Load survey responses from sftp folder 2023-02-19 19:36:14 -08:00
rebuilt
ed421296c7 Fix bug that caused an incorrect score of 1 to be assigned for admin
data item related to parity index of teachers of color to students of
color.  Now if there's not enough data to calculate a score, it produces
'NA' instead of 1. Also added admin data for a-reso-i1 and a-curv-i1
2023-01-06 17:43:48 -08:00
rebuilt
7b9abe3793 Scrape latest data from DESE 2022-12-20 15:26:11 -08:00
rebuilt
4d5143964b update enrollment counts for 2022-23 academic year 2022-12-20 09:01:30 -08:00
rebuilt
69179ce157 Replace javascript logic with hotwire. Also hide district dropdown on
home page if there is only one district.
2022-12-14 13:41:34 -08:00
rebuilt
36d7794e3a Change name of Cardinal O'Connell Alternative School to Cardinal O'Connel Early Learning Center 2022-12-11 16:09:42 -08:00
rebuilt
53a08d41bf Change label for unknown race 2022-12-10 15:44:56 -08:00
rebuilt
ba2da2e378 Update names of Seacoast High School to Seacoast High School/City Lab, and Riverside School to The BRIDGE Program at the Riverside School 2022-12-04 12:30:13 -08:00