Commit graph

185 commits

Author SHA1 Message Date
rebuilt
34c0b21e9c chore: fix problem with enrollment scraper 2025-01-28 12:15:29 -08:00
Nelson Jovel
d23f9ccc6f chore: remove test esp counts for Lee 2025-01-23 11:54:42 -08:00
Nelson Jovel
8e25530ad1 chore: remove empty file 2025-01-23 11:54:15 -08:00
Nelson Jovel
a595b2d988 chore: scrape new admin data; a-ovpe-i1 2025-01-23 11:54:07 -08:00
Nelson Jovel
93833a86bc feat: add admin data item a-curv-i5 with temporary benchmark of 2 2025-01-23 11:51:55 -08:00
Nelson Jovel
534f42dfe0 feat: add esp counts when calculating teacher participation rates on overview page 2025-01-23 11:51:32 -08:00
rebuilt
849e6e2573 feat: add updated admin data 2024-11-22 14:17:11 -08:00
Nelson Jovel
def9aad334 feat: update source of truth 2024-11-19 17:18:28 -08:00
Nelson Jovel
424e4c79a5 feat: Show parent scales on browse page 2024-09-27 13:30:58 -07:00
Nelson Jovel
f5e7ade5b9 feat: update source of truth 2024-09-27 13:24:49 -07:00
Nelson Jovel
6a8396f4df feat: read and load parent survey items 2024-09-27 13:24:14 -07:00
Nelson Jovel
564ddeee35 feat: add wisconsin admin data 2024-09-27 13:24:05 -07:00
Nelson Jovel
b3b361a4ae feat: run scraper to get latest admin data 2024-06-03 12:45:49 -07:00
Nelson Jovel
2561fa28fc feat: Split academic year into seasons if the academic year's range is
initialized with a season, i.e. "2024-25 Fall".  Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly.   Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year.  So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring".  Add tests
for the new range format.  Set the default cutoff for the start of Spring season will be the last Sunday in February
2024-04-27 14:05:02 -07:00
Nelson Jovel
67ffc996a8 Revert "Split academic year into seasons if the academic year's range is"
This reverts commit a5d4cccb37.
2024-04-26 13:48:30 -07:00
Nelson Jovel
a5d4cccb37 Split academic year into seasons if the academic year's range is
initialized with a season, i.e. "2024-25 Fall".  Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly.   Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year.  So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring".  Add tests
for the new range format.  Set the default cutoff for the start of Spring season will be the last Sunday in February
2024-04-26 13:31:50 -07:00
Nelson Jovel
bdeb89bc8c feat: #187323204 Update staffing numbers for Massachusetts 2024-03-29 12:07:55 -07:00
Nelson Jovel
4c95ea77a9 feat: update framework 2024-03-14 13:05:12 -07:00
Nelson Jovel
5b31fb9da1 feat: update staffing and enrollment numbers 2024-02-22 12:03:45 -08:00
Nelson Jovel
1a6e03e243 feat: update framework with new teacher survey items 2024-02-22 12:02:04 -08:00
rebuilt
ef44c41965 feat: add special education disaggregation 2023-10-24 13:05:57 -07:00
rebuilt
2fd56047d4 Add disaggregation by ELL 2023-10-24 12:51:12 -07:00
rebuilt
2ac30bb107 feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page 2023-10-24 09:05:27 -07:00
rebuilt
e81c9f3c44 fix: remove invalid entries from admin data. This was caused by changing 'next' to 'return' in scraper.rb which caused 2021-22 data to be merged with 2022-23 data. Removed the invalid 2022-23 data. The problematic line in the code was already fixed but the admin data was still in the codebase 2023-07-20 14:07:53 -07:00
rebuilt
a27ccc9079 Revert "Add updated admin data"
This reverts commit d199f7120d.
2023-07-19 21:10:31 -07:00
rebuilt
d199f7120d Add updated admin data 2023-07-19 21:08:17 -07:00
rebuilt
fc14c49394 Scrape new admin data values 2023-07-19 20:11:00 -07:00
00610930cc Add Stoklosa to 23-24 for spring results 2023-06-26 19:07:34 +00:00
8d870abd37 Add seeding for Butler 23-24 2023-06-23 19:45:16 +00:00
7dec0be5af Add seeding & scripts for Daley 2023-24 2023-06-23 18:33:19 +00:00
eab277b877 Fix error in master list 2023-06-23 00:14:31 +00:00
0468dba3ba Remove non-Lowell schools, remove data:seed_only_lowell & data:delete_non_lowell 2023-06-22 23:56:32 +00:00
rebuilt
4a93ab7536 feat: update framework to include new early education survey items 2023-06-12 13:32:36 -07:00
rebuilt
3f4aa8e7af Fix: Parse headers when they are surrounded by quotes. This helps load recent csv files correctly 2023-06-06 15:00:00 -07:00
rebuilt
2ee781ca7a Scrape new admin data values 2023-06-03 16:50:46 -07:00
rebuilt
df8eb465d5 Add updated admin data 2023-04-22 10:35:34 -07:00
rebuilt
9511515c22 Add older admin data file archive 2023-04-22 10:35:10 -07:00
rebuilt
65b8599c6e Update logic for calculating student response rate. Remove references
to survey table.  We no longer check or keep track of the survey type.
Instead we look in the database to see if a survey item has at least 10
responses.  If it does, that survey item was presented to the respondent
and we count it, and all responses when calculating the response rate.

Remove response rate timestamp from caching logic because we no longer
add the response rate to the database. All response rates are calculated
on the fly

Update three_b_two scraper to use teacher only numbers

swap over to using https://profiles.doe.mass.edu/statereport/gradesubjectstaffing.aspx as the source of staffing information
2023-04-08 10:59:48 -07:00
rebuilt
06f9d2f0e9 Scrape enrollment and staffing information. Seed enrollment and staffing information. Update DatabaseCleaner so it cleans up leftover information in the database. Remove old admin csvs from codebase. 2023-03-05 16:15:35 -08:00
rebuilt
984fedff02 Add academic year column to enrollment file. Add enrollment loader to seeder file 2023-02-22 01:12:09 -08:00
rebuilt
52d2676f80 Populate db with grade level data 2023-02-21 16:58:08 -08:00
rebuilt
6b4cfabb5a Update prompts of the survey items to remove pandemic language 2023-02-13 17:18:10 -08:00
rebuilt
b0e84ed82a Modify names and descriptions of subcategories and measures 2023-01-13 12:05:02 -08:00
rebuilt
10515893ff Add elementary school questions to framework. 2023-01-12 17:05:00 -08:00
rebuilt
03c6bff7bb Load survey responses from sftp folder 2023-01-12 17:04:57 -08:00
rebuilt
eeeb4f5d14 Add Stoklosa survey responses 2023-01-12 17:02:35 -08:00
rebuilt
1d6fb8eb67 Add butler middle school results for 2022-23 2023-01-12 17:02:35 -08:00
rebuilt
ed421296c7 Fix bug that caused an incorrect score of 1 to be assigned for admin
data item related to parity index of teachers of color to students of
color.  Now if there's not enough data to calculate a score, it produces
'NA' instead of 1. Also added admin data for a-reso-i1 and a-curv-i1
2023-01-06 17:43:48 -08:00
rebuilt
7b9abe3793 Scrape latest data from DESE 2022-12-20 15:26:11 -08:00
rebuilt
4d5143964b update enrollment counts for 2022-23 academic year 2022-12-20 09:01:30 -08:00