Commit graph

170 commits

Author SHA1 Message Date
Nelson Jovel
a5d4cccb37 Split academic year into seasons if the academic year's range is
initialized with a season, i.e. "2024-25 Fall".  Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly.   Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year.  So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring".  Add tests
for the new range format.  Set the default cutoff for the start of Spring season will be the last Sunday in February
2024-04-26 13:31:50 -07:00
Nelson Jovel
bdeb89bc8c feat: #187323204 Update staffing numbers for Massachusetts 2024-03-29 12:07:55 -07:00
Nelson Jovel
4c95ea77a9 feat: update framework 2024-03-14 13:05:12 -07:00
Nelson Jovel
5b31fb9da1 feat: update staffing and enrollment numbers 2024-02-22 12:03:45 -08:00
Nelson Jovel
1a6e03e243 feat: update framework with new teacher survey items 2024-02-22 12:02:04 -08:00
rebuilt
ef44c41965 feat: add special education disaggregation 2023-10-24 13:05:57 -07:00
rebuilt
2fd56047d4 Add disaggregation by ELL 2023-10-24 12:51:12 -07:00
rebuilt
2ac30bb107 feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page 2023-10-24 09:05:27 -07:00
rebuilt
e81c9f3c44 fix: remove invalid entries from admin data. This was caused by changing 'next' to 'return' in scraper.rb which caused 2021-22 data to be merged with 2022-23 data. Removed the invalid 2022-23 data. The problematic line in the code was already fixed but the admin data was still in the codebase 2023-07-20 14:07:53 -07:00
rebuilt
a27ccc9079 Revert "Add updated admin data"
This reverts commit d199f7120d.
2023-07-19 21:10:31 -07:00
rebuilt
d199f7120d Add updated admin data 2023-07-19 21:08:17 -07:00
rebuilt
fc14c49394 Scrape new admin data values 2023-07-19 20:11:00 -07:00
00610930cc Add Stoklosa to 23-24 for spring results 2023-06-26 19:07:34 +00:00
8d870abd37 Add seeding for Butler 23-24 2023-06-23 19:45:16 +00:00
7dec0be5af Add seeding & scripts for Daley 2023-24 2023-06-23 18:33:19 +00:00
eab277b877 Fix error in master list 2023-06-23 00:14:31 +00:00
0468dba3ba Remove non-Lowell schools, remove data:seed_only_lowell & data:delete_non_lowell 2023-06-22 23:56:32 +00:00
rebuilt
4a93ab7536 feat: update framework to include new early education survey items 2023-06-12 13:32:36 -07:00
rebuilt
3f4aa8e7af Fix: Parse headers when they are surrounded by quotes. This helps load recent csv files correctly 2023-06-06 15:00:00 -07:00
rebuilt
2ee781ca7a Scrape new admin data values 2023-06-03 16:50:46 -07:00
rebuilt
df8eb465d5 Add updated admin data 2023-04-22 10:35:34 -07:00
rebuilt
9511515c22 Add older admin data file archive 2023-04-22 10:35:10 -07:00
rebuilt
65b8599c6e Update logic for calculating student response rate. Remove references
to survey table.  We no longer check or keep track of the survey type.
Instead we look in the database to see if a survey item has at least 10
responses.  If it does, that survey item was presented to the respondent
and we count it, and all responses when calculating the response rate.

Remove response rate timestamp from caching logic because we no longer
add the response rate to the database. All response rates are calculated
on the fly

Update three_b_two scraper to use teacher only numbers

swap over to using https://profiles.doe.mass.edu/statereport/gradesubjectstaffing.aspx as the source of staffing information
2023-04-08 10:59:48 -07:00
rebuilt
06f9d2f0e9 Scrape enrollment and staffing information. Seed enrollment and staffing information. Update DatabaseCleaner so it cleans up leftover information in the database. Remove old admin csvs from codebase. 2023-03-05 16:15:35 -08:00
rebuilt
984fedff02 Add academic year column to enrollment file. Add enrollment loader to seeder file 2023-02-22 01:12:09 -08:00
rebuilt
52d2676f80 Populate db with grade level data 2023-02-21 16:58:08 -08:00
rebuilt
6b4cfabb5a Update prompts of the survey items to remove pandemic language 2023-02-13 17:18:10 -08:00
rebuilt
b0e84ed82a Modify names and descriptions of subcategories and measures 2023-01-13 12:05:02 -08:00
rebuilt
10515893ff Add elementary school questions to framework. 2023-01-12 17:05:00 -08:00
rebuilt
03c6bff7bb Load survey responses from sftp folder 2023-01-12 17:04:57 -08:00
rebuilt
eeeb4f5d14 Add Stoklosa survey responses 2023-01-12 17:02:35 -08:00
rebuilt
1d6fb8eb67 Add butler middle school results for 2022-23 2023-01-12 17:02:35 -08:00
rebuilt
ed421296c7 Fix bug that caused an incorrect score of 1 to be assigned for admin
data item related to parity index of teachers of color to students of
color.  Now if there's not enough data to calculate a score, it produces
'NA' instead of 1. Also added admin data for a-reso-i1 and a-curv-i1
2023-01-06 17:43:48 -08:00
rebuilt
7b9abe3793 Scrape latest data from DESE 2022-12-20 15:26:11 -08:00
rebuilt
4d5143964b update enrollment counts for 2022-23 academic year 2022-12-20 09:01:30 -08:00
rebuilt
69179ce157 Replace javascript logic with hotwire. Also hide district dropdown on
home page if there is only one district.
2022-12-14 13:41:34 -08:00
rebuilt
36d7794e3a Change name of Cardinal O'Connell Alternative School to Cardinal O'Connel Early Learning Center 2022-12-11 16:09:42 -08:00
rebuilt
53a08d41bf Change label for unknown race 2022-12-10 15:44:56 -08:00
rebuilt
ba2da2e378 Update names of Seacoast High School to Seacoast High School/City Lab, and Riverside School to The BRIDGE Program at the Riverside School 2022-12-04 12:30:13 -08:00
rebuilt
d49cf918ac Add a way to seed only lowell schools 2022-12-03 10:23:02 -08:00
rebuilt
3ca270e3b1 Fix more malformed csv errors 2022-11-25 03:09:00 -08:00
rebuilt
f82f869122 Fix malformed csv errors 2022-11-24 02:49:14 -08:00
rebuilt
318bbb01ea removed some free response columns that caused malformed csv errors 2022-11-23 13:14:29 -08:00
rebuilt
6951b6a0a1 Update cutpoints for admin data items from source of truth 2022-11-03 14:01:01 -07:00
rebuilt
54a94648e6 Make csv file match source of truth 2022-11-02 16:40:47 -07:00
rebuilt
7d7bee6498 Add gender disagreggation 2022-10-27 15:56:50 -07:00
rebuilt
a1f3dfaa33 Load gender information to survey item responses 2022-10-21 21:38:33 -07:00
rebuilt
8cdd1b6285 Create gender class. Load genders to database from demographics file 2022-10-21 17:47:52 -07:00
rebuilt
f4e2e6ca83 Correct headers for 4D so the data can be correctly imported 2022-10-21 17:29:19 -07:00
rebuilt
89a7f27b88 Finishes #183092367. Adds ui and graphs to show grade level disaggregations 2022-10-16 22:03:25 -07:00