e022af0161
feat: pull down new admin data. Fix problems with some scrapers. For 5D-ii make sure the likert score is 1 if the nurse count is 0. Prevent devision by zero returning infinity. For 3A-ii make sure not to perform division by zero. Likert score will be 1 if the number of guidance couselors, psychologists, or paraprofessionals is zero.
9 months ago
e4f53b5f94
feat: Add scraper for a-curv-i7. Scrape new admin data for that item
10 months ago
3073caa21b
feat: update source of truth to add a-curv-i7 and disable other admin data items
10 months ago
b96e0a57a9
feat: add scraper for 4D-ii
10 months ago
0de222758f
feat: finish scraper for students of color in advanced courses
10 months ago
2a71e2cc99
Fix hs only admin data item. Use alternate method to check if a school is a high school
10 months ago
a6793d03e4
chore: update esp counts
10 months ago
f0d17c376a
chore: rescrape 5D-2
10 months ago
34c0b21e9c
chore: fix problem with enrollment scraper
10 months ago
d23f9ccc6f
chore: remove test esp counts for Lee
11 months ago
8e25530ad1
chore: remove empty file
11 months ago
a595b2d988
chore: scrape new admin data; a-ovpe-i1
11 months ago
93833a86bc
feat: add admin data item a-curv-i5 with temporary benchmark of 2
11 months ago
534f42dfe0
feat: add esp counts when calculating teacher participation rates on overview page
11 months ago
849e6e2573
feat: add updated admin data
1 year ago
def9aad334
feat: update source of truth
1 year ago
424e4c79a5
feat: Show parent scales on browse page
1 year ago
f5e7ade5b9
feat: update source of truth
1 year ago
6a8396f4df
feat: read and load parent survey items
1 year ago
564ddeee35
feat: add wisconsin admin data
1 year ago
b3b361a4ae
feat: run scraper to get latest admin data
2 years ago
2561fa28fc
feat: Split academic year into seasons if the academic year's range is
...
initialized with a season, i.e. "2024-25 Fall". Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly. Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year. So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring". Add tests
for the new range format. Set the default cutoff for the start of Spring season will be the last Sunday in February
2 years ago
67ffc996a8
Revert "Split academic year into seasons if the academic year's range is"
...
This reverts commit a5d4cccb37
2 years ago
a5d4cccb37
Split academic year into seasons if the academic year's range is
...
initialized with a season, i.e. "2024-25 Fall". Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly. Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year. So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring". Add tests
for the new range format. Set the default cutoff for the start of Spring season will be the last Sunday in February
2 years ago
bdeb89bc8c
feat: #187323204 Update staffing numbers for Massachusetts
2 years ago
4c95ea77a9
feat: update framework
2 years ago
5b31fb9da1
feat: update staffing and enrollment numbers
2 years ago
1a6e03e243
feat: update framework with new teacher survey items
2 years ago
ef44c41965
feat: add special education disaggregation
2 years ago
2fd56047d4
Add disaggregation by ELL
2 years ago
2ac30bb107
feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page
2 years ago
e81c9f3c44
fix: remove invalid entries from admin data. This was caused by changing 'next' to 'return' in scraper.rb which caused 2021-22 data to be merged with 2022-23 data. Removed the invalid 2022-23 data. The problematic line in the code was already fixed but the admin data was still in the codebase
2 years ago
a27ccc9079
Revert "Add updated admin data"
...
This reverts commit d199f7120d
2 years ago
d199f7120d
Add updated admin data
2 years ago
fc14c49394
Scrape new admin data values
2 years ago
Gabe Farrell
00610930cc
Add Stoklosa to 23-24 for spring results
2 years ago
Gabe Farrell
8d870abd37
Add seeding for Butler 23-24
2 years ago
Gabe Farrell
7dec0be5af
Add seeding & scripts for Daley 2023-24
2 years ago
Gabe Farrell
eab277b877
Fix error in master list
2 years ago
Gabe Farrell
0468dba3ba
Remove non-Lowell schools, remove data:seed_only_lowell & data:delete_non_lowell
2 years ago
4a93ab7536
feat: update framework to include new early education survey items
3 years ago
3f4aa8e7af
Fix: Parse headers when they are surrounded by quotes. This helps load recent csv files correctly
3 years ago
2ee781ca7a
Scrape new admin data values
3 years ago
df8eb465d5
Add updated admin data
3 years ago
9511515c22
Add older admin data file archive
3 years ago
65b8599c6e
Update logic for calculating student response rate. Remove references
...
to survey table. We no longer check or keep track of the survey type.
Instead we look in the database to see if a survey item has at least 10
responses. If it does, that survey item was presented to the respondent
and we count it, and all responses when calculating the response rate.
Remove response rate timestamp from caching logic because we no longer
add the response rate to the database. All response rates are calculated
on the fly
Update three_b_two scraper to use teacher only numbers
swap over to using https://profiles.doe.mass.edu/statereport/gradesubjectstaffing.aspx as the source of staffing information
3 years ago
06f9d2f0e9
Scrape enrollment and staffing information. Seed enrollment and staffing information. Update DatabaseCleaner so it cleans up leftover information in the database. Remove old admin csvs from codebase.
3 years ago
984fedff02
Add academic year column to enrollment file. Add enrollment loader to seeder file
3 years ago
52d2676f80
Populate db with grade level data
3 years ago
6b4cfabb5a
Update prompts of the survey items to remove pandemic language
3 years ago
rebuilt
Gabe Farrell