Commit graph

67 commits

Author SHA1 Message Date
nelson
b2e7c45ddd ECP-77 Make sure admin data seeder updates the description from the latest column 2025-02-13 09:37:07 -08:00
Nelson Jovel
02bcb2b75b feat: add esp counts when calculating teacher participation rates on overview page 2025-01-15 13:39:41 -08:00
Nelson Jovel
7e98f7446c fix: tests 2024-11-26 10:17:36 -08:00
Nelson Jovel
beb93aa8e8 fix: make sure all likert scores get counted even when the survey item id has different capitalization. Add tests for uploading parent data. Change the parent response rate calcuation to count all students in the school instead of just for the grades that were given the student survey 2024-11-08 15:36:34 -08:00
Nelson Jovel
e5e969b968 feat: add parent survey gauges 2024-09-16 15:24:43 -07:00
Nelson Jovel
d8d2f0f91d fix: correctly load survey items from sample framework file. Fix broken tests 2024-08-27 12:45:52 -07:00
Nelson Jovel
fd61d2753d chore: add parsing rules for income: 'yes', 'no' and sped: 'No special needs' and ell: 'ELL' 2024-05-22 17:06:24 -07:00
Nelson Jovel
f6f0a45dd2 chore: update glossary values to include parsing rules for when we encounter headers 2024-05-16 17:07:24 -07:00
Nelson Jovel
b1f942133b update parsing rules from glossary 2024-05-15 10:15:16 -07:00
Nelson Jovel
ea2feb138b add disaggregation glossary 2024-05-15 10:15:16 -07:00
Nelson Jovel
8bb6f5e8f0 Add ell income and sped parsing rules for SIS data. Add tests for the
new inputs.
2024-05-07 18:46:53 -07:00
Nelson Jovel
33da0859b9 Split academic year into seasons if the academic year's range is
initialized with a season, i.e. "2024-25 Fall".  Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly.   Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year.  So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring".  Add tests
for the new range format.  Set the default cutoff for the start of Spring season will be the last Sunday in February
2024-04-25 09:21:04 -07:00
Nelson Jovel
fb04bc37b3 fix: fix broken tests 2024-03-14 12:52:57 -07:00
Nelson Jovel
d6735d449d feat: Support two date formats: ISO 8601 and the standard US date format
used in google sheets
2024-02-27 11:55:47 -08:00
Nelson Jovel
36e21515c3 chore: refactor Race out of survey_item_values 2023-12-20 12:25:23 -08:00
Nelson Jovel
b7e670bb60 Lower threshold for the number of valid student responses from 17 to 11 2023-12-06 14:15:19 -08:00
Nelson Jovel
6e05909423 chore: fix categorization of gender 2023-12-06 14:12:27 -08:00
Nelson Jovel
305ddf2b1a chore: add test for checking duplicate headers during cleaning process 2023-12-06 14:10:08 -08:00
rebuilt
48e795fcfb feat: add special education disaggregation 2023-10-06 11:41:52 -07:00
rebuilt
060d7aa55a Add disaggregation by ELL 2023-09-29 19:29:23 -07:00
rebuilt
714b90b3eb fix: ensure cleaner outputs columns for all survey items. Before the fix, if a survey item varient (ending in -1, ie s-tint-q1-1) did not have a matching survey item s-tint-q1, the resulting csv would not include that column 2023-08-23 15:30:47 -07:00
rebuilt
a785c69c44 Add Overall Response Rate 2023-08-09 15:13:58 -07:00
rebuilt
5c7729beeb feat: if admin data value is above 5, round down to 5 2023-07-21 12:14:46 -07:00
rebuilt
4f035f6a63 feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page 2023-07-07 09:14:36 -07:00
Nelson Jovel
0a2c5e02c5 feat: add ability to merge disaggregation data with raw survey data to
produce a cleaned csv with merged income disaggregation columns
2023-06-20 12:22:24 -07:00
rebuilt
30285efd69 It's possible for admin data likert score values to be above 5. If that happens, we
cap the likert score at 5.   This was happening already at the scraper
level but it's also now being done by the admin data loader for safety.
Also make sure to just update admin data instead of deleting and
reloading all values each load. Add tests to confirm this behavior
2023-06-03 17:14:41 -07:00
rebuilt
4509c157fa Add automated data cleaning. Modify SurveyItemValues class to use regex
instead of hard coded values.  Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
2023-05-16 13:38:29 -07:00
rebuilt
c15cb7b483 Change survey data loader spec to use factorybot objects instead of loading seeds. Change databasecleaner to use transaction. Add back babel-preset dependency to fix failing javascript test in production. 2023-03-28 03:06:17 -07:00
rebuilt
d7fa505285 remove unneeded column 2023-03-23 13:31:19 -07:00
rebuilt
fbfaafa996 Update school/framework files for ecp schools. Fix tests. Update fixture files with dese ids of schools in the consortium. 2023-03-15 18:04:09 -07:00
rebuilt
06f9d2f0e9 Scrape enrollment and staffing information. Seed enrollment and staffing information. Update DatabaseCleaner so it cleans up leftover information in the database. Remove old admin csvs from codebase. 2023-03-05 16:15:35 -08:00
rebuilt
52d2676f80 Populate db with grade level data 2023-02-21 16:58:08 -08:00
rebuilt
01851d8527 Make sure blank grades in csv load as nils instead of zeros 2023-02-10 13:44:48 -08:00
rebuilt
d5533bb756 Support survey item variants. Survey item id's in the format s-sbel-q1-1 will load into s-sbel-q1 2023-01-12 17:02:05 -08:00
rebuilt
53a08d41bf Change label for unknown race 2022-12-10 15:44:56 -08:00
rebuilt
a1b7db9b2e Add ability to load student demographic information for only lowell 2022-12-03 11:33:11 -08:00
rebuilt
d49cf918ac Add a way to seed only lowell schools 2022-12-03 10:23:02 -08:00
rebuilt
fc9e73f656 make sure survey responses for Butler get loaded correctly 2022-12-02 14:11:54 -08:00
rebuilt
7d7bee6498 Add gender disagreggation 2022-10-27 15:56:50 -07:00
rebuilt
a1f3dfaa33 Load gender information to survey item responses 2022-10-21 21:38:33 -07:00
rebuilt
8cdd1b6285 Create gender class. Load genders to database from demographics file 2022-10-21 17:47:52 -07:00
rebuilt
89a7f27b88 Finishes #183092367. Adds ui and graphs to show grade level disaggregations 2022-10-16 22:03:25 -07:00
Nelson Jovel
6ed405d16d Update student csvs 2022-09-26 15:57:56 -07:00
rebuilt
048aacd641 Add admin data for 4D. Finishes #182818489 and #182793402 2022-08-30 21:46:23 -07:00
rebuilt
1e349519bc Update framework. Remove/Add admin data items. Finishes #182819940 2022-08-26 14:36:01 -07:00
rebuilt
12e4e3f177 import students 2022-07-29 15:34:56 -07:00
rebuilt
765ad6a624 Create ui for data filters. Add listeners to direct to the correct url. Update ui based on the list of selected params 2022-07-26 06:52:50 -07:00
rebuilt
deaf13c976 Modify behavior of insufficient data indicators for admin data items. Now we show indicators in line with the admin data item descriptions to indicate which items are missing data 2022-07-06 15:54:29 -07:00
rebuilt
7e5b235668 Print out invalid values when loading admin data 2022-07-05 14:54:31 -07:00
Nelson Jovel
9ecc501e24 Display measure scores. Finishes #181754978 2022-04-06 13:09:33 -07:00