Commit graph

53 commits

Author SHA1 Message Date
Nelson Jovel
36e21515c3 chore: refactor Race out of survey_item_values 2023-12-20 12:25:23 -08:00
Nelson Jovel
b7e670bb60 Lower threshold for the number of valid student responses from 17 to 11 2023-12-06 14:15:19 -08:00
Nelson Jovel
6e05909423 chore: fix categorization of gender 2023-12-06 14:12:27 -08:00
Nelson Jovel
305ddf2b1a chore: add test for checking duplicate headers during cleaning process 2023-12-06 14:10:08 -08:00
rebuilt
48e795fcfb feat: add special education disaggregation 2023-10-06 11:41:52 -07:00
rebuilt
060d7aa55a Add disaggregation by ELL 2023-09-29 19:29:23 -07:00
rebuilt
714b90b3eb fix: ensure cleaner outputs columns for all survey items. Before the fix, if a survey item varient (ending in -1, ie s-tint-q1-1) did not have a matching survey item s-tint-q1, the resulting csv would not include that column 2023-08-23 15:30:47 -07:00
rebuilt
a785c69c44 Add Overall Response Rate 2023-08-09 15:13:58 -07:00
rebuilt
5c7729beeb feat: if admin data value is above 5, round down to 5 2023-07-21 12:14:46 -07:00
rebuilt
4f035f6a63 feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page 2023-07-07 09:14:36 -07:00
Nelson Jovel
0a2c5e02c5 feat: add ability to merge disaggregation data with raw survey data to
produce a cleaned csv with merged income disaggregation columns
2023-06-20 12:22:24 -07:00
rebuilt
30285efd69 It's possible for admin data likert score values to be above 5. If that happens, we
cap the likert score at 5.   This was happening already at the scraper
level but it's also now being done by the admin data loader for safety.
Also make sure to just update admin data instead of deleting and
reloading all values each load. Add tests to confirm this behavior
2023-06-03 17:14:41 -07:00
rebuilt
4509c157fa Add automated data cleaning. Modify SurveyItemValues class to use regex
instead of hard coded values.  Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
2023-05-16 13:38:29 -07:00
rebuilt
c15cb7b483 Change survey data loader spec to use factorybot objects instead of loading seeds. Change databasecleaner to use transaction. Add back babel-preset dependency to fix failing javascript test in production. 2023-03-28 03:06:17 -07:00
rebuilt
d7fa505285 remove unneeded column 2023-03-23 13:31:19 -07:00
rebuilt
fbfaafa996 Update school/framework files for ecp schools. Fix tests. Update fixture files with dese ids of schools in the consortium. 2023-03-15 18:04:09 -07:00
rebuilt
06f9d2f0e9 Scrape enrollment and staffing information. Seed enrollment and staffing information. Update DatabaseCleaner so it cleans up leftover information in the database. Remove old admin csvs from codebase. 2023-03-05 16:15:35 -08:00
rebuilt
52d2676f80 Populate db with grade level data 2023-02-21 16:58:08 -08:00
rebuilt
01851d8527 Make sure blank grades in csv load as nils instead of zeros 2023-02-10 13:44:48 -08:00
rebuilt
d5533bb756 Support survey item variants. Survey item id's in the format s-sbel-q1-1 will load into s-sbel-q1 2023-01-12 17:02:05 -08:00
rebuilt
53a08d41bf Change label for unknown race 2022-12-10 15:44:56 -08:00
rebuilt
a1b7db9b2e Add ability to load student demographic information for only lowell 2022-12-03 11:33:11 -08:00
rebuilt
d49cf918ac Add a way to seed only lowell schools 2022-12-03 10:23:02 -08:00
rebuilt
fc9e73f656 make sure survey responses for Butler get loaded correctly 2022-12-02 14:11:54 -08:00
rebuilt
7d7bee6498 Add gender disagreggation 2022-10-27 15:56:50 -07:00
rebuilt
a1f3dfaa33 Load gender information to survey item responses 2022-10-21 21:38:33 -07:00
rebuilt
8cdd1b6285 Create gender class. Load genders to database from demographics file 2022-10-21 17:47:52 -07:00
rebuilt
89a7f27b88 Finishes #183092367. Adds ui and graphs to show grade level disaggregations 2022-10-16 22:03:25 -07:00
Nelson Jovel
6ed405d16d Update student csvs 2022-09-26 15:57:56 -07:00
rebuilt
048aacd641 Add admin data for 4D. Finishes #182818489 and #182793402 2022-08-30 21:46:23 -07:00
rebuilt
1e349519bc Update framework. Remove/Add admin data items. Finishes #182819940 2022-08-26 14:36:01 -07:00
rebuilt
12e4e3f177 import students 2022-07-29 15:34:56 -07:00
rebuilt
765ad6a624 Create ui for data filters. Add listeners to direct to the correct url. Update ui based on the list of selected params 2022-07-26 06:52:50 -07:00
rebuilt
deaf13c976 Modify behavior of insufficient data indicators for admin data items. Now we show indicators in line with the admin data item descriptions to indicate which items are missing data 2022-07-06 15:54:29 -07:00
rebuilt
7e5b235668 Print out invalid values when loading admin data 2022-07-05 14:54:31 -07:00
Nelson Jovel
9ecc501e24 Display measure scores. Finishes #181754978 2022-04-06 13:09:33 -07:00
Nelson Jovel
101c252896 Import survey item responses based on DESE ID instead of qualtrics school code. Finishes #181704978 2022-03-30 17:19:06 -07:00
Nelson Jovel
5a9e8a9b01 Add metadata for 2019-20 year. Finishes #181530277 2022-03-23 19:13:52 -07:00
Nelson Jovel
36da912253 Modify survey item response csv files for 2019-20 to correct incorrect likert scores 2022-03-15 21:31:11 -07:00
Nelson Jovel
c98c0f1e30 Add metadata for 2019-2020 school year. Finishes #181530277 2022-03-14 20:37:29 -07:00
rebuilt
286e74b651 Seed db with surveys to keep track of school, year, and survey type
Seed db with survey_item information to keep track of which survey_item is on the short form survey.  REcalculate response rate depending on whether school to regular survey or short form survey.

Correct score for short form schools.  Finishes #181284202
2022-03-03 10:44:41 +01:00
rebuilt
fcec3de233 Modify collection rate for admin data items. Take into account if a
school is a high school and if the admin data item is for high schools
only.  Finishes: #181154375.
2022-02-11 18:54:14 +01:00
rebuilt
59865cd874 Show response rate for students 2022-01-27 22:43:10 +01:00
Nelson Jovel
cacc853518 Adds category short description to database and renders descriptions in
their corresponding locations to the site.  Finishes #180090033.
2021-12-13 21:15:59 +01:00
rebuilt
b5badfaef5 Add DESE ID to schools
- Add migration
- Create one-off script `rake one_off:add_dese_ids` to add the DESE ID to schools
- Update seeder to seed schools based on DESE IDs
2021-11-18 16:54:08 -05:00
Alex Basson
228cf137ad Finishes #179904795. Adds prompts to measures section on browse page 2021-11-01 20:33:45 +01:00
Alex Basson
a269bb0ec1 Try reporting on batch inserts 2021-09-27 16:30:23 -04:00
Alex Basson
027a2eeb31 Update survey response csvs to use ISO 8601 date format 2021-09-27 15:00:45 -04:00
Alex Basson
3b7695c615 Update teacher survey responses to cleaned csv 2021-09-27 13:57:43 -04:00
Alex Basson
a41d5bb4c9 Update survey data loader for new student survey responses csv 2021-09-27 13:54:25 -04:00