Commit graph

50 commits

Author SHA1 Message Date
Nelson Jovel
acf25cb525 update parsing rules from glossary 2024-05-15 10:54:39 -07:00
Nelson Jovel
d4db4e0fa2 add disaggregation glossary 2024-05-15 10:54:34 -07:00
Nelson Jovel
ac5c1edfbf feat: Split academic year into seasons if the academic year's range is
initialized with a season, i.e. "2024-25 Fall".  Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly.   Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year.  So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring".  Add tests
for the new range format.  Set the default cutoff for the start of Spring season will be the last Sunday in February
2024-04-27 14:24:05 -07:00
Nelson Jovel
9880343d79 fix: fix broken tests 2024-03-14 12:56:43 -07:00
Nelson Jovel
c4d8b927af feat: Support two date formats: ISO 8601 and the standard US date format
used in google sheets
2024-02-27 12:00:45 -08:00
Nelson Jovel
317fe3239a chore: refactor Race out of survey_item_values 2023-12-20 12:35:14 -08:00
Nelson Jovel
6f265302ea feat: if the filename includes the words 'form' or 'part' add that to the resulting cleaned filename 2023-12-18 15:58:40 -08:00
rebuilt
acfdaf5587 feat: add special education disaggregation 2023-10-17 12:29:00 -07:00
rebuilt
245cde85cd Add disaggregation by ELL 2023-10-17 11:18:47 -07:00
rebuilt
76ebcc6ef3 feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page 2023-08-08 15:52:12 -07:00
rebuilt
0a5500ecc9 feat: Add overall response rate 2023-08-08 10:01:48 -07:00
rebuilt
8f276a5f1a feat: if admin data value is above 5, round down to 5 2023-07-21 12:55:39 -07:00
rebuilt
904d0d2f2c It's possible for admin data likert score values to be above 5. If that happens, we
cap the likert score at 5.   This was happening already at the scraper
level but it's also now being done by the admin data loader for safety.
Also make sure to just update admin data instead of deleting and
reloading all values each load. Add tests to confirm this behavior
2023-06-03 16:06:50 -07:00
rebuilt
0dfc9726d0 Add automated data cleaning. Modify SurveyItemValues class to use regex
instead of hard coded values.  Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
2023-05-24 11:59:53 -07:00
rebuilt
a066f464c7 fix failing tests 2023-04-30 16:35:08 -07:00
rebuilt
09963c3323 Remove surveys table from codebase since it's no longer needed after changing logic surrounding response rates and score calculations 2023-04-22 14:21:48 -07:00
rebuilt
d5533bb756 Support survey item variants. Survey item id's in the format s-sbel-q1-1 will load into s-sbel-q1 2023-01-12 17:02:05 -08:00
rebuilt
53a08d41bf Change label for unknown race 2022-12-10 15:44:56 -08:00
rebuilt
a1b7db9b2e Add ability to load student demographic information for only lowell 2022-12-03 11:33:11 -08:00
rebuilt
d49cf918ac Add a way to seed only lowell schools 2022-12-03 10:23:02 -08:00
rebuilt
fc9e73f656 make sure survey responses for Butler get loaded correctly 2022-12-02 14:11:54 -08:00
rebuilt
7d7bee6498 Add gender disagreggation 2022-10-27 15:56:50 -07:00
rebuilt
a1f3dfaa33 Load gender information to survey item responses 2022-10-21 21:38:33 -07:00
rebuilt
8cdd1b6285 Create gender class. Load genders to database from demographics file 2022-10-21 17:47:52 -07:00
rebuilt
89a7f27b88 Finishes #183092367. Adds ui and graphs to show grade level disaggregations 2022-10-16 22:03:25 -07:00
Nelson Jovel
6ed405d16d Update student csvs 2022-09-26 15:57:56 -07:00
rebuilt
048aacd641 Add admin data for 4D. Finishes #182818489 and #182793402 2022-08-30 21:46:23 -07:00
rebuilt
1e349519bc Update framework. Remove/Add admin data items. Finishes #182819940 2022-08-26 14:36:01 -07:00
rebuilt
12e4e3f177 import students 2022-07-29 15:34:56 -07:00
rebuilt
765ad6a624 Create ui for data filters. Add listeners to direct to the correct url. Update ui based on the list of selected params 2022-07-26 06:52:50 -07:00
rebuilt
deaf13c976 Modify behavior of insufficient data indicators for admin data items. Now we show indicators in line with the admin data item descriptions to indicate which items are missing data 2022-07-06 15:54:29 -07:00
rebuilt
7e5b235668 Print out invalid values when loading admin data 2022-07-05 14:54:31 -07:00
Nelson Jovel
9ecc501e24 Display measure scores. Finishes #181754978 2022-04-06 13:09:33 -07:00
Nelson Jovel
101c252896 Import survey item responses based on DESE ID instead of qualtrics school code. Finishes #181704978 2022-03-30 17:19:06 -07:00
Nelson Jovel
5a9e8a9b01 Add metadata for 2019-20 year. Finishes #181530277 2022-03-23 19:13:52 -07:00
Nelson Jovel
36da912253 Modify survey item response csv files for 2019-20 to correct incorrect likert scores 2022-03-15 21:31:11 -07:00
Nelson Jovel
c98c0f1e30 Add metadata for 2019-2020 school year. Finishes #181530277 2022-03-14 20:37:29 -07:00
rebuilt
286e74b651 Seed db with surveys to keep track of school, year, and survey type
Seed db with survey_item information to keep track of which survey_item is on the short form survey.  REcalculate response rate depending on whether school to regular survey or short form survey.

Correct score for short form schools.  Finishes #181284202
2022-03-03 10:44:41 +01:00
rebuilt
fcec3de233 Modify collection rate for admin data items. Take into account if a
school is a high school and if the admin data item is for high schools
only.  Finishes: #181154375.
2022-02-11 18:54:14 +01:00
rebuilt
59865cd874 Show response rate for students 2022-01-27 22:43:10 +01:00
Nelson Jovel
cacc853518 Adds category short description to database and renders descriptions in
their corresponding locations to the site.  Finishes #180090033.
2021-12-13 21:15:59 +01:00
rebuilt
b5badfaef5 Add DESE ID to schools
- Add migration
- Create one-off script `rake one_off:add_dese_ids` to add the DESE ID to schools
- Update seeder to seed schools based on DESE IDs
2021-11-18 16:54:08 -05:00
Alex Basson
228cf137ad Finishes #179904795. Adds prompts to measures section on browse page 2021-11-01 20:33:45 +01:00
Alex Basson
a269bb0ec1 Try reporting on batch inserts 2021-09-27 16:30:23 -04:00
Alex Basson
027a2eeb31 Update survey response csvs to use ISO 8601 date format 2021-09-27 15:00:45 -04:00
Alex Basson
3b7695c615 Update teacher survey responses to cleaned csv 2021-09-27 13:57:43 -04:00
Alex Basson
a41d5bb4c9 Update survey data loader for new student survey responses csv 2021-09-27 13:54:25 -04:00
Alex Basson
98e7f3ce57 Update survey response data load to conform to survey response CSV standard 2021-09-24 10:52:29 -04:00
Alex Basson
fd091cfa4f Load 2020-21 student survey responses 2021-09-22 15:15:59 -04:00
Alex Basson
f5724407f2 Load teacher survey responses 2021-09-22 08:44:54 -04:00