Nelson Jovel
fd61d2753d
chore: add parsing rules for income: 'yes', 'no' and sped: 'No special needs' and ell: 'ELL'
2024-05-22 17:06:24 -07:00
Nelson Jovel
f6f0a45dd2
chore: update glossary values to include parsing rules for when we encounter headers
2024-05-16 17:07:24 -07:00
Nelson Jovel
b1f942133b
update parsing rules from glossary
2024-05-15 10:15:16 -07:00
Nelson Jovel
ea2feb138b
add disaggregation glossary
2024-05-15 10:15:16 -07:00
Nelson Jovel
8bb6f5e8f0
Add ell income and sped parsing rules for SIS data. Add tests for the
...
new inputs.
2024-05-07 18:46:53 -07:00
Nelson Jovel
33da0859b9
Split academic year into seasons if the academic year's range is
...
initialized with a season, i.e. "2024-25 Fall". Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly. Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year. So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring". Add tests
for the new range format. Set the default cutoff for the start of Spring season will be the last Sunday in February
2024-04-25 09:21:04 -07:00
Nelson Jovel
fb04bc37b3
fix: fix broken tests
2024-03-14 12:52:57 -07:00
Nelson Jovel
d6735d449d
feat: Support two date formats: ISO 8601 and the standard US date format
...
used in google sheets
2024-02-27 11:55:47 -08:00
Nelson Jovel
36e21515c3
chore: refactor Race out of survey_item_values
2023-12-20 12:25:23 -08:00
Nelson Jovel
b7e670bb60
Lower threshold for the number of valid student responses from 17 to 11
2023-12-06 14:15:19 -08:00
Nelson Jovel
6e05909423
chore: fix categorization of gender
2023-12-06 14:12:27 -08:00
Nelson Jovel
305ddf2b1a
chore: add test for checking duplicate headers during cleaning process
2023-12-06 14:10:08 -08:00
rebuilt
48e795fcfb
feat: add special education disaggregation
2023-10-06 11:41:52 -07:00
rebuilt
060d7aa55a
Add disaggregation by ELL
2023-09-29 19:29:23 -07:00
rebuilt
714b90b3eb
fix: ensure cleaner outputs columns for all survey items. Before the fix, if a survey item varient (ending in -1, ie s-tint-q1-1) did not have a matching survey item s-tint-q1, the resulting csv would not include that column
2023-08-23 15:30:47 -07:00
rebuilt
a785c69c44
Add Overall Response Rate
2023-08-09 15:13:58 -07:00
rebuilt
5c7729beeb
feat: if admin data value is above 5, round down to 5
2023-07-21 12:14:46 -07:00
rebuilt
4f035f6a63
feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page
2023-07-07 09:14:36 -07:00
Nelson Jovel
0a2c5e02c5
feat: add ability to merge disaggregation data with raw survey data to
...
produce a cleaned csv with merged income disaggregation columns
2023-06-20 12:22:24 -07:00
rebuilt
30285efd69
It's possible for admin data likert score values to be above 5. If that happens, we
...
cap the likert score at 5. This was happening already at the scraper
level but it's also now being done by the admin data loader for safety.
Also make sure to just update admin data instead of deleting and
reloading all values each load. Add tests to confirm this behavior
2023-06-03 17:14:41 -07:00
rebuilt
4509c157fa
Add automated data cleaning. Modify SurveyItemValues class to use regex
...
instead of hard coded values. Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
2023-05-16 13:38:29 -07:00
rebuilt
c15cb7b483
Change survey data loader spec to use factorybot objects instead of loading seeds. Change databasecleaner to use transaction. Add back babel-preset dependency to fix failing javascript test in production.
2023-03-28 03:06:17 -07:00
rebuilt
d7fa505285
remove unneeded column
2023-03-23 13:31:19 -07:00
rebuilt
fbfaafa996
Update school/framework files for ecp schools. Fix tests. Update fixture files with dese ids of schools in the consortium.
2023-03-15 18:04:09 -07:00
rebuilt
06f9d2f0e9
Scrape enrollment and staffing information. Seed enrollment and staffing information. Update DatabaseCleaner so it cleans up leftover information in the database. Remove old admin csvs from codebase.
2023-03-05 16:15:35 -08:00
rebuilt
52d2676f80
Populate db with grade level data
2023-02-21 16:58:08 -08:00
rebuilt
01851d8527
Make sure blank grades in csv load as nils instead of zeros
2023-02-10 13:44:48 -08:00
rebuilt
d5533bb756
Support survey item variants. Survey item id's in the format s-sbel-q1-1 will load into s-sbel-q1
2023-01-12 17:02:05 -08:00
rebuilt
53a08d41bf
Change label for unknown race
2022-12-10 15:44:56 -08:00
rebuilt
a1b7db9b2e
Add ability to load student demographic information for only lowell
2022-12-03 11:33:11 -08:00
rebuilt
d49cf918ac
Add a way to seed only lowell schools
2022-12-03 10:23:02 -08:00
rebuilt
fc9e73f656
make sure survey responses for Butler get loaded correctly
2022-12-02 14:11:54 -08:00
rebuilt
7d7bee6498
Add gender disagreggation
2022-10-27 15:56:50 -07:00
rebuilt
a1f3dfaa33
Load gender information to survey item responses
2022-10-21 21:38:33 -07:00
rebuilt
8cdd1b6285
Create gender class. Load genders to database from demographics file
2022-10-21 17:47:52 -07:00
rebuilt
89a7f27b88
Finishes #183092367 . Adds ui and graphs to show grade level disaggregations
2022-10-16 22:03:25 -07:00
Nelson Jovel
6ed405d16d
Update student csvs
2022-09-26 15:57:56 -07:00
rebuilt
048aacd641
Add admin data for 4D. Finishes #182818489 and #182793402
2022-08-30 21:46:23 -07:00
rebuilt
1e349519bc
Update framework. Remove/Add admin data items. Finishes #182819940
2022-08-26 14:36:01 -07:00
rebuilt
12e4e3f177
import students
2022-07-29 15:34:56 -07:00
rebuilt
765ad6a624
Create ui for data filters. Add listeners to direct to the correct url. Update ui based on the list of selected params
2022-07-26 06:52:50 -07:00
rebuilt
deaf13c976
Modify behavior of insufficient data indicators for admin data items. Now we show indicators in line with the admin data item descriptions to indicate which items are missing data
2022-07-06 15:54:29 -07:00
rebuilt
7e5b235668
Print out invalid values when loading admin data
2022-07-05 14:54:31 -07:00
Nelson Jovel
9ecc501e24
Display measure scores. Finishes #181754978
2022-04-06 13:09:33 -07:00
Nelson Jovel
101c252896
Import survey item responses based on DESE ID instead of qualtrics school code. Finishes #181704978
2022-03-30 17:19:06 -07:00
Nelson Jovel
5a9e8a9b01
Add metadata for 2019-20 year. Finishes #181530277
2022-03-23 19:13:52 -07:00
Nelson Jovel
36da912253
Modify survey item response csv files for 2019-20 to correct incorrect likert scores
2022-03-15 21:31:11 -07:00
Nelson Jovel
c98c0f1e30
Add metadata for 2019-2020 school year. Finishes #181530277
2022-03-14 20:37:29 -07:00
rebuilt
286e74b651
Seed db with surveys to keep track of school, year, and survey type
...
Seed db with survey_item information to keep track of which survey_item is on the short form survey. REcalculate response rate depending on whether school to regular survey or short form survey.
Correct score for short form schools. Finishes #181284202
2022-03-03 10:44:41 +01:00
rebuilt
fcec3de233
Modify collection rate for admin data items. Take into account if a
...
school is a high school and if the admin data item is for high schools
only. Finishes: #181154375 .
2022-02-11 18:54:14 +01:00
