Nelson Jovel
4c017cf857
fix: add pre-k to list of grades
2 years ago
Nelson Jovel
2cb43058a0
fix: loosen restrictions on date format
2 years ago
Nelson Jovel
289b04bc69
match an additional format for Dates. Supported dates are now '1/10/2022 14:21:45' '2022-1-10T14:21:45' '2022-1-10 14:21:45'
2 years ago
Nelson Jovel
d6735d449d
feat: Support two date formats: ISO 8601 and the standard US date format
...
used in google sheets
2 years ago
Nelson Jovel
03349b0ed5
chore: support alternate format for recorded date
2 years ago
Nelson Jovel
37610e732f
chore: alphabetize districts when writing filename for cleaned files
2 years ago
Nelson Jovel
b6de3349d6
fix: support alternate format for active admin data items. Support both 'True/False' and '1/0'
2 years ago
Nelson Jovel
0a32fb50ff
fix: no longer support 'form' in filename when cleaning. Only look for 'part X' and add that to the filename if it exists
2 years ago
Nelson Jovel
725bef2a8f
fix: Support true/false column values when categorizing income status. True is categorized as Economically Disadvantaged. False is categorized as Not Economically Disadvantaged
2 years ago
Nelson Jovel
48e1f941f5
fix: change the default to not an english language learner. Blank columns are treated as Not ELL. Only mark student as an english language learner if it's marked as such. Columns marked with 'NA' are treated as unknown
2 years ago
Nelson Jovel
3c210e0ab6
chore: rename admin data to school data on analyze page
2 years ago
Nelson Jovel
90d1419d9c
feat: change 'school admin data' to 'school data'
2 years ago
Nelson Jovel
6558ed491a
perf: reduce number of calls for student and teacher survey items in response rate calculators
2 years ago
Nelson Jovel
ec53cc9ae4
fix: correct a problem where survey items with insufficient responses were contributing to the response rate calculation
2 years ago
Nelson Jovel
c0b8c408ea
perf: reduce time spent in sql query for student response rate
2 years ago
Nelson Jovel
2f74153114
chore: refactor teacher response rate
2 years ago
Nelson Jovel
b0c9a0451e
perf: reduce number of queries for teacher survey_items
2 years ago
Nelson Jovel
8fb0a280ca
perf: reduce number of queries for respondents
2 years ago
Nelson Jovel
f026ea22ef
perf: reduce number of queries by requesting grouped_responses once instead of for each measure
2 years ago
Nelson Jovel
ed8e621333
chore: remove method that wasn't needed
2 years ago
Nelson Jovel
9e8f917457
chore: performance fixes for response rate calculation
2 years ago
Nelson Jovel
6a283b1fc8
chore: prevent multiple lookups for the boston district by inlining the
...
sql
2 years ago
Nelson Jovel
cc5e0b142c
chore: memoize grades for school
2 years ago
Nelson Jovel
60927e3271
fix: reduce number of n+1 queries
2 years ago
Nelson Jovel
ebf4ca4166
chore: move code that normalizes race data to the Race class
2 years ago
Nelson Jovel
56b512810c
chore: remove lowell seeding rules
2 years ago
Nelson Jovel
880b438eb4
chore: reenable test spec that tests data loader for races
2 years ago
Nelson Jovel
36e21515c3
chore: refactor Race out of survey_item_values
2 years ago
Nelson Jovel
e7fb009425
chore: refactor Gender out out of survey_item_values row
2 years ago
Nelson Jovel
f9717f80c7
chore: remove todo
2 years ago
Nelson Jovel
5df890923f
feat: don't show collection date of response rate if there is no survey data
2 years ago
Nelson Jovel
ea079e927b
chore: rename counts_by_grade to enrollment_by_grade for clarity
2 years ago
Nelson Jovel
a75373f6f2
feat: don't double count early ed students who are taking survey in parts
2 years ago
Nelson Jovel
934f2d7f30
fix: Correctly navigate the user to the latest academic year when no data exists for the school
2 years ago
Nelson Jovel
41d942c214
chore: Make sure 'hispanic' column only gets applied when using SIS race information
2 years ago
Nelson Jovel
24dbf33bcd
chore: remove unneeded comment
2 years ago
Nelson Jovel
f028e6c884
feat: if the filename includes the words 'form' or 'part' add that to the resulting cleaned filename
2 years ago
Nelson Jovel
d90a83e510
fix: instead of looking for 'asian' at the start of a word, look for it
...
after a word boundary. This means it still doesn't get confused with
caucasian and it's more flexible whan asian appears inside other text
such as 'Caucasian and Asian and Black'
2 years ago
Nelson Jovel
3f44613085
chore: various fixes for race and gender categorization during cleaning.
...
Also add tests for race and gender categorization
2 years ago
Nelson Jovel
883731bce1
feat: Support SIS categories for race in the form of 'White and Asian'
...
or 'Black, Asian, and white'
2 years ago
Nelson Jovel
0931950eaf
chore: make sure to output race and gender columns during cleaning
2 years ago
Nelson Jovel
3db0f9f757
fix: Print out message to make clean when there are duplicate headers
...
present in the raw survey file
2 years ago
Nelson Jovel
6541b87e9c
feat: add 2023-24 academic year and make sure previous year enrollment
...
and staffing data get loaded when missing
2 years ago
Nelson Jovel
e203be056a
chore: refactor code so we use a hash instead of a switch statement for long-term performance
2 years ago
Nelson Jovel
b7e670bb60
Lower threshold for the number of valid student responses from 17 to 11
2 years ago
Nelson Jovel
7dc881f654
chore: refactor code to put logic into models
2 years ago
Nelson Jovel
6e05909423
chore: fix categorization of gender
2 years ago
Nelson Jovel
6776ec8e2c
chore: add prefer not to disclose to gender. Add code of 7 as an option for prefer to self describe
2 years ago
Nelson Jovel
e325f38c43
Convert gender and race text into qualtrics codes during cleaning. Abide by 'prefer not to disclose' for self reported race. Give priority to self reported data but use SIS information as backup
2 years ago
Nelson Jovel
9efc1f41c6
chore: Add comment about StaffingLoader also cloning enrollment data when it clones staffing data
2 years ago