Nelson Jovel
5df890923f
feat: don't show collection date of response rate if there is no survey data
2 years ago
Nelson Jovel
ea079e927b
chore: rename counts_by_grade to enrollment_by_grade for clarity
2 years ago
Nelson Jovel
a75373f6f2
feat: don't double count early ed students who are taking survey in parts
2 years ago
Nelson Jovel
934f2d7f30
fix: Correctly navigate the user to the latest academic year when no data exists for the school
2 years ago
Nelson Jovel
41d942c214
chore: Make sure 'hispanic' column only gets applied when using SIS race information
2 years ago
Nelson Jovel
24dbf33bcd
chore: remove unneeded comment
2 years ago
Nelson Jovel
f028e6c884
feat: if the filename includes the words 'form' or 'part' add that to the resulting cleaned filename
2 years ago
Nelson Jovel
d90a83e510
fix: instead of looking for 'asian' at the start of a word, look for it
...
after a word boundary. This means it still doesn't get confused with
caucasian and it's more flexible whan asian appears inside other text
such as 'Caucasian and Asian and Black'
2 years ago
Nelson Jovel
3f44613085
chore: various fixes for race and gender categorization during cleaning.
...
Also add tests for race and gender categorization
2 years ago
Nelson Jovel
883731bce1
feat: Support SIS categories for race in the form of 'White and Asian'
...
or 'Black, Asian, and white'
2 years ago
Nelson Jovel
0931950eaf
chore: make sure to output race and gender columns during cleaning
2 years ago
Nelson Jovel
3db0f9f757
fix: Print out message to make clean when there are duplicate headers
...
present in the raw survey file
2 years ago
Nelson Jovel
6541b87e9c
feat: add 2023-24 academic year and make sure previous year enrollment
...
and staffing data get loaded when missing
2 years ago
Nelson Jovel
e203be056a
chore: refactor code so we use a hash instead of a switch statement for long-term performance
2 years ago
Nelson Jovel
b7e670bb60
Lower threshold for the number of valid student responses from 17 to 11
2 years ago
Nelson Jovel
7dc881f654
chore: refactor code to put logic into models
2 years ago
Nelson Jovel
6e05909423
chore: fix categorization of gender
2 years ago
Nelson Jovel
6776ec8e2c
chore: add prefer not to disclose to gender. Add code of 7 as an option for prefer to self describe
2 years ago
Nelson Jovel
e325f38c43
Convert gender and race text into qualtrics codes during cleaning. Abide by 'prefer not to disclose' for self reported race. Give priority to self reported data but use SIS information as backup
2 years ago
Nelson Jovel
9efc1f41c6
chore: Add comment about StaffingLoader also cloning enrollment data when it clones staffing data
2 years ago
Nelson Jovel
10c052771d
Revert "chore: Add comment that notifies that cloning previous year staffing"
...
This reverts commit 95f8ada48d .
2 years ago
Nelson Jovel
f677af826b
chore: Add comment that notifies that cloning previous year staffing
...
data will also copy over enrollment data
2 years ago
Nelson Jovel
f6f78bcd58
fix: make sure to grab the 'Gender- Qcode' column
2 years ago
Nelson Jovel
8bebe7db42
chore: since it's now possible for there to be multiple district and dese id columns separated by a dash and a number, be more explicit when we only want to filter out survey item ids that end in a -1
2 years ago
Nelson Jovel
b63c327d33
chore: when searching for dese id, split up pattern so that to be more explicit about the order in which to search out the columns that might have the dese ID we're looking for.
2 years ago
rebuilt
cddea60c8b
feat: reduce number of rows to process at one time to reduce memory use
2 years ago
rebuilt
1a707eb6bc
feat: load student responses in the same pass as loading the survey responses
...
chore: remove student loader since loading students is now done with the survey response loader
2 years ago
rebuilt
e3fbbabce5
feat: We no longer trust the progress number that gets exported from qualtrics. Instead during the cleaning progress, perform a manual count of the number of responses to filter out rows that don't meet the minimum threshold.
2 years ago
rebuilt
8baaa67730
fix: make sure sped is taken into account when caching analyze page
2 years ago
rebuilt
83661540b7
chore: upgrade to rails 7.1.
...
upgrade rspec
fix failing tests
upgrade devise
2 years ago
rebuilt
48e795fcfb
feat: add special education disaggregation
2 years ago
rebuilt
060d7aa55a
Add disaggregation by ELL
2 years ago
rebuilt
8d33095a48
fix: fix crash when viewing income graph on analyze page
2 years ago
rebuilt
aaa43cdd64
fix: I broke the feature where the site would automatically navigate the user to the latest year that had sufficient data when I made response rates calculate on each page load instead of being precalculated and stored in the database. Instead of a database lookup for response rates that meet the sufficiency threshold, I caculate the latest year when a user chooses a school from the welcome page.
2 years ago
rebuilt
abea2cb8fa
feat: support multiple columns for race and gender information
2 years ago
rebuilt
463e4c9452
fix: hide scores on analyze page for scores that don't meet the student threshold of 25%
2 years ago
rebuilt
714b90b3eb
fix: ensure cleaner outputs columns for all survey items. Before the fix, if a survey item varient (ending in -1, ie s-tint-q1-1) did not have a matching survey item s-tint-q1, the resulting csv would not include that column
2 years ago
rebuilt
2321897283
fix: start fixing problem with variants not getting added to the cleaned csv
2 years ago
rebuilt
315b398a5a
fix: Overall response rate was incorrectly using the updated_at date instead of the recorded date. Also, it was just using the last date for all academic years instead of the last date the survey was taken per academic year.
2 years ago
Gabe Farrell
a8db6c5ecf
Add Overall Response Rate Popover
2 years ago
rebuilt
b3efbdeb33
The overall response rate is artifically lower because we are including the number of all the students at the school, not just the number of students that took the survey. Updated the overall response rate presenter to return the count of only the grades that took the student survey.
2 years ago
rebuilt
65ca0fd1ac
Move color definitions out of response rate presenter and into _colors.scss
2 years ago
rebuilt
a785c69c44
Add Overall Response Rate
2 years ago
rebuilt
4afa030141
chore: remove precalculated race scores. Calculate race scores on every reload
2 years ago
rebuilt
f035c4d9ad
fix: Filter out responses that don't correspond to the grades the school serves
2 years ago
Nelson Jovel
0bacac6962
fix: fix teacher n_size so instead of counting all the indivual teacher responses for a measure, it only counts the unique respondents
2 years ago
rebuilt
5f49746bf4
feat: Rename income labels to 'Economically Disadvantaged' and 'Not Economically Disadvantaged'
2 years ago
rebuilt
67e469a66c
feat: add popover to analyze graphs that displays the n-size of the different columns. Make sure to only calculate a score for a race if there are more than 10 respondents to a question.
2 years ago
rebuilt
cec48e55d3
chore: remove outdated admin data loader file. We now use Dese::Loader to load school level data
2 years ago
rebuilt
5c7729beeb
feat: if admin data value is above 5, round down to 5
2 years ago