Nelson Jovel
24dbf33bcd
chore: remove unneeded comment
2023-12-11 15:55:00 -08:00
Nelson Jovel
f028e6c884
feat: if the filename includes the words 'form' or 'part' add that to the resulting cleaned filename
2023-12-11 15:39:20 -08:00
Nelson Jovel
d90a83e510
fix: instead of looking for 'asian' at the start of a word, look for it
...
after a word boundary. This means it still doesn't get confused with
caucasian and it's more flexible whan asian appears inside other text
such as 'Caucasian and Asian and Black'
2023-12-08 14:16:50 -08:00
Nelson Jovel
3f44613085
chore: various fixes for race and gender categorization during cleaning.
...
Also add tests for race and gender categorization
2023-12-08 13:12:19 -08:00
Nelson Jovel
883731bce1
feat: Support SIS categories for race in the form of 'White and Asian'
...
or 'Black, Asian, and white'
2023-12-07 13:40:02 -08:00
Nelson Jovel
0931950eaf
chore: make sure to output race and gender columns during cleaning
2023-12-07 13:39:25 -08:00
Nelson Jovel
3db0f9f757
fix: Print out message to make clean when there are duplicate headers
...
present in the raw survey file
2023-12-07 12:28:24 -08:00
Nelson Jovel
6541b87e9c
feat: add 2023-24 academic year and make sure previous year enrollment
...
and staffing data get loaded when missing
2023-12-07 12:27:19 -08:00
Nelson Jovel
e203be056a
chore: refactor code so we use a hash instead of a switch statement for long-term performance
2023-12-06 15:00:33 -08:00
Nelson Jovel
b7e670bb60
Lower threshold for the number of valid student responses from 17 to 11
2023-12-06 14:15:19 -08:00
Nelson Jovel
7dc881f654
chore: refactor code to put logic into models
2023-12-06 14:14:56 -08:00
Nelson Jovel
6e05909423
chore: fix categorization of gender
2023-12-06 14:12:27 -08:00
Nelson Jovel
6776ec8e2c
chore: add prefer not to disclose to gender. Add code of 7 as an option for prefer to self describe
2023-12-06 14:10:29 -08:00
Nelson Jovel
e325f38c43
Convert gender and race text into qualtrics codes during cleaning. Abide by 'prefer not to disclose' for self reported race. Give priority to self reported data but use SIS information as backup
2023-12-06 14:10:16 -08:00
Nelson Jovel
9efc1f41c6
chore: Add comment about StaffingLoader also cloning enrollment data when it clones staffing data
2023-12-06 14:09:54 -08:00
Nelson Jovel
10c052771d
Revert "chore: Add comment that notifies that cloning previous year staffing"
...
This reverts commit 95f8ada48d
2023-12-06 14:09:44 -08:00
Nelson Jovel
f677af826b
chore: Add comment that notifies that cloning previous year staffing
...
data will also copy over enrollment data
2023-12-06 14:09:33 -08:00
Nelson Jovel
f6f78bcd58
fix: make sure to grab the 'Gender- Qcode' column
2023-12-06 14:09:13 -08:00
Nelson Jovel
8bebe7db42
chore: since it's now possible for there to be multiple district and dese id columns separated by a dash and a number, be more explicit when we only want to filter out survey item ids that end in a -1
2023-11-06 14:52:21 -08:00
Nelson Jovel
b63c327d33
chore: when searching for dese id, split up pattern so that to be more explicit about the order in which to search out the columns that might have the dese ID we're looking for.
2023-11-06 13:15:50 -08:00
rebuilt
cddea60c8b
feat: reduce number of rows to process at one time to reduce memory use
2023-11-02 12:21:32 -07:00
rebuilt
1a707eb6bc
feat: load student responses in the same pass as loading the survey responses
...
chore: remove student loader since loading students is now done with the survey response loader
2023-11-02 09:52:39 -07:00
rebuilt
e3fbbabce5
feat: We no longer trust the progress number that gets exported from qualtrics. Instead during the cleaning progress, perform a manual count of the number of responses to filter out rows that don't meet the minimum threshold.
2023-10-27 15:12:24 -07:00
rebuilt
8baaa67730
fix: make sure sped is taken into account when caching analyze page
2023-10-11 11:15:13 -07:00
rebuilt
83661540b7
chore: upgrade to rails 7.1.
...
upgrade rspec
fix failing tests
upgrade devise
2023-10-11 10:58:52 -07:00
rebuilt
48e795fcfb
feat: add special education disaggregation
2023-10-06 11:41:52 -07:00
rebuilt
060d7aa55a
Add disaggregation by ELL
2023-09-29 19:29:23 -07:00
rebuilt
8d33095a48
fix: fix crash when viewing income graph on analyze page
2023-08-31 10:43:54 -07:00
rebuilt
aaa43cdd64
fix: I broke the feature where the site would automatically navigate the user to the latest year that had sufficient data when I made response rates calculate on each page load instead of being precalculated and stored in the database. Instead of a database lookup for response rates that meet the sufficiency threshold, I caculate the latest year when a user chooses a school from the welcome page.
2023-08-28 13:46:23 -07:00
rebuilt
abea2cb8fa
feat: support multiple columns for race and gender information
2023-08-25 15:37:20 -07:00
rebuilt
463e4c9452
fix: hide scores on analyze page for scores that don't meet the student threshold of 25%
2023-08-23 15:56:46 -07:00
rebuilt
714b90b3eb
fix: ensure cleaner outputs columns for all survey items. Before the fix, if a survey item varient (ending in -1, ie s-tint-q1-1) did not have a matching survey item s-tint-q1, the resulting csv would not include that column
2023-08-23 15:30:47 -07:00
rebuilt
2321897283
fix: start fixing problem with variants not getting added to the cleaned csv
2023-08-23 15:30:47 -07:00
rebuilt
315b398a5a
fix: Overall response rate was incorrectly using the updated_at date instead of the recorded date. Also, it was just using the last date for all academic years instead of the last date the survey was taken per academic year.
2023-08-17 07:05:15 -07:00
a8db6c5ecf
Add Overall Response Rate Popover
2023-08-09 15:35:40 -07:00
rebuilt
b3efbdeb33
The overall response rate is artifically lower because we are including the number of all the students at the school, not just the number of students that took the survey. Updated the overall response rate presenter to return the count of only the grades that took the student survey.
2023-08-09 15:22:05 -07:00
rebuilt
65ca0fd1ac
Move color definitions out of response rate presenter and into _colors.scss
2023-08-09 15:16:06 -07:00
rebuilt
a785c69c44
Add Overall Response Rate
2023-08-09 15:13:58 -07:00
rebuilt
4afa030141
chore: remove precalculated race scores. Calculate race scores on every reload
2023-08-07 16:02:59 -07:00
rebuilt
f035c4d9ad
fix: Filter out responses that don't correspond to the grades the school serves
2023-08-04 17:11:02 -07:00
Nelson Jovel
0bacac6962
fix: fix teacher n_size so instead of counting all the indivual teacher responses for a measure, it only counts the unique respondents
2023-08-03 12:40:42 -07:00
rebuilt
5f49746bf4
feat: Rename income labels to 'Economically Disadvantaged' and 'Not Economically Disadvantaged'
2023-07-31 16:47:34 -07:00
rebuilt
67e469a66c
feat: add popover to analyze graphs that displays the n-size of the different columns. Make sure to only calculate a score for a race if there are more than 10 respondents to a question.
2023-07-27 16:17:46 -07:00
rebuilt
cec48e55d3
chore: remove outdated admin data loader file. We now use Dese::Loader to load school level data
2023-07-21 12:16:59 -07:00
rebuilt
5c7729beeb
feat: if admin data value is above 5, round down to 5
2023-07-21 12:14:46 -07:00
rebuilt
fe8cad27cf
Merge branch 'main-out-of-state-admin-data'
2023-07-20 17:06:36 -07:00
rebuilt
cbd5687ff0
feat: Add out of state admin data
2023-07-20 17:06:07 -07:00
rebuilt
1cb2bb9dc0
fix: zeitwork eager loads all require statements. I removed twilio from Gem dependencies so I had to remove it from code as well or it breaks deployments
2023-07-20 14:00:15 -07:00
rebuilt
a4c68a4055
chore: Add cypress to codebase
2023-07-19 09:02:19 -07:00
rebuilt
b4eaa9ea2c
Add seeder for test data
2023-07-18 14:22:37 -07:00
