Commit graph

948 commits

Author SHA1 Message Date
Nelson Jovel
e325f38c43 Convert gender and race text into qualtrics codes during cleaning. Abide by 'prefer not to disclose' for self reported race. Give priority to self reported data but use SIS information as backup 2023-12-06 14:10:16 -08:00
Nelson Jovel
9efc1f41c6 chore: Add comment about StaffingLoader also cloning enrollment data when it clones staffing data 2023-12-06 14:09:54 -08:00
Nelson Jovel
10c052771d Revert "chore: Add comment that notifies that cloning previous year staffing"
This reverts commit 95f8ada48d.
2023-12-06 14:09:44 -08:00
Nelson Jovel
f677af826b chore: Add comment that notifies that cloning previous year staffing
data will also copy over enrollment data
2023-12-06 14:09:33 -08:00
Nelson Jovel
f6f78bcd58 fix: make sure to grab the 'Gender- Qcode' column 2023-12-06 14:09:13 -08:00
Nelson Jovel
8bebe7db42 chore: since it's now possible for there to be multiple district and dese id columns separated by a dash and a number, be more explicit when we only want to filter out survey item ids that end in a -1 2023-11-06 14:52:21 -08:00
Nelson Jovel
b63c327d33 chore: when searching for dese id, split up pattern so that to be more explicit about the order in which to search out the columns that might have the dese ID we're looking for. 2023-11-06 13:15:50 -08:00
rebuilt
cddea60c8b feat: reduce number of rows to process at one time to reduce memory use 2023-11-02 12:21:32 -07:00
rebuilt
1a707eb6bc feat: load student responses in the same pass as loading the survey responses
chore: remove student loader since loading students is now done with the survey response loader
2023-11-02 09:52:39 -07:00
rebuilt
e3fbbabce5 feat: We no longer trust the progress number that gets exported from qualtrics. Instead during the cleaning progress, perform a manual count of the number of responses to filter out rows that don't meet the minimum threshold. 2023-10-27 15:12:24 -07:00
rebuilt
8baaa67730 fix: make sure sped is taken into account when caching analyze page 2023-10-11 11:15:13 -07:00
rebuilt
83661540b7 chore: upgrade to rails 7.1.
upgrade rspec

fix failing tests

upgrade devise
2023-10-11 10:58:52 -07:00
rebuilt
48e795fcfb feat: add special education disaggregation 2023-10-06 11:41:52 -07:00
rebuilt
060d7aa55a Add disaggregation by ELL 2023-09-29 19:29:23 -07:00
rebuilt
8d33095a48 fix: fix crash when viewing income graph on analyze page 2023-08-31 10:43:54 -07:00
rebuilt
aaa43cdd64 fix: I broke the feature where the site would automatically navigate the user to the latest year that had sufficient data when I made response rates calculate on each page load instead of being precalculated and stored in the database. Instead of a database lookup for response rates that meet the sufficiency threshold, I caculate the latest year when a user chooses a school from the welcome page. 2023-08-28 13:46:23 -07:00
rebuilt
abea2cb8fa feat: support multiple columns for race and gender information 2023-08-25 15:37:20 -07:00
rebuilt
463e4c9452 fix: hide scores on analyze page for scores that don't meet the student threshold of 25% 2023-08-23 15:56:46 -07:00
rebuilt
714b90b3eb fix: ensure cleaner outputs columns for all survey items. Before the fix, if a survey item varient (ending in -1, ie s-tint-q1-1) did not have a matching survey item s-tint-q1, the resulting csv would not include that column 2023-08-23 15:30:47 -07:00
rebuilt
2321897283 fix: start fixing problem with variants not getting added to the cleaned csv 2023-08-23 15:30:47 -07:00
rebuilt
315b398a5a fix: Overall response rate was incorrectly using the updated_at date instead of the recorded date. Also, it was just using the last date for all academic years instead of the last date the survey was taken per academic year. 2023-08-17 07:05:15 -07:00
a8db6c5ecf Add Overall Response Rate Popover 2023-08-09 15:35:40 -07:00
rebuilt
b3efbdeb33 The overall response rate is artifically lower because we are including the number of all the students at the school, not just the number of students that took the survey. Updated the overall response rate presenter to return the count of only the grades that took the student survey. 2023-08-09 15:22:05 -07:00
rebuilt
65ca0fd1ac Move color definitions out of response rate presenter and into _colors.scss 2023-08-09 15:16:06 -07:00
rebuilt
a785c69c44 Add Overall Response Rate 2023-08-09 15:13:58 -07:00
rebuilt
4afa030141 chore: remove precalculated race scores. Calculate race scores on every reload 2023-08-07 16:02:59 -07:00
rebuilt
f035c4d9ad fix: Filter out responses that don't correspond to the grades the school serves 2023-08-04 17:11:02 -07:00
Nelson Jovel
0bacac6962 fix: fix teacher n_size so instead of counting all the indivual teacher responses for a measure, it only counts the unique respondents 2023-08-03 12:40:42 -07:00
rebuilt
5f49746bf4 feat: Rename income labels to 'Economically Disadvantaged' and 'Not Economically Disadvantaged' 2023-07-31 16:47:34 -07:00
rebuilt
67e469a66c feat: add popover to analyze graphs that displays the n-size of the different columns. Make sure to only calculate a score for a race if there are more than 10 respondents to a question. 2023-07-27 16:17:46 -07:00
rebuilt
cec48e55d3 chore: remove outdated admin data loader file. We now use Dese::Loader to load school level data 2023-07-21 12:16:59 -07:00
rebuilt
5c7729beeb feat: if admin data value is above 5, round down to 5 2023-07-21 12:14:46 -07:00
rebuilt
fe8cad27cf Merge branch 'main-out-of-state-admin-data' 2023-07-20 17:06:36 -07:00
rebuilt
cbd5687ff0 feat: Add out of state admin data 2023-07-20 17:06:07 -07:00
rebuilt
1cb2bb9dc0 fix: zeitwork eager loads all require statements. I removed twilio from Gem dependencies so I had to remove it from code as well or it breaks deployments 2023-07-20 14:00:15 -07:00
rebuilt
a4c68a4055 chore: Add cypress to codebase 2023-07-19 09:02:19 -07:00
rebuilt
b4eaa9ea2c Add seeder for test data 2023-07-18 14:22:37 -07:00
rebuilt
6edc0db868 feat: Round up response rate. Survey response rates above 24.5 will now meet sufficiency 2023-07-14 11:43:15 -07:00
rebuilt
bec80b405a fix: revert rounding up the response rate so we can make sure to patch a bug first. Only show gender/race/grade/income graphs if the the school meets the minimum response rate of 25% 2023-07-13 13:04:11 -07:00
rebuilt
234eae6d3d feat: Round up response rate. Survey response rates above 24.5 will now meet sufficiency 2023-07-13 11:42:15 -07:00
rebuilt
35c8199887 Reorder gender columns 2023-07-07 15:44:09 -07:00
rebuilt
4f035f6a63 feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page 2023-07-07 09:14:36 -07:00
rebuilt
7e1be4860c fix: added missing bootstrap files 2023-06-30 15:19:42 -07:00
rebuilt
d72f8d31e0 fix: There was an n+1 problem where we looked up the list of schools for
every row. Now we query the list of schools just once per file
2023-06-26 11:36:03 -07:00
09aa6fdb58 Change subcategory hovers to say 67 instead of 66 questions 2023-06-23 21:55:28 +00:00
rebuilt
703928c234 Add date range to subcategory report export 2023-06-23 11:46:08 -07:00
rebuilt
e8aa75bf66 feat: update survey_item_response table to indlude recorded date and import recorded date when loading responses 2023-06-23 11:26:53 -07:00
8bc14a79f6 Add hovers to browse page response rates 2023-06-22 05:00:26 +00:00
37013c4b12 Use weighted average instead of simple average when calculating response rates 2023-06-21 03:31:52 +00:00
Nelson Jovel
0a2c5e02c5 feat: add ability to merge disaggregation data with raw survey data to
produce a cleaned csv with merged income disaggregation columns
2023-06-20 12:22:24 -07:00