Commit graph

723 commits

Author SHA1 Message Date
rebuilt
4afa030141 chore: remove precalculated race scores. Calculate race scores on every reload 2023-08-07 16:02:59 -07:00
rebuilt
f035c4d9ad fix: Filter out responses that don't correspond to the grades the school serves 2023-08-04 17:11:02 -07:00
Nelson Jovel
0bacac6962 fix: fix teacher n_size so instead of counting all the indivual teacher responses for a measure, it only counts the unique respondents 2023-08-03 12:40:42 -07:00
rebuilt
5f49746bf4 feat: Rename income labels to 'Economically Disadvantaged' and 'Not Economically Disadvantaged' 2023-07-31 16:47:34 -07:00
rebuilt
67e469a66c feat: add popover to analyze graphs that displays the n-size of the different columns. Make sure to only calculate a score for a race if there are more than 10 respondents to a question. 2023-07-27 16:17:46 -07:00
rebuilt
cec48e55d3 chore: remove outdated admin data loader file. We now use Dese::Loader to load school level data 2023-07-21 12:16:59 -07:00
rebuilt
5c7729beeb feat: if admin data value is above 5, round down to 5 2023-07-21 12:14:46 -07:00
rebuilt
fe8cad27cf Merge branch 'main-out-of-state-admin-data' 2023-07-20 17:06:36 -07:00
rebuilt
cbd5687ff0 feat: Add out of state admin data 2023-07-20 17:06:07 -07:00
rebuilt
1cb2bb9dc0 fix: zeitwork eager loads all require statements. I removed twilio from Gem dependencies so I had to remove it from code as well or it breaks deployments 2023-07-20 14:00:15 -07:00
rebuilt
a4c68a4055 chore: Add cypress to codebase 2023-07-19 09:02:19 -07:00
rebuilt
b4eaa9ea2c Add seeder for test data 2023-07-18 14:22:37 -07:00
rebuilt
6edc0db868 feat: Round up response rate. Survey response rates above 24.5 will now meet sufficiency 2023-07-14 11:43:15 -07:00
rebuilt
bec80b405a fix: revert rounding up the response rate so we can make sure to patch a bug first. Only show gender/race/grade/income graphs if the the school meets the minimum response rate of 25% 2023-07-13 13:04:11 -07:00
rebuilt
234eae6d3d feat: Round up response rate. Survey response rates above 24.5 will now meet sufficiency 2023-07-13 11:42:15 -07:00
rebuilt
35c8199887 Reorder gender columns 2023-07-07 15:44:09 -07:00
rebuilt
4f035f6a63 feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page 2023-07-07 09:14:36 -07:00
rebuilt
7e1be4860c fix: added missing bootstrap files 2023-06-30 15:19:42 -07:00
rebuilt
d72f8d31e0 fix: There was an n+1 problem where we looked up the list of schools for
every row. Now we query the list of schools just once per file
2023-06-26 11:36:03 -07:00
09aa6fdb58 Change subcategory hovers to say 67 instead of 66 questions 2023-06-23 21:55:28 +00:00
rebuilt
703928c234 Add date range to subcategory report export 2023-06-23 11:46:08 -07:00
rebuilt
e8aa75bf66 feat: update survey_item_response table to indlude recorded date and import recorded date when loading responses 2023-06-23 11:26:53 -07:00
8bc14a79f6 Add hovers to browse page response rates 2023-06-22 05:00:26 +00:00
37013c4b12 Use weighted average instead of simple average when calculating response rates 2023-06-21 03:31:52 +00:00
Nelson Jovel
0a2c5e02c5 feat: add ability to merge disaggregation data with raw survey data to
produce a cleaned csv with merged income disaggregation columns
2023-06-20 12:22:24 -07:00
rebuilt
fae530d21f perf: Reduce number of queries. Remove unneeded methods. Combine
subcategory and measure queries in controller
2023-06-19 20:51:24 -07:00
rebuilt
518bc29f0f perf: include survey items with measures to avoid n+1 queries when scoring by student/teacher survey items 2023-06-11 14:42:53 -07:00
rebuilt
d306319de1 perf: memoize function when calculating response rates 2023-06-10 11:39:46 -07:00
rebuilt
452876ef09 perf: Add another index to surveyitemresponses. Implement bullet suggestions. Memoize a function in measure.rb 2023-06-10 10:30:29 -07:00
rebuilt
1aaed0682e Modify subcategory report to be threaded 2023-06-09 21:26:00 -07:00
rebuilt
aab4e78a71 Add District, School Code, and Grade columns to subcategory report 2023-06-09 15:30:57 -07:00
rebuilt
e2d24a9bec Fix: make sure values don't get reordered after copying over row values from survey item variants. This fixes a problem where cleaner would produce a row with likert scores that got shifted to align with the wrong column 2023-06-08 09:26:56 -07:00
rebuilt
c2503541ff Fix: Ensure proper detection of survey type. Make sure to remove any survey item ids that end with the survey variant style of '-1' 2023-06-07 12:39:09 -07:00
rebuilt
ddf9a628d5 Fix: enable correct detection of student surveys types by rejecting any
headers ending with '-1' (the variants of standard questions)
2023-06-07 12:38:58 -07:00
rebuilt
896f0d9961 Don't write a file if there's an empty dataset 2023-06-07 12:38:44 -07:00
rebuilt
76b79b99c2 Fix: Parse headers when they are surrounded by quotes. This helps load recent csv files correctly 2023-06-06 18:18:52 -07:00
rebuilt
30285efd69 It's possible for admin data likert score values to be above 5. If that happens, we
cap the likert score at 5.   This was happening already at the scraper
level but it's also now being done by the admin data loader for safety.
Also make sure to just update admin data instead of deleting and
reloading all values each load. Add tests to confirm this behavior
2023-06-03 17:14:41 -07:00
rebuilt
abe7a8804c Don't check standard deviation for early education surveys 2023-06-02 16:05:45 -07:00
rebuilt
9aeb5f92af Missing progress or duration information does not result in a row removed in the cleaning process 2023-06-02 15:23:21 -07:00
rebuilt
e3ae12b425 update response_date to recorded_date 2023-05-31 16:57:47 -07:00
rebuilt
a30921ce06 Add New Jersey enrollment and staffing data 2023-05-28 17:11:52 -07:00
rebuilt
93d087a5de Use short district name for cleaned csv 2023-05-28 17:11:27 -07:00
rebuilt
8ef8cfce58 Adjust valid duration threshold of short form items 2023-05-26 18:30:44 -07:00
rebuilt
82659647bb add new hero. fix background placement 2023-05-26 11:29:53 -07:00
rebuilt
87ca23df79 Add subcategory report 2023-05-23 18:55:05 -07:00
rebuilt
2e3461b685 Add subcategory report 2023-05-22 16:36:12 -07:00
rebuilt
d6b2521883 Fix regression in student loader 2023-05-19 13:48:16 -07:00
rebuilt
4509c157fa Add automated data cleaning. Modify SurveyItemValues class to use regex
instead of hard coded values.  Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
2023-05-16 13:38:29 -07:00
rebuilt
72b35ff2e3 Add viewport and context meta tags 2023-05-15 15:09:09 -07:00
rebuilt
7855663b7e Add meta description to application template 2023-05-15 15:08:15 -07:00