Commit graph

126 commits

Author SHA1 Message Date
rebuilt
6edc0db868 feat: Round up response rate. Survey response rates above 24.5 will now meet sufficiency 2023-07-14 11:43:15 -07:00
rebuilt
bec80b405a fix: revert rounding up the response rate so we can make sure to patch a bug first. Only show gender/race/grade/income graphs if the the school meets the minimum response rate of 25% 2023-07-13 13:04:11 -07:00
rebuilt
234eae6d3d feat: Round up response rate. Survey response rates above 24.5 will now meet sufficiency 2023-07-13 11:42:15 -07:00
rebuilt
4f035f6a63 feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page 2023-07-07 09:14:36 -07:00
rebuilt
c0fdaeb26b update tests for subcategory report 2023-06-26 11:36:03 -07:00
rebuilt
1c6a6a7a7a Add tests to codify behavior of weighted average logic 2023-06-21 03:33:35 +00:00
rebuilt
eee0cb14a3 Fix: failing subcategory report specs 2023-06-09 21:26:10 -07:00
rebuilt
5e9cc02024 Revert "Add tests to codify behavior of weighted average logic"
This reverts commit 0ab8e88072.
2023-06-08 15:26:50 -07:00
rebuilt
0ab8e88072 Add tests to codify behavior of weighted average logic 2023-06-08 15:25:27 -07:00
rebuilt
87ca23df79 Add subcategory report 2023-05-23 18:55:05 -07:00
rebuilt
2e3461b685 Add subcategory report 2023-05-22 16:36:12 -07:00
rebuilt
4509c157fa Add automated data cleaning. Modify SurveyItemValues class to use regex
instead of hard coded values.  Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
2023-05-16 13:38:29 -07:00
rebuilt
3c30808a5e Fix response rates for small schools by accounting for expected minimum counts of responses less than 10 2023-05-12 12:27:00 -07:00
rebuilt
596ce25737 Remove surveys table from codebase since it's no longer needed after changing logic surrounding response rates and score calculations 2023-04-20 20:51:04 -07:00
rebuilt
28f7d5647e Set a minimum threshold of 10 survey item responses to calculate scores per survey item 2023-04-18 14:05:09 -07:00
rebuilt
128748addd Update logic for calculating student response rate. Remove references
to survey table.  We no longer check or keep track of the survey type.
Instead we look in the database to see if a survey item has at least 10
responses.  If it does, that survey item was presented to the respondent
and we count it, and all responses when calculating the response rate.

Remove response rate timestamp from caching logic because we no longer
add the response rate to the database. All response rates are calculated
on the fly

Update three_b_two scraper to use teacher only numbers

swap over to using https://profiles.doe.mass.edu/statereport/gradesubjectstaffing.aspx as the source of staffing information
2023-04-18 13:59:29 -07:00
rebuilt
aaf1c8906e Add tests to make sure teacher survey items don't pollute the graphs for
students of unknown genders
2023-04-05 16:14:59 -07:00
rebuilt
c15cb7b483 Change survey data loader spec to use factorybot objects instead of loading seeds. Change databasecleaner to use transaction. Add back babel-preset dependency to fix failing javascript test in production. 2023-03-28 03:06:17 -07:00
rebuilt
da103ea95b Remove file that should not have been committed 2023-03-21 16:16:18 -07:00
rebuilt
dcade06ce2 Fix failing tests 2023-03-21 16:16:07 -07:00
rebuilt
4c4ccc01cc Merge branch 'rpp-response-rate' to bring in changes to test files 2023-03-15 15:00:25 -07:00
rebuilt
eb043f2b2d Add placeholder for testing response rate calculation 2023-03-10 14:50:09 -08:00
rebuilt
b6b88da328 Add all pillars 2023-02-28 19:08:11 -08:00
rebuilt
8128af200b add first pillar 2023-02-28 17:50:21 -08:00
rebuilt
5e0ba556bf Automatically detect the survey type by grade 2023-02-23 14:20:21 -08:00
rebuilt
a2caf42fee merge disagreggation features 2023-01-12 17:02:34 -08:00
rebuilt
8cdd1b6285 Create gender class. Load genders to database from demographics file 2022-10-21 17:47:52 -07:00
rebuilt
89a7f27b88 Finishes #183092367. Adds ui and graphs to show grade level disaggregations 2022-10-16 22:03:25 -07:00
rebuilt
d89a207c31 Load student data for all years and calculate race scores for all 2022-08-20 15:07:15 -07:00
rebuilt
aa159e953f Disable test so it passes github ci 2022-08-12 16:33:19 -07:00
rebuilt
58f5b01471 Use less memory when loading race scores 2022-08-12 02:56:25 -07:00
rebuilt
2be86a2b13 Disable race score loader tests so it passes github ci 2022-08-10 12:08:11 -07:00
rebuilt
105f30f220 Change race score calculations so the average bubbles up through survey_items
-> scales -> measure.
Precalculate averages for performance.
2022-08-10 09:58:11 -07:00
rebuilt
12e4e3f177 import students 2022-07-29 15:34:56 -07:00
rebuilt
765ad6a624 Create ui for data filters. Add listeners to direct to the correct url. Update ui based on the list of selected params 2022-07-26 06:52:50 -07:00
rebuilt
e89358dacc implement suggestions from static code analysis tools 2022-07-12 19:15:54 -07:00
rebuilt
da2e27e863 Add test for case where student response rate does not meet threshold 2022-07-05 13:16:07 -07:00
rebuilt
be715e117e Fix failing tests 2022-07-05 11:32:50 -07:00
rebuilt
c03615cb43 Rename ResponseRate to ResponseRateCalculator. Create a new response
rate model.  Create a loader to refresh response rates for all
subcategories.

Use precalculated response rates in views

Wrap more elements in page caching

Calculate a response rate for a subcategory if one does not already
exist
2022-06-16 08:19:26 -07:00
rebuilt
61aad20cb2 Create response rate model 2022-06-14 15:28:20 -07:00
rebuilt
a769996054 Refactor response rate into response rate calculator 2022-06-14 14:06:18 -07:00
rebuilt
3778aeb1d6 alter logic for insufficiency so that a count of 0 survey item responses is enough to trigger insufficiency
Implement large speed improvements to score calculations.  Add page caching to all pages.  Small speed improvements to response rate by filtering out
survey items without responses with `none?` `method vs count == 0`.
2022-06-14 11:17:59 -07:00
Nelson Jovel
57bfaa51c6 Exclude boston results. Completes #182117456 2022-05-11 11:22:05 -07:00
Nelson Jovel
0b502ce826 When calculating response rate, only take into account survey items with associated responses. Ignore any survey items with no responses. Finishes #181922483 2022-04-20 13:53:45 -07:00
Nelson Jovel
c475744939 Modify score calculations. Ignore any survey item scores of 0.
Never include zero when performing calculations for scores.
2022-04-20 13:49:27 -07:00
Nelson Jovel
9c954f97ec Update admin data collection rate numbers on browse page. Also, if all admin data has been collected, do not show 'insufficient data' indicator. Finishes #181754853 2022-04-13 20:14:25 -07:00
Nelson Jovel
9ecc501e24 Display measure scores. Finishes #181754978 2022-04-06 13:09:33 -07:00
Nelson Jovel
ed7a3b8a3d Autoformat code with rubocop 2022-03-04 15:29:54 +01:00
Nelson Jovel
91308b93e5 Visualize survey responses even when a response rate cannot be
calculated.  Set the response rate to N / A for data that has no total
student and teacher data for a certain year and school
2022-03-04 15:17:43 +01:00
rebuilt
286e74b651 Seed db with surveys to keep track of school, year, and survey type
Seed db with survey_item information to keep track of which survey_item is on the short form survey.  REcalculate response rate depending on whether school to regular survey or short form survey.

Correct score for short form schools.  Finishes #181284202
2022-03-03 10:44:41 +01:00