Commit graph

710 commits

Author SHA1 Message Date
rebuilt
bec80b405a fix: revert rounding up the response rate so we can make sure to patch a bug first. Only show gender/race/grade/income graphs if the the school meets the minimum response rate of 25% 2023-07-13 13:04:11 -07:00
rebuilt
234eae6d3d feat: Round up response rate. Survey response rates above 24.5 will now meet sufficiency 2023-07-13 11:42:15 -07:00
rebuilt
35c8199887 Reorder gender columns 2023-07-07 15:44:09 -07:00
rebuilt
4f035f6a63 feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page 2023-07-07 09:14:36 -07:00
rebuilt
7e1be4860c fix: added missing bootstrap files 2023-06-30 15:19:42 -07:00
rebuilt
d72f8d31e0 fix: There was an n+1 problem where we looked up the list of schools for
every row. Now we query the list of schools just once per file
2023-06-26 11:36:03 -07:00
09aa6fdb58 Change subcategory hovers to say 67 instead of 66 questions 2023-06-23 21:55:28 +00:00
rebuilt
703928c234 Add date range to subcategory report export 2023-06-23 11:46:08 -07:00
rebuilt
e8aa75bf66 feat: update survey_item_response table to indlude recorded date and import recorded date when loading responses 2023-06-23 11:26:53 -07:00
8bc14a79f6 Add hovers to browse page response rates 2023-06-22 05:00:26 +00:00
37013c4b12 Use weighted average instead of simple average when calculating response rates 2023-06-21 03:31:52 +00:00
Nelson Jovel
0a2c5e02c5 feat: add ability to merge disaggregation data with raw survey data to
produce a cleaned csv with merged income disaggregation columns
2023-06-20 12:22:24 -07:00
rebuilt
fae530d21f perf: Reduce number of queries. Remove unneeded methods. Combine
subcategory and measure queries in controller
2023-06-19 20:51:24 -07:00
rebuilt
518bc29f0f perf: include survey items with measures to avoid n+1 queries when scoring by student/teacher survey items 2023-06-11 14:42:53 -07:00
rebuilt
d306319de1 perf: memoize function when calculating response rates 2023-06-10 11:39:46 -07:00
rebuilt
452876ef09 perf: Add another index to surveyitemresponses. Implement bullet suggestions. Memoize a function in measure.rb 2023-06-10 10:30:29 -07:00
rebuilt
1aaed0682e Modify subcategory report to be threaded 2023-06-09 21:26:00 -07:00
rebuilt
aab4e78a71 Add District, School Code, and Grade columns to subcategory report 2023-06-09 15:30:57 -07:00
rebuilt
e2d24a9bec Fix: make sure values don't get reordered after copying over row values from survey item variants. This fixes a problem where cleaner would produce a row with likert scores that got shifted to align with the wrong column 2023-06-08 09:26:56 -07:00
rebuilt
c2503541ff Fix: Ensure proper detection of survey type. Make sure to remove any survey item ids that end with the survey variant style of '-1' 2023-06-07 12:39:09 -07:00
rebuilt
ddf9a628d5 Fix: enable correct detection of student surveys types by rejecting any
headers ending with '-1' (the variants of standard questions)
2023-06-07 12:38:58 -07:00
rebuilt
896f0d9961 Don't write a file if there's an empty dataset 2023-06-07 12:38:44 -07:00
rebuilt
76b79b99c2 Fix: Parse headers when they are surrounded by quotes. This helps load recent csv files correctly 2023-06-06 18:18:52 -07:00
rebuilt
30285efd69 It's possible for admin data likert score values to be above 5. If that happens, we
cap the likert score at 5.   This was happening already at the scraper
level but it's also now being done by the admin data loader for safety.
Also make sure to just update admin data instead of deleting and
reloading all values each load. Add tests to confirm this behavior
2023-06-03 17:14:41 -07:00
rebuilt
abe7a8804c Don't check standard deviation for early education surveys 2023-06-02 16:05:45 -07:00
rebuilt
9aeb5f92af Missing progress or duration information does not result in a row removed in the cleaning process 2023-06-02 15:23:21 -07:00
rebuilt
e3ae12b425 update response_date to recorded_date 2023-05-31 16:57:47 -07:00
rebuilt
a30921ce06 Add New Jersey enrollment and staffing data 2023-05-28 17:11:52 -07:00
rebuilt
93d087a5de Use short district name for cleaned csv 2023-05-28 17:11:27 -07:00
rebuilt
8ef8cfce58 Adjust valid duration threshold of short form items 2023-05-26 18:30:44 -07:00
rebuilt
82659647bb add new hero. fix background placement 2023-05-26 11:29:53 -07:00
rebuilt
87ca23df79 Add subcategory report 2023-05-23 18:55:05 -07:00
rebuilt
2e3461b685 Add subcategory report 2023-05-22 16:36:12 -07:00
rebuilt
d6b2521883 Fix regression in student loader 2023-05-19 13:48:16 -07:00
rebuilt
4509c157fa Add automated data cleaning. Modify SurveyItemValues class to use regex
instead of hard coded values.  Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
2023-05-16 13:38:29 -07:00
rebuilt
72b35ff2e3 Add viewport and context meta tags 2023-05-15 15:09:09 -07:00
rebuilt
7855663b7e Add meta description to application template 2023-05-15 15:08:15 -07:00
rebuilt
24e7a9abca Add meta tag 2023-05-15 15:07:14 -07:00
rebuilt
a1743da910 Update about us section 2023-05-15 15:05:44 -07:00
rebuilt
dd94b283fa Remove hotjar 2023-05-15 14:55:12 -07:00
rebuilt
51d5d72730 Fix sizing of partial data indicators 2023-05-15 14:38:22 -07:00
rebuilt
1526bb2532 Set doctype to html5 2023-05-15 14:19:47 -07:00
rebuilt
d48a4efda2 Round all averages to two decimal places 2023-05-12 13:08:25 -07:00
rebuilt
3c30808a5e Fix response rates for small schools by accounting for expected minimum counts of responses less than 10 2023-05-12 12:27:00 -07:00
rebuilt
359e266a6c Remove unused TODOs 2023-04-27 15:47:45 -07:00
rebuilt
3f2a7dff50 Fix problem with dese scraper lumping in 2021-22 data as 2022-23 data.
Deleted unused csvs.  Turned off puts statements in admin loader.
Remove old, now unused admin data loader class.
2023-04-27 15:43:17 -07:00
rebuilt
ca31bd3217 cap response rate per grade at 100 2023-04-26 16:54:43 -07:00
rebuilt
4b7d2e6feb Only return files in sftp directory, not other directories 2023-04-26 15:55:10 -07:00
rebuilt
541f29108b Rename DataAvailability to Summary 2023-04-20 20:58:15 -07:00
rebuilt
596ce25737 Remove surveys table from codebase since it's no longer needed after changing logic surrounding response rates and score calculations 2023-04-20 20:51:04 -07:00