Commit graph

653 commits

Author SHA1 Message Date
e6c8101d0b Add Overall Response Rate Popover 2023-08-08 10:09:39 -07:00
rebuilt
f6f56367fc The overall response rate is artifically lower because we are including the number of all the students at the school, not just the number of students that took the survey. Updated the overall response rate presenter to return the count of only the grades that took the student survey. 2023-08-08 10:06:39 -07:00
rebuilt
0a5500ecc9 feat: Add overall response rate 2023-08-08 10:01:48 -07:00
rebuilt
0ceaad3a2b chore: add viewport and context meta tags 2023-08-08 09:27:51 -07:00
rebuilt
39cdb57474 chore: add meta tag to application layout for better SEO 2023-08-08 09:25:48 -07:00
rebuilt
db5206b40a chore: add meta tag for better SEO 2023-08-08 09:23:56 -07:00
rebuilt
f6ede8a230 Fix sizing of partial data indicators 2023-08-08 09:21:15 -07:00
rebuilt
e5af5db755 chore: set doctype to html5 2023-08-08 09:12:19 -07:00
rebuilt
e42aa05324 chore: remove outdated admin data loader file. We now use Dese::Loader to load school level data 2023-07-21 12:58:01 -07:00
rebuilt
8f276a5f1a feat: if admin data value is above 5, round down to 5 2023-07-21 12:55:39 -07:00
rebuilt
0c18aa2083 chore: Add cypress to codebase 2023-07-19 12:43:56 -07:00
rebuilt
b684526bb4 fix: added missing bootstrap files 2023-06-30 15:20:15 -07:00
rebuilt
22cc303a95 fix: There was an n+1 problem where we looked up the list of schools for
every row. Now we query the list of schools just once per file
2023-06-26 11:25:32 -07:00
rebuilt
0ed3af8a1f Add date range to subcategory report export 2023-06-23 11:50:12 -07:00
rebuilt
784e23982e feat: update survey_item_response table to indlude recorded date and import recorded date when loading responses 2023-06-23 11:28:14 -07:00
459e4b8d21 Use weighted average instead of simple average when calculating response rates 2023-06-21 04:45:53 +00:00
rebuilt
cee1c5fbc9 perf: Reduce number of queries. Remove unneeded methods. Combine
subcategory and measure queries in controller
2023-06-19 20:49:57 -07:00
rebuilt
734b98edbb perf: include survey items with measures to avoid n+1 queries when scoring by student/teacher survey items 2023-06-11 14:43:35 -07:00
rebuilt
f9d4b28969 perf: memoize function when calculating response rates 2023-06-10 11:17:40 -07:00
rebuilt
77e8d12a3b perf: Add another index to surveyitemresponses. Implement bullet suggestions. Memoize a function in measure.rb 2023-06-10 10:19:05 -07:00
rebuilt
fb6f43e815 Modify subcategory report to be threaded 2023-06-09 21:12:04 -07:00
rebuilt
4dae0cb565 Add District, School Code, and Grade columns to subcategory report 2023-06-09 15:36:13 -07:00
rebuilt
25a2698ac9 Fix: make sure values don't get reordered after copying over row values from survey item variants. This fixes a problem where cleaner would produce a row with likert scores that got shifted to align with the wrong column 2023-06-08 09:27:44 -07:00
rebuilt
81f8738d59 Fix: Ensure proper detection of survey type. Make sure to remove any survey item ids that end with the survey variant style of '-1' 2023-06-07 12:40:23 -07:00
rebuilt
f7c40c2da2 Fix: enable correct detection of student surveys types by rejecting any
headers ending with '-1' (the variants of standard questions)
2023-06-07 12:40:14 -07:00
rebuilt
2445642586 Don't write a file if there's an empty dataset 2023-06-07 12:40:03 -07:00
rebuilt
6b2bceceb6 Fix: Parse headers when they are surrounded by quotes. This helps load recent csv files correctly 2023-06-06 18:29:47 -07:00
rebuilt
ce76c979a4 Add scraper for 3B-i student/#courses ratio 2023-06-05 11:39:08 -07:00
rebuilt
904d0d2f2c It's possible for admin data likert score values to be above 5. If that happens, we
cap the likert score at 5.   This was happening already at the scraper
level but it's also now being done by the admin data loader for safety.
Also make sure to just update admin data instead of deleting and
reloading all values each load. Add tests to confirm this behavior
2023-06-03 16:06:50 -07:00
rebuilt
3589878700 Don't check standard deviation for early education surveys 2023-06-02 16:10:35 -07:00
rebuilt
89295f8832 Missing progress or duration information does not result in a row removed in the cleaning process 2023-06-02 15:13:53 -07:00
rebuilt
6022739f07 use district short name when writing filename 2023-05-31 17:12:40 -07:00
rebuilt
f749b96006 update response_date to recorded_date 2023-05-31 17:07:31 -07:00
rebuilt
9d0f8659f1 Adjust valid duration threshold of short form items 2023-05-26 19:01:33 -07:00
rebuilt
37e932e078 Fix regression in student loader 2023-05-24 12:04:39 -07:00
rebuilt
0dfc9726d0 Add automated data cleaning. Modify SurveyItemValues class to use regex
instead of hard coded values.  Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
2023-05-24 11:59:53 -07:00
rebuilt
b5dc933187 Add subcategory report 2023-05-23 18:43:55 -07:00
rebuilt
c57ec6157c Round all averages to two decimal places 2023-05-12 13:12:42 -07:00
rebuilt
6b2555c1f0 Fix response rates for small schools by accounting for expected minimum counts of responses less than 10 2023-05-12 12:27:46 -07:00
rebuilt
a066f464c7 fix failing tests 2023-04-30 16:35:08 -07:00
rebuilt
f1022728fa Fix problem with dese scraper lumping in 2021-22 data as 2022-23 data.
Deleted unused csvs.  Turned off puts statements in admin loader.
Remove old, now unused admin data loader class.
2023-04-30 12:04:20 -07:00
rebuilt
c42b569e78 cap response rate per grade at 100 2023-04-30 11:59:22 -07:00
rebuilt
798ba1f340 Only return files in sftp directory, not other directories 2023-04-30 11:55:45 -07:00
rebuilt
0ed6cbe6b4 Rename DataAvailability to Summary 2023-04-22 14:24:39 -07:00
rebuilt
09963c3323 Remove surveys table from codebase since it's no longer needed after changing logic surrounding response rates and score calculations 2023-04-22 14:21:48 -07:00
rebuilt
001d3083c8 Calculate response rate on the fly instead of looking it up from the db
when calculating response rates.
2023-04-22 14:03:22 -07:00
rebuilt
cee7aa4c59 Remove unused filename 2023-04-22 14:01:21 -07:00
rebuilt
d3a28f7635 Fix ThreeATwo scraper 2023-04-22 14:01:01 -07:00
rebuilt
30e006ee0d Set a minimum threshold of 10 survey item responses to calculate scores per survey item 2023-04-22 14:00:51 -07:00
rebuilt
982f216c6c rename counts_by_grade method to the more descriptive enrollment_by_grade 2023-04-22 14:00:40 -07:00