rebuilt
46b5cbef2d
perf: Reduce number of queries. Remove unneeded methods. Combine
...
subcategory and measure queries in controller
2023-06-19 20:51:54 -07:00
rebuilt
05f535ed5c
perf: include survey items with measures to avoid n+1 queries when scoring by student/teacher survey items
2023-06-11 14:40:33 -07:00
rebuilt
3dd8631083
perf: memoize function when calculating response rates
2023-06-10 11:39:19 -07:00
rebuilt
8a23296ca5
perf: Add another index to surveyitemresponses. Implement bullet suggestions. Memoize a function in measure.rb
2023-06-10 10:29:28 -07:00
rebuilt
7cf6c6cc24
Modify subcategory report to be threaded
2023-06-09 21:12:55 -07:00
rebuilt
f29d72abff
Add District, School Code, and Grade columns to subcategory report
2023-06-09 15:29:12 -07:00
rebuilt
c4b90a711c
Fix: make sure values don't get reordered after copying over row values from survey item variants. This fixes a problem where cleaner would produce a row with likert scores that got shifted to align with the wrong column
2023-06-08 09:27:22 -07:00
rebuilt
ed421ceea8
Fix: Ensure proper detection of survey type. Make sure to remove any survey item ids that end with the survey variant style of '-1'
2023-06-07 12:36:56 -07:00
rebuilt
5f66d3d99a
Fix: enable correct detection of student surveys types by rejecting any
...
headers ending with '-1' (the variants of standard questions)
2023-06-07 12:25:04 -07:00
rebuilt
02a2c6cd97
Don't write a file if there's an empty dataset
2023-06-07 12:24:39 -07:00
8f0deab53b
Use weighted average instead of simple average when calculating response rates
2023-06-07 03:38:56 +00:00
rebuilt
3f4aa8e7af
Fix: Parse headers when they are surrounded by quotes. This helps load recent csv files correctly
2023-06-06 15:00:00 -07:00
rebuilt
0f23053294
It's possible for admin data likert score values to be above 5. If that happens, we
...
cap the likert score at 5. This was happening already at the scraper
level but it's also now being done by the admin data loader for safety.
Also make sure to just update admin data instead of deleting and
reloading all values each load. Add tests to confirm this behavior
2023-06-03 16:47:03 -07:00
rebuilt
c789c46032
Don't check standard deviation for early education surveys
2023-06-02 16:09:12 -07:00
rebuilt
e058c523b6
Missing progress or duration information does not result in a row removed in the cleaning process
2023-06-02 15:18:03 -07:00
960fcd570c
Add Overall Response Rate Popover
2023-05-31 18:27:15 +00:00
rebuilt
2a3f69b813
The overall response rate is artifically lower because we are including the number of all the students at the school, not just the number of students that took the survey. Updated the overall response rate presenter to return the count of only the grades that took the student survey.
2023-05-24 11:22:17 -07:00
rebuilt
391cfdc49a
specify that we are using the top level Subcategory class instead of the Report::Subcategory class
2023-05-23 20:19:53 -07:00
rebuilt
08c946a469
Add subcategory report
2023-05-23 18:59:05 -07:00
rebuilt
f590bc9dd5
Add subcategory report
2023-05-22 16:40:39 -07:00
rebuilt
e30a999aee
Move color definitions out of response rate presenter and into _colors.scss
2023-05-22 12:29:26 -07:00
rebuilt
a71ebbc4e4
Add Overall Response Rate
2023-05-22 16:03:34 +00:00
rebuilt
435bc4a5be
Fix regression in student loader
2023-05-19 13:49:00 -07:00
rebuilt
dbfc9d1d3a
Add automated data cleaning. Modify SurveyItemValues class to use regex
...
instead of hard coded values. Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
2023-05-16 13:39:12 -07:00
rebuilt
9f33a776b6
Add viewport and context meta tags
2023-05-16 13:33:55 -07:00
rebuilt
c94d025fc6
Add meta description to application template
2023-05-16 13:33:55 -07:00
rebuilt
787c26e465
Add meta tag
2023-05-16 13:33:55 -07:00
rebuilt
bff5509c25
Fix sizing of partial data indicators
2023-05-16 13:33:55 -07:00
rebuilt
a91898119e
Set doctype to html5
2023-05-16 13:33:55 -07:00
rebuilt
1a27b980d0
Round all averages to two decimal places
2023-05-12 13:13:20 -07:00
rebuilt
9f21a76ba4
Fix response rates for small schools by accounting for expected minimum counts of responses less than 10
2023-05-12 12:34:42 -07:00
rebuilt
c33c00b845
Rename DataAvailability to Summary
2023-04-22 10:44:06 -07:00
rebuilt
0bd70ca452
Remove surveys table from codebase since it's no longer needed after changing logic surrounding response rates and score calculations
2023-04-22 10:36:00 -07:00
rebuilt
2e0d266434
Calculate response rate on the fly instead of looking it up from the db
...
when calculating response rates.
2023-04-22 10:35:50 -07:00
rebuilt
654bb7df08
Remove unused filename
2023-04-22 10:35:19 -07:00
rebuilt
91bacfeb13
Fix ThreeATwo scraper
2023-04-19 19:19:47 -07:00
rebuilt
aa3a67406b
Set a minimum threshold of 10 survey item responses to calculate scores per survey item
2023-04-17 15:18:10 -07:00
rebuilt
c14960517b
rename counts_by_grade method to the more descriptive enrollment_by_grade
2023-04-14 13:37:23 -07:00
rebuilt
65b8599c6e
Update logic for calculating student response rate. Remove references
...
to survey table. We no longer check or keep track of the survey type.
Instead we look in the database to see if a survey item has at least 10
responses. If it does, that survey item was presented to the respondent
and we count it, and all responses when calculating the response rate.
Remove response rate timestamp from caching logic because we no longer
add the response rate to the database. All response rates are calculated
on the fly
Update three_b_two scraper to use teacher only numbers
swap over to using https://profiles.doe.mass.edu/statereport/gradesubjectstaffing.aspx as the source of staffing information
2023-04-08 10:59:48 -07:00
rebuilt
6764f31cbb
Make sure when checking for sufficient gender responses that we only check student survey items
2023-04-04 17:03:24 -07:00
rebuilt
05bff3ee89
Memoize schools in SurveyItemValues and academic_years in AcademicYear
...
for performace improvement
2023-03-29 15:47:20 -07:00
rebuilt
282a671531
Change survey data loader spec to use factorybot objects instead of loading seeds. Change databasecleaner to use transaction. Add back babel-preset dependency to fix failing javascript test in production.
2023-03-29 15:45:48 -07:00
rebuilt
36a6d93628
Capitalize 'data' in analyze graph. Remove the word 'admin' from data
...
sources count on browse page
2023-03-23 13:15:46 -07:00
rebuilt
319685c7d8
remove admin from text under the count of admin data sources
2023-03-23 13:09:25 -07:00
rebuilt
e37bec083f
Fix icon not showing up on category page
2023-03-22 16:54:53 -07:00
rebuilt
825259bdd8
Merge branch 'rpp-response-rate' into rpp-main to bring in improvements
...
to how we get enrollment and staffing information. Also speed up tests
2023-03-22 16:52:55 -07:00
rebuilt
1595c3a58c
rename admin data to school data
2023-03-22 16:48:38 -07:00
rebuilt
25f839e728
Add favicon
2023-03-21 15:13:01 -07:00
rebuilt
eb043f2b2d
Add placeholder for testing response rate calculation
2023-03-10 14:50:09 -08:00
rebuilt
99c6c5bd90
Update seeder to use ActiveRecord imports
2023-03-08 11:42:22 -08:00
