46b5cbef2d
perf: Reduce number of queries. Remove unneeded methods. Combine
...
subcategory and measure queries in controller
3 years ago
05f535ed5c
perf: include survey items with measures to avoid n+1 queries when scoring by student/teacher survey items
3 years ago
3dd8631083
perf: memoize function when calculating response rates
3 years ago
8a23296ca5
perf: Add another index to surveyitemresponses. Implement bullet suggestions. Memoize a function in measure.rb
3 years ago
7cf6c6cc24
Modify subcategory report to be threaded
3 years ago
f29d72abff
Add District, School Code, and Grade columns to subcategory report
3 years ago
c4b90a711c
Fix: make sure values don't get reordered after copying over row values from survey item variants. This fixes a problem where cleaner would produce a row with likert scores that got shifted to align with the wrong column
3 years ago
ed421ceea8
Fix: Ensure proper detection of survey type. Make sure to remove any survey item ids that end with the survey variant style of '-1'
3 years ago
5f66d3d99a
Fix: enable correct detection of student surveys types by rejecting any
...
headers ending with '-1' (the variants of standard questions)
3 years ago
02a2c6cd97
Don't write a file if there's an empty dataset
3 years ago
Gabe Farrell
8f0deab53b
Use weighted average instead of simple average when calculating response rates
3 years ago
3f4aa8e7af
Fix: Parse headers when they are surrounded by quotes. This helps load recent csv files correctly
3 years ago
0f23053294
It's possible for admin data likert score values to be above 5. If that happens, we
...
cap the likert score at 5. This was happening already at the scraper
level but it's also now being done by the admin data loader for safety.
Also make sure to just update admin data instead of deleting and
reloading all values each load. Add tests to confirm this behavior
3 years ago
c789c46032
Don't check standard deviation for early education surveys
3 years ago
e058c523b6
Missing progress or duration information does not result in a row removed in the cleaning process
3 years ago
Gabe Farrell
960fcd570c
Add Overall Response Rate Popover
3 years ago
2a3f69b813
The overall response rate is artifically lower because we are including the number of all the students at the school, not just the number of students that took the survey. Updated the overall response rate presenter to return the count of only the grades that took the student survey.
3 years ago
391cfdc49a
specify that we are using the top level Subcategory class instead of the Report::Subcategory class
3 years ago
08c946a469
Add subcategory report
3 years ago
f590bc9dd5
Add subcategory report
3 years ago
e30a999aee
Move color definitions out of response rate presenter and into _colors.scss
3 years ago
a71ebbc4e4
Add Overall Response Rate
3 years ago
435bc4a5be
Fix regression in student loader
3 years ago
dbfc9d1d3a
Add automated data cleaning. Modify SurveyItemValues class to use regex
...
instead of hard coded values. Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
3 years ago
9f33a776b6
Add viewport and context meta tags
3 years ago
c94d025fc6
Add meta description to application template
3 years ago
787c26e465
Add meta tag
3 years ago
bff5509c25
Fix sizing of partial data indicators
3 years ago
a91898119e
Set doctype to html5
3 years ago
1a27b980d0
Round all averages to two decimal places
3 years ago
9f21a76ba4
Fix response rates for small schools by accounting for expected minimum counts of responses less than 10
3 years ago
c33c00b845
Rename DataAvailability to Summary
3 years ago
0bd70ca452
Remove surveys table from codebase since it's no longer needed after changing logic surrounding response rates and score calculations
3 years ago
2e0d266434
Calculate response rate on the fly instead of looking it up from the db
...
when calculating response rates.
3 years ago
654bb7df08
Remove unused filename
3 years ago
91bacfeb13
Fix ThreeATwo scraper
3 years ago
aa3a67406b
Set a minimum threshold of 10 survey item responses to calculate scores per survey item
3 years ago
c14960517b
rename counts_by_grade method to the more descriptive enrollment_by_grade
3 years ago
65b8599c6e
Update logic for calculating student response rate. Remove references
...
to survey table. We no longer check or keep track of the survey type.
Instead we look in the database to see if a survey item has at least 10
responses. If it does, that survey item was presented to the respondent
and we count it, and all responses when calculating the response rate.
Remove response rate timestamp from caching logic because we no longer
add the response rate to the database. All response rates are calculated
on the fly
Update three_b_two scraper to use teacher only numbers
swap over to using https://profiles.doe.mass.edu/statereport/gradesubjectstaffing.aspx as the source of staffing information
3 years ago
6764f31cbb
Make sure when checking for sufficient gender responses that we only check student survey items
3 years ago
05bff3ee89
Memoize schools in SurveyItemValues and academic_years in AcademicYear
...
for performace improvement
3 years ago
282a671531
Change survey data loader spec to use factorybot objects instead of loading seeds. Change databasecleaner to use transaction. Add back babel-preset dependency to fix failing javascript test in production.
3 years ago
36a6d93628
Capitalize 'data' in analyze graph. Remove the word 'admin' from data
...
sources count on browse page
3 years ago
319685c7d8
remove admin from text under the count of admin data sources
3 years ago
e37bec083f
Fix icon not showing up on category page
3 years ago
825259bdd8
Merge branch 'rpp-response-rate' into rpp-main to bring in improvements
...
to how we get enrollment and staffing information. Also speed up tests
3 years ago
1595c3a58c
rename admin data to school data
3 years ago
25f839e728
Add favicon
3 years ago
eb043f2b2d
Add placeholder for testing response rate calculation
3 years ago
99c6c5bd90
Update seeder to use ActiveRecord imports
3 years ago
rebuilt
Gabe Farrell