bb472ce6c3
Reduce number of rows to process to avoid exceeding memory limit on heroku
3 years ago
4626d43e3e
Add changes to demographic loader so it the tests don't fail when run in parallel
3 years ago
7d7bee6498
Add gender disagreggation
3 years ago
a1f3dfaa33
Load gender information to survey item responses
3 years ago
8cdd1b6285
Create gender class. Load genders to database from demographics file
3 years ago
f4e2e6ca83
Correct headers for 4D so the data can be correctly imported
3 years ago
f9c4ed8880
make sure grade gets updated when loading survey responses
3 years ago
89a7f27b88
Finishes #183092367 . Adds ui and graphs to show grade level disaggregations
3 years ago
6ed405d16d
Update student csvs
3 years ago
dd9ed86dcd
Merge branch 'scrapers'
3 years ago
f556844b73
Update a-sust-i1 so it's only applicable to high schools and lower
...
benchmark for a-cure-i1 from 6.7 to 5 percent.
3 years ago
9e82023e48
Make sure we don't divide by 0
3 years ago
1a984d2cf0
Make sure we don't divide by 0
3 years ago
3ee909bbea
Update 3B-2 with an absolute floor
3 years ago
1be6e79fd8
Add scrapers for admin data and their corresponding csv files of data.
...
Make sure specs are off so they don't run in github CI
3 years ago
9e18bf2151
Turn off specs for scrapers. Generate csvs for scraped data
3 years ago
75cea539c5
Change scraped csv file names from word to number format 'one_a_one.csv'
...
-> '1A_1.csv''
3 years ago
3e28be2d0d
Remove 'scraper' from file/class names add 3B-1
3 years ago
83ef9310a4
Add scraper for 3A-1 and 2C-1. Finishes #183105787 and #183105716
3 years ago
b5bc9c9de4
Add 2A-i admin data. Finishes #183105627
3 years ago
459393381b
Load admin data for 1A-iii. Finishes #183105516
3 years ago
f783ce9724
add one-a
3 years ago
048aacd641
Add admin data for 4D. Finishes #182818489 and #182793402
3 years ago
043f6de8e7
Prefer using over uniq so the filtering happens in sql
3 years ago
30eae881f3
Load correct column for 2021-22 year
3 years ago
bc63dfab7e
add one_off scripts for each academic year
3 years ago
3fcab58557
Do not erase all students when loading each file
3 years ago
3f493727b3
Load a single year of student demographic data and race scores at a time
3 years ago
4a32ea3332
Reduce memory use in race score loader
3 years ago
d89a207c31
Load student data for all years and calculate race scores for all
3 years ago
58f5b01471
Use less memory when loading race scores
3 years ago
2be86a2b13
Disable race score loader tests so it passes github ci
3 years ago
105f30f220
Change race score calculations so the average bubbles up through survey_items
...
-> scales -> measure.
Precalculate averages for performance.
3 years ago
50b3bc678c
Columns for students by group graph change when corresponding race checkboxes are clicked
3 years ago
93486eb132
Fix failing tests
3 years ago
26f739090b
add race columns to graph
3 years ago
12e4e3f177
import students
3 years ago
765ad6a624
Create ui for data filters. Add listeners to direct to the correct url. Update ui based on the list of selected params
3 years ago
757638f6ca
continue refactoring
3 years ago
e89358dacc
implement suggestions from static code analysis tools
3 years ago
bb5f668497
Refactor code based on rubocop and reek suggestions
3 years ago
18b479b8b2
Refactor based on rubocop and reek suggestions
3 years ago
7e5b235668
Print out invalid values when loading admin data
3 years ago
7fcf580591
Load survey responses for revere somerville and wareham for the 2021-22 academic year
4 years ago
a6ad132c81
Add counter caches
4 years ago
c03615cb43
Rename ResponseRate to ResponseRateCalculator. Create a new response
...
rate model. Create a loader to refresh response rates for all
subcategories.
Use precalculated response rates in views
Wrap more elements in page caching
Calculate a response rate for a subcategory if one does not already
exist
4 years ago
4952849d96
Prevent negative admin data values from being imported
4 years ago
2d945fb696
Print a message when a survey item response is rejected from database import due to an invalid likert score
4 years ago
9ecc501e24
Display measure scores. Finishes #181754978
4 years ago
6f629e2feb
Add survey responses from 2016 through 2018. Finishes #181255948
4 years ago
101c252896
Import survey item responses based on DESE ID instead of qualtrics school code. Finishes #181704978
4 years ago
36da912253
Modify survey item response csv files for 2019-20 to correct incorrect likert scores
4 years ago
ed7a3b8a3d
Autoformat code with rubocop
4 years ago
ad03606d66
Add benchmarks to survey and admin data items. Remove them from measures. Modify seeder
...
Calculate benchmarks for measures based on a weighted average of survey
and admin data items
Added architectural records
4 years ago
65ee27742a
Perform single lookup for survey items rather than n lookups
4 years ago
6477792f1d
Improve efficiency when checking whether survey item responses already exist
...
- see https://semaphoreci.com/blog/2017/03/14/faster-rails-how-to-check-if-a-record-exists.html for more info if curious
4 years ago
4d5335491b
Inline the SurveyResponseAggregator
4 years ago
25578a896f
we have a gauge! next up, let's style the page
4 years ago
cc2f3f9352
Expand the Measured Dashboard to All Schools and Districts. [Finishes #179727798 ]
4 years ago
666eec9a20
Removed print statements from data loader output
4 years ago
b4f6daa406
Process CSV file rows in batches
4 years ago
a269bb0ec1
Try reporting on batch inserts
4 years ago
a41d5bb4c9
Update survey data loader for new student survey responses csv
4 years ago
acfc2fde63
Make SurveyResponseDataLoader.process_row a private class method
4 years ago
98e7f3ce57
Update survey response data load to conform to survey response CSV standard
4 years ago
16734f9ce7
Refactor survey response loader to use functional style
4 years ago
fd55c7c82a
Optimize School lookup by qualtrics code query
4 years ago
c66134e25e
Move School and AcademicYear lookup methods into models
4 years ago
d6fddb9f7b
use activerecord-import gem to speed up csv uploads
4 years ago
fd091cfa4f
Load 2020-21 student survey responses
4 years ago
457615505f
Move array monkey patch into its own file
4 years ago
18ddfaaaf8
Optimize SurveyResponseAggregator via a join
...
[Finishes #179425717 ]
4 years ago
f5724407f2
Load teacher survey responses
4 years ago
rebuilt
Liam Morley
Alex Basson