cf2b2433e9
Use an sftp uri unique to MCIEA
3 years ago
a5da0fb0c6
Fix bug with not all survey responses loading when using sftp loader
3 years ago
ef087a6cd0
update default folder for survey responses
3 years ago
47c1856281
Process 1000 rows at a time to limit memory usage in production
3 years ago
640de1c8df
Don't print sftptogo_url
3 years ago
380048f5cd
Load survey responses from sftp folder
3 years ago
6f986ff8a1
add proof of concept sftp downloader
3 years ago
d5533bb756
Support survey item variants. Survey item id's in the format s-sbel-q1-1 will load into s-sbel-q1
3 years ago
ed421296c7
Fix bug that caused an incorrect score of 1 to be assigned for admin
...
data item related to parity index of teachers of color to students of
color. Now if there's not enough data to calculate a score, it produces
'NA' instead of 1. Also added admin data for a-reso-i1 and a-curv-i1
3 years ago
06f49fc17f
add more colors
3 years ago
7b9abe3793
Scrape latest data from DESE
3 years ago
7ddada5050
Update empty dataset indicators
3 years ago
880da0d8ff
Only show district dropdown if there is more than one district in the database
3 years ago
4c2a299510
Fix hotwire test
3 years ago
b884021f66
Rename race column from 'Race/Ethnicity not listed' to 'Not Listed'
3 years ago
69179ce157
Replace javascript logic with hotwire. Also hide district dropdown on
...
home page if there is only one district.
3 years ago
c58686c032
rename race and gender modules to avoid naming collision with race and gender classes
3 years ago
850ef9d1cd
Make sure demographic loader doesn't break when changing the designation of a Race
3 years ago
bb9ea9b22d
Add admin data messages to analyze page for insufficient/irrelevant states
3 years ago
53a08d41bf
Change label for unknown race
3 years ago
a1b7db9b2e
Add ability to load student demographic information for only lowell
3 years ago
d49cf918ac
Add a way to seed only lowell schools
3 years ago
fc9e73f656
make sure survey responses for Butler get loaded correctly
3 years ago
9bbba64e9e
Add rules to the survey data loader to allow skipping non-lowell schools
3 years ago
1f7fa8146c
Fix bug that happens when you view gender scores for multiple years
3 years ago
43bc55ed32
Query for survey items once instead of on each row
3 years ago
83fa255e5d
Make utility method private
3 years ago
3ca270e3b1
Fix more malformed csv errors
3 years ago
360579852c
Send fewer sql queries when loading survey responses
3 years ago
9ae94a2dae
further reduce batch size to avoid exceeding memory quota
3 years ago
bb472ce6c3
Reduce number of rows to process to avoid exceeding memory limit on heroku
3 years ago
72c90b8f47
Add selector for all data
3 years ago
4626d43e3e
Add changes to demographic loader so it the tests don't fail when run in parallel
3 years ago
7d7bee6498
Add gender disagreggation
3 years ago
7f0faf8917
Add checkboxes to analyze page for genders
3 years ago
a1f3dfaa33
Load gender information to survey item responses
3 years ago
8cdd1b6285
Create gender class. Load genders to database from demographics file
3 years ago
f4e2e6ca83
Correct headers for 4D so the data can be correctly imported
3 years ago
9b28b0e629
Add grades to cache list
3 years ago
f9c4ed8880
make sure grade gets updated when loading survey responses
3 years ago
89a7f27b88
Finishes #183092367 . Adds ui and graphs to show grade level disaggregations
3 years ago
6ed405d16d
Update student csvs
3 years ago
dd9ed86dcd
Merge branch 'scrapers'
3 years ago
f556844b73
Update a-sust-i1 so it's only applicable to high schools and lower
...
benchmark for a-cure-i1 from 6.7 to 5 percent.
3 years ago
9e82023e48
Make sure we don't divide by 0
3 years ago
1a984d2cf0
Make sure we don't divide by 0
3 years ago
3ee909bbea
Update 3B-2 with an absolute floor
3 years ago
1be6e79fd8
Add scrapers for admin data and their corresponding csv files of data.
...
Make sure specs are off so they don't run in github CI
3 years ago
9e18bf2151
Turn off specs for scrapers. Generate csvs for scraped data
3 years ago
75cea539c5
Change scraped csv file names from word to number format 'one_a_one.csv'
...
-> '1A_1.csv''
3 years ago
rebuilt