d272e48adc
load total students and batch importing records
3 years ago
98ba54c305
Convert dese::loader from using seeder to factories
3 years ago
9228e3dbaf
convert student loader from seeding to factories
3 years ago
049ae4548f
Don't add another response rate record to the database. Just calculate on the fly. Otherwise we can run into a situation where we create two response rates for a given school/academic_year/subcategory
3 years ago
283845edd3
Add tests to make sure teacher survey items don't pollute the graphs for
...
students of unknown genders
3 years ago
7208cbb661
Add tests to make sure teacher survey items don't pollute the graphs for
...
students of unknown genders
3 years ago
63b1615bef
Make sure when checking for sufficient gender responses that we only check student survey items
3 years ago
098110433a
Remove duplicate line
3 years ago
5f58a5516e
print the number of student and teacher respondents
3 years ago
f7818fc9f6
make sure test database is cleaned before and after every test
3 years ago
9749cd1abb
Remove standard from gemfile
3 years ago
de478b7761
update reline
3 years ago
1290e52626
Correct branch name for ci
3 years ago
1b987f245b
Run ci when mciea-main code is pushed to github
3 years ago
36ea63332b
Add 2022-23 survey results
3 years ago
ad6561444a
Update ruby version
3 years ago
95e105e20b
Merge branch 'mciea-sftp-and-memory-fix' into mciea-main
3 years ago
8fb3019050
Patch security vulnerabilities
3 years ago
549d0eaa22
Add script to load 2016-18 data
3 years ago
6d770938ef
Swap survey data loading from local files to SFTP
3 years ago
14570b3c33
update tasks so that data gets loaded from sftp. Add task to delete 2016-17, and 2017-18 data
3 years ago
cf2b2433e9
Use an sftp uri unique to MCIEA
3 years ago
a5da0fb0c6
Fix bug with not all survey responses loading when using sftp loader
3 years ago
ef087a6cd0
update default folder for survey responses
3 years ago
47c1856281
Process 1000 rows at a time to limit memory usage in production
3 years ago
640de1c8df
Don't print sftptogo_url
3 years ago
380048f5cd
Load survey responses from sftp folder
3 years ago
6f986ff8a1
add proof of concept sftp downloader
3 years ago
f423bc734c
Add script to load 2016-18 data
3 years ago
46e3d98172
update rails version
3 years ago
a2232f9c27
Merge pull request #9 from MCIEA/add-license-1
...
Create LICENSE
3 years ago
bd4938a7ec
Create LICENSE
3 years ago
f7902c40b5
Swap survey data loading from local files to SFTP
3 years ago
fa3759ecb7
update tasks so that data gets loaded from sftp. Add task to delete 2016-17, and 2017-18 data
3 years ago
ba132a5cb9
Use an sftp uri unique to MCIEA
3 years ago
7e7f41d276
Fix bug with not all survey responses loading when using sftp loader
3 years ago
af99138628
update default folder for survey responses
3 years ago
e008e62c2e
Process 1000 rows at a time to limit memory usage in production
3 years ago
8793506a03
Don't print sftptogo_url
3 years ago
185e7d46e4
Load survey responses from sftp folder
3 years ago
8fa079451c
add proof of concept sftp downloader
3 years ago
5118358b43
Also run student demographic loader when loading survey data
3 years ago
d5533bb756
Support survey item variants. Survey item id's in the format s-sbel-q1-1 will load into s-sbel-q1
3 years ago
ed421296c7
Fix bug that caused an incorrect score of 1 to be assigned for admin
...
data item related to parity index of teachers of color to students of
color. Now if there's not enough data to calculate a score, it produces
'NA' instead of 1. Also added admin data for a-reso-i1 and a-curv-i1
3 years ago
e8825c6796
fix rake task for uploading responses so that it also loads student racial information
3 years ago
b3ded7e7be
Fix security vulnerabilities
3 years ago
94dc17e351
bump ruby version to 3.2.0
3 years ago
06f49fc17f
add more colors
3 years ago
8c8dc39465
Also delete response rates for non lowell schools
3 years ago
7b9abe3793
Scrape latest data from DESE
3 years ago
rebuilt