rebuilt
07ed8dd259
Update logic for calculating student response rate. Remove references
...
to survey table. We no longer check or keep track of the survey type.
Instead we look in the database to see if a survey item has at least 10
responses. If it does, that survey item was presented to the respondent
and we count it, and all responses when calculating the response rate.
Remove response rate timestamp from caching logic because we no longer
add the response rate to the database. All response rates are calculated
on the fly
Update three_b_two scraper to use teacher only numbers
swap over to using https://profiles.doe.mass.edu/statereport/gradesubjectstaffing.aspx as the source of staffing information
2023-04-22 14:00:20 -07:00
rebuilt
0bfde2805a
temporarily turn off caching based on the response rate timestamp
2023-04-22 13:28:09 -07:00
rebuilt
63f453d258
Update seeder to use ActiveRecord imports
2023-04-22 13:20:26 -07:00
rebuilt
357c7427d1
Batch imports for staffing data
2023-04-22 13:19:34 -07:00
rebuilt
d272e48adc
load total students and batch importing records
2023-04-22 13:18:50 -07:00
Nelson Jovel
98ba54c305
Convert dese::loader from using seeder to factories
2023-04-22 13:15:13 -07:00
Nelson Jovel
9228e3dbaf
convert student loader from seeding to factories
2023-04-22 13:15:01 -07:00
rebuilt
049ae4548f
Don't add another response rate record to the database. Just calculate on the fly. Otherwise we can run into a situation where we create two response rates for a given school/academic_year/subcategory
2023-04-08 14:49:21 -07:00
rebuilt
283845edd3
Add tests to make sure teacher survey items don't pollute the graphs for
...
students of unknown genders
2023-04-05 16:21:41 -07:00
rebuilt
7208cbb661
Add tests to make sure teacher survey items don't pollute the graphs for
...
students of unknown genders
2023-04-05 15:45:54 -07:00
rebuilt
63b1615bef
Make sure when checking for sufficient gender responses that we only check student survey items
2023-04-04 17:03:45 -07:00
rebuilt
098110433a
Remove duplicate line
2023-03-23 19:57:36 -07:00
rebuilt
5f58a5516e
print the number of student and teacher respondents
2023-03-23 17:29:02 -07:00
rebuilt
f7818fc9f6
make sure test database is cleaned before and after every test
2023-03-23 15:55:07 -07:00
rebuilt
9749cd1abb
Remove standard from gemfile
2023-03-23 13:05:09 -07:00
rebuilt
de478b7761
update reline
2023-03-17 19:06:26 -07:00
rebuilt
1290e52626
Correct branch name for ci
2023-03-17 19:02:28 -07:00
rebuilt
1b987f245b
Run ci when mciea-main code is pushed to github
2023-03-17 19:01:14 -07:00
rebuilt
36ea63332b
Add 2022-23 survey results
2023-03-17 18:55:35 -07:00
rebuilt
ad6561444a
Update ruby version
2023-03-10 16:14:54 -08:00
rebuilt
95e105e20b
Merge branch 'mciea-sftp-and-memory-fix' into mciea-main
2023-02-21 14:29:33 -08:00
rebuilt
8fb3019050
Patch security vulnerabilities
2023-02-21 14:28:28 -08:00
rebuilt
549d0eaa22
Add script to load 2016-18 data
2023-02-19 19:36:14 -08:00
rebuilt
6d770938ef
Swap survey data loading from local files to SFTP
2023-02-19 19:36:14 -08:00
rebuilt
14570b3c33
update tasks so that data gets loaded from sftp. Add task to delete 2016-17, and 2017-18 data
2023-02-19 19:36:14 -08:00
rebuilt
cf2b2433e9
Use an sftp uri unique to MCIEA
2023-02-19 19:36:14 -08:00
rebuilt
a5da0fb0c6
Fix bug with not all survey responses loading when using sftp loader
2023-02-19 19:36:14 -08:00
rebuilt
ef087a6cd0
update default folder for survey responses
2023-02-19 19:36:14 -08:00
rebuilt
47c1856281
Process 1000 rows at a time to limit memory usage in production
2023-02-19 19:36:14 -08:00
rebuilt
640de1c8df
Don't print sftptogo_url
2023-02-19 19:36:14 -08:00
rebuilt
380048f5cd
Load survey responses from sftp folder
2023-02-19 19:36:14 -08:00
rebuilt
6f986ff8a1
add proof of concept sftp downloader
2023-02-19 19:36:05 -08:00
rebuilt
f423bc734c
Add script to load 2016-18 data
2023-02-19 19:33:04 -08:00
Nelson Jovel
46e3d98172
update rails version
2023-02-15 20:24:18 -08:00
rebuilt
a2232f9c27
Merge pull request #9 from MCIEA/add-license-1
...
Create LICENSE
2023-02-15 20:06:36 -08:00
rebuilt
bd4938a7ec
Create LICENSE
2023-02-15 20:05:27 -08:00
rebuilt
f7902c40b5
Swap survey data loading from local files to SFTP
2023-02-15 17:12:55 -08:00
rebuilt
fa3759ecb7
update tasks so that data gets loaded from sftp. Add task to delete 2016-17, and 2017-18 data
2023-02-14 19:55:23 -08:00
rebuilt
ba132a5cb9
Use an sftp uri unique to MCIEA
2023-02-14 19:54:23 -08:00
rebuilt
7e7f41d276
Fix bug with not all survey responses loading when using sftp loader
2023-02-14 19:34:55 -08:00
rebuilt
af99138628
update default folder for survey responses
2023-02-14 19:34:44 -08:00
rebuilt
e008e62c2e
Process 1000 rows at a time to limit memory usage in production
2023-02-14 19:34:31 -08:00
rebuilt
8793506a03
Don't print sftptogo_url
2023-02-14 19:34:18 -08:00
rebuilt
185e7d46e4
Load survey responses from sftp folder
2023-02-14 19:32:10 -08:00
rebuilt
8fa079451c
add proof of concept sftp downloader
2023-02-14 19:31:44 -08:00
rebuilt
5118358b43
Also run student demographic loader when loading survey data
2023-01-16 17:04:12 -08:00
rebuilt
d5533bb756
Support survey item variants. Survey item id's in the format s-sbel-q1-1 will load into s-sbel-q1
2023-01-12 17:02:05 -08:00
rebuilt
ed421296c7
Fix bug that caused an incorrect score of 1 to be assigned for admin
...
data item related to parity index of teachers of color to students of
color. Now if there's not enough data to calculate a score, it produces
'NA' instead of 1. Also added admin data for a-reso-i1 and a-curv-i1
2023-01-06 17:43:48 -08:00
rebuilt
e8825c6796
fix rake task for uploading responses so that it also loads student racial information
2023-01-06 17:43:30 -08:00
rebuilt
b3ded7e7be
Fix security vulnerabilities
2023-01-03 17:22:34 -08:00