Commit graph

192 commits

Author SHA1 Message Date
rebuilt
fb963f63e0 Clean up rake tasks to get data:load_survey_responses working 2023-04-26 15:56:17 -07:00
rebuilt
128748addd Update logic for calculating student response rate. Remove references
to survey table.  We no longer check or keep track of the survey type.
Instead we look in the database to see if a survey item has at least 10
responses.  If it does, that survey item was presented to the respondent
and we count it, and all responses when calculating the response rate.

Remove response rate timestamp from caching logic because we no longer
add the response rate to the database. All response rates are calculated
on the fly

Update three_b_two scraper to use teacher only numbers

swap over to using https://profiles.doe.mass.edu/statereport/gradesubjectstaffing.aspx as the source of staffing information
2023-04-18 13:59:29 -07:00
rebuilt
a93b79151c update response load task for maynard 2023-04-07 15:18:59 -07:00
rebuilt
a656441fcd Fix oneoff script for ECP so it doesn't skip non-lowell schools 2023-04-05 13:13:59 -07:00
rebuilt
d9ed53c846 also set response rate thresholds 2023-04-04 10:39:37 -07:00
rebuilt
7aac39340b and one off script to temporarily set student and teacher response rates for lee to 100 percent 2023-04-04 09:53:29 -07:00
rebuilt
35cbb640ec add one-off script to load lee data 2023-04-03 13:12:02 -07:00
rebuilt
4c4ccc01cc Merge branch 'rpp-response-rate' to bring in changes to test files 2023-03-15 15:00:25 -07:00
rebuilt
06f9d2f0e9 Scrape enrollment and staffing information. Seed enrollment and staffing information. Update DatabaseCleaner so it cleans up leftover information in the database. Remove old admin csvs from codebase. 2023-03-05 16:15:35 -08:00
rebuilt
c0332955f3 move csv require statement to application.rb 2023-02-27 15:47:20 -08:00
rebuilt
ae6d7151b3 Load student respondent information from enrollment loader 2023-02-27 12:29:16 -08:00
rebuilt
984fedff02 Add academic year column to enrollment file. Add enrollment loader to seeder file 2023-02-22 01:12:09 -08:00
rebuilt
83ab2cfef0 Add one_off script for loading 2022-23 data 2023-02-12 16:54:54 -08:00
rebuilt
669fb7f1f0 Correct grade level for kindergarten and add one off task to load test data 2023-02-09 14:51:53 -08:00
rebuilt
3a744db975 Start adding kindergarten 2023-01-17 15:27:15 -08:00
rebuilt
03c6bff7bb Load survey responses from sftp folder 2023-01-12 17:04:57 -08:00
rebuilt
eeeb4f5d14 Add Stoklosa survey responses 2023-01-12 17:02:35 -08:00
rebuilt
d97b62b527 update logo and hero image 2023-01-12 17:02:35 -08:00
rebuilt
e2bf24e883 Add rules to the survey data loader to allow skipping non-lowell schools 2023-01-12 17:02:34 -08:00
rebuilt
a2caf42fee merge disagreggation features 2023-01-12 17:02:34 -08:00
rebuilt
e8825c6796 fix rake task for uploading responses so that it also loads student racial information 2023-01-06 17:43:30 -08:00
rebuilt
8c8dc39465 Also delete response rates for non lowell schools 2022-12-21 11:22:54 -08:00
rebuilt
7b9abe3793 Scrape latest data from DESE 2022-12-20 15:26:11 -08:00
rebuilt
0500d7c93f Add a way to delete non-lowell schools and districts 2022-12-14 14:18:54 -08:00
rebuilt
a1b7db9b2e Add ability to load student demographic information for only lowell 2022-12-03 11:33:11 -08:00
rebuilt
d49cf918ac Add a way to seed only lowell schools 2022-12-03 10:23:02 -08:00
rebuilt
9bbba64e9e Add rules to the survey data loader to allow skipping non-lowell schools 2022-12-01 16:15:45 -08:00
rebuilt
0321b3d43f add tasks to upload single year of data 2022-11-23 11:01:44 -08:00
rebuilt
89a7f27b88 Finishes #183092367. Adds ui and graphs to show grade level disaggregations 2022-10-16 22:03:25 -07:00
rebuilt
3e28be2d0d Remove 'scraper' from file/class names add 3B-1 2022-09-12 11:24:57 -07:00
rebuilt
048aacd641 Add admin data for 4D. Finishes #182818489 and #182793402 2022-08-30 21:46:23 -07:00
rebuilt
30eae881f3 Load correct column for 2021-22 year 2022-08-22 22:09:07 -07:00
rebuilt
bc63dfab7e add one_off scripts for each academic year 2022-08-22 15:24:15 -07:00
rebuilt
3fcab58557 Do not erase all students when loading each file 2022-08-22 14:36:00 -07:00
rebuilt
3f493727b3 Load a single year of student demographic data and race scores at a time 2022-08-22 11:29:38 -07:00
rebuilt
d89a207c31 Load student data for all years and calculate race scores for all 2022-08-20 15:07:15 -07:00
rebuilt
fc4fbb4644 load students from all years 2022-08-16 18:25:18 -07:00
rebuilt
105f30f220 Change race score calculations so the average bubbles up through survey_items
-> scales -> measure.
Precalculate averages for performance.
2022-08-10 09:58:11 -07:00
rebuilt
50b3bc678c Columns for students by group graph change when corresponding race checkboxes are clicked 2022-08-04 21:21:22 -07:00
rebuilt
93486eb132 Fix failing tests 2022-08-03 11:11:26 -07:00
rebuilt
94a58a87d7 Use modules to namespace classes for analyze page 2022-08-02 18:16:33 -07:00
rebuilt
d44a5275b4 Address bug related to story #182855028 2022-07-29 16:04:43 -07:00
rebuilt
12e4e3f177 import students 2022-07-29 15:34:56 -07:00
rebuilt
18b479b8b2 Refactor based on rubocop and reek suggestions 2022-07-08 19:07:23 -07:00
rebuilt
dfad41bdd5 Load teacher responses for lowell and milford 2021-22 2022-06-22 21:06:23 -07:00
rebuilt
3610d5f22d add 2021-22 data for lowell and milford 2022-06-22 18:40:10 -07:00
rebuilt
d0dcac701e change wording of output message in one-off script 2022-06-17 14:27:30 -07:00
rebuilt
7fcf580591 Load survey responses for revere somerville and wareham for the 2021-22 academic year 2022-06-17 13:45:10 -07:00
rebuilt
2d3ee28cc3 Change wording of refreshing response rates to resetting response rates 2022-06-16 17:22:26 -07:00
rebuilt
a6ad132c81 Add counter caches 2022-06-16 16:14:03 -07:00