Commit graph

161 commits

Author SHA1 Message Date
nelson
948f19015c feat: ECP-83 Clear cache after loading admin data 2025-02-13 12:13:54 -08:00
nelson
623dbe5e44 chore: add documentation to rake commands 2025-02-07 12:55:29 -08:00
6fac759ec2 Faster admin data loader + rename School.school_hash 2024-04-22 15:43:54 -04:00
deb70d4b88 Memoize admin data loader 2024-04-18 17:20:26 -04:00
Nelson Jovel
f27a590c5a Convert gender and race text into qualtrics codes during cleaning. Abide by 'prefer not to disclose' for self reported race. Give priority to self reported data but use SIS information as backup 2023-11-30 20:57:04 -08:00
rebuilt
019b954ffa feat: load student responses in the same pass as loading the survey responses
chore: remove student loader since loading students is now done with the survey response loader
2023-11-02 11:38:03 -07:00
rebuilt
ece1f61aec feat: add command for loading survey responses from arbitrary sftp directory 2023-11-01 09:01:19 -07:00
rebuilt
2fd56047d4 Add disaggregation by ELL 2023-10-24 12:51:12 -07:00
7dec0be5af Add seeding & scripts for Daley 2023-24 2023-06-23 18:33:19 +00:00
0468dba3ba Remove non-Lowell schools, remove data:seed_only_lowell & data:delete_non_lowell 2023-06-22 23:56:32 +00:00
rebuilt
bb5cfce09f Remove precalculation of response rates. Add loading of student info to database 2023-06-16 13:57:02 -07:00
rebuilt
9493007801 Also delete race scores when deleting non-lowell info 2023-06-12 15:52:57 -07:00
rebuilt
33e590607c Remove outdated tasks 2023-06-06 13:07:33 -07:00
rebuilt
8df7a1ef28 Remove redundant tasks 2023-06-06 13:04:53 -07:00
rebuilt
42ab3aef57 Fix lowell seeder to create enrollment and staffing entries in database 2023-06-05 17:41:52 -07:00
rebuilt
0f23053294 It's possible for admin data likert score values to be above 5. If that happens, we
cap the likert score at 5.   This was happening already at the scraper
level but it's also now being done by the admin data loader for safety.
Also make sure to just update admin data instead of deleting and
reloading all values each load. Add tests to confirm this behavior
2023-06-03 16:47:03 -07:00
rebuilt
56fb6abd2c Don't seed surveys when seeding lowell info 2023-04-22 11:35:04 -07:00
rebuilt
825259bdd8 Merge branch 'rpp-response-rate' into rpp-main to bring in improvements
to how we get enrollment and staffing information.  Also speed up tests
2023-03-22 16:52:55 -07:00
rebuilt
06f9d2f0e9 Scrape enrollment and staffing information. Seed enrollment and staffing information. Update DatabaseCleaner so it cleans up leftover information in the database. Remove old admin csvs from codebase. 2023-03-05 16:15:35 -08:00
rebuilt
c0332955f3 move csv require statement to application.rb 2023-02-27 15:47:20 -08:00
rebuilt
ae6d7151b3 Load student respondent information from enrollment loader 2023-02-27 12:29:16 -08:00
rebuilt
984fedff02 Add academic year column to enrollment file. Add enrollment loader to seeder file 2023-02-22 01:12:09 -08:00
rebuilt
83ab2cfef0 Add one_off script for loading 2022-23 data 2023-02-12 16:54:54 -08:00
rebuilt
3a744db975 Start adding kindergarten 2023-01-17 15:27:15 -08:00
rebuilt
03c6bff7bb Load survey responses from sftp folder 2023-01-12 17:04:57 -08:00
rebuilt
d97b62b527 update logo and hero image 2023-01-12 17:02:35 -08:00
rebuilt
e2bf24e883 Add rules to the survey data loader to allow skipping non-lowell schools 2023-01-12 17:02:34 -08:00
rebuilt
a2caf42fee merge disagreggation features 2023-01-12 17:02:34 -08:00
rebuilt
e8825c6796 fix rake task for uploading responses so that it also loads student racial information 2023-01-06 17:43:30 -08:00
rebuilt
8c8dc39465 Also delete response rates for non lowell schools 2022-12-21 11:22:54 -08:00
rebuilt
7b9abe3793 Scrape latest data from DESE 2022-12-20 15:26:11 -08:00
rebuilt
0500d7c93f Add a way to delete non-lowell schools and districts 2022-12-14 14:18:54 -08:00
rebuilt
a1b7db9b2e Add ability to load student demographic information for only lowell 2022-12-03 11:33:11 -08:00
rebuilt
d49cf918ac Add a way to seed only lowell schools 2022-12-03 10:23:02 -08:00
rebuilt
9bbba64e9e Add rules to the survey data loader to allow skipping non-lowell schools 2022-12-01 16:15:45 -08:00
rebuilt
0321b3d43f add tasks to upload single year of data 2022-11-23 11:01:44 -08:00
rebuilt
89a7f27b88 Finishes #183092367. Adds ui and graphs to show grade level disaggregations 2022-10-16 22:03:25 -07:00
rebuilt
3e28be2d0d Remove 'scraper' from file/class names add 3B-1 2022-09-12 11:24:57 -07:00
rebuilt
048aacd641 Add admin data for 4D. Finishes #182818489 and #182793402 2022-08-30 21:46:23 -07:00
rebuilt
bc63dfab7e add one_off scripts for each academic year 2022-08-22 15:24:15 -07:00
rebuilt
3fcab58557 Do not erase all students when loading each file 2022-08-22 14:36:00 -07:00
rebuilt
fc4fbb4644 load students from all years 2022-08-16 18:25:18 -07:00
rebuilt
105f30f220 Change race score calculations so the average bubbles up through survey_items
-> scales -> measure.
Precalculate averages for performance.
2022-08-10 09:58:11 -07:00
rebuilt
50b3bc678c Columns for students by group graph change when corresponding race checkboxes are clicked 2022-08-04 21:21:22 -07:00
rebuilt
93486eb132 Fix failing tests 2022-08-03 11:11:26 -07:00
rebuilt
94a58a87d7 Use modules to namespace classes for analyze page 2022-08-02 18:16:33 -07:00
rebuilt
d44a5275b4 Address bug related to story #182855028 2022-07-29 16:04:43 -07:00
rebuilt
12e4e3f177 import students 2022-07-29 15:34:56 -07:00
rebuilt
18b479b8b2 Refactor based on rubocop and reek suggestions 2022-07-08 19:07:23 -07:00
rebuilt
7fcf580591 Load survey responses for revere somerville and wareham for the 2021-22 academic year 2022-06-17 13:45:10 -07:00