Commit graph

145 commits

Author SHA1 Message Date
b3e6efdb2e Faster admin data loader + rename School.school_hash 2024-04-22 16:21:43 -04:00
b5f90376f7 Memoize admin data loader 2024-04-18 17:23:49 -04:00
Nelson Jovel
76bd79e8a2 chore: clean up rake tasks 2023-12-20 13:47:38 -08:00
rebuilt
79bc91d39f feat: add command for loading survey responses from arbitrary sftp directory 2023-10-30 19:44:52 -07:00
rebuilt
245cde85cd Add disaggregation by ELL 2023-10-17 11:18:47 -07:00
rebuilt
2903b455ce chore: remove unused tasks from data.rake and one_off.rake 2023-08-08 16:39:29 -07:00
rebuilt
904d0d2f2c It's possible for admin data likert score values to be above 5. If that happens, we
cap the likert score at 5.   This was happening already at the scraper
level but it's also now being done by the admin data loader for safety.
Also make sure to just update admin data instead of deleting and
reloading all values each load. Add tests to confirm this behavior
2023-06-03 16:06:50 -07:00
rebuilt
03efd88284 Do not create response rate entries in the database when loading survey item responses 2023-04-25 17:16:44 -07:00
rebuilt
6d770938ef Swap survey data loading from local files to SFTP 2023-02-19 19:36:14 -08:00
rebuilt
14570b3c33 update tasks so that data gets loaded from sftp. Add task to delete 2016-17, and 2017-18 data 2023-02-19 19:36:14 -08:00
rebuilt
380048f5cd Load survey responses from sftp folder 2023-02-19 19:36:14 -08:00
rebuilt
5118358b43 Also run student demographic loader when loading survey data 2023-01-16 17:04:12 -08:00
rebuilt
e8825c6796 fix rake task for uploading responses so that it also loads student racial information 2023-01-06 17:43:30 -08:00
rebuilt
8c8dc39465 Also delete response rates for non lowell schools 2022-12-21 11:22:54 -08:00
rebuilt
7b9abe3793 Scrape latest data from DESE 2022-12-20 15:26:11 -08:00
rebuilt
0500d7c93f Add a way to delete non-lowell schools and districts 2022-12-14 14:18:54 -08:00
rebuilt
a1b7db9b2e Add ability to load student demographic information for only lowell 2022-12-03 11:33:11 -08:00
rebuilt
d49cf918ac Add a way to seed only lowell schools 2022-12-03 10:23:02 -08:00
rebuilt
9bbba64e9e Add rules to the survey data loader to allow skipping non-lowell schools 2022-12-01 16:15:45 -08:00
rebuilt
0321b3d43f add tasks to upload single year of data 2022-11-23 11:01:44 -08:00
rebuilt
89a7f27b88 Finishes #183092367. Adds ui and graphs to show grade level disaggregations 2022-10-16 22:03:25 -07:00
rebuilt
3e28be2d0d Remove 'scraper' from file/class names add 3B-1 2022-09-12 11:24:57 -07:00
rebuilt
048aacd641 Add admin data for 4D. Finishes #182818489 and #182793402 2022-08-30 21:46:23 -07:00
rebuilt
bc63dfab7e add one_off scripts for each academic year 2022-08-22 15:24:15 -07:00
rebuilt
3fcab58557 Do not erase all students when loading each file 2022-08-22 14:36:00 -07:00
rebuilt
fc4fbb4644 load students from all years 2022-08-16 18:25:18 -07:00
rebuilt
105f30f220 Change race score calculations so the average bubbles up through survey_items
-> scales -> measure.
Precalculate averages for performance.
2022-08-10 09:58:11 -07:00
rebuilt
50b3bc678c Columns for students by group graph change when corresponding race checkboxes are clicked 2022-08-04 21:21:22 -07:00
rebuilt
93486eb132 Fix failing tests 2022-08-03 11:11:26 -07:00
rebuilt
94a58a87d7 Use modules to namespace classes for analyze page 2022-08-02 18:16:33 -07:00
rebuilt
d44a5275b4 Address bug related to story #182855028 2022-07-29 16:04:43 -07:00
rebuilt
12e4e3f177 import students 2022-07-29 15:34:56 -07:00
rebuilt
18b479b8b2 Refactor based on rubocop and reek suggestions 2022-07-08 19:07:23 -07:00
rebuilt
7fcf580591 Load survey responses for revere somerville and wareham for the 2021-22 academic year 2022-06-17 13:45:10 -07:00
rebuilt
2d3ee28cc3 Change wording of refreshing response rates to resetting response rates 2022-06-16 17:22:26 -07:00
rebuilt
a6ad132c81 Add counter caches 2022-06-16 16:14:03 -07:00
rebuilt
c03615cb43 Rename ResponseRate to ResponseRateCalculator. Create a new response
rate model.  Create a loader to refresh response rates for all
subcategories.

Use precalculated response rates in views

Wrap more elements in page caching

Calculate a response rate for a subcategory if one does not already
exist
2022-06-16 08:19:26 -07:00
Nelson Jovel
9ecc501e24 Display measure scores. Finishes #181754978 2022-04-06 13:09:33 -07:00
Nelson Jovel
ed7a3b8a3d Autoformat code with rubocop 2022-03-04 15:29:54 +01:00
Nelson Jovel
ad03606d66 Add benchmarks to survey and admin data items. Remove them from measures. Modify seeder
Calculate benchmarks for measures based on a weighted average of survey
and admin data items

Added architectural records
2021-12-28 14:10:34 +01:00
Alex Basson
0dbe05817e rake data:load_survey_responses loads all csv files in the data/survey_responses/ directory 2021-09-22 21:03:12 -04:00
Alex Basson
fd091cfa4f Load 2020-21 student survey responses 2021-09-22 15:15:59 -04:00
Alex Basson
f5724407f2 Load teacher survey responses 2021-09-22 08:44:54 -04:00
Alex Basson
75787cf682 Remove vestigial comment 2021-09-03 11:32:48 -04:00
Alex Basson
f0ae6d8558 Added comment to trigger Heroku update 2021-08-30 15:46:48 -04:00
Jared Cosulich
712ad1206b editing data.rake for admin data 2020-01-12 08:13:50 -05:00
Jared Cosulich
9032341290 working on student/teacher ratios 2019-08-05 21:31:37 -04:00
Jared Cosulich
ed9329e912 fixing sync 2019-07-30 17:42:46 -04:00
Jared Cosulich
71b5edddde sync reverse questions 2019-07-30 07:32:38 -04:00
Jared Cosulich
9eb36b0510 sync school aggregates 2019-07-28 21:14:25 -04:00