rebuilt
ece1f61aec
feat: add command for loading survey responses from arbitrary sftp directory
2023-11-01 09:01:19 -07:00
rebuilt
2fd56047d4
Add disaggregation by ELL
2023-10-24 12:51:12 -07:00
rebuilt
2ac30bb107
feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page
2023-10-24 09:05:27 -07:00
7dec0be5af
Add seeding & scripts for Daley 2023-24
2023-06-23 18:33:19 +00:00
0468dba3ba
Remove non-Lowell schools, remove data:seed_only_lowell & data:delete_non_lowell
2023-06-22 23:56:32 +00:00
rebuilt
bb5cfce09f
Remove precalculation of response rates. Add loading of student info to database
2023-06-16 13:57:02 -07:00
rebuilt
1aebc23721
chore: remove unneeded tasks
2023-06-13 09:21:13 -07:00
0c7b5a6e06
Add cleaned data upload script for Lowell
2023-06-13 04:13:15 +00:00
rebuilt
9493007801
Also delete race scores when deleting non-lowell info
2023-06-12 15:52:57 -07:00
rebuilt
33e590607c
Remove outdated tasks
2023-06-06 13:07:33 -07:00
rebuilt
8df7a1ef28
Remove redundant tasks
2023-06-06 13:04:53 -07:00
rebuilt
42ab3aef57
Fix lowell seeder to create enrollment and staffing entries in database
2023-06-05 17:41:52 -07:00
rebuilt
0f23053294
It's possible for admin data likert score values to be above 5. If that happens, we
...
cap the likert score at 5. This was happening already at the scraper
level but it's also now being done by the admin data loader for safety.
Also make sure to just update admin data instead of deleting and
reloading all values each load. Add tests to confirm this behavior
2023-06-03 16:47:03 -07:00
rebuilt
08c946a469
Add subcategory report
2023-05-23 18:59:05 -07:00
vineeshathallapaneni@gmail.com
4a9b95aad1
updated code by adding a task to find most skipped questions on regular survey questions
2023-05-18 15:56:34 -04:00
rebuilt
dbfc9d1d3a
Add automated data cleaning. Modify SurveyItemValues class to use regex
...
instead of hard coded values. Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
2023-05-16 13:39:12 -07:00
vineeshathallapaneni@gmail.com
4bf61fb7b1
added tasks to find stray responses and skipped questions
2023-05-15 20:31:37 -04:00
rebuilt
56fb6abd2c
Don't seed surveys when seeding lowell info
2023-04-22 11:35:04 -07:00
rebuilt
aa3a67406b
Set a minimum threshold of 10 survey item responses to calculate scores per survey item
2023-04-17 15:18:10 -07:00
rebuilt
d888cdff3a
add oneoff for deleting invalid survey item responses
2023-04-16 14:55:12 -07:00
rebuilt
65b8599c6e
Update logic for calculating student response rate. Remove references
...
to survey table. We no longer check or keep track of the survey type.
Instead we look in the database to see if a survey item has at least 10
responses. If it does, that survey item was presented to the respondent
and we count it, and all responses when calculating the response rate.
Remove response rate timestamp from caching logic because we no longer
add the response rate to the database. All response rates are calculated
on the fly
Update three_b_two scraper to use teacher only numbers
swap over to using https://profiles.doe.mass.edu/statereport/gradesubjectstaffing.aspx as the source of staffing information
2023-04-08 10:59:48 -07:00
rebuilt
825259bdd8
Merge branch 'rpp-response-rate' into rpp-main to bring in improvements
...
to how we get enrollment and staffing information. Also speed up tests
2023-03-22 16:52:55 -07:00
rebuilt
06f9d2f0e9
Scrape enrollment and staffing information. Seed enrollment and staffing information. Update DatabaseCleaner so it cleans up leftover information in the database. Remove old admin csvs from codebase.
2023-03-05 16:15:35 -08:00
rebuilt
c0332955f3
move csv require statement to application.rb
2023-02-27 15:47:20 -08:00
rebuilt
ae6d7151b3
Load student respondent information from enrollment loader
2023-02-27 12:29:16 -08:00
rebuilt
984fedff02
Add academic year column to enrollment file. Add enrollment loader to seeder file
2023-02-22 01:12:09 -08:00
rebuilt
83ab2cfef0
Add one_off script for loading 2022-23 data
2023-02-12 16:54:54 -08:00
rebuilt
669fb7f1f0
Correct grade level for kindergarten and add one off task to load test data
2023-02-09 14:51:53 -08:00
rebuilt
3a744db975
Start adding kindergarten
2023-01-17 15:27:15 -08:00
rebuilt
03c6bff7bb
Load survey responses from sftp folder
2023-01-12 17:04:57 -08:00
rebuilt
eeeb4f5d14
Add Stoklosa survey responses
2023-01-12 17:02:35 -08:00
rebuilt
d97b62b527
update logo and hero image
2023-01-12 17:02:35 -08:00
rebuilt
e2bf24e883
Add rules to the survey data loader to allow skipping non-lowell schools
2023-01-12 17:02:34 -08:00
rebuilt
a2caf42fee
merge disagreggation features
2023-01-12 17:02:34 -08:00
rebuilt
e8825c6796
fix rake task for uploading responses so that it also loads student racial information
2023-01-06 17:43:30 -08:00
rebuilt
8c8dc39465
Also delete response rates for non lowell schools
2022-12-21 11:22:54 -08:00
rebuilt
7b9abe3793
Scrape latest data from DESE
2022-12-20 15:26:11 -08:00
rebuilt
0500d7c93f
Add a way to delete non-lowell schools and districts
2022-12-14 14:18:54 -08:00
rebuilt
a1b7db9b2e
Add ability to load student demographic information for only lowell
2022-12-03 11:33:11 -08:00
rebuilt
d49cf918ac
Add a way to seed only lowell schools
2022-12-03 10:23:02 -08:00
rebuilt
9bbba64e9e
Add rules to the survey data loader to allow skipping non-lowell schools
2022-12-01 16:15:45 -08:00
rebuilt
0321b3d43f
add tasks to upload single year of data
2022-11-23 11:01:44 -08:00
rebuilt
89a7f27b88
Finishes #183092367 . Adds ui and graphs to show grade level disaggregations
2022-10-16 22:03:25 -07:00
rebuilt
3e28be2d0d
Remove 'scraper' from file/class names add 3B-1
2022-09-12 11:24:57 -07:00
rebuilt
048aacd641
Add admin data for 4D. Finishes #182818489 and #182793402
2022-08-30 21:46:23 -07:00
rebuilt
30eae881f3
Load correct column for 2021-22 year
2022-08-22 22:09:07 -07:00
rebuilt
bc63dfab7e
add one_off scripts for each academic year
2022-08-22 15:24:15 -07:00
rebuilt
3fcab58557
Do not erase all students when loading each file
2022-08-22 14:36:00 -07:00
rebuilt
3f493727b3
Load a single year of student demographic data and race scores at a time
2022-08-22 11:29:38 -07:00
rebuilt
d89a207c31
Load student data for all years and calculate race scores for all
2022-08-20 15:07:15 -07:00
