Commit graph

236 commits

Author SHA1 Message Date
nelson
948f19015c feat: ECP-83 Clear cache after loading admin data 2025-02-13 12:13:54 -08:00
nelson
1c4cec3fed chore: rename sftp environment variable 2025-02-07 12:57:35 -08:00
nelson
623dbe5e44 chore: add documentation to rake commands 2025-02-07 12:55:29 -08:00
Nelson Jovel
534f42dfe0 feat: add esp counts when calculating teacher participation rates on overview page 2025-01-23 11:51:32 -08:00
Nelson Jovel
0146b0f005 fix: order of deletion. Delete students after updating references to nil on survey item responses 2024-11-25 18:23:14 -08:00
Nelson Jovel
e135048b66 chore: add script to delete student records incorrectly created by teacher responses 2024-11-25 17:40:43 -08:00
Nelson Jovel
3659433fb5 feat: create a report at the survey item response level that shows averages by student to selected measures 2024-07-18 15:48:10 -07:00
Nelson Jovel
ba9a23083d chore: add example usage 2024-07-16 21:24:24 -07:00
Nelson Jovel
c48b944280 chore: add usage example for report:survey_item:create 2024-06-25 12:04:16 -07:00
Nelson Jovel
9c9346f455 chore: add ability to filter survey item report by student survey type 2024-06-19 15:48:50 -07:00
Nelson Jovel
118938deeb chore: add report for listing district level averages for measure scores 2024-06-19 10:15:37 -07:00
Nelson Jovel
7142dca620 chore: print the n-size when printing nil grades 2024-05-23 13:34:31 -07:00
Nelson Jovel
43ae016968 chore: increase limit to 10 percent when printing out nil grade values 2024-05-23 13:14:03 -07:00
Nelson Jovel
7cf4cd821e chore: generate report of high number of nil grades in responses 2024-05-23 13:11:31 -07:00
Nelson Jovel
cf5c4f2d13 feat: add seasonal academic years 2024-05-08 15:22:26 -07:00
Nelson Jovel
2561fa28fc feat: Split academic year into seasons if the academic year's range is
initialized with a season, i.e. "2024-25 Fall".  Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly.   Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year.  So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring".  Add tests
for the new range format.  Set the default cutoff for the start of Spring season will be the last Sunday in February
2024-04-27 14:05:02 -07:00
Nelson Jovel
67ffc996a8 Revert "Split academic year into seasons if the academic year's range is"
This reverts commit a5d4cccb37.
2024-04-26 13:48:30 -07:00
Nelson Jovel
a5d4cccb37 Split academic year into seasons if the academic year's range is
initialized with a season, i.e. "2024-25 Fall".  Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly.   Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year.  So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring".  Add tests
for the new range format.  Set the default cutoff for the start of Spring season will be the last Sunday in February
2024-04-26 13:31:50 -07:00
6fac759ec2 Faster admin data loader + rename School.school_hash 2024-04-22 15:43:54 -04:00
e3bbf1353b Feat: Add item-level reporting by grade 2024-04-19 15:10:52 -04:00
deb70d4b88 Memoize admin data loader 2024-04-18 17:20:26 -04:00
deaae5cf65 Feat: Add task to generate item-level survey report 2024-04-10 14:24:30 -04:00
Nelson Jovel
fc77eb0ee6 chore: create script for resetting respondents 2024-03-29 12:07:13 -07:00
Nelson Jovel
b5e42498d2 feat: Add more measures to bll request 2024-03-20 08:56:30 -07:00
Nelson Jovel
9fb32cc1f5 fix: remove duplicate measure ids from report 2024-03-19 09:24:00 -07:00
Nelson Jovel
9f5ca007a1 fix: make sure averages for admin data scales are included in report 2024-03-19 08:16:32 -07:00
Nelson Jovel
d90669b74d feat: create beyond learning loss report 2024-03-19 07:16:13 -07:00
Nelson Jovel
f27a590c5a Convert gender and race text into qualtrics codes during cleaning. Abide by 'prefer not to disclose' for self reported race. Give priority to self reported data but use SIS information as backup 2023-11-30 20:57:04 -08:00
Nelson Jovel
bb964943b7 Add task to delete 2023-24 data so enrollment data can be reseeded 2023-11-06 21:56:11 -08:00
rebuilt
019b954ffa feat: load student responses in the same pass as loading the survey responses
chore: remove student loader since loading students is now done with the survey response loader
2023-11-02 11:38:03 -07:00
rebuilt
ece1f61aec feat: add command for loading survey responses from arbitrary sftp directory 2023-11-01 09:01:19 -07:00
rebuilt
2fd56047d4 Add disaggregation by ELL 2023-10-24 12:51:12 -07:00
rebuilt
2ac30bb107 feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page 2023-10-24 09:05:27 -07:00
7dec0be5af Add seeding & scripts for Daley 2023-24 2023-06-23 18:33:19 +00:00
0468dba3ba Remove non-Lowell schools, remove data:seed_only_lowell & data:delete_non_lowell 2023-06-22 23:56:32 +00:00
rebuilt
bb5cfce09f Remove precalculation of response rates. Add loading of student info to database 2023-06-16 13:57:02 -07:00
rebuilt
1aebc23721 chore: remove unneeded tasks 2023-06-13 09:21:13 -07:00
0c7b5a6e06 Add cleaned data upload script for Lowell 2023-06-13 04:13:15 +00:00
rebuilt
9493007801 Also delete race scores when deleting non-lowell info 2023-06-12 15:52:57 -07:00
rebuilt
33e590607c Remove outdated tasks 2023-06-06 13:07:33 -07:00
rebuilt
8df7a1ef28 Remove redundant tasks 2023-06-06 13:04:53 -07:00
rebuilt
42ab3aef57 Fix lowell seeder to create enrollment and staffing entries in database 2023-06-05 17:41:52 -07:00
rebuilt
0f23053294 It's possible for admin data likert score values to be above 5. If that happens, we
cap the likert score at 5.   This was happening already at the scraper
level but it's also now being done by the admin data loader for safety.
Also make sure to just update admin data instead of deleting and
reloading all values each load. Add tests to confirm this behavior
2023-06-03 16:47:03 -07:00
rebuilt
08c946a469 Add subcategory report 2023-05-23 18:59:05 -07:00
vineeshathallapaneni@gmail.com
4a9b95aad1 updated code by adding a task to find most skipped questions on regular survey questions 2023-05-18 15:56:34 -04:00
rebuilt
dbfc9d1d3a Add automated data cleaning. Modify SurveyItemValues class to use regex
instead of hard coded values.  Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
2023-05-16 13:39:12 -07:00
vineeshathallapaneni@gmail.com
4bf61fb7b1 added tasks to find stray responses and skipped questions 2023-05-15 20:31:37 -04:00
rebuilt
56fb6abd2c Don't seed surveys when seeding lowell info 2023-04-22 11:35:04 -07:00
rebuilt
aa3a67406b Set a minimum threshold of 10 survey item responses to calculate scores per survey item 2023-04-17 15:18:10 -07:00
rebuilt
d888cdff3a add oneoff for deleting invalid survey item responses 2023-04-16 14:55:12 -07:00