Commit graph

227 commits

Author SHA1 Message Date
rebuilt
6899e1aa69 Create ability to run exports locally so they get created in
tmp/exports.
Fix measure summary for 'all years' output.

Slight speedup to survey item by grade.
Fix Survey item by item for the 'all years' output
2025-06-09 21:17:16 -07:00
nelson
2220225caa feat: ECP-83 Clear cache after loading admin data 2025-02-13 12:10:41 -08:00
nelson
5235ad8c6a chore: rename sftp environment variable 2025-02-07 12:53:47 -08:00
nelson
8fe308c139 chore: add documentation to rake commands 2025-02-07 12:52:08 -08:00
Nelson Jovel
8303d3bfdc feat: add esp counts when calculating teacher participation rates on overview page 2025-01-23 11:35:20 -08:00
Nelson Jovel
9071e87aea fix: order of deletion. Delete students after updating references to nil on survey item responses 2024-11-25 18:21:30 -08:00
Nelson Jovel
b40a81c8fd chore: add script to delete student records incorrectly created by teacher responses 2024-11-25 17:40:27 -08:00
Nelson Jovel
82bdc076de feat: create a report at the survey item response level that shows averages by student to selected measures 2024-07-18 16:45:47 -07:00
Nelson Jovel
7f0b52029d chore: add example usage 2024-07-16 21:24:38 -07:00
Nelson Jovel
1d95b74707 chore: add usage example for report:survey_item:create 2024-06-25 12:04:28 -07:00
Nelson Jovel
d27e8da343 chore: add ability to filter survey item report by student survey type 2024-06-19 15:49:06 -07:00
Nelson Jovel
6c86cc3fce chore: add report for listing district level averages for measure scores 2024-06-19 10:15:52 -07:00
Nelson Jovel
74218449b7 chore: print the n-size when printing nil grades 2024-05-23 13:35:53 -07:00
Nelson Jovel
cc3b320477 chore: set cutoff at 10 percent when printing out nil grades 2024-05-23 13:27:25 -07:00
Nelson Jovel
40f6abe256 chore: generate report of high number of nil grades in responses 2024-05-23 13:14:29 -07:00
Nelson Jovel
79a964cb38 chore: delete more academic years when doing the reset for multiple survey administrations 2024-05-22 17:34:09 -07:00
Nelson Jovel
ac5c1edfbf feat: Split academic year into seasons if the academic year's range is
initialized with a season, i.e. "2024-25 Fall".  Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly.   Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year.  So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring".  Add tests
for the new range format.  Set the default cutoff for the start of Spring season will be the last Sunday in February
2024-04-27 14:24:05 -07:00
b3e6efdb2e Faster admin data loader + rename School.school_hash 2024-04-22 16:21:43 -04:00
a70ce7aafc Feat: Add item-level reporting by grade 2024-04-19 15:11:02 -04:00
b5f90376f7 Memoize admin data loader 2024-04-18 17:23:49 -04:00
ef7b5435ba Feat: Add task to generate item-level survey report 2024-04-10 14:24:52 -04:00
Nelson Jovel
49bef23890 feat: Add more measures to bll request 2024-03-20 08:56:47 -07:00
Nelson Jovel
e8024eccda fix: remove duplicate measure ids from report 2024-03-19 09:24:13 -07:00
Nelson Jovel
3117080f2d fix: make sure averages for admin data scales are included in report 2024-03-19 08:16:49 -07:00
Nelson Jovel
7666b5466b feat: create beyond learning loss report 2024-03-19 07:17:22 -07:00
Nelson Jovel
4082f2ad1c Revert "chore: update source of truth and add a way to delete 'Library Access' measure from database"
This reverts commit a70a6ae32c.
2024-03-08 14:53:40 -08:00
Nelson Jovel
31f42b3434 chore: update source of truth and add a way to delete 'Library Access' measure from database 2024-03-08 14:52:24 -08:00
Nelson Jovel
a70a6ae32c chore: update source of truth and add a way to delete 'Library Access' measure from database 2024-03-08 14:42:53 -08:00
Nelson Jovel
8dfaa86982 feat: create a score csv report for measures 2024-03-06 15:50:07 -08:00
Nelson Jovel
76bd79e8a2 chore: clean up rake tasks 2023-12-20 13:47:38 -08:00
rebuilt
79bc91d39f feat: add command for loading survey responses from arbitrary sftp directory 2023-10-30 19:44:52 -07:00
rebuilt
245cde85cd Add disaggregation by ELL 2023-10-17 11:18:47 -07:00
rebuilt
071e7b5208 chore: continue cleaning up unneeded tasks 2023-08-09 11:01:46 -07:00
rebuilt
2903b455ce chore: remove unused tasks from data.rake and one_off.rake 2023-08-08 16:39:29 -07:00
rebuilt
76ebcc6ef3 feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page 2023-08-08 15:52:12 -07:00
vineeshathallapaneni@gmail.com
1fc1c8348f Revert "added a rake task to output stray responses"
This reverts commit ac0374533e.
2023-06-28 23:55:35 -04:00
vineeshathallapaneni@gmail.com
ac0374533e added a rake task to output stray responses 2023-06-28 23:51:00 -04:00
73a5f4e30b Patch upload script over from rpp 2023-06-21 03:27:47 +00:00
4091fcdd44 Add cleaned data upload script for Lowell 2023-06-21 03:23:00 +00:00
rebuilt
904d0d2f2c It's possible for admin data likert score values to be above 5. If that happens, we
cap the likert score at 5.   This was happening already at the scraper
level but it's also now being done by the admin data loader for safety.
Also make sure to just update admin data instead of deleting and
reloading all values each load. Add tests to confirm this behavior
2023-06-03 16:06:50 -07:00
rebuilt
83fa0c4e63 Removed duplicate parameter 2023-06-02 10:36:46 -07:00
rebuilt
1e3cebf223 add oneoff script to load wareham data 2023-05-27 17:05:40 -07:00
rebuilt
28e7f1fcb2 Change Dese ID of Minot Forest in Wareham to 310001799. Change Dese ID of Wareham Elementary School to 3100017 2023-05-27 15:44:04 -07:00
rebuilt
0dfc9726d0 Add automated data cleaning. Modify SurveyItemValues class to use regex
instead of hard coded values.  Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
2023-05-24 11:59:53 -07:00
rebuilt
b5dc933187 Add subcategory report 2023-05-23 18:43:55 -07:00
rebuilt
03efd88284 Do not create response rate entries in the database when loading survey item responses 2023-04-25 17:16:44 -07:00
rebuilt
07ed8dd259 Update logic for calculating student response rate. Remove references
to survey table.  We no longer check or keep track of the survey type.
Instead we look in the database to see if a survey item has at least 10
responses.  If it does, that survey item was presented to the respondent
and we count it, and all responses when calculating the response rate.

Remove response rate timestamp from caching logic because we no longer
add the response rate to the database. All response rates are calculated
on the fly

Update three_b_two scraper to use teacher only numbers

swap over to using https://profiles.doe.mass.edu/statereport/gradesubjectstaffing.aspx as the source of staffing information
2023-04-22 14:00:20 -07:00
rebuilt
098110433a Remove duplicate line 2023-03-23 19:57:36 -07:00
rebuilt
5f58a5516e print the number of student and teacher respondents 2023-03-23 17:29:02 -07:00
rebuilt
36ea63332b Add 2022-23 survey results 2023-03-17 18:55:35 -07:00