b6675c2516
ECP-206 Delete the 3 info boxes for each sub-category on the Browse page
1 month ago
72e38f5ee8
feat: add task to upload exports directory
6 months ago
686e89d0ba
Create ability to run exports locally so they get created in
...
tmp/exports.
Fix measure summary for 'all years' output.
Slight speedup to survey item by grade.
Fix Survey item by item for the 'all years' output
6 months ago
e14c71a595
feat: ECP-83 Clear cache after loading admin data
10 months ago
3d2b32cebf
chore: rename sftp environment variable
10 months ago
934a306b8a
chore: add documentation to rake commands
10 months ago
02bcb2b75b
feat: add esp counts when calculating teacher participation rates on overview page
11 months ago
a514cfd64d
fix: order of deletion. Delete students after updating references to nil on survey item responses
1 year ago
0f5c0b280d
chore: add script to delete student records incorrectly created by teacher responses
1 year ago
8a2c34462b
feat: create a report at the survey item response level that shows averages by student to selected measures
1 year ago
645b2a8bda
chore: add example usage
1 year ago
c5cb34c698
chore: add usage example for report:survey_item:create
1 year ago
c4e1023446
chore: add ability to filter survey item report by student survey type
1 year ago
9a6db9235a
chore: add report for listing district level averages for measure scores
1 year ago
4df3698a3a
chore: print the n-size when printing nil grades
2 years ago
c724996b6b
chore: generate report of high number of nil grades in responses
2 years ago
9938a2cf44
chore: delete more academic years when doing the reset for multiple survey administrations
2 years ago
33da0859b9
Split academic year into seasons if the academic year's range is
...
initialized with a season, i.e. "2024-25 Fall". Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly. Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year. So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring". Add tests
for the new range format. Set the default cutoff for the start of Spring season will be the last Sunday in February
2 years ago
Gabe Farrell
5789ebf564
Faster admin data loader + rename School.school_hash
2 years ago
Gabe Farrell
963d945eea
Feat: Add item-level reporting by grade
2 years ago
Gabe Farrell
04d61c0b1a
Memoize admin data loader
2 years ago
Gabe Farrell
a085afb3b6
Feat: Add task to generate item-level survey report
2 years ago
e14240a9a4
chore: create script for resetting respondents
2 years ago
91e8211673
feat: Add more measures to bll request
2 years ago
2b66a1139a
fix: remove duplicate measure ids from report
2 years ago
0864b6e901
fix: make sure averages for admin data scales are included in report
2 years ago
e83865ad55
feat: create beyond learning loss report
2 years ago
5d5bc310bf
chore: update source of truth and add a way to delete 'Library Access' measure from database
2 years ago
6ba367471b
Revert "chore: update source of truth and add a way to delete 'Library Access' measure from database"
...
This reverts commit a030cb1811
2 years ago
a030cb1811
chore: update source of truth and add a way to delete 'Library Access' measure from database
2 years ago
ee4343383c
feat: create a score csv report for measures
2 years ago
1a707eb6bc
feat: load student responses in the same pass as loading the survey responses
...
chore: remove student loader since loading students is now done with the survey response loader
2 years ago
2d90516f9f
feat: add command for loading survey responses from arbitrary sftp directory
2 years ago
060d7aa55a
Add disaggregation by ELL
2 years ago
4e33c8e173
chore: remove unused tasks
2 years ago
ca71eeb710
chore: accidentally left dese admin data commented out. Turn it back on
2 years ago
cbd5687ff0
feat: Add out of state admin data
2 years ago
4f035f6a63
feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page
2 years ago
Gabe Farrell
527aa66796
Patch upload script over from rpp
3 years ago
Gabe Farrell
b07a675427
Add cleaned data upload script for Lowell
3 years ago
0a2c5e02c5
feat: add ability to merge disaggregation data with raw survey data to
...
produce a cleaned csv with merged income disaggregation columns
3 years ago
30285efd69
It's possible for admin data likert score values to be above 5. If that happens, we
...
cap the likert score at 5. This was happening already at the scraper
level but it's also now being done by the admin data loader for safety.
Also make sure to just update admin data instead of deleting and
reloading all values each load. Add tests to confirm this behavior
3 years ago
87ca23df79
Add subcategory report
3 years ago
4509c157fa
Add automated data cleaning. Modify SurveyItemValues class to use regex
...
instead of hard coded values. Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
3 years ago
5cf5a5f383
added tasks to find stray responses and skipped questions
3 years ago
fb963f63e0
Clean up rake tasks to get data:load_survey_responses working
3 years ago
128748addd
Update logic for calculating student response rate. Remove references
...
to survey table. We no longer check or keep track of the survey type.
Instead we look in the database to see if a survey item has at least 10
responses. If it does, that survey item was presented to the respondent
and we count it, and all responses when calculating the response rate.
Remove response rate timestamp from caching logic because we no longer
add the response rate to the database. All response rates are calculated
on the fly
Update three_b_two scraper to use teacher only numbers
swap over to using https://profiles.doe.mass.edu/statereport/gradesubjectstaffing.aspx as the source of staffing information
3 years ago
a93b79151c
update response load task for maynard
3 years ago
a656441fcd
Fix oneoff script for ECP so it doesn't skip non-lowell schools
3 years ago
d9ed53c846
also set response rate thresholds
3 years ago
rebuilt
Gabe Farrell
vineeshathallapaneni@gmail.com