948f19015c
feat: ECP-83 Clear cache after loading admin data
10 months ago
1c4cec3fed
chore: rename sftp environment variable
10 months ago
623dbe5e44
chore: add documentation to rake commands
10 months ago
534f42dfe0
feat: add esp counts when calculating teacher participation rates on overview page
11 months ago
0146b0f005
fix: order of deletion. Delete students after updating references to nil on survey item responses
1 year ago
e135048b66
chore: add script to delete student records incorrectly created by teacher responses
1 year ago
3659433fb5
feat: create a report at the survey item response level that shows averages by student to selected measures
1 year ago
ba9a23083d
chore: add example usage
1 year ago
c48b944280
chore: add usage example for report:survey_item:create
1 year ago
9c9346f455
chore: add ability to filter survey item report by student survey type
1 year ago
118938deeb
chore: add report for listing district level averages for measure scores
1 year ago
7142dca620
chore: print the n-size when printing nil grades
2 years ago
43ae016968
chore: increase limit to 10 percent when printing out nil grade values
2 years ago
7cf4cd821e
chore: generate report of high number of nil grades in responses
2 years ago
cf5c4f2d13
feat: add seasonal academic years
2 years ago
2561fa28fc
feat: Split academic year into seasons if the academic year's range is
...
initialized with a season, i.e. "2024-25 Fall". Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly. Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year. So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring". Add tests
for the new range format. Set the default cutoff for the start of Spring season will be the last Sunday in February
2 years ago
67ffc996a8
Revert "Split academic year into seasons if the academic year's range is"
...
This reverts commit a5d4cccb37
2 years ago
a5d4cccb37
Split academic year into seasons if the academic year's range is
...
initialized with a season, i.e. "2024-25 Fall". Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly. Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year. So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring". Add tests
for the new range format. Set the default cutoff for the start of Spring season will be the last Sunday in February
2 years ago
Gabe Farrell
6fac759ec2
Faster admin data loader + rename School.school_hash
2 years ago
Gabe Farrell
e3bbf1353b
Feat: Add item-level reporting by grade
2 years ago
Gabe Farrell
deb70d4b88
Memoize admin data loader
2 years ago
Gabe Farrell
deaae5cf65
Feat: Add task to generate item-level survey report
2 years ago
fc77eb0ee6
chore: create script for resetting respondents
2 years ago
b5e42498d2
feat: Add more measures to bll request
2 years ago
9fb32cc1f5
fix: remove duplicate measure ids from report
2 years ago
9f5ca007a1
fix: make sure averages for admin data scales are included in report
2 years ago
d90669b74d
feat: create beyond learning loss report
2 years ago
f27a590c5a
Convert gender and race text into qualtrics codes during cleaning. Abide by 'prefer not to disclose' for self reported race. Give priority to self reported data but use SIS information as backup
2 years ago
bb964943b7
Add task to delete 2023-24 data so enrollment data can be reseeded
2 years ago
019b954ffa
feat: load student responses in the same pass as loading the survey responses
...
chore: remove student loader since loading students is now done with the survey response loader
2 years ago
ece1f61aec
feat: add command for loading survey responses from arbitrary sftp directory
2 years ago
2fd56047d4
Add disaggregation by ELL
2 years ago
2ac30bb107
feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page
2 years ago
Gabe Farrell
7dec0be5af
Add seeding & scripts for Daley 2023-24
2 years ago
Gabe Farrell
0468dba3ba
Remove non-Lowell schools, remove data:seed_only_lowell & data:delete_non_lowell
2 years ago
bb5cfce09f
Remove precalculation of response rates. Add loading of student info to database
3 years ago
1aebc23721
chore: remove unneeded tasks
3 years ago
Gabe Farrell
0c7b5a6e06
Add cleaned data upload script for Lowell
3 years ago
9493007801
Also delete race scores when deleting non-lowell info
3 years ago
33e590607c
Remove outdated tasks
3 years ago
8df7a1ef28
Remove redundant tasks
3 years ago
42ab3aef57
Fix lowell seeder to create enrollment and staffing entries in database
3 years ago
0f23053294
It's possible for admin data likert score values to be above 5. If that happens, we
...
cap the likert score at 5. This was happening already at the scraper
level but it's also now being done by the admin data loader for safety.
Also make sure to just update admin data instead of deleting and
reloading all values each load. Add tests to confirm this behavior
3 years ago
08c946a469
Add subcategory report
3 years ago
4a9b95aad1
updated code by adding a task to find most skipped questions on regular survey questions
3 years ago
dbfc9d1d3a
Add automated data cleaning. Modify SurveyItemValues class to use regex
...
instead of hard coded values. Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
3 years ago
4bf61fb7b1
added tasks to find stray responses and skipped questions
3 years ago
56fb6abd2c
Don't seed surveys when seeding lowell info
3 years ago
aa3a67406b
Set a minimum threshold of 10 survey item responses to calculate scores per survey item
3 years ago
d888cdff3a
add oneoff for deleting invalid survey item responses
3 years ago
nelson
Gabe Farrell
vineeshathallapaneni@gmail.com