5f66d3d99a
Fix: enable correct detection of student surveys types by rejecting any
...
headers ending with '-1' (the variants of standard questions)
3 years ago
0f23053294
It's possible for admin data likert score values to be above 5. If that happens, we
...
cap the likert score at 5. This was happening already at the scraper
level but it's also now being done by the admin data loader for safety.
Also make sure to just update admin data instead of deleting and
reloading all values each load. Add tests to confirm this behavior
3 years ago
c789c46032
Don't check standard deviation for early education surveys
3 years ago
e058c523b6
Missing progress or duration information does not result in a row removed in the cleaning process
3 years ago
a71ebbc4e4
Add Overall Response Rate
3 years ago
dbfc9d1d3a
Add automated data cleaning. Modify SurveyItemValues class to use regex
...
instead of hard coded values. Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
3 years ago
05bff3ee89
Memoize schools in SurveyItemValues and academic_years in AcademicYear
...
for performace improvement
3 years ago
282a671531
Change survey data loader spec to use factorybot objects instead of loading seeds. Change databasecleaner to use transaction. Add back babel-preset dependency to fix failing javascript test in production.
3 years ago
01851d8527
Make sure blank grades in csv load as nils instead of zeros
3 years ago
3a744db975
Start adding kindergarten
3 years ago
03c6bff7bb
Load survey responses from sftp folder
3 years ago
eeeb4f5d14
Add Stoklosa survey responses
3 years ago
d5533bb756
Support survey item variants. Survey item id's in the format s-sbel-q1-1 will load into s-sbel-q1
3 years ago
a1b7db9b2e
Add ability to load student demographic information for only lowell
3 years ago
rebuilt