 Gabe Farrell
|
9b0cc1527f
|
candidate ~1.1s
|
2 years ago |
|
Gabe Farrell
|
f6c6d26a2c
|
wip 3:14
|
2 years ago |
|
Gabe Farrell
|
c146f23bd4
|
wip 3:14.12
|
2 years ago |
Nelson Jovel
|
2cb43058a0
|
fix: loosen restrictions on date format
|
2 years ago |
|
Nelson Jovel
|
289b04bc69
|
match an additional format for Dates. Supported dates are now '1/10/2022 14:21:45' '2022-1-10T14:21:45' '2022-1-10 14:21:45'
|
2 years ago |
|
Nelson Jovel
|
d6735d449d
|
feat: Support two date formats: ISO 8601 and the standard US date format
used in google sheets
|
2 years ago |
|
Nelson Jovel
|
03349b0ed5
|
chore: support alternate format for recorded date
|
2 years ago |
|
Nelson Jovel
|
37610e732f
|
chore: alphabetize districts when writing filename for cleaned files
|
2 years ago |
|
Nelson Jovel
|
0a32fb50ff
|
fix: no longer support 'form' in filename when cleaning. Only look for 'part X' and add that to the filename if it exists
|
2 years ago |
|
Nelson Jovel
|
ebf4ca4166
|
chore: move code that normalizes race data to the Race class
|
2 years ago |
|
Nelson Jovel
|
56b512810c
|
chore: remove lowell seeding rules
|
2 years ago |
|
Nelson Jovel
|
880b438eb4
|
chore: reenable test spec that tests data loader for races
|
2 years ago |
|
Nelson Jovel
|
36e21515c3
|
chore: refactor Race out of survey_item_values
|
2 years ago |
|
Nelson Jovel
|
e7fb009425
|
chore: refactor Gender out out of survey_item_values row
|
2 years ago |
|
Nelson Jovel
|
ea079e927b
|
chore: rename counts_by_grade to enrollment_by_grade for clarity
|
2 years ago |
|
Nelson Jovel
|
41d942c214
|
chore: Make sure 'hispanic' column only gets applied when using SIS race information
|
2 years ago |
|
Nelson Jovel
|
24dbf33bcd
|
chore: remove unneeded comment
|
2 years ago |
|
Nelson Jovel
|
f028e6c884
|
feat: if the filename includes the words 'form' or 'part' add that to the resulting cleaned filename
|
2 years ago |
|
Nelson Jovel
|
3f44613085
|
chore: various fixes for race and gender categorization during cleaning.
Also add tests for race and gender categorization
|
2 years ago |
|
Nelson Jovel
|
883731bce1
|
feat: Support SIS categories for race in the form of 'White and Asian'
or 'Black, Asian, and white'
|
2 years ago |
|
Nelson Jovel
|
0931950eaf
|
chore: make sure to output race and gender columns during cleaning
|
2 years ago |
|
Nelson Jovel
|
3db0f9f757
|
fix: Print out message to make clean when there are duplicate headers
present in the raw survey file
|
2 years ago |
|
Nelson Jovel
|
6541b87e9c
|
feat: add 2023-24 academic year and make sure previous year enrollment
and staffing data get loaded when missing
|
2 years ago |
|
Nelson Jovel
|
b7e670bb60
|
Lower threshold for the number of valid student responses from 17 to 11
|
2 years ago |
|
Nelson Jovel
|
7dc881f654
|
chore: refactor code to put logic into models
|
2 years ago |
|
Nelson Jovel
|
e325f38c43
|
Convert gender and race text into qualtrics codes during cleaning. Abide by 'prefer not to disclose' for self reported race. Give priority to self reported data but use SIS information as backup
|
2 years ago |
|
Nelson Jovel
|
9efc1f41c6
|
chore: Add comment about StaffingLoader also cloning enrollment data when it clones staffing data
|
2 years ago |
|
Nelson Jovel
|
f6f78bcd58
|
fix: make sure to grab the 'Gender- Qcode' column
|
2 years ago |
|
Nelson Jovel
|
8bebe7db42
|
chore: since it's now possible for there to be multiple district and dese id columns separated by a dash and a number, be more explicit when we only want to filter out survey item ids that end in a -1
|
2 years ago |
|
Nelson Jovel
|
b63c327d33
|
chore: when searching for dese id, split up pattern so that to be more explicit about the order in which to search out the columns that might have the dese ID we're looking for.
|
2 years ago |
|
rebuilt
|
cddea60c8b
|
feat: reduce number of rows to process at one time to reduce memory use
|
2 years ago |
|
rebuilt
|
1a707eb6bc
|
feat: load student responses in the same pass as loading the survey responses
chore: remove student loader since loading students is now done with the survey response loader
|
2 years ago |
|
rebuilt
|
e3fbbabce5
|
feat: We no longer trust the progress number that gets exported from qualtrics. Instead during the cleaning progress, perform a manual count of the number of responses to filter out rows that don't meet the minimum threshold.
|
2 years ago |
|
rebuilt
|
83661540b7
|
chore: upgrade to rails 7.1.
upgrade rspec
fix failing tests
upgrade devise
|
2 years ago |
|
rebuilt
|
48e795fcfb
|
feat: add special education disaggregation
|
2 years ago |
|
rebuilt
|
060d7aa55a
|
Add disaggregation by ELL
|
2 years ago |
|
rebuilt
|
abea2cb8fa
|
feat: support multiple columns for race and gender information
|
2 years ago |
|
rebuilt
|
463e4c9452
|
fix: hide scores on analyze page for scores that don't meet the student threshold of 25%
|
2 years ago |
|
rebuilt
|
714b90b3eb
|
fix: ensure cleaner outputs columns for all survey items. Before the fix, if a survey item varient (ending in -1, ie s-tint-q1-1) did not have a matching survey item s-tint-q1, the resulting csv would not include that column
|
2 years ago |
|
rebuilt
|
2321897283
|
fix: start fixing problem with variants not getting added to the cleaned csv
|
2 years ago |
|
rebuilt
|
a785c69c44
|
Add Overall Response Rate
|
2 years ago |
|
rebuilt
|
4afa030141
|
chore: remove precalculated race scores. Calculate race scores on every reload
|
2 years ago |
|
rebuilt
|
f035c4d9ad
|
fix: Filter out responses that don't correspond to the grades the school serves
|
2 years ago |
|
rebuilt
|
5f49746bf4
|
feat: Rename income labels to 'Economically Disadvantaged' and 'Not Economically Disadvantaged'
|
2 years ago |
|
rebuilt
|
67e469a66c
|
feat: add popover to analyze graphs that displays the n-size of the different columns. Make sure to only calculate a score for a race if there are more than 10 respondents to a question.
|
2 years ago |
|
rebuilt
|
cec48e55d3
|
chore: remove outdated admin data loader file. We now use Dese::Loader to load school level data
|
2 years ago |
|
rebuilt
|
5c7729beeb
|
feat: if admin data value is above 5, round down to 5
|
2 years ago |
|
rebuilt
|
cbd5687ff0
|
feat: Add out of state admin data
|
2 years ago |
|
rebuilt
|
4f035f6a63
|
feat: Add income table to the database. Add seeder for income. Add a reference to income from survey item response. Update the loader to import income data from the survey response csv. Refactor analyze controller to extract presenter. Add corresponding specs. Add income graph to analyze page
|
2 years ago |
|
rebuilt
|
d72f8d31e0
|
fix: There was an n+1 problem where we looked up the list of schools for
every row. Now we query the list of schools just once per file
|
2 years ago |
