Nelson Jovel
c6c9fd38de
fix: batch in smaller size to stay within memory limits
2024-02-23 10:34:18 -08:00
Nelson Jovel
f62854117f
fix: support alternate format for active admin data items. Support both 'True/False' and '1/0'
2024-02-23 08:58:46 -08:00
Nelson Jovel
e97e7047b1
fix: no longer support 'form' in filename when cleaning. Only look for 'part X' and add that to the filename if it exists
2024-02-22 12:04:36 -08:00
Nelson Jovel
e2ba084e5b
fix: Support true/false column values when categorizing income status. True is categorized as Economically Disadvantaged. False is categorized as Not Economically Disadvantaged
2024-02-20 21:27:29 -08:00
Nelson Jovel
06cb494f45
fix: change the default to not an english language learner. Blank columns are treated as Not ELL. Only mark student as an english language learner if it's marked as such. Columns marked with 'NA' are treated as unknown
2024-02-20 21:27:21 -08:00
Nelson Jovel
e1fc5dbbaa
feat: add 2023-24 academic year and make sure previous year enrollment
...
and staffing data get loaded when missing
2024-02-20 21:06:55 -08:00
Nelson Jovel
c6960c957d
chore: rename admin data to school data on analyze page
2024-01-31 14:25:59 -08:00
Nelson Jovel
5fc5c21bcb
feat: change 'school admin data' to 'school data'
2024-01-31 11:04:00 -08:00
Nelson Jovel
2e0cc3a4d8
fix: make sure response rate gets rounded to nearest integer
2024-01-12 14:18:39 -08:00
Nelson Jovel
edbb84334a
perf: reduce number of calls for student and teacher survey items in response rate calculators
2024-01-12 13:55:14 -08:00
Nelson Jovel
ec5c1bd1ef
fix: correct a problem where survey items with insufficient responses were contributing to the response rate calculation
2024-01-12 13:54:59 -08:00
Nelson Jovel
cf9dd9042d
perf: reduce time spent in sql query for student response rate
2024-01-12 13:54:00 -08:00
Nelson Jovel
b70755aef1
chore: refactor teacher response rate
2024-01-12 13:53:51 -08:00
Nelson Jovel
45ea735fa5
perf: reduce number of queries for teacher survey_items
2024-01-12 13:53:41 -08:00
Nelson Jovel
3718d74e62
perf: reduce number of queries for respondents
2024-01-12 13:53:33 -08:00
Nelson Jovel
277e36429a
perf: reduce number of queries by requesting grouped_responses once instead of for each measure
2024-01-12 13:52:41 -08:00
Nelson Jovel
5b34c2257f
chore: performance fixes for response rate calculation
2024-01-12 13:51:59 -08:00
Nelson Jovel
47cca3ce1f
fix: reduce number of n+1 queries
2024-01-12 13:51:14 -08:00
Nelson Jovel
2dd73f003c
chore: remove method that wasn't needed
2024-01-12 13:49:11 -08:00
Nelson Jovel
a960202d66
chore: performance fixes for response rate calculation
2024-01-12 13:49:02 -08:00
Nelson Jovel
9e368ae47d
chore: prevent multiple lookups for the boston district by inlining the
...
sql
2024-01-12 13:48:51 -08:00
Nelson Jovel
db7c74479d
chore: memoize grades for school
2024-01-12 13:48:08 -08:00
Nelson Jovel
d2efec1574
fix: reduce number of n+1 queries
2023-12-21 13:35:48 -08:00
Nelson Jovel
2a125aa058
chore: bring in some refactoring changes that didn't get copied over from the main branch
2023-12-20 19:27:06 -08:00
Nelson Jovel
75451648e5
chore: move code that normalizes race data to the Race class
2023-12-20 19:07:52 -08:00
Nelson Jovel
e7f06ef4e9
chore: remove lowell seeding rules
2023-12-20 14:08:38 -08:00
Nelson Jovel
bbefdcb5bb
chore: remove student loader since we load race information in data loader
2023-12-20 13:47:09 -08:00
Nelson Jovel
063810a9d7
chore: make sure to load races in data loader instead of student loader
2023-12-20 13:39:03 -08:00
Nelson Jovel
381625f58b
chore: reenable test spec that tests data loader for races
2023-12-20 12:40:22 -08:00
Nelson Jovel
317fe3239a
chore: refactor Race out of survey_item_values
2023-12-20 12:35:14 -08:00
Nelson Jovel
a295b8afb9
chore: refactor Gender out out of survey_item_values row
2023-12-20 12:33:18 -08:00
Nelson Jovel
5514fef62c
feat: don't show collection date of response rate if there is no survey data
2023-12-18 15:59:45 -08:00
Nelson Jovel
0359dae88a
chore: rename counts_by_grade to enrollment_by_grade for clarity
2023-12-18 15:59:30 -08:00
Nelson Jovel
1d0bac126b
feat: don't double count early ed students who are taking survey in parts
2023-12-18 15:59:19 -08:00
Nelson Jovel
32b05487a1
fix: Correctly navigate the user to the latest academic year when no data exists for the school
2023-12-18 15:59:08 -08:00
Nelson Jovel
ee5e53f992
chore: Make sure 'hispanic' column only gets applied when using SIS race information
2023-12-18 15:58:54 -08:00
Nelson Jovel
6f265302ea
feat: if the filename includes the words 'form' or 'part' add that to the resulting cleaned filename
2023-12-18 15:58:40 -08:00
Nelson Jovel
d79635054c
fix: instead of looking for 'asian' at the start of a word, look for it
...
after a word boundary. This means it still doesn't get confused with
caucasian and it's more flexible whan asian appears inside other text
such as 'Caucasian and Asian and Black'
2023-12-18 15:44:51 -08:00
Nelson Jovel
fe039e3d04
chore: various fixes for race and gender categorization during cleaning.
...
Also add tests for race and gender categorization
2023-12-18 15:38:31 -08:00
Nelson Jovel
054e5603b7
chore: fix failing legacy tests
2023-11-03 10:18:46 -07:00
rebuilt
a07728fcd6
feat: We no longer trust the progress number that gets exported from qualtrics. Instead during the cleaning progress, perform a manual count of the number of responses to filter out rows that don't meet the minimum threshold.
2023-10-27 15:13:17 -07:00
rebuilt
4419aea1da
fix: make sure sped is taken into account when caching analyze page
2023-10-17 12:34:26 -07:00
rebuilt
9d680c5159
chore: upgrade to rails 7.1.
...
upgrade rspec
fix failing tests
upgrade devise
2023-10-17 12:34:11 -07:00
rebuilt
acfdaf5587
feat: add special education disaggregation
2023-10-17 12:29:00 -07:00
rebuilt
5bdffec8f9
Add disaggregation by ELL
2023-10-17 12:06:19 -07:00
rebuilt
245cde85cd
Add disaggregation by ELL
2023-10-17 11:18:47 -07:00
rebuilt
bcfb52c97a
fix: I broke the feature where the site would automatically navigate the user to the latest year that had sufficient data when I made response rates calculate on each page load instead of being precalculated and stored in the database. Instead of a database lookup for response rates that meet the sufficiency threshold, I caculate the latest year when a user chooses a school from the welcome page.
2023-08-28 13:46:50 -07:00
rebuilt
5ea01ac916
Reorder gender columns
2023-08-22 12:22:51 -07:00
rebuilt
2a8148b8cd
fix: hide scores on analyze page for scores that don't meet the student threshold of 25%
2023-08-22 12:18:18 -07:00
rebuilt
aafaeeaf41
fix: Overall response rate was incorrectly using the updated_at date instead of the recorded date. Also, it was just using the last date for all academic years instead of the last date the survey was taken per academic year.
2023-08-15 16:13:47 -07:00
