Commit graph

1472 commits

Author SHA1 Message Date
Nelson Jovel
e7fb009425 chore: refactor Gender out out of survey_item_values row 2023-12-20 11:08:23 -08:00
Nelson Jovel
8a3c6d9821 chore: fix binstubs 2023-12-19 15:56:38 -08:00
Nelson Jovel
f9717f80c7 chore: remove todo 2023-12-19 15:51:13 -08:00
Nelson Jovel
8bb97c8f2f chore: slight improvement to test execution time by disabling all but the most fatal of logging 2023-12-19 15:22:59 -08:00
Nelson Jovel
a3ab83fb56 chore: remove cypress 2023-12-19 14:05:13 -08:00
Nelson Jovel
031034edad fix: binstubs 2023-12-19 13:49:20 -08:00
Nelson Jovel
ebc037c65d chore: update gem versions 2023-12-19 13:03:21 -08:00
Nelson Jovel
593a597bac chore: install binstubs 2023-12-19 13:03:04 -08:00
Nelson Jovel
5df890923f feat: don't show collection date of response rate if there is no survey data 2023-12-18 15:16:56 -08:00
Nelson Jovel
ea079e927b chore: rename counts_by_grade to enrollment_by_grade for clarity 2023-12-18 15:01:33 -08:00
Nelson Jovel
a75373f6f2 feat: don't double count early ed students who are taking survey in parts 2023-12-18 14:57:15 -08:00
Nelson Jovel
ac1a3ab3e5 chore: update devise 2023-12-12 15:14:23 -08:00
Nelson Jovel
934f2d7f30 fix: Correctly navigate the user to the latest academic year when no data exists for the school 2023-12-12 10:57:46 -08:00
Nelson Jovel
41d942c214 chore: Make sure 'hispanic' column only gets applied when using SIS race information 2023-12-12 10:53:07 -08:00
Nelson Jovel
2d6bbe0e5a feat: add Hampden-Wilbraham schools 2023-12-12 10:29:08 -08:00
Nelson Jovel
24dbf33bcd chore: remove unneeded comment 2023-12-11 15:55:00 -08:00
Nelson Jovel
f028e6c884 feat: if the filename includes the words 'form' or 'part' add that to the resulting cleaned filename 2023-12-11 15:39:20 -08:00
Nelson Jovel
d90a83e510 fix: instead of looking for 'asian' at the start of a word, look for it
after a word boundary.  This means it still doesn't get confused with
caucasian and it's more flexible whan asian appears inside other text
such as 'Caucasian and Asian and Black'
2023-12-08 14:16:50 -08:00
Nelson Jovel
3f44613085 chore: various fixes for race and gender categorization during cleaning.
Also add tests for race and gender categorization
2023-12-08 13:12:19 -08:00
Nelson Jovel
242192e2f3 feat: add early ed survey items to the framework source of truth 2023-12-07 14:52:47 -08:00
Nelson Jovel
883731bce1 feat: Support SIS categories for race in the form of 'White and Asian'
or 'Black, Asian, and white'
2023-12-07 13:40:02 -08:00
Nelson Jovel
0931950eaf chore: make sure to output race and gender columns during cleaning 2023-12-07 13:39:25 -08:00
Nelson Jovel
3db0f9f757 fix: Print out message to make clean when there are duplicate headers
present in the raw survey file
2023-12-07 12:28:24 -08:00
Nelson Jovel
6541b87e9c feat: add 2023-24 academic year and make sure previous year enrollment
and staffing data get loaded when missing
2023-12-07 12:27:19 -08:00
Nelson Jovel
e203be056a chore: refactor code so we use a hash instead of a switch statement for long-term performance 2023-12-06 15:00:33 -08:00
Nelson Jovel
1e43e288b1 Merge branch 'main' of github.com:edcommonwealth/sqm-dashboards 2023-12-06 14:19:50 -08:00
Nelson Jovel
f84ab5fb28 chore: turn off cypress tests in github actions 2023-12-06 14:15:29 -08:00
Nelson Jovel
b7e670bb60 Lower threshold for the number of valid student responses from 17 to 11 2023-12-06 14:15:19 -08:00
Nelson Jovel
7dc881f654 chore: refactor code to put logic into models 2023-12-06 14:14:56 -08:00
Nelson Jovel
6e05909423 chore: fix categorization of gender 2023-12-06 14:12:27 -08:00
Nelson Jovel
b3c5584aab chore: turn off journey spec 2023-12-06 14:12:08 -08:00
Nelson Jovel
6776ec8e2c chore: add prefer not to disclose to gender. Add code of 7 as an option for prefer to self describe 2023-12-06 14:10:29 -08:00
Nelson Jovel
e325f38c43 Convert gender and race text into qualtrics codes during cleaning. Abide by 'prefer not to disclose' for self reported race. Give priority to self reported data but use SIS information as backup 2023-12-06 14:10:16 -08:00
Nelson Jovel
305ddf2b1a chore: add test for checking duplicate headers during cleaning process 2023-12-06 14:10:08 -08:00
Nelson Jovel
9efc1f41c6 chore: Add comment about StaffingLoader also cloning enrollment data when it clones staffing data 2023-12-06 14:09:54 -08:00
Nelson Jovel
10c052771d Revert "chore: Add comment that notifies that cloning previous year staffing"
This reverts commit 95f8ada48d.
2023-12-06 14:09:44 -08:00
Nelson Jovel
f677af826b chore: Add comment that notifies that cloning previous year staffing
data will also copy over enrollment data
2023-12-06 14:09:33 -08:00
Nelson Jovel
f6f78bcd58 fix: make sure to grab the 'Gender- Qcode' column 2023-12-06 14:09:13 -08:00
rebuilt
24272d09a3
Merge pull request #2 from edcommonwealth/dependabot/npm_and_yarn/babel/traverse-7.23.4
chore(deps): bump @babel/traverse from 7.22.10 to 7.23.4
2023-11-28 15:40:38 -08:00
dependabot[bot]
62efd03f26
chore(deps): bump @babel/traverse from 7.22.10 to 7.23.4
Bumps [@babel/traverse](https://github.com/babel/babel/tree/HEAD/packages/babel-traverse) from 7.22.10 to 7.23.4.
- [Release notes](https://github.com/babel/babel/releases)
- [Changelog](https://github.com/babel/babel/blob/main/CHANGELOG.md)
- [Commits](https://github.com/babel/babel/commits/v7.23.4/packages/babel-traverse)

---
updated-dependencies:
- dependency-name: "@babel/traverse"
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-28 23:39:40 +00:00
Nelson Jovel
8bebe7db42 chore: since it's now possible for there to be multiple district and dese id columns separated by a dash and a number, be more explicit when we only want to filter out survey item ids that end in a -1 2023-11-06 14:52:21 -08:00
Nelson Jovel
b63c327d33 chore: when searching for dese id, split up pattern so that to be more explicit about the order in which to search out the columns that might have the dese ID we're looking for. 2023-11-06 13:15:50 -08:00
rebuilt
cddea60c8b feat: reduce number of rows to process at one time to reduce memory use 2023-11-02 12:21:32 -07:00
rebuilt
1a707eb6bc feat: load student responses in the same pass as loading the survey responses
chore: remove student loader since loading students is now done with the survey response loader
2023-11-02 09:52:39 -07:00
rebuilt
2d90516f9f feat: add command for loading survey responses from arbitrary sftp directory 2023-11-01 08:59:17 -07:00
rebuilt
e3fbbabce5 feat: We no longer trust the progress number that gets exported from qualtrics. Instead during the cleaning progress, perform a manual count of the number of responses to filter out rows that don't meet the minimum threshold. 2023-10-27 15:12:24 -07:00
rebuilt
d43020a6b0 chore: update to 7.1.1 2023-10-11 16:05:59 -07:00
rebuilt
8baaa67730 fix: make sure sped is taken into account when caching analyze page 2023-10-11 11:15:13 -07:00
rebuilt
83661540b7 chore: upgrade to rails 7.1.
upgrade rspec

fix failing tests

upgrade devise
2023-10-11 10:58:52 -07:00
rebuilt
85f984999d chore: update ruby version 2023-10-06 12:13:13 -07:00