Nelson Jovel
934f2d7f30
fix: Correctly navigate the user to the latest academic year when no data exists for the school
2023-12-12 10:57:46 -08:00
Nelson Jovel
41d942c214
chore: Make sure 'hispanic' column only gets applied when using SIS race information
2023-12-12 10:53:07 -08:00
Nelson Jovel
2d6bbe0e5a
feat: add Hampden-Wilbraham schools
2023-12-12 10:29:08 -08:00
Nelson Jovel
24dbf33bcd
chore: remove unneeded comment
2023-12-11 15:55:00 -08:00
Nelson Jovel
f028e6c884
feat: if the filename includes the words 'form' or 'part' add that to the resulting cleaned filename
2023-12-11 15:39:20 -08:00
Nelson Jovel
d90a83e510
fix: instead of looking for 'asian' at the start of a word, look for it
...
after a word boundary. This means it still doesn't get confused with
caucasian and it's more flexible whan asian appears inside other text
such as 'Caucasian and Asian and Black'
2023-12-08 14:16:50 -08:00
Nelson Jovel
3f44613085
chore: various fixes for race and gender categorization during cleaning.
...
Also add tests for race and gender categorization
2023-12-08 13:12:19 -08:00
Nelson Jovel
242192e2f3
feat: add early ed survey items to the framework source of truth
2023-12-07 14:52:47 -08:00
Nelson Jovel
883731bce1
feat: Support SIS categories for race in the form of 'White and Asian'
...
or 'Black, Asian, and white'
2023-12-07 13:40:02 -08:00
Nelson Jovel
0931950eaf
chore: make sure to output race and gender columns during cleaning
2023-12-07 13:39:25 -08:00
Nelson Jovel
3db0f9f757
fix: Print out message to make clean when there are duplicate headers
...
present in the raw survey file
2023-12-07 12:28:24 -08:00
Nelson Jovel
6541b87e9c
feat: add 2023-24 academic year and make sure previous year enrollment
...
and staffing data get loaded when missing
2023-12-07 12:27:19 -08:00
Nelson Jovel
e203be056a
chore: refactor code so we use a hash instead of a switch statement for long-term performance
2023-12-06 15:00:33 -08:00
Nelson Jovel
1e43e288b1
Merge branch 'main' of github.com:edcommonwealth/sqm-dashboards
2023-12-06 14:19:50 -08:00
Nelson Jovel
f84ab5fb28
chore: turn off cypress tests in github actions
2023-12-06 14:15:29 -08:00
Nelson Jovel
b7e670bb60
Lower threshold for the number of valid student responses from 17 to 11
2023-12-06 14:15:19 -08:00
Nelson Jovel
7dc881f654
chore: refactor code to put logic into models
2023-12-06 14:14:56 -08:00
Nelson Jovel
6e05909423
chore: fix categorization of gender
2023-12-06 14:12:27 -08:00
Nelson Jovel
b3c5584aab
chore: turn off journey spec
2023-12-06 14:12:08 -08:00
Nelson Jovel
6776ec8e2c
chore: add prefer not to disclose to gender. Add code of 7 as an option for prefer to self describe
2023-12-06 14:10:29 -08:00
Nelson Jovel
e325f38c43
Convert gender and race text into qualtrics codes during cleaning. Abide by 'prefer not to disclose' for self reported race. Give priority to self reported data but use SIS information as backup
2023-12-06 14:10:16 -08:00
Nelson Jovel
305ddf2b1a
chore: add test for checking duplicate headers during cleaning process
2023-12-06 14:10:08 -08:00
Nelson Jovel
9efc1f41c6
chore: Add comment about StaffingLoader also cloning enrollment data when it clones staffing data
2023-12-06 14:09:54 -08:00
Nelson Jovel
10c052771d
Revert "chore: Add comment that notifies that cloning previous year staffing"
...
This reverts commit 95f8ada48d
2023-12-06 14:09:44 -08:00
Nelson Jovel
f677af826b
chore: Add comment that notifies that cloning previous year staffing
...
data will also copy over enrollment data
2023-12-06 14:09:33 -08:00
Nelson Jovel
f6f78bcd58
fix: make sure to grab the 'Gender- Qcode' column
2023-12-06 14:09:13 -08:00
rebuilt
24272d09a3
Merge pull request #2 from edcommonwealth/dependabot/npm_and_yarn/babel/traverse-7.23.4
...
chore(deps): bump @babel/traverse from 7.22.10 to 7.23.4
2023-11-28 15:40:38 -08:00
dependabot[bot]
62efd03f26
chore(deps): bump @babel/traverse from 7.22.10 to 7.23.4
...
Bumps [@babel/traverse](https://github.com/babel/babel/tree/HEAD/packages/babel-traverse ) from 7.22.10 to 7.23.4.
- [Release notes](https://github.com/babel/babel/releases )
- [Changelog](https://github.com/babel/babel/blob/main/CHANGELOG.md )
- [Commits](https://github.com/babel/babel/commits/v7.23.4/packages/babel-traverse )
---
updated-dependencies:
- dependency-name: "@babel/traverse"
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-11-28 23:39:40 +00:00
Nelson Jovel
8bebe7db42
chore: since it's now possible for there to be multiple district and dese id columns separated by a dash and a number, be more explicit when we only want to filter out survey item ids that end in a -1
2023-11-06 14:52:21 -08:00
Nelson Jovel
b63c327d33
chore: when searching for dese id, split up pattern so that to be more explicit about the order in which to search out the columns that might have the dese ID we're looking for.
2023-11-06 13:15:50 -08:00
rebuilt
cddea60c8b
feat: reduce number of rows to process at one time to reduce memory use
2023-11-02 12:21:32 -07:00
rebuilt
1a707eb6bc
feat: load student responses in the same pass as loading the survey responses
...
chore: remove student loader since loading students is now done with the survey response loader
2023-11-02 09:52:39 -07:00
rebuilt
2d90516f9f
feat: add command for loading survey responses from arbitrary sftp directory
2023-11-01 08:59:17 -07:00
rebuilt
e3fbbabce5
feat: We no longer trust the progress number that gets exported from qualtrics. Instead during the cleaning progress, perform a manual count of the number of responses to filter out rows that don't meet the minimum threshold.
2023-10-27 15:12:24 -07:00
rebuilt
d43020a6b0
chore: update to 7.1.1
2023-10-11 16:05:59 -07:00
rebuilt
8baaa67730
fix: make sure sped is taken into account when caching analyze page
2023-10-11 11:15:13 -07:00
rebuilt
83661540b7
chore: upgrade to rails 7.1.
...
upgrade rspec
fix failing tests
upgrade devise
2023-10-11 10:58:52 -07:00
rebuilt
85f984999d
chore: update ruby version
2023-10-06 12:13:13 -07:00
rebuilt
48e795fcfb
feat: add special education disaggregation
2023-10-06 11:41:52 -07:00
rebuilt
c582126d2a
chore: upgrade cypress to address security vulnerability
2023-10-02 11:19:25 -07:00
rebuilt
c2127a2458
chore: address security vulnerabilities
2023-10-02 11:13:36 -07:00
rebuilt
060d7aa55a
Add disaggregation by ELL
2023-09-29 19:29:23 -07:00
rebuilt
8d33095a48
fix: fix crash when viewing income graph on analyze page
2023-08-31 10:43:54 -07:00
rebuilt
aaa43cdd64
fix: I broke the feature where the site would automatically navigate the user to the latest year that had sufficient data when I made response rates calculate on each page load instead of being precalculated and stored in the database. Instead of a database lookup for response rates that meet the sufficiency threshold, I caculate the latest year when a user chooses a school from the welcome page.
2023-08-28 13:46:23 -07:00
rebuilt
abea2cb8fa
feat: support multiple columns for race and gender information
2023-08-25 15:37:20 -07:00
rebuilt
463e4c9452
fix: hide scores on analyze page for scores that don't meet the student threshold of 25%
2023-08-23 15:56:46 -07:00
rebuilt
714b90b3eb
fix: ensure cleaner outputs columns for all survey items. Before the fix, if a survey item varient (ending in -1, ie s-tint-q1-1) did not have a matching survey item s-tint-q1, the resulting csv would not include that column
2023-08-23 15:30:47 -07:00
rebuilt
2321897283
fix: start fixing problem with variants not getting added to the cleaned csv
2023-08-23 15:30:47 -07:00
rebuilt
4e33c8e173
chore: remove unused tasks
2023-08-17 08:44:27 -07:00
rebuilt
315b398a5a
fix: Overall response rate was incorrectly using the updated_at date instead of the recorded date. Also, it was just using the last date for all academic years instead of the last date the survey was taken per academic year.
2023-08-17 07:05:15 -07:00
