gabehf/sqm-dashboards
1
0
Fork 0
mirror of https://github.com/edcommonwealth/sqm-dashboards.git synced 2026-03-08 23:18:18 -07:00
Code Issues Projects Releases Packages Wiki Activity Actions
935 commits 6 branches 0 tags 81 MiB
Commit graph

935 commits

This branch
This branch
All branches
Author SHA1 Message Date
rebuilt
097edb1744 update ship it to use 'yarn jest' instead of 'yarn test' so javascript test will run correctly 2023-05-01 10:32:29 -07:00
rebuilt
a066f464c7 fix failing tests 2023-04-30 16:35:08 -07:00
rebuilt
a21a11f809 specify gender column 2023-04-30 12:19:31 -07:00
rebuilt
80431e7660 Add most recent admin data 2023-04-30 12:04:36 -07:00
rebuilt
f1022728fa Fix problem with dese scraper lumping in 2021-22 data as 2022-23 data. 
Deleted unused csvs.  Turned off puts statements in admin loader.
Remove old, now unused admin data loader class.
 2023-04-30 12:04:20 -07:00
rebuilt
c42b569e78 cap response rate per grade at 100 2023-04-30 11:59:22 -07:00
rebuilt
798ba1f340 Only return files in sftp directory, not other directories 2023-04-30 11:55:45 -07:00
rebuilt
03efd88284 Do not create response rate entries in the database when loading survey item responses 2023-04-25 17:16:44 -07:00
rebuilt
0ed6cbe6b4 Rename DataAvailability to Summary 2023-04-22 14:24:39 -07:00
rebuilt
09963c3323 Remove surveys table from codebase since it's no longer needed after changing logic surrounding response rates and score calculations 2023-04-22 14:21:48 -07:00
rebuilt
001d3083c8 Calculate response rate on the fly instead of looking it up from the db 
when calculating response rates.
 2023-04-22 14:03:22 -07:00
rebuilt
7f9b96fdb3 Add updated admin data 2023-04-22 14:03:00 -07:00
rebuilt
cee7aa4c59 Remove unused filename 2023-04-22 14:01:21 -07:00
rebuilt
1f8aea31de Add older admin data file archive 2023-04-22 14:01:10 -07:00
rebuilt
d3a28f7635 Fix ThreeATwo scraper 2023-04-22 14:01:01 -07:00
rebuilt
30e006ee0d Set a minimum threshold of 10 survey item responses to calculate scores per survey item 2023-04-22 14:00:51 -07:00
rebuilt
982f216c6c rename counts_by_grade method to the more descriptive enrollment_by_grade 2023-04-22 14:00:40 -07:00
rebuilt
07ed8dd259 Update logic for calculating student response rate. Remove references 
to survey table.  We no longer check or keep track of the survey type.
Instead we look in the database to see if a survey item has at least 10
responses.  If it does, that survey item was presented to the respondent
and we count it, and all responses when calculating the response rate.

Remove response rate timestamp from caching logic because we no longer
add the response rate to the database. All response rates are calculated
on the fly

Update three_b_two scraper to use teacher only numbers

swap over to using https://profiles.doe.mass.edu/statereport/gradesubjectstaffing.aspx as the source of staffing information
 2023-04-22 14:00:20 -07:00
rebuilt
0bfde2805a temporarily turn off caching based on the response rate timestamp 2023-04-22 13:28:09 -07:00
rebuilt
63f453d258 Update seeder to use ActiveRecord imports 2023-04-22 13:20:26 -07:00
rebuilt
357c7427d1 Batch imports for staffing data 2023-04-22 13:19:34 -07:00
rebuilt
d272e48adc load total students and batch importing records 2023-04-22 13:18:50 -07:00
Nelson Jovel
98ba54c305 Convert dese::loader from using seeder to factories 2023-04-22 13:15:13 -07:00
Nelson Jovel
9228e3dbaf convert student loader from seeding to factories 2023-04-22 13:15:01 -07:00
rebuilt
049ae4548f Don't add another response rate record to the database. Just calculate on the fly. Otherwise we can run into a situation where we create two response rates for a given school/academic_year/subcategory 2023-04-08 14:49:21 -07:00
rebuilt
283845edd3 Add tests to make sure teacher survey items don't pollute the graphs for 
students of unknown genders
 2023-04-05 16:21:41 -07:00
rebuilt
7208cbb661 Add tests to make sure teacher survey items don't pollute the graphs for 
students of unknown genders
 2023-04-05 15:45:54 -07:00
rebuilt
63b1615bef Make sure when checking for sufficient gender responses that we only check student survey items 2023-04-04 17:03:45 -07:00
rebuilt
098110433a Remove duplicate line 2023-03-23 19:57:36 -07:00
rebuilt
5f58a5516e print the number of student and teacher respondents 2023-03-23 17:29:02 -07:00
rebuilt
f7818fc9f6 make sure test database is cleaned before and after every test 2023-03-23 15:55:07 -07:00
rebuilt
9749cd1abb Remove standard from gemfile 2023-03-23 13:05:09 -07:00
rebuilt
de478b7761 update reline 2023-03-17 19:06:26 -07:00
rebuilt
1290e52626 Correct branch name for ci 2023-03-17 19:02:28 -07:00
rebuilt
1b987f245b Run ci when mciea-main code is pushed to github 2023-03-17 19:01:14 -07:00
rebuilt
36ea63332b Add 2022-23 survey results 2023-03-17 18:55:35 -07:00
rebuilt
ad6561444a Update ruby version 2023-03-10 16:14:54 -08:00
rebuilt
95e105e20b Merge branch 'mciea-sftp-and-memory-fix' into mciea-main 2023-02-21 14:29:33 -08:00
rebuilt
8fb3019050 Patch security vulnerabilities 2023-02-21 14:28:28 -08:00
rebuilt
549d0eaa22 Add script to load 2016-18 data 2023-02-19 19:36:14 -08:00
rebuilt
6d770938ef Swap survey data loading from local files to SFTP 2023-02-19 19:36:14 -08:00
rebuilt
14570b3c33 update tasks so that data gets loaded from sftp. Add task to delete 2016-17, and 2017-18 data 2023-02-19 19:36:14 -08:00
rebuilt
cf2b2433e9 Use an sftp uri unique to MCIEA 2023-02-19 19:36:14 -08:00
rebuilt
a5da0fb0c6 Fix bug with not all survey responses loading when using sftp loader 2023-02-19 19:36:14 -08:00
rebuilt
ef087a6cd0 update default folder for survey responses 2023-02-19 19:36:14 -08:00
rebuilt
47c1856281 Process 1000 rows at a time to limit memory usage in production 2023-02-19 19:36:14 -08:00
rebuilt
640de1c8df Don't print sftptogo_url 2023-02-19 19:36:14 -08:00
rebuilt
380048f5cd Load survey responses from sftp folder 2023-02-19 19:36:14 -08:00
rebuilt
6f986ff8a1 add proof of concept sftp downloader 2023-02-19 19:36:05 -08:00
rebuilt
f423bc734c Add script to load 2016-18 data 2023-02-19 19:33:04 -08:00