Commit graph

686 commits

Author SHA1 Message Date
rebuilt
abe7a8804c Don't check standard deviation for early education surveys 2023-06-02 16:05:45 -07:00
rebuilt
9aeb5f92af Missing progress or duration information does not result in a row removed in the cleaning process 2023-06-02 15:23:21 -07:00
rebuilt
e3ae12b425 update response_date to recorded_date 2023-05-31 16:57:47 -07:00
rebuilt
a30921ce06 Add New Jersey enrollment and staffing data 2023-05-28 17:11:52 -07:00
rebuilt
93d087a5de Use short district name for cleaned csv 2023-05-28 17:11:27 -07:00
rebuilt
8ef8cfce58 Adjust valid duration threshold of short form items 2023-05-26 18:30:44 -07:00
rebuilt
82659647bb add new hero. fix background placement 2023-05-26 11:29:53 -07:00
rebuilt
87ca23df79 Add subcategory report 2023-05-23 18:55:05 -07:00
rebuilt
2e3461b685 Add subcategory report 2023-05-22 16:36:12 -07:00
rebuilt
d6b2521883 Fix regression in student loader 2023-05-19 13:48:16 -07:00
rebuilt
4509c157fa Add automated data cleaning. Modify SurveyItemValues class to use regex
instead of hard coded values.  Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
2023-05-16 13:38:29 -07:00
rebuilt
72b35ff2e3 Add viewport and context meta tags 2023-05-15 15:09:09 -07:00
rebuilt
7855663b7e Add meta description to application template 2023-05-15 15:08:15 -07:00
rebuilt
24e7a9abca Add meta tag 2023-05-15 15:07:14 -07:00
rebuilt
a1743da910 Update about us section 2023-05-15 15:05:44 -07:00
rebuilt
dd94b283fa Remove hotjar 2023-05-15 14:55:12 -07:00
rebuilt
51d5d72730 Fix sizing of partial data indicators 2023-05-15 14:38:22 -07:00
rebuilt
1526bb2532 Set doctype to html5 2023-05-15 14:19:47 -07:00
rebuilt
d48a4efda2 Round all averages to two decimal places 2023-05-12 13:08:25 -07:00
rebuilt
3c30808a5e Fix response rates for small schools by accounting for expected minimum counts of responses less than 10 2023-05-12 12:27:00 -07:00
rebuilt
359e266a6c Remove unused TODOs 2023-04-27 15:47:45 -07:00
rebuilt
3f2a7dff50 Fix problem with dese scraper lumping in 2021-22 data as 2022-23 data.
Deleted unused csvs.  Turned off puts statements in admin loader.
Remove old, now unused admin data loader class.
2023-04-27 15:43:17 -07:00
rebuilt
ca31bd3217 cap response rate per grade at 100 2023-04-26 16:54:43 -07:00
rebuilt
4b7d2e6feb Only return files in sftp directory, not other directories 2023-04-26 15:55:10 -07:00
rebuilt
541f29108b Rename DataAvailability to Summary 2023-04-20 20:58:15 -07:00
rebuilt
596ce25737 Remove surveys table from codebase since it's no longer needed after changing logic surrounding response rates and score calculations 2023-04-20 20:51:04 -07:00
rebuilt
f68b650d8b Calculate response rate on the fly instead of looking it up from the db
when calculating response rates.
2023-04-20 20:27:01 -07:00
rebuilt
10cedd2310 Remove unused filename 2023-04-20 17:42:27 -07:00
rebuilt
5b2bae0d92 Fix ThreeATwo scraper 2023-04-19 19:20:54 -07:00
rebuilt
28f7d5647e Set a minimum threshold of 10 survey item responses to calculate scores per survey item 2023-04-18 14:05:09 -07:00
rebuilt
cfe97c6718 rename counts_by_grade method to the more descriptive enrollment_by_grade 2023-04-18 14:00:56 -07:00
rebuilt
128748addd Update logic for calculating student response rate. Remove references
to survey table.  We no longer check or keep track of the survey type.
Instead we look in the database to see if a survey item has at least 10
responses.  If it does, that survey item was presented to the respondent
and we count it, and all responses when calculating the response rate.

Remove response rate timestamp from caching logic because we no longer
add the response rate to the database. All response rates are calculated
on the fly

Update three_b_two scraper to use teacher only numbers

swap over to using https://profiles.doe.mass.edu/statereport/gradesubjectstaffing.aspx as the source of staffing information
2023-04-18 13:59:29 -07:00
rebuilt
0283f1d0d9 Revert "eliminate space between bottom content and red divider"
This reverts commit 59490faa71.
2023-04-04 17:18:23 -07:00
rebuilt
59490faa71 eliminate space between bottom content and red divider 2023-04-04 17:09:18 -07:00
rebuilt
2305e32f6d Make sure when checking for sufficient gender responses that we only check student survey items 2023-04-04 16:59:39 -07:00
rebuilt
e1c750b8d7 Revert "temporarily turn off caching based on the response rate timestamp"
This reverts commit 1c99f55528.
2023-04-04 13:07:14 -07:00
rebuilt
1c99f55528 temporarily turn off caching based on the response rate timestamp 2023-04-04 10:50:49 -07:00
rebuilt
bc6d2dcaf9 disable puts statement from calculator 2023-04-03 13:11:44 -07:00
rebuilt
b250ebe415 Memoize schools in SurveyItemValues and academic_years in AcademicYear
for performace improvement
2023-03-28 03:38:52 -07:00
rebuilt
c15cb7b483 Change survey data loader spec to use factorybot objects instead of loading seeds. Change databasecleaner to use transaction. Add back babel-preset dependency to fix failing javascript test in production. 2023-03-28 03:06:17 -07:00
rebuilt
dcade06ce2 Fix failing tests 2023-03-21 16:16:07 -07:00
rebuilt
308742f619 refactor authentication method 2023-03-21 13:37:50 -07:00
rebuilt
7d387dbe0e add authentication by district 2023-03-21 11:47:19 -07:00
rebuilt
db3e4f1178 Set config variable for SFTP_TO_GO server 2023-03-20 13:05:43 -07:00
rebuilt
e41a90bd9c Change title and add favicon 2023-03-20 12:54:06 -07:00
rebuilt
894cd81c7b Change page title to ECP 2023-03-20 12:52:45 -07:00
rebuilt
7fd98f302d Add favicon and apple-touch-icon 2023-03-20 12:52:25 -07:00
rebuilt
8a9d4d89fe Change HALS dashboard to ECP 2023-03-20 12:50:59 -07:00
rebuilt
bd5c2d6b27 Resize logo 2023-03-20 12:50:40 -07:00
rebuilt
c8ef3b11c9 file must exist so emptying the file to see if the app stops crashing 2023-03-18 13:49:44 -07:00