Commit graph

1242 commits

Author SHA1 Message Date
rebuilt
f6e4fd1ba9 docs: add contributing doc 2023-06-10 11:39:56 -07:00
rebuilt
d306319de1 perf: memoize function when calculating response rates 2023-06-10 11:39:46 -07:00
rebuilt
452876ef09 perf: Add another index to surveyitemresponses. Implement bullet suggestions. Memoize a function in measure.rb 2023-06-10 10:30:29 -07:00
rebuilt
eee0cb14a3 Fix: failing subcategory report specs 2023-06-09 21:26:10 -07:00
rebuilt
1aaed0682e Modify subcategory report to be threaded 2023-06-09 21:26:00 -07:00
rebuilt
aab4e78a71 Add District, School Code, and Grade columns to subcategory report 2023-06-09 15:30:57 -07:00
rebuilt
5e9cc02024 Revert "Add tests to codify behavior of weighted average logic"
This reverts commit 0ab8e88072.
2023-06-08 15:26:50 -07:00
rebuilt
0ab8e88072 Add tests to codify behavior of weighted average logic 2023-06-08 15:25:27 -07:00
rebuilt
e2d24a9bec Fix: make sure values don't get reordered after copying over row values from survey item variants. This fixes a problem where cleaner would produce a row with likert scores that got shifted to align with the wrong column 2023-06-08 09:26:56 -07:00
rebuilt
c2503541ff Fix: Ensure proper detection of survey type. Make sure to remove any survey item ids that end with the survey variant style of '-1' 2023-06-07 12:39:09 -07:00
rebuilt
ddf9a628d5 Fix: enable correct detection of student surveys types by rejecting any
headers ending with '-1' (the variants of standard questions)
2023-06-07 12:38:58 -07:00
rebuilt
896f0d9961 Don't write a file if there's an empty dataset 2023-06-07 12:38:44 -07:00
rebuilt
d4f4b899f0 Scrape new admin data values 2023-06-06 18:25:18 -07:00
rebuilt
76b79b99c2 Fix: Parse headers when they are surrounded by quotes. This helps load recent csv files correctly 2023-06-06 18:18:52 -07:00
rebuilt
b57489a7b0 Scrape new admin data values 2023-06-03 17:14:56 -07:00
rebuilt
30285efd69 It's possible for admin data likert score values to be above 5. If that happens, we
cap the likert score at 5.   This was happening already at the scraper
level but it's also now being done by the admin data loader for safety.
Also make sure to just update admin data instead of deleting and
reloading all values each load. Add tests to confirm this behavior
2023-06-03 17:14:41 -07:00
rebuilt
abe7a8804c Don't check standard deviation for early education surveys 2023-06-02 16:05:45 -07:00
rebuilt
5fe0e07020 Add Wisconsin enrollment and staffing information 2023-06-02 15:49:50 -07:00
rebuilt
9aeb5f92af Missing progress or duration information does not result in a row removed in the cleaning process 2023-06-02 15:23:21 -07:00
rebuilt
e3ae12b425 update response_date to recorded_date 2023-05-31 16:57:47 -07:00
rebuilt
a30921ce06 Add New Jersey enrollment and staffing data 2023-05-28 17:11:52 -07:00
rebuilt
93d087a5de Use short district name for cleaned csv 2023-05-28 17:11:27 -07:00
rebuilt
8ef8cfce58 Adjust valid duration threshold of short form items 2023-05-26 18:30:44 -07:00
rebuilt
82659647bb add new hero. fix background placement 2023-05-26 11:29:53 -07:00
rebuilt
43bcd51452 Set credentials before switching to different district instead of after in the hopes the test will be less flaky when run in github actions 2023-05-25 10:31:11 -07:00
rebuilt
87ca23df79 Add subcategory report 2023-05-23 18:55:05 -07:00
rebuilt
2e3461b685 Add subcategory report 2023-05-22 16:36:12 -07:00
rebuilt
d6b2521883 Fix regression in student loader 2023-05-19 13:48:16 -07:00
rebuilt
b915c61476 Add livereload 2023-05-17 16:33:25 -07:00
rebuilt
4509c157fa Add automated data cleaning. Modify SurveyItemValues class to use regex
instead of hard coded values.  Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
2023-05-16 13:38:29 -07:00
vineeshathallapaneni@gmail.com
5cf5a5f383 added tasks to find stray responses and skipped questions 2023-05-15 20:23:39 -04:00
vineeshathallapaneni@gmail.com
d0db255af1 updated gemfile for mac 2023-05-15 20:17:06 -04:00
rebuilt
72b35ff2e3 Add viewport and context meta tags 2023-05-15 15:09:09 -07:00
rebuilt
7855663b7e Add meta description to application template 2023-05-15 15:08:15 -07:00
rebuilt
24e7a9abca Add meta tag 2023-05-15 15:07:14 -07:00
rebuilt
a1743da910 Update about us section 2023-05-15 15:05:44 -07:00
rebuilt
b72c173c0b Add webmanifest 2023-05-15 14:55:22 -07:00
rebuilt
dd94b283fa Remove hotjar 2023-05-15 14:55:12 -07:00
rebuilt
51d5d72730 Fix sizing of partial data indicators 2023-05-15 14:38:22 -07:00
rebuilt
1526bb2532 Set doctype to html5 2023-05-15 14:19:47 -07:00
rebuilt
09be5f1fc8 Make sure to perform authorization when switching districts. Make sure to use apparition for system specs 2023-05-13 09:29:58 -07:00
rebuilt
d48a4efda2 Round all averages to two decimal places 2023-05-12 13:08:25 -07:00
rebuilt
3c30808a5e Fix response rates for small schools by accounting for expected minimum counts of responses less than 10 2023-05-12 12:27:00 -07:00
rebuilt
b5be86d74d Add Waupun and Dunellen school districts 2023-05-11 17:14:14 -07:00
rebuilt
170bc79f96 update ship it to use 'yarn jest' instead of 'yarn test' so javascript test will run correctly 2023-05-01 10:16:57 -07:00
rebuilt
359e266a6c Remove unused TODOs 2023-04-27 15:47:45 -07:00
rebuilt
c5373b5e99 Add most recent admin data 2023-04-27 15:44:56 -07:00
rebuilt
3f2a7dff50 Fix problem with dese scraper lumping in 2021-22 data as 2022-23 data.
Deleted unused csvs.  Turned off puts statements in admin loader.
Remove old, now unused admin data loader class.
2023-04-27 15:43:17 -07:00
rebuilt
ca31bd3217 cap response rate per grade at 100 2023-04-26 16:54:43 -07:00
rebuilt
fb963f63e0 Clean up rake tasks to get data:load_survey_responses working 2023-04-26 15:56:17 -07:00