Commit graph

1062 commits

Author SHA1 Message Date
vineeshathallapaneni@gmail.com
eaef648516 upgraded semver to 7.5.2 and adding updated files package.json and yarn.lock
patching a security vulnerability
2023-06-28 23:25:35 -04:00
vineeshathallapaneni@gmail.com
d42464cfad updated Nokogiri as part of security vulnerability and adding updated file Gemfile.lock 2023-06-28 23:25:00 -04:00
rebuilt
a13d46354a fix: Flaky test might be related to not waiting for go button to appear. Add line to wait for go button 2023-06-26 14:20:29 -07:00
rebuilt
ebe28ed719 fix: remove debug from dependencies since it's causing unresolved dependency errors in CI 2023-06-26 11:51:49 -07:00
rebuilt
c0fdaeb26b update tests for subcategory report 2023-06-26 11:36:03 -07:00
rebuilt
d72f8d31e0 fix: There was an n+1 problem where we looked up the list of schools for
every row. Now we query the list of schools just once per file
2023-06-26 11:36:03 -07:00
09aa6fdb58 Change subcategory hovers to say 67 instead of 66 questions 2023-06-23 21:55:28 +00:00
rebuilt
703928c234 Add date range to subcategory report export 2023-06-23 11:46:08 -07:00
rebuilt
e8aa75bf66 feat: update survey_item_response table to indlude recorded date and import recorded date when loading responses 2023-06-23 11:26:53 -07:00
8bc14a79f6 Add hovers to browse page response rates 2023-06-22 05:00:26 +00:00
rebuilt
1c6a6a7a7a Add tests to codify behavior of weighted average logic 2023-06-21 03:33:35 +00:00
37013c4b12 Use weighted average instead of simple average when calculating response rates 2023-06-21 03:31:52 +00:00
527aa66796 Patch upload script over from rpp 2023-06-21 03:28:48 +00:00
dd26663340 Update README.md with upload script 2023-06-21 03:20:42 +00:00
b07a675427 Add cleaned data upload script for Lowell 2023-06-21 03:20:42 +00:00
Nelson Jovel
0a2c5e02c5 feat: add ability to merge disaggregation data with raw survey data to
produce a cleaned csv with merged income disaggregation columns
2023-06-20 12:22:24 -07:00
rebuilt
fae530d21f perf: Reduce number of queries. Remove unneeded methods. Combine
subcategory and measure queries in controller
2023-06-19 20:51:24 -07:00
0662d7233f Update README.md 2023-06-16 03:00:11 +00:00
rebuilt
411c632c25 chore: remove errant comment 2023-06-12 16:06:57 -07:00
rebuilt
518bc29f0f perf: include survey items with measures to avoid n+1 queries when scoring by student/teacher survey items 2023-06-11 14:42:53 -07:00
rebuilt
f6e4fd1ba9 docs: add contributing doc 2023-06-10 11:39:56 -07:00
rebuilt
d306319de1 perf: memoize function when calculating response rates 2023-06-10 11:39:46 -07:00
rebuilt
452876ef09 perf: Add another index to surveyitemresponses. Implement bullet suggestions. Memoize a function in measure.rb 2023-06-10 10:30:29 -07:00
rebuilt
eee0cb14a3 Fix: failing subcategory report specs 2023-06-09 21:26:10 -07:00
rebuilt
1aaed0682e Modify subcategory report to be threaded 2023-06-09 21:26:00 -07:00
rebuilt
aab4e78a71 Add District, School Code, and Grade columns to subcategory report 2023-06-09 15:30:57 -07:00
rebuilt
5e9cc02024 Revert "Add tests to codify behavior of weighted average logic"
This reverts commit 0ab8e88072.
2023-06-08 15:26:50 -07:00
rebuilt
0ab8e88072 Add tests to codify behavior of weighted average logic 2023-06-08 15:25:27 -07:00
rebuilt
e2d24a9bec Fix: make sure values don't get reordered after copying over row values from survey item variants. This fixes a problem where cleaner would produce a row with likert scores that got shifted to align with the wrong column 2023-06-08 09:26:56 -07:00
rebuilt
c2503541ff Fix: Ensure proper detection of survey type. Make sure to remove any survey item ids that end with the survey variant style of '-1' 2023-06-07 12:39:09 -07:00
rebuilt
ddf9a628d5 Fix: enable correct detection of student surveys types by rejecting any
headers ending with '-1' (the variants of standard questions)
2023-06-07 12:38:58 -07:00
rebuilt
896f0d9961 Don't write a file if there's an empty dataset 2023-06-07 12:38:44 -07:00
rebuilt
d4f4b899f0 Scrape new admin data values 2023-06-06 18:25:18 -07:00
rebuilt
76b79b99c2 Fix: Parse headers when they are surrounded by quotes. This helps load recent csv files correctly 2023-06-06 18:18:52 -07:00
rebuilt
b57489a7b0 Scrape new admin data values 2023-06-03 17:14:56 -07:00
rebuilt
30285efd69 It's possible for admin data likert score values to be above 5. If that happens, we
cap the likert score at 5.   This was happening already at the scraper
level but it's also now being done by the admin data loader for safety.
Also make sure to just update admin data instead of deleting and
reloading all values each load. Add tests to confirm this behavior
2023-06-03 17:14:41 -07:00
rebuilt
abe7a8804c Don't check standard deviation for early education surveys 2023-06-02 16:05:45 -07:00
rebuilt
5fe0e07020 Add Wisconsin enrollment and staffing information 2023-06-02 15:49:50 -07:00
rebuilt
9aeb5f92af Missing progress or duration information does not result in a row removed in the cleaning process 2023-06-02 15:23:21 -07:00
rebuilt
e3ae12b425 update response_date to recorded_date 2023-05-31 16:57:47 -07:00
rebuilt
a30921ce06 Add New Jersey enrollment and staffing data 2023-05-28 17:11:52 -07:00
rebuilt
93d087a5de Use short district name for cleaned csv 2023-05-28 17:11:27 -07:00
rebuilt
8ef8cfce58 Adjust valid duration threshold of short form items 2023-05-26 18:30:44 -07:00
rebuilt
82659647bb add new hero. fix background placement 2023-05-26 11:29:53 -07:00
rebuilt
43bcd51452 Set credentials before switching to different district instead of after in the hopes the test will be less flaky when run in github actions 2023-05-25 10:31:11 -07:00
rebuilt
87ca23df79 Add subcategory report 2023-05-23 18:55:05 -07:00
rebuilt
2e3461b685 Add subcategory report 2023-05-22 16:36:12 -07:00
rebuilt
d6b2521883 Fix regression in student loader 2023-05-19 13:48:16 -07:00
rebuilt
b915c61476 Add livereload 2023-05-17 16:33:25 -07:00
rebuilt
4509c157fa Add automated data cleaning. Modify SurveyItemValues class to use regex
instead of hard coded values.  Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
2023-05-16 13:38:29 -07:00