43bcd51452
Set credentials before switching to different district instead of after in the hopes the test will be less flaky when run in github actions
3 years ago
87ca23df79
Add subcategory report
3 years ago
2e3461b685
Add subcategory report
3 years ago
4509c157fa
Add automated data cleaning. Modify SurveyItemValues class to use regex
...
instead of hard coded values. Produce a clean csv and a csv with all
the removed values and columns with reason for removal. Add script for
running cleaning for each project
3 years ago
09be5f1fc8
Make sure to perform authorization when switching districts. Make sure to use apparition for system specs
3 years ago
3c30808a5e
Fix response rates for small schools by accounting for expected minimum counts of responses less than 10
3 years ago
3f2a7dff50
Fix problem with dese scraper lumping in 2021-22 data as 2022-23 data.
...
Deleted unused csvs. Turned off puts statements in admin loader.
Remove old, now unused admin data loader class.
3 years ago
541f29108b
Rename DataAvailability to Summary
3 years ago
596ce25737
Remove surveys table from codebase since it's no longer needed after changing logic surrounding response rates and score calculations
3 years ago
28f7d5647e
Set a minimum threshold of 10 survey item responses to calculate scores per survey item
3 years ago
128748addd
Update logic for calculating student response rate. Remove references
...
to survey table. We no longer check or keep track of the survey type.
Instead we look in the database to see if a survey item has at least 10
responses. If it does, that survey item was presented to the respondent
and we count it, and all responses when calculating the response rate.
Remove response rate timestamp from caching logic because we no longer
add the response rate to the database. All response rates are calculated
on the fly
Update three_b_two scraper to use teacher only numbers
swap over to using https://profiles.doe.mass.edu/statereport/gradesubjectstaffing.aspx as the source of staffing information
3 years ago
aaf1c8906e
Add tests to make sure teacher survey items don't pollute the graphs for
...
students of unknown genders
3 years ago
b250ebe415
Memoize schools in SurveyItemValues and academic_years in AcademicYear
...
for performace improvement
3 years ago
c15cb7b483
Change survey data loader spec to use factorybot objects instead of loading seeds. Change databasecleaner to use transaction. Add back babel-preset dependency to fix failing javascript test in production.
3 years ago
d7fa505285
remove unneeded column
3 years ago
8ea793d019
Remove redundant DatabaseCleaner config setup
3 years ago
da103ea95b
Remove file that should not have been committed
3 years ago
dcade06ce2
Fix failing tests
3 years ago
3c5e743649
Turn off journey spec
3 years ago
a21554c215
Fix failing test
3 years ago
10bf7177e4
Fix icon not showing up on category page
3 years ago
fbfaafa996
Update school/framework files for ecp schools. Fix tests. Update fixture files with dese ids of schools in the consortium.
3 years ago
4c4ccc01cc
Merge branch 'rpp-response-rate' to bring in changes to test files
3 years ago
eb043f2b2d
Add placeholder for testing response rate calculation
3 years ago
6b31fa9115
Batch imports for staffing data
3 years ago
d059177f0c
load total students and batch importing records
3 years ago
bfa5f28d7b
Convert dese::loader from using seeder to factories
3 years ago
7a7b78a9e0
convert student loader from seeding to factories
3 years ago
2cf2b7d7c1
turn off some slow tests that don't add value
3 years ago
2362d884eb
Convert admin data loader from using seeder to using factory
3 years ago
d0219217de
Convert response rate loader spec from using the seeder to using the factory
3 years ago
06f9d2f0e9
Scrape enrollment and staffing information. Seed enrollment and staffing information. Update DatabaseCleaner so it cleans up leftover information in the database. Remove old admin csvs from codebase.
3 years ago
b6b88da328
Add all pillars
3 years ago
8128af200b
add first pillar
3 years ago
c0332955f3
move csv require statement to application.rb
3 years ago
20d4f966e7
singularize respondents
3 years ago
7915a1bc7c
rename respondents to repondent
3 years ago
ae6d7151b3
Load student respondent information from enrollment loader
3 years ago
5e0ba556bf
Automatically detect the survey type by grade
3 years ago
52d2676f80
Populate db with grade level data
3 years ago
7a5e02eed9
Remove unused method item_descriptions from admin_data_presenter and
...
student_survey_presenter.
3 years ago
a72fd373dc
Remove unused method; item_descriptions
3 years ago
01851d8527
Make sure blank grades in csv load as nils instead of zeros
3 years ago
05ae1cd94b
fix failing tests
3 years ago
10515893ff
Add elementary school questions to framework.
3 years ago
03c6bff7bb
Load survey responses from sftp folder
3 years ago
a2caf42fee
merge disagreggation features
3 years ago
d5533bb756
Support survey item variants. Survey item id's in the format s-sbel-q1-1 will load into s-sbel-q1
3 years ago
4c2a299510
Fix hotwire test
3 years ago
69179ce157
Replace javascript logic with hotwire. Also hide district dropdown on
...
home page if there is only one district.
3 years ago
87802c034e
Add specs for admin bar messages
3 years ago
c58686c032
rename race and gender modules to avoid naming collision with race and gender classes
3 years ago
bb9ea9b22d
Add admin data messages to analyze page for insufficient/irrelevant states
3 years ago
53a08d41bf
Change label for unknown race
3 years ago
a1b7db9b2e
Add ability to load student demographic information for only lowell
3 years ago
d49cf918ac
Add a way to seed only lowell schools
3 years ago
fc9e73f656
make sure survey responses for Butler get loaded correctly
3 years ago
9bbba64e9e
Add rules to the survey data loader to allow skipping non-lowell schools
3 years ago
72c90b8f47
Add selector for all data
3 years ago
7d7bee6498
Add gender disagreggation
3 years ago
a1f3dfaa33
Load gender information to survey item responses
3 years ago
8cdd1b6285
Create gender class. Load genders to database from demographics file
3 years ago
89a7f27b88
Finishes #183092367 . Adds ui and graphs to show grade level disaggregations
3 years ago
6ed405d16d
Update student csvs
3 years ago
f556844b73
Update a-sust-i1 so it's only applicable to high schools and lower
...
benchmark for a-cure-i1 from 6.7 to 5 percent.
3 years ago
1a984d2cf0
Make sure we don't divide by 0
3 years ago
3ee909bbea
Update 3B-2 with an absolute floor
3 years ago
1be6e79fd8
Add scrapers for admin data and their corresponding csv files of data.
...
Make sure specs are off so they don't run in github CI
3 years ago
9e18bf2151
Turn off specs for scrapers. Generate csvs for scraped data
3 years ago
5002e4eb63
disable specs
3 years ago
75cea539c5
Change scraped csv file names from word to number format 'one_a_one.csv'
...
-> '1A_1.csv''
3 years ago
3e28be2d0d
Remove 'scraper' from file/class names add 3B-1
3 years ago
83ef9310a4
Add scraper for 3A-1 and 2C-1. Finishes #183105787 and #183105716
3 years ago
b5bc9c9de4
Add 2A-i admin data. Finishes #183105627
3 years ago
459393381b
Load admin data for 1A-iii. Finishes #183105516
3 years ago
f783ce9724
add one-a
3 years ago
048aacd641
Add admin data for 4D. Finishes #182818489 and #182793402
3 years ago
1e349519bc
Update framework. Remove/Add admin data items. Finishes #182819940
3 years ago
d89a207c31
Load student data for all years and calculate race scores for all
3 years ago
aa159e953f
Disable test so it passes github ci
3 years ago
58f5b01471
Use less memory when loading race scores
3 years ago
54ea1a1070
Change race score calculation from a minimum of 10 responses to meet
...
sufficiency to 10 students.
3 years ago
e2bded66e8
Disable checkboxes that are irrelevant for the graph type
3 years ago
2be86a2b13
Disable race score loader tests so it passes github ci
3 years ago
105f30f220
Change race score calculations so the average bubbles up through survey_items
...
-> scales -> measure.
Precalculate averages for performance.
3 years ago
3f2279e2e8
Position multi-word analyze graph labels horizontally
3 years ago
50b3bc678c
Columns for students by group graph change when corresponding race checkboxes are clicked
3 years ago
ff14bad102
Rename Student column to AllStudent so there isn't a naming clash with
...
the Student model.
3 years ago
93486eb132
Fix failing tests
3 years ago
26f739090b
add race columns to graph
3 years ago
88339c729f
Turn off failing test that depends on key_derivation_salt so tests dont fail in the github CI environment
3 years ago
12e4e3f177
import students
3 years ago
765ad6a624
Create ui for data filters. Add listeners to direct to the correct url. Update ui based on the list of selected params
3 years ago
757638f6ca
continue refactoring
3 years ago
e89358dacc
implement suggestions from static code analysis tools
3 years ago
bb5f668497
Refactor code based on rubocop and reek suggestions
3 years ago
fc853c4fbc
Fix regression where we accidentally list the questions for measure 1B-i
3 years ago
deaf13c976
Modify behavior of insufficient data indicators for admin data items. Now we show indicators in line with the admin data item descriptions to indicate which items are missing data
3 years ago
7c0794f261
Remove old todos
3 years ago
7e5b235668
Print out invalid values when loading admin data
3 years ago
da2e27e863
Add test for case where student response rate does not meet threshold
3 years ago
be715e117e
Fix failing tests
3 years ago
7fcf580591
Load survey responses for revere somerville and wareham for the 2021-22 academic year
4 years ago
2d3ee28cc3
Change wording of refreshing response rates to resetting response rates
4 years ago
a6ad132c81
Add counter caches
4 years ago
c03615cb43
Rename ResponseRate to ResponseRateCalculator. Create a new response
...
rate model. Create a loader to refresh response rates for all
subcategories.
Use precalculated response rates in views
Wrap more elements in page caching
Calculate a response rate for a subcategory if one does not already
exist
4 years ago
61aad20cb2
Create response rate model
4 years ago
a769996054
Refactor response rate into response rate calculator
4 years ago
3778aeb1d6
alter logic for insufficiency so that a count of 0 survey item responses is enough to trigger insufficiency
...
Implement large speed improvements to score calculations. Add page caching to all pages. Small speed improvements to response rate by filtering out
survey items without responses with `none?` `method vs count == 0`.
4 years ago
1155f74ca9
Set a minimum bar height for analyze graphs
4 years ago
cb3499de64
Fix failing test
4 years ago
a34766009b
Fix failing journey test
4 years ago
e8f3109df9
Disable checkboxes for years that don't have data to show. Add exclamation icon with explanatory text. Finishes #182332983
4 years ago
50256cacce
Create academic year checkbox selectors. Refresh page with years selected on
...
checkbox change. Draw bar graphs for each academic year selected.
Center bar graphs in their column. Color the columns to match the
sample colors on the checkboxes. Add scores on beta to top of graph.
Automatically display the most recent year of data for the district.
Modify logic for the insufficient data message or the 'measure not based
on student/teacher surveys' message so it only shows if there are no
bars with data to display.
4 years ago
30c97f4428
Refactor grouped_bar_column_presenter so it calculates the score from
...
the measure given to the initializer
4 years ago
8efaf8514d
Extract student and teacher presenters from grouped_bar_column_presenter
4 years ago
16569974a6
Add checkboxes to select academic years for analyze page. Stimulus controller reads the state of the checkboxes and builds the correct link to route the user
4 years ago
6764024cd2
Show subcategory data when user selects different subcategory from
...
analyze dropdown. Finishes #182277850
4 years ago
61978eb45d
Change which category is displayed when the category dropdown is changed
...
on the analyze page. Finishes #182277818
4 years ago
a04f797f30
Add all measures for a given subcategory to the analyze page. Finishes #182277762
4 years ago
9837fbf0d0
If the measure is not based on a type of data(student/teacher) or if there is insufficent data to calculate a score, show a message on the graph indicating such
4 years ago
3d7e62f21f
Draw the teacher survey data bar. Finishes #182226823
4 years ago
7a9830915b
Create grouped bar chart on analyze page
4 years ago
d7b0fe0e36
Add attleboro survey item responses for 2021-22. Finishes #182215755
4 years ago
4952849d96
Prevent negative admin data values from being imported
4 years ago
cb5fe56c30
Create analyze page. Finishes #182097292
4 years ago
57bfaa51c6
Exclude boston results. Completes #182117456
4 years ago
cbc8ba59ba
remove authentication check. Finishes #181920761
4 years ago
c49dee0a63
Do not show question prompts for measure 1B-1. Finishes #181921933
4 years ago
0b502ce826
When calculating response rate, only take into account survey items with associated responses. Ignore any survey items with no responses. Finishes #181922483
4 years ago
c475744939
Modify score calculations. Ignore any survey item scores of 0.
...
Never include zero when performing calculations for scores.
4 years ago
9c954f97ec
Update admin data collection rate numbers on browse page. Also, if all admin data has been collected, do not show 'insufficient data' indicator. Finishes #181754853
4 years ago
9ecc501e24
Display measure scores. Finishes #181754978
4 years ago
448e883f39
Add new csv for student and teacher metadata. Finishes #181530310
4 years ago
101c252896
Import survey item responses based on DESE ID instead of qualtrics school code. Finishes #181704978
4 years ago
78fb737f5a
Make measure titles clickable on the variance chart
4 years ago
bf8b824ab8
Add links to subcategories from overview page framework indicator
...
section. Finishes #181681266
4 years ago
5a9e8a9b01
Add metadata for 2019-20 year. Finishes #181530277
4 years ago
36da912253
Modify survey item response csv files for 2019-20 to correct incorrect likert scores
4 years ago
c98c0f1e30
Add metadata for 2019-2020 school year. Finishes #181530277
4 years ago
ed7a3b8a3d
Autoformat code with rubocop
4 years ago
91308b93e5
Visualize survey responses even when a response rate cannot be
...
calculated. Set the response rate to N / A for data that has no total
student and teacher data for a certain year and school
4 years ago
286e74b651
Seed db with surveys to keep track of school, year, and survey type
...
Seed db with survey_item information to keep track of which survey_item is on the short form survey. REcalculate response rate depending on whether school to regular survey or short form survey.
Correct score for short form schools. Finishes #181284202
4 years ago
2a2777745a
Change the sufficiency threshold from a static number of minimum responses to a minimum response rate of 25 percent
4 years ago
d4df7cbc06
Add scales to framework. Change calculations to first group and then
...
average those groupings and the way up the framework. Likert scores for
a survey_item are averaged. Then all the survey_items in a scale are
averaged. Then student scales in a measure are averaged. And teacher
scales in a measure are averaged. Then the average of those two
calculations becomes the score for a measure. Then the measures in a
subcategory are averaged.
4 years ago
fcec3de233
Modify collection rate for admin data items. Take into account if a
...
school is a high school and if the admin data item is for high schools
only. Finishes: #181154375 .
4 years ago
8ce50c45c8
Change admin data response rate from 0/0 to N/A
4 years ago
e1f50fef9e
Add 2019-20 year teacher surveys and activate the year selector
4 years ago
ad14563460
Browse page displays the admin data collection rate
4 years ago
67d51aff5e
Refactor response rate
4 years ago
rebuilt