6b31fa9115
Batch imports for staffing data
3 years ago
d059177f0c
load total students and batch importing records
3 years ago
2362d884eb
Convert admin data loader from using seeder to using factory
3 years ago
d0219217de
Convert response rate loader spec from using the seeder to using the factory
3 years ago
06f9d2f0e9
Scrape enrollment and staffing information. Seed enrollment and staffing information. Update DatabaseCleaner so it cleans up leftover information in the database. Remove old admin csvs from codebase.
3 years ago
e6f7d27e0c
Implement bullet suggestions for GPS report
3 years ago
b6b88da328
Add all pillars
3 years ago
8128af200b
add first pillar
3 years ago
c0332955f3
move csv require statement to application.rb
3 years ago
d9c47dbc4d
fix boston usage
3 years ago
045bd15485
Fix boston
3 years ago
cb970895ac
Scope doesn't work. Revert to using class method.
3 years ago
bdb9455919
Move raw_response_rate method down to student/teacher classes
3 years ago
5d07f06a65
Add scope for boston
3 years ago
ae6d7151b3
Load student respondent information from enrollment loader
3 years ago
79f7915edf
Add scopes to SurveyItem for selecting survey items by grade and
...
subcategory. Add notes to student response rate calculator
3 years ago
5e0ba556bf
Automatically detect the survey type by grade
3 years ago
cfece47993
document other queries for story
3 years ago
396e8e9008
example queries
3 years ago
984fedff02
Add academic year column to enrollment file. Add enrollment loader to seeder file
3 years ago
52d2676f80
Populate db with grade level data
3 years ago
69c089d9bb
Remove occurances of MCIEA
3 years ago
7a5e02eed9
Remove unused method item_descriptions from admin_data_presenter and
...
student_survey_presenter.
3 years ago
a72fd373dc
Remove unused method; item_descriptions
3 years ago
01851d8527
Make sure blank grades in csv load as nils instead of zeros
3 years ago
669fb7f1f0
Correct grade level for kindergarten and add one off task to load test data
3 years ago
3a744db975
Start adding kindergarten
3 years ago
b0e84ed82a
Modify names and descriptions of subcategories and measures
3 years ago
10515893ff
Add elementary school questions to framework.
3 years ago
c6b8518cb1
Fix bug with not all survey responses loading when using sftp loader
3 years ago
b1200dca33
update default folder for survey responses
3 years ago
7a159f7ddf
Process 1000 rows at a time to limit memory usage in production
3 years ago
79adff5faa
Don't print sftptogo_url
3 years ago
03c6bff7bb
Load survey responses from sftp folder
3 years ago
1426e7cc63
add proof of concept sftp downloader
3 years ago
eeeb4f5d14
Add Stoklosa survey responses
3 years ago
a4677223d4
Update empty dataset modal so it displays Lowell branded information
3 years ago
01d97945b3
Modify text and links on welcome page
3 years ago
d97b62b527
update logo and hero image
3 years ago
1a18837fa2
Only show district dropdown if there is more than one district in the database
3 years ago
d5533bb756
Support survey item variants. Survey item id's in the format s-sbel-q1-1 will load into s-sbel-q1
3 years ago
ed421296c7
Fix bug that caused an incorrect score of 1 to be assigned for admin
...
data item related to parity index of teachers of color to students of
color. Now if there's not enough data to calculate a score, it produces
'NA' instead of 1. Also added admin data for a-reso-i1 and a-curv-i1
3 years ago
06f49fc17f
add more colors
3 years ago
7b9abe3793
Scrape latest data from DESE
3 years ago
7ddada5050
Update empty dataset indicators
3 years ago
880da0d8ff
Only show district dropdown if there is more than one district in the database
3 years ago
4c2a299510
Fix hotwire test
3 years ago
b884021f66
Rename race column from 'Race/Ethnicity not listed' to 'Not Listed'
3 years ago
69179ce157
Replace javascript logic with hotwire. Also hide district dropdown on
...
home page if there is only one district.
3 years ago
c58686c032
rename race and gender modules to avoid naming collision with race and gender classes
3 years ago
850ef9d1cd
Make sure demographic loader doesn't break when changing the designation of a Race
3 years ago
bb9ea9b22d
Add admin data messages to analyze page for insufficient/irrelevant states
3 years ago
53a08d41bf
Change label for unknown race
3 years ago
a1b7db9b2e
Add ability to load student demographic information for only lowell
3 years ago
d49cf918ac
Add a way to seed only lowell schools
3 years ago
fc9e73f656
make sure survey responses for Butler get loaded correctly
3 years ago
9bbba64e9e
Add rules to the survey data loader to allow skipping non-lowell schools
3 years ago
1f7fa8146c
Fix bug that happens when you view gender scores for multiple years
3 years ago
43bc55ed32
Query for survey items once instead of on each row
3 years ago
83fa255e5d
Make utility method private
3 years ago
3ca270e3b1
Fix more malformed csv errors
3 years ago
360579852c
Send fewer sql queries when loading survey responses
3 years ago
9ae94a2dae
further reduce batch size to avoid exceeding memory quota
3 years ago
bb472ce6c3
Reduce number of rows to process to avoid exceeding memory limit on heroku
3 years ago
72c90b8f47
Add selector for all data
3 years ago
4626d43e3e
Add changes to demographic loader so it the tests don't fail when run in parallel
3 years ago
7d7bee6498
Add gender disagreggation
3 years ago
7f0faf8917
Add checkboxes to analyze page for genders
3 years ago
a1f3dfaa33
Load gender information to survey item responses
3 years ago
8cdd1b6285
Create gender class. Load genders to database from demographics file
3 years ago
f4e2e6ca83
Correct headers for 4D so the data can be correctly imported
3 years ago
9b28b0e629
Add grades to cache list
3 years ago
f9c4ed8880
make sure grade gets updated when loading survey responses
3 years ago
89a7f27b88
Finishes #183092367 . Adds ui and graphs to show grade level disaggregations
3 years ago
6ed405d16d
Update student csvs
3 years ago
dd9ed86dcd
Merge branch 'scrapers'
3 years ago
f556844b73
Update a-sust-i1 so it's only applicable to high schools and lower
...
benchmark for a-cure-i1 from 6.7 to 5 percent.
3 years ago
9e82023e48
Make sure we don't divide by 0
3 years ago
1a984d2cf0
Make sure we don't divide by 0
3 years ago
3ee909bbea
Update 3B-2 with an absolute floor
3 years ago
1be6e79fd8
Add scrapers for admin data and their corresponding csv files of data.
...
Make sure specs are off so they don't run in github CI
3 years ago
9e18bf2151
Turn off specs for scrapers. Generate csvs for scraped data
3 years ago
75cea539c5
Change scraped csv file names from word to number format 'one_a_one.csv'
...
-> '1A_1.csv''
3 years ago
3e28be2d0d
Remove 'scraper' from file/class names add 3B-1
3 years ago
83ef9310a4
Add scraper for 3A-1 and 2C-1. Finishes #183105787 and #183105716
3 years ago
b5bc9c9de4
Add 2A-i admin data. Finishes #183105627
3 years ago
459393381b
Load admin data for 1A-iii. Finishes #183105516
3 years ago
f783ce9724
add one-a
3 years ago
048aacd641
Add admin data for 4D. Finishes #182818489 and #182793402
3 years ago
1e349519bc
Update framework. Remove/Add admin data items. Finishes #182819940
3 years ago
043f6de8e7
Prefer using over uniq so the filtering happens in sql
3 years ago
30eae881f3
Load correct column for 2021-22 year
3 years ago
bc63dfab7e
add one_off scripts for each academic year
3 years ago
3fcab58557
Do not erase all students when loading each file
3 years ago
3f493727b3
Load a single year of student demographic data and race scores at a time
3 years ago
4a32ea3332
Reduce memory use in race score loader
3 years ago
d89a207c31
Load student data for all years and calculate race scores for all
3 years ago
191abdbd50
Align styling to closer match design
3 years ago
a4dbeb6718
Change logic on analyze page to include admin data when presenting insufficiency messages and enable/disable academic year checkboxes
3 years ago
42e150b33b
Update caching rule so a race_score with an updated timestamp will break the cache
3 years ago
rebuilt