rebuilt
b0df611f4d
feat: create a parents by language graph
...
Update demographics table with lanugage options
Create a lanugage table to hold the new languages
Update the demographic loader to input languages into the database
Update the cleaner to read the language column
Update the parent table to hold a reference to a language
Update the data uploader script to read the language from the csv and update the language information for any parent items that already exist (or create database entries if none already exist)
update the analyze interface to add controls for selecting ‘parents by group’ and a dropdown for ‘parent by language’
Update the analyze controller to read the parent-by-group parameter
Create a graph for the parent-by-group view
Bubble up averages for language calculations.
Make sure n-size only counts responses for a given measure.
2025-04-30 16:03:29 -07:00
rebuilt
1845d1ac7b
feat: Add language filter for parent analysis
2025-04-25 16:38:36 -07:00
rebuilt
8e5e2a030a
feat: Add language filter for parent analysis
2025-04-25 16:35:53 -07:00
rebuilt
e90e6a4f0f
WIP: add multiple languages to parent
2025-04-25 16:21:13 -07:00
rebuilt
446b3b1096
WIP: Update the parent table to hold a reference to a language
...
Update the data uploader script to read the language from the csv and update the language information for any parent items that already exist (or create database entries if none already exist)
2025-04-25 16:17:01 -07:00
rebuilt
6503d6444f
chore: correctly detect missing grade header
2025-03-20 13:15:21 -07:00
rebuilt
204e9c1b3a
feat: pull down new admin data. Fix problems with some scrapers. For 5D-ii make sure the likert score is 1 if the nurse count is 0. Prevent devision by zero returning infinity. For 3A-ii make sure not to perform division by zero. Likert score will be 1 if the number of guidance couselors, psychologists, or paraprofessionals is zero.
2025-03-20 13:12:36 -07:00
nelson
9470e55701
feat: Add scraper for a-curv-i7. Scrape new admin data for that item
2025-02-13 12:10:30 -08:00
nelson
5235ad8c6a
chore: rename sftp environment variable
2025-02-07 12:53:47 -08:00
nelson
29caf0904f
feat: add scraper for 4D-ii
2025-02-06 21:11:45 -08:00
nelson
7c38d3faee
feat: finish scraper for students of color in advanced courses
2025-02-06 13:51:22 -08:00
nelson
966e25c995
Fix hs only admin data item. Use alternate method to check if a school is a high school
2025-02-06 13:50:56 -08:00
rebuilt
38cf38fdb5
chore: fix problem with enrollment scraper
2025-01-28 12:04:35 -08:00
Nelson Jovel
b9a0016f14
chore: scrape new admin data; a-ovpe-i1
2025-01-23 11:44:36 -08:00
Nelson Jovel
8ab944acca
feat: add admin data item a-curv-i5 with temporary benchmark of 2
2025-01-23 11:41:00 -08:00
Nelson Jovel
8303d3bfdc
feat: add esp counts when calculating teacher participation rates on overview page
2025-01-23 11:35:20 -08:00
Nelson Jovel
67a9a96433
fix: make sure all likert scores get counted even when the survey item id has different capitalization. Add tests for uploading parent data. Change the parent response rate calcuation to count all students in the school instead of just for the grades that were given the student survey
2024-11-14 09:30:25 -08:00
Nelson Jovel
d338003886
Show parent response rate
2024-11-14 09:22:51 -08:00
Nelson Jovel
c85ddddd8d
feat: add parent survey gauges
2024-09-27 13:50:30 -07:00
Nelson Jovel
22b9b44773
chore: add another variant for column name
2024-06-26 14:20:07 -07:00
Nelson Jovel
66dda0d30d
chore: During cleaning, stop execution if grade column isn't found. Also stop execution if a duplicate header is found. Turn off spec for duplicate header check
2024-05-23 12:52:47 -07:00
Nelson Jovel
8d31faf012
chore: speed up survey data loader
2024-05-23 12:24:47 -07:00
Nelson Jovel
62a7fbb4fc
chore: Add 'English Learner' and 'DirectCert' as valid column headers
2024-05-17 09:42:38 -07:00
Nelson Jovel
5a1db34a18
chore: add a way to print out errors in dese id when cleaning files
2024-05-16 15:11:04 -07:00
Nelson Jovel
d4db4e0fa2
add disaggregation glossary
2024-05-15 10:54:34 -07:00
Nelson Jovel
5851ab1cbf
chore: add parsing rules for disaggregation columns; ell, income, sped. Add tests for new rules
2024-05-09 19:16:57 -07:00
Nelson Jovel
6a9d04f7ff
fix: make sure enrollment loader works
2024-04-27 14:34:07 -07:00
Nelson Jovel
ac5c1edfbf
feat: Split academic year into seasons if the academic year's range is
...
initialized with a season, i.e. "2024-25 Fall". Update scapers for
admin data, enrollment and staffing to use the new range standard
correctly. Update the loaders for admin data, enrollment and staffing
so that it populates all seasons in a given year. So admin data for
2024-25 gets loaded into "2024-25 Fall" and "2024-25 Spring". Add tests
for the new range format. Set the default cutoff for the start of Spring season will be the last Sunday in February
2024-04-27 14:24:05 -07:00
b3e6efdb2e
Faster admin data loader + rename School.school_hash
2024-04-22 16:21:43 -04:00
b5f90376f7
Memoize admin data loader
2024-04-18 17:23:49 -04:00
Nelson Jovel
3c3b0d2cf5
fix: loosen restrictions on date format
2024-03-01 10:16:15 -08:00
Nelson Jovel
bd1a7b3877
match an additional format for Dates. Supported dates are now '1/10/2022 14:21:45' '2022-1-10T14:21:45' '2022-1-10 14:21:45'
2024-03-01 09:30:50 -08:00
Nelson Jovel
c4d8b927af
feat: Support two date formats: ISO 8601 and the standard US date format
...
used in google sheets
2024-02-27 12:00:45 -08:00
Nelson Jovel
7d527b5639
chore: support alternate format for recorded date
2024-02-23 14:23:46 -08:00
Nelson Jovel
8d596faeeb
chore: alphabetize districts when writing filename for cleaned files
2024-02-23 11:28:42 -08:00
Nelson Jovel
c6c9fd38de
fix: batch in smaller size to stay within memory limits
2024-02-23 10:34:18 -08:00
Nelson Jovel
e97e7047b1
fix: no longer support 'form' in filename when cleaning. Only look for 'part X' and add that to the filename if it exists
2024-02-22 12:04:36 -08:00
Nelson Jovel
e1fc5dbbaa
feat: add 2023-24 academic year and make sure previous year enrollment
...
and staffing data get loaded when missing
2024-02-20 21:06:55 -08:00
Nelson Jovel
2a125aa058
chore: bring in some refactoring changes that didn't get copied over from the main branch
2023-12-20 19:27:06 -08:00
Nelson Jovel
75451648e5
chore: move code that normalizes race data to the Race class
2023-12-20 19:07:52 -08:00
Nelson Jovel
e7f06ef4e9
chore: remove lowell seeding rules
2023-12-20 14:08:38 -08:00
Nelson Jovel
bbefdcb5bb
chore: remove student loader since we load race information in data loader
2023-12-20 13:47:09 -08:00
Nelson Jovel
063810a9d7
chore: make sure to load races in data loader instead of student loader
2023-12-20 13:39:03 -08:00
Nelson Jovel
381625f58b
chore: reenable test spec that tests data loader for races
2023-12-20 12:40:22 -08:00
Nelson Jovel
317fe3239a
chore: refactor Race out of survey_item_values
2023-12-20 12:35:14 -08:00
Nelson Jovel
a295b8afb9
chore: refactor Gender out out of survey_item_values row
2023-12-20 12:33:18 -08:00
Nelson Jovel
0359dae88a
chore: rename counts_by_grade to enrollment_by_grade for clarity
2023-12-18 15:59:30 -08:00
Nelson Jovel
ee5e53f992
chore: Make sure 'hispanic' column only gets applied when using SIS race information
2023-12-18 15:58:54 -08:00
Nelson Jovel
6f265302ea
feat: if the filename includes the words 'form' or 'part' add that to the resulting cleaned filename
2023-12-18 15:58:40 -08:00
Nelson Jovel
fe039e3d04
chore: various fixes for race and gender categorization during cleaning.
...
Also add tests for race and gender categorization
2023-12-18 15:38:31 -08:00
