3 Commits (f27a590c5a2fdacf40e7d0274553f2753dc386db)

Author	SHA1	Message	Date
Nelson Jovel	97ddb09167	chore: add test for checking duplicate headers during cleaning process	2 years ago
rebuilt	7bd7923d41	fix: ensure cleaner outputs columns for all survey items. Before the fix, if a survey item varient (ending in -1, ie s-tint-q1-1) did not have a matching survey item s-tint-q1, the resulting csv would not include that column	2 years ago
rebuilt	dbfc9d1d3a	Add automated data cleaning. Modify SurveyItemValues class to use regex ... instead of hard coded values. Produce a clean csv and a csv with all the removed values and columns with reason for removal. Add script for running cleaning for each project	3 years ago