gabehf/sqm-dashboards
1
0
Fork 0
mirror of https://github.com/edcommonwealth/sqm-dashboards.git synced 2026-03-11 00:10:35 -07:00
Code Issues Projects Releases Packages Wiki Activity Actions

feat: add command for loading survey responses from arbitrary sftp directory

Browse source
This commit is contained in:
rebuilt 2023-10-30 19:44:52 -07:00
parent 91ab2dd82e
commit ece1f61aec
2 changed files with 42 additions and 64 deletions
Download patch file Download diff file Expand all files Collapse all files

25
README.md
View file

@ -124,30 +124,43 @@ How to run the data loading task:
```bash
# locally
$ bundle exec rake data:load_survey_responses
bundle exec rake data:load_survey_responses
# on heroku staging environment
$ heroku run:detached -a mciea-beta bundle exec rake data:load_survey_responses
heroku run:detached -a mciea-beta bundle exec rake data:load_survey_responses
# on heroku production environment
$ heroku run:detached -a mciea-dashboard bundle exec rake data:load_survey_responses
heroku run:detached -a mciea-dashboard bundle exec rake data:load_survey_responses
```
Or if you want to load data from a specific directory
```bash
# locally
SFTP_PATH=/data/survey_responses/2022_23 bundle exec rake data:load_survey_responses_from_path
# on heroku staging environment
heroku run:detached -a mciea-beta SFTP_PATH=/data/survey_responses/2022_23 bundle exec rake data:load_survey_responses_from_path
# on heroku production environment
heroku run:detached -a mciea-dashboard SFTP_PATH=/data/survey_responses/2022_23 bundle exec rake data:load_survey_responses_from_path
```
Or if you only want to load data for Lowell
```bash
# locally
$ bundle exec rake data:load_survey_responses_for_lowell
bundle exec rake data:load_survey_responses_for_lowell
```
For convenience, you can use the following script for loading data on Heroku:
```bash
# on heroku staging environment
$ ./scripts/load_survey_responses_on_heroku beta
./scripts/load_survey_responses_on_heroku beta
# on heroku production environment
$ ./scripts/load_survey_responses_on_heroku dashboard
./scripts/load_survey_responses_on_heroku dashboard
```
There is also an example one-off task to load a single csv at a time.