[ARCHIVED] Why is sync is deleting the files it just downloaded?

[kathryn_taylor]

I have the CLI  (Node 4.4.4)  installed on a Windows server.  When I sync it downloads the files, but cleanup deletes the files it just downloaded, leaving empty folders.

I can see the .gz files in the folders, then the gz files disappear.

From the log:

downloaded 155 new files out of 155 total files

new files downloaded [ 'account_dim-00000-ba303757.gz',

  'assignment_dim-00000-b216da46.gz',

  'assignment_fact-00000-4b85b3a1.gz',

  etc..

  then

searching for old files to remove

will remove files [ 'account_dim/account_dim-00000-ba303757.gz',

  'assignment_dim/assignment_dim-00000-b216da46.gz',

  'assignment_fact/assignment_fact-00000-4b85b3a1.gz',

  etc..

finished cleanup, done!

The folders are empty. If I download again, it starts from scratch. I have tried using a status.json file but it is not getting updated. I am trying to automate the download as a part of my planned ETL process to a database. I am running everything from the default install location

Thanks.

[cward]

 @kathryn_taylor ​ are you still getting this issue? We updated the CLI recently, so please try the latest version and let me know if there's still a problem!

Chris

[kathryn_taylor]

No luck. I am using the latest stable NPM and downloaded the most recent CLI

Node.js is 4.4.5 with npm 2.15.5, CLI is 0.3.1

and I have the same results. I tried it on 2 Windows servers and a Windows 7 machine.  I can  use FETCH instead of SYCH, but I really like SYNCH.  I hope I am missing something really simple. I am logged in with admin rights when I run it at the command prompt or from a batch file.

This is the command I run in a batch file.

CMD /C "canvasDataCli sync -c C:\Users\***\AppData\Roaming\npm\node_modules\canvas-data-cli\config.js -l debug"

I tried creating an empty state.json file and add it to the same folder with the config file and it is still empty. This is my config file.

module.exports = {

  saveLocation: './dataFiles',

  unpackLocation: './unpackedFiles',

  stateFile: './state.json',

  apiUrl: 'https://api.inshosteddata.com/api',

  key:***,

  secret:***

}

It still deletes all the files it just downloaded as its cleanup. From the log:

downloaded 184 new files out of 184 total files

new files downloaded [ 'account_dim-00000-8235a115.gz',

  'assignment_dim-00000-a341415f.gz',

  'assignment_fact-00000-d52e13e6.gz',

  'assignment_group_dim-00000-8586298b.gz',

ETC

cached files []

searching for old files to remove

will remove files [ 'account_dim/account_dim-00000-8235a115.gz',                                

  'assignment_dim/assignment_dim-00000-a341415f.gz',

  'assignment_fact/assignment_fact-00000-d52e13e6.gz',

  'assignment_group_dim/assignment_group_dim-00000-8586298b.gz',

ETC

finished cleanup, done!

sync command completed successfully

[cward]

OK, I'll ping the engineers and see if they have any solutions.