Windows users are recommended to use Git for Windows Installer to follow through these instructions.

One of the biggest challenges we often face when transferring data between remote HPC systems is that of large numbers of files.

<aside> 💡

Note:

Archive files first and then transfer

$ tar -xvzf <directory>

To compress,

$ tar -cvzf <directory>

</aside>

scp can be used to securely transfer files

$ scp <user1>@<machine1>:/source/file <user2>@<machine2>:/destination/file

<aside> 💡

For a directory, use -r directive.

scp -r directory <user2>@<machine2....

</aside>

In case of multiple or bigger file transfer, use rsync to transfer files. It is typically faster and advanced as compared to scp or sftp.

$ rsync -avP ... same as above

sftp can also be used to transfer data. Use sftp clients such as FileZilla or MobaXterm

<aside> 💡

Use tmux terminal emulator to carry out transfers unattended.

</aside>