I have a ton of files I need to backup. The problem I have is this. Say I have a folder I need to backup. I
tar it and then encrypt it with PGP and then upload it to Digital ocean
spaces. Now it’s been a few weeks since the last backup and I need to make a new backup.
But I only want to make a backup of the files that have changed and new files that were added. The only way for me to know which files are new and which ones have changed is to download my previous backup, decrypt and then do a diff between my old backup and my current backup folder.
This process is tedious if I have a lot of files or if the previous encrypted backup is large. I can offset this discomfort my keeping a manifest of all files that are part of the backup. But there is still a lot of manual work to be done when the time comes to generate the diff.
I looked at tarsnap and it does what I want. Encryption and only uploading only diffs. But it’s expensive for me.
Spaces costs me 0.02$/GB/month. Whereas, tarsnap is 0.25$/GB/month. So it’s quite a bit expensive when you have a lot of data. But in the defense of tarsnap, the service does a lot more than
Spaces merely gives you storage in the cloud. No diff. No encryption. Whereas tarsnap offers more value.
Do you guys use any other methods to accomplish encryption and backing up only the diffs?