David Tr
Oct 29, 2017 10:01:04 PM

Syncrify slow on backup

Doing some testing with the syncrify server. Just doing local backups on the LAN (i7 on the client to NAS) the backups seem to take a long time to process:

https://i.imgur.com/ZvoZntC.png

These are the options used:

https://i.imgur.com/8F5g2BO.png

 

Is this what I should expect?

I've read http://web.synametrics.com/syncrifyandbw.htm and I wouldn't think it's the hashing even with the VSS enabled (this is Evo 850 SSD)

Evaluating for 150+ client install, 12TB of data. I'm trying to see if Syncrify can handle the data and the client load.

 

Thx,

David



Synametrics support engineer
Oct 30, 2017 5:09:04 AM

Syncrify slow on backup

David,

I have a few suggestions:

  • Since you are using Syncrify on LAN, I'd recommend turning compression off. Check http://web.synametrics.com/SyncrifyCompression.htm for details. This feature is useful on a slow network, such as the Internet. Using it on LAN will unnecessary waste CPU cycles.
  • I see versioning is enabled, which means block matching will occur twice: once on the client and then on the server. Turning versioning off will increase the overall time.
  • Since you have already read the Bandwidth article, I assume you know why Syncrify took 14 minutes to move just 10MB - most of that time was spent in determining the delta and not network.

The amount of time for block matching is directly proportional to the size of the delta. Try selecting a few random files and see how big is the delta. You can do this by clicking the right mouse button on any file that has been modified and selecting Block Diff from the pop-up menu. If the delta is as big as the original file itself - meaning almost every block within the file is different, you're better off using Simple Copy instead of Delta Copy. Click here for details.  



Synametrics support engineer
Oct 30, 2017 5:14:23 AM

Syncrify slow on backup

David,

I forgot to comment on VSS. VSS has no impact on how matching occurs. Once VSS is created, it becomes transparent, and the rsync algorithm does not know/care if it is being used. What did you mean by "Hashing"? I assume you meant "Block Matching", right?



David Tr
Oct 30, 2017 9:58:57 AM

Syncrify slow on backup

Hashing...create a hash of the blocks of files to compare and determine what needs backup in a delta backup scenario. I assumed that was the only way you could match :)

Yes, I figured I could get some speed increases because of the LAN and disabling certain options...but I'm also wanting to test and see what kind of speed it will be when remote over WAN. I'll be having some clients with 500K+ files as well, and some with 2+TB of data with VM backups. If backups in those scenarios two extreme schenarios (once first backup is done) and backups run longer than 12hrs for an overnight, then I'm going to run into other problems later.

The restore process with versioning...is non-ideal :(

David



Synametrics support engineer
Oct 30, 2017 11:01:47 AM

Syncrify slow on backup

Hashing

Ah, I get it now. To be more explicit, Syncrify uses MD5 hashes. These signatures are have nothing to do with VSS and will get created with or without VSS.

Virtual Machines

Check http://web.synametrics.com/syncrify-vhd-files.htm for some tips on backing up VHD files.

WAN vs LAN

Syncrify works better on WAN than on LAN. I say that because the network is typically very fast on a LAN and therefore, the time spent on computing delta is often higher than transferring the entire file again without using rsync. Without rsync, Syncrify is no different than hundreds of other backup product out there.

It's the WAN where you need to minimize network traffic, and that is where Syncrify works better than any other backup product.

Question

What do you mean by restoring versioned file is not ideal?



David Tr
Oct 31, 2017 4:15:12 PM

Syncrify slow on backup

Well, I was going to try and keep this thread on topic but since you asked:

Just using the GUI of the Syncrify App is weird:

  • Understanding the logic of the "profile"
  • Right-clicking for adding files/folder to backup requires clicking in blank area, doesn't respond when right-clicking the profile name in the main part of the window
  • Log files in raw/only view mode, no gui
  • To even open the Syncrify Client GUI can't be done from systray, has to be launched from start menu

Then restoring:

  • Didn't realize the restore function is just a selection method of the files/folders dialog (used to a "backup" mode, and a "restore" mode/window)
  • Restoring selected folders only has a "days to go back" field, when testing I manually ran 3 tests back to back, and was going to test the restore process before realizing that wasn't possible. Have to wait another day to pass before I could even test restore.
  • Multiple backups/day you aren't going to be able to restore a specific version of a folder
  • Was trying to avoid doing version restores from http server since zip file is only option

Then Test Sync profile sync every minute: 

  • Sync is deleting files incorrectly

....so I'm definitely running into more than a couple problems :(



Synametrics support engineer
Oct 31, 2017 4:59:20 PM

Syncrify slow on backup

David,

Profiles - Some backup programs call this Jobs. In short, a profile defines what gets backed up and when. Check http://web.synametrics.com/SyncrifyProfile.htm for details.

Adding folders/files - Two way to do that: either right click in the tree view on the left or drag-n-drop files from Windows Explorer. In my opinion, the second option is easier.

Log files - Log files are typically not for end-user. I guess you're used to seeing log files because you're technical. Therefore, this is no option in the GUI. An administrator can pull log files from any client machine from the server's web interface. Check http://web.synametrics.com/SyncrifyLogFiles.htm for details.

Opening Client from Systray - This is a good suggestion and I am going to forward this to our dev. team.

Restoring - Syncrify keeps multiple versions of file - not folders. This means file F1.txt could have 5 versions and F2.txt could have 1 version and both be in the same folder. Assume F1.txt changed for the past 5 days and you want to go back 2 days, you will end up getting version 3 of F1.txt and version 1 of F2.txt

You can restore previous versions of a file from the web interface. Right click on a desired file and select Previous Versions. Check http://web.synametrics.com/SyncrifyVersioningFeature.htm for details.

 



David Tr
Nov 1, 2017 1:02:41 AM

Syncrify slow on backup

So by extrapolation of the logic "Restoring - Syncrify keeps multiple versions of file - not folders."

If you are backing up a shared drive for an office of people, with 500K files spread across 1000's of folders there no way for you to see the state (and restore said state) of any folder to an instance of time that a backup was run? A bulk restore operation to 4 days in the past will restore any file (deleted or otherwise) of every file that has ever existed in those folders regardless of deletion date?

...and then by the same logic, if you have a backed up cryptolocker style infection, how do you restore 500K files to the previous verions....or the version as it existed x days ago?



Synametrics support engineer
Nov 1, 2017 8:34:03 AM

Syncrify slow on backup

I apologize - I meant to say "Versioning" not "Restoring" keeps multiple versions of files.

It does not matter how many files you have 500K or millions. Each file will be independently versioned. The state of a folder is computed at the time of restore. Syncrify maintains the last modified date of each version. If you decide to go back five days, it figures out how far each file will have to get rollbacked. 

I recommend you use versioning and see how Syncrify keeps the files on the destination (server's end). This will help you understand how it works.

Cryptolocker:
There are two variants: one that changes the files names and another that keeps the file names intact but changes the data within the file. You get protection from the first type by using the Delete Retention feature in Syncrify. Versioning protects the second category.

Navigation

Social Media

Powered by 10MinutesWeb.com