rsync results questions

acme · 03-03-2013, 01:40 PM

I just did an rsync using this command:

Code:

sudo rsync -av --progress /Source_directory/ /Target_directory

My questions are:

1. why's the Target about .53 GB smaller than the source?

and

2. contains about 500 million fewer items?

should the results of a correct rsync-ing be identical to the source? Perhaps not in disc space used, if the discs are of diff. size, but certainly in the # of items?

thank you!

a

cpragman · 03-03-2013, 03:52 PM

did it finish successfully? Throw an error message?

acme · 03-03-2013, 03:53 PM

I believe so..here are the last 3 lines Terminal produced before appearing (to me) stopped:

sent 130221247836 bytes received 5154162 bytes 65194694.37 bytes/sec
total size is 130188799910 speedup is 1.00
tests-Mac-Pro:~ Lion$

fracai · 03-05-2013, 08:35 AM

Try running the command a second time. It should complete very quickly and produce not much more than that final output.

Then, compare the source and target using something like 'diff'.

Can you identify any files that were left out? How are you arriving at the item count?

acme · 03-05-2013, 09:05 AM

Quote:

Originally Posted by fracai


	Try running the command a second time. It should complete very quickly and produce not much more than that final output. Then, compare the source and target using something like 'diff'. Can you identify any files that were left out? How are you arriving at the item count?

I can run again

I'm comparing by doing get info on source and target; reveals GB size and # of items.

a

fracai · 03-05-2013, 12:40 PM

Not all the time, but I've occassionally seen inconsistent results with Get Info. It will often display cached results until it refreshes the information, so you mismatch may not exist.

Try using 'du' for the size comparison and 'find . | wc -l' for a file count. Metadata like '.DS_Store' files can still result in count differences, so you could do something like 'find . \! -name .DS_Store | wc -l' to filter out that difference.

I don't think I've ever seen an rsync task result in different numbers of files unless I was excluding items.

I usually use '--partial' to speed things up with interrupted transfers, but that shouldn't be a problem either way here.

acme · 03-09-2013, 11:33 AM

ran it again just now and the speed up was given as 256...

I presume that means the speed to back up the new files to sync compared to the total and to the first time when the whole thing had to be synced?

fracai · 03-12-2013, 11:57 AM

Speedup is the ratio of total bytes considered vs bytes transferred. So, size not time.

Do you still have a mismatch? Did you try comparing the 'du' size or the 'find' count?

03-03-2013, 01:40 PM	#1
acme MVP Join Date: Jan 2009 Posts: 1,684	rsync results questions I just did an rsync using this command: Code: sudo rsync -av --progress /Source_directory/ /Target_directory My questions are: 1. why's the Target about .53 GB smaller than the source? and 2. contains about 500 million fewer items? should the results of a correct rsync-ing be identical to the source? Perhaps not in disc space used, if the discs are of diff. size, but certainly in the # of items? thank you! a

03-05-2013, 08:35 AM	#4
fracai MVP Join Date: May 2004 Posts: 2,012	Try running the command a second time. It should complete very quickly and produce not much more than that final output. Then, compare the source and target using something like 'diff'. Can you identify any files that were left out? How are you arriving at the item count? __________________ i am jack's amusing sig file
$fracai is offline$

03-05-2013, 12:40 PM	#6
fracai MVP Join Date: May 2004 Posts: 2,012	Not all the time, but I've occassionally seen inconsistent results with Get Info. It will often display cached results until it refreshes the information, so you mismatch may not exist. Try using 'du' for the size comparison and 'find . \| wc -l' for a file count. Metadata like '.DS_Store' files can still result in count differences, so you could do something like 'find . \! -name .DS_Store \| wc -l' to filter out that difference. I don't think I've ever seen an rsync task result in different numbers of files unless I was excluding items. I usually use '--partial' to speed things up with interrupted transfers, but that shouldn't be a problem either way here. __________________ i am jack's amusing sig file
$fracai is offline$

03-09-2013, 11:33 AM	#7
acme MVP Join Date: Jan 2009 Posts: 1,684	ran it again just now and the speed up was given as 256... I presume that means the speed to back up the new files to sync compared to the total and to the first time when the whole thing had to be synced? Last edited by acme; 03-09-2013 at 12:27 PM.

03-12-2013, 11:57 AM	#8
fracai MVP Join Date: May 2004 Posts: 2,012	Speedup is the ratio of total bytes considered vs bytes transferred. So, size not time. Do you still have a mismatch? Did you try comparing the 'du' size or the 'find' count? __________________ i am jack's amusing sig file
$fracai is offline$

03-03-2013, 03:52 PM	#2
cpragman All Star Join Date: Jan 2004 Location: Limerick, PA Posts: 687	did it finish successfully? Throw an error message?

03-03-2013, 03:53 PM	#3
acme MVP Join Date: Jan 2009 Posts: 1,684	I believe so..here are the last 3 lines Terminal produced before appearing (to me) stopped: sent 130221247836 bytes received 5154162 bytes 65194694.37 bytes/sec total size is 130188799910 speedup is 1.00 tests-Mac-Pro:~ Lion$

Thread Tools
Show Printable Version Email this Page
Display Modes	Rate This Thread
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode	Rate This Thread: