[Box Backup] Restore & Compare Issue ** UPDATE **

Chris Wilson boxbackup@fluffy.co.uk
Tue, 24 Apr 2007 09:24:36 +0100 (BST)


Hi Matt,

On Tue, 24 Apr 2007, Matt Brown wrote:

>> > Do you have any huge directories backed up?
>> 
>> Only this one 3.5GB file (its a 20GB SQL database file compressed to 3.5GB 
>> (gzip))

By the way, I don't think this is a good idea. Because of the way that 
gzip works, you will end up uploading about 3.5 GB every night (replacing 
the entire file).

Normally for an rsync-style backup I would recommend that you back up 
uncompressed files instead. Box Backup does its own compression, so you 
should not actually lose much space on the server. However, I'm not sure 
whether it will be any more efficient on uploads because it depends how 
much of that 20 GB file gets churned every day. I'd say it's definitely 
worth a try.

> Ok I have now tried with two other files, 1 which was 8k in size and 1 
> which was 11MB in size. Both were fetched without any TLS issues - 
> therefore it appears that BB has an issue restoring single files over a 
> certain size. The file I am trying to restore is 3.5GB is there a limit 
> anywhere ?

There should not be, but it's possible that either there is a bug with 
restoring large files (over 2 GB), or that the filesystem that you're 
restoring to does not support large files.

To eliminate the latter, could you try dd'ing a large file in the restore 
directory? (Is that /tmp? Is it a ramdisk by any chance?)

 	dd if=/dev/zero of=/tmp/bigfile bs=1M count=4k

and check that it does actually produce a 4GB file?

Cheers, Chris.
-- 
_____ __     _
\  __/ / ,__(_)_  | Chris Wilson <0000 at qwirx.com> - Cambs UK |
/ (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer |
\ _/_/_/_//_/___/ | We are GNU-free your mind-and your software |