[Box Backup] Box Backup Hive?

Ben Summers boxbackup@fluffy.co.uk
Fri, 16 Jun 2006 10:09:24 +0100

It's possible, but certainly not a priority. However, it would be  
nice to have automatic sync between servers so you can back up to  
more than one without using rysnc between them (which works well but  
is a bit of a hack), and if you were going to do that, you might as  
well implement this distribution method.

As for the code, the necessary abstraction is already in place --  
stores are written through the RaidFile interface only. This could be  
modified to do RAID over multiple servers rather than multiple discs.


On 15 Jun 2006, at 15:59, W. Chris Shank wrote:

> A backup hive would be like a massive internet-based raid. For  
> instance, if I wanted to participate in the hive I may dedicate  
> 10-20% of my diskspace to the hive, which lets say equates to 20G  
> of space and I had 10G of data that I wanted to backup.  So if  
> there was 1000 nodes participating in the hive, that would be a  
> total of 20,000 GB of available space. so my 10G of data would be  
> distributed amongs the other 999 nodes. There would need to be  
> significant redundancy, say 30%-40%, for when nodes were off-line.  
> So even if 40% of the nodes were off-line i could reconstitute my  
> backups using the other nodes and the parity information they  
> contained.
> This may not be practical for general Internet users where you  
> don't have any obligation to maintain a node. But if you were a  
> business with say hundreds of small sites spread out around the  
> country (world?) and had some level of control of your nodes, this  
> could be interesting method of backup and archiving. Each office  
> would keep backup and parity info for every other office in the hive.
> ----- Original Message -----
> From: Per Thomsen <pthomsen@reedtz.com>
> To: boxbackup@fluffy.co.uk
> Sent: Thursday, June 15, 2006 4:10:01 AM GMT-0500
> Subject: Re: [Box Backup] Box Backup Hive?
> On 6/14/06 2:36 PM, W. Chris Shank wrote:
>> I think that box backup could be the ideal base for a backup hive  
>> system. A backup hive is kind of the reverse of bittorrent.  
>> instead of a bunch of peers used to download the same file, the  
>> peers would upload fragments of your encrypted, compressed, backup  
>> set. It seems to me that box has most of the components needed.  
>> I'm wondering what the developers think?
> Is this for data redundancy, to put the backup sets in multiple  
> places?
> Thanks,
> Per
> -- 
> Per Reedtz Thomsen | Reedtz Consulting, LLC | F: 209 883 4119
> V: 209 883 4102 | pthomsen@reedtz.com | C: 209 996 9561
> GPG ID: 1209784F | Yahoo! Chat: pthomsen | AIM: pthomsen
> _______________________________________________
> boxbackup mailing list
> boxbackup@fluffy.co.uk
> http://lists.warhead.org.uk/mailman/listinfo/boxbackup
> -- 
> W. Chris Shank
> ACE Technology Group, LLC
> www.myremoteITdept.com
> (610) 640-4223
> --------------------------------
> Security Note: To protect against computer viruses,
> e-mail programs may prevent sending or receiving
> certain types of file attachments. Check your e-mail
> security settings to determine how attachments are
> handled.
> _______________________________________________
> boxbackup mailing list
> boxbackup@fluffy.co.uk
> http://lists.warhead.org.uk/mailman/listinfo/boxbackup