[Box Backup] Box Backup Hive?
Fri, 16 Jun 2006 10:09:24 +0100
It's possible, but certainly not a priority. However, it would be
nice to have automatic sync between servers so you can back up to
more than one without using rysnc between them (which works well but
is a bit of a hack), and if you were going to do that, you might as
well implement this distribution method.
As for the code, the necessary abstraction is already in place --
stores are written through the RaidFile interface only. This could be
modified to do RAID over multiple servers rather than multiple discs.
On 15 Jun 2006, at 15:59, W. Chris Shank wrote:
> A backup hive would be like a massive internet-based raid. For
> instance, if I wanted to participate in the hive I may dedicate
> 10-20% of my diskspace to the hive, which lets say equates to 20G
> of space and I had 10G of data that I wanted to backup. So if
> there was 1000 nodes participating in the hive, that would be a
> total of 20,000 GB of available space. so my 10G of data would be
> distributed amongs the other 999 nodes. There would need to be
> significant redundancy, say 30%-40%, for when nodes were off-line.
> So even if 40% of the nodes were off-line i could reconstitute my
> backups using the other nodes and the parity information they
> This may not be practical for general Internet users where you
> don't have any obligation to maintain a node. But if you were a
> business with say hundreds of small sites spread out around the
> country (world?) and had some level of control of your nodes, this
> could be interesting method of backup and archiving. Each office
> would keep backup and parity info for every other office in the hive.
> ----- Original Message -----
> From: Per Thomsen <firstname.lastname@example.org>
> To: email@example.com
> Sent: Thursday, June 15, 2006 4:10:01 AM GMT-0500
> Subject: Re: [Box Backup] Box Backup Hive?
> On 6/14/06 2:36 PM, W. Chris Shank wrote:
>> I think that box backup could be the ideal base for a backup hive
>> system. A backup hive is kind of the reverse of bittorrent.
>> instead of a bunch of peers used to download the same file, the
>> peers would upload fragments of your encrypted, compressed, backup
>> set. It seems to me that box has most of the components needed.
>> I'm wondering what the developers think?
> Is this for data redundancy, to put the backup sets in multiple
> Per Reedtz Thomsen | Reedtz Consulting, LLC | F: 209 883 4119
> V: 209 883 4102 | firstname.lastname@example.org | C: 209 996 9561
> GPG ID: 1209784F | Yahoo! Chat: pthomsen | AIM: pthomsen
> boxbackup mailing list
> W. Chris Shank
> ACE Technology Group, LLC
> (610) 640-4223
> Security Note: To protect against computer viruses,
> e-mail programs may prevent sending or receiving
> certain types of file attachments. Check your e-mail
> security settings to determine how attachments are
> boxbackup mailing list