[Box Backup] Boxbackup deleted directories

Peter boxbackup@fluffy.co.uk
Mon, 27 Mar 2006 21:45:40 +0200


ons 2006-03-08 klockan 10:30 +0000 skrev Ben Summers:
> On 8 Mar 2006, at 10:24, Peter wrote:
> 
> > I'm running boxbackup from one clients server to another server housed
> > in an offsite data centre.
> >
> > Now, a while back the drive containing /home started acting funny with
> > read-errors on certain sectors.
> >
> > So I took it offline to run do some checking, and ordered a raid-card
> > and some new drives to replace it.
> >
> > I didn't kill bbackupd before I unmounted the drive however (but a  
> > short
> > time later), and when I now run bbackupquery it only lists one  
> > directory
> > in /home. The other dirs are listed as deleted.
> >
> > Now, when (and if) I manage to get most of the data off the semi- 
> > broken
> > disk and onto the new raid-array, will bbackupd have to re-transfer
> > everything?
> >
> > Or will box backup understand that it already have these files and
> > there's no need to transfer them again, just mark them as present and
> > not deleted?
> >
> > Alternatively, is there anyway I can tell box backup to make the  
> > deleted
> > directories be listed as present in the store again?
> 
> Stop bbackupd. Delete contents of /var/bbackupd . Then
> 
> bbackupquery -w
>     cd home
>     undelete dir1
>     undelete dir2
> 
>     etc...
> 
> That will mark everything as undeleted. When bbackupd nexts runs over  
> them, it'll put everything back to match what's on the disc.
> 
> There's a feature request on the wiki about this. A good one for the  
> next version, I think.
> 
> ben
> 

Hello again,

unfortunately, although the directories are back, nothing new seems to
be uploaded to the store.

This is what I get in the logs on the client (extended logging on):

Mar 27 21:04:15 biognos1 bbackupd[17522]: Send
ListDirectory(0xd91d5,0xffffffff,0xc,true)
Mar 27 21:04:18 biognos1 bbackupd[17522]: Receive Success(0xd91d5)
Mar 27 21:04:18 biognos1 bbackupd[17522]: Receiving stream, size
34284049
Mar 27 21:25:22 biognos1 bbackupd[17522]: Send
ListDirectory(0x150269,0xffffffff,0xc,true)
Mar 27 21:25:22 biognos1 bbackupd[17522]: Send
SetClientStoreMarker(0x40ffeef8dcc80)
Mar 27 21:25:22 biognos1 bbackupd[17522]: Exception caught (Connection
TLSReadFailed (Probably a network issue between client and server.)
7/34), reset state and waiting to retry...
Mar 27 21:25:32 biognos1 bbackupd[17522]: File statistics: total file
size uploaded 0, bytes already on server 0, encoded size 0
Mar 27 21:25:32 biognos1 bbackupd[17522]: Beginning scan of local files
Mar 27 21:25:32 biognos1 bbackupd[17522]: Opening connection to server
biognosbackup...
Mar 27 21:25:32 biognos1 bbackupd[17522]: Send Version(0x1)
Mar 27 21:25:32 biognos1 bbackupd[17522]: Receive Version(0x1)
Mar 27 21:25:32 biognos1 bbackupd[17522]: Send Login(0x1,0x0)
Mar 27 21:25:33 biognos1 bbackupd[17522]: Receive
LoginConfirmed(0x0,0xfb14de,0x3840000,0x3e80000)
Mar 27 21:25:33 biognos1 bbackupd[17522]: Connection made, login
successful
Mar 27 21:25:33 biognos1 bbackupd[17522]: Send
ListDirectory(0x1,0x2,0xc,false)

And on the server:

Mar 27 21:04:41 biognosbackup bbstored[21718]: Receive
ListDirectory(0xd91d5,0xffffffff,0xc,true)
Mar 27 21:04:41 biognosbackup bbstored[21718]: Receive
ListDirectory(0xd91d5,0xffffffff,0xc,true)
Mar 27 21:04:44 biognosbackup bbstored[21718]: Send Success(0xd91d5)
Mar 27 21:04:44 biognosbackup bbstored[21718]: Send Success(0xd91d5)
Mar 27 21:04:44 biognosbackup bbstored[21718]: Sending stream, size
34284049
Mar 27 21:10:04 biognosbackup bbstored/hk[19946]: Starting housekeeping
Mar 27 21:10:04 biognosbackup bbstored/hk[19946]: Finished housekeeping
Mar 27 21:24:27 biognosbackup bbstored[21718]: Connection statistics for
BACKUP-1: IN=3735 OUT=52433211 TOTAL=52436946
Mar 27 21:25:04 biognosbackup bbstored/hk[19946]: Starting housekeeping
Mar 27 21:25:59 biognosbackup bbstored[19945]: Incoming connection from
195.24.161.186 port 43663 (handling in child 21743)
Mar 27 21:25:59 biognosbackup bbstored[21743]: Certificate CN: BACKUP-1
Mar 27 21:25:59 biognosbackup bbstored[21743]: Receive Version(0x1)
Mar 27 21:25:59 biognosbackup bbstored[21743]: Receive Version(0x1)
Mar 27 21:25:59 biognosbackup bbstored[21743]: Send Version(0x1)
Mar 27 21:25:59 biognosbackup bbstored[21743]: Send Version(0x1)
Mar 27 21:25:59 biognosbackup bbstored[21743]: Receive Login(0x1,0x0)
Mar 27 21:25:59 biognosbackup bbstored[21743]: Receive Login(0x1,0x0)

I ran bbstoreaccounts and fixed four found problems, but the problem
remains the same.

We have quite large files on the client (some a few GB each), could this
be a cause for concern?

I added 
KeepAliveTime = 60
MaximumDiffingTime = 3600
to bbackupd.conf without success.

I upgraded both server and client to 0.10 but the problem remains
between versions.

Any ideas?

Thanks, 
Peter