[Box Backup] Boxbackup deleted directories

Peter boxbackup@fluffy.co.uk
Mon, 27 Mar 2006 22:24:41 +0200


mån 2006-03-27 klockan 21:14 +0100 skrev Ben Summers:
> On 27 Mar 2006, at 20:45, Peter wrote:
> 
> > ons 2006-03-08 klockan 10:30 +0000 skrev Ben Summers:
> >> On 8 Mar 2006, at 10:24, Peter wrote:
> >>
> >>> I'm running boxbackup from one clients server to another server  
> >>> housed
> >>> in an offsite data centre.
> >>>
> >>> Now, a while back the drive containing /home started acting funny  
> >>> with
> >>> read-errors on certain sectors.
> >>>
> >>> So I took it offline to run do some checking, and ordered a raid- 
> >>> card
> >>> and some new drives to replace it.
> >>>
> >>> I didn't kill bbackupd before I unmounted the drive however (but a
> >>> short
> >>> time later), and when I now run bbackupquery it only lists one
> >>> directory
> >>> in /home. The other dirs are listed as deleted.
> >>>
> >>> Now, when (and if) I manage to get most of the data off the semi-
> >>> broken
> >>> disk and onto the new raid-array, will bbackupd have to re-transfer
> >>> everything?
> >>>
> >>> Or will box backup understand that it already have these files and
> >>> there's no need to transfer them again, just mark them as present  
> >>> and
> >>> not deleted?
> >>>
> >>> Alternatively, is there anyway I can tell box backup to make the
> >>> deleted
> >>> directories be listed as present in the store again?
> >>
> >> Stop bbackupd. Delete contents of /var/bbackupd . Then
> >>
> >> bbackupquery -w
> >>     cd home
> >>     undelete dir1
> >>     undelete dir2
> >>
> >>     etc...
> >>
> >> That will mark everything as undeleted. When bbackupd nexts runs over
> >> them, it'll put everything back to match what's on the disc.
> >>
> >> There's a feature request on the wiki about this. A good one for the
> >> next version, I think.
> >>
> >> ben
> >>
> >
> > Hello again,
> >
> > unfortunately, although the directories are back, nothing new seems to
> > be uploaded to the store.
> >
> > This is what I get in the logs on the client (extended logging on):
> >
> > Mar 27 21:04:15 biognos1 bbackupd[17522]: Send
> > ListDirectory(0xd91d5,0xffffffff,0xc,true)
> > Mar 27 21:04:18 biognos1 bbackupd[17522]: Receive Success(0xd91d5)
> > Mar 27 21:04:18 biognos1 bbackupd[17522]: Receiving stream, size
> > 34284049
> > Mar 27 21:25:22 biognos1 bbackupd[17522]: Send
> > ListDirectory(0x150269,0xffffffff,0xc,true)
> > Mar 27 21:25:22 biognos1 bbackupd[17522]: Send
> > SetClientStoreMarker(0x40ffeef8dcc80)
> > Mar 27 21:25:22 biognos1 bbackupd[17522]: Exception caught (Connection
> > TLSReadFailed (Probably a network issue between client and server.)
> > 7/34), reset state and waiting to retry...
> > Mar 27 21:25:32 biognos1 bbackupd[17522]: File statistics: total file
> > size uploaded 0, bytes already on server 0, encoded size 0
> > Mar 27 21:25:32 biognos1 bbackupd[17522]: Beginning scan of local  
> > files
> > Mar 27 21:25:32 biognos1 bbackupd[17522]: Opening connection to server
> > biognosbackup...
> > Mar 27 21:25:32 biognos1 bbackupd[17522]: Send Version(0x1)
> > Mar 27 21:25:32 biognos1 bbackupd[17522]: Receive Version(0x1)
> > Mar 27 21:25:32 biognos1 bbackupd[17522]: Send Login(0x1,0x0)
> > Mar 27 21:25:33 biognos1 bbackupd[17522]: Receive
> > LoginConfirmed(0x0,0xfb14de,0x3840000,0x3e80000)
> > Mar 27 21:25:33 biognos1 bbackupd[17522]: Connection made, login
> > successful
> > Mar 27 21:25:33 biognos1 bbackupd[17522]: Send
> > ListDirectory(0x1,0x2,0xc,false)
> >
> > And on the server:
> >
> > Mar 27 21:04:41 biognosbackup bbstored[21718]: Receive
> > ListDirectory(0xd91d5,0xffffffff,0xc,true)
> > Mar 27 21:04:41 biognosbackup bbstored[21718]: Receive
> > ListDirectory(0xd91d5,0xffffffff,0xc,true)
> > Mar 27 21:04:44 biognosbackup bbstored[21718]: Send Success(0xd91d5)
> > Mar 27 21:04:44 biognosbackup bbstored[21718]: Send Success(0xd91d5)
> > Mar 27 21:04:44 biognosbackup bbstored[21718]: Sending stream, size
> > 34284049
> > Mar 27 21:10:04 biognosbackup bbstored/hk[19946]: Starting  
> > housekeeping
> > Mar 27 21:10:04 biognosbackup bbstored/hk[19946]: Finished  
> > housekeeping
> > Mar 27 21:24:27 biognosbackup bbstored[21718]: Connection  
> > statistics for
> > BACKUP-1: IN=3735 OUT=52433211 TOTAL=52436946
> > Mar 27 21:25:04 biognosbackup bbstored/hk[19946]: Starting  
> > housekeeping
> > Mar 27 21:25:59 biognosbackup bbstored[19945]: Incoming connection  
> > from
> > 195.24.161.186 port 43663 (handling in child 21743)
> > Mar 27 21:25:59 biognosbackup bbstored[21743]: Certificate CN:  
> > BACKUP-1
> > Mar 27 21:25:59 biognosbackup bbstored[21743]: Receive Version(0x1)
> > Mar 27 21:25:59 biognosbackup bbstored[21743]: Receive Version(0x1)
> > Mar 27 21:25:59 biognosbackup bbstored[21743]: Send Version(0x1)
> > Mar 27 21:25:59 biognosbackup bbstored[21743]: Send Version(0x1)
> > Mar 27 21:25:59 biognosbackup bbstored[21743]: Receive Login(0x1,0x0)
> > Mar 27 21:25:59 biognosbackup bbstored[21743]: Receive Login(0x1,0x0)
> >
> > I ran bbstoreaccounts and fixed four found problems, but the problem
> > remains the same.
> >
> > We have quite large files on the client (some a few GB each), could  
> > this
> > be a cause for concern?
> >
> > I added
> > KeepAliveTime = 60
> > MaximumDiffingTime = 3600
> > to bbackupd.conf without success.
> >
> > I upgraded both server and client to 0.10 but the problem remains
> > between versions.
> >
> > Any ideas?
> 
> Could be the large files if there isn't enough free space in the  
> account. Run bbstoreaccounts info to find out.
> 
> Ben
> 

Should be plenty of free space;

                  Account ID: 00000001
              Last object ID: 3350743
                 Blocks used: 16454879 (64276.87Mb)
    Blocks used by old files: 720120 (2812.97Mb)
Blocks used by deleted files: 4 (0.02Mb)
  Blocks used by directories: 79419 (310.23Mb)
            Block soft limit: 58982400 (230400.00Mb)
            Block hard limit: 65536000 (256000.00Mb)
         Client store marker: 0

/Peter