[Box Backup] Boxbackup deleted directories

[Ben Summers]

On 27 Mar 2006, at 20:45, Peter wrote:

> ons 2006-03-08 klockan 10:30 +0000 skrev Ben Summers:
>> On 8 Mar 2006, at 10:24, Peter wrote:
>>
>>> I'm running boxbackup from one clients server to another server  
>>> housed
>>> in an offsite data centre.
>>>
>>> Now, a while back the drive containing /home started acting funny  
>>> with
>>> read-errors on certain sectors.
>>>
>>> So I took it offline to run do some checking, and ordered a raid- 
>>> card
>>> and some new drives to replace it.
>>>
>>> I didn't kill bbackupd before I unmounted the drive however (but a
>>> short
>>> time later), and when I now run bbackupquery it only lists one
>>> directory
>>> in /home. The other dirs are listed as deleted.
>>>
>>> Now, when (and if) I manage to get most of the data off the semi-
>>> broken
>>> disk and onto the new raid-array, will bbackupd have to re-transfer
>>> everything?
>>>
>>> Or will box backup understand that it already have these files and
>>> there's no need to transfer them again, just mark them as present  
>>> and
>>> not deleted?
>>>
>>> Alternatively, is there anyway I can tell box backup to make the
>>> deleted
>>> directories be listed as present in the store again?
>>
>> Stop bbackupd. Delete contents of /var/bbackupd . Then
>>
>> bbackupquery -w
>>     cd home
>>     undelete dir1
>>     undelete dir2
>>
>>     etc...
>>
>> That will mark everything as undeleted. When bbackupd nexts runs over
>> them, it'll put everything back to match what's on the disc.
>>
>> There's a feature request on the wiki about this. A good one for the
>> next version, I think.
>>
>> ben
>>
>
> Hello again,
>
> unfortunately, although the directories are back, nothing new seems to
> be uploaded to the store.
>
> This is what I get in the logs on the client (extended logging on):
>
> Mar 27 21:04:15 biognos1 bbackupd[17522]: Send
> ListDirectory(0xd91d5,0xffffffff,0xc,true)
> Mar 27 21:04:18 biognos1 bbackupd[17522]: Receive Success(0xd91d5)
> Mar 27 21:04:18 biognos1 bbackupd[17522]: Receiving stream, size
> 34284049
> Mar 27 21:25:22 biognos1 bbackupd[17522]: Send
> ListDirectory(0x150269,0xffffffff,0xc,true)
> Mar 27 21:25:22 biognos1 bbackupd[17522]: Send
> SetClientStoreMarker(0x40ffeef8dcc80)
> Mar 27 21:25:22 biognos1 bbackupd[17522]: Exception caught (Connection
> TLSReadFailed (Probably a network issue between client and server.)
> 7/34), reset state and waiting to retry...
> Mar 27 21:25:32 biognos1 bbackupd[17522]: File statistics: total file
> size uploaded 0, bytes already on server 0, encoded size 0
> Mar 27 21:25:32 biognos1 bbackupd[17522]: Beginning scan of local  
> files
> Mar 27 21:25:32 biognos1 bbackupd[17522]: Opening connection to server
> biognosbackup...
> Mar 27 21:25:32 biognos1 bbackupd[17522]: Send Version(0x1)
> Mar 27 21:25:32 biognos1 bbackupd[17522]: Receive Version(0x1)
> Mar 27 21:25:32 biognos1 bbackupd[17522]: Send Login(0x1,0x0)
> Mar 27 21:25:33 biognos1 bbackupd[17522]: Receive
> LoginConfirmed(0x0,0xfb14de,0x3840000,0x3e80000)
> Mar 27 21:25:33 biognos1 bbackupd[17522]: Connection made, login
> successful
> Mar 27 21:25:33 biognos1 bbackupd[17522]: Send
> ListDirectory(0x1,0x2,0xc,false)
>
> And on the server:
>
> Mar 27 21:04:41 biognosbackup bbstored[21718]: Receive
> ListDirectory(0xd91d5,0xffffffff,0xc,true)
> Mar 27 21:04:41 biognosbackup bbstored[21718]: Receive
> ListDirectory(0xd91d5,0xffffffff,0xc,true)
> Mar 27 21:04:44 biognosbackup bbstored[21718]: Send Success(0xd91d5)
> Mar 27 21:04:44 biognosbackup bbstored[21718]: Send Success(0xd91d5)
> Mar 27 21:04:44 biognosbackup bbstored[21718]: Sending stream, size
> 34284049
> Mar 27 21:10:04 biognosbackup bbstored/hk[19946]: Starting  
> housekeeping
> Mar 27 21:10:04 biognosbackup bbstored/hk[19946]: Finished  
> housekeeping
> Mar 27 21:24:27 biognosbackup bbstored[21718]: Connection  
> statistics for
> BACKUP-1: IN=3735 OUT=52433211 TOTAL=52436946
> Mar 27 21:25:04 biognosbackup bbstored/hk[19946]: Starting  
> housekeeping
> Mar 27 21:25:59 biognosbackup bbstored[19945]: Incoming connection  
> from
> 195.24.161.186 port 43663 (handling in child 21743)
> Mar 27 21:25:59 biognosbackup bbstored[21743]: Certificate CN:  
> BACKUP-1
> Mar 27 21:25:59 biognosbackup bbstored[21743]: Receive Version(0x1)
> Mar 27 21:25:59 biognosbackup bbstored[21743]: Receive Version(0x1)
> Mar 27 21:25:59 biognosbackup bbstored[21743]: Send Version(0x1)
> Mar 27 21:25:59 biognosbackup bbstored[21743]: Send Version(0x1)
> Mar 27 21:25:59 biognosbackup bbstored[21743]: Receive Login(0x1,0x0)
> Mar 27 21:25:59 biognosbackup bbstored[21743]: Receive Login(0x1,0x0)
>
> I ran bbstoreaccounts and fixed four found problems, but the problem
> remains the same.
>
> We have quite large files on the client (some a few GB each), could  
> this
> be a cause for concern?
>
> I added
> KeepAliveTime = 60
> MaximumDiffingTime = 3600
> to bbackupd.conf without success.
>
> I upgraded both server and client to 0.10 but the problem remains
> between versions.
>
> Any ideas?

Could be the large files if there isn't enough free space in the  
account. Run bbstoreaccounts info to find out.

Ben