[Box Backup] Redundant locations not removed?

[Tobias Balle-Petersen]

Hello Chris.

I now see whats going on:

When the client starts to upload to the store, the store is 96% full (soft limit). The upload
continues until the store is full. Housekeeping on the store does not delete any "deleted" files
while the client is logged in. The client gets disconnected when the store is full. The following
housekeeping on the store will delete "deleted" files until the usage of the store is again 96%
(soft limit). At this point I can initiate another sync. The 4 hours is the time it takes to move
enough data to get from 96% to 99%(100%).

Is this the way it is supposed to work?

I guess I could lower the soft limit temporarely to get around this.

Thanks,
Tobias



Tobias Balle-Petersen wrote:
> Hello Chris.
> 
> My files are now starting to be backed up. The backups stops after 4 hours however. Looking at the
> stats for the store, data is beeing transfered until the connection ends. As far as I can tell, this
>  would mean that this is not a SSL-timeout related problem. Client is 0.10 and store is chris_merge
> 1725.
> 
> I'm running at session again now. If it stops after 4 hours, I'm expecting it will, I will revert to
> 0.10 on the store as well and run a sync again.
> 
> 
> Logs from the two sessions I have run below.
> 
> -------------------------------------------
> CLIENT 0.10:
> -------------------------------------------
> 
> Session 1:
> Jul 24 13:00:29 yoiko bbackupd[402]: Incoming connection from local (UNIX socket)
> Jul 24 13:00:29 yoiko bbackupd[402]: Connection from command socket
> Jul 24 13:00:29 yoiko bbackupd[402]: Beginning scan of local files
> Jul 24 13:00:29 yoiko bbackupd[402]: Opening connection to server misora.local.kontrapunkt.dk...
> Jul 24 13:00:30 yoiko bbackupd[402]: Connection made, login successful
> Jul 24 17:01:39 yoiko bbackupd[402]: Exception caught (Connection Protocol_UnexpectedReply (Server
> probably reported an error.) 7/47), reset state and waiting to retry...
> Jul 24 17:01:49 yoiko bbackupd[402]: File statistics: total file size uploaded 93763175181, bytes
> already on server 0, encoded size 54271648859
> 
> Session 2:
> Jul 25 00:00:01 yoiko bbackupd[402]: Incoming connection from local (UNIX socket)
> Jul 25 00:00:01 yoiko bbackupd[402]: Connection from command socket
> Jul 25 00:00:01 yoiko bbackupd[402]: Beginning scan of local files
> Jul 25 00:00:01 yoiko bbackupd[402]: Opening connection to server misora.local.kontrapunkt.dk...
> Jul 25 00:00:01 yoiko bbackupd[402]: Connection made, login successful
> Jul 25 03:45:21 yoiko bbackupd[402]: Exception caught (Connection Protocol_UnexpectedReply (Server
> probably reported an error.) 7/47), reset state and waiting to retry...
> Jul 25 03:45:31 yoiko bbackupd[402]: File statistics: total file size uploaded 81804900665, bytes
> already on server 0, encoded size 54427385858
> 
> -------------------------------------------
> STORE chris_merge 1725:
> -------------------------------------------
> 
> Session 1:
> Jul 24 13:03:48 misora Box Backup (bbstored)[18666]: Incoming connection from 192.168.0.51 port
> 63456 (handling in child 32225)
> Jul 24 13:03:48 misora Box Backup (bbstored)[32225]: Certificate CN: BACKUP-1
> Jul 24 13:03:48 misora Box Backup (bbstored)[32225]: Login: Client ID 00000001, Read/Write
> Jul 24 13:08:29 misora bbstored/hk[18667]: Starting housekeeping
> Jul 24 13:09:29 misora bbstored/hk[18667]: Finished housekeeping
> .......
> .......
> .......
> Jul 24 16:53:30 misora bbstored/hk[18667]: Starting housekeeping
> Jul 24 16:54:30 misora bbstored/hk[18667]: Finished housekeeping
> Jul 24 17:04:58 misora Box Backup (bbstored)[32225]: Session finished
> Jul 24 17:04:58 misora Box Backup (bbstored)[32225]: Connection statistics for BACKUP-1:
> IN=54273151997 OUT=2917099 TOTAL=54276069096
> 
> Session 2:
> Jul 25 00:03:20 misora Box Backup (bbstored)[18666]: Incoming connection from 192.168.0.51 port
> 51921 (handling in child 10676)
> Jul 25 00:03:20 misora Box Backup (bbstored)[10676]: Certificate CN: BACKUP-1
> Jul 25 00:03:20 misora Box Backup (bbstored)[10676]: Login: Client ID 00000001, Read/Write
> Jul 25 00:08:45 misora bbstored/hk[18667]: Starting housekeeping
> Jul 25 00:09:45 misora bbstored/hk[18667]: Finished housekeeping
> .......
> .......
> .......
> Jul 25 03:38:46 misora bbstored/hk[18667]: Starting housekeeping
> Jul 25 03:39:46 misora bbstored/hk[18667]: Finished housekeeping
> Jul 25 03:48:41 misora Box Backup (bbstored)[10676]: Session finished
> Jul 25 03:48:41 misora Box Backup (bbstored)[10676]: Connection statistics for BACKUP-1:
> IN=54428917970 OUT=3562128 TOTAL=54432480098
> 
> 
> Thanks,
> Tobias
> 
> 
> 
> Chris Wilson wrote:
>> Hi Tobias,
>>
>> On Tue, 24 Jul 2007, Tobias Balle-Petersen wrote:
>>
>>> I reverted back to 0.10 client from chris_merge 1696. The redundant
>>> locations were removed after 48 hours as they should be. My files are
>>> now being backed up.
>>>
>>> The store is still chris_merge.
>>>
>>> So it would seem there was an error in client v. 1696.
>> Indeed, thanks for letting me know, will look into it.
>>
>> Cheers, Chris.
> 
> _______________________________________________
> boxbackup mailing list
> boxbackup@fluffy.co.uk
> http://lists.warhead.org.uk/mailman/listinfo/boxbackup
>