[Box Backup] Redundant locations not removed?
Tobias Balle-Petersen
boxbackup@fluffy.co.uk
Wed, 25 Jul 2007 15:42:58 +0200
Hello Chris.
The 1696 client did nothing when attempting a sync. I'm now back at 0.10 store and 0.10 client.
Now files are not beeing backed up because the store is 99% full:
Jul 25 15:32:23 yoiko bbackupd[24426]: Starting daemon (config: /etc/box_misora/bbackupd.conf)
(version 0.10)
Jul 25 15:34:28 yoiko bbackupd[24426]: Incoming connection from local (UNIX socket)
Jul 25 15:34:28 yoiko bbackupd[24426]: Connection from command socket
Jul 25 15:34:28 yoiko bbackupd[24426]: Beginning scan of local files
Jul 25 15:34:28 yoiko bbackupd[24426]: Opening connection to server misora.local.kontrapunkt.dk...
Jul 25 15:34:29 yoiko bbackupd[24426]: Connection made, login successful
Jul 25 15:34:29 yoiko bbackupd[24426]: Exceeded storage limits on server -- not uploading changes to
files
Jul 25 15:34:29 yoiko bbackupd[24426]: About to notify administrator about event store-full, running
script '/etc/box_misora/bbackupd/NotifySysadmin.sh store-full'
Jul 25 15:34:29 yoiko bbackupd[24426]: Finished scan of local files
Jul 25 15:34:29 yoiko bbackupd[24426]: File statistics: total file size uploaded 0, bytes already on
server 0, encoded size 0
The thing is, 73% of the files are deleted files. Shouldn't they be removed and the new files be
backed up?
Used 1331183.2Mb 99% ***************************************
Old files 0.0Mb 0%
Deleted files 972295.6Mb 73% *****************************
Directories 626.1Mb 0%
Soft limit 1280000.0Mb 96% **************************************
Hard limit 1331200.0Mb 100% ****************************************
Thanks,
Tobias
Tobias Balle-Petersen wrote:
> Hello Chris.
>
> As expected, the backup ended after approx. 4 hours:
> Jul 25 10:59:54 yoiko bbackupd[402]: Incoming connection from local (UNIX socket)
> Jul 25 10:59:54 yoiko bbackupd[402]: Connection from command socket
> Jul 25 10:59:54 yoiko bbackupd[402]: Beginning scan of local files
> Jul 25 10:59:54 yoiko bbackupd[402]: Opening connection to server misora.local.kontrapunkt.dk...
> Jul 25 10:59:54 yoiko bbackupd[402]: Connection made, login successful
> Jul 25 15:06:14 yoiko bbackupd[402]: Exception caught (Connection Protocol_UnexpectedReply (Server
> probably reported an error.) 7/47), reset state and waiting to retry...
> Jul 25 15:06:24 yoiko bbackupd[402]: File statistics: total file size uploaded 93870658096, bytes
> already on server 0, encoded size 53966419139
>
> I'm now running a sync with the chris_merge 1696 client and chris_merge 1725 store.
>
> If this fails, I'll revert to the 0.10 store as I wrote previously.
>
> Tobias
>
>
> Tobias Balle-Petersen wrote:
>> Hello Chris.
>>
>> My files are now starting to be backed up. The backups stops after 4 hours however. Looking at the
>> stats for the store, data is beeing transfered until the connection ends. As far as I can tell, this
>> would mean that this is not a SSL-timeout related problem. Client is 0.10 and store is chris_merge
>> 1725.
>>
>> I'm running at session again now. If it stops after 4 hours, I'm expecting it will, I will revert to
>> 0.10 on the store as well and run a sync again.
>>
>>
>> Logs from the two sessions I have run below.
>>
>> -------------------------------------------
>> CLIENT 0.10:
>> -------------------------------------------
>>
>> Session 1:
>> Jul 24 13:00:29 yoiko bbackupd[402]: Incoming connection from local (UNIX socket)
>> Jul 24 13:00:29 yoiko bbackupd[402]: Connection from command socket
>> Jul 24 13:00:29 yoiko bbackupd[402]: Beginning scan of local files
>> Jul 24 13:00:29 yoiko bbackupd[402]: Opening connection to server misora.local.kontrapunkt.dk...
>> Jul 24 13:00:30 yoiko bbackupd[402]: Connection made, login successful
>> Jul 24 17:01:39 yoiko bbackupd[402]: Exception caught (Connection Protocol_UnexpectedReply (Server
>> probably reported an error.) 7/47), reset state and waiting to retry...
>> Jul 24 17:01:49 yoiko bbackupd[402]: File statistics: total file size uploaded 93763175181, bytes
>> already on server 0, encoded size 54271648859
>>
>> Session 2:
>> Jul 25 00:00:01 yoiko bbackupd[402]: Incoming connection from local (UNIX socket)
>> Jul 25 00:00:01 yoiko bbackupd[402]: Connection from command socket
>> Jul 25 00:00:01 yoiko bbackupd[402]: Beginning scan of local files
>> Jul 25 00:00:01 yoiko bbackupd[402]: Opening connection to server misora.local.kontrapunkt.dk...
>> Jul 25 00:00:01 yoiko bbackupd[402]: Connection made, login successful
>> Jul 25 03:45:21 yoiko bbackupd[402]: Exception caught (Connection Protocol_UnexpectedReply (Server
>> probably reported an error.) 7/47), reset state and waiting to retry...
>> Jul 25 03:45:31 yoiko bbackupd[402]: File statistics: total file size uploaded 81804900665, bytes
>> already on server 0, encoded size 54427385858
>>
>> -------------------------------------------
>> STORE chris_merge 1725:
>> -------------------------------------------
>>
>> Session 1:
>> Jul 24 13:03:48 misora Box Backup (bbstored)[18666]: Incoming connection from 192.168.0.51 port
>> 63456 (handling in child 32225)
>> Jul 24 13:03:48 misora Box Backup (bbstored)[32225]: Certificate CN: BACKUP-1
>> Jul 24 13:03:48 misora Box Backup (bbstored)[32225]: Login: Client ID 00000001, Read/Write
>> Jul 24 13:08:29 misora bbstored/hk[18667]: Starting housekeeping
>> Jul 24 13:09:29 misora bbstored/hk[18667]: Finished housekeeping
>> .......
>> .......
>> .......
>> Jul 24 16:53:30 misora bbstored/hk[18667]: Starting housekeeping
>> Jul 24 16:54:30 misora bbstored/hk[18667]: Finished housekeeping
>> Jul 24 17:04:58 misora Box Backup (bbstored)[32225]: Session finished
>> Jul 24 17:04:58 misora Box Backup (bbstored)[32225]: Connection statistics for BACKUP-1:
>> IN=54273151997 OUT=2917099 TOTAL=54276069096
>>
>> Session 2:
>> Jul 25 00:03:20 misora Box Backup (bbstored)[18666]: Incoming connection from 192.168.0.51 port
>> 51921 (handling in child 10676)
>> Jul 25 00:03:20 misora Box Backup (bbstored)[10676]: Certificate CN: BACKUP-1
>> Jul 25 00:03:20 misora Box Backup (bbstored)[10676]: Login: Client ID 00000001, Read/Write
>> Jul 25 00:08:45 misora bbstored/hk[18667]: Starting housekeeping
>> Jul 25 00:09:45 misora bbstored/hk[18667]: Finished housekeeping
>> .......
>> .......
>> .......
>> Jul 25 03:38:46 misora bbstored/hk[18667]: Starting housekeeping
>> Jul 25 03:39:46 misora bbstored/hk[18667]: Finished housekeeping
>> Jul 25 03:48:41 misora Box Backup (bbstored)[10676]: Session finished
>> Jul 25 03:48:41 misora Box Backup (bbstored)[10676]: Connection statistics for BACKUP-1:
>> IN=54428917970 OUT=3562128 TOTAL=54432480098
>>
>>
>> Thanks,
>> Tobias
>>
>>
>>
>> Chris Wilson wrote:
>>> Hi Tobias,
>>>
>>> On Tue, 24 Jul 2007, Tobias Balle-Petersen wrote:
>>>
>>>> I reverted back to 0.10 client from chris_merge 1696. The redundant
>>>> locations were removed after 48 hours as they should be. My files are
>>>> now being backed up.
>>>>
>>>> The store is still chris_merge.
>>>>
>>>> So it would seem there was an error in client v. 1696.
>>> Indeed, thanks for letting me know, will look into it.
>>>
>>> Cheers, Chris.
>> _______________________________________________
>> boxbackup mailing list
>> boxbackup@fluffy.co.uk
>> http://lists.warhead.org.uk/mailman/listinfo/boxbackup
>>
>
> _______________________________________________
> boxbackup mailing list
> boxbackup@fluffy.co.uk
> http://lists.warhead.org.uk/mailman/listinfo/boxbackup
>