[Box Backup] Redundant locations not removed?
Tobias Balle-Petersen
boxbackup@fluffy.co.uk
Wed, 25 Jul 2007 15:59:28 +0200
Hello Chris.
I was a bit quick with my last mail. Housekeeping has now run on my store and deleted files.
Thanks,
Tobias
Tobias Balle-Petersen wrote:
> Hello Chris.
>
> The 1696 client did nothing when attempting a sync. I'm now back at 0.10 store and 0.10 client.
>
> Now files are not beeing backed up because the store is 99% full:
> Jul 25 15:32:23 yoiko bbackupd[24426]: Starting daemon (config: /etc/box_misora/bbackupd.conf)
> (version 0.10)
> Jul 25 15:34:28 yoiko bbackupd[24426]: Incoming connection from local (UNIX socket)
> Jul 25 15:34:28 yoiko bbackupd[24426]: Connection from command socket
> Jul 25 15:34:28 yoiko bbackupd[24426]: Beginning scan of local files
> Jul 25 15:34:28 yoiko bbackupd[24426]: Opening connection to server misora.local.kontrapunkt.dk...
> Jul 25 15:34:29 yoiko bbackupd[24426]: Connection made, login successful
> Jul 25 15:34:29 yoiko bbackupd[24426]: Exceeded storage limits on server -- not uploading changes to
> files
> Jul 25 15:34:29 yoiko bbackupd[24426]: About to notify administrator about event store-full, running
> script '/etc/box_misora/bbackupd/NotifySysadmin.sh store-full'
> Jul 25 15:34:29 yoiko bbackupd[24426]: Finished scan of local files
> Jul 25 15:34:29 yoiko bbackupd[24426]: File statistics: total file size uploaded 0, bytes already on
> server 0, encoded size 0
>
> The thing is, 73% of the files are deleted files. Shouldn't they be removed and the new files be
> backed up?
>
> Used 1331183.2Mb 99% ***************************************
> Old files 0.0Mb 0%
> Deleted files 972295.6Mb 73% *****************************
> Directories 626.1Mb 0%
> Soft limit 1280000.0Mb 96% **************************************
> Hard limit 1331200.0Mb 100% ****************************************
>
> Thanks,
> Tobias
>
>
>
> Tobias Balle-Petersen wrote:
>> Hello Chris.
>>
>> As expected, the backup ended after approx. 4 hours:
>> Jul 25 10:59:54 yoiko bbackupd[402]: Incoming connection from local (UNIX socket)
>> Jul 25 10:59:54 yoiko bbackupd[402]: Connection from command socket
>> Jul 25 10:59:54 yoiko bbackupd[402]: Beginning scan of local files
>> Jul 25 10:59:54 yoiko bbackupd[402]: Opening connection to server misora.local.kontrapunkt.dk...
>> Jul 25 10:59:54 yoiko bbackupd[402]: Connection made, login successful
>> Jul 25 15:06:14 yoiko bbackupd[402]: Exception caught (Connection Protocol_UnexpectedReply (Server
>> probably reported an error.) 7/47), reset state and waiting to retry...
>> Jul 25 15:06:24 yoiko bbackupd[402]: File statistics: total file size uploaded 93870658096, bytes
>> already on server 0, encoded size 53966419139
>>
>> I'm now running a sync with the chris_merge 1696 client and chris_merge 1725 store.
>>
>> If this fails, I'll revert to the 0.10 store as I wrote previously.
>>
>> Tobias
>>
>>
>> Tobias Balle-Petersen wrote:
>>> Hello Chris.
>>>
>>> My files are now starting to be backed up. The backups stops after 4 hours however. Looking at the
>>> stats for the store, data is beeing transfered until the connection ends. As far as I can tell, this
>>> would mean that this is not a SSL-timeout related problem. Client is 0.10 and store is chris_merge
>>> 1725.
>>>
>>> I'm running at session again now. If it stops after 4 hours, I'm expecting it will, I will revert to
>>> 0.10 on the store as well and run a sync again.
>>>
>>>
>>> Logs from the two sessions I have run below.
>>>
>>> -------------------------------------------
>>> CLIENT 0.10:
>>> -------------------------------------------
>>>
>>> Session 1:
>>> Jul 24 13:00:29 yoiko bbackupd[402]: Incoming connection from local (UNIX socket)
>>> Jul 24 13:00:29 yoiko bbackupd[402]: Connection from command socket
>>> Jul 24 13:00:29 yoiko bbackupd[402]: Beginning scan of local files
>>> Jul 24 13:00:29 yoiko bbackupd[402]: Opening connection to server misora.local.kontrapunkt.dk...
>>> Jul 24 13:00:30 yoiko bbackupd[402]: Connection made, login successful
>>> Jul 24 17:01:39 yoiko bbackupd[402]: Exception caught (Connection Protocol_UnexpectedReply (Server
>>> probably reported an error.) 7/47), reset state and waiting to retry...
>>> Jul 24 17:01:49 yoiko bbackupd[402]: File statistics: total file size uploaded 93763175181, bytes
>>> already on server 0, encoded size 54271648859
>>>
>>> Session 2:
>>> Jul 25 00:00:01 yoiko bbackupd[402]: Incoming connection from local (UNIX socket)
>>> Jul 25 00:00:01 yoiko bbackupd[402]: Connection from command socket
>>> Jul 25 00:00:01 yoiko bbackupd[402]: Beginning scan of local files
>>> Jul 25 00:00:01 yoiko bbackupd[402]: Opening connection to server misora.local.kontrapunkt.dk...
>>> Jul 25 00:00:01 yoiko bbackupd[402]: Connection made, login successful
>>> Jul 25 03:45:21 yoiko bbackupd[402]: Exception caught (Connection Protocol_UnexpectedReply (Server
>>> probably reported an error.) 7/47), reset state and waiting to retry...
>>> Jul 25 03:45:31 yoiko bbackupd[402]: File statistics: total file size uploaded 81804900665, bytes
>>> already on server 0, encoded size 54427385858
>>>
>>> -------------------------------------------
>>> STORE chris_merge 1725:
>>> -------------------------------------------
>>>
>>> Session 1:
>>> Jul 24 13:03:48 misora Box Backup (bbstored)[18666]: Incoming connection from 192.168.0.51 port
>>> 63456 (handling in child 32225)
>>> Jul 24 13:03:48 misora Box Backup (bbstored)[32225]: Certificate CN: BACKUP-1
>>> Jul 24 13:03:48 misora Box Backup (bbstored)[32225]: Login: Client ID 00000001, Read/Write
>>> Jul 24 13:08:29 misora bbstored/hk[18667]: Starting housekeeping
>>> Jul 24 13:09:29 misora bbstored/hk[18667]: Finished housekeeping
>>> .......
>>> .......
>>> .......
>>> Jul 24 16:53:30 misora bbstored/hk[18667]: Starting housekeeping
>>> Jul 24 16:54:30 misora bbstored/hk[18667]: Finished housekeeping
>>> Jul 24 17:04:58 misora Box Backup (bbstored)[32225]: Session finished
>>> Jul 24 17:04:58 misora Box Backup (bbstored)[32225]: Connection statistics for BACKUP-1:
>>> IN=54273151997 OUT=2917099 TOTAL=54276069096
>>>
>>> Session 2:
>>> Jul 25 00:03:20 misora Box Backup (bbstored)[18666]: Incoming connection from 192.168.0.51 port
>>> 51921 (handling in child 10676)
>>> Jul 25 00:03:20 misora Box Backup (bbstored)[10676]: Certificate CN: BACKUP-1
>>> Jul 25 00:03:20 misora Box Backup (bbstored)[10676]: Login: Client ID 00000001, Read/Write
>>> Jul 25 00:08:45 misora bbstored/hk[18667]: Starting housekeeping
>>> Jul 25 00:09:45 misora bbstored/hk[18667]: Finished housekeeping
>>> .......
>>> .......
>>> .......
>>> Jul 25 03:38:46 misora bbstored/hk[18667]: Starting housekeeping
>>> Jul 25 03:39:46 misora bbstored/hk[18667]: Finished housekeeping
>>> Jul 25 03:48:41 misora Box Backup (bbstored)[10676]: Session finished
>>> Jul 25 03:48:41 misora Box Backup (bbstored)[10676]: Connection statistics for BACKUP-1:
>>> IN=54428917970 OUT=3562128 TOTAL=54432480098
>>>
>>>
>>> Thanks,
>>> Tobias
>>>
>>>
>>>
>>> Chris Wilson wrote:
>>>> Hi Tobias,
>>>>
>>>> On Tue, 24 Jul 2007, Tobias Balle-Petersen wrote:
>>>>
>>>>> I reverted back to 0.10 client from chris_merge 1696. The redundant
>>>>> locations were removed after 48 hours as they should be. My files are
>>>>> now being backed up.
>>>>>
>>>>> The store is still chris_merge.
>>>>>
>>>>> So it would seem there was an error in client v. 1696.
>>>> Indeed, thanks for letting me know, will look into it.
>>>>
>>>> Cheers, Chris.
>>> _______________________________________________
>>> boxbackup mailing list
>>> boxbackup@fluffy.co.uk
>>> http://lists.warhead.org.uk/mailman/listinfo/boxbackup
>>>
>> _______________________________________________
>> boxbackup mailing list
>> boxbackup@fluffy.co.uk
>> http://lists.warhead.org.uk/mailman/listinfo/boxbackup
>>
>
> _______________________________________________
> boxbackup mailing list
> boxbackup@fluffy.co.uk
> http://lists.warhead.org.uk/mailman/listinfo/boxbackup
>