[Box Backup] Manually deleting files
Oli
boxbackup@fluffy.co.uk
Mon, 11 Feb 2008 12:05:24 +0000
Hi Chris, sorry to not get back to you straight away...
Chris Wilson wrote:
> Hi Oli and Matt,
>
> On Fri, 25 Jan 2008, Oli wrote:
>
>> Unfortunately the store has no old or 'deleted' files to delete, it's
>> all 'current' :-(
>>
>> If I could convince it to do a backup run, it would probably mark as
>> deleted a few.
>
> I think you didn't say what version of Box Backup you're running on the
> client.
>
> Box Backup 0.11 (rc1) will do a backup run and delete excluded files even
> if the store is full (or at least it should, please let me know if it
> doesn't).
I've just upgraded to 0.11RC2 on client and server, and I set up my
excluded files list to include various directories and files which are
very large.
I had also previously increased the store size and done a backup run,
unfortunately it filled up again - otherwise I was hoping to fix it this
way first.
Anyhoo, just upgraded and tried it, but unfortunately it doesn't seem to
have gone through and deleted the newly excluded files, so my store is
still full.
Here's some logs...
Client:
Feb 11 11:44:16 io Box Backup[26907]: NOTICE: Using configuration file
/etc/box/bbackupd.conf
Feb 11 11:44:16 io Box Backup (bbackupd)[26904]: Incoming connection
from local (UNIX socket)
Feb 11 11:44:16 io Box Backup (bbackupd)[26904]: Connection from command
socket
Feb 11 11:44:16 io Box Backup[26907]: Daemon configuration summary:
AutomaticBackup = false UpdateStor
eInterval = 0 seconds MinimumFileAge = 60 seconds MaxUploadWait = 0
seconds
Feb 11 11:44:16 io Box Backup (bbackupd)[26904]: NOTICE: Beginning scan
of local files
Feb 11 11:44:16 io Box Backup (bbackupd)[26904]: Opening connection to
server '***'
Feb 11 11:44:16 io Box Backup[26907]: Sync started...
Feb 11 11:44:17 io Box Backup (bbackupd)[26904]: Connection made, login
successful
Feb 11 11:44:18 io Box Backup (bbackupd)[26904]: Receiving stream, size 240
Feb 11 11:44:18 io Box Backup (bbackupd)[26904]: Not deleting unused
entries - none in list
Feb 11 11:44:18 io Box Backup (bbackupd)[26904]: NOTICE: About to notify
administrator about event backup-
start, running script '/etc/box/bbackupd/NotifySysadmin.sh backup-start'
Feb 11 11:44:18 io Box Backup (bbackupd)[26904]: Scanning directory:
***censored... ;-) ***
Feb 11 11:44:18 io Box Backup (bbackupd)[26904]: Skipping excluded
directory: ***censored... ;-) ***
Feb 11 11:44:18 io Box Backup (bbackupd)[26904]: Receiving stream, size 1073
Feb 11 11:44:18 io Box Backup (bbackupd)[26904]: Uploading complete
file: ***censored... ;-) ***
ar
Feb 11 11:44:18 io Box Backup (bbackupd)[26904]: Sending stream, size
uncertain
Feb 11 11:45:39 io Box Backup (bbackupquery)[26989]: NOTICE: Box Backup
Query Tool v0.11rc2, (c) Ben Summe
rs and contributors 2003-2008
Feb 11 11:49:16 io Box Backup (bbackupd)[26904]: WARNING: Exception
thrown: ConnectionException(Conn_Proto
col_UnexpectedReply) at autogen_BackupProtocolClient.cpp(1485)
Feb 11 11:49:16 io Box Backup (bbackupd)[26904]: NOTICE: About to notify
administrator about event store-f
ull, running script '/etc/box/bbackupd/NotifySysadmin.sh store-full'
Feb 11 11:49:16 io Box Backup (bbackupd)[26904]: ERROR: Failed to upload
file: ***censored... ;-) ***
rge.tar: server error: StorageLimitExceeded
Feb 11 11:49:16 io Box Backup (bbackupd)[26904]: ERROR: Failed to upload
file: ***censored... ;-) ***
rge.tar: caught exception: Connection Protocol_UnexpectedReply (Server
probably reported an error.) (7/47)
Feb 11 11:49:16 io Box Backup (bbackupd)[26904]: NOTICE: About to notify
administrator about event backup-
error, running script '/etc/box/bbackupd/NotifySysadmin.sh backup-error'
Feb 11 11:49:16 io Box Backup (bbackupd)[26904]: ERROR: Exception caught
(Connection Protocol_UnexpectedRe
ply (Server probably reported an error.) 7/47), reset state and waiting
to retry...
Feb 11 11:49:26 io Box Backup (bbackupd)[26904]: NOTICE: File
statistics: total file size uploaded 9222144
0, bytes already on server 0, encoded size 82014870
Feb 11 11:49:26 io Box Backup[26907]: Sync finished.
Interesting the client can't tell the file size, and the server doesn't
give an error until it's finished...
Server log:
Feb 11 11:26:44 mars Box Backup (bbstored)[27204]: NOTICE: Starting
daemon, version 0.11rc2, config: /etc/box/bbstored.conf
Feb 11 11:32:37 mars Box Backup (bbstored)[27204]: WARNING: Message from
child process 27233: Incoming connection from ***censored... ;-) ***
port 61910
Feb 11 11:32:38 mars Box Backup (bbstored)[27233]: NOTICE: Login from
Client ID 0x075ab23c Read/Write
Feb 11 11:32:38 mars Box Backup (bbstored)[27233]: Sending stream, size 240
Feb 11 11:32:39 mars Box Backup (bbstored)[27233]: Sending stream, size 1073
Feb 11 11:32:39 mars Box Backup (bbstored)[27233]: Receiving stream,
size uncertain
Feb 11 11:32:46 mars Box Backup (bbstored)[27204]: WARNING: Message from
child process 27234: Incoming connection from ***censored... ;-) *** 58757
Feb 11 11:32:46 mars Box Backup (bbstored)[27234]: NOTICE: Login from
Client ID 0x075ab23c Read-only
Feb 11 11:35:22 mars Box Backup (bbstored)[27234]: NOTICE: Session
finished for Client ID 0x075ab23c
Feb 11 11:36:25 mars Box Backup (bbstored)[27233]: WARNING: Exception
thrown: BackupStoreException(AddedFileExceedsStorageLi
mit) at BackupContext.cpp(569)
Feb 11 11:36:25 mars Box Backup (bbstored)[27233]: NOTICE: Session
finished for Client ID 0x075ab23c
>
> Box Backup 0.10 (stable release) will not do anything else after it
> discovers that the store is full, unfortunately.
>
>> Actually, that is helpful... you've given me a way to mark some bits as
>> deleted immediately once I've increased the store size without waiting
>> interfering with a full backup run, then I can shrink it again to force
>> the deletion of the old bits.
>
> Out of curiosity, what way was that? I didn't see it.
Oh, I'm a bit of a BB noob... I didn't know how to trigger a manual
backup :-)
>
>> I'd still quite like to be able to just zap the odd file/dir that I know
>> doesn't need to be there any more (ie, I just excluded it on the client)
>
> I'm thinking about adding that feature to 0.11, even though it's in
> feature freeze right now, so I shouldn't really. At least it should be
> quite simple and easy to add.
That would be seriously cool :-)
>
> If you're running 0.10, I'd advise/request you to upgrade to 0.11rc1 on
> the client and see if that fixes the problem for you.
>
> Cheers, Chris.
Cheers,
-Oli
--
Oli Comber
Systems Developer
3aIT Limited - Official Corporate Sponsor of the British Bobsleigh Team
4-10 Barttelot Rd Horsham West Sussex RH12 1DQ
M: +44 (0)77255 82405 T: +44 (0)870 881 5097 F: +44 (0)870 116 0793
3aIT Limited is a company registered in England and Wales.
CoReg: 3866698 VATReg: 771388600
Visit www.3aIT.co.uk for Design, Systems, Support
Disclaimer:
The information contained within this email is confidential and may be
legally privileged. It is intended solely for the addressee. If you are
not the intended recipient, any disclosure, copying or distribution of
this email is prohibited and may be unlawful. The content of this email
represents the views of the individual and not necessarily 3aIT Limited.
3aIT Limited reserves the right to monitor the content of all emails in
accordance with lawful business practice. Whilst every effort is made to
ensure that attachments are free from computer viruses before
transmission, 3aIT Limited does not accept any liability in respect of
any virus that is not detected.
3aIT Limited