[Box Backup] Full server store not deleting old and deleted files (boxwin0.09)
E.W. Peter Jalajas
boxbackup@fluffy.co.uk
Wed, 1 Mar 2006 15:34:00 -0800 (PST)
Ah! I see a 176MB version of it at the top of the BackupLocations
Path! I think it's fine now, Ben.
petjal@ns1b:~$ grep -i -e 11200.*Login -e 11200.*finish /var/log/box
Mar 1 17:26:36 localhost bbstored[11200]: Receive Login(0x14,0x0)
Mar 1 17:26:36 localhost bbstored[11200]: Receive Login(0x14,0x0)
Mar 1 17:26:36 localhost bbstored[11200]: Login: Client ID 00000014,
Read/WriteMar 1 17:26:36 localhost bbstored[11200]: Send
LoginConfirmed(0x40dc9d5005900,0x9bced,0x9c400,0xdac00)
Mar 1 17:26:36 localhost bbstored[11200]: Send
LoginConfirmed(0x40dc9d5005900,0x9bced,0x9c400,0xdac00)
Mar 1 18:12:15 localhost bbstored[11200]: Receive Finished()
Mar 1 18:12:15 localhost bbstored[11200]: Receive Finished()
Mar 1 18:12:15 localhost bbstored[11200]: Session finished
Mar 1 18:12:15 localhost bbstored[11200]: Send Finished()
Mar 1 18:12:15 localhost bbstored[11200]: Send Finished()
Mar 1 16:55:19 localhost bbstored/hk[9614]: Housekeeping process
started
Mar 1 16:55:20 localhost bbstored/hk[9614]: Starting housekeeping
Mar 1 17:18:36 localhost bbstored/hk[9614]: Account 0x00000014,
removed 44398 blocks (3816 files, 19 dirs)
Mar 1 17:18:36 localhost bbstored/hk[9614]: Finished housekeeping
Mar 1 17:19:36 localhost bbstored/hk[9614]: Starting housekeeping
Mar 1 17:19:39 localhost bbstored/hk[9614]: Finished housekeeping
Mar 1 17:34:37 localhost bbstored/hk[9614]: Starting housekeeping
Mar 1 17:34:38 localhost bbstored/hk[9614]: Finished housekeeping
Mar 1 17:49:36 localhost bbstored/hk[9614]: Starting housekeeping
Mar 1 17:49:45 localhost bbstored/hk[9614]: Finished housekeeping
Mar 1 18:04:36 localhost bbstored/hk[9614]: Starting housekeeping
Mar 1 18:04:58 localhost bbstored/hk[9614]: Finished housekeeping
Mar 1 18:19:36 localhost bbstored/hk[9614]: Starting housekeeping
Mar 1 18:19:45 localhost bbstored/hk[9614]: Account 0x00000014,
removed 42243 blocks (35 files, 0 dirs)
Mar 1 18:19:47 localhost bbstored/hk[9614]: Finished housekeeping
petjal@ns1b:~$ ps -ef | grep bb
1003 9613 1 0 16:55 ? 00:00:00 /etc/init.d/bbstored
1003 9614 9613 25 16:55 ? 00:22:16 /etc/init.d/bbstored
petjal@ns1b:~$ sudo /usr/local/bin/bbstoreaccounts info 00000014
Password:
Account ID: 00000014
Last object ID: 22202
Blocks used: 639041 (2496.25Mb)
Blocks used by old files: 3 (0.01Mb)
Blocks used by deleted files: 55800 (217.97Mb)
Blocks used by directories: 1895 (7.40Mb)
Block soft limit: 640000 (2500.00Mb)
Block hard limit: 896000 (3500.00Mb)
Client store marker: 1141254462000000
And on windows, it looks like it finished up with this:
Finished scan of local files.
File statistics: total file size uploaded 188934621, bytes already on
server 9177355, encoded size 176131400.
So, I think we are OK. I think the issue was that I had too little
headroom between the soft and hard limits for this client with large
files. It got stuck. I fixed it, with Ben's guidance, by increasing
the hard limit substantially, and restarting daemons on both the client
and server, and letting it run. I failed to realize that the filename
could have been duplicated elsewhere in by BackupLocations Path--no,
actually, I didn't read my BackupLocations Path correctly--I was
looking down in a subdirectory that I had forgotten was Excluded. I
think I'll keep the hard limit at its present value, presuming that Box
Backup will keep the storage down near the soft limit as best it can.
Below is my bi-hourly script output that happened to run about the same
time.
Thanks again, Ben!
Pete
Report Timestamp: Wed Mar 1 18:17:14 EST 2006.
Your Account Number, Account Name, Storage Quota, Email Address(es):
00000014 <client> 2500M x@y.com
Store account checked, no errors found.
Account ID: 00000014
Last object ID: 22202
Blocks used: 681284 (2661.27Mb)
Blocks used by old files: 42244 (165.02Mb)
Blocks used by deleted files: 55802 (217.98Mb)
Blocks used by directories: 1897 (7.41Mb)
Block soft limit: 640000 (2500.00Mb)
Block hard limit: 896000 (3500.00Mb)
Client store marker: 1141254462000000
Total size of your files safely backed up with Tebuco: 2.7G
Total number of your files safely backed up with Tebuco: 16698
Number of your files changed in our storage during the following time
periods:
0-2h 2-4h 4-8h 8-12hr 0.5-1d 1-2d 2-4d 4-8d 8+days
444 0 0 0 0 0 0 202 16052
(Please note that a delay of up to a few hours exists between the time
you edit a file and the time that change is reflected in the numbers
above.)
--- Ben Summers wrote:
>
> On 1 Mar 2006, at 22:36, E.W. Peter Jalajas wrote:
>
> >
> > I restarted the service on the windows client and it is now stuck
> > trying to backup the old file that doesn't exist anymore; from the
> > windows Event Viewer:
> > Send ListDirectory(0x5647,0xffffffff,0xc,true).
> > Receive Success(0x5647).
> > Receiving stream, size 489.
> > Send GetBlockIndexByName(0x5647,"Hallmos 101503 2.QBB").
> > Receive Success(0x5648).
> > Receiving stream, size 89148.
> > Sending stream, size uncertain.
> > Send
> > StoreFile(0x5647,0x40dca63288f40,0x263be2696554d151,0x5648,"Hallmos
> > 101503 2.QBB").
> > Sending stream, size uncertain.
>
>
> I think you now need to work out what exactly it's doing. After all,
>
> it shouldn't be trying to back up a file which no longer exists.
>
> Can you do a search on the disc for all files of that name? And check
>
> them carefully.
>
> Ben
>
>
>
> _______________________________________________
> boxbackup mailing list
> boxbackup@fluffy.co.uk
> http://lists.warhead.org.uk/mailman/listinfo/boxbackup
>