[Box Backup] Possible problem

boxbackup@fluffy.co.uk boxbackup@fluffy.co.uk
Fri, 28 May 2004 09:00:00 -0400 (EDT)


  This message is in MIME format.  The first part should be readable text,
  while the remaining parts are likely unreadable without MIME-aware tools.
  Send mail to mime@docserver.cac.washington.edu for more info.

--8323328-1424959287-1085749200=:2949
Content-Type: TEXT/PLAIN; charset=US-ASCII



On Fri, 28 May 2004, Ben Summers wrote:

>
> On 28 May 2004, at 03:04, rprice@freeshell.org wrote:
>
> > Hi,
> >
> > I'm having a problem, these are the symptoms I see.
>
> I believe everything is working as expected:
>
> >
> > When this happened I was running version 5, I just upgraded to version
> > 6
> > to make sure it wasn't that.
> >
> > I ran out of space on your server for my backups. That was my fault for
> > sure, I put some huge files on my machine and I forgot that it would
> > try
> > to back them up.
> >
> > I then deleted the files, and over the last week or so, many more to
> > try
> > and get back under the limit.
> >
> > The backup client still figures I'm over the soft limit.
>
> After time, your usage on the server will hover around the soft limit,
> sometimes just below, sometimes just above.
>
> >
> > However, some of the deleted files are not showing up as deleted when
> > I do
> > a backup query, or at least I don't think they are being considered
> > deleted, they show up in a normal listing, when I select ls -d to show
> > the
> > deleted files, some show up, but there are ones I know have been
> > deleted
> > for probably a week now that are still showing up in the normal
> > listing.
>
> They will show up for quite some time (with the 'X' flag) so they are
> available to you if you need them back. However, if you do a restore,
> they won't be restored.

Do they show up in the normal listing with an 'X' flag?

I can't remember, but I don't think they had the 'X' flag.

>
> >
> > It's entirely possible I'm still over the limit, but I don't think so.
> >
> > I'm wondering if the client does not delete "deleted files/directories"
> > when it's over the soft limit.
>
> It does -- there's a load of code to make sure it will do this for
> obvious reasons.
>
> >
> > Can you help me out here?
>
> The server looks fine, and the logs show it and the client behaving as
> it should. However, the deleted files thing I can't really check out --
> can you send me the directory name (type pwd) and listing for both the
> filesystem and the directory store so I can compare them?

I'm getting the following error message in my logs:

May 27 22:40:15 server bbackupd[1910]: Exceeded storage limits on server
-- not uploading changes to files

I received this for many days, but I've been too busy to look into it
until now.

>
> On filesystem
>
>    pwd
>    ls -la

rprice@server:/home/Public$ pwd
/home/Public
rprice@server:/home/Public$ ls -la
total 8
drwxrws---    2 root     users        4096 May 23 13:32 .
drwxr-xr-x   17 root     root         4096 Apr 20 19:13 ..
rprice@server:/home/Public$


>
> On store
>
>    pwd
>    list -dotsh

query > pwd
/home/Public (00000005)
query > ls -dotsh
00017bcf -dX-- 1970-01-01T00:00:00 0000000000000000 00000 2.04.24
00018598 -dX-- 1970-01-01T00:00:00 0000000000000000 00000 4.37.00
00019108 f-X-- 2004-05-14T17:22:19 6af628a10f26d4b1 03300 edc_files.tar.gz
00019109 f-X-- 2004-05-14T01:22:03 68aa7e4a38df6a17 00005
build_scripts.tgz
0001910a f-X-- 2004-05-14T02:40:40 193a947056a992dc 135860 C1800.dmp
0001910c -dX-- 1970-01-01T00:00:00 0000000000000000 00000 gs_demo
0001910e f-X-- 2004-05-16T18:52:02 b60fe842ea0b354e 03413 Working
Files.zip
query >

When I checked it out last night, some of the files I believe C1800.dmp
and perhaps edc_files_tar.gz did not have the X, but I could be wrong.

I just ran bbackupctl and this is the output I received:

rprice@server:/home/Public$ sudo bbackupctl sync
Using configuration file /etc/box/bbackupd.conf
Daemon configuration summary:
  AutomaticBackup = true
  UpdateStoreInterval = 3600 seconds
  MinimumFileAge = 21600 seconds
  MaxUploadWait = 86400 seconds
Succeeded.
rprice@server:/home/Public$

>
> I would point out that just over half your storage allocation is taken
> up with deleted files, and about a quarter by old versions. Is this
> plausible? Perhaps housekeeping hasn't needed to really delete anything
> from the store?

My concern was why it was telling me I was out of space, when my file
usage should have been back down to what it was before.

>
> Remember that the deleted file flag is 'X' in the listings.
>
> I think it's fine, to be quite honest.

Well you would certainly know better than me.


I have attached two syslog files that I ran through grep to extract just
the bbackupd entries.

The part where it gets the "SSL err during Load certificates:", was
probably just after I upgraded to version 6 and forgot to put sudo in
front of the command  when I ran something. For sure I noticed it talking
about removing the redundant location after I switched to version 6.

I had also deleted more files last night, I'm not sure if it was a
significant amount. It looks like the problem went away after I started
using version 6.

The redundant location did not have any files in it AFAIK, but I probably
did not check correctly. I think it was there for quite some time, and
AFAIK wasn't causing any problems.

Rick

>
> Ben
>
>
> _______________________________________________
> boxbackup mailing list
> boxbackup@fluffy.co.uk
> http://lists.warhead.org.uk/mailman/listinfo/boxbackup
>
--8323328-1424959287-1085749200=:2949
Content-Type: APPLICATION/octet-stream; name="bbackupd.syslog.o.gz"
Content-Transfer-Encoding: BASE64
Content-ID: <Pine.LNX.4.56.0405280900000.2949@server>
Content-Description: 
Content-Disposition: attachment; filename="bbackupd.syslog.o.gz"

H4sICHQ1t0AAA2JiYWNrdXBkLnN5c2xvZy5vAL2aXW/bNhSG7/sreNcESB3q
y7J0t6YtECBth6UFCgxDIEu0I0SWMlLq6v36HYqOa7iiDgVSuwxkPi/F84ik
GH3M9sSPCY1Tn6bUI4Lx74yT9TrLn7rn4k8v8Zd/peQt25Z1XdZbIvKsJs2G
VE2eVWRTVky8+mgG+fzMekTe1DXL27KpSdu8/FjQxZYuVIvFY7cWe7HIm0X3
tFgszgJ8XcDNT/AuK9gVdBK6TUSX50yITVeZgt7/yBkrWEFE2/Bsy0hV7spW
EAAfWrx5Q+qmJd1z1WRFf1OPWb1lQt7R0KCEuqgPZV2KRxmFDuwIo2LQ1awt
RVvmIoVOtAcGEeW/7NBNCKFXZL1voZtZxVlW7E/uCC6xOm/6u5Zt6DF9JdN9
7WCZuYFA7N1QAYG9GwjIpRsqys4NlDGrG4lMj2I7NxCIvRsqYGXvBgJy6YaK
SqzcQBlzuuGBll7qac00cgODWLtxCIis3cBADt04RC1t3MAZs7rhyfRIO1hm
biAQezdUgHaMzN1AQC7dUFHaydTIDZQxqxs+7BPSQDvJmrmBQOzdUAHaudXc
DQTk0o0+KqRWbqCMWd0IYGc2stsxcwOB2LuhAhysKQjIpRsqym5NQRmzuhH2
6XZ7UQxi74YKsN+LYiCXbqgoq70ozpjVjUimB9pZy8wNBGLvhgrQHqCYu4GA
XLqhorQv9kZuoIxZ3Vj26doXfjM3EIi9GypAu2iZu4GAXLqhorTLl5EbKGNW
N2LYJ4wswGZuIBB7N1SAg/cUBOTSDRVl956CMmZ1Y9WnW76nIBB7N1SAg/cU
BOTSjT5Kv9AauYEyZnUjgec99Sz3ogjE3g0V4GAvioBcuqGi7PaiKGNON+Rx
fZSGdmsKBrF24xBg7wYGcujGIcrKDZwxqxserL4p1aabuYFA7N3oAzzt3Gru
BgJy6YaK0r4SGbmBMmZ2I4h+/ff63x3j+5Tc398RxjkpOi6H4Q5ySM54W27K
PIOkVF5teEp9Sj1K36VQ2JbtYETXPAPApgEr0t8Z35VCyMoVIAkr3IZDdhxS
6qdvbz8T3nRtWcPFD7d37x9uvvxxd9Int7leSN/dyFzZ4JgLf0Dst4dOsIeT
Vg+gUFk/yKppO6Q/G7+F2u3Onq4Nb3YHny6+frr9RkSTP7H20pR5c4aChF1W
FweMKeWLrG0NckLnioztmvq0ZTy4V/IDKpvetxk/aUcu4OY25TYl16zNr9fN
j+uXJgt55ZJcAKa3iC7o8tI4x3R6G6e4mN9kwsBzfkiYMsGNk9zOcONZHuGs
6Ooiq9t+XGX/BYF+8wYCipLDLTV8TzYN/OiK/FNWFcwCFWuZ0k52kZFs0wLc
i/0VlSWAQS6E+ch9reFpK47xL+kpgbvPK3bKSYYPsDzqVshk+OCpjzH2cQzi
RMdk+GypD5hk4xjIsYxjUf+Ti2NdmKbi0LTaY35bw3oi7x8GptzsSVbs5Fai
5Rl0kWT9VfadwX32fX4D9aiuCO9evOLlc0te/+Lt9aced78XPXAhHk/avzbt
nIK8pHDWdryGewaX+4WRyH3GglxMjT9/gLT5hrsqhDHrrkr+M3P4A5MJUwAC
sZ8CVMDQ697EKQABuZwCVJSdGyhjVjcCmT54cDvBDQRi74YKGDq0nehGkEbR
iMVGBUMZpgUL/VUMm4ZAX7cg8v2VT8Oz8gUhDYOVr3q0IpTK4RncFpsWEYdY
FvEYMHRKMqWICuQNf4RtWEQTxnxPHaR7Mn3w5HZCwRCIfcFUgHaMzAumQBZP
nQlj1oLBJO2n1LJgCMS+YCrAQcF6kF4to4KhDNOC+XEUx8vlyDTpx2FAw6V/
Vj4PWvnxsUOB7NDgF4oTaohA7GuoArTTsHkNARQMf/1qXkOUYbzUwSoWx+ZP
Hvze838ucKHsR2hZOgRiXzoV4KB0PWjwq1/z0qEM09It/SSJkpE9ijz3WJ4/
eksaR8mxM1EahsNfOEyoHwKxr58KsN1lKtDAie60+qEM0/p5UeCFyUpfwJWX
nM+cqyCMwuWr/wB434VeOzcAAA==

--8323328-1424959287-1085749200=:2949
Content-Type: APPLICATION/octet-stream; name="bbackupd.syslog.gz"
Content-Transfer-Encoding: BASE64
Content-ID: <Pine.LNX.4.56.0405280900001.2949@server>
Content-Description: 
Content-Disposition: attachment; filename="bbackupd.syslog.gz"

H4sICHk1t0AAA2JiYWNrdXBkLnN5c2xvZwCtlFFrgzAUhd/7K+7jBiUkRm30
cYVBH7o9DQZjDzHGNlSTYuLA/fpl1nVMsAruPfc7595zyJ63EDDAcRpGaUDB
yvpD1pBlXJyac/5GEoLfU3iQB6W10gewgmswBZRG8BIKVUq72s+DPJ9lhxBG
aymcMhqc+XlsMTpgdJlAxyazrUXCoOaEEBoIhGMC219wxXO59ia9bbCNENLa
oin/gigeAz0qrexR5tPb3mKUEqzjTlmnhE39rq5ngFWfEppzabzLHJIo2IR4
DVnrpAVe1pLnLfglejJjLEjYGqQW5vt9N01iSujVy6Y7DFsW3wRkeXwXgWR5
fB0oJIvim2TMjY8kQUwpHc+PUBonYTgIkJIg2rCrHea9pNHo8Xd+tBpcv6hN
1a929/K0ewVrxEm6+7nM7QDlFSqu8x4zlzKvWxOQ5d26CPxDtzwoSPHoJzar
W5OMud268SvgQZ/w6guQuK6mzAUAAA==

--8323328-1424959287-1085749200=:2949--