[Box Backup-dev] "setlimit 0 (...) back with vengeance (Was: Proposal (patch): bbstored HousekeepingStyle mod)

G. boxbackup-dev@fluffy.co.uk
Tue, 23 Jan 2007 11:57:10 -0800 (PST)


Hi ladies and gents,=0A=0AUnfortunately, the "bbstoreaccounts setlimit <acc=
ount> 0M <hard-limit>" issue (setting the soft-limit to the special value o=
f 0) is back with vengeance. I just switched my bbstored server from i686 (=
Intel Xeon) to AMD64 (AMD Opteron), and the o/s from CentOS 4 to Ubuntu 6.0=
6, and backups no longer complete. bbstored reports:=0A=0AExceeded storage =
limits on server -- not uploading changes to files=0A...=0ANot notifying ad=
ministrator about event store-full -- set NotifyScript to do this in future=
=0A...=0AFinished scan of local files=0A...=0AFile statistics: total file s=
ize uploaded 0, bytes already on server 0, encoded size 0=0A=0AVerification=
s performed:=0A=0A- bbstoreaccounts info shows identical block count and li=
mit ranges on both servers=0A- bbstoreaccounts check reports all ok=0A- bbs=
tored startup is ok (no /var/log/box error messages)=0A- housekeeping cycle=
 reports no inconsistencies to be corrected=0A- compare -lq <sample directo=
ry> completes ok=0A- compare -l <sample directory> completes ok=0A- restore=
 <sample ~50MB directory> completes ok=0A=0ARe-setting the soft-limit from =
0 to, say, 50% of hard-limit fixes the problem immediately. I thought the h=
ard-limit was relevant for >>new<< file version upload, while the soft-limi=
t was relevant for >>old<< file version upload only?=0A=0ASo, it looks like=
 we are back to square one, with the following alternatives:=0A=0A1. Review=
 bbstored and bbackupd code to verify correct interpretation of the 0 soft-=
limit special case, or:=0A=0A2. Treat soft-limit 0 as logical zero-content =
(no special case), but re-apply my explicit bbstored HousekeepingStyle patc=
h, which allows a user to set the soft limit to <hard-limit less 3%>, and w=
hack all old and deleted files during every housekeeping run (file: bbstore=
d.conf, option: HousekeepingStyle=3DRetainCurrentOnly).=0A=0AThoughts?=0A=
=0AGary=0A=0A=0A=0A=0A =0A_________________________________________________=
___________________________________=0ADon't get soaked.  Take a quick peak =
at the forecast=0Awith the Yahoo! Search weather shortcut.=0Ahttp://tools.s=
earch.yahoo.com/shortcuts/#loc_weather