[Box Backup] RaidFileDoesntExist (2/11) Error -- can't find info.rfw

[Peter Porter]

I've come across an odd issue with one of my Box Backup clients (v0.10, 
server and clients) -- "exception RaidFile RaidFileDoesn'tExist 
(2/11)".  The error arose several months ago, and continues to happen on 
any attempted connection for that particular client, both remote 
connections -- from bbackupd or bbackupquery, during bbstored 
housekeeping, or locally on the backup server when running 
"bbstoreaccounts info".

I saw no further details when enabling ExtendedLogging or a debug build, 
but I added a few extra debugging statements and figured out that it 
can't find "info.rfw" in that account's folder.  I see an info.rfw file 
in other accounts' folders, but not in /backups/backup/000000c2/.  Any 
ideas what could have caused this, or how to recreate this file?  I'm 
hoping there's a way to recover from this situation rather than blowing 
away the store and having the client repopulate an empty store.  I'd 
like to know what sort of situation could cause this, but evidence for 
that may be long gone...

I've included the log from when the error started, but I see no useful 
information.  There are a number of accounts on this server (~10) all 
using the same raid disc 0, which is just a folder on a single drive. 

I appreciate any input!

-Peter



logs at time of first error
----------------------------------------

    Nov 26 05:19:06 njardvik bbstored[9329]: Certificate CN: BACKUP-c2
    Nov 26 05:19:06 njardvik bbstored[9329]: Login: Client ID 000000C2, 
Read/Write
    Nov 26 05:19:43 njardvik bbstored[9329]: Session finished
    Nov 26 05:19:43 njardvik bbstored[9329]: Connection statistics for 
BACKUP-c2: IN=12012 OUT=393059 TOTAL=405071

    ..several other clients successfully connect and disconnect..

    Nov 26 05:47:21 njardvik bbstored/hk[15364]: Starting housekeeping
    Nov 26 05:48:44 njardvik bbstored/hk[15364]: Finished housekeeping

    ..housekeeping ran several times later with no issue..

    Nov 26 06:42:10 njardvik bbstored[9445]: Login: Client ID 00000029, 
Read/Write
    Nov 26 06:42:48 njardvik bbstored[9445]: Session finished
    Nov 26 06:42:48 njardvik bbstored[9445]: Connection statistics for 
BACKUP-29: IN=89 OUT=177757 TOTAL=177846
    Nov 26 06:47:21 njardvik bbstored/hk[15364]: Starting housekeeping
    Nov 26 06:48:34 njardvik bbstored/hk[15364]: while housekeeping 
account 000000C2,  exception RaidFile RaidFileDoesntExist (2/11) -- 
aborting housekeeping run for this account

raidfile.conf:
----------------------------------------

    disc0
    {
            SetNumber = 0
            BlockSize = 2048
            Dir0 = /backups
            Dir1 = /backups
            Dir2 = /backups
    }

Output of "bbstoreaccounts info c2" with debug build and my added output 
statement around line 1048
----------------------------------------
DEBUG: Filename == backup/000000c2//info
Obtained 7 stack frames.
../../debug/bin/bbstoreaccounts/bbstoreaccounts [0x808e0d6]
../../debug/bin/bbstoreaccounts/bbstoreaccounts [0x8064409]
../../debug/bin/bbstoreaccounts/bbstoreaccounts [0x805d5ad]
../../debug/bin/bbstoreaccounts/bbstoreaccounts [0x804bb02]
../../debug/bin/bbstoreaccounts/bbstoreaccounts [0x804d13c]
/lib/tls/libc.so.6(__libc_start_main+0xe4) [0x42015574]
../../debug/bin/bbstoreaccounts/bbstoreaccounts(lchown+0x61) [0x804b081]
Exception thrown: RaidFileException(RaidFileDoesntExist) at 
RaidFileRead.cpp(1050)
Exception: RaidFile RaidFileDoesntExist (2/11)