[Box Backup-dev] Background backup: Sync of directory listings

[G.]

Chris,=0A=0A> However, the StoreObjectInfoFile does not backup the =0A> Bac=
kupClientDirectoryRecord objects, so after bbackup is shut down and =0A> re=
started, they will be recreated, with no checksum, and all the directory =
=0A> listings will have to be downloaded again...=0A=0ABackupClientDirector=
yRecord::Serialize()=0A=0A> BackupClientDirectoryRecord.cpp, we download a =
directly listing if our =0A> cached checksum of the directory contents does=
n't match the current =0A> checksum, i.e. something has changed in the dire=
ctory locally, or we just =0A> created the BackupClientDirectoryRecord obje=
ct so it has no valid =0A> checksum.=0A=0AYes, thus if Dominik has a lot of=
, say, single-byte, single-file changes, but in a large number of different=
 directories, the slowdown is unavoidable.=0A=0A> Also, I think that in thi=
s case, Dominik is not shutting down bbackupd =0A> (please correct me if I'=
m wrong), but rather suspending his laptop during =0A=0AWell, since I could=
 not think of any other reason for bbackupd to lose its cache data, I was b=
etting that bbackupd process was getting shut down (or killed off) and rest=
arted as a part of the suspend process, without using StoreObjectInfoFile t=
o restore its state.=0A=0A> a sync. When the laptop is resumed, the SSL con=
nection will have failed, =0A> so bbackupd will end the sync run with an ex=
ception, and delete the =0A> StoreObjectInfoFile.=0A=0ADoesn't bbackupd shu=
t down the SSL connection in between scan cycles? In that scenario, deletin=
g the cache file is a mistake, as this is not a bbackupd state-altering err=
or condition. As a side note, the cache file should probably never be delet=
ed, but rather upgraded to an ACID storage system, with a commit/rollback c=
apability to match the last logical backup state before bbackupd goes down.=
 I started working on this already way back using SQLite, but held off due =
to Ben's mention of an upcoming massive rework of the internal state repres=
entation.=0A=0AGary=0A=0A=0A=0A=0A=0A=0A =0A_______________________________=
_____________________________________________________=0ADo you Yahoo!?=0AEv=
eryone is raving about the all-new Yahoo! Mail beta.=0Ahttp://new.mail.yaho=
o.com