[Box Backup] problems....

boxbackup@fluffy.co.uk boxbackup@fluffy.co.uk
Sat, 3 Apr 2004 08:35:01 -0500


Man,  I wrote this super long email describing my problem and error logs.  and
my stupid webmail client session expired.

anyway, basically i setup client & server.  was having connection problem and
turned on extended logging.  found out that my hosts file was incorrectly
setup.    fixed it and the backup started going.  forgot to turn off exteneded
logging, so I killed both client & server.  and turned off the logging, and
restarted server & client.  And then i saw that the server continued backing
up, so I left the console and came back 15 minuts later and noticed that the
backup was stopped at around 4gigs completed and some errors in the error
logs.  before I show you those errors, i was curious if these compile warnings
are anything to worry about:



g++ -g -Wall -I../../lib/common -DPLATFORM_LINUX -DPLATFORM_GCC3
-DBOX_VERSION="\"0.04PLUS1\"" -I/usr/local/openssl/include  -c
RaidFileUtil.cpp -o ../../debug/lib/raidfile/RaidFileUtil.o
In file included from ../../lib/common/Box.h:159,
                 from RaidFileUtil.cpp:47:
/usr/include/asm/byteorder.h:6:2: warning: #warning using private kernel
header; include <endian.h> instead!








Server Log:

Apr  3 01:31:03 backup bbstored[8063]: Starting daemon (config:
/etc/box/bbstored.conf) (version 0.04PLUS1)
Apr  3 01:31:03 backup bbstored/hk[8064]: Housekeeping process started
Apr  3 01:31:03 backup bbstored/hk[8064]: Starting housekeeping
Apr  3 01:31:03 backup bbstored/hk[8064]: On housekeeping, sizes in store do
not match calculated sizes, correcting
Apr  3 01:31:03 backup bbstored/hk[8064]: different (store,calc): acc
0x00040404, used (230722,230746), old (0,0), deleted (0,0), dirs (3933,3933)
Apr  3 01:31:03 backup bbstored/hk[8064]: Finished housekeeping
Apr  3 01:31:11 backup bbstored[8063]: Incoming connection from
209.126.207.150 port 54812 (handling in child 8065)
Apr  3 01:31:11 backup bbstored[8065]: Certificate CN: BACKUP-040404
Apr  3 01:31:11 backup bbstored[8065]: Login: Client ID 00040404, Read/Write
Apr  3 01:31:45 backup bbstored[8063]: Incoming connection from
209.126.207.150 port 54815 (handling in child 8067)
Apr  3 01:31:45 backup bbstored[8067]: Certificate CN: BACKUP-040404
Apr  3 01:31:45 backup bbstored[8067]: Login: Client ID 00040404, Read-only
Apr  3 01:46:03 backup bbstored/hk[8064]: Starting housekeeping
Apr  3 01:46:07 backup bbstored/hk[8064]: Finished housekeeping
Apr  3 01:46:57 backup bbstored[8067]: in server child, exception Connection
Protocol_Timeout (Probably a network issue between client and server.) (7/41)
-- terminating child
Apr  3 01:55:48 backup bbstored[8063]: Incoming connection from
209.126.207.150 port 54908 (handling in child 8080)
Apr  3 01:55:48 backup bbstored[8080]: Certificate CN: BACKUP-040404
Apr  3 01:55:48 backup bbstored[8080]: Login: Client ID 00040404, Read-only
Apr  3 01:55:52 backup bbstored[8080]: in server child, exception Connection
TLSReadFailed (Probably a network issue between client and server.) (7/34) --
terminating child
Apr  3 01:56:05 backup bbstored[8063]: Incoming connection from
209.126.207.150 port 54909 (handling in child 8081)
Apr  3 01:56:05 backup bbstored[8081]: Certificate CN: BACKUP-040404
Apr  3 01:56:10 backup bbstored[8081]: Failed to get write lock (for Client ID
00040404)
Apr  3 01:56:10 backup bbstored[8081]: in server child, exception Connection
TLSReadFailed (Probably a network issue between client and server.) (7/34) --
terminating child
Apr  3 01:56:39 backup bbstored[8063]: Terminating daemon
Apr  3 01:56:39 backup bbstored/hk[8064]: Terminating daemon



Client Log:


Apr  3 01:31:11 slag bbackupd[17014]: Starting daemon (config:
/etc/box/bbackupd.conf) (version 0.04PLUS1)
Apr  3 01:31:11 slag bbackupd[17014]: Beginning scan of local files
Apr  3 01:31:11 slag bbackupd[17014]: Opening connection to server
backup.naweb.com... 
Apr  3 01:31:11 slag bbackupd[17014]: Connection made, login successful
Apr  3 01:55:45 slag bbackupd[17014]: Backup object failed, error when reading
/home/ronald/Mail/xmycopy11
Apr  3 01:55:45 slag bbackupd[17014]: Error code when uploading was (7/41),
Connection Protocol_Timeout (Probably a network issue between client and server.)
Apr  3 01:56:05 slag bbackupd[17247]: Starting daemon (config:
/etc/box/bbackupd.conf) (version 0.04PLUS1)
Apr  3 01:56:05 slag bbackupd[17247]: Beginning scan of local files
Apr  3 01:56:05 slag bbackupd[17247]: Opening connection to server
backup.naweb.com...
Apr  3 01:56:10 slag bbackupd[17247]: Exception caught (7/47), reset state and
waiting to retry...
Apr  3 01:56:39 slag bbackupd[17014]: Backup object failed, error when reading
/home/ronald/Mail/xmycopy12
Apr  3 01:56:39 slag bbackupd[17014]: Error code when uploading was (7/33),
Connection TLSWriteFailed (Probably a network issue between client and server.)
Apr  3 01:56:39 slag bbackupd[17014]: SSL err during Write: error:1409F07F:SSL
routines:SSL3_WRITE_PENDING:bad write retry
Apr  3 01:56:39 slag bbackupd[17014]: Backup object failed, error when reading
/home/ronald/Mail/xmycopy13
Apr  3 01:56:39 slag bbackupd[17014]: Error code when uploading was (7/33),
Connection TLSWriteFailed (Probably a network issue between client and server.)
Apr  3 01:56:39 slag bbackupd[17014]: SSL err during Write: error:1409F07F:SSL
routines:SSL3_WRITE_PENDING:bad write retry
Apr  3 01:56:39 slag bbackupd[17014]: SSL err during Write: error:1409F07F:SSL
routines:SSL3_WRITE_PENDING:bad write retry
Apr  3 01:56:39 slag bbackupd[17014]: Exception caught (7/33), reset state and
waiting to retry...
Apr  3 01:57:50 slag bbackupd[17247]: File statistics: total file size
uploaded 0, bytes already on server 0, encoded size 0
Apr  3 01:57:50 slag bbackupd[17247]: Beginning scan of local files 



The current state is (maybe I'm just looking at it wrong and maybe its
finished backing up data, but there are lots of errors.  here is the server
log with the debug version:




Apr  3 04:27:11 backup bbstored[11788]: Starting daemon (config:
/etc/box/bbstored.conf) (version 0.04PLUS1)
Apr  3 04:27:11 backup bbstored/hk[11789]: Housekeeping process started
Apr  3 04:27:11 backup bbstored/hk[11789]: Starting housekeeping
Apr  3 04:27:11 backup bbstored/hk[11789]: TRACE: Exception thrown:
RaidFileException(RaidFileDoesntExist) at RaidFileRead.cpp(1055)
Apr  3 04:27:11 backup bbstored/hk[11789]: while housekeeping account
00040404, exception RaidFile RaidFileDoesntExist (2/11) -- aborting
housekeeping run for this account
Apr  3 04:27:11 backup bbstored/hk[11789]: Finished housekeeping
Apr  3 04:28:24 backup bbstored[11788]: Incoming connection from
209.126.207.150 port 55588 (handling in child 11796)
Apr  3 04:28:24 backup bbstored[11796]: Certificate CN: BACKUP-040404
Apr  3 04:28:24 backup bbstored[11796]: TRACE: Send block allocation size is 4
Apr  3 04:28:24 backup bbstored[11796]: Receive Version(0x1)
Apr  3 04:28:24 backup bbstored[11796]: Send Version(0x1)
Apr  3 04:28:24 backup bbstored[11796]: Receive Login(0x40404,0x0)
Apr  3 04:28:24 backup bbstored[11796]: Login: Client ID 00040404, Read/Write
Apr  3 04:28:24 backup bbstored[11796]: Send
LoginConfirmed(0x3d727761647c0,0xf89ab,0x500000,0x5c0000)
Apr  3 04:28:24 backup bbstored[11796]: Receive ListDirectory(0x1,0x2,0xc,false)
Apr  3 04:28:24 backup bbstored[11796]: Send Success(0x1)
Apr  3 04:28:24 backup bbstored[11796]: Sending stream, size 520
Apr  3 04:28:24 backup bbstored[11796]: Receive
ListDirectory(0x2,0xffffffff,0xc,true)
Apr  3 04:28:24 backup bbstored[11796]: Send Success(0x2)
Apr  3 04:28:24 backup bbstored[11796]: Sending stream, size 4609
Apr  3 04:28:24 backup bbstored[11796]: Receive
ListDirectory(0x3,0xffffffff,0xc,true)
Apr  3 04:28:24 backup bbstored[11796]: Send Success(0x3)
Apr  3 04:28:24 backup bbstored[11796]: Sending stream, size 881
Apr  3 04:28:24 backup bbstored[11796]: Receive
ListDirectory(0x75,0xffffffff,0xc,true)
Apr  3 04:28:24 backup bbstored[11796]: TRACE: Exception thrown:
RaidFileException(RaidFileDoesntExist) at RaidFileRead.cpp(1055)
Apr  3 04:28:24 backup bbstored[11796]: in server child, exception RaidFile
RaidFileDoesntExist (2/11) -- terminating child
Apr  3 04:30:04 backup bbstored[11788]: Incoming connection from
209.126.207.150 port 55596 (handling in child 11834)
Apr  3 04:30:04 backup bbstored[11834]: Certificate CN: BACKUP-040404
Apr  3 04:30:04 backup bbstored[11834]: TRACE: Send block allocation size is 4
Apr  3 04:30:04 backup bbstored[11834]: Receive Version(0x1)
Apr  3 04:30:04 backup bbstored[11834]: Send Version(0x1)
Apr  3 04:30:04 backup bbstored[11834]: Receive Login(0x40404,0x0)
Apr  3 04:30:04 backup bbstored[11834]: Login: Client ID 00040404, Read/Write
Apr  3 04:30:04 backup bbstored[11834]: Send
LoginConfirmed(0x3d727761647c0,0xf89ab,0x500000,0x5c0000)
Apr  3 04:30:04 backup bbstored[11834]: Receive ListDirectory(0x1,0x2,0xc,false)
Apr  3 04:30:04 backup bbstored[11834]: Send Success(0x1)
Apr  3 04:30:04 backup bbstored[11834]: Sending stream, size 520
Apr  3 04:30:04 backup bbstored[11834]: Receive
ListDirectory(0x2,0xffffffff,0xc,true)
Apr  3 04:30:04 backup bbstored[11834]: Send Success(0x2)
Apr  3 04:30:04 backup bbstored[11834]: Sending stream, size 4609
Apr  3 04:30:04 backup bbstored[11834]: Receive
ListDirectory(0x3,0xffffffff,0xc,true)
Apr  3 04:30:04 backup bbstored[11834]: Send Success(0x3)
Apr  3 04:30:04 backup bbstored[11834]: Sending stream, size 881
Apr  3 04:30:04 backup bbstored[11834]: Receive
ListDirectory(0x75,0xffffffff,0xc,true)
Apr  3 04:30:04 backup bbstored[11834]: TRACE: Exception thrown:
RaidFileException(RaidFileDoesntExist) at RaidFileRead.cpp(1055)
Apr  3 04:30:04 backup bbstored[11834]: in server child, exception RaidFile
RaidFileDoesntExist (2/11) -- terminating child
Apr  3 04:30:46 backup bbstored/hk[11789]: TRACE: housekeeping received
command 't' over interprocess comms
Apr  3 04:30:46 backup bbstored[11788]: Terminating daemon
Apr  3 04:30:46 backup bbstored/hk[11789]: Terminating daemon




client log:


Apr  3 04:28:24 slag bbackupd[19322]: Starting daemon (config:
/etc/box/bbackupd.conf) (version 0.04PLUS1)
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: Set maximum diffing time to 20
seconds
Apr  3 04:28:24 slag bbackupd[19322]: Beginning scan of local files
Apr  3 04:28:24 slag bbackupd[19322]: Opening connection to server
backup.naweb.com...
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: Send block allocation size is 4
Apr  3 04:28:24 slag bbackupd[19322]: Connection made, login successful
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: Found mount point at /
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: Found mount point at /proc
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: Found mount point at /dev/pts
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: Found mount point at /dev/shm
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: Found mount point at /var
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: Found mount point at /home
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: Found mount point at /store
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: new location
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: 7 potential mount points
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: checking against mount point /dev/pts
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: checking against mount point /dev/shm
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: checking against mount point /store
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: checking against mount point /home
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: checking against mount point /proc
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: checking against mount point /var
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: checking against mount point /
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: mount point chosen for /bin is /
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: Reallocating filename
encoding/decoding buffer from 2 to 31
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: Block 80bd368 realloc(), but not
in list. Error? Or allocated in startup static objects?
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: new location
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: 7 potential mount points
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: checking against mount point /dev/pts
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: checking against mount point /dev/shm
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: checking against mount point /store
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: checking against mount point /home
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: checking against mount point /proc
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: checking against mount point /var
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: checking against mount point /
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: mount point chosen for /boot is /
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: Reallocating filename
encoding/decoding buffer from 31 to 32
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: new location


some more of the similiar trace errors and then:



Apr  3 04:28:24 slag bbackupd[19322]: TRACE: mount point chosen for /var is /var
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: Reallocating filename
encoding/decoding buffer from 34 to 41
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: Reallocating filename
encoding/decoding buffer from 41 to 50
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: Reallocating filename
encoding/decoding buffer from 50 to 51
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: Exception thrown:
ConnectionException(Conn_TLSReadFailed) at SocketStreamTLS.cpp(334)
Apr  3 04:28:24 slag bbackupd[19322]: TRACE: Exception thrown:
ConnectionException(Conn_TLSReadFailed) at SocketStreamTLS.cpp(334)
Apr  3 04:28:24 slag bbackupd[19322]: Exception caught (7/34), reset state and
waiting to retry...
Apr  3 04:30:04 slag bbackupd[19322]: File statistics: total file size
uploaded 0, bytes already on server 0, encoded size 0
Apr  3 04:30:04 slag bbackupd[19322]: Beginning scan of local files
Apr  3 04:30:04 slag bbackupd[19322]: Opening connection to server
backup.naweb.com...
Apr  3 04:30:04 slag bbackupd[19322]: TRACE: Send block allocation size is 4
Apr  3 04:30:04 slag bbackupd[19322]: Connection made, login successful
Apr  3 04:30:04 slag bbackupd[19322]: TRACE: Found mount point at /


....


Apr  3 04:30:04 slag bbackupd[19322]: TRACE: mount point chosen for /var is /var
Apr  3 04:30:04 slag bbackupd[19322]: TRACE: Exception thrown:
ConnectionException(Conn_TLSReadFailed) at SocketStreamTLS.cpp(334)
Apr  3 04:30:04 slag bbackupd[19322]: TRACE: Exception thrown:
ConnectionException(Conn_TLSReadFailed) at SocketStreamTLS.cpp(334)
Apr  3 04:30:04 slag bbackupd[19322]: Exception caught (7/34), reset state and
waiting to retry...



lemme know what I did wrong.  or maybe I'm just overlooking something obvious.
   Also hopefully i haven't overlooked somehting else to include in this
email.  let me know if you need any other info.  

Thanks!

Imran