From boxbackup at boxbackup.org Sat Nov 1 13:43:36 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Sat, 1 Nov 2008 13:43:36 +0000 (GMT) Subject: [Box Backup] Windows Boxbackup path configuration and eventlogs In-Reply-To: <5DB1D2D8020D4449AF3111C784529E62470165@jeep.netcal.l> References: <5DB1D2D8020D4449AF3111C784529E62470165@jeep.netcal.l> Message-ID: Hi Brendon, On Thu, 30 Oct 2008, Brendon Baumgartner wrote: > I'm having a hard time nailing down the Windows path exclusions. Does > someone have a current example? I see the 0.10 example in Trac is quite > a bit different than the example that comes with the latest agent. The examples included in the configuration file are the best that I have. Do you need something else? If you could describe what you're trying to do in more detail then perhaps I can help more, and add more examples to the config file or wiki. > Also, is there a way to have boxbackup log file open errors to something > other than the event log? My eventlog is getting flooded! In the latest SVN trunk you can log to a file instead of the event log, but I recommend that you do use the event log, and just reduce the detail level if necessary. I'm surprised that the level of logging is excessive. Which version of the client are you using? Could you give some examples of messages that you don't think should be in the event log? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Sun Nov 2 22:12:04 2008 From: boxbackup at boxbackup.org (Brendon Baumgartner) Date: Sun, 2 Nov 2008 14:12:04 -0800 Subject: [Box Backup] Windows Boxbackup path configuration and eventlogs In-Reply-To: References: <5DB1D2D8020D4449AF3111C784529E62470165@jeep.netcal.l> Message-ID: <5DB1D2D8020D4449AF3111C784529E62470171@jeep.netcal.l> > -----Original Message----- > From: boxbackup-admin at boxbackup.org [mailto:boxbackup- > admin at boxbackup.org] On Behalf Of Chris Wilson > Sent: Saturday, November 01, 2008 6:44 AM > To: boxbackup at boxbackup.org > Subject: Re: [Box Backup] Windows Boxbackup path configuration and > eventlogs >=20 > Hi Brendon, >=20 > On Thu, 30 Oct 2008, Brendon Baumgartner wrote: >=20 > > I'm having a hard time nailing down the Windows path exclusions. Does > > someone have a current example? I see the 0.10 example in Trac is > quite > > a bit different than the example that comes with the latest agent. >=20 > The examples included in the configuration file are the best that I > have. > Do you need something else? If you could describe what you're trying to > do > in more detail then perhaps I can help more, and add more examples to > the > config file or wiki. >=20 > > Also, is there a way to have boxbackup log file open errors to > something > > other than the event log? My eventlog is getting flooded! >=20 > In the latest SVN trunk you can log to a file instead of the event log, > but I recommend that you do use the event log, and just reduce the > detail > level if necessary. I'm surprised that the level of logging is > excessive. > Which version of the client are you using? Could you give some examples > of > messages that you don't think should be in the event log? Thanks for the reply. I'm using win32 build 1857, which I believe is the latest. In about 12 hours, there are ~420 events in the logs. An example of some of them are at the end. It would be nice to configure detail that goes to the event log and flat file log separately. Maybe this is possible?=20 I notice if I restart the agent (stop/start) it crashes. If I stop the agent, wait a few minutes, and then start it, it doesn't crash. Many of my errors in the eventlog are about file open errors. I have attempted to add exclusions, which I think I finally got right, but it'll be awhile before I get the exclusion list correct. Windows has a lot of open files! Some errors: ERROR: Exception caught (Connection Protocol_UnexpectedReply (Server probably reported an error.) 7/47), reset state and waiting to retry... WARNING: Suppressing duplicate notification about backup-error WARNING: Exception thrown: ConnectionException(Conn_Protocol_UnexpectedReply) at autogen_BackupProtocolClient.cpp(1135) ERROR: Exception caught (Connection Protocol_UnexpectedReply (Server probably reported an error.) 7/47), reset state and waiting to retry... WARNING: Exception thrown: ConnectionException(Conn_Protocol_UnexpectedReply) at autogen_BackupProtocolClient.cpp(1135) ERROR: Exception caught (Connection Protocol_UnexpectedReply (Server probably reported an error.) 7/47), reset state and waiting to retry... WARNING: Exception thrown: ConnectionException(Conn_Protocol_UnexpectedReply) at autogen_BackupProtocolClient.cpp(1135) ERROR: Exception caught (Connection Protocol_UnexpectedReply (Server probably reported an error.) 7/47), reset state and waiting to retry... WARNING: Exception thrown: ConnectionException(Conn_Protocol_UnexpectedReply) at autogen_BackupProtocolClient.cpp(1135) ERROR: Exception caught (Connection Protocol_UnexpectedReply (Server probably reported an error.) 7/47), reset state and waiting to retry... WARNING: Exception thrown: ConnectionException(Conn_Protocol_UnexpectedReply) at autogen_BackupProtocolClient.cpp(1135) ERROR: Exception caught (Connection Protocol_UnexpectedReply (Server probably reported an error.) 7/47), reset state and waiting to retry... WARNING: Exception thrown: ConnectionException(Conn_Protocol_UnexpectedReply) at autogen_BackupProtocolClient.cpp(1135) ERROR: Exception caught (Connection TLSWriteFailed (Probably a network issue between client and server.) 7/33), reset state and waiting to retry... WARNING: Exception thrown: ConnectionException(Conn_TLSWriteFailed) at SocketStreamTLS.cpp(403) ERROR: SSL error during Write: error:1409F07F:SSL routines:SSL3_WRITE_PENDING:bad write retry From boxbackup at boxbackup.org Sun Nov 2 23:00:13 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Sun, 2 Nov 2008 23:00:13 +0000 (GMT) Subject: [Box Backup] Windows Boxbackup path configuration and eventlogs In-Reply-To: <5DB1D2D8020D4449AF3111C784529E62470171@jeep.netcal.l> References: <5DB1D2D8020D4449AF3111C784529E62470165@jeep.netcal.l> <5DB1D2D8020D4449AF3111C784529E62470171@jeep.netcal.l> Message-ID: Hi Brendon, On Sun, 2 Nov 2008, Brendon Baumgartner wrote: > I'm using win32 build 1857, which I believe is the latest. It is the latest precompiled release for Windows, but the LogFile feature that I mentioned has been added since. I'm afraid I haven't released a new Windows build with this feature. > In about 12 hours, there are ~420 events in the logs. An example of some > of them are at the end. It would be nice to configure detail that goes > to the event log and flat file log separately. Maybe this is possible? Yes, it is possible with newer code, but you'll have to either compile it yourself or wait for us to release a new Windows build. > I notice if I restart the agent (stop/start) it crashes. If I stop the > agent, wait a few minutes, and then start it, it doesn't crash. Yes, I noticed that too and it's already fixed in trunk, same comment applies as above. > Many of my errors in the eventlog are about file open errors. I have > attempted to add exclusions, which I think I finally got right, but > it'll be awhile before I get the exclusion list correct. Windows has a > lot of open files! > > Some errors: > ERROR: Exception caught (Connection Protocol_UnexpectedReply (Server > probably reported an error.) 7/47), reset state and waiting to retry... This is bad, it probably means that something is wrong on the server. Did you get any error messages in the server log around this time? > ERROR: Exception caught (Connection TLSWriteFailed (Probably a network > issue between client and server.) 7/33), reset state and waiting to > retry... This may mean that the connection to the server timed out after 15 minutes of inactivity. What is your MaximumDiffingTime and KeepAliveTime set to on the client? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Mon Nov 3 11:00:35 2008 From: boxbackup at boxbackup.org (Tobias Balle-Petersen) Date: Mon, 03 Nov 2008 12:00:35 +0100 Subject: [Box Backup] Restoring deleted files recursively In-Reply-To: <20080128193457.0cfbdcd4@matrix.tuxianer.homelinux.net> References: <20080114222604.6140da6b@matrix.tuxianer.homelinux.net> <20080128193457.0cfbdcd4@matrix.tuxianer.homelinux.net> Message-ID: <490ED9D3.8000505@kontrapunkt.com> Hello Torsten and Chris. I have the exact same problem as described by Torsten below. > I made some tests and now i can more specific describe my problem. > > Deleted files inside of a (not deleted) subdirectory are not restored. I have a maildir with subfolders and want to restore all deleted mails within still existing directories. The command: "restore -d top_dir_on_store new_folder_on_mailserver" Restores nothing.So I have to go into every directory with bbackupquery and identify if it has deleted mail, and then restore folders like that one by one. So tedious to be unusable. Any ideas? Regards, Tobias Balle-Petersen From boxbackup at boxbackup.org Mon Nov 3 18:52:49 2008 From: boxbackup at boxbackup.org (Brendon Baumgartner) Date: Mon, 3 Nov 2008 10:52:49 -0800 Subject: [Box Backup] Windows Boxbackup path configuration and eventlogs In-Reply-To: References: <5DB1D2D8020D4449AF3111C784529E62470165@jeep.netcal.l> <5DB1D2D8020D4449AF3111C784529E62470171@jeep.netcal.l> Message-ID: <5DB1D2D8020D4449AF3111C784529E621E1131@jeep.netcal.l> > -----Original Message----- > From: boxbackup-admin at boxbackup.org [mailto:boxbackup-admin at boxbackup.org] > On Behalf Of Chris Wilson > Sent: Sunday, November 02, 2008 3:00 PM > To: boxbackup at boxbackup.org > Subject: RE: [Box Backup] Windows Boxbackup path configuration and > eventlogs >=20 > Hi Brendon, >=20 > On Sun, 2 Nov 2008, Brendon Baumgartner wrote: >=20 > > I'm using win32 build 1857, which I believe is the latest. >=20 > It is the latest precompiled release for Windows, but the LogFile feature > that I mentioned has been added since. I'm afraid I haven't released a new > Windows build with this feature. Anytime soon? I'm not sure I want to get into compiling binaries for windows. > > ERROR: Exception caught (Connection Protocol_UnexpectedReply (Server > > probably reported an error.) 7/47), reset state and waiting to retry... >=20 > This is bad, it probably means that something is wrong on the server. > Did you get any error messages in the server log around this time? I couldn't find that error in the eventlogs. I didn't note the time before. Here are a bunch of errors listed on the server. http://pastebin.com/mc816912 > > ERROR: Exception caught (Connection TLSWriteFailed (Probably a network > > issue between client and server.) 7/33), reset state and waiting to > > retry... >=20 > This may mean that the connection to the server timed out after 15 minutes > of inactivity. What is your MaximumDiffingTime and KeepAliveTime set to on > the client? MaximumDiffingTime is commented out KeepAliveTime is commented out --=20 -BB From boxbackup at boxbackup.org Tue Nov 4 01:02:04 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Tue, 4 Nov 2008 01:02:04 +0000 (GMT) Subject: [Box Backup] Windows Boxbackup path configuration and eventlogs In-Reply-To: <5DB1D2D8020D4449AF3111C784529E621E1131@jeep.netcal.l> References: <5DB1D2D8020D4449AF3111C784529E62470165@jeep.netcal.l> <5DB1D2D8020D4449AF3111C784529E62470171@jeep.netcal.l> <5DB1D2D8020D4449AF3111C784529E621E1131@jeep.netcal.l> Message-ID: Hi Brendon, On Mon, 3 Nov 2008, Brendon Baumgartner wrote: > > > I'm using win32 build 1857, which I believe is the latest. > > > > It is the latest precompiled release for Windows, but the LogFile > > feature that I mentioned has been added since. I'm afraid I haven't > > released a new Windows build with this feature. > > Anytime soon? I'm not sure I want to get into compiling binaries for > windows. I've uploaded a new Windows binary build for the latest monthly snapshot, which you can find here: https://www.boxbackup.org/trac/wiki/WindowsClientReleases Please give it a try and let us know if you have any problems with it. > > > ERROR: Exception caught (Connection Protocol_UnexpectedReply (Server > > > probably reported an error.) 7/47), reset state and waiting to > > > retry... > > > > This is bad, it probably means that something is wrong on the server. > > Did you get any error messages in the server log around this time? > > I couldn't find that error in the eventlogs. I didn't note the time > before. Here are a bunch of errors listed on the server. > http://pastebin.com/mc816912 On second thoughts I think this may have been caused by the account being locked after the connection was killed due to a timeout. > > > ERROR: Exception caught (Connection TLSWriteFailed (Probably a > > > network issue between client and server.) 7/33), reset state and > > > waiting to retry... > > > > This may mean that the connection to the server timed out after 15 > > minutes of inactivity. What is your MaximumDiffingTime and > > KeepAliveTime set to on the client? > > MaximumDiffingTime is commented out > KeepAliveTime is commented out Please could you try enabling both of these? Set MaximumDiffingTime to 300 (seconds) for a start, and KeepAliveTime to 60 (seconds). Using the new build, you should be able to log to a file with the LogFile setting in the configuration, and set the level used for this logging with LogFileLevel (e.g. = debug). Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Tue Nov 4 01:23:08 2008 From: boxbackup at boxbackup.org (Brendon Baumgartner) Date: Mon, 3 Nov 2008 17:23:08 -0800 Subject: [Box Backup] Windows Boxbackup path configuration and eventlogs In-Reply-To: References: <5DB1D2D8020D4449AF3111C784529E62470165@jeep.netcal.l> <5DB1D2D8020D4449AF3111C784529E62470171@jeep.netcal.l> <5DB1D2D8020D4449AF3111C784529E621E1131@jeep.netcal.l> Message-ID: <5DB1D2D8020D4449AF3111C784529E621E1133@jeep.netcal.l> > -----Original Message----- > From: boxbackup-admin at boxbackup.org [mailto:boxbackup-admin at boxbackup.org] > On Behalf Of Chris Wilson > Sent: Monday, November 03, 2008 5:02 PM > To: boxbackup at boxbackup.org > Subject: RE: [Box Backup] Windows Boxbackup path configuration and > eventlogs >=20 > Hi Brendon, >=20 > On Mon, 3 Nov 2008, Brendon Baumgartner wrote: >=20 > > > > I'm using win32 build 1857, which I believe is the latest. > > > > > > It is the latest precompiled release for Windows, but the LogFile > > > feature that I mentioned has been added since. I'm afraid I haven't > > > released a new Windows build with this feature. > > > > Anytime soon? I'm not sure I want to get into compiling binaries for > > windows. >=20 > I've uploaded a new Windows binary build for the latest monthly snapshot, > which you can find here: WOW! Thanks for this... looks like a release was due. > > > > ERROR: Exception caught (Connection Protocol_UnexpectedReply (Server > > > > probably reported an error.) 7/47), reset state and waiting to > > > > retry... > > > > > > This is bad, it probably means that something is wrong on the server. > > > Did you get any error messages in the server log around this time? > > > > I couldn't find that error in the eventlogs. I didn't note the time > > before. Here are a bunch of errors listed on the server. > > http://pastebin.com/mc816912 >=20 > On second thoughts I think this may have been caused by the account being > locked after the connection was killed due to a timeout. >=20 > > > > ERROR: Exception caught (Connection TLSWriteFailed (Probably a > > > > network issue between client and server.) 7/33), reset state and > > > > waiting to retry... > > > > > > This may mean that the connection to the server timed out after 15 > > > minutes of inactivity. What is your MaximumDiffingTime and > > > KeepAliveTime set to on the client? > > > > MaximumDiffingTime is commented out > > KeepAliveTime is commented out >=20 > Please could you try enabling both of these? >=20 > Set MaximumDiffingTime to 300 (seconds) for a start, and KeepAliveTime to > 60 (seconds). >=20 > Using the new build, you should be able to log to a file with the LogFile > setting in the configuration, and set the level used for this logging with > LogFileLevel (e.g. =3D debug). Okay. I'll give all of this a try and report back soon! -BB From boxbackup at boxbackup.org Tue Nov 4 15:38:28 2008 From: boxbackup at boxbackup.org (Torsten) Date: Tue, 4 Nov 2008 16:38:28 +0100 Subject: [Box Backup] box backup and not existing directories Message-ID: <200811041638.30484.ddmails@web.de> --Boundary-00=_2xGEJHbkfDbvVWq Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Content-Disposition: inline Hi, if i have a location not existing locally and not existing on the store but activated as a location in bbackupd.conf. With this configuration box backup throws this errors on start. ERROR: Failed to stat file: '/test-192.168.1.87-torsten': No such file or directory (2) WARNING: Exception thrown: CommonException(OSFileError) at BackupClientFileAttributes.cpp(309) ERROR: Failed to get attributes for path '/test-192.168.1.87-torsten', skipping location 'test-192.168.1.87-torsten' WARNING: Failed to access directory: /test-192.168.1.87-torsten: No such file or directory NOTICE: About to notify administrator about event backup-ok, running script '/root/exobackup/boxbackup/NotifySysadmin.sh backup-ok' My problems: - this errors are only printed once. The next backup runs do not consider to backup this location. That is not good for me. I have locations on remote storage mounted via samba. So only one mount error and i will never again be notified that this location is not backed up. - is this the right behavior, that backup-ok is called even though there was this error? I attached a little patch that makes box backup to retry this location. But i dont think that this is a clean way. Can anybody help me with this? Thank you Torsten --Boundary-00=_2xGEJHbkfDbvVWq Content-Type: text/x-diff; charset="iso 8859-15"; name="bb_retry_dir_not_existing.diff" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="bb_retry_dir_not_existing.diff" Index: bin/bbackupd/BackupDaemon.cpp =================================================================== --- bin/bbackupd/BackupDaemon.cpp (Revision 2373) +++ bin/bbackupd/BackupDaemon.cpp (Arbeitskopie) @@ -1676,7 +1676,7 @@ "for path '" << apLoc->mPath << "', skipping location '" << apLoc->mName << "'"); - continue; + //continue; } // Execute create directory command --Boundary-00=_2xGEJHbkfDbvVWq-- From boxbackup at boxbackup.org Tue Nov 4 18:00:03 2008 From: boxbackup at boxbackup.org (Brendon Baumgartner) Date: Tue, 4 Nov 2008 10:00:03 -0800 Subject: [Box Backup] Windows Boxbackup path configuration and eventlogs In-Reply-To: <5DB1D2D8020D4449AF3111C784529E621E1133@jeep.netcal.l> References: <5DB1D2D8020D4449AF3111C784529E621E1133@jeep.netcal.l> Message-ID: <5DB1D2D8020D4449AF3111C784529E624701A2@jeep.netcal.l> A few questions regarding the new win32 agent I'm using. 1. When a file open error occurs, there are 3 separate event log entries. Could this be reduced to 1? 2. Can I separately specify the verbosity of the logging in the event logs and the logfile? 3. What are the valid values for LogFileLevel? -BB From boxbackup at boxbackup.org Tue Nov 4 22:44:09 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Tue, 4 Nov 2008 22:44:09 +0000 (GMT) Subject: [Box Backup] Windows Boxbackup path configuration and eventlogs In-Reply-To: <5DB1D2D8020D4449AF3111C784529E624701A2@jeep.netcal.l> References: <5DB1D2D8020D4449AF3111C784529E621E1133@jeep.netcal.l> <5DB1D2D8020D4449AF3111C784529E624701A2@jeep.netcal.l> Message-ID: Hi Brendon, On Tue, 4 Nov 2008, Brendon Baumgartner wrote: > A few questions regarding the new win32 agent I'm using. > > 1. When a file open error occurs, there are 3 separate event log > entries. Could this be reduced to 1? That depends, what are they? > 2. Can I separately specify the verbosity of the logging in the event > logs and the logfile? Yes, the LogFile level depends only on the LogFileLevel configuration option and on nothing else. Use the command-line options to change the verbosity of console and event logging. > 3. What are the valid values for LogFileLevel? nothing, fatal, error, warning, notice, info, trace, everything. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Tue Nov 4 23:16:20 2008 From: boxbackup at boxbackup.org (Brendon Baumgartner) Date: Tue, 4 Nov 2008 15:16:20 -0800 Subject: [Box Backup] Windows Boxbackup path configuration and eventlogs In-Reply-To: References: <5DB1D2D8020D4449AF3111C784529E621E1133@jeep.netcal.l> <5DB1D2D8020D4449AF3111C784529E624701A2@jeep.netcal.l> Message-ID: <5DB1D2D8020D4449AF3111C784529E624701B1@jeep.netcal.l> Thanks... I'm getting further. Looking much better :) > > 1. When a file open error occurs, there are 3 separate event log > > entries. Could this be reduced to 1? >=20 > That depends, what are they? They are below (from the logfile, but the event log looks the same): 14:44:52 [WARNING] Failed to open file: C:\Documents and Settings\LocalService\ntuser.dat.LOG: Resource device (16) 14:44:52 [WARNING] Exception thrown: CommonException(OSFileOpenError) at FileStream.cpp(117) 14:44:52 [ERROR] Failed to upload file: C:\Documents and Settings\LocalService\ntuser.dat.LOG: caught exception: Common OSFileOpenError (Can't open a file -- attempted to load a non-existant config file or bad file referenced within?) (1/2)=20 It appears the solution for this is the verbosity in logging? One other thing, does StoreObjectInfoFile work on the Windows agent? The state file never gets created and I have the errors below. Does it take a few days for the state file to be created? WARNING: Failed to open file: C:\Program Files\BoxBackup\bbackupd\bbackupd.state: Invalid argument (22) WARNING: Exception thrown: CommonException(OSFileOpenError) at FileStream.cpp(117) ERROR: Internal error reading store object info file: C:\Program Files\BoxBackup\bbackupd\bbackupd.state: Common OSFileOpenError (Can't open a file -- attempted to load a non-existant config file or bad file referenced within?) WARNING: Store object info file is missing, not accessible, or inconsistent. Will re-cache from store. (C:\Program Files\BoxBackup\bbackupd\bbackupd.state) My scratchpad of notes/errors: http://pastebin.com/m260cfc0d -BB From boxbackup at boxbackup.org Tue Nov 4 23:45:12 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Tue, 4 Nov 2008 23:45:12 +0000 (GMT) Subject: [Box Backup] Windows Boxbackup path configuration and eventlogs In-Reply-To: <5DB1D2D8020D4449AF3111C784529E624701B1@jeep.netcal.l> References: <5DB1D2D8020D4449AF3111C784529E621E1133@jeep.netcal.l> <5DB1D2D8020D4449AF3111C784529E624701A2@jeep.netcal.l> <5DB1D2D8020D4449AF3111C784529E624701B1@jeep.netcal.l> Message-ID: Hi Brendon, On Tue, 4 Nov 2008, Brendon Baumgartner wrote: > > > 1. When a file open error occurs, there are 3 separate event log > > > entries. Could this be reduced to 1? > > > > That depends, what are they? > > They are below (from the logfile, but the event log looks the same): > > 14:44:52 [WARNING] Failed to open file: C:\Documents and > Settings\LocalService\ntuser.dat.LOG: Resource device (16) > 14:44:52 [WARNING] Exception thrown: CommonException(OSFileOpenError) at > FileStream.cpp(117) > 14:44:52 [ERROR] Failed to upload file: C:\Documents and > Settings\LocalService\ntuser.dat.LOG: caught exception: Common > OSFileOpenError (Can't open a file -- attempted to load a non-existant > config file or bad file referenced within?) (1/2) > > It appears the solution for this is the verbosity in logging? Yes, but it's only a partial solution. If you run bbackupd with -Werror then you will only get the last error message, but that may not help you to resolve the problem as it does not give the reason for the error. On the other hand, "Resource device" is not a very helpful error code (from Windows) in this case, so maybe you don't need it. > One other thing, does StoreObjectInfoFile work on the Windows agent? The > state file never gets created and I have the errors below. Does it take > a few days for the state file to be created? It should be created after a successful backup on all platforms. If the backup fails (does not complete) every time then it will never be created. Is your backup failing to complete? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Wed Nov 5 06:27:10 2008 From: boxbackup at boxbackup.org (Brendon Baumgartner) Date: Tue, 4 Nov 2008 22:27:10 -0800 Subject: [Box Backup] Windows Boxbackup path configuration and eventlogs In-Reply-To: References: <5DB1D2D8020D4449AF3111C784529E621E1133@jeep.netcal.l> <5DB1D2D8020D4449AF3111C784529E624701A2@jeep.netcal.l> <5DB1D2D8020D4449AF3111C784529E624701B1@jeep.netcal.l> Message-ID: <5DB1D2D8020D4449AF3111C784529E624701B5@jeep.netcal.l> Hi Chris! > > One other thing, does StoreObjectInfoFile work on the Windows agent? The > > state file never gets created and I have the errors below. Does it take > > a few days for the state file to be created? >=20 > It should be created after a successful backup on all platforms. If the > backup fails (does not complete) every time then it will never be > created. > Is your backup failing to complete? Ah ha! Yes, it is. It always dies at one particular file listed here along with the agent config. I reviewed the wiki notes on the TLSWriteFailed errors, but it looks like I have it correct. http://pastebin.com/m3b315cde Failed to upload file: D:\engineering\Solidworks 2006\SW06-3.daa: caught exception: Connection TLSWriteFailed (Probably a network issue between client and server.) (7/33) The file is 543 MB in size! -BB From boxbackup at boxbackup.org Wed Nov 5 19:31:41 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Wed, 5 Nov 2008 19:31:41 +0000 (GMT) Subject: [Box Backup] Windows Boxbackup path configuration and eventlogs In-Reply-To: <5DB1D2D8020D4449AF3111C784529E624701B5@jeep.netcal.l> References: <5DB1D2D8020D4449AF3111C784529E621E1133@jeep.netcal.l> <5DB1D2D8020D4449AF3111C784529E624701A2@jeep.netcal.l> <5DB1D2D8020D4449AF3111C784529E624701B1@jeep.netcal.l> <5DB1D2D8020D4449AF3111C784529E624701B5@jeep.netcal.l> Message-ID: Hi Brendon, On Tue, 4 Nov 2008, Brendon Baumgartner wrote: > > It should be created after a successful backup on all platforms. If > > the backup fails (does not complete) every time then it will never be > > created. Is your backup failing to complete? > > Ah ha! Yes, it is. It always dies at one particular file listed here > along with the agent config. I reviewed the wiki notes on the > TLSWriteFailed errors, but it looks like I have it correct. > > http://pastebin.com/m3b315cde > > Failed to upload file: D:\engineering\Solidworks 2006\SW06-3.daa: caught > exception: Connection TLSWriteFailed (Probably a network issue between > client and server.) (7/33) > > The file is 543 MB in size! Please could you enable maximum verbosity logging to a file with the following options: LogFile = c:\windows\temp\bbackupd.log (or similar) LogFileLevel = everything LogAllFileAccess = yes and send me the log file after a failed backup? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Wed Nov 5 22:14:12 2008 From: boxbackup at boxbackup.org (Brendon Baumgartner) Date: Wed, 5 Nov 2008 14:14:12 -0800 Subject: [Box Backup] Windows Boxbackup path configuration and eventlogs In-Reply-To: References: <5DB1D2D8020D4449AF3111C784529E621E1133@jeep.netcal.l> <5DB1D2D8020D4449AF3111C784529E624701A2@jeep.netcal.l> <5DB1D2D8020D4449AF3111C784529E624701B1@jeep.netcal.l> <5DB1D2D8020D4449AF3111C784529E624701B5@jeep.netcal.l> Message-ID: <5DB1D2D8020D4449AF3111C784529E624701BE@jeep.netcal.l> Hi Chris... =20 > Please could you enable maximum verbosity logging to a file with the > following options: >=20 > LogFile =3D c:\windows\temp\bbackupd.log (or similar) > LogFileLevel =3D everything > LogAllFileAccess =3D yes >=20 > and send me the log file after a failed backup? So I did all that, but there is seems there is a window of about 1 minute before the backup restarts and deletes the log. Any tips on saving the logfile? Are there log rotation settings? -BB From boxbackup at boxbackup.org Wed Nov 5 23:39:05 2008 From: boxbackup at boxbackup.org (Brendon Baumgartner) Date: Wed, 5 Nov 2008 15:39:05 -0800 Subject: [Box Backup] Windows Boxbackup path configuration and eventlogs In-Reply-To: <5DB1D2D8020D4449AF3111C784529E624701BE@jeep.netcal.l> References: <5DB1D2D8020D4449AF3111C784529E621E1133@jeep.netcal.l> <5DB1D2D8020D4449AF3111C784529E624701A2@jeep.netcal.l> <5DB1D2D8020D4449AF3111C784529E624701B1@jeep.netcal.l> <5DB1D2D8020D4449AF3111C784529E624701B5@jeep.netcal.l> <5DB1D2D8020D4449AF3111C784529E624701BE@jeep.netcal.l> Message-ID: <5DB1D2D8020D4449AF3111C784529E624701C1@jeep.netcal.l> > > LogFile =3D c:\windows\temp\bbackupd.log (or similar) > > LogFileLevel =3D everything > > LogAllFileAccess =3D yes > > > > and send me the log file after a failed backup? >=20 > So I did all that, but there is seems there is a window of about 1 > minute before the backup restarts and deletes the log. Any tips on > saving the logfile? Are there log rotation settings? I set automaticbackup to no and enabled pipes to use the controller. Let's see what happens. -BB From boxbackup at boxbackup.org Fri Nov 7 10:34:49 2008 From: boxbackup at boxbackup.org (Roy) Date: Fri, 07 Nov 2008 11:34:49 +0100 Subject: [Box Backup] Eventlog full with warnings Message-ID: <491419C9.1060500@hostingbrothers.nl> Hi all, I just upgraded my BoxBackup installation, to the latest Windows client release (2368) and the server to the latest SVN checkout (2373). First I got an error about the notify script on windows. There is an error in it. I replaced the section with the error with that same section from an older script. But now it is running I got numerous warnings, like this one: WARNING: Found conflicting parent ID for file ID 2002 ($PATH$\$FILENAME$): expected 118406 ($PATH$) but found 11495 (same directory used in two different locations?) $PATH$ is an existing path on my windows workstation, and $FILENAME$ also exists. Second $PATH$ is the same as the first. This directory is not used in any other location, so I don't understand this error. And more importantly, what can I do to solve this? Or is this not necessary (but then I always would have numerous warnings in my eventlog)? Thanks in advance, Roy From boxbackup at boxbackup.org Fri Nov 7 20:10:08 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Fri, 7 Nov 2008 20:10:08 +0000 (GMT) Subject: [Box Backup] Eventlog full with warnings In-Reply-To: <491419C9.1060500@hostingbrothers.nl> References: <491419C9.1060500@hostingbrothers.nl> Message-ID: Hi Roy, On Fri, 7 Nov 2008, Roy wrote: > I just upgraded my BoxBackup installation, to the latest Windows client > release (2368) and the server to the latest SVN checkout (2373). Great, thanks for testing it! > First I got an error about the notify script on windows. There is an > error in it. I replaced the section with the error with that same > section from an older script. Please could you let me know what exactly you changed, and to what, as I'm not aware of this error? > But now it is running I got numerous warnings, like this one: > WARNING: Found conflicting parent ID for file ID 2002 ($PATH$\$FILENAME$): > expected 118406 ($PATH$) but found 11495 (same directory used in two different > locations?) > > $PATH$ is an existing path on my windows workstation, and $FILENAME$ also > exists. Second $PATH$ is the same as the first. > > This directory is not used in any other location, so I don't understand > this error. And more importantly, what can I do to solve this? Or is > this not necessary (but then I always would have numerous warnings in my > eventlog)? Box Backup uses the file ID to track renamed files. It keeps a database of file IDs by name. If the ID changes between runs, this may indicate that the file was moved to a different directory. However, it should not change during a run. The only case where I've seen this is when I've created two locations using the same path, hence the suggestion in the error message. Please could you tell us what's in the BackupLocations section of your bbackupd.conf? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Sat Nov 8 14:01:01 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Sat, 8 Nov 2008 14:01:01 +0000 (GMT) Subject: [Box Backup] Web Management Interface Message-ID: Hi all, I've started work on a basic web management GUI for Box Backup servers, for my own purposes. You can find more information at: http://www.boxbackup.org/trac/wiki/WebManagementInterface I think that some of you have already developed web management GUIs for various purposes, and I'd like to see how these can be integrated into a unified system. Please let me know your suggestions. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Sat Nov 8 18:38:26 2008 From: boxbackup at boxbackup.org (Peter Jalajas, GigaLock Backup Services) Date: Sat, 8 Nov 2008 13:38:26 -0500 Subject: [Box Backup] Web Management Interface In-Reply-To: References: Message-ID: <74d01c7a0811081038n6101bee0vd0dede97bc9b0ba2@mail.gmail.com> Hi Chris, On Sat, Nov 8, 2008 at 9:01 AM, Chris Wilson wrote: > Hi all, > > I've started work on a basic web management GUI for Box Backup servers, > for my own purposes. You can find more information at: > > http://www.boxbackup.org/trac/wiki/WebManagementInterface > > I think that some of you have already developed web management GUIs for > various purposes, and I'd like to see how these can be integrated into a > unified system. Please let me know your suggestions. > Well, Chris, I, for one, would rather you worked on boxi... :^) (I think the client side is where more day-to-day activity by non-techies is performed. And I'd prefer that you focus on what you do better than anybody, and let someone else grapple with the server-side web interface.) While on the subject, while boxi is still under development, I'm about to hire a java developer buddy to work with me to create a gui wrapper around the boxbackup windows client .exe command lines. For queries and restores, it would be really handy, if I understand it correctly, to read from bbackupd.dat instead of contacting the server each time. Do you have any suggestions in that regard? Do we already have a tool for reading that file? Is bbackupd.dat documented somewhere ('cept in the code)? Thanks, Pete From boxbackup at boxbackup.org Sat Nov 8 18:49:40 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Sat, 8 Nov 2008 18:49:40 +0000 (GMT) Subject: [Box Backup] Web Management Interface In-Reply-To: <74d01c7a0811081038n6101bee0vd0dede97bc9b0ba2@mail.gmail.com> References: <74d01c7a0811081038n6101bee0vd0dede97bc9b0ba2@mail.gmail.com> Message-ID: Hi Pete, On Sat, 8 Nov 2008, Peter Jalajas, GigaLock Backup Services wrote: > Well, Chris, I, for one, would rather you worked on boxi... :^) (I > think the client side is where more day-to-day activity by non-techies > is performed. And I'd prefer that you focus on what you do better than > anybody, and let someone else grapple with the server-side web > interface.) Well I agree that it would be good for me to work on Boxi, but one of the best options for me is a partnership with a company that will sell Box Backup accounts for me. If they sell enough, it will help to pay for me to work on Boxi. But they're not Unix experts and need a better way to manage accounts. Also, the key management on Windows is really hard at the moment, and this is a big part of making it easier (by sorting out the CSR and certificate transfer). The other part is a script that I have planned for Windows should make it much easier. > While on the subject, while boxi is still under development, I'm about > to hire a java developer buddy to work with me to create a gui wrapper > around the boxbackup windows client .exe command lines. For queries and > restores, it would be really handy, if I understand it correctly, to > read from bbackupd.dat instead of contacting the server each time. Do > you have any suggestions in that regard? Do we already have a tool for > reading that file? Is bbackupd.dat documented somewhere ('cept in the > code)? Not sure what you mean by bbackupd.dat? Is that the StoreObjectInfoFile? I'm afraid it's not documented, I think Chromi wrote the code, I can explain the binary format to you if it helps (it's actually quite simple) but there's absolutely no guarantee that it won't change in future, or even that it will be present at a particular time (e.g. it's deleted at the start of a backup and only recreated if/when the backup finishes successfully). Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Fri Nov 7 23:21:04 2008 From: boxbackup at boxbackup.org (Roy) Date: Sat, 08 Nov 2008 00:21:04 +0100 Subject: [Box Backup] Eventlog full with warnings In-Reply-To: References: <491419C9.1060500@hostingbrothers.nl> Message-ID: <4914CD60.4090301@hostingbrothers.nl> This is a multi-part message in MIME format. --------------030905090305010408000403 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Chris Wilson wrote: > Hi Roy, > > On Fri, 7 Nov 2008, Roy wrote: > > >> I just upgraded my BoxBackup installation, to the latest Windows client >> release (2368) and the server to the latest SVN checkout (2373). >> > > Great, thanks for testing it! > > >> First I got an error about the notify script on windows. There is an >> error in it. I replaced the section with the error with that same >> section from an older script. >> > > Please could you let me know what exactly you changed, and to what, as I'm > not aware of this error? > I changed the read-error part from: subject = subjtmpl & " (read errors)" body = "Errors occurred reading some files or directories " & _ "for backup on " & hostname & "." _ & vbCrLf & _ vbCrLf & _ "===================================" & vbCrLf & _ "THESE FILES ARE NOT BEING BACKED UP" & vbCrLf & _ "===================================" & vbCrLf & vbCrLf & _ "Check the logs on "&hostname&" for the files and " & _ "directories which caused" & vbCrLf & _ "these errors, and take appropriate action." & vbCrLf & _ vbCrLf & _ "Other files are being backed up." & vbCrLf SendMail from,sendto,subject,body to subject = subjtmpl & " (read errors)" body = "Errors occured reading some files or directories for backup on "&hostname&"." _ & vbCrLf & vbCrLf & _ "===================================" & vbCrLf & _ "THESE FILES ARE NOT BEING BACKED UP" & vbCrLf & _ "===================================" & vbCrLf & vbCrLf & _ "Check the logs on "&hostname&" for the files and directories which caused" & _ "these errors, and take appropraite action." & vbCrLf & vbCrLf & _ "Other files are being backed up." & vbCrLf SendMail from,sendto,subject,body The latter section I had in my older notify script. I couldn't locate the fault in the one supplied, but I'm not familiar with the language of these scripts. > >> But now it is running I got numerous warnings, like this one: >> WARNING: Found conflicting parent ID for file ID 2002 ($PATH$\$FILENAME$): >> expected 118406 ($PATH$) but found 11495 (same directory used in two different >> locations?) >> >> $PATH$ is an existing path on my windows workstation, and $FILENAME$ also >> exists. Second $PATH$ is the same as the first. >> >> This directory is not used in any other location, so I don't understand >> this error. And more importantly, what can I do to solve this? Or is >> this not necessary (but then I always would have numerous warnings in my >> eventlog)? >> > > Box Backup uses the file ID to track renamed files. It keeps a database of > file IDs by name. If the ID changes between runs, this may indicate that > the file was moved to a different directory. However, it should not change > during a run. The only case where I've seen this is when I've created two > locations using the same path, hence the suggestion in the error message. > Please could you tell us what's in the BackupLocations section of your > bbackupd.conf? > > Cheers, Chris. > Everytime it runs, I got these errors. So it thinks the file is moved everytime? BackupLocations section: GTO { Path = D:\GTO } Foto's & Afbeeldingen { Path = D:\Foto's & Afbeeldingen } Application Data { Path = C:\Documents and Settings\Makaveli\Application Data ExcludeDir = C:\Documents and Settings\Makaveli\Application Data\Skype ExcludeFilesRegex = .(lock)$ ExcludeFilesRegex = .(.sqlite-journal)$ } Bureaublad { Path = C:\Documents and Settings\Makaveli\Bureaublad } Hope this helps. Thanks in advance, Roy --------------030905090305010408000403 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Chris Wilson wrote:
Hi Roy,

On Fri, 7 Nov 2008, Roy wrote:

  
I just upgraded my BoxBackup installation, to the latest Windows client 
release (2368) and the server to the latest SVN checkout (2373).
    

Great, thanks for testing it!

  
First I got an error about the notify script on windows. There is an 
error in it. I replaced the section with the error with that same 
section from an older script.
    

Please could you let me know what exactly you changed, and to what, as I'm 
not aware of this error?
  
I changed the read-error part from:
    subject = subjtmpl & " (read errors)"
    body =    "Errors occurred reading some files or directories " & _
        "for backup on " & hostname & "." _ & vbCrLf & _
        vbCrLf & _
        "===================================" & vbCrLf & _
        "THESE FILES ARE NOT BEING BACKED UP" & vbCrLf & _
        "===================================" & vbCrLf & vbCrLf & _
        "Check the logs on "&hostname&" for the files and " & _
        "directories which caused" & vbCrLf & _
        "these errors, and take appropriate action." & vbCrLf & _
        vbCrLf & _
        "Other files are being backed up." & vbCrLf
    SendMail from,sendto,subject,body

to
    subject = subjtmpl & " (read errors)"
    body =    "Errors occured reading some files or directories for backup on "&hostname&"." _
            & vbCrLf & vbCrLf & _
            "===================================" & vbCrLf & _
            "THESE FILES ARE NOT BEING BACKED UP" & vbCrLf & _
            "===================================" & vbCrLf & vbCrLf & _
            "Check the logs on "&hostname&" for the files and directories which caused" & _
            "these errors, and take appropraite action." & vbCrLf & vbCrLf & _
            "Other files are being backed up." & vbCrLf
    SendMail from,sendto,subject,body

The latter section I had in my older notify script. I couldn't locate the fault in the one supplied, but I'm not familiar with the language of these scripts.
  
But now it is running I got numerous warnings, like this one:
WARNING: Found conflicting parent ID for file ID 2002 ($PATH$\$FILENAME$):
expected 118406 ($PATH$) but found 11495 (same directory used in two different
locations?)

$PATH$ is an existing path on my windows workstation, and $FILENAME$ also
exists. Second $PATH$ is the same as the first.

This directory is not used in any other location, so I don't understand 
this error. And more importantly, what can I do to solve this? Or is 
this not necessary (but then I always would have numerous warnings in my 
eventlog)?
    

Box Backup uses the file ID to track renamed files. It keeps a database of 
file IDs by name. If the ID changes between runs, this may indicate that 
the file was moved to a different directory. However, it should not change 
during a run. The only case where I've seen this is when I've created two 
locations using the same path, hence the suggestion in the error message. 
Please could you tell us what's in the BackupLocations section of your
bbackupd.conf?

Cheers, Chris.
  

Everytime it runs, I got these errors. So it thinks the file is moved everytime?
BackupLocations section:
    GTO
    {
        Path = D:\GTO
    }
   
    Foto's & Afbeeldingen
    {
        Path = D:\Foto's & Afbeeldingen
    }
   
    Application Data
    {
        Path = C:\Documents and Settings\Makaveli\Application Data
        ExcludeDir = C:\Documents and Settings\Makaveli\Application Data\Skype
        ExcludeFilesRegex = .(lock)$
        ExcludeFilesRegex = .(.sqlite-journal)$
    }
   
    Bureaublad
    {
        Path = C:\Documents and Settings\Makaveli\Bureaublad
    }

Hope this helps.

Thanks in advance,

Roy
--------------030905090305010408000403-- From boxbackup at boxbackup.org Sat Nov 8 20:38:05 2008 From: boxbackup at boxbackup.org (Peter Jalajas, GigaLock Backup Services) Date: Sat, 8 Nov 2008 15:38:05 -0500 Subject: [Box Backup] Web Management Interface In-Reply-To: References: <74d01c7a0811081038n6101bee0vd0dede97bc9b0ba2@mail.gmail.com> Message-ID: <74d01c7a0811081238w38224731qce251ad798adb415@mail.gmail.com> Hi Chris, On Sat, Nov 8, 2008 at 1:49 PM, Chris Wilson wrote: > Hi Pete, > > On Sat, 8 Nov 2008, Peter Jalajas, GigaLock Backup Services wrote: > > Well I agree that it would be good for me to work on Boxi, but one of the > best options for me is a partnership with a company that will sell Box > Backup accounts for me. If they sell enough, it will help to pay for me to > work on Boxi. But they're not Unix experts and need a better way to manage > accounts. Yes, my situation exactly. > Also, the key management on Windows is really hard at the moment, and this > is a big part of making it easier (by sorting out the CSR and certificate > transfer). The other part is a script that I have planned for Windows > should make it much easier. I'd offer to help, but I haven't been very good at following up on such offers. FWIW, I have a script that I run by hand on my separate key CA machine that handles much of the process. My reseller requests an account via my website, I run the script, and it: 1) chooses an account number, 2) generates the keys and signs the csr, 3) creates the account on the store server via keyless ssh, and 4) sends the reseller a .7z file, encrypted to the reseller's pre-shared password (gosh I wish I could get them to use PKI!), that contains the client keys encrypted in another client .7z, and that also contains another file with the unique password for that client .7z file. The reseller then: 5) unzips their reseller .7z file on their own machine (not the client machine), 6) obtains the client keys and the client .7z file password inside there, 7) puts the client .7z file in the correct place on the client machine, and then 8) runs a little batch file I have there that runs 7za.exe to unzip the client .7z file, prompting for that client .7z password. Maybe some of that logic(!) can be applied to your tool? Suggestions welcome! >> While on the subject, while boxi is still under development, I'm about >> to hire a java developer buddy to work with me to create a gui wrapper >> around the boxbackup windows client .exe command lines. For queries and >> restores, it would be really handy, if I understand it correctly, to >> read from bbackupd.dat instead of contacting the server each time. Do >> you have any suggestions in that regard? Do we already have a tool for >> reading that file? Is bbackupd.dat documented somewhere ('cept in the >> code)? > > Not sure what you mean by bbackupd.dat? Is that the StoreObjectInfoFile? Yes, sorry. > I'm afraid it's not documented, I think Chromi wrote the code, I can > explain the binary format to you if it helps (it's actually quite simple) Please do. I'm hoping that my java gui can use that file to quickly build a snappy interactive file-and-directory tree, including old and deleted files (instead of having to use 'bbackupquery "list -dotsr" quit | findstr ...'), for more convenient queries and restores. > but there's absolutely no guarantee that it won't change in future, or > even that it will be present at a particular time (e.g. it's deleted at > the start of a backup and only recreated if/when the backup finishes > successfully). Understood. Thanks, Pete From boxbackup at boxbackup.org Sat Nov 8 20:38:18 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Sat, 8 Nov 2008 20:38:18 +0000 (GMT) Subject: [Box Backup] Eventlog full with warnings In-Reply-To: <4914CD60.4090301@hostingbrothers.nl> References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> Message-ID: Hi Roy, On Sat, 8 Nov 2008, Roy wrote: > > > First I got an error about the notify script on windows. There is an > > > error in it. I replaced the section with the error with that same > > > section from an older script. > > > > Please could you let me know what exactly you changed, and to what, as > > I'm not aware of this error? ... > The latter section I had in my older notify script. I couldn't locate the > fault in the one supplied, but I'm not familiar with the language of these > scripts. If you have a chance, could you try changing it back to the original text and report the error message and line number that Windows reports on the script? Thanks! > > > But now it is running I got numerous warnings, like this one: > > > WARNING: Found conflicting parent ID for file ID 2002 > > > ($PATH$\$FILENAME$): expected 118406 ($PATH$) but found 11495 (same > > > directory used in two different locations?) > > > > > > $PATH$ is an existing path on my windows workstation, and $FILENAME$ > > > also exists. Second $PATH$ is the same as the first. > > > > > > This directory is not used in any other location, so I don't > > > understand this error. And more importantly, what can I do to solve > > > this? Or is this not necessary (but then I always would have > > > numerous warnings in my eventlog)? > > Everytime it runs, I got these errors. So it thinks the file is moved > everytime? Yes, exactly. The reason is probably that two different locations have the same file ID. I guess you're not using NTFS junction points, are you? Please could you tell me what "dir c:\" and "dir d:\" report as the Volume Serial Number for both volumes? Also, please could you try running bbackupd with the following configuration options: LogFile = c:\bbackupd.log LogFileLevel = debug and send me the log file that it produces? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Sat Nov 8 21:54:28 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Sat, 8 Nov 2008 21:54:28 +0000 (GMT) Subject: [Box Backup] Web Management Interface In-Reply-To: <74d01c7a0811081238w38224731qce251ad798adb415@mail.gmail.com> References: <74d01c7a0811081038n6101bee0vd0dede97bc9b0ba2@mail.gmail.com> <74d01c7a0811081238w38224731qce251ad798adb415@mail.gmail.com> Message-ID: Hi Pete, On Sat, 8 Nov 2008, Peter Jalajas, GigaLock Backup Services wrote: > > Also, the key management on Windows is really hard at the moment, and > > this is a big part of making it easier (by sorting out the CSR and > > certificate transfer). The other part is a script that I have planned > > for Windows should make it much easier. > > I'd offer to help, but I haven't been very good at following up on > such offers. FWIW, I have a script that I run by hand on my separate > key CA machine that handles much of the process. My reseller requests > an account via my website, I run the script, and it: > 1) chooses an account number, > 2) generates the keys and signs the csr, > 3) creates the account on the store server via keyless ssh, and > 4) sends the reseller a .7z file, encrypted to the reseller's > pre-shared password (gosh I wish I could get them to use PKI!), that > contains the client keys encrypted in another client .7z, and that > also contains another file with the unique password for that client > .7z file. > The reseller then: > 5) unzips their reseller .7z file on their own machine (not the client > machine), > 6) obtains the client keys and the client .7z file password inside there, > 7) puts the client .7z file in the correct place on the client > machine, and then > 8) runs a little batch file I have there that runs 7za.exe to unzip > the client .7z file, prompting for that client .7z password. > Maybe some of that logic(!) can be applied to your tool? > Suggestions welcome! I'm hoping that it won't be necessary to do such complex things. There should be a simple signup API where the reseller can give the user an account number and password, they enter it into Boxi (or a script or other GUI on their machine) and it generates their keys locally and uses the web interface to get the certificate. That way you don't need to have access to their keys. > > Not sure what you mean by bbackupd.dat? Is that the > > StoreObjectInfoFile? I'm afraid it's not documented, I think Chromi > > wrote the code, I can explain the binary format to you if it helps > > (it's actually quite simple) > > Please do. I'm hoping that my java gui can use that file to quickly > build a snappy interactive file-and-directory tree, including old and > deleted files (instead of having to use 'bbackupquery "list -dotsr" > quit | findstr ...'), for more convenient queries and restores. Have a look at this: http://www.boxbackup.org/trac/wiki/StoreObjectInfoFile Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Sat Nov 8 21:57:29 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Sat, 8 Nov 2008 21:57:29 +0000 (GMT) Subject: [Box Backup] Eventlog full with warnings In-Reply-To: References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> Message-ID: On Sat, 8 Nov 2008, Chris Wilson wrote: > LogFile = c:\bbackupd.log > LogFileLevel = debug Sorry, that should have been: LogFileLevel = trace I'm afraid I haven't been able to reproduce the problem, so I'll really need that log file to help. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Sat Nov 8 22:16:46 2008 From: boxbackup at boxbackup.org (Peter Jalajas, GigaLock Backup Services) Date: Sat, 8 Nov 2008 17:16:46 -0500 Subject: [Box Backup] Web Management Interface In-Reply-To: References: <74d01c7a0811081038n6101bee0vd0dede97bc9b0ba2@mail.gmail.com> <74d01c7a0811081238w38224731qce251ad798adb415@mail.gmail.com> Message-ID: <74d01c7a0811081416u77c2bb5ek7cdd103c610f6d07@mail.gmail.com> Hi Chris, On Sat, Nov 8, 2008 at 4:54 PM, Chris Wilson wrote: > Hi Pete, > > On Sat, 8 Nov 2008, Peter Jalajas, GigaLock Backup Services wrote: > >> > Also, the key management on Windows is really hard at the moment, and >> > this is a big part of making it easier (by sorting out the CSR and >> > certificate transfer). The other part is a script that I have planned >> > for Windows should make it much easier. >> >> I'd offer to help, but I haven't been very good at following up on >> such offers. FWIW, I have a script that I run by hand on my separate >> key CA machine that handles much of the process. My reseller requests >> an account via my website, I run the script, and it: >> 1) chooses an account number, >> 2) generates the keys and signs the csr, >> 3) creates the account on the store server via keyless ssh, and >> 4) sends the reseller a .7z file, encrypted to the reseller's >> pre-shared password (gosh I wish I could get them to use PKI!), that >> contains the client keys encrypted in another client .7z, and that >> also contains another file with the unique password for that client >> .7z file. >> The reseller then: >> 5) unzips their reseller .7z file on their own machine (not the client >> machine), >> 6) obtains the client keys and the client .7z file password inside there, >> 7) puts the client .7z file in the correct place on the client >> machine, and then >> 8) runs a little batch file I have there that runs 7za.exe to unzip >> the client .7z file, prompting for that client .7z password. >> Maybe some of that logic(!) can be applied to your tool? >> Suggestions welcome! > > I'm hoping that it won't be necessary to do such complex things. There > should be a simple signup API where the reseller can give the user an > account number and password, they enter it into Boxi (or a script or other > GUI on their machine) and it generates their keys locally and uses the web > interface to get the certificate. That way you don't need to have access > to their keys. Yes, something easier, and more secure like that, would be nice. >> > Not sure what you mean by bbackupd.dat? Is that the >> > StoreObjectInfoFile? I'm afraid it's not documented, I think Chromi >> > wrote the code, I can explain the binary format to you if it helps >> > (it's actually quite simple) >> >> Please do. I'm hoping that my java gui can use that file to quickly >> build a snappy interactive file-and-directory tree, including old and >> deleted files (instead of having to use 'bbackupquery "list -dotsr" >> quit | findstr ...'), for more convenient queries and restores. > > Have a look at this: > > http://www.boxbackup.org/trac/wiki/StoreObjectInfoFile That'll take a while to digest. You are amazing. Thanks for all you do! Pete From boxbackup at boxbackup.org Sat Nov 8 22:17:36 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Sat, 8 Nov 2008 22:17:36 +0000 (GMT) Subject: [Box Backup] box backup and not existing directories In-Reply-To: <200811041638.30484.ddmails@web.de> References: <200811041638.30484.ddmails@web.de> Message-ID: Hi Torsten, On Tue, 4 Nov 2008, Torsten wrote: > if i have a location not existing locally and not existing on the store > but activated as a location in bbackupd.conf. With this configuration > box backup throws this errors on start. > > ERROR: Failed to stat file: '/test-192.168.1.87-torsten': No such file or > directory (2) > WARNING: Exception thrown: CommonException(OSFileError) at > BackupClientFileAttributes.cpp(309) > ERROR: Failed to get attributes for path '/test-192.168.1.87-torsten', > skipping location 'test-192.168.1.87-torsten' > WARNING: Failed to access directory: /test-192.168.1.87-torsten: No such file > or directory > NOTICE: About to notify administrator about event backup-ok, running > script '/root/exobackup/boxbackup/NotifySysadmin.sh backup-ok' > > My problems: > > - this errors are only printed once. The next backup runs do not consider to > backup this location. That is not good for me. I have locations on remote > storage mounted via samba. So only one mount error and i will never again be > notified that this location is not backed up. Thanks for reporting this. I agree that it should be reported on every backup that the location is not available, or it should be included if it is. However I'm uncertain about what other effects your patch may have, and therefore I'm reluctant to include it right now. I'll have to think about it a bit more, which will take a bit of time. > - is this the right behavior, that backup-ok is called even though there > was this error? No, that is definitely a bug. I don't have time to fix it now so I've filed a bug report at http://www.boxbackup.org/trac/ticket/48. If you like, please continue using your patch and let us know if you have any problems. That should help me to believe that it's safe to include. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Sat Nov 8 22:40:44 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Sat, 8 Nov 2008 22:40:44 +0000 (GMT) Subject: [Box Backup] Restoring deleted files recursively In-Reply-To: <490ED9D3.8000505@kontrapunkt.com> References: <20080114222604.6140da6b@matrix.tuxianer.homelinux.net> <20080128193457.0cfbdcd4@matrix.tuxianer.homelinux.net> <490ED9D3.8000505@kontrapunkt.com> Message-ID: This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. ---128931150-1864528584-1226184044=:29722 Content-Type: TEXT/PLAIN; charset=US-ASCII Hi Tobias and all, On Mon, 3 Nov 2008, Tobias Balle-Petersen wrote: > I have the exact same problem as described by Torsten below. > > > I made some tests and now i can more specific describe my problem. > > > > Deleted files inside of a (not deleted) subdirectory are not restored. > > I have a maildir with subfolders and want to restore all deleted mails within > still existing directories. > > The command: > "restore -d top_dir_on_store new_folder_on_mailserver" > > Restores nothing. So I have to go into every directory with bbackupquery > and identify if it has deleted mail, and then restore folders like that > one by one. So tedious to be unusable. Sorry to hear about this problem. Please could you try the attached patch and see if it makes a difference for you? This patch changes the behaviour of the "restore -d" command so that it restores all files, including deleted files, rather than just deleted files. If anyone has any objections to this new behaviour, please speak now, before I apply it. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | ---128931150-1864528584-1226184044=:29722 Content-Type: TEXT/PLAIN; charset=US-ASCII; name=bb_restore_deleted_restores_all.patch Content-Transfer-Encoding: BASE64 Content-ID: Content-Description: Content-Disposition: attachment; filename=bb_restore_deleted_restores_all.patch SW5kZXg6IGxpYi9iYWNrdXBjbGllbnQvQmFja3VwQ2xpZW50UmVzdG9yZS5j cHANCj09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT0NCi0tLSBsaWIvYmFja3VwY2xp ZW50L0JhY2t1cENsaWVudFJlc3RvcmUuY3BwCShyZXZpc2lvbiAyMzczKQ0K KysrIGxpYi9iYWNrdXBjbGllbnQvQmFja3VwQ2xpZW50UmVzdG9yZS5jcHAJ KHdvcmtpbmcgY29weSkNCkBAIC00NDAsNyArNDQwLDcgQEANCiAJLy8gbGlz dCBvZiBmaWxlcyB3aGljaCBpcyBhcHByb3ByaWF0ZSB0byB0aGUgcmVzdG9y ZSB0eXBlDQogCXJDb25uZWN0aW9uLlF1ZXJ5TGlzdERpcmVjdG9yeSgNCiAJ CURpcmVjdG9yeUlELA0KLQkJUGFyYW1zLlJlc3RvcmVEZWxldGVkPyhCYWNr dXBQcm90b2NvbENsaWVudExpc3REaXJlY3Rvcnk6OkZsYWdzX0RlbGV0ZWQp OihCYWNrdXBQcm90b2NvbENsaWVudExpc3REaXJlY3Rvcnk6OkZsYWdzX0lO Q0xVREVfRVZFUllUSElORyksDQorCQlCYWNrdXBQcm90b2NvbENsaWVudExp c3REaXJlY3Rvcnk6OkZsYWdzX0lOQ0xVREVfRVZFUllUSElORywNCiAJCUJh Y2t1cFByb3RvY29sQ2xpZW50TGlzdERpcmVjdG9yeTo6RmxhZ3NfT2xkVmVy c2lvbiB8IChQYXJhbXMuUmVzdG9yZURlbGV0ZWQ/KDApOihCYWNrdXBQcm90 b2NvbENsaWVudExpc3REaXJlY3Rvcnk6OkZsYWdzX0RlbGV0ZWQpKSwNCiAJ CXRydWUgLyogd2FudCBhdHRyaWJ1dGVzICovKTsNCiANCg== ---128931150-1864528584-1226184044=:29722-- From boxbackup at boxbackup.org Sat Nov 8 22:40:44 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Sat, 8 Nov 2008 22:40:44 +0000 (GMT) Subject: [Box Backup] Restoring deleted files recursively In-Reply-To: <490ED9D3.8000505@kontrapunkt.com> References: <20080114222604.6140da6b@matrix.tuxianer.homelinux.net> <20080128193457.0cfbdcd4@matrix.tuxianer.homelinux.net> <490ED9D3.8000505@kontrapunkt.com> Message-ID: This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. ---128931150-1864528584-1226184044=:29722 Content-Type: TEXT/PLAIN; charset=US-ASCII Hi Tobias and all, On Mon, 3 Nov 2008, Tobias Balle-Petersen wrote: > I have the exact same problem as described by Torsten below. > > > I made some tests and now i can more specific describe my problem. > > > > Deleted files inside of a (not deleted) subdirectory are not restored. > > I have a maildir with subfolders and want to restore all deleted mails within > still existing directories. > > The command: > "restore -d top_dir_on_store new_folder_on_mailserver" > > Restores nothing. So I have to go into every directory with bbackupquery > and identify if it has deleted mail, and then restore folders like that > one by one. So tedious to be unusable. Sorry to hear about this problem. Please could you try the attached patch and see if it makes a difference for you? This patch changes the behaviour of the "restore -d" command so that it restores all files, including deleted files, rather than just deleted files. If anyone has any objections to this new behaviour, please speak now, before I apply it. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | ---128931150-1864528584-1226184044=:29722 Content-Type: TEXT/PLAIN; charset=US-ASCII; name=bb_restore_deleted_restores_all.patch Content-Transfer-Encoding: BASE64 Content-ID: Content-Description: Content-Disposition: attachment; filename=bb_restore_deleted_restores_all.patch SW5kZXg6IGxpYi9iYWNrdXBjbGllbnQvQmFja3VwQ2xpZW50UmVzdG9yZS5j cHANCj09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT0NCi0tLSBsaWIvYmFja3VwY2xp ZW50L0JhY2t1cENsaWVudFJlc3RvcmUuY3BwCShyZXZpc2lvbiAyMzczKQ0K KysrIGxpYi9iYWNrdXBjbGllbnQvQmFja3VwQ2xpZW50UmVzdG9yZS5jcHAJ KHdvcmtpbmcgY29weSkNCkBAIC00NDAsNyArNDQwLDcgQEANCiAJLy8gbGlz dCBvZiBmaWxlcyB3aGljaCBpcyBhcHByb3ByaWF0ZSB0byB0aGUgcmVzdG9y ZSB0eXBlDQogCXJDb25uZWN0aW9uLlF1ZXJ5TGlzdERpcmVjdG9yeSgNCiAJ CURpcmVjdG9yeUlELA0KLQkJUGFyYW1zLlJlc3RvcmVEZWxldGVkPyhCYWNr dXBQcm90b2NvbENsaWVudExpc3REaXJlY3Rvcnk6OkZsYWdzX0RlbGV0ZWQp OihCYWNrdXBQcm90b2NvbENsaWVudExpc3REaXJlY3Rvcnk6OkZsYWdzX0lO Q0xVREVfRVZFUllUSElORyksDQorCQlCYWNrdXBQcm90b2NvbENsaWVudExp c3REaXJlY3Rvcnk6OkZsYWdzX0lOQ0xVREVfRVZFUllUSElORywNCiAJCUJh Y2t1cFByb3RvY29sQ2xpZW50TGlzdERpcmVjdG9yeTo6RmxhZ3NfT2xkVmVy c2lvbiB8IChQYXJhbXMuUmVzdG9yZURlbGV0ZWQ/KDApOihCYWNrdXBQcm90 b2NvbENsaWVudExpc3REaXJlY3Rvcnk6OkZsYWdzX0RlbGV0ZWQpKSwNCiAJ CXRydWUgLyogd2FudCBhdHRyaWJ1dGVzICovKTsNCiANCg== ---128931150-1864528584-1226184044=:29722-- From boxbackup at boxbackup.org Sun Nov 9 23:23:35 2008 From: boxbackup at boxbackup.org (Tobias Balle-Petersen) Date: Mon, 10 Nov 2008 00:23:35 +0100 Subject: [Box Backup] Web Management Interface In-Reply-To: References: Message-ID: <491770F7.8040602@kontrapunkt.com> Hello Chris. Chris Wilson wrote: > Hi all, > > I've started work on a basic web management GUI for Box Backup servers, > for my own purposes. You can find more information at: Very interesting! This is really something I would like for boxbackup. Thank you for all your hard work on bb. Tobias From boxbackup at boxbackup.org Mon Nov 10 00:05:32 2008 From: boxbackup at boxbackup.org (Scott McNee) Date: Mon, 10 Nov 2008 10:05:32 +1000 Subject: [Box Backup] Web Management Interface In-Reply-To: References: Message-ID: <49177ACC.8030507@lubetech.com.au> Chris Wilson wrote: > Hi all, > > I've started work on a basic web management GUI for Box Backup servers, > for my own purposes. You can find more information at: > > http://www.boxbackup.org/trac/wiki/WebManagementInterface > > I think that some of you have already developed web management GUIs for > various purposes, and I'd like to see how these can be integrated into a > unified system. Please let me know your suggestions. > > Cheers, Chris. > Hi Chris, Thanks for the effort that you have been putting in I really appreciate it. I have been having a play with your Web Interface and I have hit a snag. At a guess it could be different version of the bbstoreaccounts program and the way that it outputs its data. The error that I am getting is : Bad format in bbstoreaccounts info output for account 1: 'Account ID is integer specified in hex ' at /var/www/html/admin/accounts/accounts.cgi line 403. Accounts.txt : 1:0 27c3e3:0 3e44a1:0 5c7fb7:0 15fb969:0 19d1606:0 728216e:0 bbstoreaccounts info 1 : Account ID: 00000001 Last object ID: 143587 Blocks used: 13036178 (50922.57Mb) Blocks used by old files: 88367 (345.18Mb) Blocks used by deleted files: 3536705 (13815.25Mb) Blocks used by directories: 5359 (20.93Mb) Block soft limit: 13107200 (51200.00Mb) Block hard limit: 14417920 (56320.00Mb) Client store marker: 1226101987000000 Any Ideas ? Thanks. Scott. From boxbackup at boxbackup.org Mon Nov 10 00:09:04 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Mon, 10 Nov 2008 00:09:04 +0000 (GMT) Subject: [Box Backup] Web Management Interface In-Reply-To: <49177ACC.8030507@lubetech.com.au> References: <49177ACC.8030507@lubetech.com.au> Message-ID: Hi Scott, On Mon, 10 Nov 2008, Scott McNee wrote: > Thanks for the effort that you have been putting in I really appreciate > it. > > I have been having a play with your Web Interface and I have hit a snag. > At a guess it could be different version of the bbstoreaccounts program > and the way that it outputs its data. > > The error that I am getting is : > > Bad format in bbstoreaccounts info output for account 1: 'Account ID is > integer specified in hex' at /var/www/html/admin/accounts/accounts.cgi > line 403. I think you probably need a very recent version of bbstoreaccounts which has the -m option to display the output in machine-readable format. Thanks for testing though! Please note that account creation doesn't actually create the account yet. i.e. this is not finished code. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Mon Nov 10 01:34:40 2008 From: boxbackup at boxbackup.org (Scott McNee) Date: Mon, 10 Nov 2008 11:34:40 +1000 Subject: [Box Backup] Web Management Interface In-Reply-To: References: <49177ACC.8030507@lubetech.com.au> Message-ID: <49178FB0.7090204@lubetech.com.au> Chris Wilson wrote: > Hi Scott, > > On Mon, 10 Nov 2008, Scott McNee wrote: > > >> Thanks for the effort that you have been putting in I really appreciate >> it. >> >> I have been having a play with your Web Interface and I have hit a snag. >> At a guess it could be different version of the bbstoreaccounts program >> and the way that it outputs its data. >> >> The error that I am getting is : >> >> Bad format in bbstoreaccounts info output for account 1: 'Account ID is >> integer specified in hex' at /var/www/html/admin/accounts/accounts.cgi >> line 403. >> > > I think you probably need a very recent version of bbstoreaccounts > which has the -m option to display the output in machine-readable format. > > Thanks for testing though! > > Please note that account creation doesn't actually create the account yet. > i.e. this is not finished code. > > Cheers, Chris. > Hi Chris thanks for the prompt reply, I downloaded the latest trunk and Installed. Another error has appeared Software error: at /var/www/html/admin/accounts/accounts.cgi line 348. bbstoreaccount -m output : Account ID: 0x00000001 Last object ID: 0x230e3 Used: 52144712 kB, 90% Old files: 353468 kB, 0% Deleted files: 14146820 kB, 24% Directories: 21436 kB, 0% Soft limit: 52428800 kB, 90% Hard limit: 57671680 kB, 100% Client store marker: 143587 From boxbackup at boxbackup.org Mon Nov 10 03:17:31 2008 From: boxbackup at boxbackup.org (Scott McNee) Date: Mon, 10 Nov 2008 13:17:31 +1000 Subject: [Box Backup] Web Management Interface In-Reply-To: References: <49177ACC.8030507@lubetech.com.au> Message-ID: <4917A7CB.7090906@lubetech.com.au> Chris Wilson wrote: > Hi Scott, > > On Mon, 10 Nov 2008, Scott McNee wrote: > > >> Thanks for the effort that you have been putting in I really appreciate >> it. >> >> I have been having a play with your Web Interface and I have hit a snag. >> At a guess it could be different version of the bbstoreaccounts program >> and the way that it outputs its data. >> >> The error that I am getting is : >> >> Bad format in bbstoreaccounts info output for account 1: 'Account ID is >> integer specified in hex' at /var/www/html/admin/accounts/accounts.cgi >> line 403. >> > > I think you probably need a very recent version of bbstoreaccounts > which has the -m option to display the output in machine-readable format. > > Thanks for testing though! > > Please note that account creation doesn't actually create the account yet. > i.e. this is not finished code. > > Cheers, Chris. > Further to the last issue : [Mon Nov 10 11:46:14 2008] [error] [client xxx.xxx.xxx.xxx] ERROR: Expected raidfile backup/0728216e//info does not exist [Mon Nov 10 11:46:14 2008] [error] [client xxx.xxx.xxx.xxx] WARNING: Exception thrown: RaidFileException(RaidFileDoesntExist) at RaidFileRead.cpp(1026) This message appears in the Apache error log. The path is correct and I have specifically set the RaidFile paht. Thanks. From boxbackup at boxbackup.org Mon Nov 10 08:32:09 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Mon, 10 Nov 2008 08:32:09 +0000 (GMT) Subject: [Box Backup] Web Management Interface In-Reply-To: <4917A7CB.7090906@lubetech.com.au> References: <49177ACC.8030507@lubetech.com.au> <4917A7CB.7090906@lubetech.com.au> Message-ID: Hi Scott, On Mon, 10 Nov 2008, Scott McNee wrote: > Further to the last issue : > > [Mon Nov 10 11:46:14 2008] [error] [client xxx.xxx.xxx.xxx] ERROR: Expected > raidfile backup/0728216e//info does not exist > [Mon Nov 10 11:46:14 2008] [error] [client xxx.xxx.xxx.xxx] WARNING: Exception > thrown: RaidFileException(RaidFileDoesntExist) at RaidFileRead.cpp(1026) > > This message appears in the Apache error log. > > The path is correct and I have specifically set the RaidFile paht. What did you set it to? It looks like you used a relative path. That won't work. Otherwise, does backup/0728216e/info exist under it? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Mon Nov 10 09:59:29 2008 From: boxbackup at boxbackup.org (Scott McNee) Date: Mon, 10 Nov 2008 19:59:29 +1000 Subject: [Box Backup] Web Management Interface In-Reply-To: References: <49177ACC.8030507@lubetech.com.au> <4917A7CB.7090906@lubetech.com.au> Message-ID: <49180601.3010101@lubetech.com.au> Chris Wilson wrote: > Hi Scott, > > On Mon, 10 Nov 2008, Scott McNee wrote: > > >> Further to the last issue : >> >> [Mon Nov 10 11:46:14 2008] [error] [client xxx.xxx.xxx.xxx] ERROR: Expected >> raidfile backup/0728216e//info does not exist >> [Mon Nov 10 11:46:14 2008] [error] [client xxx.xxx.xxx.xxx] WARNING: Exception >> thrown: RaidFileException(RaidFileDoesntExist) at RaidFileRead.cpp(1026) >> >> This message appears in the Apache error log. >> >> The path is correct and I have specifically set the RaidFile paht. >> > > What did you set it to? It looks like you used a relative path. That won't > work. Otherwise, does backup/0728216e/info exist under it? > > Cheers, Chris. > Hi Chris, Here is the raid file : The Path in accounts.cgi is definitely set to this file. (No relative paths at all) /etc/box/raidfile.conf disc0 { SetNumber = 0 BlockSize = 4096 Dir0 = /DATA/LUBETECH/CLIENTS/LIVE/Backups Dir1 = /DATA/LUBETECH/CLIENTS/LIVE/Backups Dir2 = /DATA/LUBETECH/CLIENTS/LIVE/Backups } Thanks From boxbackup at boxbackup.org Mon Nov 10 13:31:52 2008 From: boxbackup at boxbackup.org (Roy) Date: Mon, 10 Nov 2008 14:31:52 +0100 Subject: [Box Backup] Eventlog full with warnings In-Reply-To: References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> Message-ID: <491837C8.60303@hostingbrothers.nl> Chris Wilson wrote: > Hi Roy, > > On Sat, 8 Nov 2008, Roy wrote: > > >>>> First I got an error about the notify script on windows. There is an >>>> error in it. I replaced the section with the error with that same >>>> section from an older script. >>>> >>> Please could you let me know what exactly you changed, and to what, as >>> I'm not aware of this error? >>> > ... > >> The latter section I had in my older notify script. I couldn't locate the >> fault in the one supplied, but I'm not familiar with the language of these >> scripts. >> > > If you have a chance, could you try changing it back to the original text > and report the error message and line number that Windows reports on the > script? Thanks! > I've put the original backup, and get the following error: C:\Program Files\Box Backup>cscript NotifySysAdmin.vbs backup-start Microsoft (R) Windows Script Host versie 5.6 Copyright (C) Microsoft Corporation 1996-2001. Alle rechten voorbehouden. C:\Program Files\Box Backup\NotifySysAdmin.vbs(35, 39) Compilatiefout Microsoft VBScript: Ongeldig teken The error message is in dutch, so I will translate it here: C:\Program Files\Box Backup\NotifySysAdmin.vbs(35, 39) Compilation error Microsoft VBScript: Invalid character > >>>> But now it is running I got numerous warnings, like this one: >>>> WARNING: Found conflicting parent ID for file ID 2002 >>>> ($PATH$\$FILENAME$): expected 118406 ($PATH$) but found 11495 (same >>>> directory used in two different locations?) >>>> >>>> $PATH$ is an existing path on my windows workstation, and $FILENAME$ >>>> also exists. Second $PATH$ is the same as the first. >>>> >>>> This directory is not used in any other location, so I don't >>>> understand this error. And more importantly, what can I do to solve >>>> this? Or is this not necessary (but then I always would have >>>> numerous warnings in my eventlog)? >>>> >> Everytime it runs, I got these errors. So it thinks the file is moved >> everytime? >> > > Yes, exactly. The reason is probably that two different locations have the > same file ID. I guess you're not using NTFS junction points, are you? > Please could you tell me what "dir c:\" and "dir d:\" report as the Volume > Serial Number for both volumes? > > Also, please could you try running bbackupd with the following > configuration options: > > LogFile = c:\bbackupd.log > LogFileLevel = debug > > and send me the log file that it produces? > > Cheers, Chris. > I've done this and will post the results later. Thanks in advance, Roy From boxbackup at boxbackup.org Mon Nov 10 14:14:20 2008 From: boxbackup at boxbackup.org (Roy) Date: Mon, 10 Nov 2008 15:14:20 +0100 Subject: [Box Backup] Decimal or hexadecimal format account number? Message-ID: <491841BC.40206@hostingbrothers.nl> Hi all, In the logfiles on bbstored server I got the following messages: Nov 10 14:25:31 hostname bbstored client=0x00000001[24583]: NOTICE: Connection statistics for BACKUP-1: IN=425 OUT=14301 TOTAL=14726 Now I want to know if "client=0x00000001" is hexadecimal and the same for the number in "BACKUP-1"? The first looks hexadecimal to me, because of the 0x in front of it, but I rather be sure ;-) I want to know this, so I'm able to make correct regular expressions for logcheck. Thanks, Roy From boxbackup at boxbackup.org Mon Nov 10 14:53:22 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Mon, 10 Nov 2008 14:53:22 +0000 (GMT) Subject: [Box Backup] Decimal or hexadecimal format account number? In-Reply-To: <491841BC.40206@hostingbrothers.nl> References: <491841BC.40206@hostingbrothers.nl> Message-ID: Hi Roy, On Mon, 10 Nov 2008, Roy wrote: > In the logfiles on bbstored server I got the following messages: > > Nov 10 14:25:31 hostname bbstored client=0x00000001[24583]: NOTICE: > Connection statistics for BACKUP-1: IN=425 OUT=14301 TOTAL=14726 > > Now I want to know if "client=0x00000001" is hexadecimal and the same > for the number in "BACKUP-1"? The first looks hexadecimal to me, because > of the 0x in front of it, but I rather be sure ;-) I want to know this, > so I'm able to make correct regular expressions for logcheck. They should both be hexadecimal. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Mon Nov 10 01:24:59 2008 From: boxbackup at boxbackup.org (Scott McNee) Date: Mon, 10 Nov 2008 11:24:59 +1000 Subject: [Box Backup] Web Management Interface In-Reply-To: References: <49177ACC.8030507@lubetech.com.au> Message-ID: <49178D6B.7020309@lubetech.com.au> This is a multi-part message in MIME format. --------------020202060705060001060502 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Chris Wilson wrote: > Hi Scott, > > On Mon, 10 Nov 2008, Scott McNee wrote: > > >> Thanks for the effort that you have been putting in I really appreciate >> it. >> >> I have been having a play with your Web Interface and I have hit a snag. >> At a guess it could be different version of the bbstoreaccounts program >> and the way that it outputs its data. >> >> The error that I am getting is : >> >> Bad format in bbstoreaccounts info output for account 1: 'Account ID is >> integer specified in hex' at /var/www/html/admin/accounts/accounts.cgi >> line 403. >> > > I think you probably need a very recent version of bbstoreaccounts > which has the -m option to display the output in machine-readable format. > > Thanks for testing though! > > Please note that account creation doesn't actually create the account yet. > i.e. this is not finished code. > > Cheers, Chris. > Hi Chris thanks for the prompt reply, I downloaded the latest trunk and Installed. Another error has appeared Software error: at /var/www/html/admin/accounts/accounts.cgi line 348. bbstoreaccount -m output : Account ID: 0x00000001 Last object ID: 0x230e3 Used: 52144712 kB, 90% Old files: 353468 kB, 0% Deleted files: 14146820 kB, 24% Directories: 21436 kB, 0% Soft limit: 52428800 kB, 90% Hard limit: 57671680 kB, 100% Client store marker: 143587 --------------020202060705060001060502 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit
Chris Wilson wrote:
Hi Scott,

On Mon, 10 Nov 2008, Scott McNee wrote:

  
Thanks for the effort that you have been putting in I really appreciate 
it.

I have been having a play with your Web Interface and I have hit a snag. 
At a guess it could be different version of the bbstoreaccounts program 
and the way that it outputs its data.

The error that I am getting is :

Bad format in bbstoreaccounts info output for account 1: 'Account ID is 
integer specified in hex' at /var/www/html/admin/accounts/accounts.cgi 
line 403.
    

I think you probably need a very recent version of bbstoreaccounts
which has the -m option to display the output in machine-readable format.

Thanks for testing though!

Please note that account creation doesn't actually create the account yet. 
i.e. this is not finished code.

Cheers, Chris.
  

Hi Chris thanks for the prompt reply,

I downloaded the latest trunk and Installed. Another error has appeared

Software error:

 at /var/www/html/admin/accounts/accounts.cgi line 348.


bbstoreaccount -m output :

Account ID: 0x00000001
Last object ID: 0x230e3
Used: 52144712 kB, 90%
Old files: 353468 kB, 0%
Deleted files: 14146820 kB, 24%
Directories: 21436 kB, 0%
Soft limit: 52428800 kB, 90%
Hard limit: 57671680 kB, 100%
Client store marker: 143587




--------------020202060705060001060502-- From boxbackup at boxbackup.org Mon Nov 10 19:50:57 2008 From: boxbackup at boxbackup.org (Com Puter) Date: Mon, 10 Nov 2008 19:50:57 +0000 Subject: [Box Backup] Backup client gets a new home Message-ID: --_845d7959-2ec3-40b4-8a72-e25f482adf0a_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable I am backing up a client box that has almost 700GB of data. I need to move= it all to a bigger box. Is there anything important that I need to be awa= re of when moving the data to the new box? I don't want to start up the cl= ient agent and have it try to re-backup all the data. Is there a database = of some sort the agent uses to determine this that I need to make sure gets= copied also? Any other gotcha's?Thanks=2C-CJ _________________________________________________________________ Stay up to date on your PC=2C the Web=2C and your mobile phone with Windows= Live http://clk.atdmt.com/MRT/go/119462413/direct/01/= --_845d7959-2ec3-40b4-8a72-e25f482adf0a_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable I am backing up a client box that has almost 700GB of data. =A0I need to mo= ve it all to a bigger box. =A0Is there anything important that I need to be= aware of when moving the data to the new box? =A0I don't want to start up = the client agent and have it try to re-backup all the data. =A0Is there a d= atabase of some sort the agent uses to determine this that I need to make s= ure gets copied also? =A0Any other gotcha's?

<= /div>
Thanks=2C

-CJ


Stay up t= o date on your PC=2C the Web=2C and your mobile phone with Windows Live C= lick here = --_845d7959-2ec3-40b4-8a72-e25f482adf0a_-- From boxbackup at boxbackup.org Mon Nov 10 21:33:08 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Mon, 10 Nov 2008 21:33:08 +0000 (GMT) Subject: [Box Backup] Backup client gets a new home In-Reply-To: References: Message-ID: Hi CJ, On Mon, 10 Nov 2008, Com Puter wrote: > I am backing up a client box that has almost 700GB of data. I need to > move it all to a bigger box. Is there anything important that I need to > be aware of when moving the data to the new box? I don't want to start > up the client agent and have it try to re-backup all the data. Is there > a database of some sort the agent uses to determine this that I need to > make sure gets copied also? Any other gotcha's? Thanks,-CJ I can't think of any major gotchas. One thing that's important is to make sure that the client isn't backing up while you copy the data, otherwise you might get inconsistent files on the store. If it takes a long time to copy (it probably will for 700GB) and you don't want to stop the client for too long, then make the first copy, stop the client and use rsync to copy any differences quickly. All the information about file dates and times, etc. is in the account directory in stored objects, just like the file data. You might want to run a bbstoreaccount check on the account on both sides before restarting the client. Make sure you create the account on the server :) and that the new server's certificate is signed by the same CA as the old server's. That should be it, but do let us know if you have any problems. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Tue Nov 11 00:27:08 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Tue, 11 Nov 2008 00:27:08 +0000 (GMT) Subject: [Box Backup] Web Management Interface In-Reply-To: <49178FB0.7090204@lubetech.com.au> References: <49177ACC.8030507@lubetech.com.au> <49178FB0.7090204@lubetech.com.au> Message-ID: Hi Scott, On Mon, 10 Nov 2008, Scott McNee wrote: > Hi Chris thanks for the prompt reply, > > I downloaded the latest trunk and Installed. Another error has appeared > > Software error: > > at /var/www/html/admin/accounts/accounts.cgi line 348. > > bbstoreaccount -m output : > > Account ID: 0x00000001 > Last object ID: 0x230e3 > Used: 52144712 kB, 90% > Old files: 353468 kB, 0% > Deleted files: 14146820 kB, 24% > Directories: 21436 kB, 0% > Soft limit: 52428800 kB, 90% > Hard limit: 57671680 kB, 100% > Client store marker: 143587 I can't see an obvious cause for this error, so I added some more debugging code. Please could you update to the latest version of the web interface and tell me what error it reports? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Tue Nov 11 00:44:37 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Tue, 11 Nov 2008 00:44:37 +0000 (GMT) Subject: [Box Backup] Eventlog full with warnings In-Reply-To: <491837C8.60303@hostingbrothers.nl> References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> Message-ID: Hi Roy, On Mon, 10 Nov 2008, Roy wrote: > > > > > First I got an error about the notify script on windows. There is an > > > > > error in it. I replaced the section with the error with that same > > > > > section from an older script. > > > > If you have a chance, could you try changing it back to the original text > > and report the error message and line number that Windows reports on the > > script? Thanks! > > I've put the original backup, and get the following error: > C:\Program Files\Box Backup>cscript NotifySysAdmin.vbs backup-start > Microsoft (R) Windows Script Host versie 5.6 > Copyright (C) Microsoft Corporation 1996-2001. Alle rechten voorbehouden. > > C:\Program Files\Box Backup\NotifySysAdmin.vbs(35, 39) Compilatiefout > Microsoft > VBScript: Ongeldig teken > > The error message is in dutch, so I will translate it here: > C:\Program Files\Box Backup\NotifySysAdmin.vbs(35, 39) Compilation error > Microsoft > VBScript: Invalid character Thanks, fixed in trunk. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Tue Nov 11 06:29:26 2008 From: boxbackup at boxbackup.org (Scott McNee) Date: Tue, 11 Nov 2008 16:29:26 +1000 Subject: [Box Backup] Web Management Interface In-Reply-To: References: <49177ACC.8030507@lubetech.com.au> <49178FB0.7090204@lubetech.com.au> Message-ID: <49192646.3010307@lubetech.com.au> Hi Chris here is the apache error log after updated version [Tue Nov 11 16:27:12 2008] [error] [client 220.245.xxx.xxx] ERROR: Expected raidfile backup/00000001//info does not exist [Tue Nov 11 16:27:12 2008] [error] [client 220.245.xxx.xxx] WARNING: Exception thrown: RaidFileException(RaidFileDoesntExist) at RaidFileRead.cpp(1026) [Tue Nov 11 16:27:12 2008] [error] [client 220.245.xxx.xxx] [Tue Nov 11 16:27:12 2008] accounts.cgi: Use of uninitialized value in pattern match (m//) at /var/www/html/admin/accounts/accounts.cgi line 348, line 9. [Tue Nov 11 16:27:12 2008] [error] [client 220.245.xxx.xxx] [Tue Nov 11 16:27:12 2008] accounts.cgi: Use of uninitialized value in concatenation (.) or string at /var/www/html/admin/accounts/accounts.cgi line 348, line 9. [Tue Nov 11 16:27:12 2008] [error] [client 220.245.xxx.xxx] [Tue Nov 11 16:27:12 2008] accounts.cgi: bad format in value: expected number followed by kB, found '' at /var/www/html/admin/accounts/accounts.cgi line 348. and the page error is bad format in value: expected number followed by kB, found '' at /var/www/html/admin/accounts/accounts.cgi line 348. Thanks. Chris Wilson wrote: > Hi Scott, > > On Mon, 10 Nov 2008, Scott McNee wrote: > > >> Hi Chris thanks for the prompt reply, >> >> I downloaded the latest trunk and Installed. Another error has appeared >> >> Software error: >> >> at /var/www/html/admin/accounts/accounts.cgi line 348. >> >> bbstoreaccount -m output : >> >> Account ID: 0x00000001 >> Last object ID: 0x230e3 >> Used: 52144712 kB, 90% >> Old files: 353468 kB, 0% >> Deleted files: 14146820 kB, 24% >> Directories: 21436 kB, 0% >> Soft limit: 52428800 kB, 90% >> Hard limit: 57671680 kB, 100% >> Client store marker: 143587 >> > > I can't see an obvious cause for this error, so I added some more > debugging code. Please could you update to the latest version of the web > interface and tell me what error it reports? > > Cheers, Chris. > -- From boxbackup at boxbackup.org Tue Nov 11 09:42:24 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Tue, 11 Nov 2008 09:42:24 +0000 (GMT) Subject: [Box Backup] Web Management Interface In-Reply-To: <49192646.3010307@lubetech.com.au> References: <49177ACC.8030507@lubetech.com.au> <49178FB0.7090204@lubetech.com.au> <49192646.3010307@lubetech.com.au> Message-ID: Hi Scott, On Tue, 11 Nov 2008, Scott McNee wrote: > Hi Chris here is the apache error log after updated version > > [Tue Nov 11 16:27:12 2008] [error] [client 220.245.xxx.xxx] ERROR: > Expected raidfile backup/00000001//info does not exist > [Tue Nov 11 16:27:12 2008] [error] [client 220.245.xxx.xxx] WARNING: > Exception thrown: RaidFileException(RaidFileDoesntExist) at > RaidFileRead.cpp(1026) > [Tue Nov 11 16:27:12 2008] [error] [client 220.245.xxx.xxx] [Tue Nov 11 > 16:27:12 2008] accounts.cgi: Use of uninitialized value in pattern match > (m//) at /var/www/html/admin/accounts/accounts.cgi line 348, line 9. > [Tue Nov 11 16:27:12 2008] [error] [client 220.245.xxx.xxx] [Tue Nov 11 > 16:27:12 2008] accounts.cgi: Use of uninitialized value in concatenation > (.) or string at /var/www/html/admin/accounts/accounts.cgi line 348, > line 9. > [Tue Nov 11 16:27:12 2008] [error] [client 220.245.xxx.xxx] [Tue Nov 11 > 16:27:12 2008] accounts.cgi: bad format in value: expected number > followed by kB, found '' at /var/www/html/admin/accounts/accounts.cgi > line 348. > > and the page error is > > bad format in value: expected number followed by kB, found '' at > /var/www/html/admin/accounts/accounts.cgi line 348. Ok, so the Apache error is just because it got no output from bbstoreaccounts. Could you check your accounts database (accounts.txt) and for each account in it, run bbstoreaccounts on it and check that you get the status, and not any errors like the ones above? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Tue Nov 11 09:43:29 2008 From: boxbackup at boxbackup.org (Roy) Date: Tue, 11 Nov 2008 10:43:29 +0100 Subject: [Box Backup] Eventlog full with warnings In-Reply-To: <491837C8.60303@hostingbrothers.nl> References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> Message-ID: <491953C1.3080406@hostingbrothers.nl> Roy wrote: > Chris Wilson wrote: >> Hi Roy, >> >> On Sat, 8 Nov 2008, Roy wrote: >> >> >>>>> First I got an error about the notify script on windows. There is >>>>> an error in it. I replaced the section with the error with that >>>>> same section from an older script. >>>>> >>>> Please could you let me know what exactly you changed, and to what, >>>> as I'm not aware of this error? >>>> >> ... >> >>> The latter section I had in my older notify script. I couldn't >>> locate the >>> fault in the one supplied, but I'm not familiar with the language of >>> these >>> scripts. >>> >> >> If you have a chance, could you try changing it back to the original >> text and report the error message and line number that Windows >> reports on the script? Thanks! >> > I've put the original backup, and get the following error: > C:\Program Files\Box Backup>cscript NotifySysAdmin.vbs backup-start > Microsoft (R) Windows Script Host versie 5.6 > Copyright (C) Microsoft Corporation 1996-2001. Alle rechten voorbehouden. > > C:\Program Files\Box Backup\NotifySysAdmin.vbs(35, 39) Compilatiefout > Microsoft > VBScript: Ongeldig teken > > The error message is in dutch, so I will translate it here: > C:\Program Files\Box Backup\NotifySysAdmin.vbs(35, 39) Compilation > error Microsoft > VBScript: Invalid character > >> >>>>> But now it is running I got numerous warnings, like this one: >>>>> WARNING: Found conflicting parent ID for file ID 2002 >>>>> ($PATH$\$FILENAME$): expected 118406 ($PATH$) but found 11495 >>>>> (same directory used in two different locations?) >>>>> >>>>> $PATH$ is an existing path on my windows workstation, and >>>>> $FILENAME$ also exists. Second $PATH$ is the same as the first. >>>>> >>>>> This directory is not used in any other location, so I don't >>>>> understand this error. And more importantly, what can I do to >>>>> solve this? Or is this not necessary (but then I always would have >>>>> numerous warnings in my eventlog)? >>>>> >>> Everytime it runs, I got these errors. So it thinks the file is moved >>> everytime? >>> >> >> Yes, exactly. The reason is probably that two different locations >> have the same file ID. I guess you're not using NTFS junction points, >> are you? Please could you tell me what "dir c:\" and "dir d:\" report >> as the Volume Serial Number for both volumes? >> >> Also, please could you try running bbackupd with the following >> configuration options: >> >> LogFile = c:\bbackupd.log >> LogFileLevel = debug >> >> and send me the log file that it produces? >> >> Cheers, Chris. >> > I've done this and will post the results later. > > Thanks in advance, > > Roy > > _______________________________________________ > boxbackup mailing list > boxbackup at boxbackup.org > http://lists.warhead.org.uk/mailman/listinfo/boxbackup > > Hi Chris, Already any luck with debugging the warnings? Or do you need a bigger logfile. Because I have it still running in trace mode. Roy From boxbackup at boxbackup.org Tue Nov 11 09:46:47 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Tue, 11 Nov 2008 09:46:47 +0000 (GMT) Subject: [Box Backup] Eventlog full with warnings In-Reply-To: <491953C1.3080406@hostingbrothers.nl> References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> Message-ID: Hi Roy, On Tue, 11 Nov 2008, Roy wrote: > Already any luck with debugging the warnings? Or do you need a bigger logfile. > Because I have it still running in trace mode. There were no "Found conflicting ID" messages in the log that you sent me. I guess maybe it was a first run. The file that was originally in conflict, with ID 2002, no longer appears to be. If you have any conflicts in the log file now, please could you send it again? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Tue Nov 11 09:48:43 2008 From: boxbackup at boxbackup.org (Scott McNee) Date: Tue, 11 Nov 2008 19:48:43 +1000 Subject: [Box Backup] Web Management Interface In-Reply-To: References: <49177ACC.8030507@lubetech.com.au> <49178FB0.7090204@lubetech.com.au> <49192646.3010307@lubetech.com.au> Message-ID: <491954FB.40500@lubetech.com.au> Hi Chris All accounts report the correct status information. No issues at all. Chris Wilson wrote: > Hi Scott, > > On Tue, 11 Nov 2008, Scott McNee wrote: > > >> Hi Chris here is the apache error log after updated version >> >> [Tue Nov 11 16:27:12 2008] [error] [client 220.245.xxx.xxx] ERROR: >> Expected raidfile backup/00000001//info does not exist >> [Tue Nov 11 16:27:12 2008] [error] [client 220.245.xxx.xxx] WARNING: >> Exception thrown: RaidFileException(RaidFileDoesntExist) at >> RaidFileRead.cpp(1026) >> [Tue Nov 11 16:27:12 2008] [error] [client 220.245.xxx.xxx] [Tue Nov 11 >> 16:27:12 2008] accounts.cgi: Use of uninitialized value in pattern match >> (m//) at /var/www/html/admin/accounts/accounts.cgi line 348, line 9. >> [Tue Nov 11 16:27:12 2008] [error] [client 220.245.xxx.xxx] [Tue Nov 11 >> 16:27:12 2008] accounts.cgi: Use of uninitialized value in concatenation >> (.) or string at /var/www/html/admin/accounts/accounts.cgi line 348, >> line 9. >> [Tue Nov 11 16:27:12 2008] [error] [client 220.245.xxx.xxx] [Tue Nov 11 >> 16:27:12 2008] accounts.cgi: bad format in value: expected number >> followed by kB, found '' at /var/www/html/admin/accounts/accounts.cgi >> line 348. >> >> and the page error is >> >> bad format in value: expected number followed by kB, found '' at >> /var/www/html/admin/accounts/accounts.cgi line 348. >> > > Ok, so the Apache error is just because it got no output from > bbstoreaccounts. Could you check your accounts database (accounts.txt) and > for each account in it, run bbstoreaccounts on it and check that you get > the status, and not any errors like the ones above? > > Cheers, Chris. > From boxbackup at boxbackup.org Wed Nov 12 11:06:30 2008 From: boxbackup at boxbackup.org (Roy) Date: Wed, 12 Nov 2008 12:06:30 +0100 Subject: [Box Backup] Eventlog full with warnings In-Reply-To: References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> Message-ID: <491AB8B6.3060804@hostingbrothers.nl> Chris Wilson wrote: > Hi Roy, > > On Tue, 11 Nov 2008, Roy wrote: > > >> Already any luck with debugging the warnings? Or do you need a bigger logfile. >> Because I have it still running in trace mode. >> > > There were no "Found conflicting ID" messages in the log that you sent me. > I guess maybe it was a first run. The file that was originally in > conflict, with ID 2002, no longer appears to be. If you have any conflicts > in the log file now, please could you send it again? > > Cheers, Chris. > Hi Chris, I now got some messages in my syslog on my Debian server: Nov 12 11:28:35 weblx100 bbstored client=0x00000001[16879]: WARNING: When allocating object ID, found that 0x1e6f6 is already in use Nov 12 11:28:35 weblx100 bbstored client=0x00000001[16879]: WARNING: When allocating object ID, found that 0x1e6f7 is already in use Nov 12 11:28:35 weblx100 bbstored client=0x00000001[16879]: WARNING: When allocating object ID, found that 0x1e6f8 is already in use Nov 12 11:28:35 weblx100 bbstored client=0x00000001[16879]: WARNING: When allocating object ID, found that 0x1e6f9 is already in use Nov 12 11:28:35 weblx100 bbstored client=0x00000001[16879]: WARNING: When allocating object ID, found that 0x1e6fa is already in use Has this also something to do with those conflicting ID's? Or is this a whole new problem? Cheers, Roy From boxbackup at boxbackup.org Wed Nov 12 18:22:13 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Wed, 12 Nov 2008 18:22:13 +0000 (GMT) Subject: [Box Backup] Eventlog full with warnings In-Reply-To: <491AB8B6.3060804@hostingbrothers.nl> References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> Message-ID: Hi Roy, On Wed, 12 Nov 2008, Roy wrote: > I now got some messages in my syslog on my Debian server: > > Nov 12 11:28:35 weblx100 bbstored client=0x00000001[16879]: WARNING: When > allocating object ID, found that 0x1e6f6 is already in use > Nov 12 11:28:35 weblx100 bbstored client=0x00000001[16879]: WARNING: When > allocating object ID, found that 0x1e6f7 is already in use > Nov 12 11:28:35 weblx100 bbstored client=0x00000001[16879]: WARNING: When > allocating object ID, found that 0x1e6f8 is already in use > Nov 12 11:28:35 weblx100 bbstored client=0x00000001[16879]: WARNING: When > allocating object ID, found that 0x1e6f9 is already in use > Nov 12 11:28:35 weblx100 bbstored client=0x00000001[16879]: WARNING: When > allocating object ID, found that 0x1e6fa is already in use > > Has this also something to do with those conflicting ID's? Or is this a whole > new problem? This is probably caused by the client or server throwing an exception and not completing the backup run. It's probably a different problem. What messages do you get on both sides at the end of the backup run that preceded this one? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Wed Nov 12 19:11:50 2008 From: boxbackup at boxbackup.org (Roy) Date: Wed, 12 Nov 2008 20:11:50 +0100 Subject: [Box Backup] Eventlog full with warnings In-Reply-To: References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> Message-ID: <491B2A76.4060102@hostingbrothers.nl> Chris Wilson wrote: > Hi Roy, > > On Wed, 12 Nov 2008, Roy wrote: > > >> I now got some messages in my syslog on my Debian server: >> >> Nov 12 11:28:35 weblx100 bbstored client=0x00000001[16879]: WARNING: When >> allocating object ID, found that 0x1e6f6 is already in use >> Nov 12 11:28:35 weblx100 bbstored client=0x00000001[16879]: WARNING: When >> allocating object ID, found that 0x1e6f7 is already in use >> Nov 12 11:28:35 weblx100 bbstored client=0x00000001[16879]: WARNING: When >> allocating object ID, found that 0x1e6f8 is already in use >> Nov 12 11:28:35 weblx100 bbstored client=0x00000001[16879]: WARNING: When >> allocating object ID, found that 0x1e6f9 is already in use >> Nov 12 11:28:35 weblx100 bbstored client=0x00000001[16879]: WARNING: When >> allocating object ID, found that 0x1e6fa is already in use >> >> Has this also something to do with those conflicting ID's? Or is this a whole >> new problem? >> > > This is probably caused by the client or server throwing an exception and > not completing the backup run. It's probably a different problem. What > messages do you get on both sides at the end of the backup run that > preceded this one? > > Cheers, Chris. > Hi Chris, I think that I myself was the problem. As you can see the last log lines are quite a bit earlier. Yesterday bbackupd took 100%CPU on my desktop machine, so I terminated it. That's probably the cause then. It didn't backup after this anymore until this morning I started my machine again. Log on serverside: Nov 11 17:30:09 weblx100 bbstored[2427]: NOTICE: Message from child process 13107: Incoming connection from 85.145.114.42 port 4609 Nov 11 17:30:09 weblx100 bbstored client=0x00000001[13107]: NOTICE: Login from Client ID 0x00000001 Read/Write Nov 11 17:33:23 weblx100 bbstored client=0x00000001[13107]: WARNING: Exception thrown: ConnectionException(Conn_TLSReadFailed) at SocketStreamTLS.cpp(339) Nov 11 17:33:23 weblx100 bbstored client=0x00000001[13107]: WARNING: ProtocolUncertainStream destroyed before stream finished Nov 11 17:33:23 weblx100 bbstored client=0x00000001[13107]: NOTICE: Connection statistics for BACKUP-1: IN=5142181 OUT=604599 TOTAL=5746780 Logs on client side: ERROR: Failed to connect to backup daemon: it is busy with another connection WARNING: Exception thrown: ServerException(SocketOpenError) at WinNamedPipeStream.cpp(272) Allready an idea what the other problem is? Cheers, Roy From boxbackup at boxbackup.org Wed Nov 12 16:30:26 2008 From: boxbackup at boxbackup.org (Com Puter) Date: Wed, 12 Nov 2008 16:30:26 +0000 Subject: [Box Backup] Backup client gets a new home In-Reply-To: References: Message-ID: --_d927ab48-c557-44b6-a011-9012eed8b714_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable > From: chris at qwirx.com> To: boxbackup at boxbackup.org> Subject: Re: [Box Bac= kup] Backup client gets a new home> Date: Mon=2C 10 Nov 2008 21:33:08 +0000= > > Hi CJ=2C> > On Mon=2C 10 Nov 2008=2C Com Puter wrote:> >> I am backing = up a client box that has almost 700GB of data. I need to >> move it all to= a bigger box. Is there anything important that I need to >> be aware of w= hen moving the data to the new box? I don't want to start >> up the client= agent and have it try to re-backup all the data. Is there >> a database o= f some sort the agent uses to determine this that I need to >> make sure ge= ts copied also? Any other gotcha's? Thanks=2C-CJ > > I can't think of any = major gotchas. One thing that's important is to make > sure that the client= isn't backing up while you copy the data=2C otherwise > you might get inco= nsistent files on the store. If it takes a long time to > copy (it probably= will for 700GB) and you don't want to stop the client > for too long=2C th= en make the first copy=2C stop the client and use rsync to > copy any diffe= rences quickly.> > All the information about file dates and times=2C etc. i= s in the account > directory in stored objects=2C just like the file data. = You might want to > run a bbstoreaccount check on the account on both sides= before restarting > the client. Make sure you create the account on the se= rver :) and that the > new server's certificate is signed by the same CA as= the old server's.> > That should be it=2C but do let us know if you have a= ny problems.Thanks fro the info=2CThe hardware didn't come yesterday as exp= ected=2C so I'll be doing this upgrade tonight.. It will be just the clien= t so I was expecting to just copy the data from the old client to the new c= lient hardware and turn it on. The account information I would think shoul= d stay the same on the server and let the client continue to use its certif= icates.Question: I am being asked if I could move a directory structure whi= le copying. Wouldn't that invalidate the backup?Example -> old box: /mnt/h= ome/dirs new box: /home/dirsThanks=2C _________________________________________________________________ See how Windows=AE connects the people=2C information=2C and fun that are p= art of your life http://clk.atdmt.com/MRT/go/119463819/direct/01/= --_d927ab48-c557-44b6-a011-9012eed8b714_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable > From: chris at qwirx.com
> To: boxbackup at boxbackup.org
> Subject: Re: = [Box Backup] Backup client gets a new home
> Date: Mon=2C 10 Nov 2008 21= :33:08 +0000
>
> Hi CJ=2C
>
> On Mon=2C 10 Nov 2008=2C Com Pu= ter wrote:
>
>> I am backing up a client box that has almost 700GB o= f data. I need to
>> move it all to a bigger box. Is there anything i= mportant that I need to
>> be aware of when moving the data to the new = box? I don't want to start
>> up the client agent and have it try to r= e-backup all the data. Is there
>> a database of some sort the agent u= ses to determine this that I need to
>> make sure gets copied also? An= y other gotcha's? Thanks=2C-CJ
>
> I can't think of any major gotch= as. One thing that's important is to make
> sure that the client isn't = backing up while you copy the data=2C otherwise
> you might get inconsi= stent files on the store. If it takes a long time to
> copy (it probabl= y will for 700GB) and you don't want to stop the client
> for too long= =2C then make the first copy=2C stop the client and use rsync to
> copy= any differences quickly.
>
> All the information about file dates a= nd times=2C etc. is in the account
> directory in stored objects=2C jus= t like the file data. You might want to
> run a bbstoreaccount check on= the account on both sides before restarting
> the client. Make sure yo= u create the account on the server :) and that the
> new server's certi= ficate is signed by the same CA as the old server's.
>
> That should= be it=2C but do let us know if you have any problems.


Thanks fro the info=2C

The hardware didn't come yesterd= ay as expected=2C so I'll be doing this upgrade tonight.. =A0It will be jus= t the client so I was expecting to just copy the data from the old client t= o the new client hardware and turn it on. =A0The account information I woul= d think should stay the same on the server and let the client continue to u= se its certificates.

Question: I am being asked if= I could move a directory structure while copying. =A0Wouldn't that invalid= ate the backup?
Example -> old box: /mnt/home/dirs =A0 =A0 new bo= x: /home/dirs

Thanks=2C

=


See how Windows=AE connects the people=2C information=2C = and fun that are part of your life Click here = --_d927ab48-c557-44b6-a011-9012eed8b714_-- From boxbackup at boxbackup.org Wed Nov 12 22:32:22 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Wed, 12 Nov 2008 22:32:22 +0000 (GMT) Subject: [Box Backup] Eventlog full with warnings In-Reply-To: <491B2A76.4060102@hostingbrothers.nl> References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> Message-ID: Hi Roy, On Wed, 12 Nov 2008, Roy wrote: > > This is probably caused by the client or server throwing an exception and > > not completing the backup run. It's probably a different problem. What > > messages do you get on both sides at the end of the backup run that preceded > > this one? > > I think that I myself was the problem. As you can see the last log lines > are quite a bit earlier. Yesterday bbackupd took 100%CPU on my desktop > machine, so I terminated it. That's probably the cause then. It didn't > backup after this anymore until this morning I started my machine again. Yes, that probably was the problem. The warning messages are harmless in this case, as they simply indicate that the server didn't update the largest used object ID in its database before it exited, so next time it ran, when it tried to find an unused object ID, it initially tried some that were already in use. > Allready an idea what the other problem is? I'm not sure, but I was wondering if you might have been moving files around between directories while a backup was running? E.g. was "D:\Foto's & Afbeeldingen\webimages\Tiger Extras Win\The Icons\Puft Smart Folder.ico" moved from D:\Foto's & Afbeeldingen\Sonja to D:\Foto's & Afbeeldingen\webimages\Tiger Extras Win\The Icons? It's a long shot I know. Otherwise I think that the in-memory ID Map database is becoming corrupted, but I don't yet see how that could be possible, I'm still working on it. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Wed Nov 12 22:34:21 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Wed, 12 Nov 2008 22:34:21 +0000 (GMT) Subject: [Box Backup] Backup client gets a new home In-Reply-To: References: Message-ID: Hi CJ, On Wed, 12 Nov 2008, Com Puter wrote: > Question: I am being asked if I could move a directory > structure while copying. Wouldn't that invalidate the backup? Example > -> old box: /mnt/home/dirs new box: /home/dirs Yes, moving the directories (i.e. deleting files from the old location) while the backup is running would certainly cause problems. However, copying them would not (as long as you run an rsync --delete afterwards, when the client is not logged in). Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Wed Nov 12 22:39:23 2008 From: boxbackup at boxbackup.org (Roy) Date: Wed, 12 Nov 2008 23:39:23 +0100 Subject: [Box Backup] Eventlog full with warnings In-Reply-To: References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> Message-ID: <491B5B1B.8050908@hostingbrothers.nl> Chris Wilson wrote: > Hi Roy, > > On Wed, 12 Nov 2008, Roy wrote: > > >>> This is probably caused by the client or server throwing an exception and >>> not completing the backup run. It's probably a different problem. What >>> messages do you get on both sides at the end of the backup run that preceded >>> this one? >>> >> I think that I myself was the problem. As you can see the last log lines >> are quite a bit earlier. Yesterday bbackupd took 100%CPU on my desktop >> machine, so I terminated it. That's probably the cause then. It didn't >> backup after this anymore until this morning I started my machine again. >> > > Yes, that probably was the problem. The warning messages are harmless in > this case, as they simply indicate that the server didn't update the > largest used object ID in its database before it exited, so next time it > ran, when it tried to find an unused object ID, it initially tried some > that were already in use. > > >> Allready an idea what the other problem is? >> > > I'm not sure, but I was wondering if you might have been moving files > around between directories while a backup was running? E.g. was "D:\Foto's > & Afbeeldingen\webimages\Tiger Extras Win\The Icons\Puft Smart Folder.ico" > moved from D:\Foto's & Afbeeldingen\Sonja to D:\Foto's & > Afbeeldingen\webimages\Tiger Extras Win\The Icons? It's a long shot I > know. > > Otherwise I think that the in-memory ID Map database is becoming > corrupted, but I don't yet see how that could be possible, I'm still > working on it. > > Cheers, Chris. > Hi Chris, No that example you gave, is not correct. Files in "20080920-26_Hongarije" are possibly be renamed, but files in webimages are certainly not renamed or moved. Can I do something to prevent corrupting it? Or to reverse the process? Thanks for you help! Roy From boxbackup at boxbackup.org Wed Nov 12 22:43:07 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Wed, 12 Nov 2008 22:43:07 +0000 (GMT) Subject: [Box Backup] Eventlog full with warnings In-Reply-To: <491B5B1B.8050908@hostingbrothers.nl> References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> <491B5B1B.8050908@hostingbrothers.nl> Message-ID: Hi Roy, On Wed, 12 Nov 2008, Roy wrote: > > > Allready an idea what the other problem is? > > > > I'm not sure, but I was wondering if you might have been moving files > > around between directories while a backup was running? E.g. was > > "D:\Foto's > > & Afbeeldingen\webimages\Tiger Extras Win\The Icons\Puft Smart > > Folder.ico" moved from D:\Foto's & Afbeeldingen\Sonja to D:\Foto's & > > Afbeeldingen\webimages\Tiger Extras Win\The Icons? It's a long shot I > > know. > > > > Otherwise I think that the in-memory ID Map database is becoming > > corrupted, but I don't yet see how that could be possible, I'm still > > working on it. > > No that example you gave, is not correct. Files in > "20080920-26_Hongarije" are possibly be renamed, but files in webimages > are certainly not renamed or moved. Can I do something to prevent > corrupting it? Or to reverse the process? I'm afraid I don't yet know why the corruption is happening, if it is happening, so I can't help you much except to release a new build with this warning downgraded to a lower priority level so that it doesn't spam your logs so much. It doesn't affect the actual operation of Box Backup, so if it was working before, it will still work now, but I do want to get to the bottom of it, as I don't yet understand how this situation can happen. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Wed Nov 12 20:47:10 2008 From: boxbackup at boxbackup.org (Brendon Baumgartner) Date: Wed, 12 Nov 2008 12:47:10 -0800 Subject: [Box Backup] Error: Found conflicting parent ID for file ID Message-ID: <5DB1D2D8020D4449AF3111C784529E62470219@jeep.netcal.l> This is a multi-part message in MIME format. ------_=_NextPart_001_01C94507.D95C662E Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable I can't find any previous mention of this error other than the source code. =20 Can someone elaborate? =20 11:56:53 [WARNING] Found conflicting parent ID for file ID 18446744073709541437 (D:\apps\APPS\MP5120A\GOLD\TChinese\setup.inx): expected 39319 (D:\apps\APPS\MP5120A\GOLD\TChinese) but found 204676 (same directory used in two different locations?) ------_=_NextPart_001_01C94507.D95C662E Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

I can’t find any previous mention of this = error other than the source code.

 

Can someone elaborate?

 

11:56:53 [WARNING] Found conflicting parent ID for = file ID 18446744073709541437 (D:\apps\APPS\MP5120A\GOLD\TChinese\setup.inx): = expected 39319 (D:\apps\APPS\MP5120A\GOLD\TChinese) but found 204676 (same = directory used in two different locations?)

------_=_NextPart_001_01C94507.D95C662E-- From boxbackup at boxbackup.org Thu Nov 13 23:14:51 2008 From: boxbackup at boxbackup.org (Scott McNee) Date: Fri, 14 Nov 2008 09:14:51 +1000 Subject: [Box Backup] Web Management Interface In-Reply-To: References: <49177ACC.8030507@lubetech.com.au> <49178FB0.7090204@lubetech.com.au> <49192646.3010307@lubetech.com.au> Message-ID: <491CB4EB.304@lubetech.com.au> Hi Chris have you had any further thoughts on the Web Interface issues ? I can probably organize remote access to a server for testing if you would like? Chris Wilson wrote: > Hi Scott, > > On Tue, 11 Nov 2008, Scott McNee wrote: > > >> Hi Chris here is the apache error log after updated version >> >> [Tue Nov 11 16:27:12 2008] [error] [client 220.245.xxx.xxx] ERROR: >> Expected raidfile backup/00000001//info does not exist >> [Tue Nov 11 16:27:12 2008] [error] [client 220.245.xxx.xxx] WARNING: >> Exception thrown: RaidFileException(RaidFileDoesntExist) at >> RaidFileRead.cpp(1026) >> [Tue Nov 11 16:27:12 2008] [error] [client 220.245.xxx.xxx] [Tue Nov 11 >> 16:27:12 2008] accounts.cgi: Use of uninitialized value in pattern match >> (m//) at /var/www/html/admin/accounts/accounts.cgi line 348, line 9. >> [Tue Nov 11 16:27:12 2008] [error] [client 220.245.xxx.xxx] [Tue Nov 11 >> 16:27:12 2008] accounts.cgi: Use of uninitialized value in concatenation >> (.) or string at /var/www/html/admin/accounts/accounts.cgi line 348, >> line 9. >> [Tue Nov 11 16:27:12 2008] [error] [client 220.245.xxx.xxx] [Tue Nov 11 >> 16:27:12 2008] accounts.cgi: bad format in value: expected number >> followed by kB, found '' at /var/www/html/admin/accounts/accounts.cgi >> line 348. >> >> and the page error is >> >> bad format in value: expected number followed by kB, found '' at >> /var/www/html/admin/accounts/accounts.cgi line 348. >> > > Ok, so the Apache error is just because it got no output from > bbstoreaccounts. Could you check your accounts database (accounts.txt) and > for each account in it, run bbstoreaccounts on it and check that you get > the status, and not any errors like the ones above? > > Cheers, Chris. > From boxbackup at boxbackup.org Fri Nov 14 20:54:02 2008 From: boxbackup at boxbackup.org (Alexandre Mallais) Date: Fri, 14 Nov 2008 15:54:02 -0500 Subject: [Box Backup] deleting file in the store In-Reply-To: References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> <491B5B1B.8050908@hostingbrothers.nl> Message-ID: <491DE56A.4030400@avior.ca> On this page http://boxbackup.org/trac/wiki/011 There is a quote that says: "If you have problems with large files (over 2GB compressed) not being backed up, restored or compared, you will need to delete them from the store server to fix them properly. You can do this before or after upgrading, but if they are uploaded again by the 0.10 client then the problem will not be solved." My current question is not about 2GB files. I just want to know how can you delete files in the store server ? There is not command for it with bbackupquery. :( From boxbackup at boxbackup.org Fri Nov 14 21:07:04 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Fri, 14 Nov 2008 21:07:04 +0000 (GMT) Subject: [Box Backup] deleting file in the store In-Reply-To: <491DE56A.4030400@avior.ca> References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> <491B5B1B.8050908@hostingbrothers.nl> <491DE56A.4030400@avior.ca> Message-ID: Hi Alexandre, On Fri, 14 Nov 2008, Alexandre Mallais wrote: > On this page http://boxbackup.org/trac/wiki/011 > > There is a quote that says: "If you have problems with large files (over > 2GB compressed) not being backed up, restored or compared, you will need > to delete them from the store server to fix them properly. You can do > this before or after upgrading, but if they are uploaded again by the > 0.10 client then the problem will not be solved." > > My current question is not about 2GB files. I just want to know how can > you delete files in the store server ? There is not command for it with > bbackupquery. :( You can either exclude it from the backup, run a sync and then remove the exclusion; or use a more recent version of Box Backup, such as the latest snapshot, where this command has been added to bbackupquery. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Fri Nov 14 21:19:29 2008 From: boxbackup at boxbackup.org (Alexandre Mallais) Date: Fri, 14 Nov 2008 16:19:29 -0500 Subject: [Box Backup] deleting file in the store In-Reply-To: References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> <491B5B1B.8050908@hostingbrothers.nl> <491DE56A.4030400@avior.ca> Message-ID: <491DEB61.7010402@avior.ca> Well talking about the new snapshot, when do you expect the new version to be release (yeah you probably get asked a lot) and is there a possibily for the 0.11RC2 to be available on freebsd ports, I talked with the FreeBSD ports, and he says he would make it available, but it is still not there yet. Chris Wilson wrote: > Hi Alexandre, > > On Fri, 14 Nov 2008, Alexandre Mallais wrote: > > >> On this page http://boxbackup.org/trac/wiki/011 >> >> There is a quote that says: "If you have problems with large files (over >> 2GB compressed) not being backed up, restored or compared, you will need >> to delete them from the store server to fix them properly. You can do >> this before or after upgrading, but if they are uploaded again by the >> 0.10 client then the problem will not be solved." >> >> My current question is not about 2GB files. I just want to know how can >> you delete files in the store server ? There is not command for it with >> bbackupquery. :( >> > > You can either exclude it from the backup, run a sync and then remove the > exclusion; or use a more recent version of Box Backup, such as the latest > snapshot, where this command has been added to bbackupquery. > > Cheers, Chris. > From boxbackup at boxbackup.org Fri Nov 14 21:22:14 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Fri, 14 Nov 2008 21:22:14 +0000 (GMT) Subject: [Box Backup] deleting file in the store In-Reply-To: <491DEB61.7010402@avior.ca> References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> <491B5B1B.8050908@hostingbrothers.nl> <491DE56A.4030400@avior.ca> <491DEB61.7010402@avior.ca> Message-ID: Hi Alexandre, On Fri, 14 Nov 2008, Alexandre Mallais wrote: > Well talking about the new snapshot, when do you expect the new version > to be release (yeah you probably get asked a lot) I'm afraid I just don't know. I don't want to push it to be released too quickly. I'd encourage anyone who wants to help us to get there, to try out snapshots and report success or failure. > and is there a possibily for the 0.11RC2 to be available on freebsd > ports, I talked with the FreeBSD ports, and he says he would make it > available, but it is still not there yet. I'm afraid that's not up to me, please contact the maintainer of the port. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Fri Nov 14 22:58:51 2008 From: boxbackup at boxbackup.org (James O'Gorman) Date: Fri, 14 Nov 2008 22:58:51 +0000 Subject: [Box Backup] deleting file in the store In-Reply-To: References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> <491B5B1B.8050908@hostingbrothers.nl> <491DE56A.4030400@avior.ca> <491DEB61.7010402@avior.ca> Message-ID: <491E02AB.9070206@netinertia.co.uk> On 14/11/08 21:22, Chris Wilson wrote: > Hi Alexandre, > > On Fri, 14 Nov 2008, Alexandre Mallais wrote: > >> Well talking about the new snapshot, when do you expect the new version >> to be release (yeah you probably get asked a lot) > > I'm afraid I just don't know. I don't want to push it to be released too > quickly. I'd encourage anyone who wants to help us to get there, to try > out snapshots and report success or failure. Absolutely, which is why it would be good if the volunteers who have created distribution packages could help create packages from snapshots, where possible. I've spoken privately with the Debian maintainer about this so hopefully we might see something in the experimental branch. >> and is there a possibily for the 0.11RC2 to be available on freebsd >> ports, I talked with the FreeBSD ports, and he says he would make it >> available, but it is still not there yet. > > I'm afraid that's not up to me, please contact the maintainer of the port. That would be me :-) Unfortunately I haven't had the time I thought I would to publish an updated port, but I'm hoping to do this soon, based on the snapshots. The general plan is to try and bring updated port skeletons out with each snapshot. James From boxbackup at boxbackup.org Sat Nov 15 22:11:46 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Sat, 15 Nov 2008 22:11:46 +0000 (GMT) Subject: [Box Backup] Web Management Interface In-Reply-To: <491CB4EB.304@lubetech.com.au> References: <49177ACC.8030507@lubetech.com.au> <49178FB0.7090204@lubetech.com.au> <49192646.3010307@lubetech.com.au> <491CB4EB.304@lubetech.com.au> Message-ID: Hi Scott, On Fri, 14 Nov 2008, Scott McNee wrote: > Hi Chris have you had any further thoughts on the Web Interface issues ? > > I can probably organize remote access to a server for testing if you > would like? Just a quick check, does the Apache user have access to the bbstored configuration files (bbstored.conf, raidfile.conf and accounts.txt) and the info.rfw files for each account? If you run "bbstoreaccounts 1 check" as the Apache user, does it work? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Mon Nov 17 18:55:33 2008 From: boxbackup at boxbackup.org (Alexandre Mallais) Date: Mon, 17 Nov 2008 13:55:33 -0500 Subject: [Box Backup] Files are backup, but old/delete does not stay In-Reply-To: <491E02AB.9070206@netinertia.co.uk> References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> <491B5B1B.8050908@hostingbrothers.nl> <491DE56A.4030400@avior.ca> <491DEB61.7010402@avior.ca> <491E02AB.9070206@netinertia.co.uk> Message-ID: <4921BE25.8050108@avior.ca> I backup several server (4 linux/freebsd). But one of them does not backup correctly. I backup the folder /abc . In /abc there is a file that is generated each day, and has the output of `date` in its name. If i got on the backup with bbackupquery, and I list what is in /abc with ls -do I do not see any deleted (X) file , but there should be a lot of them. On my other server everything seems to backup correctly, I even brought back old version of config file and it worked. From boxbackup at boxbackup.org Mon Nov 17 21:25:03 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Mon, 17 Nov 2008 21:25:03 +0000 (GMT) Subject: [Box Backup] Files are backup, but old/delete does not stay In-Reply-To: <4921BE25.8050108@avior.ca> References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> <491B5B1B.8050908@hostingbrothers.nl> <491DE56A.4030400@avior.ca> <491DEB61.7010402@avior.ca> <491E02AB.9070206@netinertia.co.uk> <4921BE25.8050108@avior.ca> Message-ID: Hi Alexandre, On Mon, 17 Nov 2008, Alexandre Mallais wrote: > I backup several server (4 linux/freebsd). But one of them does not > backup correctly. > > I backup the folder /abc . In /abc there is a file that is generated > each day, and has the output of `date` in its name. If i got on the > backup with bbackupquery, and I list what is in /abc with ls -do I do > not see any deleted (X) file , but there should be a lot of them. > > On my other server everything seems to backup correctly, I even brought > back old version of config file and it worked. How much free space does the account have up to the soft limit? Old and deleted versions of files will be removed when the account reaches its soft limit, until it is below the limit again. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Mon Nov 17 21:29:16 2008 From: boxbackup at boxbackup.org (Alexandre Mallais) Date: Mon, 17 Nov 2008 16:29:16 -0500 Subject: [Box Backup] Files are backup, but old/delete does not stay In-Reply-To: References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> <491B5B1B.8050908@hostingbrothers.nl> <491DE56A.4030400@avior.ca> <491DEB61.7010402@avior.ca> <491E02AB.9070206@netinertia.co.uk> <4921BE25.8050108@avior.ca> Message-ID: <4921E22C.6030903@avior.ca> Sorry I miss to provide this informations. I doubt this being the problem usage show this: query > usage Used 1328.1Mb 66% ************************** Old files 11.0Mb 0% Deleted files 0.0Mb 0% Directories 9.5Mb 0% Soft limit 1500.0Mb 75% ****************************** Hard limit 2000.0Mb 100% **************************************** So I doubt this is the problem, it did not acheive the 75% for a long time Chris Wilson wrote: > Hi Alexandre, > > On Mon, 17 Nov 2008, Alexandre Mallais wrote: > > >> I backup several server (4 linux/freebsd). But one of them does not >> backup correctly. >> >> I backup the folder /abc . In /abc there is a file that is generated >> each day, and has the output of `date` in its name. If i got on the >> backup with bbackupquery, and I list what is in /abc with ls -do I do >> not see any deleted (X) file , but there should be a lot of them. >> >> On my other server everything seems to backup correctly, I even brought >> back old version of config file and it worked. >> > > How much free space does the account have up to the soft limit? Old and > deleted versions of files will be removed when the account reaches its > soft limit, until it is below the limit again. > > Cheers, Chris. > From boxbackup at boxbackup.org Tue Nov 18 00:03:14 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Tue, 18 Nov 2008 00:03:14 +0000 (GMT) Subject: [Box Backup] Files are backup, but old/delete does not stay In-Reply-To: <4921E22C.6030903@avior.ca> References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> <491B5B1B.8050908@hostingbrothers.nl> <491DE56A.4030400@avior.ca> <491DEB61.7010402@avior.ca> <491E02AB.9070206@netinertia.co.uk> <4921BE25.8050108@avior.ca> <4921E22C.6030903@avior.ca> Message-ID: Hi Alexandre, On Mon, 17 Nov 2008, Alexandre Mallais wrote: > Sorry I miss to provide this informations. I doubt this being the > problem > > usage show this: > query > usage > Used 1328.1Mb 66% ************************** > Old files 11.0Mb 0% > Deleted files 0.0Mb 0% > Directories 9.5Mb 0% > Soft limit 1500.0Mb 75% ****************************** > Hard limit 2000.0Mb 100% **************************************** > > So I doubt this is the problem, it did not acheive the 75% for a long time I'm not sure about that, perhaps housekeeping deleted the old versions to bring it below 75%. How much data is added each day? Could you try increasing the softlimit to see if it starts keeping old versions of this file? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Tue Nov 18 00:17:53 2008 From: boxbackup at boxbackup.org (Peter Jalajas, GigaLock Backup Services) Date: Mon, 17 Nov 2008 19:17:53 -0500 Subject: [Box Backup] Files are backup, but old/delete does not stay In-Reply-To: References: <491419C9.1060500@hostingbrothers.nl> <491DE56A.4030400@avior.ca> <491DEB61.7010402@avior.ca> <491E02AB.9070206@netinertia.co.uk> <4921BE25.8050108@avior.ca> <4921E22C.6030903@avior.ca> Message-ID: <74d01c7a0811171617y2452a681w7692cc7253049b79@mail.gmail.com> Hi, On Mon, Nov 17, 2008 at 7:03 PM, Chris Wilson wrote: > Hi Alexandre, > > On Mon, 17 Nov 2008, Alexandre Mallais wrote: > > I'm not sure about that, perhaps housekeeping deleted the old versions to > bring it below 75%. How much data is added each day? Could you try > increasing the softlimit to see if it starts keeping old versions of this > file? Maybe it's a timing issue? Maybe the files on that particular server are being deleted before they are being backed up? Pete From boxbackup at boxbackup.org Tue Nov 18 04:46:29 2008 From: boxbackup at boxbackup.org (Alexandre Mallais) Date: Mon, 17 Nov 2008 23:46:29 -0500 Subject: [Box Backup] Files are backup, but old/delete does not stay In-Reply-To: <74d01c7a0811171617y2452a681w7692cc7253049b79@mail.gmail.com> References: <491419C9.1060500@hostingbrothers.nl> <491DE56A.4030400@avior.ca> <491DEB61.7010402@avior.ca> <491E02AB.9070206@netinertia.co.uk> <4921BE25.8050108@avior.ca> <4921E22C.6030903@avior.ca> <74d01c7a0811171617y2452a681w7692cc7253049b79@mail.gmail.com> Message-ID: <492248A5.4020501@avior.ca> no I doubt it because, there is a file that is generate daily in there, and there is always the latest file in the backup, but the earlier ones. We would like to access the file from 3 days ago, but we can't because it seems to just not keep them. Peter Jalajas, GigaLock Backup Services wrote: > Hi, > > On Mon, Nov 17, 2008 at 7:03 PM, Chris Wilson wrote: > >> Hi Alexandre, >> >> On Mon, 17 Nov 2008, Alexandre Mallais wrote: >> >> I'm not sure about that, perhaps housekeeping deleted the old versions to >> bring it below 75%. How much data is added each day? Could you try >> increasing the softlimit to see if it starts keeping old versions of this >> file? >> > > Maybe it's a timing issue? Maybe the files on that particular server > are being deleted before they are being backed up? > > Pete > _______________________________________________ > boxbackup mailing list > boxbackup at boxbackup.org > http://lists.warhead.org.uk/mailman/listinfo/boxbackup > . > > From boxbackup at boxbackup.org Tue Nov 18 04:47:12 2008 From: boxbackup at boxbackup.org (Alexandre Mallais) Date: Mon, 17 Nov 2008 23:47:12 -0500 Subject: [Box Backup] Files are backup, but old/delete does not stay In-Reply-To: References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> <491B5B1B.8050908@hostingbrothers.nl> <491DE56A.4030400@avior.ca> <491DEB61.7010402@avior.ca> <491E02AB.9070206@netinertia.co.uk> <4921BE25.8050108@avior.ca> <4921E22C.6030903@avior.ca> Message-ID: <492248D0.6080902@avior.ca> I will bring the soft limit to 90 % Chris Wilson wrote: > Hi Alexandre, > > On Mon, 17 Nov 2008, Alexandre Mallais wrote: > > >> Sorry I miss to provide this informations. I doubt this being the >> problem >> >> usage show this: >> query > usage >> Used 1328.1Mb 66% ************************** >> Old files 11.0Mb 0% >> Deleted files 0.0Mb 0% >> Directories 9.5Mb 0% >> Soft limit 1500.0Mb 75% ****************************** >> Hard limit 2000.0Mb 100% **************************************** >> >> So I doubt this is the problem, it did not acheive the 75% for a long time >> > > I'm not sure about that, perhaps housekeeping deleted the old versions to > bring it below 75%. How much data is added each day? Could you try > increasing the softlimit to see if it starts keeping old versions of this > file? > > Cheers, Chris. > From boxbackup at boxbackup.org Tue Nov 18 09:07:19 2008 From: boxbackup at boxbackup.org (Torsten) Date: Tue, 18 Nov 2008 10:07:19 +0100 Subject: [Box Backup] Files are backup, but old/delete does not stay In-Reply-To: <492248D0.6080902@avior.ca> References: <491419C9.1060500@hostingbrothers.nl> <492248D0.6080902@avior.ca> Message-ID: <200811181007.23048.ddmails@web.de> Hi Alexandre, which version of box backup do you use? With version 0.10 i had the problem, that sometimes old files are not kept. I only could restore deleted files. Perhaps the same issue? But with bb 0.11svn i think i do not have this problem anymore. Torsten Am Tuesday 18 November 2008 05:47:12 schrieb Alexandre Mallais: > I will bring the soft limit to 90 % > > Chris Wilson wrote: > > Hi Alexandre, > > > > On Mon, 17 Nov 2008, Alexandre Mallais wrote: > >> Sorry I miss to provide this informations. I doubt this being the > >> problem > >> > >> usage show this: > >> query > usage > >> Used 1328.1Mb 66% ************************** > >> Old files 11.0Mb 0% > >> Deleted files 0.0Mb 0% > >> Directories 9.5Mb 0% > >> Soft limit 1500.0Mb 75% ****************************** > >> Hard limit 2000.0Mb 100% **************************************** > >> > >> So I doubt this is the problem, it did not acheive the 75% for a long > >> time > > > > I'm not sure about that, perhaps housekeeping deleted the old versions to > > bring it below 75%. How much data is added each day? Could you try > > increasing the softlimit to see if it starts keeping old versions of this > > file? > > > > Cheers, Chris. > > _______________________________________________ > boxbackup mailing list > boxbackup at boxbackup.org > http://lists.warhead.org.uk/mailman/listinfo/boxbackup From boxbackup at boxbackup.org Wed Nov 19 12:13:28 2008 From: boxbackup at boxbackup.org (Roy) Date: Wed, 19 Nov 2008 13:13:28 +0100 Subject: [Box Backup] Eventlog full with warnings In-Reply-To: References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> <491B5B1B.8050908@hostingbrothers.nl> Message-ID: <492402E8.9030000@hostingbrothers.nl> Chris Wilson wrote: > Hi Roy, > > On Wed, 12 Nov 2008, Roy wrote: > > >>>> Allready an idea what the other problem is? >>>> >>> I'm not sure, but I was wondering if you might have been moving files >>> around between directories while a backup was running? E.g. was >>> "D:\Foto's >>> & Afbeeldingen\webimages\Tiger Extras Win\The Icons\Puft Smart >>> Folder.ico" moved from D:\Foto's & Afbeeldingen\Sonja to D:\Foto's & >>> Afbeeldingen\webimages\Tiger Extras Win\The Icons? It's a long shot I >>> know. >>> >>> Otherwise I think that the in-memory ID Map database is becoming >>> corrupted, but I don't yet see how that could be possible, I'm still >>> working on it. >>> >> No that example you gave, is not correct. Files in >> "20080920-26_Hongarije" are possibly be renamed, but files in webimages >> are certainly not renamed or moved. Can I do something to prevent >> corrupting it? Or to reverse the process? >> > > I'm afraid I don't yet know why the corruption is happening, if it is > happening, so I can't help you much except to release a new build with > this warning downgraded to a lower priority level so that it doesn't spam > your logs so much. It doesn't affect the actual operation of Box Backup, > so if it was working before, it will still work now, but I do want to get > to the bottom of it, as I don't yet understand how this situation can > happen. > > Cheers, Chris. > Hi Chris, Can I do something to help you debug this problem? Maybe running a debug build on my workstation? Or do I have to remove that backup location from my configuration file, wait till it is removed and then add it again to resolve this issues? Cheers, Roy From boxbackup at boxbackup.org Wed Nov 19 20:57:33 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Wed, 19 Nov 2008 20:57:33 +0000 (GMT) Subject: [Box Backup] Eventlog full with warnings In-Reply-To: <492402E8.9030000@hostingbrothers.nl> References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> <491B5B1B.8050908@hostingbrothers.nl> <492402E8.9030000@hostingbrothers.nl> Message-ID: Hi Roy, On Wed, 19 Nov 2008, Roy wrote: > > I'm afraid I don't yet know why the corruption is happening, if it is > > happening, so I can't help you much except to release a new build with > > this warning downgraded to a lower priority level so that it doesn't > > spam your logs so much. It doesn't affect the actual operation of Box > > Backup, so if it was working before, it will still work now, but I do > > want to get to the bottom of it, as I don't yet understand how this > > situation can happen. > > Can I do something to help you debug this problem? Maybe running a debug > build on my workstation? I'm afraid there's no debug information that would help at this point. The best thing would be to have access to the machine where it happens, but I assume that's not possible for you. Failing that, I have to be able to reproduce it, and so far I haven't been able to. If you run the same build on another Windows system, does it have the same problem? Can you give me the Volume Serial Numbers of each drive that you're backing up? > Or do I have to remove that backup location from my configuration file, > wait till it is removed and then add it again to resolve this issues? No, that shouldn't be necessary and probably won't help. What's the biggest problem for you at the moment? The fact that the messages are filling up your logs, or is the backup not actually working? I think that it should be working if "compare -a" works for you and reports no differences. Could you try that and let me know? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Wed Nov 19 22:55:11 2008 From: boxbackup at boxbackup.org (Roy) Date: Wed, 19 Nov 2008 23:55:11 +0100 Subject: [Box Backup] Eventlog full with warnings In-Reply-To: References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> <491B5B1B.8050908@hostingbrothers.nl> <492402E8.9030000@hostingbrothers.nl> Message-ID: <4924994F.8080006@hostingbrothers.nl> Chris Wilson wrote: > Hi Roy, > > On Wed, 19 Nov 2008, Roy wrote: > > >>> I'm afraid I don't yet know why the corruption is happening, if it is >>> happening, so I can't help you much except to release a new build with >>> this warning downgraded to a lower priority level so that it doesn't >>> spam your logs so much. It doesn't affect the actual operation of Box >>> Backup, so if it was working before, it will still work now, but I do >>> want to get to the bottom of it, as I don't yet understand how this >>> situation can happen. >>> >> Can I do something to help you debug this problem? Maybe running a debug >> build on my workstation? >> > > I'm afraid there's no debug information that would help at this point. The > best thing would be to have access to the machine where it happens, but I > assume that's not possible for you. Failing that, I have to be able to > reproduce it, and so far I haven't been able to. > It is my workstation, that I use most of the time. So it would be quite hard to do that. BTW it's a Windows system. So I must use RDP or VNC. But can I do some things for you to test things? Maybe a chat/debug session would be quite handy for this? > If you run the same build on another Windows system, does it have the same > problem? Can you give me the Volume Serial Numbers of each drive that > you're backing up? > I didn't upgrade my other Windows systems to this build. And I'm reluctant to do it, because of these errors. Where can I find these volume serial numbers? Then I will post them. > >> Or do I have to remove that backup location from my configuration file, >> wait till it is removed and then add it again to resolve this issues? >> > > No, that shouldn't be necessary and probably won't help. > > What's the biggest problem for you at the moment? The fact that the > messages are filling up your logs, or is the backup not actually working? > I think that it should be working if "compare -a" works for you and > reports no differences. Could you try that and let me know? > > Cheers, Chris. > I'm afraid that the backup isn't working correctly. Tomorrow I will do a compare -a, so then I can tell more. The logs filling is not the worst of this, it's however annoying. And I stop looking at it, so I can miss other problems. Cheers, Roy From boxbackup at boxbackup.org Wed Nov 19 23:01:56 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Wed, 19 Nov 2008 23:01:56 +0000 (GMT) Subject: [Box Backup] Eventlog full with warnings In-Reply-To: <4924994F.8080006@hostingbrothers.nl> References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> <491B5B1B.8050908@hostingbrothers.nl> <492402E8.9030000@hostingbrothers.nl> <4924994F.8080006@hostingbrothers.nl> Message-ID: Hi Roy, On Wed, 19 Nov 2008, Roy wrote: > > I'm afraid there's no debug information that would help at this point. > > The best thing would be to have access to the machine where it > > happens, but I assume that's not possible for you. Failing that, I > > have to be able to reproduce it, and so far I haven't been able to. > > It is my workstation, that I use most of the time. So it would be quite hard > to do that. BTW it's a Windows system. So I must use RDP or VNC. But can I do > some things for you to test things? Maybe a chat/debug session would be quite > handy for this? Unfortunately at the moment I have no idea where this bug might come from, how the memory could get corrupted, so I can't think of anything obvious for you to test unless I can somehow make a custom build of bbackupd that has memory corruption detection. Another thing that would be really helpful is to have a debug log file where both the initial run (when the IDs are stored in the mapping database) and the subsequent run (where those IDs are used to detect moved files) in the same file. You've sent me two separate log files already but I don't know whether there were any intervening runs or what could have happened in the time between those logs. > > If you run the same build on another Windows system, does it have the same > > problem? Can you give me the Volume Serial Numbers of each drive that you're > > backing up? > > I didn't upgrade my other Windows systems to this build. And I'm reluctant to > do it, because of these errors. It's just a warning message, which was previously ignored. It could well be a false alarm. > Where can I find these volume serial numbers? Then I will post them. Use "dir" on each drive, the volume serial number is at the top of the output. > > What's the biggest problem for you at the moment? The fact that the > > messages are filling up your logs, or is the backup not actually > > working? I think that it should be working if "compare -a" works for > > you and reports no differences. Could you try that and let me know? > > I'm afraid that the backup isn't working correctly. Tomorrow I will do a > compare -a, so then I can tell more. The logs filling is not the worst of > this, it's however annoying. And I stop looking at it, so I can miss other > problems. Please do run a compare -a when you can, I hope that it will reassure you that the backup is actually working correctly and that the warnings, although they indicate a false assumption on our part that may be a bug in Box Backup, are relatively harmless and can be ignored for now. Unfortunately I'm just too busy this week to look into it much further. Next week should be better for me. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Wed Nov 19 23:02:29 2008 From: boxbackup at boxbackup.org (Roy) Date: Thu, 20 Nov 2008 00:02:29 +0100 Subject: [Box Backup] Which notifyScript is used? Message-ID: <49249B05.9030108@hostingbrothers.nl> Hi all, I had some troubles with the notify script that was in the latest Windows release. But that bug is solved by Chris now. However at the moment, I receive after every run 2 mails from Box Backup with an unknow error. The message in eventlog never showed that the notify script was started with an unknow parameter, only backup-start/-finish/-ok. The strange thing is that in the config file I have: NotifyScript = cscript "C:\Program Files\Box Backup\NotifySysAdmin.vbs" And I changed in that particular script the subjtmpl, but the mails remain the same. Also I commented out the part of the unknown error, but still I receive that kind of errors. I don't understand this, which script is executed? How can I check this? And does Box Backup cache this script somewhere? Greetings, Roy From boxbackup at boxbackup.org Wed Nov 19 23:07:26 2008 From: boxbackup at boxbackup.org (Roy) Date: Thu, 20 Nov 2008 00:07:26 +0100 Subject: [Box Backup] Eventlog full with warnings In-Reply-To: References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> <491B5B1B.8050908@hostingbrothers.nl> <492402E8.9030000@hostingbrothers.nl> <4924994F.8080006@hostingbrothers.nl> Message-ID: <49249C2E.7010602@hostingbrothers.nl> Chris Wilson wrote: > Hi Roy, > > On Wed, 19 Nov 2008, Roy wrote: > > >>> I'm afraid there's no debug information that would help at this point. >>> The best thing would be to have access to the machine where it >>> happens, but I assume that's not possible for you. Failing that, I >>> have to be able to reproduce it, and so far I haven't been able to. >>> >> It is my workstation, that I use most of the time. So it would be quite hard >> to do that. BTW it's a Windows system. So I must use RDP or VNC. But can I do >> some things for you to test things? Maybe a chat/debug session would be quite >> handy for this? >> > > Unfortunately at the moment I have no idea where this bug might come from, > how the memory could get corrupted, so I can't think of anything obvious > for you to test unless I can somehow make a custom build of bbackupd that > has memory corruption detection. > > Another thing that would be really helpful is to have a debug log file > where both the initial run (when the IDs are stored in the mapping > database) and the subsequent run (where those IDs are used to detect moved > files) in the same file. You've sent me two separate log files already but > I don't know whether there were any intervening runs or what could have > happened in the time between those logs. > Initial run, is the first run when the service starts? I will start logging again... > >>> If you run the same build on another Windows system, does it have the same >>> problem? Can you give me the Volume Serial Numbers of each drive that you're >>> backing up? >>> >> I didn't upgrade my other Windows systems to this build. And I'm reluctant to >> do it, because of these errors. >> > > It's just a warning message, which was previously ignored. It could well > be a false alarm. > Maybe on Saturday I will upgrade a Windows 2003 server to this version. I will monitor the eventlog. > >> Where can I find these volume serial numbers? Then I will post them. >> > > Use "dir" on each drive, the volume serial number is at the top of the > output. > c: => 941B-B190 d: => 78FA-5915 > >>> What's the biggest problem for you at the moment? The fact that the >>> messages are filling up your logs, or is the backup not actually >>> working? I think that it should be working if "compare -a" works for >>> you and reports no differences. Could you try that and let me know? >>> >> I'm afraid that the backup isn't working correctly. Tomorrow I will do a >> compare -a, so then I can tell more. The logs filling is not the worst of >> this, it's however annoying. And I stop looking at it, so I can miss other >> problems. >> > > Please do run a compare -a when you can, I hope that it will reassure you > that the backup is actually working correctly and that the warnings, > although they indicate a false assumption on our part that may be a bug in > Box Backup, are relatively harmless and can be ignored for now. > > Unfortunately I'm just too busy this week to look into it much further. > Next week should be better for me. > > Cheers, Chris. > Oke, I will run that check tomorrow and let you know what happened. Thanks for your time! Cheers, Roy From boxbackup at boxbackup.org Wed Nov 19 23:10:50 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Wed, 19 Nov 2008 23:10:50 +0000 (GMT) Subject: [Box Backup] Which notifyScript is used? In-Reply-To: <49249B05.9030108@hostingbrothers.nl> References: <49249B05.9030108@hostingbrothers.nl> Message-ID: Hi Roy, On Thu, 20 Nov 2008, Roy wrote: > I had some troubles with the notify script that was in the latest > Windows release. But that bug is solved by Chris now. However at the > moment, I receive after every run 2 mails from Box Backup with an unknow > error. The message in eventlog never showed that the notify script was > started with an unknow parameter, only backup-start/-finish/-ok. The > strange thing is that in the config file I have: > > NotifyScript = cscript "C:\Program Files\Box Backup\NotifySysAdmin.vbs" > > And I changed in that particular script the subjtmpl, but the mails remain the > same. Also I commented out the part of the unknown error, but still I receive > that kind of errors. I don't understand this, which script is executed? How > can I check this? And does Box Backup cache this script somewhere? Box Backup doesn't cache the script, but is this on Windows Vista? If so, you may be editing a copy in the shadow directory in C:\Users\Your User\Local\Virtual Store\Program Files\Box Backup without realising it. The original copy would still be in C:\Program Files\Box Backup and bbackupd would still be running that copy. The easiest solution is to change your bbackupd.conf to point to the virtual store directory. Otherwise, please let us know what version of Windows you are running and please attach your current NotifySysAdmin.vbs and an example of the emails that you receive from it. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Wed Nov 19 23:13:39 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Wed, 19 Nov 2008 23:13:39 +0000 (GMT) Subject: [Box Backup] Eventlog full with warnings In-Reply-To: <49249C2E.7010602@hostingbrothers.nl> References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> <491B5B1B.8050908@hostingbrothers.nl> <492402E8.9030000@hostingbrothers.nl> <4924994F.8080006@hostingbrothers.nl> <49249C2E.7010602@hostingbrothers.nl> Message-ID: Hi Roy, On Thu, 20 Nov 2008, Roy wrote: > > Another thing that would be really helpful is to have a debug log file > > where both the initial run (when the IDs are stored in the mapping > > database) and the subsequent run (where those IDs are used to detect > > moved files) in the same file. You've sent me two separate log files > > already but I don't know whether there were any intervening runs or > > what could have happened in the time between those logs. > > Initial run, is the first run when the service starts? Yes, that's right. > > Use "dir" on each drive, the volume serial number is at the top of the > > output. > > c: => 941B-B190 > d: => 78FA-5915 OK, so it's not that the drives have the same serial number, which was one of my theories. Bummer. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Wed Nov 19 23:25:30 2008 From: boxbackup at boxbackup.org (Roy) Date: Thu, 20 Nov 2008 00:25:30 +0100 Subject: [Box Backup] Which notifyScript is used? In-Reply-To: References: <49249B05.9030108@hostingbrothers.nl> Message-ID: <4924A06A.4080000@hostingbrothers.nl> Chris Wilson wrote: > Hi Roy, > > On Thu, 20 Nov 2008, Roy wrote: > > >> I had some troubles with the notify script that was in the latest >> Windows release. But that bug is solved by Chris now. However at the >> moment, I receive after every run 2 mails from Box Backup with an unknow >> error. The message in eventlog never showed that the notify script was >> started with an unknow parameter, only backup-start/-finish/-ok. The >> strange thing is that in the config file I have: >> >> NotifyScript = cscript "C:\Program Files\Box Backup\NotifySysAdmin.vbs" >> >> And I changed in that particular script the subjtmpl, but the mails remain the >> same. Also I commented out the part of the unknown error, but still I receive >> that kind of errors. I don't understand this, which script is executed? How >> can I check this? And does Box Backup cache this script somewhere? >> > > Box Backup doesn't cache the script, but is this on Windows Vista? If so, > you may be editing a copy in the shadow directory in C:\Users\Your > User\Local\Virtual Store\Program Files\Box Backup without realising it. > The original copy would still be in C:\Program Files\Box Backup and > bbackupd would still be running that copy. The easiest solution is to > change your bbackupd.conf to point to the virtual store directory. > > Otherwise, please let us know what version of Windows you are running and > please attach your current NotifySysAdmin.vbs and an example of the emails > that you receive from it. > > Cheers, Chris. > Hi Chris, I'm running Windows XP Pro, so no Vista here... Copy of the notifyscript: ------------------------------------------------------------------------------ Dim hostname Dim account Dim from Dim sendto Dim subjtmpl Dim subject Dim body Dim smtpserver Set WshNet = CreateObject("WScript.Network") hostname = WshNet.ComputerName account = "0x1" from = "" sendto = "" smtpserver = "192.168.5.1" subjtmpl = "(root) BACKUP PROBLEM on host " & hostname Set args = WScript.Arguments If args(0) = "store-full" Then subject = subjtmpl & " (store full)" body = "The store account for "&hostname&" is full." & vbCrLf & _ vbCrLf & _ "=============================" & vbCrLf & _ "FILES ARE NOT BEING BACKED UP" & vbCrLf & _ "=============================" & vbCrLf & _ vbCrLf & _ "Please adjust the limits on account "&account&" on server "&hostname&"." _ & vbCrLf SendMail from,sendto,subject,body ElseIf args(0) = "read-error" Then subject = subjtmpl & " (read errors)" body = "Errors occured reading some files or directories for backup on "&hostname&"." _ & vbCrLf & vbCrLf & _ "===================================" & vbCrLf & _ "THESE FILES ARE NOT BEING BACKED UP" & vbCrLf & _ "===================================" & vbCrLf & vbCrLf & _ "Check the logs on "&hostname&" for the files and directories which caused" & _ "these errors, and take appropraite action." & vbCrLf & vbCrLf & _ "Other files are being backed up." & vbCrLf SendMail from,sendto,subject,body ElseIf args(0) = "backup-error" Then subject = subjtmpl & " (read errors)" body = "An error occurred during the backup on "&hostname&"." _ & vbCrLf & vbCrLf & _ "==========================" & vbCrLf & _ "FILES MAY NOT BE BACKED UP" & vbCrLf & _ "==========================" & vbCrLf & _ vbCrLf & _ "Check the logs on "&hostname&" for more " & _ "information about the error, " & vbCrLf & _ "and take appropriate action." & vbCrLf SendMail from,sendto,subject,body ElseIf args(0) = "backup-start" Or args(0) = "backup-finish" Or args(0) = "backup-ok" Then ' do nothing for these messages by default 'Else ' subject = subjtmpl & " (unknown)" ' body = "The backup daemon on "&hostname&" reported an unknown error. Argument: "&args(0)&" | " _ ' & vbCrLf & vbCrLf & _ ' "==========================" & vbCrLf & _ ' "FILES MAY NOT BE BACKED UP" & vbCrLf & _ ' "==========================" & vbCrLf & vbCrLf & _ ' "Please check the logs on "&hostname&"." & vbCrLf ' 'SendMail from,sendto,subject,body End If Function CheckSMTPSvc() Set objWMISvc = GetObject("winmgmts:" _ & "{impersonationLevel=impersonate}!\\.\root\cimv2") Set colSMTPSvc = objWMISvc.ExecQuery("Select * From Win32_Service " _ & "Where Name='SMTPSVC'") If colSMTPSvc.Count > 0 Then CheckSMTPSvc = True Else CheckSMTPSvc = False End If End Function Sub SendMail(from,sendto,subject,body) Set objEmail = CreateObject("CDO.Message") Set WshShell = CreateObject("WScript.Shell") Dim cdoschema cdoschema = "http://schemas.microsoft.com/cdo/configuration/" With objEmail .From = from .To = sendto .Subject = subject .TextBody = body If CheckSMTPSvc = False Then .Configuration.Fields.Item(cdoschema & "sendusing") = 2 .Configuration.Fields.Item(cdoschema & "smtpserver") = smtpserver .Configuration.Fields.Item(cdoschema & "smtpserverport") = 25 .Configuration.Fields.Update End If End With On Error Resume Next rc = objEmail.Send If rc Then WshShell.Exec "eventcreate /L Application /ID 201 /T WARNING " _ & "/SO ""Box Backup"" /D """ & args(0) _ & " notification sent to " & sendto & ".""" Else WshShell.Exec "eventcreate /L Application /ID 202 /T ERROR " _ & "/SO ""Box Backup"" /D ""Failed to send " & args(0) _ & " notification to " & sendto & ".""" End If End Sub ------------------------------------------------------------------------------ Copy of the mail I receive: The backup daemon on hz-server reported an unknown error. ========================== FILES MAY NOT BE BACKED UP ========================== Please check the logs on hz-server. Cheers, Roy From boxbackup at boxbackup.org Wed Nov 19 23:36:34 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Wed, 19 Nov 2008 23:36:34 +0000 (GMT) Subject: [Box Backup] Which notifyScript is used? In-Reply-To: <4924A06A.4080000@hostingbrothers.nl> References: <49249B05.9030108@hostingbrothers.nl> <4924A06A.4080000@hostingbrothers.nl> Message-ID: Hi Roy, On Thu, 20 Nov 2008, Roy wrote: > > > I had some troubles with the notify script that was in the latest > > > Windows release. But that bug is solved by Chris now. However at the > > > moment, I receive after every run 2 mails from Box Backup with an > > > unknow error. The message in eventlog never showed that the notify > > > script was started with an unknow parameter, only > > > backup-start/-finish/-ok. The strange thing is that in the config > > > file I have: > > > > > > NotifyScript = cscript "C:\Program Files\Box Backup\NotifySysAdmin.vbs" > > > > > > And I changed in that particular script the subjtmpl, but the mails > > > remain the same. Also I commented out the part of the unknown error, > > > but still I receive that kind of errors. I don't understand this, > > > which script is executed? How can I check this? And does Box Backup > > > cache this script somewhere? > > I'm running Windows XP Pro, so no Vista here... OK, I can't see an obvious reason for the problem. If you run: cscript "C:\Program Files\Box Backup\NotifySysAdmin.vbs" foobar does it send you an email or not? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Wed Nov 19 23:39:40 2008 From: boxbackup at boxbackup.org (Roy) Date: Thu, 20 Nov 2008 00:39:40 +0100 Subject: [Box Backup] Which notifyScript is used? In-Reply-To: References: <49249B05.9030108@hostingbrothers.nl> <4924A06A.4080000@hostingbrothers.nl> Message-ID: <4924A3BC.8010708@hostingbrothers.nl> Chris Wilson wrote: > Hi Roy, > > On Thu, 20 Nov 2008, Roy wrote: > > >>>> I had some troubles with the notify script that was in the latest >>>> Windows release. But that bug is solved by Chris now. However at the >>>> moment, I receive after every run 2 mails from Box Backup with an >>>> unknow error. The message in eventlog never showed that the notify >>>> script was started with an unknow parameter, only >>>> backup-start/-finish/-ok. The strange thing is that in the config >>>> file I have: >>>> >>>> NotifyScript = cscript "C:\Program Files\Box Backup\NotifySysAdmin.vbs" >>>> >>>> And I changed in that particular script the subjtmpl, but the mails >>>> remain the same. Also I commented out the part of the unknown error, >>>> but still I receive that kind of errors. I don't understand this, >>>> which script is executed? How can I check this? And does Box Backup >>>> cache this script somewhere? >>>> >> I'm running Windows XP Pro, so no Vista here... >> > > OK, I can't see an obvious reason for the problem. If you run: > > cscript "C:\Program Files\Box Backup\NotifySysAdmin.vbs" foobar > > does it send you an email or not? > > Cheers, Chris. > No it's not. That the strange thing. Although looking at the script it is obvious that it doesn't, but why is BB itself doing it? It is driving me crazy... Roy From boxbackup at boxbackup.org Wed Nov 19 23:44:05 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Wed, 19 Nov 2008 23:44:05 +0000 (GMT) Subject: [Box Backup] Which notifyScript is used? In-Reply-To: <4924A3BC.8010708@hostingbrothers.nl> References: <49249B05.9030108@hostingbrothers.nl> <4924A06A.4080000@hostingbrothers.nl> <4924A3BC.8010708@hostingbrothers.nl> Message-ID: Hi Roy, On Thu, 20 Nov 2008, Roy wrote: > > > > > And I changed in that particular script the subjtmpl, but the > > > > > mails remain the same. Also I commented out the part of the > > > > > unknown error, but still I receive that kind of errors. I don't > > > > > understand this, which script is executed? How can I check this? > > > > > And does Box Backup cache this script somewhere? > > > > OK, I can't see an obvious reason for the problem. If you run: > > > > cscript "C:\Program Files\Box Backup\NotifySysAdmin.vbs" foobar > > > > does it send you an email or not? > > No it's not. That the strange thing. Although looking at the script it > is obvious that it doesn't, but why is BB itself doing it? It is driving > me crazy... Is it possible that you changed the path to this script in bbackupd.conf and didn't restart the bbackupd service, so it's still using an old copy of the configuration (and hence an old path to the script)? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Wed Nov 19 23:48:04 2008 From: boxbackup at boxbackup.org (Roy) Date: Thu, 20 Nov 2008 00:48:04 +0100 Subject: [Box Backup] Which notifyScript is used? In-Reply-To: References: <49249B05.9030108@hostingbrothers.nl> <4924A06A.4080000@hostingbrothers.nl> <4924A3BC.8010708@hostingbrothers.nl> Message-ID: <4924A5B4.4050204@hostingbrothers.nl> Chris Wilson wrote: > Hi Roy, > > On Thu, 20 Nov 2008, Roy wrote: > > >>>>>> And I changed in that particular script the subjtmpl, but the >>>>>> mails remain the same. Also I commented out the part of the >>>>>> unknown error, but still I receive that kind of errors. I don't >>>>>> understand this, which script is executed? How can I check this? >>>>>> And does Box Backup cache this script somewhere? >>>>>> >>> OK, I can't see an obvious reason for the problem. If you run: >>> >>> cscript "C:\Program Files\Box Backup\NotifySysAdmin.vbs" foobar >>> >>> does it send you an email or not? >>> >> No it's not. That the strange thing. Although looking at the script it >> is obvious that it doesn't, but why is BB itself doing it? It is driving >> me crazy... >> > > Is it possible that you changed the path to this script in bbackupd.conf > and didn't restart the bbackupd service, so it's still using an old copy > of the configuration (and hence an old path to the script)? > > Cheers, Chris. > No, the path and filename in the configuration hasn't changed for a long time. So that's not the problem. And with Process Explorer I can't see which file it opens, because probably it only show it, when it is being used at that moment. Really really strange... should I remove and then install the service? Roy From boxbackup at boxbackup.org Wed Nov 19 23:56:07 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Wed, 19 Nov 2008 23:56:07 +0000 (GMT) Subject: [Box Backup] Which notifyScript is used? In-Reply-To: <4924A5B4.4050204@hostingbrothers.nl> References: <49249B05.9030108@hostingbrothers.nl> <4924A06A.4080000@hostingbrothers.nl> <4924A3BC.8010708@hostingbrothers.nl> <4924A5B4.4050204@hostingbrothers.nl> Message-ID: Hi Roy, On Thu, 20 Nov 2008, Roy wrote: > > Is it possible that you changed the path to this script in > > bbackupd.conf and didn't restart the bbackupd service, so it's still > > using an old copy of the configuration (and hence an old path to the > > script)? > > No, the path and filename in the configuration hasn't changed for a long > time. So that's not the problem. And with Process Explorer I can't see > which file it opens, because probably it only show it, when it is being > used at that moment. Really really strange... should I remove and then > install the service? Is it possible that you have more than one copy of Box Backup on the system? What is the service command line in the service properties? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Thu Nov 20 00:00:45 2008 From: boxbackup at boxbackup.org (Roy) Date: Thu, 20 Nov 2008 01:00:45 +0100 Subject: [Box Backup] Which notifyScript is used? In-Reply-To: References: <49249B05.9030108@hostingbrothers.nl> <4924A06A.4080000@hostingbrothers.nl> <4924A3BC.8010708@hostingbrothers.nl> <4924A5B4.4050204@hostingbrothers.nl> Message-ID: <4924A8AD.4020906@hostingbrothers.nl> Chris Wilson wrote: > Hi Roy, > > On Thu, 20 Nov 2008, Roy wrote: > > >>> Is it possible that you changed the path to this script in >>> bbackupd.conf and didn't restart the bbackupd service, so it's still >>> using an old copy of the configuration (and hence an old path to the >>> script)? >>> >> No, the path and filename in the configuration hasn't changed for a long >> time. So that's not the problem. And with Process Explorer I can't see >> which file it opens, because probably it only show it, when it is being >> used at that moment. Really really strange... should I remove and then >> install the service? >> > > Is it possible that you have more than one copy of Box Backup on the > system? What is the service command line in the service properties? > > Cheers, Chris. > No, only one installed. It is upgraded though some time ago. Command line: C:\Program Files\Box Backup\bbackupd.exe -s -S "bbackupd" "C:\Program Files\Box Backup\bbackupd.conf" This is correct, and this should be running fine. I think I have a mysterious machine ... Cheers, Roy From boxbackup at boxbackup.org Thu Nov 20 00:05:43 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Thu, 20 Nov 2008 00:05:43 +0000 (GMT) Subject: [Box Backup] Which notifyScript is used? In-Reply-To: <4924A8AD.4020906@hostingbrothers.nl> References: <49249B05.9030108@hostingbrothers.nl> <4924A06A.4080000@hostingbrothers.nl> <4924A3BC.8010708@hostingbrothers.nl> <4924A5B4.4050204@hostingbrothers.nl> <4924A8AD.4020906@hostingbrothers.nl> Message-ID: Hi Roy, On Thu, 20 Nov 2008, Roy wrote: > > > > Is it possible that you changed the path to this script in > > > > bbackupd.conf and didn't restart the bbackupd service, so it's > > > > still using an old copy of the configuration (and hence an old > > > > path to the script)? > > > > > > > No, the path and filename in the configuration hasn't changed for a > > > long time. So that's not the problem. And with Process Explorer I > > > can't see which file it opens, because probably it only show it, > > > when it is being used at that moment. Really really strange... > > > should I remove and then install the service? > > > > Is it possible that you have more than one copy of Box Backup on the system? > > What is the service command line in the service properties? > > Command line: > C:\Program Files\Box Backup\bbackupd.exe -s -S "bbackupd" "C:\Program > Files\Box Backup\bbackupd.conf" > This is correct, and this should be running fine. > > I think I have a mysterious machine ... I think so too :( Could you try stopping and removing the service, and then running bbackupd from the command line, does that still send you the mysterious emails? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Thu Nov 20 00:17:37 2008 From: boxbackup at boxbackup.org (Roy) Date: Thu, 20 Nov 2008 01:17:37 +0100 Subject: [Box Backup] Which notifyScript is used? In-Reply-To: References: <49249B05.9030108@hostingbrothers.nl> <4924A06A.4080000@hostingbrothers.nl> <4924A3BC.8010708@hostingbrothers.nl> <4924A5B4.4050204@hostingbrothers.nl> <4924A8AD.4020906@hostingbrothers.nl> Message-ID: <4924ACA1.9090406@hostingbrothers.nl> Chris Wilson wrote: > Hi Roy, > > On Thu, 20 Nov 2008, Roy wrote: > > >>>>> Is it possible that you changed the path to this script in >>>>> bbackupd.conf and didn't restart the bbackupd service, so it's >>>>> still using an old copy of the configuration (and hence an old >>>>> path to the script)? >>>>> >>>>> >>>> No, the path and filename in the configuration hasn't changed for a >>>> long time. So that's not the problem. And with Process Explorer I >>>> can't see which file it opens, because probably it only show it, >>>> when it is being used at that moment. Really really strange... >>>> should I remove and then install the service? >>>> >>> Is it possible that you have more than one copy of Box Backup on the system? >>> What is the service command line in the service properties? >>> >> Command line: >> C:\Program Files\Box Backup\bbackupd.exe -s -S "bbackupd" "C:\Program >> Files\Box Backup\bbackupd.conf" >> This is correct, and this should be running fine. >> >> I think I have a mysterious machine ... >> > > I think so too :( Could you try stopping and removing the service, and > then running bbackupd from the command line, does that still send you the > mysterious emails? > > Cheers, Chris. > First run, no warnings and no e-mails. Second run (after issuing a bbackupctl sync command), a lot of warnings (same as the other thread), but still no mail. Why is this? This is how it is supposed to work (exept the warnings offcourse). Cheers, Roy From boxbackup at boxbackup.org Thu Nov 20 00:19:49 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Thu, 20 Nov 2008 00:19:49 +0000 (GMT) Subject: [Box Backup] Which notifyScript is used? In-Reply-To: <4924ACA1.9090406@hostingbrothers.nl> References: <49249B05.9030108@hostingbrothers.nl> <4924A06A.4080000@hostingbrothers.nl> <4924A3BC.8010708@hostingbrothers.nl> <4924A5B4.4050204@hostingbrothers.nl> <4924A8AD.4020906@hostingbrothers.nl> <4924ACA1.9090406@hostingbrothers.nl> Message-ID: Hi Roy, On Thu, 20 Nov 2008, Roy wrote: > > > I think I have a mysterious machine ... > > > > I think so too :( Could you try stopping and removing the service, and > > then running bbackupd from the command line, does that still send you > > the mysterious emails? > > First run, no warnings and no e-mails. Second run (after issuing a > bbackupctl sync command), a lot of warnings (same as the other thread), > but still no mail. Why is this? This is how it is supposed to work > (exept the warnings offcourse). Could you try installing and running the service again now? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Thu Nov 20 00:24:07 2008 From: boxbackup at boxbackup.org (Peter Jalajas, GigaLock Backup Services) Date: Wed, 19 Nov 2008 19:24:07 -0500 Subject: [Box Backup] Help installing client on MacBook White Message-ID: <74d01c7a0811191624i876c96dvef7f4dbc8807fad6@mail.gmail.com> Hi all, I finally broke my rule about only having two operating systems in my life (Ubuntu and, alas, Windows). I bought a MacBook White for my guitar-playing son http://www.apple.com/macbook/white/ (it has the Intel processor). The good news is that this should help me understand how to run boxbackup on Macs and thus, I hope, open up my business to the creative folks who like to use Macs. So, can someone hold my hand through installing boxbackup client on this thing? The only admin I've done on it so far is install OpenOffice.org and the like by downloading things like .dmg files and dragging them to the "A" thing (I have no idea what it's doing under the covers, or if even that is the best way to install things). Thanks for the help! Pete From boxbackup at boxbackup.org Thu Nov 20 00:34:27 2008 From: boxbackup at boxbackup.org (Roy) Date: Thu, 20 Nov 2008 01:34:27 +0100 Subject: [Box Backup] Which notifyScript is used? In-Reply-To: References: <49249B05.9030108@hostingbrothers.nl> <4924A06A.4080000@hostingbrothers.nl> <4924A3BC.8010708@hostingbrothers.nl> <4924A5B4.4050204@hostingbrothers.nl> <4924A8AD.4020906@hostingbrothers.nl> <4924ACA1.9090406@hostingbrothers.nl> Message-ID: <4924B093.3000608@hostingbrothers.nl> Chris Wilson wrote: > Hi Roy, > > On Thu, 20 Nov 2008, Roy wrote: > > >>>> I think I have a mysterious machine ... >>>> >>> I think so too :( Could you try stopping and removing the service, and >>> then running bbackupd from the command line, does that still send you >>> the mysterious emails? >>> >> First run, no warnings and no e-mails. Second run (after issuing a >> bbackupctl sync command), a lot of warnings (same as the other thread), >> but still no mail. Why is this? This is how it is supposed to work >> (exept the warnings offcourse). >> > > Could you try installing and running the service again now? > > Cheers, Chris. > I was already trying that... and first run, no errors and no e-mail. Second run, lots of warning, but still no e-mail. So I think the mysterious sending of e-mails is resolved. Strange thing is, when doing a sync pretty soon after the first run, it will upload a lot of bytes (NOTICE: File statistics: total file size uploaded 6078911, bytes already on server 6074956, encoded size 75795). I wonder if this has to do with the warnings or if it's normal. Cheers, Roy From boxbackup at boxbackup.org Thu Nov 20 01:07:25 2008 From: boxbackup at boxbackup.org (Roy) Date: Thu, 20 Nov 2008 02:07:25 +0100 Subject: [Box Backup] Which notifyScript is used? In-Reply-To: <4924B093.3000608@hostingbrothers.nl> References: <49249B05.9030108@hostingbrothers.nl> <4924A06A.4080000@hostingbrothers.nl> <4924A3BC.8010708@hostingbrothers.nl> <4924A5B4.4050204@hostingbrothers.nl> <4924A8AD.4020906@hostingbrothers.nl> <4924ACA1.9090406@hostingbrothers.nl> <4924B093.3000608@hostingbrothers.nl> Message-ID: <4924B84D.1050101@hostingbrothers.nl> Roy wrote: > Chris Wilson wrote: >> Hi Roy, >> >> On Thu, 20 Nov 2008, Roy wrote: >> >> >>>>> I think I have a mysterious machine ... >>>>> >>>> I think so too :( Could you try stopping and removing the service, >>>> and then running bbackupd from the command line, does that still >>>> send you the mysterious emails? >>>> >>> First run, no warnings and no e-mails. Second run (after issuing a >>> bbackupctl sync command), a lot of warnings (same as the other >>> thread), but still no mail. Why is this? This is how it is supposed >>> to work (exept the warnings offcourse). >>> >> >> Could you try installing and running the service again now? >> >> Cheers, Chris. >> > > I was already trying that... and first run, no errors and no e-mail. > Second run, lots of warning, but still no e-mail. > So I think the mysterious sending of e-mails is resolved. > > Strange thing is, when doing a sync pretty soon after the first run, > it will upload a lot of bytes (NOTICE: File statistics: total file > size uploaded 6078911, bytes already on server 6074956, encoded size > 75795). I wonder if this has to do with the warnings or if it's normal. > > Cheers, > > Roy > > > _______________________________________________ > boxbackup mailing list > boxbackup at boxbackup.org > http://lists.warhead.org.uk/mailman/listinfo/boxbackup > > !DSPAM:4924b0ce141587785174857! > I'm sorry for wasting your time, but the error mails didn't come from my main Windows workstation, but my Linux home server. The notify script there, also has missing parts for backup-start, backup-finish and backup-ok. Is that already fixed in trunk for not only Windows, but also for Linux? Cheers, Roy From boxbackup at boxbackup.org Thu Nov 20 01:09:41 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Thu, 20 Nov 2008 01:09:41 +0000 (GMT) Subject: [Box Backup] Which notifyScript is used? In-Reply-To: <4924B84D.1050101@hostingbrothers.nl> References: <49249B05.9030108@hostingbrothers.nl> <4924A06A.4080000@hostingbrothers.nl> <4924A3BC.8010708@hostingbrothers.nl> <4924A5B4.4050204@hostingbrothers.nl> <4924A8AD.4020906@hostingbrothers.nl> <4924ACA1.9090406@hostingbrothers.nl> <4924B093.3000608@hostingbrothers.nl> <4924B84D.1050101@hostingbrothers.nl> Message-ID: Hi Roy, On Thu, 20 Nov 2008, Roy wrote: > I'm sorry for wasting your time, but the error mails didn't come from my > main Windows workstation, but my Linux home server. The notify script > there, also has missing parts for backup-start, backup-finish and > backup-ok. Is that already fixed in trunk for not only Windows, but also > for Linux? The notify script on Unixes is generated when you run bbackupd-config, so either you need to run it again after upgrading, or manually edit the script, as described on the wiki's Upgrading page. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Thu Nov 20 07:32:43 2008 From: boxbackup at boxbackup.org (James O'Gorman) Date: Thu, 20 Nov 2008 07:32:43 +0000 Subject: [Box Backup] Help installing client on MacBook White In-Reply-To: <74d01c7a0811191624i876c96dvef7f4dbc8807fad6@mail.gmail.com> References: <74d01c7a0811191624i876c96dvef7f4dbc8807fad6@mail.gmail.com> Message-ID: <4925129B.60505@netinertia.co.uk> On 20/11/08 00:24, Peter Jalajas, GigaLock Backup Services wrote: > Hi all, > > I finally broke my rule about only having two operating systems in my > life (Ubuntu and, alas, Windows). I bought a MacBook White for my > guitar-playing son http://www.apple.com/macbook/white/ (it has the > Intel processor). Lucky boy :-) > The good news is that this should help me understand how to run > boxbackup on Macs and thus, I hope, open up my business to the > creative folks who like to use Macs. > > So, can someone hold my hand through installing boxbackup client on > this thing? The only admin I've done on it so far is install > OpenOffice.org and the like by downloading things like .dmg files and > dragging them to the "A" thing (I have no idea what it's doing under > the covers, or if even that is the best way to install things). I hope that's not exactly what you're doing :-) (The .dmg is like a tar file, you need to drag things from the .dmg to the Applications folder, not the .dmg itself.) I have some notes somewhere on creating a daemon account under Leopard. I'll try and dig them out and put something on the wiki when I get home from work tonight. Feel free to give me a shout if you have any Mac-related questions, too. James From boxbackup at boxbackup.org Thu Nov 20 12:07:47 2008 From: boxbackup at boxbackup.org (Roy) Date: Thu, 20 Nov 2008 13:07:47 +0100 Subject: [Box Backup] Which notifyScript is used? In-Reply-To: References: <49249B05.9030108@hostingbrothers.nl> <4924A06A.4080000@hostingbrothers.nl> <4924A3BC.8010708@hostingbrothers.nl> <4924A5B4.4050204@hostingbrothers.nl> <4924A8AD.4020906@hostingbrothers.nl> <4924ACA1.9090406@hostingbrothers.nl> <4924B093.3000608@hostingbrothers.nl> <4924B84D.1050101@hostingbrothers.nl> Message-ID: <49255313.5080301@hostingbrothers.nl> Chris Wilson wrote: > Hi Roy, > > On Thu, 20 Nov 2008, Roy wrote: > > >> I'm sorry for wasting your time, but the error mails didn't come from my >> main Windows workstation, but my Linux home server. The notify script >> there, also has missing parts for backup-start, backup-finish and >> backup-ok. Is that already fixed in trunk for not only Windows, but also >> for Linux? >> > > The notify script on Unixes is generated when you run bbackupd-config, > so either you need to run it again after upgrading, or manually edit the > script, as described on the wiki's Upgrading page. > > Cheers, Chris. > Hi Chris, Why is this file generated and not already available in the parcel? On upgrading, you never run bbackupd-config, because that would overwrite your current config. So you're stuck with an old version of the notify script. Isn't it beter to put it in the parcel and maybe put the config parameters in bbackupd.conf? And there is an error on the wiki, the backup-ok is missing there. I don't have a login so, I can't update the page (http://boxbackup.org/trac/wiki/011) Cheers, Roy From boxbackup at boxbackup.org Thu Nov 20 13:10:14 2008 From: boxbackup at boxbackup.org (Roy) Date: Thu, 20 Nov 2008 14:10:14 +0100 Subject: [Box Backup] Eventlog full with warnings In-Reply-To: References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> <491B5B1B.8050908@hostingbrothers.nl> <492402E8.9030000@hostingbrothers.nl> <4924994F.8080006@hostingbrothers.nl> <49249C2E.7010602@hostingbrothers.nl> Message-ID: <492561B6.7060202@hostingbrothers.nl> Chris Wilson wrote: > Hi Roy, > > On Thu, 20 Nov 2008, Roy wrote: > > >>> Another thing that would be really helpful is to have a debug log file >>> where both the initial run (when the IDs are stored in the mapping >>> database) and the subsequent run (where those IDs are used to detect >>> moved files) in the same file. You've sent me two separate log files >>> already but I don't know whether there were any intervening runs or >>> what could have happened in the time between those logs. >>> >> Initial run, is the first run when the service starts? >> > > Yes, that's right. > > >>> Use "dir" on each drive, the volume serial number is at the top of the >>> output. >>> >> c: => 941B-B190 >> d: => 78FA-5915 >> > > OK, so it's not that the drives have the same serial number, which was one > of my theories. Bummer. > > Cheers, Chris. > Hi Chris, I'm running a full compare, and I wanted to catch the output into a logfile, but I think it didn't work. bbackupctl "compare -a" > output.txt I see a lot of message rolling through my command window, but the logfile is still empty. Eventlog is full, so I'll probably be missing a lot. How can I capture the output? And I have already a "different contents to store file" warning. And that file hasn't changed for 9 months! So something is going wrong. Can I force a upload of that particular file? Cheers, Roy PS. compare isn't finished yet, so maybe I'll add some here later... From boxbackup at boxbackup.org Thu Nov 20 13:53:04 2008 From: boxbackup at boxbackup.org (Peter Jalajas, GigaLock Backup Services) Date: Thu, 20 Nov 2008 08:53:04 -0500 Subject: [Box Backup] Help installing client on MacBook White In-Reply-To: <4925129B.60505@netinertia.co.uk> References: <74d01c7a0811191624i876c96dvef7f4dbc8807fad6@mail.gmail.com> <4925129B.60505@netinertia.co.uk> Message-ID: <74d01c7a0811200553u3f132b8te0da5bc0c94079c1@mail.gmail.com> Thanks, James! On Thu, Nov 20, 2008 at 2:32 AM, James O'Gorman wrote: > On 20/11/08 00:24, Peter Jalajas, GigaLock Backup Services wrote: >> >> Hi all, ... by downloading things like .dmg files and >> dragging them to the "A" thing (I have no idea what it's doing under >> the covers, or if even that is the best way to install things). > > I hope that's not exactly what you're doing :-) (The .dmg is like a tar > file, you need to drag things from the .dmg to the Applications folder, not > the .dmg itself.) I'm really out of my element on macs... :^) Maybe I actually double clicked the .dmg first--sorry. > I have some notes somewhere on creating a daemon account under Leopard. I'll > try and dig them out and put something on the wiki when I get home from work > tonight. > > Feel free to give me a shout if you have any Mac-related questions, too. > > James Thanks for everything, James! Remember to dumb it down for me if you can (as I sit here on my windows box, I'm not even sure I know how to get to a command line on the mac; I'm sure it's in one of the menus). I'll try to update the wiki with what we gather up. Pete From boxbackup at boxbackup.org Thu Nov 20 14:53:44 2008 From: boxbackup at boxbackup.org (David H Kaufman) Date: Thu, 20 Nov 2008 09:53:44 -0500 Subject: [Box Backup] Which notifyScript is =?UTF-8?Q?used=3F?= In-Reply-To: <49255313.5080301@hostingbrothers.nl> References: <49249B05.9030108@hostingbrothers.nl> <4924A06A.4080000@hostingbrothers.nl> <4924A3BC.8010708@hostingbrothers.nl> <4924A5B4.4050204@hostingbrothers.nl> <4924A8AD.4020906@hostingbrothers.nl> <4924ACA1.9090406@hostingbrothers.nl> <4924B093.3000608@hostingbrothers.nl> <4924B84D.1050101@hostingbrothers.nl> <49255313.5080301@hostingbrothers.nl> Message-ID: <908c5c7aafe4142a5ef2bb71b1726dd5@kaufmanfamily.net> On Thu, 20 Nov 2008 13:07:47 +0100, Roy wrote: > Chris Wilson wrote: ... >> The notify script on Unixes is generated when you run bbackupd-config, >> so either you need to run it again after upgrading, or manually edit the >> script, as described on the wiki's Upgrading page. >> >> Cheers, Chris. >> > > Hi Chris, > > Why is this file generated and not already available in the parcel? On > upgrading, you never run bbackupd-config, because that would overwrite > your current config. So you're stuck with an old version of the notify > script. Isn't it beter to put it in the parcel and maybe put the config > parameters in bbackupd.conf? Hi Chris & Roy, I'll agree that this very confusing. I spent a while trying to figure out where the notify script came from when I did the boxbackup 0.11 package for Gentoo, and finally punted on trying to upgrade it automatically. (The package just prints a generic warning.) Now that I know the answer, there are probably some things that could be improved in the Gentoo package. Thanks David > And there is an error on the wiki, the backup-ok is missing there. I > don't have a login so, I can't update the page > (http://boxbackup.org/trac/wiki/011) > > Cheers, > > Roy > > _______________________________________________ > boxbackup mailing list > boxbackup at boxbackup.org > http://lists.warhead.org.uk/mailman/listinfo/boxbackup From boxbackup at boxbackup.org Fri Nov 21 08:14:28 2008 From: boxbackup at boxbackup.org (Per Reedtz Thomsen) Date: Fri, 21 Nov 2008 00:14:28 -0800 Subject: [Box Backup] Help installing client on MacBook White In-Reply-To: <4925129B.60505@netinertia.co.uk> References: <74d01c7a0811191624i876c96dvef7f4dbc8807fad6@mail.gmail.com> <4925129B.60505@netinertia.co.uk> Message-ID: <1C23AD61-EF9B-4B80-AA6E-0FE404DDBD56@reedtz.com> On Nov 19, 2008, at 11:32 PM, James O'Gorman wrote: > On 20/11/08 00:24, Peter Jalajas, GigaLock Backup Services wrote: >> >> The good news is that this should help me understand how to run >> boxbackup on Macs and thus, I hope, open up my business to the >> creative folks who like to use Macs. >> >> So, can someone hold my hand through installing boxbackup client on >> this thing? The only admin I've done on it so far is install >> OpenOffice.org and the like by downloading things like .dmg files and >> dragging them to the "A" thing (I have no idea what it's doing under >> the covers, or if even that is the best way to install things). > > I hope that's not exactly what you're doing :-) (The .dmg is like a > tar file, you need to drag things from the .dmg to the Applications > folder, not the .dmg itself.) > > I have some notes somewhere on creating a daemon account under > Leopard. I'll try and dig them out and put something on the wiki > when I get home from work tonight. > > Feel free to give me a shout if you have any Mac-related questions, > too. There are launchd config files in the contrib/mac_osx directory, that controls the automatic starting of bbackupd on boot, etc. Since you'll be running bbackupd, you should copy the org.boxbackup.bbackupd.plist file to /Library/LaunchDaemons. The plist file relies on bbackupd being installed in /usr/local/bin... Otherwise the configuration is the same as for any other unix client: certs/bbackupd.conf/etc. The Apple launchd man page (http://tinyurl.com/637xfc) is a good starting point, if you run into problems and need to understand a little more about how to use and test launchd stuff. Or, of course, you can ask here... :-) Thanks, Per -- Per Reedtz Thomsen | Reedtz Consulting, LLC | F: 209 883 4119 V: 209 883 4102 | pthomsen at reedtz.com | C: 209 996 9561 GPG ID: 1209784F | Yahoo! Chat: pthomsen | AIM: pthomsen From boxbackup at boxbackup.org Sat Nov 22 15:31:25 2008 From: boxbackup at boxbackup.org (James O'Gorman) Date: Sat, 22 Nov 2008 15:31:25 +0000 Subject: [Box Backup] Help installing client on MacBook White In-Reply-To: <1C23AD61-EF9B-4B80-AA6E-0FE404DDBD56@reedtz.com> References: <74d01c7a0811191624i876c96dvef7f4dbc8807fad6@mail.gmail.com> <4925129B.60505@netinertia.co.uk> <1C23AD61-EF9B-4B80-AA6E-0FE404DDBD56@reedtz.com> Message-ID: <492825CD.1030103@netinertia.co.uk> On 21/11/08 08:14, Per Reedtz Thomsen wrote: > There are launchd config files in the contrib/mac_osx directory, that > controls the automatic starting of bbackupd on boot, etc. Since you'll > be running bbackupd, you should copy the org.boxbackup.bbackupd.plist > file to /Library/LaunchDaemons. Ah hah, I'd forgotten about those. :-) As of r2381 we now install the plist files automatically on OS X so installing on OS X should be as simply as any other platform. :-) > The plist file relies on bbackupd being installed in /usr/local/bin... I've autoconfified these, so they use the PREFIX now (defaults to /usr/local but can be specified with ./configure --prefix=...) James From boxbackup at boxbackup.org Sat Nov 22 15:34:50 2008 From: boxbackup at boxbackup.org (James O'Gorman) Date: Sat, 22 Nov 2008 15:34:50 +0000 Subject: [Box Backup] Help installing client on MacBook White In-Reply-To: <74d01c7a0811200553u3f132b8te0da5bc0c94079c1@mail.gmail.com> References: <74d01c7a0811191624i876c96dvef7f4dbc8807fad6@mail.gmail.com> <4925129B.60505@netinertia.co.uk> <74d01c7a0811200553u3f132b8te0da5bc0c94079c1@mail.gmail.com> Message-ID: <4928269A.6070309@netinertia.co.uk> On 20/11/08 13:53, Peter Jalajas, GigaLock Backup Services wrote: > Thanks for everything, James! Remember to dumb it down for me if you > can (as I sit here on my windows box, I'm not even sure I know how to > get to a command line on the mac; I'm sure it's in one of the menus). > I'll try to update the wiki with what we gather up. As per my previous email, installing on OS X is now the same as installing on Linux, FreeBSD, etc and gives you the added bonus of automatically adding the launchd plist (equiv of init/rc on Unix). Not sure what I was thinking when I mentioned adding daemon accounts - of course this isn't necessary for bbackupd as it runs as root. Regarding a "command line" on Mac - just run Terminal from Applications/Utilities in Finder. Drag it into your Dock for extra convenience. :-) James From boxbackup at boxbackup.org Mon Nov 24 11:05:28 2008 From: boxbackup at boxbackup.org (Tom Albers) Date: Mon, 24 Nov 2008 12:05:28 +0100 Subject: [Box Backup] Old vs. Deleted Message-ID: <4618818.g6x8ZKMkUH@kovoks.nl> --nextPart2813045.e686Lt5MW2 Content-Type: text/plain Content-Transfer-Encoding: 7Bit Hi, Recently I had to retrieve an older version of a folder, but I could not because there were no older versions available. Running info resulted in the following: Account ID: 00000001 Last object ID: 8009785 Blocks used: 51199878 (99999.76Mb) Blocks used by old files: 0 (0.00Mb) Blocks used by deleted files: 27961849 (54612.99Mb) Blocks used by directories: 233209 (455.49Mb) Block soft limit: 51200000 (100000.00Mb) Block hard limit: 64000000 (125000.00Mb) Client store marker: 1226809601724028 So all space is occupied by current files and deleted files. As stuff moves pretty quickly on that server, a lot of info goes to the deleted section. But part of that is not interesting anymore, but it is kept in the backup for ever. Would it be possible to say: I want 20GB for deleted, 20GB for old and 60GB for current? Or would it be possible to purge the deleted files if they are deleted longer then a week ago? Best, Tom Albers -- KovoKs B.V. KvK: 11033334 --nextPart2813045.e686Lt5MW2-- From boxbackup at boxbackup.org Mon Nov 24 15:51:15 2008 From: boxbackup at boxbackup.org (Alexandre Mallais) Date: Mon, 24 Nov 2008 10:51:15 -0500 Subject: [Box Backup] Files are backup, but old/delete does not stay In-Reply-To: <492248D0.6080902@avior.ca> References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> <491B5B1B.8050908@hostingbrothers.nl> <491DE56A.4030400@avior.ca> <491DEB61.7010402@avior.ca> <491E02AB.9070206@netinertia.co.uk> <4921BE25.8050108@avior.ca> <4921E22C.6030903@avior.ca> <492248D0.6080902@avior.ca> Message-ID: <492ACD73.6030409@avior.ca> ok this was very stupid problem. There was just not enough place for deleted/old files, here is the new output: query > usage Used 4812.4Mb 46% ****************** Old files 1499.7Mb 14% ***** Deleted files 1993.2Mb 19% ******* Directories 9.7Mb 0% Soft limit 8192.0Mb 80% ******************************** Hard limit 10240.0Mb 100% **************************************** Alexandre Mallais wrote: > I will bring the soft limit to 90 % > Chris Wilson wrote: >> Hi Alexandre, >> >> On Mon, 17 Nov 2008, Alexandre Mallais wrote: >> >> >>> Sorry I miss to provide this informations. I doubt this being the >>> problem >>> >>> usage show this: >>> query > usage >>> Used 1328.1Mb 66% ************************** >>> Old files 11.0Mb 0% >>> Deleted files 0.0Mb 0% >>> Directories 9.5Mb 0% >>> Soft limit 1500.0Mb 75% ****************************** >>> Hard limit 2000.0Mb 100% >>> **************************************** >>> >>> So I doubt this is the problem, it did not acheive the 75% for a >>> long time >>> >> >> I'm not sure about that, perhaps housekeeping deleted the old >> versions to bring it below 75%. How much data is added each day? >> Could you try increasing the softlimit to see if it starts keeping >> old versions of this file? >> >> Cheers, Chris. >> > _______________________________________________ > boxbackup mailing list > boxbackup at boxbackup.org > http://lists.warhead.org.uk/mailman/listinfo/boxbackup > . > From boxbackup at boxbackup.org Mon Nov 24 21:38:39 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Mon, 24 Nov 2008 21:38:39 +0000 (GMT) Subject: [Box Backup] Old vs. Deleted In-Reply-To: <4618818.g6x8ZKMkUH@kovoks.nl> References: <4618818.g6x8ZKMkUH@kovoks.nl> Message-ID: Hi Tom, On Mon, 24 Nov 2008, Tom Albers wrote: > Recently I had to retrieve an older version of a folder, but I could not > because there were no older versions available. Running info resulted in > the following: > > Account ID: 00000001 > Last object ID: 8009785 > Blocks used: 51199878 (99999.76Mb) > Blocks used by old files: 0 (0.00Mb) > Blocks used by deleted files: 27961849 (54612.99Mb) > Blocks used by directories: 233209 (455.49Mb) > Block soft limit: 51200000 (100000.00Mb) > Block hard limit: 64000000 (125000.00Mb) > Client store marker: 1226809601724028 > > So all space is occupied by current files and deleted files. As stuff > moves pretty quickly on that server, a lot of info goes to the deleted > section. But part of that is not interesting anymore, but it is kept in > the backup for ever. > > Would it be possible to say: I want 20GB for deleted, 20GB for old and > 60GB for current? Or would it be possible to purge the deleted files if > they are deleted longer then a week ago? I'm afraid it's not possible at the moment. I must confess that I don't really understand the logic for removing old or deleted files in housekeeping. I wish this was under the client's control, but currently it's not. Perhaps separate quotas, as you suggest, might be a simple workaround. I think the best solution would be to move to a snapshot layout for the store, where you could delete old snapshots when they are no longer useful and manage your disk space that way. Unfortunately it's quite a big change and therefore won't happen for a while. I've created ticket 52 to remind me to look into this. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Mon Nov 24 21:54:14 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Mon, 24 Nov 2008 21:54:14 +0000 (GMT) Subject: [Box Backup] Files are backup, but old/delete does not stay In-Reply-To: <492ACD73.6030409@avior.ca> References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> <491B5B1B.8050908@hostingbrothers.nl> <491DE56A.4030400@avior.ca> <491DEB61.7010402@avior.ca> <491E02AB.9070206@netinertia.co.uk> <4921BE25.8050108@avior.ca> <4921E22C.6030903@avior.ca> <492248D0.6080902@avior.ca> <492ACD73.6030409@avior.ca> Message-ID: Hi Alexandre, On Mon, 24 Nov 2008, Alexandre Mallais wrote: > ok this was very stupid problem. > > There was just not enough place for deleted/old files, here is the new output: > query > usage > Used 4812.4Mb 46% ****************** > Old files 1499.7Mb 14% ***** > Deleted files 1993.2Mb 19% ******* > Directories 9.7Mb 0% > Soft limit 8192.0Mb 80% ******************************** > Hard limit 10240.0Mb 100% **************************************** I'm glad you were able to fix it :) Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org | From boxbackup at boxbackup.org Sat Nov 29 11:16:22 2008 From: boxbackup at boxbackup.org (Roy) Date: Sat, 29 Nov 2008 12:16:22 +0100 Subject: [Box Backup] Eventlog full with warnings In-Reply-To: <49249C2E.7010602@hostingbrothers.nl> References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> <491B5B1B.8050908@hostingbrothers.nl> <492402E8.9030000@hostingbrothers.nl> <4924994F.8080006@hostingbrothers.nl> <49249C2E.7010602@hostingbrothers.nl> Message-ID: <49312486.8050801@hostingbrothers.nl> This is a multi-part message in MIME format. --------------050202090804020408080401 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Roy wrote: > Chris Wilson wrote: >> Hi Roy, >> >> On Wed, 19 Nov 2008, Roy wrote: >> >> >>>> I'm afraid there's no debug information that would help at this >>>> point. The best thing would be to have access to the machine where >>>> it happens, but I assume that's not possible for you. Failing that, >>>> I have to be able to reproduce it, and so far I haven't been able to. >>>> >>> It is my workstation, that I use most of the time. So it would be >>> quite hard >>> to do that. BTW it's a Windows system. So I must use RDP or VNC. But >>> can I do >>> some things for you to test things? Maybe a chat/debug session would >>> be quite >>> handy for this? >>> >> >> Unfortunately at the moment I have no idea where this bug might come >> from, how the memory could get corrupted, so I can't think of >> anything obvious for you to test unless I can somehow make a custom >> build of bbackupd that has memory corruption detection. >> >> Another thing that would be really helpful is to have a debug log >> file where both the initial run (when the IDs are stored in the >> mapping database) and the subsequent run (where those IDs are used to >> detect moved files) in the same file. You've sent me two separate log >> files already but I don't know whether there were any intervening >> runs or what could have happened in the time between those logs. >> > Initial run, is the first run when the service starts? I will start > logging again... >> >>>> If you run the same build on another Windows system, does it have >>>> the same >>>> problem? Can you give me the Volume Serial Numbers of each drive >>>> that you're >>>> backing up? >>>> >>> I didn't upgrade my other Windows systems to this build. And I'm >>> reluctant to >>> do it, because of these errors. >>> >> >> It's just a warning message, which was previously ignored. It could >> well be a false alarm. > Maybe on Saturday I will upgrade a Windows 2003 server to this > version. I will monitor the eventlog. >> >>> Where can I find these volume serial numbers? Then I will post them. >>> >> >> Use "dir" on each drive, the volume serial number is at the top of >> the output. >> > c: => 941B-B190 > d: => 78FA-5915 >> >>>> What's the biggest problem for you at the moment? The fact that the >>>> messages are filling up your logs, or is the backup not actually >>>> working? I think that it should be working if "compare -a" works >>>> for you and reports no differences. Could you try that and let me >>>> know? >>>> >>> I'm afraid that the backup isn't working correctly. Tomorrow I will >>> do a >>> compare -a, so then I can tell more. The logs filling is not the >>> worst of >>> this, it's however annoying. And I stop looking at it, so I can miss >>> other >>> problems. >>> >> >> Please do run a compare -a when you can, I hope that it will reassure >> you that the backup is actually working correctly and that the >> warnings, although they indicate a false assumption on our part that >> may be a bug in Box Backup, are relatively harmless and can be >> ignored for now. >> >> Unfortunately I'm just too busy this week to look into it much >> further. Next week should be better for me. >> >> Cheers, Chris. >> > Oke, I will run that check tomorrow and let you know what happened. > > Thanks for your time! > > Cheers, > > Roy > > > _______________________________________________ > boxbackup mailing list > boxbackup at boxbackup.org > http://lists.warhead.org.uk/mailman/listinfo/boxbackup > > !DSPAM:49249c7a93931804284693! > Hi Chris, I updated a Windows 2003 server machine with the 2368 build (same one as on my workstation) and got the same problems. Bot machines are upgraded from build 1857. I started without the old StoreObjectInfoFile (so BB had to create a new one). First run is clean and on the second run I got a lot of errors. I also made a diff file for two of the errors in the notifyscript. I don't know if they are allready solved or not, because they are generated by the build system. Cheers, Roy --------------050202090804020408080401 Content-Type: text/plain; name="NotifySysAdmin.diff" Content-Transfer-Encoding: base64 Content-Disposition: inline; filename="NotifySysAdmin.diff" LS0tIEQ6XEJlaGVlclxTb2Z0d2FyZVxCb3hcTm90aWZ5U3lzQWRtaW4udmJzCW1hIG9rdCAy NyAyMToyMjoxMCAyMDA4DQorKysgRDpcQmVoZWVyXFNvZnR3YXJlXEJveFxOb3RpZnlTeXNB ZG1pbi1maXgudmJzCXphIG5vdiAyOSAxMDowNTo1OSAyMDA4DQpAQCAtMzIsNyArMzIsNyBA QA0KIEVsc2VJZiBhcmdzKDApID0gInJlYWQtZXJyb3IiIFRoZW4KIAlzdWJqZWN0ID0gc3Vi anRtcGwgJiAiIChyZWFkIGVycm9ycykiCiAJYm9keSA9CSJFcnJvcnMgb2NjdXJyZWQgcmVh ZGluZyBzb21lIGZpbGVzIG9yIGRpcmVjdG9yaWVzICIgJiBfCi0JCSJmb3IgYmFja3VwIG9u ICIgJiBob3N0bmFtZSAmICIuIiBfICYgdmJDckxmICYgXworCQkiZm9yIGJhY2t1cCBvbiAi ICYgaG9zdG5hbWUgJiAiLiIgJiB2YkNyTGYgJiBfCiAJCXZiQ3JMZiAmIF8KIAkJIj09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09IiAmIHZiQ3JMZiAmIF8KIAkJIlRIRVNF IEZJTEVTIEFSRSBOT1QgQkVJTkcgQkFDS0VEIFVQIiAmIHZiQ3JMZiAmIF8KQEAgLTU1LDcg KzU1LDcgQEANCiAJCSJpbmZvcm1hdGlvbiBhYm91dCB0aGUgZXJyb3IsICIgJiB2YkNyTGYg JiBfCiAJCSJhbmQgdGFrZSBhcHByb3ByaWF0ZSBhY3Rpb24uIiAmIHZiQ3JMZgogCVNlbmRN YWlsIGZyb20sc2VuZHRvLHN1YmplY3QsYm9keQotRWxzZUlmIGFyZ3MoMCkgPSAiYmFja3Vw LXN0YXJ0IiBPciBhcmdzKDApID0gImJhY2t1cC1maW5pc2giIFRoZW4KK0Vsc2VJZiBhcmdz KDApID0gImJhY2t1cC1zdGFydCIgT3IgYXJncygwKSA9ICJiYWNrdXAtZmluaXNoIiBPciBh cmdzKDApID0gImJhY2t1cC1vayIgVGhlbgogCScgZG8gbm90aGluZyBmb3IgdGhlc2UgbWVz c2FnZXMgYnkgZGVmYXVsdAogRWxzZQogCXN1YmplY3QgPSBzdWJqdG1wbCAmICIgKHVua25v d24pIgo= --------------050202090804020408080401-- From boxbackup at boxbackup.org Sat Nov 29 12:01:26 2008 From: boxbackup at boxbackup.org (Chris Wilson) Date: Sat, 29 Nov 2008 12:01:26 +0000 (GMT) Subject: [Box Backup] Eventlog full with warnings In-Reply-To: <49312486.8050801@hostingbrothers.nl> References: <491419C9.1060500@hostingbrothers.nl> <4914CD60.4090301@hostingbrothers.nl> <491837C8.60303@hostingbrothers.nl> <491953C1.3080406@hostingbrothers.nl> <491AB8B6.3060804@hostingbrothers.nl> <491B2A76.4060102@hostingbrothers.nl> <491B5B1B.8050908@hostingbrothers.nl> <492402E8.9030000@hostingbrothers.nl> <4924994F.8080006@hostingbrothers.nl> <49249C2E.7010602@hostingbrothers.nl> <49312486.8050801@hostingbrothers.nl> Message-ID: Hi Roy, On Sat, 29 Nov 2008, Roy wrote: > > > Another thing that would be really helpful is to have a debug log file > > > where both the initial run (when the IDs are stored in the mapping > > > database) and the subsequent run (where those IDs are used to detect moved > > > files) in the same file. You've sent me two separate log files already but > > > I don't know whether there were any intervening runs or what could have > > > happened in the time between those logs. > > > > Initial run, is the first run when the service starts? I will start logging > > again... > > > > > It's just a warning message, which was previously ignored. It could well > > > be a false alarm. > > > > Maybe on Saturday I will upgrade a Windows 2003 server to this version. I > > will monitor the eventlog. > > I updated a Windows 2003 server machine with the 2368 build (same one as > on my workstation) and got the same problems. Bot machines are upgraded > from build 1857. I started without the old StoreObjectInfoFile (so BB > had to create a new one). First run is clean and on the second run I got > a lot of errors. Thanks, could you send me the logs from one of these machines for both runs? > I also made a diff file for two of the errors in the notifyscript. I > don't know if they are allready solved or not, because they are > generated by the build system. Thanks, but I think I already fixed them in the trunk. The Windows script is not generated by the install system, which I think is what you meant instead of build system, as there is no install system to generate it. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | Stop nuclear war http://www.nuclearrisk.org |