From boxbackup at fluffy.co.uk Fri Jun 1 16:07:19 2007 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Fri, 01 Jun 2007 17:07:19 +0200 Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> Message-ID: <46603627.2040102@kontrapunkt.com> Hi Chris. Running ./bootstrap on my OS X system gives me: aclocal: cannot open > aclocal.m4: Permission denied at /usr/bin/aclocal line 459 This is on the system I used to compile the running bb 0.10. Tobias Chris Wilson wrote: > Hi Tobias, > > On Wed, 30 May 2007, Tobias Balle-Petersen wrote: > >> I have checked out your merge tree. There is no configure file. How do >> I compile? > > Run ./bootstrap, that will create the configure script. > > Cheers, Chris. From boxbackup at fluffy.co.uk Fri Jun 1 22:32:16 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Fri, 1 Jun 2007 22:32:16 +0100 (BST) Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: <46603627.2040102@kontrapunkt.com> References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> Message-ID: Hi Tobias, On Fri, 1 Jun 2007, Tobias Balle-Petersen wrote: > Running ./bootstrap on my OS X system gives me: > aclocal: cannot open > aclocal.m4: Permission denied > at /usr/bin/aclocal line 459 Please check permissions on the directory and all files inside it. They should all be owned by the user that you run ./bootstrap as. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Sat Jun 2 12:40:12 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Sat, 2 Jun 2007 12:40:12 +0100 (BST) Subject: [Box Backup] problem with raidfile In-Reply-To: <7C8A82BE-4931-42C3-8ECB-5A1455865187@beryllium.net> References: <7C8A82BE-4931-42C3-8ECB-5A1455865187@beryllium.net> Message-ID: Hi Remco, On Tue, 29 May 2007, Remco Poelstra wrote: > I've boxbackup 0.10 running on my Debian system. It worked fine until > there was a power outage. It now gives the error: while housekeeping > account 1, exception RaidFile RaidFileDoesntExist (2/11) -- aborting. > > How can I fix that? As far as I can see everything is fine. bbstoreaccounts 1 check fix. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Sat Jun 2 22:49:07 2007 From: boxbackup at fluffy.co.uk (Remco Poelstra) Date: Sat, 02 Jun 2007 23:49:07 +0200 Subject: [Box Backup] problem with raidfile In-Reply-To: References: <7C8A82BE-4931-42C3-8ECB-5A1455865187@beryllium.net> Message-ID: <4661E5D3.6080205@beryllium.net> Chris Wilson schreef: > Hi Remco, > > On Tue, 29 May 2007, Remco Poelstra wrote: > >> I've boxbackup 0.10 running on my Debian system. It worked fine until >> there was a power outage. It now gives the error: while housekeeping >> account 1, exception RaidFile RaidFileDoesntExist (2/11) -- aborting. >> >> How can I fix that? As far as I can see everything is fine. > > bbstoreaccounts 1 check fix. Thanks. That seems to solve the raidfile problem. Strange way of boxbackup to tell of such a problem. The problem is now that bbackupquery connects fine to the store,but the bbackup daemon gives an 7/34 error in the syslog on the server. The website states that this error should get cleared automatically, but appears not. How can I fix that? Thanks in advance, Remco Poelstra From boxbackup at fluffy.co.uk Sun Jun 3 10:31:31 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Sun, 3 Jun 2007 10:31:31 +0100 (BST) Subject: [Box Backup] problem with raidfile In-Reply-To: <4661E5D3.6080205@beryllium.net> References: <7C8A82BE-4931-42C3-8ECB-5A1455865187@beryllium.net> <4661E5D3.6080205@beryllium.net> Message-ID: Hi Remco, On Sat, 2 Jun 2007, Remco Poelstra wrote: > Thanks. That seems to solve the raidfile problem. Strange way of > boxbackup to tell of such a problem. I've improved this error message in the trunk, it now tells you to run a check on the store. > The problem is now that bbackupquery connects fine to the store,but the > bbackup daemon gives an 7/34 error in the syslog on the server. The > website states that this error should get cleared automatically, but > appears not. How can I fix that? Can you give some more details about your problem? What platform and version are your running on both sides? Did you compile Box Backup yourself or use a package? Does bbackupd disconnect immediately or some time after connecting? Could you turn on ExtendedLogging on the client and tell us the last few lines of output before the exception? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Sun Jun 3 11:27:49 2007 From: boxbackup at fluffy.co.uk (Remco Poelstra) Date: Sun, 03 Jun 2007 12:27:49 +0200 Subject: [Box Backup] problem with raidfile In-Reply-To: References: <7C8A82BE-4931-42C3-8ECB-5A1455865187@beryllium.net> <4661E5D3.6080205@beryllium.net> Message-ID: <466297A5.7070708@beryllium.net> Chris Wilson schreef: > Hi Remco, > > On Sat, 2 Jun 2007, Remco Poelstra wrote: > >> Thanks. That seems to solve the raidfile problem. Strange way of >> boxbackup to tell of such a problem. > > I've improved this error message in the trunk, it now tells you to run a > check on the store. > >> The problem is now that bbackupquery connects fine to the store,but >> the bbackup daemon gives an 7/34 error in the syslog on the server. >> The website states that this error should get cleared automatically, >> but appears not. How can I fix that? > > Can you give some more details about your problem? What platform and > version are your running on both sides? Did you compile Box Backup > yourself or use a package? Does bbackupd disconnect immediately or some > time after connecting? Could you turn on ExtendedLogging on the client > and tell us the last few lines of output before the exception? Ok, there is something stupid with the ps command on the Mac. Turns out I was running the client twice, but a `ps aux | grep bb` only showed one of the two, which is why I didn't notice. The second instance had a longer commandline (it included the full path) and ps truncated the commandstring to the terminal width, so the bbackup part was truncated, hence grep didn't show it. Seems that solved the problem. Thanks for your support, Remco Poelstra From boxbackup at fluffy.co.uk Sun Jun 3 14:55:39 2007 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Sun, 03 Jun 2007 15:55:39 +0200 Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> Message-ID: <4662C85B.6000000@kontrapunkt.com> Hello Chris. The directory meaning the directory with the source code right? I am the owner of everything in that folder. Tobias Chris Wilson wrote: > Hi Tobias, > > On Fri, 1 Jun 2007, Tobias Balle-Petersen wrote: > >> Running ./bootstrap on my OS X system gives me: >> aclocal: cannot open > aclocal.m4: Permission denied >> at /usr/bin/aclocal line 459 > > Please check permissions on the directory and all files inside it. They > should all be owned by the user that you run ./bootstrap as. > > Cheers, Chris. From boxbackup at fluffy.co.uk Sun Jun 3 15:31:45 2007 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Sun, 03 Jun 2007 16:31:45 +0200 Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: <4662C85B.6000000@kontrapunkt.com> References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> <4662C85B.6000000@kontrapunkt.com> Message-ID: <4662D0D1.3060508@kontrapunkt.com> Hello again. Realized you meant the dir with /usr/bin/aclocal. Enabled root on my (Mac OS X) machine and it ran fine. When it's done, I run bsdmake in the same dir and I get: test -d parcels/boxbackup-chris_merge_1693-backup-client-darwin8.7.0 || mkdir parcels/boxbackup-chris_merge_1693-backup-client-darwin8.7.0 (cd bin/bbackupd; bsdmake -D RELEASE) (cd ../../lib/common; bsdmake -D RELEASE -D NODEPS) g++ -DNDEBUG -O2 -Wall -DBOX_VERSION="\"chris_merge_1693\"" -g -Wall -c EventWatchFilesystemObject.cpp -o ../../release/lib/common/EventWatchFilesystemObject.o EventWatchFilesystemObject.cpp: In constructor 'EventWatchFilesystemObject::EventWatchFilesystemObject(const char*)': EventWatchFilesystemObject.cpp:41: error: 'errno' was not declared in this scope *** Error code 1 Stop in /Users/kpadmin/Documents/boxbackup/cris_merge_2007.05.30/merge/lib/common. *** Error code 1 Stop. *** Error code 1 Stop in /Users/kpadmin/Documents/boxbackup/cris_merge_2007.05.30/merge. b08-tbp-kp:/Users/kpadmin/Documents/boxbackup/cris_merge_2007.05.30/merge root# changing dir to bin/bbackupd/ and then running bsdmake returns: (cd ../../lib/common; bsdmake -D NODEPS) g++ -g -Wall -DBOX_VERSION="\"chris_merge_1693\"" -g -Wall -c autogen_CommonException.cpp -o ../../debug/lib/common/autogen_CommonException.o g++ -g -Wall -DBOX_VERSION="\"chris_merge_1693\"" -g -Wall -c autogen_ConversionException.cpp -o ../../debug/lib/common/autogen_ConversionException.o g++ -g -Wall -DBOX_VERSION="\"chris_merge_1693\"" -g -Wall -c ConversionString.cpp -o ../../debug/lib/common/ConversionString.o g++ -g -Wall -DBOX_VERSION="\"chris_merge_1693\"" -g -Wall -c EventWatchFilesystemObject.cpp -o ../../debug/lib/common/EventWatchFilesystemObject.o EventWatchFilesystemObject.cpp: In constructor 'EventWatchFilesystemObject::EventWatchFilesystemObject(const char*)': EventWatchFilesystemObject.cpp:41: error: 'errno' was not declared in this scope *** Error code 1 Stop in /Users/kpadmin/Documents/boxbackup/cris_merge_2007.05.30/merge/lib/common. *** Error code 1 Stop. Tobias Tobias Balle-Petersen wrote: > Hello Chris. > > The directory meaning the directory with the source code right? I am the owner of everything in that > folder. > > Tobias > > Chris Wilson wrote: >> Hi Tobias, >> >> On Fri, 1 Jun 2007, Tobias Balle-Petersen wrote: >> >>> Running ./bootstrap on my OS X system gives me: >>> aclocal: cannot open > aclocal.m4: Permission denied >>> at /usr/bin/aclocal line 459 >> Please check permissions on the directory and all files inside it. They >> should all be owned by the user that you run ./bootstrap as. >> >> Cheers, Chris. > > _______________________________________________ > boxbackup mailing list > boxbackup at fluffy.co.uk > http://lists.warhead.org.uk/mailman/listinfo/boxbackup > From boxbackup at fluffy.co.uk Sun Jun 3 15:33:29 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Sun, 3 Jun 2007 15:33:29 +0100 (BST) Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: <4662C85B.6000000@kontrapunkt.com> References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> <4662C85B.6000000@kontrapunkt.com> Message-ID: Hi Tobias, > The directory meaning the directory with the source code right? I am the > owner of everything in that folder. > >> On Fri, 1 Jun 2007, Tobias Balle-Petersen wrote: >> >>> Running ./bootstrap on my OS X system gives me: >>> aclocal: cannot open > aclocal.m4: Permission denied >>> at /usr/bin/aclocal line 459 For some reason that's not entirely clear to me, aclocal can't create the file called aclocal.m4 in the directory where you are running it. I can only think that that's some kind of permissions issue on the directory itself. Can you create such a file manually, e.g. by touching it? What are the actual permissions on the directory? What does "ls -ld ." show? If you cannot create files in that directory, you will definitely not be able to build Box Backup until you fix it. Even if it's just the aclocal.m4 file, you must still be able to overwrite it. If nothing else helps, please could you try downloading a fresh copy of the source into a new directory and running ./bootstrap, doing everything with the same user account (not root). Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Sun Jun 3 15:36:45 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Sun, 3 Jun 2007 15:36:45 +0100 (BST) Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: <4662D0D1.3060508@kontrapunkt.com> References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> <4662C85B.6000000@kontrapunkt.com> <4662D0D1.3060508@kontrapunkt.com> Message-ID: Hi Tobias, > EventWatchFilesystemObject.cpp: In constructor > 'EventWatchFilesystemObject::EventWatchFilesystemObject(const char*)': > EventWatchFilesystemObject.cpp:41: error: 'errno' was not declared in this scope Thanks, fixed now, please svn update and try again? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Mon Jun 4 09:14:20 2007 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Mon, 04 Jun 2007 10:14:20 +0200 Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> <4662C85B.6000000@kontrapunkt.com> <4662D0D1.3060508@kontrapunkt.com> Message-ID: <4663C9DC.1050509@kontrapunkt.com> Hello Chris. Get the files: svn co http://bbdev.fluffy.co.uk/svn/box/chris/merge/ # Checked out revision 1694. Enter dir with source. Run bootstrap (as non root): ./bootstrap Ran OK this time. Run configure: ./configure ........... ........... ........... test/backupstore test/backupstorefix test/backupstorepatch test/backupdiff test/bbackupd Type 'cd ; bsdmake' to build a module A summary of the build configuration is below. Box Backup will function without these features, but will work better where they are present. Refer to the documentation for more information on each feature. Regular expressions: yes Large files: yes Berkeley DB: no Readline: no Extended attributes: yes Staying in the dir I run bsdmake to compile everything: bsdmake ........... ........... ........... X_VERSION="\"chris_merge_1694\"" -g -Wall -c bbstoreaccounts.cpp -o ../../release/bin/bbstoreaccounts/bbstoreaccounts.o g++ -o ../../release/bin/bbstoreaccounts/bbstoreaccounts ../../release/bin/bbstoreaccounts/bbstoreaccounts.o ../../release/lib/backupstore/backupstore.a ../../release/lib/raidfile/raidfile.a ../../release/lib/backupclient/backupclient.a ../../release/lib/server/server.a ../../release/lib/crypto/crypto.a ../../release/lib/compress/compress.a ../../release/lib/common/common.a -lcrypto -lssl -lz cp release/bin/bbstoreaccounts/bbstoreaccounts parcels/boxbackup-chris_merge_1694-backup-server-darwin8.7.0 cp bin/bbstored/bbstored-certs parcels/boxbackup-chris_merge_1694-backup-server-darwin8.7.0 cp bin/bbstored/bbstored-config parcels/boxbackup-chris_merge_1694-backup-server-darwin8.7.0 cp lib/raidfile/raidfile-config parcels/boxbackup-chris_merge_1694-backup-server-darwin8.7.0 cp parcels/scripts/install-backup-server parcels/boxbackup-chris_merge_1694-backup-server-darwin8.7.0 (cd parcels; tar cf - boxbackup-chris_merge_1694-backup-server-darwin8.7.0 | gzip -9 - > boxbackup-chris_merge_1694-backup-server-darwin8.7.0.tgz ) So everything looks allright..... Can I just run the version of bbackupd in the parcels dir instead of my older bbackupd to test this newer version? Whar are the consequenses of this?: Berkeley DB: no Thanks, Tobias Chris Wilson wrote: > Hi Tobias, > >> EventWatchFilesystemObject.cpp: In constructor >> 'EventWatchFilesystemObject::EventWatchFilesystemObject(const char*)': >> EventWatchFilesystemObject.cpp:41: error: 'errno' was not declared in >> this scope > > Thanks, fixed now, please svn update and try again? > > Cheers, Chris. From boxbackup at fluffy.co.uk Mon Jun 4 09:40:20 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Mon, 4 Jun 2007 09:40:20 +0100 (BST) Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: <4663C9DC.1050509@kontrapunkt.com> References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> <4662C85B.6000000@kontrapunkt.com> <4662D0D1.3060508@kontrapunkt.com> <4663C9DC.1050509@kontrapunkt.com> Message-ID: Hi Tobias, On Mon, 4 Jun 2007, Tobias Balle-Petersen wrote: > So everything looks allright..... Yes, looks like it worked this time. > Can I just run the version of bbackupd in the parcels dir instead of my > older bbackupd to test this newer version? Yes. > Whar are the consequenses of this?: > Berkeley DB: no No inode database, so file renames will not be tracked across bbackupd shutdowns. Probably not a huge deal unless you rename big files a lot. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Mon Jun 4 09:45:12 2007 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Mon, 04 Jun 2007 10:45:12 +0200 Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> <4662C85B.6000000@kontrapunkt.com> <4662D0D1.3060508@kontrapunkt.com> <4663C9DC.1050509@kontrapunkt.com> Message-ID: <4663D118.4060900@kontrapunkt.com> Hi Chris. Sounds good. I'll run this version of bbackupd on a MAC OS X and a Red Hat machine. I'll report back. Tobias Chris Wilson wrote: > Hi Tobias, > > On Mon, 4 Jun 2007, Tobias Balle-Petersen wrote: > >> So everything looks allright..... > > Yes, looks like it worked this time. > >> Can I just run the version of bbackupd in the parcels dir instead of >> my older bbackupd to test this newer version? > > Yes. > >> Whar are the consequenses of this?: >> Berkeley DB: no > > No inode database, so file renames will not be tracked across bbackupd > shutdowns. Probably not a huge deal unless you rename big files a lot. > > Cheers, Chris. From boxbackup at fluffy.co.uk Mon Jun 4 10:09:09 2007 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Mon, 04 Jun 2007 11:09:09 +0200 Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> <4662C85B.6000000@kontrapunkt.com> <4662D0D1.3060508@kontrapunkt.com> <4663C9DC.1050509@kontrapunkt.com> Message-ID: <4663D6B5.4070807@kontrapunkt.com> Hello Chris. Trying to run the new 1694 bbackupd on my OS X machine gives me: /usr/local/bin/bbackupd_1694 /etc/box_misora/bbackupd.conf Unknown parameter on command line: '/etc/box_misora/bbackupd.conf' Tobias Chris Wilson wrote: > Hi Tobias, > > On Mon, 4 Jun 2007, Tobias Balle-Petersen wrote: > >> So everything looks allright..... > > Yes, looks like it worked this time. > >> Can I just run the version of bbackupd in the parcels dir instead of >> my older bbackupd to test this newer version? > > Yes. > >> Whar are the consequenses of this?: >> Berkeley DB: no > > No inode database, so file renames will not be tracked across bbackupd > shutdowns. Probably not a huge deal unless you rename big files a lot. > > Cheers, Chris. From boxbackup at fluffy.co.uk Mon Jun 4 10:18:52 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Mon, 4 Jun 2007 10:18:52 +0100 (BST) Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: <4663D6B5.4070807@kontrapunkt.com> References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> <4662C85B.6000000@kontrapunkt.com> <4662D0D1.3060508@kontrapunkt.com> <4663C9DC.1050509@kontrapunkt.com> <4663D6B5.4070807@kontrapunkt.com> Message-ID: Hi TObias, Thanks, try with "-c" to specify the config file. I've reworked the option handling and some old ways of doing things no longer work, will look into it. Cheers, Chris. On Mon, 4 Jun 2007, Tobias Balle-Petersen wrote: > Hello Chris. > > Trying to run the new 1694 bbackupd on my OS X machine gives me: > > /usr/local/bin/bbackupd_1694 /etc/box_misora/bbackupd.conf > > Unknown parameter on command line: '/etc/box_misora/bbackupd.conf' > > > Tobias > > > > Chris Wilson wrote: >> Hi Tobias, >> >> On Mon, 4 Jun 2007, Tobias Balle-Petersen wrote: >> >>> So everything looks allright..... >> >> Yes, looks like it worked this time. >> >>> Can I just run the version of bbackupd in the parcels dir instead of >>> my older bbackupd to test this newer version? >> >> Yes. >> >>> Whar are the consequenses of this?: >>> Berkeley DB: no >> >> No inode database, so file renames will not be tracked across bbackupd >> shutdowns. Probably not a huge deal unless you rename big files a lot. >> >> Cheers, Chris. > > _______________________________________________ > boxbackup mailing list > boxbackup at fluffy.co.uk > http://lists.warhead.org.uk/mailman/listinfo/boxbackup > > > !DSPAM:4663d729252771598617033! > -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Mon Jun 4 10:28:47 2007 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Mon, 04 Jun 2007 11:28:47 +0200 Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> <4662C85B.6000000@kontrapunkt.com> <4662D0D1.3060508@kontrapunkt.com> <4663C9DC.1050509@kontrapunkt.com> <4663D6B5.4070807@kontrapunkt.com> Message-ID: <4663DB4F.4040805@kontrapunkt.com> Hello again. This is what happens using -c: /usr/local/bin/bbackupd_1694 -c /etc/box_misora/bbackupd.conf Unknown parameter on command line: '-c' Tobias Chris Wilson wrote: > Hi TObias, > > Thanks, try with "-c" to specify the config file. I've reworked the > option handling and some old ways of doing things no longer work, will > look into it. > > Cheers, Chris. > > On Mon, 4 Jun 2007, Tobias Balle-Petersen wrote: > >> Hello Chris. >> >> Trying to run the new 1694 bbackupd on my OS X machine gives me: >> >> /usr/local/bin/bbackupd_1694 /etc/box_misora/bbackupd.conf >> >> Unknown parameter on command line: '/etc/box_misora/bbackupd.conf' >> >> >> Tobias >> >> >> >> Chris Wilson wrote: >>> Hi Tobias, >>> >>> On Mon, 4 Jun 2007, Tobias Balle-Petersen wrote: >>> >>>> So everything looks allright..... >>> >>> Yes, looks like it worked this time. >>> >>>> Can I just run the version of bbackupd in the parcels dir instead of >>>> my older bbackupd to test this newer version? >>> >>> Yes. >>> >>>> Whar are the consequenses of this?: >>>> Berkeley DB: no >>> >>> No inode database, so file renames will not be tracked across bbackupd >>> shutdowns. Probably not a huge deal unless you rename big files a lot. >>> >>> Cheers, Chris. >> >> _______________________________________________ >> boxbackup mailing list >> boxbackup at fluffy.co.uk >> http://lists.warhead.org.uk/mailman/listinfo/boxbackup >> >> >> !DSPAM:4663d729252771598617033! >> > From boxbackup at fluffy.co.uk Mon Jun 4 22:16:42 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Mon, 4 Jun 2007 22:16:42 +0100 (BST) Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: <4663DB4F.4040805@kontrapunkt.com> References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> <4662C85B.6000000@kontrapunkt.com> <4662D0D1.3060508@kontrapunkt.com> <4663C9DC.1050509@kontrapunkt.com> <4663D6B5.4070807@kontrapunkt.com> <4663DB4F.4040805@kontrapunkt.com> Message-ID: Hi Tobias, > Hello again. > > This is what happens using -c: /usr/local/bin/bbackupd_1694 -c > /etc/box_misora/bbackupd.conf > > Unknown parameter on command line: '-c' Thanks for pointing that out! It should be fixed now, please could you svn update && make clean && make? Cheers, Chris. -- _ ___ __ _ / __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Tue Jun 5 12:11:50 2007 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Tue, 05 Jun 2007 13:11:50 +0200 Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> <4662C85B.6000000@kontrapunkt.com> <4662D0D1.3060508@kontrapunkt.com> <4663C9DC.1050509@kontrapunkt.com> <4663D6B5.4070807@kontrapunkt.com> <4663DB4F.4040805@kontrapunkt.com> Message-ID: <466544F6.2020107@kontrapunkt.com> Hello Chris. Your latest version started up this time with the command: /usr/local/bin/bbackupd_1696 -c /etc/box_misora/bbackupd.conf Now, I need to check the ability to backup 2GB+ files. Do I need to do anything special? I seem to remember you telling someone with the same problem to manually delete the 2GB+ files from the store. Please advice. Thanks, Tobias Chris Wilson wrote: > Hi Tobias, > >> Hello again. >> >> This is what happens using -c: /usr/local/bin/bbackupd_1694 -c >> /etc/box_misora/bbackupd.conf >> >> Unknown parameter on command line: '-c' > > Thanks for pointing that out! It should be fixed now, please could you > svn update && make clean && make? > > Cheers, Chris. From boxbackup at fluffy.co.uk Tue Jun 5 13:14:34 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Tue, 5 Jun 2007 13:14:34 +0100 (BST) Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: <466544F6.2020107@kontrapunkt.com> References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> <4662C85B.6000000@kontrapunkt.com> <4662D0D1.3060508@kontrapunkt.com> <4663C9DC.1050509@kontrapunkt.com> <4663D6B5.4070807@kontrapunkt.com> <4663DB4F.4040805@kontrapunkt.com> <466544F6.2020107@kontrapunkt.com> Message-ID: Hi Tobias, > Your latest version started up this time with the command: > /usr/local/bin/bbackupd_1696 -c /etc/box_misora/bbackupd.conf Cool, glad it worked at last! > Now, I need to check the ability to backup 2GB+ files. Do I need to do > anything special? I seem to remember you telling someone with the same > problem to manually delete the 2GB+ files from the store. Please advice. I don't think there's an explicit command to delete a file on the store. Can you rename the file? If so, please do it while bbackupd is NOT running, and it will be uploaded again, hopefully properly this time. Cheers, Chris. -- _ ___ __ _ / __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Tue Jun 5 15:20:22 2007 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Tue, 05 Jun 2007 16:20:22 +0200 Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> <4662C85B.6000000@kontrapunkt.com> <4662D0D1.3060508@kontrapunkt.com> <4663C9DC.1050509@kontrapunkt.com> <4663D6B5.4070807@kontrapunkt.com> <4663DB4F.4040805@kontrapunkt.com> <466544F6.2020107@kontrapunkt.com> Message-ID: <46657126.9000202@kontrapunkt.com> Hello Chris. Chris Wilson wrote: > I don't think there's an explicit command to delete a file on the store. > Can you rename the file? If so, please do it while bbackupd is NOT > running, and it will be uploaded again, hopefully properly this time. Doesnt boxbackup track files to avoid the reupload of renamed but otherwise identical files? I have made a copy of the file and renamed it. Will report back on result of restore of the file. Thanks, Tobias From boxbackup at fluffy.co.uk Tue Jun 5 18:42:21 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Tue, 5 Jun 2007 18:42:21 +0100 (BST) Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: <46657126.9000202@kontrapunkt.com> References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> <4662C85B.6000000@kontrapunkt.com> <4662D0D1.3060508@kontrapunkt.com> <4663C9DC.1050509@kontrapunkt.com> <4663D6B5.4070807@kontrapunkt.com> <4663DB4F.4040805@kontrapunkt.com> <466544F6.2020107@kontrapunkt.com> <46657126.9000202@kontrapunkt.com> Message-ID: Hi Tobias, On Tue, 5 Jun 2007, Tobias Balle-Petersen wrote: > Chris Wilson wrote: >> I don't think there's an explicit command to delete a file on the store. >> Can you rename the file? If so, please do it while bbackupd is NOT >> running, and it will be uploaded again, hopefully properly this time. > > Doesnt boxbackup track files to avoid the reupload of renamed but > otherwise identical files? Yes, but it doesn't work when Box Backup is built without Berkeley database support (which I think you said is the case for you) and when Box Backup is shut down, which is why I asked you to shut it down before renaming. > I have made a copy of the file and renamed it. Will report back on > result of restore of the file. OK, that will work just as well. Cheers, Chris. -- _ ___ __ _ / __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Fri Jun 8 11:21:08 2007 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Fri, 08 Jun 2007 12:21:08 +0200 Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> <4662C85B.6000000@kontrapunkt.com> <4662D0D1.3060508@kontrapunkt.com> <4663C9DC.1050509@kontrapunkt.com> <4663D6B5.4070807@kontrapunkt.com> <4663DB4F.4040805@kontrapunkt.com> <466544F6.2020107@kontrapunkt.com> <46657126.9000202@kontrapunkt.com> Message-ID: <46692D94.1090301@kontrapunkt.com> Hello Chris. I have tested backing up a 2GB+ file with a 0.10 store on OS X and your version 1694 of bbackupd on a Red Hat system. Unfortunately the results were not good. Maybe you can shed light on the problem? Please see the results of my tests below: Restore of a 2GB+ file: -------------------------------------- query > ls 00001033 -d---- .kde 0000103d f----- .gtkrc 0000103e f----- .bash_history 0000103f f----- .bash_logout 00001040 f----- .canna 00001041 f----- .bashrc 00001042 f----- .emacs 00001043 f----- .bash_profile 00001044 f----- .zshrc 00001059 f----- Unit.zip query > get -i 00001059 unit.restore.zip Failed to fetch file: Connection TLSReadFailed (Probably a network issue between client and server, or a problem with the server.) query > ls Exception: Connection TLSReadFailed (Probably a network issue between client and server, or a problem with the server.) (7/34) -------------------------------------- query > get Unit.zip unit.restore.zip Failed to fetch file: Connection TLSReadFailed (Probably a network issue between client and server, or a problem with the server.) query > ls Exception: Connection TLSReadFailed (Probably a network issue between client and server, or a problem with the server.) (7/34) -------------------------------------- query > getobject 00001059 unit.restore.zip Object ID 00001059 fetched successfully. query > exit Logging off... Session finished. -------------------------------------- Now, I'll check the original file and the restored file: md5sum unit.restore.zip -> 2ca0ec94494efff9f6063667f86a3434 md5sum Unit.zip -> 15626af50a3785d3cbe632b4623731a4 I'll also check the size of the files: unit.restore.zip -> 2190251829 Unit.zip -> 2196637554 I'll try to unzip the restored file: unzip unit.restore.zip Archive: unit.restore.zip End-of-central-directory signature not found. Either this file is not a zipfile, or it constitutes one disk of a multi-part archive. In the latter case the central directory and zipfile comment will be found on the last disk(s) of this archive. unzip: cannot find zipfile directory in one of unit.restore.zip or unit.restore.zip.zip, and cannot find unit.restore.zip.ZIP, period. Thank you, Tobias From boxbackup at fluffy.co.uk Fri Jun 8 10:37:17 2007 From: boxbackup at fluffy.co.uk (Baltasar Cevc) Date: Fri, 8 Jun 2007 11:37:17 +0200 Subject: [Box Backup] error fixing account after server crash Message-ID: This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --Apple-Mail-7--1022708806 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Hi, I've got an boxbackup server which crashed a few days ago; now I'm trying to resume backups. As the link is quite slow I'd rather reuse the data that's already on the server. However, I'm unable to fix one of the accounts with bbstoreaccounts. It's the second time I run into this error, so I thought it would be worth asking... Permissions seem correct to mee (everything owned by bbstored:bbstored). Do you have any hints? I've tried to compile a debug version and find the error using it, but I've got an "assertation failed" error there. Thanx a lot, Baltasar root at bak:~# bbstoreaccounts check 3 Check store account ID 00000003 Phase 1, check objects... Phase 2, check directories... Phase 3, check root... Root directory doesn't exist Phase 4, fix unattached objects... Phase 5, fix unrecovered inconsistencies... Phase 6, regenerate store info... Load of existing store info failed, regenerating. NOTE: Soft limit for account changed to ensure housekeeping doesn't delete files on next run NOTE: Hard limit for account changed to ensure housekeeping doesn't delete files on next run 2 errors found NOTE: No changes to the store account have been made. Run again with fix option to fix these errors You should now use bbackupquery on the client machine to examine the store. root at bak:~# ----------------------- root at bak:~# bbstoreaccounts check 3 fix NOTE: Will fix errors encountered during checking. Check store account ID 00000003 Phase 1, check objects... Phase 2, check directories... Phase 3, check root... Root directory doesn't exist Exception: RaidFile CannotOverwriteExistingFile (2/4) ----------------------- debug version output root at bak:~# bbstoreaccounts-debug check 3 fix NOTE: Will fix errors encountered during checking. Check store account ID 00000003 Phase 1, check objects... Max dir starting ID is 0 Phase 2, check directories... Phase 3, check root... ASSERT FAILED: [pblock != 0] at BackupStoreCheckData.cpp(182) Obtained 8 stack frames. bbstoreaccounts-debug [0x8080c6d] bbstoreaccounts-debug [0x805f458] bbstoreaccounts-debug [0x8056e7b] bbstoreaccounts-debug [0x8050a69] bbstoreaccounts-debug [0x804b4b4] bbstoreaccounts-debug [0x804d19e] /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xc8) [0xb7ae9ea8] bbstoreaccounts-debug(__gxx_personality_v0+0xf9) [0x804afd1] Exception thrown: CommonException(AssertFailed) at BackupStoreCheckData.cpp(182) Exception: Common AssertFailed (1/1) ----------------------- strace output (left out the first lines, as the output's quite long) ... write(1, "Check store account ID 00000003\n"..., 58Check store account ID 00000003 Phase 1, check objects... ) = 58 open("/backup/int-2/box//backup/00000003/", O_RDONLY|O_NONBLOCK| O_LARGEFILE|O_DIRECTORY) = 4 fstat64(4, {st_mode=S_IFDIR|0755, st_size=12288, ...}) = 0 fcntl64(4, F_SETFD, FD_CLOEXEC) = 0 getdents64(4, /* 128 entries */, 4096) = 4072 getdents64(4, /* 128 entries */, 4096) = 4088 getdents64(4, /* 169 entries */, 4096) = 4096 getdents64(4, /* 90 entries */, 4096) = 2160 getdents64(4, /* 0 entries */, 4096) = 0 close(4) = 0 stat64("/backup/int-2/box//backup/00000003", {st_mode=S_IFDIR|0755, st_size=12288, ...}) = 0 open("/backup/int-2/box//backup/00000003", O_RDONLY|O_NONBLOCK| O_LARGEFILE|O_DIRECTORY) = 4 fstat64(4, {st_mode=S_IFDIR|0755, st_size=12288, ...}) = 0 fcntl64(4, F_SETFD, FD_CLOEXEC) = 0 getdents64(4, /* 128 entries */, 4096) = 4072 getdents64(4, /* 128 entries */, 4096) = 4088 getdents64(4, /* 169 entries */, 4096) = 4096 getdents64(4, /* 90 entries */, 4096) = 2160 getdents64(4, /* 0 entries */, 4096) = 0 close(4) = 0 write(1, "Phase 2, check directories...\n", 30Phase 2, check directories... ) = 30 write(1, "Phase 3, check root...\n", 23Phase 3, check root... ) = 23 write(1, "Root directory doesn\'t exist\n", 29Root directory doesn't exist ) = 29 stat64("/backup/int-2/box//backup/00000003/", {st_mode=S_IFDIR|0755, st_size=12288, ...}) = 0 stat64("/backup/int-2/box//backup/00000003/o01.rfw", {st_mode=S_IFREG| 0644, st_size=96, ...}) = 0 close(3) = 0 getgid32() = 106 setresgid32(-1, 106, -1) = 0 getuid32() = 104 setresuid32(-1, 104, -1) = 0 write(1, "Exception: RaidFile CannotOverwr"..., 54Exception: RaidFile CannotOverwriteExistingFile (2/4) ) = 54 munmap(0xb7fbe000, 4096) = 0 exit_group(1) = ? Process 7217 detached ((( Baltasar Cevc ) World wide web: # http://www.openairkino.net/ (a project for the local youth; German only) # http://technik.juz-kirchheim.de/ (programming and admin projects) # http://baltasar.cevc-topp.de/ (private homepage) ) Phone: +49 176 23 22 08 22 ) --Apple-Mail-7--1022708806 content-type: application/pgp-signature; x-mac-type=70674453; name=PGP.sig content-description: This is a digitally signed message part content-disposition: inline; filename=PGP.sig content-transfer-encoding: 7bit -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (Darwin) iD8DBQFGaSNNp2YsmzTbIwYRApDAAKCVKUolUhuo+Su5ObVlXOZhGcoN1QCffZ4x rDVubBC5cB3Ve2iPOMcMcYM= =aAI0 -----END PGP SIGNATURE----- --Apple-Mail-7--1022708806-- From boxbackup at fluffy.co.uk Fri Jun 8 13:24:27 2007 From: boxbackup at fluffy.co.uk (Ricardo Kuznik - aciComputer) Date: Fri, 8 Jun 2007 14:24:27 +0200 Subject: [Box Backup] SSL problem Message-ID: <46694A7B.3070102@aci-anhalt.de> Hello List! I try to install boxbackup, but something is wrong with SSL (openSSL 0.9.7e is on both machines) Here are the commands, I executed: Server: raidfile-config /etc/box 4096 bbstored-config /etc/box 192.168.1.163 _bbstored bbstored-certs ca init bbstored-certs ca sign-server /etc/box/bbstored/192.168.1.163-csr.pem cp -a ca/servers/192.168.1.163-cert.pem /etc/box/bbstored/ cp -a ca/roots/clientCA.pem /etc/box/bbstored/ /usr/local/bin/bbstored /var/log/messages said: Jun 8 13:34:10 linux bbstored[8501]: Starting daemon (config: /etc/box/bbstored.conf) (version 0.10) Jun 8 13:34:10 linux bbstored/hk[8502]: Housekeeping process started Jun 8 13:34:10 linux bbstored/hk[8502]: Starting housekeeping Jun 8 13:34:10 linux bbstored/hk[8502]: Finished housekeeping I think it is everything OK. Then the Client: /usr/local/bin/bbackupd-config /etc/box lazy 115 192.168.1.163 / scp /etc/box/bbackupd/115-csr.pem 192.168.1.163:/ Server: bbstored-certs ca sign 1-csr.pem Client: scp 192.168.1.163:/ca/clients/115-cert.pem /etc/box/bbackupd scp 192.168.1.163:/ca/roots/serverCA.pem /etc/box/bbackupd /varlog/messages Jun 8 14:05:54 acimail3 bbackupd[13579]: Starting daemon (config: /etc/box/bbackupd.conf) (version 0.10) Jun 8 14:05:54 acimail3 bbackupd[13579]: Beginning scan of local files Jun 8 14:05:54 acimail3 bbackupd[13579]: Opening connection to server 192.168.1.163... Jun 8 14:05:55 acimail3 bbackupd[13579]: SSL err during Connect: error:14090086:SSL routines:SSL3_GET_SERVER_CERTIFICATE:certificate verify failed Jun 8 14:05:55 acimail3 bbackupd[13579]: Exception caught (Connection TLSHandshakeFailed 7/30), reset state and waiting to retry... Jun 8 14:06:05 acimail3 bbackupd[13579]: File statistics: total file size uploaded 0, bytes already on server 0, encoded size 0 Why failed the verifying? What did I wrong! Thank you for every feeddback and help! Greetings, R. Kuznik -- Mit freundlichen Gr??en, Ricardo Kuznik aci Computer Innovationsgesellschaft mbH Anhalt Tel.: 0340-26069-31 Fax: 0340-2400141 Mail: r.kuznik at aci-anhalt.de Web: www.aci-anhalt.de ------------------------------------------ Gesch?ftsf?hrer: Ing. J?rg Pl?tz, Dipl.-Phys. Joachim von Below Sitz: Seelmannstr. 2, 06847 Dessau Amtsgericht Stendal, HRB Nr. 14051 ------------------------------------------ ____________ Virus checked by G DATA AntiVirusKit Version: AVK 17.4039 from 17.04.2007 Virus news: www.antiviruslab.com From boxbackup at fluffy.co.uk Fri Jun 8 13:37:40 2007 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Fri, 08 Jun 2007 14:37:40 +0200 Subject: [Box Backup] SSL problem In-Reply-To: <46694A7B.3070102@aci-anhalt.de> References: <46694A7B.3070102@aci-anhalt.de> Message-ID: <46694D94.5010701@kontrapunkt.com> Hello. Make sure the time on the store and client are syncronized. Tobias Ricardo Kuznik - aciComputer wrote: > Hello List! > > I try to install boxbackup, but something is wrong with SSL (openSSL > 0.9.7e is on both machines) > > > Here are the commands, I executed: > Server: > raidfile-config /etc/box 4096 > bbstored-config /etc/box 192.168.1.163 _bbstored > bbstored-certs ca init > bbstored-certs ca sign-server /etc/box/bbstored/192.168.1.163-csr.pem > cp -a ca/servers/192.168.1.163-cert.pem /etc/box/bbstored/ > cp -a ca/roots/clientCA.pem /etc/box/bbstored/ > /usr/local/bin/bbstored > > > /var/log/messages said: > Jun 8 13:34:10 linux bbstored[8501]: Starting daemon (config: > /etc/box/bbstored.conf) (version 0.10) > Jun 8 13:34:10 linux bbstored/hk[8502]: Housekeeping process started > Jun 8 13:34:10 linux bbstored/hk[8502]: Starting housekeeping > Jun 8 13:34:10 linux bbstored/hk[8502]: Finished housekeeping > > I think it is everything OK. > > Then the Client: > > /usr/local/bin/bbackupd-config /etc/box lazy 115 192.168.1.163 / > scp /etc/box/bbackupd/115-csr.pem 192.168.1.163:/ > > Server: > bbstored-certs ca sign 1-csr.pem > > Client: > scp 192.168.1.163:/ca/clients/115-cert.pem /etc/box/bbackupd > scp 192.168.1.163:/ca/roots/serverCA.pem /etc/box/bbackupd > > /varlog/messages > > Jun 8 14:05:54 acimail3 bbackupd[13579]: Starting daemon (config: > /etc/box/bbackupd.conf) (version 0.10) > Jun 8 14:05:54 acimail3 bbackupd[13579]: Beginning scan of local files > Jun 8 14:05:54 acimail3 bbackupd[13579]: Opening connection to server > 192.168.1.163... > Jun 8 14:05:55 acimail3 bbackupd[13579]: SSL err during Connect: > error:14090086:SSL routines:SSL3_GET_SERVER_CERTIFICATE:certificate > verify failed > Jun 8 14:05:55 acimail3 bbackupd[13579]: Exception caught (Connection > TLSHandshakeFailed 7/30), reset state and waiting to retry... > Jun 8 14:06:05 acimail3 bbackupd[13579]: File statistics: total file > size uploaded 0, bytes already on server 0, encoded size 0 > > Why failed the verifying? What did I wrong! > > Thank you for every feeddback and help! > > Greetings, R. Kuznik > > From boxbackup at fluffy.co.uk Fri Jun 8 13:48:45 2007 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Fri, 08 Jun 2007 14:48:45 +0200 Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> <4662C85B.6000000@kontrapunkt.com> <4662D0D1.3060508@kontrapunkt.com> <4663C9DC.1050509@kontrapunkt.com> <4663D6B5.4070807@kontrapunkt.com> <4663DB4F.4040805@kontrapunkt.com> <466544F6.2020107@kontrapunkt.com> <46657126.9000202@kontrapunkt.com> Message-ID: <4669502D.2020707@kontrapunkt.com> Hello Chris. I just did a 2GB+ backup restore test on other two other machines with a Linux 0.10 store and an OS X merge_1696 bbackupd. I got the same results as before. The restored file is not correct. No errors are reported. Thanks, Tobias Chris Wilson wrote: > Hi Tobias, > > On Tue, 5 Jun 2007, Tobias Balle-Petersen wrote: > >> Chris Wilson wrote: >>> I don't think there's an explicit command to delete a file on the store. >>> Can you rename the file? If so, please do it while bbackupd is NOT >>> running, and it will be uploaded again, hopefully properly this time. >> >> Doesnt boxbackup track files to avoid the reupload of renamed but >> otherwise identical files? > > Yes, but it doesn't work when Box Backup is built without Berkeley > database support (which I think you said is the case for you) and when > Box Backup is shut down, which is why I asked you to shut it down before > renaming. > >> I have made a copy of the file and renamed it. Will report back on >> result of restore of the file. > > OK, that will work just as well. > > Cheers, Chris. From boxbackup at fluffy.co.uk Fri Jun 8 22:58:20 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Fri, 8 Jun 2007 22:58:20 +0100 (BST) Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: <46692D94.1090301@kontrapunkt.com> References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> <4662C85B.6000000@kontrapunkt.com> <4662D0D1.3060508@kontrapunkt.com> <4663C9DC.1050509@kontrapunkt.com> <4663D6B5.4070807@kontrapunkt.com> <4663DB4F.4040805@kontrapunkt.com> <466544F6.2020107@kontrapunkt.com> <46657126.9000202@kontrapunkt.com> <46692D94.1090301@kontrapunkt.com> Message-ID: Hi Tobias, Thanks very much for testing, and sorry to hear that you had problems! Unfortunately I'm just going away on holiday for 8 days, will look into it when I get back, sorry for the delay. Cheers, Chris. On Fri, 8 Jun 2007, Tobias Balle-Petersen wrote: > Hello Chris. > > I have tested backing up a 2GB+ file with a 0.10 store on OS X and your version 1694 of bbackupd on > a Red Hat system. > > Unfortunately the results were not good. Maybe you can shed light on the problem? > > Please see the results of my tests below: > > > Restore of a 2GB+ file: > > -------------------------------------- > query > ls > 00001033 -d---- .kde > 0000103d f----- .gtkrc > 0000103e f----- .bash_history > 0000103f f----- .bash_logout > 00001040 f----- .canna > 00001041 f----- .bashrc > 00001042 f----- .emacs > 00001043 f----- .bash_profile > 00001044 f----- .zshrc > 00001059 f----- Unit.zip > query > get -i 00001059 unit.restore.zip > Failed to fetch file: Connection TLSReadFailed (Probably a network issue between client and server, > or a problem with the server.) > query > ls > Exception: Connection TLSReadFailed (Probably a network issue between client and server, or a > problem with the server.) (7/34) > -------------------------------------- > query > get Unit.zip unit.restore.zip > Failed to fetch file: Connection TLSReadFailed (Probably a network issue between client and server, > or a problem with the server.) > query > ls > Exception: Connection TLSReadFailed (Probably a network issue between client and server, or a > problem with the server.) (7/34) > -------------------------------------- > query > getobject 00001059 unit.restore.zip > Object ID 00001059 fetched successfully. > query > exit > Logging off... > Session finished. > -------------------------------------- > > > Now, I'll check the original file and the restored file: > md5sum unit.restore.zip -> 2ca0ec94494efff9f6063667f86a3434 > md5sum Unit.zip -> 15626af50a3785d3cbe632b4623731a4 > > I'll also check the size of the files: > unit.restore.zip -> 2190251829 > Unit.zip -> 2196637554 > > I'll try to unzip the restored file: > unzip unit.restore.zip > Archive: unit.restore.zip > End-of-central-directory signature not found. Either this file is not > a zipfile, or it constitutes one disk of a multi-part archive. In the > latter case the central directory and zipfile comment will be found on > the last disk(s) of this archive. > unzip: cannot find zipfile directory in one of unit.restore.zip or > unit.restore.zip.zip, and cannot find unit.restore.zip.ZIP, period. > > > Thank you, > Tobias > > > > > > > > _______________________________________________ > boxbackup mailing list > boxbackup at fluffy.co.uk > http://lists.warhead.org.uk/mailman/listinfo/boxbackup > > > !DSPAM:46692e0c192116648012310! > -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Sat Jun 9 18:49:55 2007 From: boxbackup at fluffy.co.uk (Nick Brandon) Date: Sat, 09 Jun 2007 18:49:55 +0100 Subject: [Box Backup] Is BoxBackup suitable for single files? Message-ID: Hi, I've been reading the documentation on BoxBackup today to try to investigate if it is suitable for my scenario using single files. I've not found anything conclusive so I would appreciate some help. I would like the backup client to be able to submit individual files (via the command line) to the backup server. Ideally I would like to be able to override the destination directory if possible. I.e. /client/dirA/bigfile.dat --> /server/dirA/bigfile.dat /client/dirB/bigfile.dat --> /server/dirA/bigfile.dat ^^^^ ^^^^ If BoxBackup is not suitable I would appreciate any recommendations. Thanks Nick From boxbackup at fluffy.co.uk Sun Jun 10 11:29:32 2007 From: boxbackup at fluffy.co.uk (Ben Summers) Date: Sun, 10 Jun 2007 11:29:32 +0100 Subject: [Box Backup] error fixing account after server crash In-Reply-To: <20070608110003.29130.79219.Mailman@love.warhead.org.uk> References: <20070608110003.29130.79219.Mailman@love.warhead.org.uk> Message-ID: > Baltasar Cevc wrote: > > I've got an boxbackup server which crashed a few days ago; now I'm > trying to resume backups. As the link is quite slow I'd rather reuse > the data that's already on the server. However, I'm unable to fix one > of the accounts with bbstoreaccounts. It's the second time I run into > this error, so I thought it would be worth asking... > Permissions seem correct to mee (everything owned by > bbstored:bbstored). > > Do you have any hints? I've tried to compile a debug version and find > the error using it, but I've got an "assertation failed" error th It looks like you've got a particularly confused disc state after your crash. Within your backup root, move away the 00000003/o01.* files -- if you're using RAID then do this in all of the disc sets. Then fix it again, and it will recreate those files. Ben From boxbackup at fluffy.co.uk Mon Jun 11 10:48:26 2007 From: boxbackup at fluffy.co.uk (Ricardo Kuznik - aciComputer) Date: Mon, 11 Jun 2007 11:48:26 +0200 Subject: [Box Backup] SSL problem In-Reply-To: <46694D94.5010701@kontrapunkt.com> References: <46694A7B.3070102@aci-anhalt.de> <46694D94.5010701@kontrapunkt.com> Message-ID: <466D1A6A.1040102@aci-anhalt.de> Hi! Thanks for the answer, there was a time problem. Now I still ahve a problem. Here are some messages which are written by starting the client: Jun 11 11:45:33 acimail3 bbackupd[23423]: SSL err during Connect: error:0407006A:rsa routines:RSA_padding_check_PKCS1_type_1:block type is not 01 Jun 11 11:45:33 acimail3 bbackupd[23423]: SSL err during Connect: error:04067072:rsa routines:RSA_EAY_PUBLIC_DECRYPT:padding check failed Jun 11 11:45:33 acimail3 bbackupd[23423]: SSL err during Connect: error:0D089006:asn1 encoding routines:ASN1_verify:EVP lib Jun 11 11:45:33 acimail3 bbackupd[23423]: SSL err during Connect: error:14090086:SSL routines:SSL3_GET_SERVER_CERTIFICATE:certificate verify failed Tobias Balle-Petersen schrieb: > Hello. > > Make sure the time on the store and client are syncronized. > > Tobias > > Ricardo Kuznik - aciComputer wrote: > >> Hello List! >> >> I try to install boxbackup, but something is wrong with SSL (openSSL >> 0.9.7e is on both machines) >> >> >> Here are the commands, I executed: >> Server: >> raidfile-config /etc/box 4096 >> bbstored-config /etc/box 192.168.1.163 _bbstored >> bbstored-certs ca init >> bbstored-certs ca sign-server /etc/box/bbstored/192.168.1.163-csr.pem >> cp -a ca/servers/192.168.1.163-cert.pem /etc/box/bbstored/ >> cp -a ca/roots/clientCA.pem /etc/box/bbstored/ >> /usr/local/bin/bbstored >> >> >> /var/log/messages said: >> Jun 8 13:34:10 linux bbstored[8501]: Starting daemon (config: >> /etc/box/bbstored.conf) (version 0.10) >> Jun 8 13:34:10 linux bbstored/hk[8502]: Housekeeping process started >> Jun 8 13:34:10 linux bbstored/hk[8502]: Starting housekeeping >> Jun 8 13:34:10 linux bbstored/hk[8502]: Finished housekeeping >> >> I think it is everything OK. >> >> Then the Client: >> >> /usr/local/bin/bbackupd-config /etc/box lazy 115 192.168.1.163 / >> scp /etc/box/bbackupd/115-csr.pem 192.168.1.163:/ >> >> Server: >> bbstored-certs ca sign 1-csr.pem >> >> Client: >> scp 192.168.1.163:/ca/clients/115-cert.pem /etc/box/bbackupd >> scp 192.168.1.163:/ca/roots/serverCA.pem /etc/box/bbackupd >> >> /varlog/messages >> >> Jun 8 14:05:54 acimail3 bbackupd[13579]: Starting daemon (config: >> /etc/box/bbackupd.conf) (version 0.10) >> Jun 8 14:05:54 acimail3 bbackupd[13579]: Beginning scan of local files >> Jun 8 14:05:54 acimail3 bbackupd[13579]: Opening connection to server >> 192.168.1.163... >> Jun 8 14:05:55 acimail3 bbackupd[13579]: SSL err during Connect: >> error:14090086:SSL routines:SSL3_GET_SERVER_CERTIFICATE:certificate >> verify failed >> Jun 8 14:05:55 acimail3 bbackupd[13579]: Exception caught (Connection >> TLSHandshakeFailed 7/30), reset state and waiting to retry... >> Jun 8 14:06:05 acimail3 bbackupd[13579]: File statistics: total file >> size uploaded 0, bytes already on server 0, encoded size 0 >> >> Why failed the verifying? What did I wrong! >> >> Thank you for every feeddback and help! >> >> Greetings, R. Kuznik >> >> >> > > _______________________________________________ > boxbackup mailing list > boxbackup at fluffy.co.uk > http://lists.warhead.org.uk/mailman/listinfo/boxbackup > > > > -- Mit freundlichen Gr??en, Ricardo Kuznik aci Computer Innovationsgesellschaft mbH Anhalt Tel.: 0340-26069-31 Fax: 0340-2400141 Mail: r.kuznik at aci-anhalt.de Web: www.aci-anhalt.de ------------------------------------------ Gesch?ftsf?hrer: Ing. J?rg Pl?tz, Dipl.-Phys. Joachim von Below Sitz: Seelmannstr. 2, 06847 Dessau Amtsgericht Stendal, HRB Nr. 14051 ------------------------------------------ ____________ Virus checked by G DATA AntiVirusKit Version: AVK 17.4039 from 17.04.2007 Virus news: www.antiviruslab.com From boxbackup at fluffy.co.uk Mon Jun 11 08:46:01 2007 From: boxbackup at fluffy.co.uk (Stefan Norlin) Date: Mon, 11 Jun 2007 09:46:01 +0200 Subject: [Box Backup] Is BoxBackup suitable for single files? References: Message-ID: <009201c7abfc$8ed5e800$1601060a@cs> > I would like the backup client to be able to submit individual files (via > the > command line) to the backup server. Ideally I would like to be able to > override the destination directory if possible. I.e. > > /client/dirA/bigfile.dat --> /server/dirA/bigfile.dat > /client/dirB/bigfile.dat --> /server/dirA/bigfile.dat > ^^^^ ^^^^ Hi Nick, I do not see Box Backup very suitable for this since the Box Backup store is in a proprietary format with file named etc encrypted. So, there is no 1-to-1 mapping between files on the client and server side. > If BoxBackup is not suitable I would appreciate any recommendations. To me it sounds like a "simple" script, based on rsync, be suitable for this scenario? http://samba.anu.edu.au/rsync/ Regards, Stefan From boxbackup at fluffy.co.uk Mon Jun 11 19:46:05 2007 From: boxbackup at fluffy.co.uk (E.W. Peter Jalajas) Date: Mon, 11 Jun 2007 11:46:05 -0700 (PDT) Subject: [Box Backup] How to secure Box Backup on Windows clients? Message-ID: <367038.85091.qm@web60622.mail.yahoo.com> Hi all, I'd like to make sure that I am securing sensitive Box Backup application files on my Windows clients. First, let me confirm that I only really need to secure the *FileEncKeys.raw file from prying eyes--true? If someone gets a hold of that file, they can obtain decrypted files from the server, right? On client machines like Windows 2003 Server in a Windows domain (presuming NTFS), I can right-click the *FileEncKeys.raw file, click Properties, Security, and then remove all Users and Groups except that as which the Box Backup service runs, presumably the "Administrators" group. Most importantly, I think, I should remove the "Authenticated Users". What should I do with the "SYSTEM" user? Is there anything else I should know about this? I want to make sure that I don't break Box Backup in some way by over-tightening the permissions on the Keys file. Are there any other Box Backup Windows client files which we should handle specially? File permissions on other Windows machines explained fairly thoroughly here: http://support.microsoft.com/kb/304040 http://support.microsoft.com/kb/308418 http://www.microsoft.com/windowsxp/using/security/learnmore/accesscontrol.mspx On Windows XP Home with NTFS, per http://support.microsoft.com/kb/308418 , it looks like one must reboot into Safe Mode, and then lock down the Keys file that way. For Windows XP Pro, it'll depend upon whether you have Simple File Sharing on or not (and whether the Keys file is on NTFS). I don't think FAT users can secure the Keys file. I'll summarize the results of this thread on the wiki as part of setting up the client on Windows, http://bbdev.fluffy.co.uk/trac/wiki/ConfiguringAClient Thanks, Pete From boxbackup at fluffy.co.uk Mon Jun 11 20:39:27 2007 From: boxbackup at fluffy.co.uk (Martin Ebourne) Date: Mon, 11 Jun 2007 20:39:27 +0100 Subject: [Box Backup] How to secure Box Backup on Windows clients? In-Reply-To: <367038.85091.qm@web60622.mail.yahoo.com> References: <367038.85091.qm@web60622.mail.yahoo.com> Message-ID: <1181590768.3358.10.camel@avenin.ebourne.me.uk> On Mon, 2007-06-11 at 11:46 -0700, E.W. Peter Jalajas wrote: > First, let me confirm that I only really need to secure the > *FileEncKeys.raw file from prying eyes--true? If someone gets a hold > of that file, they can obtain decrypted files from the server, right? Protect the client certificate the same. Without that an attacker can't even log into bbstored which gives an extra level of defence. I'll defer windows specific stuff to someone who knows. :) Cheers, Martin. From boxbackup at fluffy.co.uk Tue Jun 12 08:18:16 2007 From: boxbackup at fluffy.co.uk (Jernej Porenta) Date: Tue, 12 Jun 2007 09:18:16 +0200 (CEST) Subject: [Box Backup] housekeeping time Message-ID: Hello, What can I do about housekeeping taking way too much time? The problem is that housekeeping takes more time than the client update interval is configured. Usually housekeeping takes about several hours (client is configured to update store in 12 hours). But when housekeeping is accidentally interrupted with client trying to update the store, the next housekeeping takes 25 hours!! And if I wouldnt stop the client, the housekeeping would never finish, because of the 12 hour update interval. The funny thing is that if I shut down the server after the first interrupted housekeeping and run check&fix and set up the limits again, housekeeping would take only about 2 hours (bbstoreaccount check 1 fix takes about 2 hours as well). The client has quite a lot of files (Maildir), but 25 hours is way too long. So what is the deal with slow housekeeping after the hk interrupt? Some info about the server: - dual Xeon 2.66GHz, 2.5GB ram, U160 SCSI 136 hard drive dedicated for bbackup shell> bbstoreaccount info 1 Account ID: 00000001 Last object ID: 6078056 Blocks used: 31452510 (122861.37Mb) Blocks used by old files: 9029810 (35272.70Mb) Blocks used by deleted files: 10498170 (41008.48Mb) Blocks used by directories: 104938 (409.91Mb) Block soft limit: 31457280 (122880.00Mb) Block hard limit: 34603008 (135168.00Mb) Client store marker: 1181519035000000 Here is the log from the server(some parts are taken out, but not the last 3 lines :)): Jun 8 17:50:43 krpan bbstored[12748]: Starting daemon (config: /etc/boxbackup/bbstored.conf) (version 0.10) Jun 8 17:50:43 krpan bbstored/hk[12749]: Housekeeping process started Jun 8 17:50:43 krpan bbstored/hk[12749]: Starting housekeeping Jun 8 21:29:56 krpan bbstored/hk[12749]: Account 0x00000001, removed 38431 blocks (3603 files, 40 dirs) Jun 8 21:29:56 krpan bbstored/hk[12749]: Finished housekeeping ... housekeeping... Jun 9 17:50:43 krpan bbstored/hk[12749]: Starting housekeeping Jun 9 21:29:05 krpan bbstored[12748]: Incoming connection from 212.235.240.122 port 35366 (handling in child 19978) Jun 9 21:29:05 krpan bbstored[19978]: Certificate CN: BACKUP-1 Jun 9 21:29:09 krpan bbstored[19978]: Failed to get write lock (for Client ID 00000001) Jun 9 21:29:09 krpan bbstored[19978]: Connection statistics for BACKUP-1: IN=60 OUT=60 TOTAL=120 Jun 9 21:29:09 krpan bbstored[19978]: in server child, exception Connection TLSReadFailed (Probably a network issue between client and server.) (7/34) -- terminating child Jun 9 21:31:43 krpan bbstored/hk[12749]: Housekeeping giving way to connection for account 0x00000001 Jun 9 21:31:43 krpan bbstored/hk[12749]: Account 0x00000001, removed 49708 blocks (3439 files, 0 dirs) was interrupted Jun 9 21:31:44 krpan bbstored/hk[12749]: Finished housekeeping Jun 9 21:36:50 krpan bbstored[12748]: Incoming connection from 212.235.240.122 port 38802 (handling in child 20948) Jun 9 21:36:50 krpan bbstored[20948]: Certificate CN: BACKUP-1 Jun 9 21:36:50 krpan bbstored[20948]: Login: Client ID 00000001, Read/Write Jun 9 21:50:43 krpan bbstored/hk[12749]: Starting housekeeping Jun 9 21:50:43 krpan bbstored/hk[12749]: Finished housekeeping Jun 10 01:44:09 krpan bbstored[20948]: Session finished Jun 10 01:44:09 krpan bbstored[20948]: Connection statistics for BACKUP-1: IN=141304716 OUT=79655544 TOTAL=220960260 ... other logs Jun 10 22:00:08 krpan bbstored/hk[12749]: Starting housekeeping Jun 10 22:04:26 krpan bbstored[12748]: Incoming connection from 212.235.240.122 port 41346 (handling in child 9500) Jun 10 22:04:26 krpan bbstored[9500]: Certificate CN: BACKUP-1 Jun 10 22:04:26 krpan bbstored/hk[12749]: Housekeeping giving way to connection for account 0x00000001 Jun 10 22:04:27 krpan bbstored/hk[12749]: Finished housekeeping Jun 10 22:04:27 krpan bbstored[9500]: Login: Client ID 00000001, Read/Write Jun 11 01:44:43 krpan bbstored[9500]: Session finished Jun 11 01:44:43 krpan bbstored[9500]: Connection statistics for BACKUP-1: IN=127452172 OUT=80183825 TOTAL=207635997 Jun 11 02:00:08 krpan bbstored/hk[12749]: Starting housekeeping Jun 12 03:33:28 krpan bbstored/hk[12749]: Account 0x00000001, removed 173612 blocks (21950 files, 12 dirs) Jun 12 03:33:28 krpan bbstored/hk[12749]: Finished housekeeping Have fun, Jernej From boxbackup at fluffy.co.uk Tue Jun 12 18:46:08 2007 From: boxbackup at fluffy.co.uk (Wolfgang Trexler) Date: Tue, 12 Jun 2007 19:46:08 +0200 Subject: [Box Backup] debian.myreseau.org - New Debian Packages only for stable? Message-ID: <466EDBE0.9070600@trexler.at> On my Debian Etch Server there are new packages proposed for boxbackup, while I didn't see them for oldstable (sarge). What is the reason for these new packages, it would be nice if such changes could be announced here... Reading package lists... Building dependency tree... The following packages will be upgraded: boxbackup-client boxbackup-server 2 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. Inst boxbackup-client [0.10-1] (0.10-1 debian.myreseau.org) Inst boxbackup-server [0.10-1] (0.10-1 debian.myreseau.org) Conf boxbackup-client (0.10-1 debian.myreseau.org) Conf boxbackup-server (0.10-1 debian.myreseau.org) best regards Wolfgang From boxbackup at fluffy.co.uk Wed Jun 13 09:57:14 2007 From: boxbackup at fluffy.co.uk (Baltasar Cevc) Date: Wed, 13 Jun 2007 10:57:14 +0200 Subject: [Box Backup] error fixing account after server crash In-Reply-To: References: <20070608110003.29130.79219.Mailman@love.warhead.org.uk> Message-ID: <32E8FD30-BB22-4DCC-8995-A9324E53440E@cevc-topp.de> Ben, On 10.06.2007, at 12:29, Ben Summers wrote: >> Baltasar Cevc wrote: >> >> I've got an boxbackup server which crashed a few days ago; now I'm >> trying to resume backups. As the link is quite slow I'd rather reuse >> the data that's already on the server. However, I'm unable to fix one >> of the accounts with bbstoreaccounts. It's the second time I run into >> this error, so I thought it would be worth asking... >> Permissions seem correct to mee (everything owned by >> bbstored:bbstored). > > Within your backup root, move away the 00000003/o01.* files -- if > you're using RAID then do this in all of the disc sets. Then fix it > again, and it will recreate those files. thanx for the hint. The fix ran cleanly now, however when checking the directory using bbackupquery, everything's empty and quota usage is 0. Anything else to try? If the data's lost, it's not that bad, however I'd prefer to reuse it as the network link is really slow and it's about 150 GB... Thanx, Baltasar ((( Baltasar Cevc ) World wide web: # http://www.openairkino.net/ (a project for the local youth; German only) # http://technik.juz-kirchheim.de/ (programming and admin projects) # http://baltasar.cevc-topp.de/ (private homepage) ) Phone: +49 176 23 22 08 22 ) From boxbackup at fluffy.co.uk Wed Jun 13 10:00:20 2007 From: boxbackup at fluffy.co.uk (Ben Summers) Date: Wed, 13 Jun 2007 10:00:20 +0100 Subject: [Box Backup] error fixing account after server crash In-Reply-To: <32E8FD30-BB22-4DCC-8995-A9324E53440E@cevc-topp.de> References: <20070608110003.29130.79219.Mailman@love.warhead.org.uk> <32E8FD30-BB22-4DCC-8995-A9324E53440E@cevc-topp.de> Message-ID: <2B1C8CAC-801E-4584-8432-DFD1FBEE8447@fluffy.co.uk> On 13 Jun 2007, at 09:57, Baltasar Cevc wrote: > Ben, > > On 10.06.2007, at 12:29, Ben Summers wrote: >>> Baltasar Cevc wrote: >>> >>> I've got an boxbackup server which crashed a few days ago; now I'm >>> trying to resume backups. As the link is quite slow I'd rather reuse >>> the data that's already on the server. However, I'm unable to fix >>> one >>> of the accounts with bbstoreaccounts. It's the second time I run >>> into >>> this error, so I thought it would be worth asking... >>> Permissions seem correct to mee (everything owned by >>> bbstored:bbstored). >> >> Within your backup root, move away the 00000003/o01.* files -- if >> you're using RAID then do this in all of the disc sets. Then fix >> it again, and it will recreate those files. > > thanx for the hint. The fix ran cleanly now, however when checking > the directory > using bbackupquery, everything's empty and quota usage is 0. > Anything else to try? What does bbstoreaccounts info show for this account? Is there a "lost and found" directory in bbackupquery? > If the data's lost, it's not that bad, however I'd prefer to reuse > it as the network link is really slow and it's about 150 GB... It's possible this may be your best option, all depending on what exactly your server crash did to the files on disc. It sounds like it was unpleasant. Is it possible to transport stores between servers, so you could do a backup locally on the network, then transport the disc physically and copy it onto the server. Ben From boxbackup at fluffy.co.uk Wed Jun 13 11:07:02 2007 From: boxbackup at fluffy.co.uk (Baltasar Cevc) Date: Wed, 13 Jun 2007 12:07:02 +0200 Subject: [Box Backup] error fixing account after server crash In-Reply-To: <2B1C8CAC-801E-4584-8432-DFD1FBEE8447@fluffy.co.uk> References: <20070608110003.29130.79219.Mailman@love.warhead.org.uk> <32E8FD30-BB22-4DCC-8995-A9324E53440E@cevc-topp.de> <2B1C8CAC-801E-4584-8432-DFD1FBEE8447@fluffy.co.uk> Message-ID: Hi Ben, thanx for the quick answer. On 13.06.2007, at 11:00, Ben Summers wrote: > > On 13 Jun 2007, at 09:57, Baltasar Cevc wrote: > >> Ben, >> >> On 10.06.2007, at 12:29, Ben Summers wrote: >>>> Baltasar Cevc wrote: >>>> >>>> I've got an boxbackup server which crashed a few days ago; now I'm >>>> trying to resume backups. As the link is quite slow I'd rather >>>> reuse >>>> the data that's already on the server. However, I'm unable to >>>> fix one >>>> of the accounts with bbstoreaccounts. It's the second time I run >>>> into >>>> this error, so I thought it would be worth asking... >>>> Permissions seem correct to mee (everything owned by >>>> bbstored:bbstored). >>> >>> Within your backup root, move away the 00000003/o01.* files -- if >>> you're using RAID then do this in all of the disc sets. Then fix >>> it again, and it will recreate those files. >> >> thanx for the hint. The fix ran cleanly now, however when checking >> the directory >> using bbackupquery, everything's empty and quota usage is 0. >> Anything else to try? > > > What does bbstoreaccounts info show for this account? Is there a > "lost and found" directory in bbackupquery? root at bak:/backup/int-2/box/backup# bbstoreaccounts info 00000003 Account ID: 00000003 Last object ID: 0 Blocks used: 1 (0.00Mb) Blocks used by old files: 0 (0.00Mb) Blocks used by deleted files: 0 (0.00Mb) Blocks used by directories: 1 (0.00Mb) Block soft limit: 78643200 (153600.00Mb) Block hard limit: 104857600 (204800.00Mb) Client store marker: 0 I'll really just re-start from the beginning, this seems the sanest option to me... Thanx for your help, anyway. Baltasar ((( Baltasar Cevc ) World wide web: # http://www.openairkino.net/ (a project for the local youth; German only) # http://technik.juz-kirchheim.de/ (programming and admin projects) # http://baltasar.cevc-topp.de/ (private homepage) ) Phone: +49 176 23 22 08 22 ) From boxbackup at fluffy.co.uk Wed Jun 13 17:02:44 2007 From: boxbackup at fluffy.co.uk (Torsten Boob) Date: Wed, 13 Jun 2007 18:02:44 +0200 Subject: [Box Backup] Resume Big Files Message-ID: <20070613180244.37fdc6fc@matrix.tuxianer.homelinux.net> Hi, we have an internet-connection, that is disconnected every day. There is a 2,7 Gigabyte file in the backup location. The upload is limited to 1.3 gigabyte per 24 hours. Every restart ob bbackupd the transfer starts at the beginning. So the complete file will never be backupd up. Is there a solutions for resuming files ob bbackupd restart ? Nice day Torsten From boxbackup at fluffy.co.uk Thu Jun 14 16:40:11 2007 From: boxbackup at fluffy.co.uk (E.W. Peter Jalajas) Date: Thu, 14 Jun 2007 08:40:11 -0700 (PDT) Subject: [Box Backup] using get command with a target path returns confusing error message Message-ID: <896721.64713.qm@web60619.mail.yahoo.com> I'm not sure if this is a current bug or not, but we were doing a test restore of a deleted quickbooks file on an old 0.10 Windows client (it was a chris version in the 500 range, 526 maybe), and I issued get -i testrestore/testrestore.qbb trying to put the restored file into the testrestore subdirectory (to keep it out of the \Program Files\Box Backup\ directory), but I was getting an error about the file already existing, when I now think that I should have been getting an error message reporting that I shouldn't have been using a path in my target. And, help get didn't clarify. (Not sure if this is a problem without the -i option [client user was watching and we had to disconnect]). Let me know if I should submit a bug ticket. Thanks, Pete From boxbackup at fluffy.co.uk Mon Jun 18 08:23:40 2007 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Mon, 18 Jun 2007 09:23:40 +0200 Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> <4662C85B.6000000@kontrapunkt.com> <4662D0D1.3060508@kontrapunkt.com> <4663C9DC.1050509@kontrapunkt.com> <4663D6B5.4070807@kontrapunkt.com> <4663DB4F.4040805@kontrapunkt.com> <466544F6.2020107@kontrapunkt.com> <46657126.9000202@kontrapunkt.com> <46692D94.1090301@kontrapunkt.com> Message-ID: <467632FC.6020009@kontrapunkt.com> Hello Chris. Hope you had a nice holiday. Thank you for all your help. Tobias Chris Wilson wrote: > Hi Tobias, > > Thanks very much for testing, and sorry to hear that you had problems! > Unfortunately I'm just going away on holiday for 8 days, will look into > it when I get back, sorry for the delay. > > Cheers, Chris. > > On Fri, 8 Jun 2007, Tobias Balle-Petersen wrote: > >> Hello Chris. >> >> I have tested backing up a 2GB+ file with a 0.10 store on OS X and >> your version 1694 of bbackupd on >> a Red Hat system. >> >> Unfortunately the results were not good. Maybe you can shed light on >> the problem? >> >> Please see the results of my tests below: >> >> >> Restore of a 2GB+ file: >> >> -------------------------------------- >> query > ls >> 00001033 -d---- .kde >> 0000103d f----- .gtkrc >> 0000103e f----- .bash_history >> 0000103f f----- .bash_logout >> 00001040 f----- .canna >> 00001041 f----- .bashrc >> 00001042 f----- .emacs >> 00001043 f----- .bash_profile >> 00001044 f----- .zshrc >> 00001059 f----- Unit.zip >> query > get -i 00001059 unit.restore.zip >> Failed to fetch file: Connection TLSReadFailed (Probably a network >> issue between client and server, >> or a problem with the server.) >> query > ls >> Exception: Connection TLSReadFailed (Probably a network issue between >> client and server, or a >> problem with the server.) (7/34) >> -------------------------------------- >> query > get Unit.zip unit.restore.zip >> Failed to fetch file: Connection TLSReadFailed (Probably a network >> issue between client and server, >> or a problem with the server.) >> query > ls >> Exception: Connection TLSReadFailed (Probably a network issue between >> client and server, or a >> problem with the server.) (7/34) >> -------------------------------------- >> query > getobject 00001059 unit.restore.zip >> Object ID 00001059 fetched successfully. >> query > exit >> Logging off... >> Session finished. >> -------------------------------------- >> >> >> Now, I'll check the original file and the restored file: >> md5sum unit.restore.zip -> 2ca0ec94494efff9f6063667f86a3434 >> md5sum Unit.zip -> 15626af50a3785d3cbe632b4623731a4 >> >> I'll also check the size of the files: >> unit.restore.zip -> 2190251829 >> Unit.zip -> 2196637554 >> >> I'll try to unzip the restored file: >> unzip unit.restore.zip >> Archive: unit.restore.zip >> End-of-central-directory signature not found. Either this file is not >> a zipfile, or it constitutes one disk of a multi-part archive. In the >> latter case the central directory and zipfile comment will be found on >> the last disk(s) of this archive. >> unzip: cannot find zipfile directory in one of unit.restore.zip or >> unit.restore.zip.zip, and cannot find unit.restore.zip.ZIP, >> period. >> >> >> Thank you, >> Tobias >> >> >> >> >> >> >> >> _______________________________________________ >> boxbackup mailing list >> boxbackup at fluffy.co.uk >> http://lists.warhead.org.uk/mailman/listinfo/boxbackup >> >> >> !DSPAM:46692e0c192116648012310! >> > From boxbackup at fluffy.co.uk Mon Jun 18 23:10:46 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Mon, 18 Jun 2007 23:10:46 +0100 (BST) Subject: [Box Backup] SSL problem In-Reply-To: <466D1A6A.1040102@aci-anhalt.de> References: <46694A7B.3070102@aci-anhalt.de> <46694D94.5010701@kontrapunkt.com> <466D1A6A.1040102@aci-anhalt.de> Message-ID: Hi Ricardo, On Mon, 11 Jun 2007, Ricardo Kuznik - aciComputer wrote: > Thanks for the answer, there was a time problem. Now I still ahve a problem. > Here are some messages which are written by starting the client: > > Jun 11 11:45:33 acimail3 bbackupd[23423]: SSL err during Connect: > error:0407006A:rsa routines:RSA_padding_check_PKCS1_type_1:block type is not > 01 > Jun 11 11:45:33 acimail3 bbackupd[23423]: SSL err during Connect: > error:04067072:rsa routines:RSA_EAY_PUBLIC_DECRYPT:padding check failed > Jun 11 11:45:33 acimail3 bbackupd[23423]: SSL err during Connect: > error:0D089006:asn1 encoding routines:ASN1_verify:EVP lib > Jun 11 11:45:33 acimail3 bbackupd[23423]: SSL err during Connect: > error:14090086:SSL routines:SSL3_GET_SERVER_CERTIFICATE:certificate verify > failed What version of OpenSSL do you have on the client and server? There is a know problem with 0.9.8d which may also exist in 0.9.8e, and may be the source of your problem: [http://bbdev.fluffy.co.uk/trac/ticket/21] Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Mon Jun 18 23:20:44 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Mon, 18 Jun 2007 23:20:44 +0100 (BST) Subject: [Box Backup] How to secure Box Backup on Windows clients? In-Reply-To: <367038.85091.qm@web60622.mail.yahoo.com> References: <367038.85091.qm@web60622.mail.yahoo.com> Message-ID: Hi Pete, On Mon, 11 Jun 2007, E.W. Peter Jalajas wrote: > I'd like to make sure that I am securing sensitive Box Backup > application files on my Windows clients. > > First, let me confirm that I only really need to secure the > *FileEncKeys.raw file from prying eyes--true? If someone gets a hold of > that file, they can obtain decrypted files from the server, right? That is the most sensitive file, but as Martin rightly pointed out, it makes sense to secure your certificate and private key as well. > On client machines like Windows 2003 Server in a Windows domain > (presuming NTFS), I can right-click the *FileEncKeys.raw file, click > Properties, Security, and then remove all Users and Groups except that > as which the Box Backup service runs, presumably the "Administrators" > group. Most importantly, I think, I should remove the "Authenticated > Users". What should I do with the "SYSTEM" user? Is there anything else > I should know about this? I want to make sure that I don't break Box > Backup in some way by over-tightening the permissions on the Keys file. > Are there any other Box Backup Windows client files which we should > handle specially? Whatever user Box runs as should be able to access the files. If you run bbackupd as a service, then the service user (which is probably Local System) must have access. If you run bbackupquery from the command line as a normal user, then that normal user must also have access. In any case, you must check that Box Backup is still running and backing up by doing regular compares and investigating any reported compare errors or mismatches. That will catch permissions problems as long as any services or daemons are restarted as well. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Tue Jun 19 07:30:40 2007 From: boxbackup at fluffy.co.uk (Ricardo Kuznik - aciComputer) Date: Tue, 19 Jun 2007 08:30:40 +0200 Subject: [Box Backup] SSL problem In-Reply-To: References: <46694A7B.3070102@aci-anhalt.de> <46694D94.5010701@kontrapunkt.com> <466D1A6A.1040102@aci-anhalt.de> Message-ID: <46777810.7060206@aci-anhalt.de> Hi Chris, on both machines is OpennSSL 0.9.7e installed. I tested some times, now I have following messages: Server: Jun 19 08:25:20 linux bbstored/hk[6187]: Starting housekeeping Jun 19 08:25:20 linux bbstored/hk[6187]: Finished housekeeping Jun 19 08:26:39 linux bbstored[6186]: Incoming connection from 192.168.1.115 port 52261 (handling in child 6188) Jun 19 08:26:39 linux bbstored[6188]: Certificate CN: BACKUP-AAAAAA Jun 19 08:26:39 linux bbstored[6188]: Failed login: Client ID presented was 00AAAAAA Jun 19 08:26:39 linux bbstored[6188]: Connection statistics for BACKUP-AAAAAA: IN=60 OUT=60 TOTAL=120 Jun 19 08:26:39 linux bbstored[6188]: in server child, exception Connection TLSReadFailed (Probably a network issue between client and server.) (7/34) -- terminating child Client: Jun 19 08:28:01 acimail3 bbackupd[6776]: Beginning scan of local files Jun 19 08:28:01 acimail3 bbackupd[6776]: Opening connection to server 192.168.1.163... Jun 19 08:28:01 acimail3 bbackupd[6776]: Exception caught (Connection Protocol_UnexpectedReply (Server probably reported an error.) 7/47), reset state and waiting to retry... Jun 19 08:28:11 acimail3 bbackupd[6776]: File statistics: total file size uploaded 0, bytes already on server 0, encoded size 0 I don't know where the problem is :( Cheers, Ricardo Chris Wilson schrieb: > Hi Ricardo, > > On Mon, 11 Jun 2007, Ricardo Kuznik - aciComputer wrote: > >> Thanks for the answer, there was a time problem. Now I still ahve a >> problem. Here are some messages which are written by starting the >> client: >> >> Jun 11 11:45:33 acimail3 bbackupd[23423]: SSL err during Connect: >> error:0407006A:rsa routines:RSA_padding_check_PKCS1_type_1:block type >> is not 01 >> Jun 11 11:45:33 acimail3 bbackupd[23423]: SSL err during Connect: >> error:04067072:rsa routines:RSA_EAY_PUBLIC_DECRYPT:padding check failed >> Jun 11 11:45:33 acimail3 bbackupd[23423]: SSL err during Connect: >> error:0D089006:asn1 encoding routines:ASN1_verify:EVP lib >> Jun 11 11:45:33 acimail3 bbackupd[23423]: SSL err during Connect: >> error:14090086:SSL routines:SSL3_GET_SERVER_CERTIFICATE:certificate >> verify failed > > What version of OpenSSL do you have on the client and server? There is > a know problem with 0.9.8d which may also exist in 0.9.8e, and may be > the source of your problem: > > [http://bbdev.fluffy.co.uk/trac/ticket/21] > > Cheers, Chris. -- Mit freundlichen Gr??en, Ricardo Kuznik aci Computer Innovationsgesellschaft mbH Anhalt Tel.: 0340-26069-31 Fax: 0340-2400141 Mail: r.kuznik at aci-anhalt.de Web: www.aci-anhalt.de ------------------------------------------ Gesch?ftsf?hrer: Ing. J?rg Pl?tz, Dipl.-Phys. Joachim von Below Sitz: Seelmannstr. 2, 06847 Dessau Amtsgericht Stendal, HRB Nr. 14051 ------------------------------------------ ____________ Virus checked by G DATA AntiVirusKit Version: AVK 17.4039 from 17.04.2007 Virus news: www.antiviruslab.com From boxbackup at fluffy.co.uk Tue Jun 19 15:00:10 2007 From: boxbackup at fluffy.co.uk (E.W. Peter Jalajas) Date: Tue, 19 Jun 2007 07:00:10 -0700 (PDT) Subject: [Box Backup] How to secure Box Backup on Windows clients? Message-ID: <866733.94908.qm@web60617.mail.yahoo.com> Thanks, Chris. To summarize so far, *key.pem *cert.pem *Keys.raw 1. must have Full Control (Modify, Read & Execute, Read, and Write) by the Administrators and SYSTEM security groups (and maybe also the Backup Operators group if you are using that), and 2. must have NO access by any other group. (I'm guessing that the SYSTEM group holds the "Local System account" Log On user under which the Box Backup services runs.) Now, let's move on to the executables (.exe), .dlls, bbackupd.conf, and any home-grown batch files or scheduled tasks? They: 1. must have Full Control (Modify, Read & Execute, Read, and Write) by the above groups, and only the above groups, and 2. may optionally be readable by anyone, --correct? (I'm guessing that a bad guy could stop [DoS] or crack the Box Backup application/service, or do rogue restores, by modifying or running those files.) (I found that the QBDataServiceUser, presumably from QuickBooks, had Full Control on everything--go figure.) Thanks again, Pete ----- Original Message ---- From: Chris Wilson To: Box Backup Mailing List Sent: Monday, June 18, 2007 6:20:44 PM Subject: Re: [Box Backup] How to secure Box Backup on Windows clients? Hi Pete, On Mon, 11 Jun 2007, E.W. Peter Jalajas wrote: > I'd like to make sure that I am securing sensitive Box Backup > application files on my Windows clients. > > First, let me confirm that I only really need to secure the > *FileEncKeys.raw file from prying eyes--true? If someone gets a hold of > that file, they can obtain decrypted files from the server, right? That is the most sensitive file, but as Martin rightly pointed out, it makes sense to secure your certificate and private key as well. > On client machines like Windows 2003 Server in a Windows domain > (presuming NTFS), I can right-click the *FileEncKeys.raw file, click > Properties, Security, and then remove all Users and Groups except that > as which the Box Backup service runs, presumably the "Administrators" > group. Most importantly, I think, I should remove the "Authenticated > Users". What should I do with the "SYSTEM" user? Is there anything else > I should know about this? I want to make sure that I don't break Box > Backup in some way by over-tightening the permissions on the Keys file. > Are there any other Box Backup Windows client files which we should > handle specially? Whatever user Box runs as should be able to access the files. If you run bbackupd as a service, then the service user (which is probably Local System) must have access. If you run bbackupquery from the command line as a normal user, then that normal user must also have access. In any case, you must check that Box Backup is still running and backing up by doing regular compares and investigating any reported compare errors or mismatches. That will catch permissions problems as long as any services or daemons are restarted as well. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | _______________________________________________ boxbackup mailing list boxbackup at fluffy.co.uk http://lists.warhead.org.uk/mailman/listinfo/boxbackup From boxbackup at fluffy.co.uk Tue Jun 19 19:08:18 2007 From: boxbackup at fluffy.co.uk (Nick Brandon) Date: Tue, 19 Jun 2007 19:08:18 +0100 Subject: [Box Backup] Is BoxBackup suitable for single files? In-Reply-To: <009201c7abfc$8ed5e800$1601060a@cs> References: <009201c7abfc$8ed5e800$1601060a@cs> Message-ID: On Mon, 11 Jun 2007 08:46:01 +0100, Stefan Norlin wrote: > > I do not see Box Backup very suitable for this since the Box Backup > store is in a proprietary format with file named etc encrypted. So, there > is no 1-to-1 mapping between files on the client and server side. > >> If BoxBackup is not suitable I would appreciate any recommendations. > > To me it sounds like a "simple" script, based on rsync, be suitable for > this scenario? > > http://samba.anu.edu.au/rsync/ > Hi Stefan, Thanks for the prompt response. I suspect you are right regarding the suitability of Box Backup and I appreciate your suggestion of rsync. Further investigation is needed but it does seem to offer the "controllability" for my scenario. Regards Nick From boxbackup at fluffy.co.uk Tue Jun 19 21:14:15 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Tue, 19 Jun 2007 21:14:15 +0100 (BST) Subject: [Box Backup] Resume Big Files In-Reply-To: <20070613180244.37fdc6fc@matrix.tuxianer.homelinux.net> References: <20070613180244.37fdc6fc@matrix.tuxianer.homelinux.net> Message-ID: Hi Torsten, On Wed, 13 Jun 2007, Torsten Boob wrote: > we have an internet-connection, that is disconnected every day. Why? > There is a 2,7 Gigabyte file in the backup location. The upload is > limited to 1.3 gigabyte per 24 hours. Every restart ob bbackupd the > transfer starts at the beginning. So the complete file will never be > backupd up. > > Is there a solutions for resuming files ob bbackupd restart ? Unfortunately not at the moment, no. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Tue Jun 19 21:41:39 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Tue, 19 Jun 2007 21:41:39 +0100 (BST) Subject: [Box Backup] using get command with a target path returns confusing error message In-Reply-To: <896721.64713.qm@web60619.mail.yahoo.com> References: <896721.64713.qm@web60619.mail.yahoo.com> Message-ID: Hi Pete, On Thu, 14 Jun 2007, E.W. Peter Jalajas wrote: > I'm not sure if this is a current bug or not, but we were doing a test > restore of a deleted quickbooks file on an old 0.10 Windows client (it > was a chris version in the 500 range, 526 maybe), and I issued > > get -i testrestore/testrestore.qbb > > trying to put the restored file into the testrestore subdirectory (to > keep it out of the \Program Files\Box Backup\ directory), but I was > getting an error about the file already existing, when I now think that > I should have been getting an error message reporting that I shouldn't > have been using a path in my target. Please try the latest client release, and if it doesn't work, please do file a bug report. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Wed Jun 20 00:06:32 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Wed, 20 Jun 2007 00:06:32 +0100 (BST) Subject: [Box Backup] SSL problem In-Reply-To: <46777810.7060206@aci-anhalt.de> References: <46694A7B.3070102@aci-anhalt.de> <46694D94.5010701@kontrapunkt.com> <466D1A6A.1040102@aci-anhalt.de> <46777810.7060206@aci-anhalt.de> Message-ID: Hi Ricardo, On Tue, 19 Jun 2007, Ricardo Kuznik - aciComputer wrote: > on both machines is OpennSSL 0.9.7e installed. I tested some times, now > I have following messages: > > Server: > Jun 19 08:25:20 linux bbstored/hk[6187]: Starting housekeeping > Jun 19 08:25:20 linux bbstored/hk[6187]: Finished housekeeping > Jun 19 08:26:39 linux bbstored[6186]: Incoming connection from 192.168.1.115 > port 52261 (handling in child 6188) > Jun 19 08:26:39 linux bbstored[6188]: Certificate CN: BACKUP-AAAAAA > Jun 19 08:26:39 linux bbstored[6188]: Failed login: Client ID presented was > 00AAAAAA Does the account AAAAAA actually exist on the server? Does "bbstoreaccounts info AAAAAA" produce account statistics for you? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Wed Jun 20 07:10:49 2007 From: boxbackup at fluffy.co.uk (Ricardo Kuznik - aciComputer) Date: Wed, 20 Jun 2007 08:10:49 +0200 Subject: [Box Backup] SSL problem In-Reply-To: References: <46694A7B.3070102@aci-anhalt.de> <46694D94.5010701@kontrapunkt.com> <466D1A6A.1040102@aci-anhalt.de> <46777810.7060206@aci-anhalt.de> Message-ID: <4678C4E9.1020809@aci-anhalt.de> Hi! Indeed I had serveral problems. Now they are solved. The first problem was that on the server the time run too fast. And I I mad a mistake with bbstoreaccounts und with the direcorties to scan. Now the problems are solved and I can go on testing. Thanky you! Chris Wilson schrieb: > Hi Ricardo, > > On Tue, 19 Jun 2007, Ricardo Kuznik - aciComputer wrote: > >> on both machines is OpennSSL 0.9.7e installed. I tested some times, >> now I have following messages: >> >> Server: >> Jun 19 08:25:20 linux bbstored/hk[6187]: Starting housekeeping >> Jun 19 08:25:20 linux bbstored/hk[6187]: Finished housekeeping >> Jun 19 08:26:39 linux bbstored[6186]: Incoming connection from >> 192.168.1.115 port 52261 (handling in child 6188) >> Jun 19 08:26:39 linux bbstored[6188]: Certificate CN: BACKUP-AAAAAA >> Jun 19 08:26:39 linux bbstored[6188]: Failed login: Client ID >> presented was 00AAAAAA > > Does the account AAAAAA actually exist on the server? Does > "bbstoreaccounts info AAAAAA" produce account statistics for you? > > Cheers, Chris. -- Mit freundlichen Gr??en, Ricardo Kuznik aci Computer Innovationsgesellschaft mbH Anhalt Tel.: 0340-26069-31 Fax: 0340-2400141 Mail: r.kuznik at aci-anhalt.de Web: www.aci-anhalt.de ------------------------------------------ Gesch?ftsf?hrer: Ing. J?rg Pl?tz, Dipl.-Phys. Joachim von Below Sitz: Seelmannstr. 2, 06847 Dessau Amtsgericht Stendal, HRB Nr. 14051 ------------------------------------------ ____________ Virus checked by G DATA AntiVirusKit Version: AVK 17.4039 from 17.04.2007 Virus news: www.antiviruslab.com From boxbackup at fluffy.co.uk Wed Jun 20 12:14:16 2007 From: boxbackup at fluffy.co.uk (Wolfgang Trexler) Date: Wed, 20 Jun 2007 13:14:16 +0200 Subject: [Box Backup] Debian packages upgrade failure with Debian etch - debian.myreseau.org Message-ID: <46790C08.10506@trexler.at> Hi, when I do an "aptitude upgrade" I a new boxbackup package is recommended for installation. During the installation I get the following error dpkg: error processing /var/cache/apt/archives/boxbackup-server_0.10-1_i386.deb (--unpack): trying to overwrite `/usr/bin/bbstored-certs', which is also in package boxbackup-utils Errors were encountered while processing: /var/cache/apt/archives/boxbackup-server_0.10-1_i386.deb E: Sub-process /usr/bin/dpkg returned an error code (1) A package failed to install. Trying to recover: and the upgrade fails. Is anybody experiencing the same problem with the packages from debian.myreseau.org (deb http://debian.myreseau.org/ etch main)? Previous history: I did a switch from sarge to etch a few weeks ago, maybe there is a coincidence? btw: I solved the problem with dpkg -i --force-all /var/cache/apt/archives/boxbackup-server_0.10-1_i386.deb but I don't think that's the way it's meant to be... btw2: I there a signature file or package for the debian boxbackup archive to avoid the warning regarding system security? br Wolfgang Enclose the full upgrade session: localhost:/home/user# aptitude upgrade Reading package lists... Done Building dependency tree... Done Reading extended state information Initializing package states... Done Reading task descriptions... Done Building tag database... Done The following packages will be upgraded: boxbackup-server 1 packages upgraded, 0 newly installed, 0 to remove and 0 not upgraded. Need to get 0B/295kB of archives. After unpacking 41,0kB will be used. Do you want to continue? [Y/n/?] Y WARNING: untrusted versions of the following packages will be installed! Untrusted packages could compromise your system's security. You should only proceed with the installation if you are certain that this is what you want to do. boxbackup-server Do you want to ignore this warning and proceed anyway? To continue, enter "Yes"; to abort, enter "No": yes Preconfiguring packages ... (Reading database ... 44795 files and directories currently installed.) Preparing to replace boxbackup-server 0.10-1 (using .../boxbackup-server_0.10-1_i386.deb) ... Unpacking replacement boxbackup-server ... dpkg: error processing /var/cache/apt/archives/boxbackup-server_0.10-1_i386.deb (--unpack): trying to overwrite `/usr/bin/bbstored-certs', which is also in package boxbackup-utils Errors were encountered while processing: /var/cache/apt/archives/boxbackup-server_0.10-1_i386.deb E: Sub-process /usr/bin/dpkg returned an error code (1) A package failed to install. Trying to recover: From boxbackup at fluffy.co.uk Wed Jun 20 21:37:38 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Wed, 20 Jun 2007 21:37:38 +0100 (BST) Subject: [Box Backup] How to secure Box Backup on Windows clients? In-Reply-To: <866733.94908.qm@web60617.mail.yahoo.com> References: <866733.94908.qm@web60617.mail.yahoo.com> Message-ID: Hi Pete, On Tue, 19 Jun 2007, E.W. Peter Jalajas wrote: > To summarize so far, > *key.pem > *cert.pem > *Keys.raw > > 1. must have Full Control (Modify, Read & Execute, Read, and Write) by > the Administrators and SYSTEM security groups (and maybe also the > Backup Operators group if you are using that), and > > 2. must have NO access by any other group. (I'm guessing that the > SYSTEM group holds the "Local System account" Log On user under which > the Box Backup services runs.) That seems reasonable, but I'd check that the System group actually contains the LocalSystem user, or whichever user the Box Backup service runs as. > Now, let's move on to the executables (.exe), .dlls, bbackupd.conf, and > any home-grown batch files or scheduled tasks? They: > > 1. must have Full Control (Modify, Read & Execute, Read, and Write) by > the above groups, and only the above groups, and No need for LocalSystem or Backup Operators to have write access to those files. Only Administrators should. > 2. may optionally be readable by anyone, > > --correct? Yes, looks OK to me. > (I'm guessing that a bad guy could stop [DoS] or crack the Box Backup > application/service, or do rogue restores, by modifying or running those > files.) Yes. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Thu Jun 21 00:07:43 2007 From: boxbackup at fluffy.co.uk (scott) Date: Thu, 21 Jun 2007 09:07:43 +1000 Subject: [Box Backup] How to secure Box Backup on Windows clients? In-Reply-To: References: <866733.94908.qm@web60617.mail.yahoo.com> Message-ID: <001a01c7b38f$cf28a0b0$6d79e210$@com.au> Hi Chris, You mentioned some time ago about a windows version of the server? I am thinking of using this for another project where data can be viewed from local media ie. DVD created on a linux machine under windows. Single threading and no Housekeeping process would be well suited to this application. Can you send through some code or a link to some. Thanks. Scott. -----Original Message----- From: boxbackup-admin at fluffy.co.uk [mailto:boxbackup-admin at fluffy.co.uk] On Behalf Of Chris Wilson Sent: Thursday, 21 June 2007 6:38 AM To: boxbackup at fluffy.co.uk Subject: Re: [Box Backup] How to secure Box Backup on Windows clients? Hi Pete, On Tue, 19 Jun 2007, E.W. Peter Jalajas wrote: > To summarize so far, > *key.pem > *cert.pem > *Keys.raw > > 1. must have Full Control (Modify, Read & Execute, Read, and Write) by > the Administrators and SYSTEM security groups (and maybe also the > Backup Operators group if you are using that), and > > 2. must have NO access by any other group. (I'm guessing that the > SYSTEM group holds the "Local System account" Log On user under which > the Box Backup services runs.) That seems reasonable, but I'd check that the System group actually contains the LocalSystem user, or whichever user the Box Backup service runs as. > Now, let's move on to the executables (.exe), .dlls, bbackupd.conf, and > any home-grown batch files or scheduled tasks? They: > > 1. must have Full Control (Modify, Read & Execute, Read, and Write) by > the above groups, and only the above groups, and No need for LocalSystem or Backup Operators to have write access to those files. Only Administrators should. > 2. may optionally be readable by anyone, > > --correct? Yes, looks OK to me. > (I'm guessing that a bad guy could stop [DoS] or crack the Box Backup > application/service, or do rogue restores, by modifying or running those > files.) Yes. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | _______________________________________________ boxbackup mailing list boxbackup at fluffy.co.uk http://lists.warhead.org.uk/mailman/listinfo/boxbackup From boxbackup at fluffy.co.uk Thu Jun 21 08:32:27 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Thu, 21 Jun 2007 08:32:27 +0100 (BST) Subject: [Box Backup] How to secure Box Backup on Windows clients? In-Reply-To: <001a01c7b38f$cf28a0b0$6d79e210$@com.au> References: <866733.94908.qm@web60617.mail.yahoo.com> <001a01c7b38f$cf28a0b0$6d79e210$@com.au> Message-ID: Hi Scott, > You mentioned some time ago about a windows version of the server? The standard Box Backup server now builds on Windows. > I am thinking of using this for another project where data can be viewed > from local media ie. DVD created on a linux machine under windows. > > Single threading and no Housekeeping process would be well suited to > this application. > > Can you send through some code or a link to some. You can download the source code from my General tree, and follow the building instructions for Windows with MinGW (not with MSVC, unless you create a new MSVC project for it). This will now build a server parcel for you. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Sun Jun 24 15:45:59 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Sun, 24 Jun 2007 15:45:59 +0100 (BST) Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: <46692D94.1090301@kontrapunkt.com> References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> <4662C85B.6000000@kontrapunkt.com> <4662D0D1.3060508@kontrapunkt.com> <4663C9DC.1050509@kontrapunkt.com> <4663D6B5.4070807@kontrapunkt.com> <4663DB4F.4040805@kontrapunkt.com> <466544F6.2020107@kontrapunkt.com> <46657126.9000202@kontrapunkt.com> <46692D94.1090301@kontrapunkt.com> Message-ID: Hi Tobias, > I have tested backing up a 2GB+ file with a 0.10 store on OS X and your > version 1694 of bbackupd on a Red Hat system. > > Unfortunately the results were not good. Maybe you can shed light on the > problem? Sorry, it looks like I was wrong that you could use an unmodified server. Patch 1586 affects the server sending back the contents of files over 2GB compressed. Without this patch, you will almost certainly get data corruption when restoring such files. Please could you try running 1694 (or later) for both client and server, preferably both on the Red Hat system, as it's easiest for me to reproduce any problems on this system rather than OSX (which I don't have). Please could you try backing up, comparing and restoring your large file with this combination? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Sun Jun 24 16:03:44 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Sun, 24 Jun 2007 16:03:44 +0100 (BST) Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: <46692D94.1090301@kontrapunkt.com> References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> <4662C85B.6000000@kontrapunkt.com> <4662D0D1.3060508@kontrapunkt.com> <4663C9DC.1050509@kontrapunkt.com> <4663D6B5.4070807@kontrapunkt.com> <4663DB4F.4040805@kontrapunkt.com> <466544F6.2020107@kontrapunkt.com> <46657126.9000202@kontrapunkt.com> <46692D94.1090301@kontrapunkt.com> Message-ID: Hi Tobias, On Fri, 8 Jun 2007, Tobias Balle-Petersen wrote: > query > getobject 00001059 unit.restore.zip > Object ID 00001059 fetched successfully. > query > exit > Logging off... > Session finished. Please note that the "getobject" command saves the compressed, encrypted data from the server, which should definitely NOT match your original file! So there's no point testing this one, it will only confuse us. Please use "get" or "get -i" instead. > Now, I'll check the original file and the restored file: > md5sum unit.restore.zip -> 2ca0ec94494efff9f6063667f86a3434 > md5sum Unit.zip -> 15626af50a3785d3cbe632b4623731a4 > > I'll also check the size of the files: > unit.restore.zip -> 2190251829 > Unit.zip -> 2196637554 Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Mon Jun 25 09:11:47 2007 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Mon, 25 Jun 2007 10:11:47 +0200 Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: References: <4652BB6B.9070604@kontrapunkt.com> <465BF20C.6030601@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> <4662C85B.6000000@kontrapunkt.com> <4662D0D1.3060508@kontrapunkt.com> <4663C9DC.1050509@kontrapunkt.com> <4663D6B5.4070807@kontrapunkt.com> <4663DB4F.4040805@kontrapunkt.com> <466544F6.2020107@kontrapunkt.com> <46657126.9000202@kontrapunkt.com> <46692D94.1090301@kontrapunkt.com> Message-ID: <467F78C3.9060805@kontrapunkt.com> Chris Wilson wrote: > Please could you try running 1694 (or later) for both client and server, > preferably both on the Red Hat system, as it's easiest for me to > reproduce any problems on this system rather than OSX (which I don't > have). Hello Chris. I only have one Red Hat system. My servers are a mix of OS X and Debian. I'll test 1694 on those. Tobias From boxbackup at fluffy.co.uk Mon Jun 25 09:38:45 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Mon, 25 Jun 2007 09:38:45 +0100 (BST) Subject: [Box Backup] Exception: Connection Protocol_ObjTooBig (7/42) ? In-Reply-To: <467F78C3.9060805@kontrapunkt.com> References: <4652BB6B.9070604@kontrapunkt.com> <465D6DF7.3060902@kontrapunkt.com> <46603627.2040102@kontrapunkt.com> <4662C85B.6000000@kontrapunkt.com> <4662D0D1.3060508@kontrapunkt.com> <4663C9DC.1050509@kontrapunkt.com> <4663D6B5.4070807@kontrapunkt.com> <4663DB4F.4040805@kontrapunkt.com> <466544F6.2020107@kontrapunkt.com> <46657126.9000202@kontrapunkt.com> <46692D94.1090301@kontrapunkt.com> <467F78C3.9060805@kontrapunkt.com> Message-ID: Hi Tobias, > I only have one Red Hat system. My servers are a mix of OS X and Debian. > I'll test 1694 on those. Nothing stops you from running both client and server on the same system, and it will make debugging easier for me if that was the Red Hat system. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Mon Jun 25 13:34:28 2007 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Mon, 25 Jun 2007 14:34:28 +0200 Subject: [Box Backup] Compiling boxbackup chris-merge on debian etch? Message-ID: <467FB654.2070107@kontrapunkt.com> Hello.. I'm trying to compile the latest chris-merge of boxbackup on a Debian PPC box but I cant make it work. Please have a look below and let me know if you have any ideas. Checkout code: # svn co http://bbdev.fluffy.co.uk/svn/box/chris/merge/ Checked out revision 1701. #./bootstrap #./configure ...... test/bbackupd Type 'cd ; make' to build a module A summary of the build configuration is below. Box Backup will function without these features, but will work better where they are present. Refer to the documentation for more information on each feature. Regular expressions: yes Large files: yes Berkeley DB: yes Readline: yes Extended attributes: yes #make #./runtest.pl ALL ..... ..... ./test [0x10005490] /lib/tls/libc.so.6 [0xf945994] /lib/tls/libc.so.6(__libc_start_main+0xb0) [0xf945ad0] Exception thrown: BackupStoreException(AttributesNotLoaded) at BackupClientFileAttributes.cpp(587) *********** Your platform supports xattr, but your filesystem does not. Skipping tests. *********** Server: ../../bin/bbstored/bbstored testfiles/bbstored.conf FAILURE: Couldn't start server at ../../lib/common/Test.h(224) FAILURE: Condition [bbstored_pid != -1 && bbstored_pid != 0] failed at testbbackupd.cpp(425) FAILED: 2 tests failed (first at ../../lib/common/Test.h:224) -------- common: PASSED crypto: PASSED compress: PASSED raidfile: PASSED basicserver: FAILED: 8 tests failed (first at ../../lib/common/Test.h:224) backupstore: FAILED: 2 tests failed (first at ../../lib/common/Test.h:224) backupstorefix: FAILED: 2 tests failed (first at ../../lib/common/Test.h:224) backupstorepatch: FAILED: 2 tests failed (first at ../../lib/common/Test.h:224) backupdiff: PASSED bbackupd: FAILED: 2 tests failed (first at ../../lib/common/Test.h:224) Thanks, Tobias From boxbackup at fluffy.co.uk Mon Jun 25 15:12:54 2007 From: boxbackup at fluffy.co.uk (Matthias Rieber) Date: Mon, 25 Jun 2007 16:12:54 +0200 Subject: [Box Backup] restore file >2GB Message-ID: <467FCD66.7000206@paepstin.info> Hi, I try to restore a file with 3.5GB. I'm using bboxbackup server version 0.10 and the client version chris_merge_1701. During the restore process I got the following error message: Unknown error during restore. Logging off... Exception: Connection TLSReadFailed (7/34) The logfile says: bbstored[9810]: Certificate CN: BACKUP-1 bbstored[9810]: Login: Client ID 00000001, Read-only bbstored[9810]: Connection statistics for BACKUP-1: IN=23475 OUT=5439274 TOTAL=5462749 bbstored[9810]: in server child, exception RaidFile OSError (Error when accessing an underlying file. Check file permissions allow files to be read and written in the configured raid directories.) (2/8) -- terminating child Backup (bbackupquery)[9809]: Failed to restore file /sql/mantis.sql: Connection TLSReadFailed The file permissions are ok. I thought the 2GB issues haven been fixed in the chris branch. What's my mistake? matthias From boxbackup at fluffy.co.uk Mon Jun 25 15:50:46 2007 From: boxbackup at fluffy.co.uk (Reinhard Tartler) Date: Mon, 25 Jun 2007 16:50:46 +0200 Subject: [Box Backup] restore file >2GB In-Reply-To: <467FCD66.7000206@paepstin.info> (Matthias Rieber's message of "Mon, 25 Jun 2007 16:12:54 +0200") References: <467FCD66.7000206@paepstin.info> Message-ID: <873b0gdr5l.fsf@hermes.olymp.tauware.de> Matthias Rieber writes: > Hi, > > I try to restore a file with 3.5GB. I'm using bboxbackup server version > 0.10 and the client version chris_merge_1701. During the restore process > I got the following error message: > The file permissions are ok. I thought the 2GB issues haven been fixed > in the chris branch. What's my mistake? According to the code, the server needs to run the chris_merge branch as well, since some problems seem to be on the server side as well... -- Gruesse/greetings, Reinhard Tartler, KeyID 945348A4 From boxbackup at fluffy.co.uk Mon Jun 25 21:13:28 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Mon, 25 Jun 2007 21:13:28 +0100 (BST) Subject: [Box Backup] Compiling boxbackup chris-merge on debian etch? In-Reply-To: <467FB654.2070107@kontrapunkt.com> References: <467FB654.2070107@kontrapunkt.com> Message-ID: Hi Tobias, > I'm trying to compile the latest chris-merge of boxbackup on a Debian > PPC box but I cant make it work. Please have a look below and let me > know if you have any ideas. ... > #./runtest.pl ALL ... > Server: ../../bin/bbstored/bbstored testfiles/bbstored.conf > FAILURE: Couldn't start server at ../../lib/common/Test.h(224) > FAILURE: Condition [bbstored_pid != -1 && bbstored_pid != 0] failed at testbbackupd.cpp(425) > FAILED: 2 tests failed (first at ../../lib/common/Test.h:224) Do you already have a bbstored running on that machine? You cannot run the tests while another bbstored is running. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Mon Jun 25 21:37:16 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Mon, 25 Jun 2007 21:37:16 +0100 (BST) Subject: [Box Backup] restore file >2GB In-Reply-To: <467FCD66.7000206@paepstin.info> References: <467FCD66.7000206@paepstin.info> Message-ID: Hi Matthias, On Mon, 25 Jun 2007, Matthias Rieber wrote: > I try to restore a file with 3.5GB. I'm using bboxbackup server version > 0.10 and the client version chris_merge_1701. During the restore process > I got the following error message: > > Unknown error during restore. > Logging off... > Exception: Connection TLSReadFailed (7/34) Unfortunately the server requires a patch as well to support files over 2GB compressed, otherwise you will get errors like this. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Wed Jun 27 08:25:07 2007 From: boxbackup at fluffy.co.uk (Matthias Rieber) Date: Wed, 27 Jun 2007 09:25:07 +0200 Subject: [Box Backup] restore file >2GB In-Reply-To: References: <467FCD66.7000206@paepstin.info> Message-ID: <468210D3.9010101@paepstin.info> Hello Chris, Chris Wilson wrote: > Hi Matthias, > > On Mon, 25 Jun 2007, Matthias Rieber wrote: > >> I try to restore a file with 3.5GB. I'm using bboxbackup server >> version 0.10 and the client version chris_merge_1701. During the >> restore process I got the following error message: >> >> Unknown error during restore. >> Logging off... >> Exception: Connection TLSReadFailed (7/34) > > Unfortunately the server requires a patch as well to support files over > 2GB compressed, otherwise you will get errors like this. it seems to work. But I discovered another strange thing. It seems that only one bbackupquery process can connect to the server. When I start another it stops at Connecting to store... and nothing happens. I start bbstored with the deamontools with the command exec /usr/local/bin/bbstored /etc/box/bbstored.conf SINGLEPROCESS Is it possible to use the 0.10 client with your server? matthias From boxbackup at fluffy.co.uk Wed Jun 27 10:59:41 2007 From: boxbackup at fluffy.co.uk (James O'Gorman) Date: Wed, 27 Jun 2007 10:59:41 +0100 Subject: [Box Backup] Carbonite Message-ID: <20070627095940.GE62388@netinertia.co.uk> Hi all, I just stumbled upon a backup system called Carbonite (http://www.carbonite.com/). It looks very similar to Box, but it's closed/commercial and completely centralised. While it looks very good (being similar to Box), there's just a nagging feeling in the back of my mind that makes me not want to trust them purely because I have no control over it! It would be nice if we could get Box running to the same level on desktop PCs too! (Imo, the server is already pretty well covered. I hardly ever have to look at the backup server except to run the occasional compare and running a restore on a server machine after the odd oops has always worked flawlessly). James From boxbackup at fluffy.co.uk Wed Jun 27 11:33:31 2007 From: boxbackup at fluffy.co.uk (Jernej Porenta) Date: Wed, 27 Jun 2007 12:33:31 +0200 (CEST) Subject: [Box Backup] housekeeping time Message-ID: Heya, I was wondering what is the reasonable amount of time, before you give up on housekeeping and delete files by regular tools (rm?)? My problem goes like this: I have just one account who had 120GB/132GB limit with large number of files (Cyrus mail store) and housekeeping was taking about 23 hours to finish on that account so I changed the limits to 80GB/120GB and restarted the server, which started housekeeping straight away and it is doing it for *7 days* now. In that seven days I stopped the client, because I didn't want to interrupt the housekeeping process. The machine is dual-Xeon 2.66/2.5GB RAM, store is on U320 SCSI disk used just for that purpose, runs Debian Etch with svn build of boxbackup. The account info is: Account ID: 00000001 Last object ID: 6233095 Blocks used: 31491156 (123012.33Mb) Blocks used by old files: 8942537 (34931.79Mb) Blocks used by deleted files: 10908404 (42610.95Mb) Blocks used by directories: 105613 (412.55Mb) Block soft limit: 20971520 (81920.00Mb) Block hard limit: 31457280 (122880.00Mb) Client store marker: 0 So what do you think, is it time to give up on boxbackup? cheers, Jernej From boxbackup at fluffy.co.uk Wed Jun 27 19:28:17 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Wed, 27 Jun 2007 19:28:17 +0100 (BST) Subject: [Box Backup] restore file >2GB In-Reply-To: <468210D3.9010101@paepstin.info> References: <467FCD66.7000206@paepstin.info> <468210D3.9010101@paepstin.info> Message-ID: Hi Matthias, On Wed, 27 Jun 2007, Matthias Rieber wrote: > it seems to work. But I discovered another strange thing. It seems that > only one bbackupquery process can connect to the server. When I start > another it stops at Connecting to store... and nothing happens. I start > bbstored with the deamontools with the command > > exec /usr/local/bin/bbstored /etc/box/bbstored.conf SINGLEPROCESS That is normal if you use the SINGLEPROCESS option. In a single process, we can only handle a single client. > Is it possible to use the 0.10 client with your server? Yes, it should work fine except for the 2GB bugs. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Wed Jun 27 19:36:53 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Wed, 27 Jun 2007 19:36:53 +0100 (BST) Subject: [Box Backup] Carbonite In-Reply-To: <20070627095940.GE62388@netinertia.co.uk> References: <20070627095940.GE62388@netinertia.co.uk> Message-ID: Hi James, > While it looks very good (being similar to Box), there's just a nagging > feeling in the back of my mind that makes me not want to trust them > purely because I have no control over it! Also, I'm not completely sure, but from their description the data may not really be encrypted on the server: "We use the same encryption techniques that most banks and e-payment sites do." i.e. SSL on the link. > It would be nice if we could get Box running to the same level on > desktop PCs too! That is the purpose of Boxi. Anyone willing to offer help? I'm a bit busy right now :-) Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Wed Jun 27 19:43:25 2007 From: boxbackup at fluffy.co.uk (E.W. Peter Jalajas) Date: Wed, 27 Jun 2007 11:43:25 -0700 (PDT) Subject: [Box Backup] restore file >2GB In-Reply-To: Message-ID: <235853.2641.qm@web60619.mail.yahoo.com> Hi Chris, Would you please clarify for the record whether >2 GB is working on Box Backup, and if so, what one needs to do on the client and store server to get it working? (I have your 1692 client on my Win2k3 Server and v0.10 server on my Ubuntu store.) Thanks, Pete From boxbackup at fluffy.co.uk Wed Jun 27 20:05:01 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Wed, 27 Jun 2007 20:05:01 +0100 (BST) Subject: [Box Backup] restore file >2GB In-Reply-To: <235853.2641.qm@web60619.mail.yahoo.com> References: <235853.2641.qm@web60619.mail.yahoo.com> Message-ID: Hi Pete, > Would you please clarify for the record whether >2 GB is working on Box > Backup, and if so, what one needs to do on the client and store server > to get it working? > > (I have your 1692 client on my Win2k3 Server and v0.10 server on my > Ubuntu store.) It should work if you run a recent enough chris/merge on the server AND chris/merge or chris/general on the client. 0.10 on the server or client is not enough. If you backed up a large file with an older client, then you will have to delete it from the store and upload it again to fix it. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Wed Jun 27 21:01:39 2007 From: boxbackup at fluffy.co.uk (Dave Bamford) Date: Wed, 27 Jun 2007 21:01:39 +0100 Subject: [Box Backup] Carbonite In-Reply-To: References: <20070627095940.GE62388@netinertia.co.uk> Message-ID: <4682C223.3000507@logical-progress.com> Chris Wilson wrote: > Hi James, > >> While it looks very good (being similar to Box), there's just a >> nagging feeling in the back of my mind that makes me not want to >> trust them purely because I have no control over it! > > Also, I'm not completely sure, but from their description the data may > not really be encrypted on the server: > > "We use the same encryption techniques that most banks and e-payment > sites do." > > i.e. SSL on the link. > According to the Ts & Cs data is encrypted. But I don't know why they have to check file types against extensions. I can't believe they offer "Unlimited" storage for only $50 per year. Tempted to send my 1Tb of box backup store there. > > *Software Data Collection and Privacy Policy* > > Carbonite needs to collect limited amounts of basic data about files > on your computer. None of this data is shared with third parties. > Carbonite?s software routinely scans your computer in order to detect > new, modified or deleted data files that require our software to take > further action to complete backup and restore operations. Carbonite?s > software also catalogs the number and total storage size of various > file types on your computer. Carbonite?s software inspects file > headers and related information in order to confirm that each file?s > type is properly represented by its file extension. Carbonite will > never examine the contents of your files for any other purpose, and no > information about a file?s content, other than its type (e.g. digital > photos, word processing document, etc.) and size, will ever be > collected, tracked or stored by Carbonite. Contents of all files are > encrypted before they are transmitted to Carbonite?s data center. By > using Carbonite Products, you expressly agree to allow Carbonite to > collect and use data as specified in our ?Software Data Collection and > Privacy Policy.? Dave Bamford From boxbackup at fluffy.co.uk Wed Jun 27 21:12:39 2007 From: boxbackup at fluffy.co.uk (E.W. Peter Jalajas) Date: Wed, 27 Jun 2007 13:12:39 -0700 (PDT) Subject: [Box Backup] restore file >2GB In-Reply-To: Message-ID: <929764.27902.qm@web60618.mail.yahoo.com> Thanks, Chris. Would you please give this relative novice 5 lines or so of instructions on how to move my Ubuntu/Debian server store from v0.10 to your "a recent enough chris/merge on the server". Something like: 1. sudo killall bbstored 2. Backup everything in /etc/boxbackup/* and /usr/local/bin/bb* 3. svn ... 4. compile ... 5. ... And also, I'm not sure what do with your "If you backed up a large file with an older client...". I'm sure I have some quite large files backed up with the older client in several accounts on my store server. I'm not sure if any are >2GB. (BTW, is that 2GB as measured on the client or on the store server?) And so, to delete it from the store, should I exclude it in the bbackupd.conf and let housekeeping take care of it, or should I just whack it on the server? For the record, this is what I'm trying to fix, an Exchange Server ntbackup (until I get my nascent Shadow Copy tricks working...anybody care to join me on that trek?): 00014369 f--o-- 2007-05-12T23:04:05 00001 ExchangeBackup.bkf 0001736e f--o-- 2007-05-19T23:09:12 00001 ExchangeBackup.bkf 00017d72 f--o-- 2007-05-26T23:04:40 00001 ExchangeBackup.bkf 000185d5 f--o-- 2007-06-02T23:04:35 00001 ExchangeBackup.bkf 0001915d f--o-- 2007-06-09T23:04:41 00001 ExchangeBackup.bkf 00019e01 f--o-- 2007-06-16T23:03:10 00001 ExchangeBackup.bkf 0001a5ce f----- 2007-06-23T23:05:31 00001 ExchangeBackup.bkf That .bkf is 2.6 GB. Thanks again! Pete --- Chris Wilson wrote: > Hi Pete, > > > Would you please clarify for the record whether >2 GB is working on Box > > Backup, and if so, what one needs to do on the client and store server > > to get it working? > > > > (I have your 1692 client on my Win2k3 Server and v0.10 server on my > > Ubuntu store.) > > It should work if you run a recent enough chris/merge on the server AND > chris/merge or chris/general on the client. 0.10 on the server or client > is not enough. > > If you backed up a large file with an older client, then you will have to > delete it from the store and upload it again to fix it. > > Cheers, Chris. > -- > _____ __ _ > \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | > / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | > \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | > _______________________________________________ > boxbackup mailing list > boxbackup at fluffy.co.uk > http://lists.warhead.org.uk/mailman/listinfo/boxbackup > > > > From boxbackup at fluffy.co.uk Wed Jun 27 22:33:56 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Wed, 27 Jun 2007 22:33:56 +0100 (BST) Subject: [Box Backup] restore file >2GB In-Reply-To: <929764.27902.qm@web60618.mail.yahoo.com> References: <929764.27902.qm@web60618.mail.yahoo.com> Message-ID: Hi Pete, > Would you please give this relative novice 5 lines or so of instructions > on how to move my Ubuntu/Debian server store from v0.10 to your "a > recent enough chris/merge on the server". Just the same as any upgrade. Please ensure that you back up your 0.10 binaries and installation first, as you suggest. And please don't do this unless you're prepared to accept that this is an experimental version, and you have another backup strategy. 1. Backup everything in /etc/boxbackup/* and /usr/local/bin/bb* 2. svn co http://bbdev.fluffy.co.uk/svn/box/chris/merge 3. cd merge 4. ./configure 5. sudo killall bbstored 6. ./runtest ALL 7. ./runtest ALL release 8. install as usual (untar the server parcel and copy files to /usr/local/bin) 9. /usr/local/bin/bbstored > And also, I'm not sure what do with your "If you backed up a large file > with an older client...". I'm sure I have some quite large files backed > up with the older client in several accounts on my store server. I'm > not sure if any are >2GB. (BTW, is that 2GB as measured on the client > or on the store server?) As measured on the server (compressed encrypted). If you don't have any files that large, and don't expect to have any in the near future, then you shouldn't need to upgrade anything on the server. > And so, to delete it from the store, should I exclude it in the > bbackupd.conf and let housekeeping take care of it, or should I just > whack it on the server? I'm not sure how to "whack it on the server", but excluding it, running a backup, and then un-excluding it should work. Please check that the files are marked as deleted with bbackupquery. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Wed Jun 27 22:57:22 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Wed, 27 Jun 2007 22:57:22 +0100 (BST) Subject: [Box Backup] restore file >2GB In-Reply-To: References: <929764.27902.qm@web60618.mail.yahoo.com> Message-ID: Hi Pete. On Wed, 27 Jun 2007, Chris Wilson wrote: > 3. cd merge > > 4. ./configure Sorry, I forgot a step: before running ./configure, run ./bootstrap. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Thu Jun 28 07:24:44 2007 From: boxbackup at fluffy.co.uk (Matthias Rieber) Date: Thu, 28 Jun 2007 08:24:44 +0200 Subject: [Box Backup] restore file >2GB In-Reply-To: References: <467FCD66.7000206@paepstin.info> <468210D3.9010101@paepstin.info> Message-ID: <4683542C.7020400@paepstin.info> Hello, Chris Wilson wrote: > Hi Matthias, > > On Wed, 27 Jun 2007, Matthias Rieber wrote: > >> it seems to work. But I discovered another strange thing. It seems >> that only one bbackupquery process can connect to the server. When I >> start another it stops at Connecting to store... and nothing happens. >> I start bbstored with the deamontools with the command >> >> exec /usr/local/bin/bbstored /etc/box/bbstored.conf SINGLEPROCESS > > That is normal if you use the SINGLEPROCESS option. In a single process, > we can only handle a single client. Has this option a new behaviour in your branch? With version 0.10 it was possible to connect with many clients and bbackupquery tools at the same time. I just need a --do-not-fork-to-background option for the daemontools. matthias From boxbackup at fluffy.co.uk Thu Jun 28 09:47:17 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Thu, 28 Jun 2007 09:47:17 +0100 (BST) Subject: [Box Backup] restore file >2GB In-Reply-To: <4683542C.7020400@paepstin.info> References: <467FCD66.7000206@paepstin.info> <468210D3.9010101@paepstin.info> <4683542C.7020400@paepstin.info> Message-ID: Hi Matthias, On Thu, 28 Jun 2007, Matthias Rieber wrote: >>> It seems that only one bbackupquery process can connect to the server. >>> When I start another it stops at Connecting to store... and nothing >>> happens. I start bbstored with the deamontools with the command >>> >>> exec /usr/local/bin/bbstored /etc/box/bbstored.conf SINGLEPROCESS >> >> That is normal if you use the SINGLEPROCESS option. In a single >> process, we can only handle a single client. > > Has this option a new behaviour in your branch? With version 0.10 it was > possible to connect with many clients and bbackupquery tools at the same > time. Yes, it is new. I took SINGLEPROCESS to mean exactly that, because it helped for debugging. I did not realise that people were using it in production as you are. > I just need a --do-not-fork-to-background option for the daemontools. OK, does anyone have a preference on whether I restore SINGLEPROCESS to its old meaning, and add a new option for _really_ only one process :-) or add a new option which just doesn't fork into the background, and otherwise behaves as normal? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Thu Jun 28 10:18:27 2007 From: boxbackup at fluffy.co.uk (Matthias Rieber) Date: Thu, 28 Jun 2007 11:18:27 +0200 Subject: [Box Backup] restore file >2GB In-Reply-To: References: <467FCD66.7000206@paepstin.info> <468210D3.9010101@paepstin.info> <4683542C.7020400@paepstin.info> Message-ID: <46837CE3.5000800@paepstin.info> Hi Chris, Chris Wilson wrote: > Hi Matthias, > > On Thu, 28 Jun 2007, Matthias Rieber wrote: > >>> That is normal if you use the SINGLEPROCESS option. In a single >>> process, we can only handle a single client. >> >> Has this option a new behaviour in your branch? With version 0.10 it >> was possible to connect with many clients and bbackupquery tools at >> the same time. > > Yes, it is new. I took SINGLEPROCESS to mean exactly that, because it > helped for debugging. I did not realise that people were using it in > production as you are. > >> I just need a --do-not-fork-to-background option for the daemontools. > > OK, does anyone have a preference on whether I restore SINGLEPROCESS to > its old meaning, and add a new option for _really_ only one process :-) > or add a new option which just doesn't fork into the background, and > otherwise behaves as normal? I think it's better to add a new option for that, because SINGLEPROCESS is not the right name for that. matthias From boxbackup at fluffy.co.uk Thu Jun 28 10:46:40 2007 From: boxbackup at fluffy.co.uk (Martin Ebourne) Date: Thu, 28 Jun 2007 10:46:40 +0100 Subject: [Box Backup] restore file >2GB In-Reply-To: References: <467FCD66.7000206@paepstin.info> <468210D3.9010101@paepstin.info> <4683542C.7020400@paepstin.info> Message-ID: <20070628104640.hmqn1je2skkcc884@ebourne.me.uk> Chris Wilson wrote: > OK, does anyone have a preference on whether I restore SINGLEPROCESS > to its old meaning, and add a new option for _really_ only one > process :-) or add a new option which just doesn't fork into the > background, and otherwise behaves as normal? I'm sure Ben will correct me if I'm wrong, but I got the impression that SINGLEPROCESS was a little bit of a kludge for use by the test suite, and was not really intended to escape into the wild. I think it would be best to add a proper option for foreground running as this is quite common. Cheers, Martin. From boxbackup at fluffy.co.uk Thu Jun 28 13:51:24 2007 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Thu, 28 Jun 2007 14:51:24 +0200 Subject: [Box Backup] Compiling boxbackup chris-merge on debian etch? In-Reply-To: References: <467FB654.2070107@kontrapunkt.com> Message-ID: <4683AECC.3010200@kontrapunkt.com> Hello Chris. I have a bbstored on the machine allready. But: 1. It's not running 2. /var/run/bbstored.pid does not exist There is no bbstored.pid on the whole system as repported by: find / -iname bbstored.pid I have compiled again, but still get the same errors: Skipping tests. *********** Server: ../../bin/bbstored/bbstored testfiles/bbstored.conf FAILURE: Couldn't start server at ../../lib/common/Test.h(224) FAILURE: Condition [bbstored_pid != -1 && bbstored_pid != 0] failed at testbbackupd.cpp(425) FAILED: 2 tests failed (first at ../../lib/common/Test.h:224) -------- common: PASSED crypto: PASSED compress: PASSED raidfile: PASSED basicserver: FAILED: 8 tests failed (first at ../../lib/common/Test.h:224) backupstore: FAILED: 2 tests failed (first at ../../lib/common/Test.h:224) backupstorefix: FAILED: 2 tests failed (first at ../../lib/common/Test.h:224) backupstorepatch: FAILED: 2 tests failed (first at ../../lib/common/Test.h:224) backupdiff: PASSED bbackupd: FAILED: 2 tests failed (first at ../../lib/common/Test.h:224) Any ideas? Tobias Chris Wilson wrote: > Hi Tobias, > >> I'm trying to compile the latest chris-merge of boxbackup on a Debian >> PPC box but I cant make it work. Please have a look below and let me >> know if you have any ideas. > ... >> #./runtest.pl ALL > ... >> Server: ../../bin/bbstored/bbstored testfiles/bbstored.conf >> FAILURE: Couldn't start server at ../../lib/common/Test.h(224) >> FAILURE: Condition [bbstored_pid != -1 && bbstored_pid != 0] failed at >> testbbackupd.cpp(425) >> FAILED: 2 tests failed (first at ../../lib/common/Test.h:224) > > Do you already have a bbstored running on that machine? You cannot run > the tests while another bbstored is running. > > Cheers, Chris. From boxbackup at fluffy.co.uk Thu Jun 28 20:41:03 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Thu, 28 Jun 2007 20:41:03 +0100 (BST) Subject: [Box Backup] Compiling boxbackup chris-merge on debian etch? In-Reply-To: <4683AECC.3010200@kontrapunkt.com> References: <467FB654.2070107@kontrapunkt.com> <4683AECC.3010200@kontrapunkt.com> Message-ID: Hi Tobias, On Thu, 28 Jun 2007, Tobias Balle-Petersen wrote: > I have a bbstored on the machine allready. > > But: > 1. It's not running > 2. /var/run/bbstored.pid does not exist > > There is no bbstored.pid on the whole system as repported by: > find / -iname bbstored.pid > > I have compiled again, but still get the same errors: > Skipping tests. > *********** > Server: ../../bin/bbstored/bbstored testfiles/bbstored.conf > FAILURE: Couldn't start server at ../../lib/common/Test.h(224) > FAILURE: Condition [bbstored_pid != -1 && bbstored_pid != 0] failed at testbbackupd.cpp(425) > FAILED: 2 tests failed (first at ../../lib/common/Test.h:224) Please could you try this: ps auxww | grep bbstored (check that none are running) cd debug/test/basicserver ../../bin/bbstored/bbstored -DVT testfiles/bbstored.conf It should run in the foreground, waiting for a connection. And if so, then the test should work fine. Can you let me know if it does so? If it exits for any reason, then the test will not work. In that case, please could you paste the output? Also, please check your system logs for messages from bbstored in either case. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Thu Jun 28 20:55:17 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Thu, 28 Jun 2007 20:55:17 +0100 (BST) Subject: [Box Backup] restore file >2GB In-Reply-To: <46837CE3.5000800@paepstin.info> References: <467FCD66.7000206@paepstin.info> <468210D3.9010101@paepstin.info> <4683542C.7020400@paepstin.info> <46837CE3.5000800@paepstin.info> Message-ID: Hi Matthias, On Thu, 28 Jun 2007, Matthias Rieber wrote: >>>> That is normal if you use the SINGLEPROCESS option. In a single >>>> process, we can only handle a single client. >>> >>> Has this option a new behaviour in your branch? With version 0.10 it >>> was possible to connect with many clients and bbackupquery tools at >>> the same time. >> >> Yes, it is new. I took SINGLEPROCESS to mean exactly that, because it >> helped for debugging. I did not realise that people were using it in >> production as you are. >> >>> I just need a --do-not-fork-to-background option for the daemontools. >> >> OK, does anyone have a preference on whether I restore SINGLEPROCESS to >> its old meaning, and add a new option for _really_ only one process :-) >> or add a new option which just doesn't fork into the background, and >> otherwise behaves as normal? > > I think it's better to add a new option for that, because SINGLEPROCESS > is not the right name for that. OK, following your and Martin's guidance I've added a new option, -F, which causes the daemon not to fork into the background, but still accept multiple connections. Please could you update to the latest svn and check if this solves the problem for you? (using -F instead of SINGLEPROCESS) Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Thu Jun 28 21:36:21 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Thu, 28 Jun 2007 21:36:21 +0100 (BST) Subject: [Box Backup] Box Backup port registration In-Reply-To: <87ejjwi3fx.fsf@faui44a.informatik.uni-erlangen.de> References: <20070329080549.6867.90854.reportbug@hermes.olymp.tauware.de> <87mz1vde6a.fsf@hermes.olymp.tauware.de> <87648jkxam.fsf@hermes.olymp.tauware.de> <87y7iavp7x.fsf@hermes.olymp.tauware.de> <871wg1uk1r.fsf@hermes.olymp.tauware.de> <87odj1u6sr.fsf@hermes.olymp.tauware.de> <87ejjwi3fx.fsf@faui44a.informatik.uni-erlangen.de> Message-ID: Hi all, On Thu, 28 Jun 2007, Reinhard Tartler wrote: > No, I don't run bbstored on my laptop. > > However, I run another service on port 2201, which seems to break the > tests as well :/ - pff, let's see when I find some time to fix the > testsuite to use a random free port for the tests... I've just realised that port 2201 is not registered with IANA (http://www.iana.org/assignments/port-numbers), and is in fact reserved for another application, "Advanced Training System Program". Ports 2210 and 22201 are available, perhaps we should register one of these and change the default port in bbstored? Any objections or preferences? I propose the following registration details (see RFC 4340 at ftp://ftp.rfc-editor.org/in-notes/rfc4340.txt, section 19.9): bbstored 2210/tcp (or 22201/tcp) Box Backup store daemon SC:bbsd (http://www.fluffy.co.uk/boxbackup) # Ben Summers We would also need to request a Service Code such as SC:bbsd as defined in RFC4340 section 8.1.2. I have no idea where to send such registration requests at present. Does anyone know? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Fri Jun 29 08:50:40 2007 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Fri, 29 Jun 2007 09:50:40 +0200 Subject: [Box Backup] Compiling boxbackup chris-merge on debian etch? In-Reply-To: References: <467FB654.2070107@kontrapunkt.com> <4683AECC.3010200@kontrapunkt.com> Message-ID: <4684B9D0.8050909@kontrapunkt.com> Hi Chris. Thanks for your help. Doing everything from the top: 1. Stop bbstored 2. Check that pid-file does not exist 3. check for running instances of bbstored 4. Checkout code 5. ./bootstrap -> ./configure -> make 6. cd debug/test/basicserver 7. ../../bin/bbstored/bbstored -DVT testfiles/bbstored.conf -> No such file 8. ls ../../bin/bbstored -> "Empty dir" 9. find /root/merge -type f -iname bbstored /root/merge/release/bin/bbstored/bbstored /root/merge/parcels/boxbackup-chris_merge_1708-backup-server-linux-gnu/bbstored /root/merge/distribution/boxbackup/contrib/redhat/bbstored /root/merge/distribution/boxbackup/contrib/suse/bbstored 10. /root/merge/release/bin/bbstored/bbstored -DVT testfiles/bbstored.conf 09:50:04 Unknown error in getopt: returned '?' >From /var/log/syslog: Jun 29 09:50:04 misora Box Backup (bbstored)[15154]: Unknown error in getopt: returned '?' Any ideas? Tobias Chris Wilson wrote: > Hi Tobias, > > On Thu, 28 Jun 2007, Tobias Balle-Petersen wrote: > >> I have a bbstored on the machine allready. >> >> But: >> 1. It's not running >> 2. /var/run/bbstored.pid does not exist >> >> There is no bbstored.pid on the whole system as repported by: >> find / -iname bbstored.pid >> >> I have compiled again, but still get the same errors: >> Skipping tests. >> *********** >> Server: ../../bin/bbstored/bbstored testfiles/bbstored.conf >> FAILURE: Couldn't start server at ../../lib/common/Test.h(224) >> FAILURE: Condition [bbstored_pid != -1 && bbstored_pid != 0] failed at >> testbbackupd.cpp(425) >> FAILED: 2 tests failed (first at ../../lib/common/Test.h:224) > > Please could you try this: > > ps auxww | grep bbstored (check that none are running) > cd debug/test/basicserver > ../../bin/bbstored/bbstored -DVT testfiles/bbstored.conf > > It should run in the foreground, waiting for a connection. And if so, > then the test should work fine. Can you let me know if it does so? > > If it exits for any reason, then the test will not work. In that case, > please could you paste the output? > > Also, please check your system logs for messages from bbstored in either > case. > > Cheers, Chris. From boxbackup at fluffy.co.uk Fri Jun 29 09:47:43 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Fri, 29 Jun 2007 09:47:43 +0100 (BST) Subject: [Box Backup] Compiling boxbackup chris-merge on debian etch? In-Reply-To: <4684B9D0.8050909@kontrapunkt.com> References: <467FB654.2070107@kontrapunkt.com> <4683AECC.3010200@kontrapunkt.com> <4684B9D0.8050909@kontrapunkt.com> Message-ID: Hi Tobias, On Fri, 29 Jun 2007, Tobias Balle-Petersen wrote: > Doing everything from the top: > > 1. Stop bbstored > 2. Check that pid-file does not exist > 3. check for running instances of bbstored > 4. Checkout code > 5. ./bootstrap -> ./configure -> make > 6. cd debug/test/basicserver > 7. ../../bin/bbstored/bbstored -DVT testfiles/bbstored.conf -> No such file > 8. ls ../../bin/bbstored -> "Empty dir" OK, I wasn't expecting that you would delete everything before running those commands :-) That's why it didn't work. > 10. /root/merge/release/bin/bbstored/bbstored -DVT testfiles/bbstored.conf > 09:50:04 Unknown error in getopt: returned '?' Anyway, this is enough to know that something weird is going on. Is that really a question mark between the quotes, or did it get mangled by email? Could you try compiling the following test program for me: cat > test.c < int main() { #ifdef __GLIBC__ puts("yes"); #else puts("no"); #endif } gcc -o test test.c ./test and let me know whether it outputs "yes" or "no"? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Fri Jun 29 09:58:11 2007 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Fri, 29 Jun 2007 10:58:11 +0200 Subject: [Box Backup] Compiling boxbackup chris-merge on debian etch? In-Reply-To: References: <467FB654.2070107@kontrapunkt.com> <4683AECC.3010200@kontrapunkt.com> <4684B9D0.8050909@kontrapunkt.com> Message-ID: <4684C9A3.1000703@kontrapunkt.com> Hello Chris. My results: 1. enter "test" directory 2. Create test.c file 3. gcc -o test test.c (no output) 4. ./test -> "yes" Thanks Chris Wilson wrote: > Hi Tobias, > > On Fri, 29 Jun 2007, Tobias Balle-Petersen wrote: > >> Doing everything from the top: >> >> 1. Stop bbstored >> 2. Check that pid-file does not exist >> 3. check for running instances of bbstored >> 4. Checkout code >> 5. ./bootstrap -> ./configure -> make >> 6. cd debug/test/basicserver >> 7. ../../bin/bbstored/bbstored -DVT testfiles/bbstored.conf -> No such >> file >> 8. ls ../../bin/bbstored -> "Empty dir" > > OK, I wasn't expecting that you would delete everything before running > those commands :-) That's why it didn't work. > >> 10. /root/merge/release/bin/bbstored/bbstored -DVT >> testfiles/bbstored.conf >> 09:50:04 Unknown error in getopt: returned '?' > > Anyway, this is enough to know that something weird is going on. > > Is that really a question mark between the quotes, or did it get mangled > by email? > > Could you try compiling the following test program for me: > > cat > test.c < #include > int main() { > #ifdef __GLIBC__ > puts("yes"); > #else > puts("no"); > #endif > } > gcc -o test test.c > ./test > > and let me know whether it outputs "yes" or "no"? > > Cheers, Chris. From boxbackup at fluffy.co.uk Fri Jun 29 11:01:36 2007 From: boxbackup at fluffy.co.uk (Matthias Rieber) Date: Fri, 29 Jun 2007 12:01:36 +0200 Subject: [Box Backup] restore file >2GB In-Reply-To: References: <467FCD66.7000206@paepstin.info> <468210D3.9010101@paepstin.info> <4683542C.7020400@paepstin.info> <46837CE3.5000800@paepstin.info> Message-ID: <4684D880.3070302@paepstin.info> Hello Christ, Chris Wilson wrote: > Hi Matthias, > > On Thu, 28 Jun 2007, Matthias Rieber wrote: > >>> OK, does anyone have a preference on whether I restore SINGLEPROCESS to >>> its old meaning, and add a new option for _really_ only one process :-) >>> or add a new option which just doesn't fork into the background, and >>> otherwise behaves as normal? >> >> I think it's better to add a new option for that, because SINGLEPROCESS >> is not the right name for that. > > OK, following your and Martin's guidance I've added a new option, -F, > which causes the daemon not to fork into the background, but still > accept multiple connections. > > Please could you update to the latest svn and check if this solves the > problem for you? (using -F instead of SINGLEPROCESS) I've tested chris_merge_1708. It seems to work as expected with daemontools. Thanks! matthias From boxbackup at fluffy.co.uk Fri Jun 29 11:32:34 2007 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Fri, 29 Jun 2007 12:32:34 +0200 Subject: [Box Backup] Type 'cd ; make' to build a module ? Message-ID: <4684DFC2.3040305@kontrapunkt.com> Hello... After having run ./configure when compiling boxbackup you get the message: Type 'cd ; make' to build a module It is unclear, to me, what directory this would be. These are the dirs in the base dir: drwxr-xr-x 2 root root 4,0K 2007-06-29 11:56 autom4te.cache drwxr-xr-x 9 root root 4,0K 2007-06-29 11:55 bin drwxr-xr-x 5 root root 4,0K 2007-06-29 12:30 debug drwxr-xr-x 4 root root 4,0K 2007-06-29 11:55 distribution drwxr-xr-x 6 root root 4,0K 2007-06-29 11:55 docs drwxr-xr-x 4 root root 4,0K 2007-06-29 11:55 documentation drwxr-xr-x 6 root root 4,0K 2007-06-29 12:30 infrastructure drwxr-xr-x 12 root root 4,0K 2007-06-29 11:55 lib drwxr-xr-x 2 root root 4,0K 2007-06-29 12:30 local drwxr-xr-x 3 root root 4,0K 2007-06-29 12:30 parcels drwxr-xr-x 5 root root 4,0K 2007-06-29 12:30 release drwxr-xr-x 14 root root 4,0K 2007-06-29 11:55 test Maybe the message could be improved? Thanks, Tobias From boxbackup at fluffy.co.uk Fri Jun 29 12:15:59 2007 From: boxbackup at fluffy.co.uk (James O'Gorman) Date: Fri, 29 Jun 2007 12:15:59 +0100 Subject: [Box Backup] Type 'cd ; make' to build a module ? In-Reply-To: <4684DFC2.3040305@kontrapunkt.com> References: <4684DFC2.3040305@kontrapunkt.com> Message-ID: <20070629111559.GJ62388@netinertia.co.uk> On Fri, Jun 29, 2007 at 12:32:34PM +0200, Tobias Balle-Petersen wrote: > Hello... > > After having run ./configure when compiling boxbackup you get the message: > Type 'cd ; make' to build a module > > It is unclear, to me, what directory this would be. A "module" is basically each program needed for Box (e.g. bbackupd, bbstored, etc.) You can actually just type "make" after "configure" and it will build everything. > Maybe the message could be improved? It can probably be removed altogether - I suspect not many people (other than developers) build the individual modules. James From boxbackup at fluffy.co.uk Fri Jun 29 12:26:18 2007 From: boxbackup at fluffy.co.uk (James O'Gorman) Date: Fri, 29 Jun 2007 12:26:18 +0100 Subject: [Box Backup] Type 'cd ; make' to build a module ? In-Reply-To: <20070629111559.GJ62388@netinertia.co.uk> References: <4684DFC2.3040305@kontrapunkt.com> <20070629111559.GJ62388@netinertia.co.uk> Message-ID: <20070629112618.GK62388@netinertia.co.uk> On Fri, Jun 29, 2007 at 12:15:59PM +0100, James O'Gorman wrote: > On Fri, Jun 29, 2007 at 12:32:34PM +0200, Tobias Balle-Petersen wrote: > > Hello... > > > > After having run ./configure when compiling boxbackup you get the message: > > Type 'cd ; make' to build a module > > > > It is unclear, to me, what directory this would be. [snip] > > Maybe the message could be improved? > > It can probably be removed altogether - I suspect not many people (other > than developers) build the individual modules. As an aside, this has just reminded me of something that bugs me a little - to build just the client or just the server you have to specify the path to the parcel as the make target (e.g. make parcels/boxbackup_$release_client_$os.tgz), whereas with the install targets we have nice, friendly "install-backup-client" and "install-backup-server" targets. If I submitted a ticket with a patch to create a more friendly build target, would it likely be accepted? James From boxbackup at fluffy.co.uk Fri Jun 29 12:29:54 2007 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Fri, 29 Jun 2007 13:29:54 +0200 Subject: [Box Backup] Type 'cd ; make' to build a module ? In-Reply-To: <20070629111559.GJ62388@netinertia.co.uk> References: <4684DFC2.3040305@kontrapunkt.com> <20070629111559.GJ62388@netinertia.co.uk> Message-ID: <4684ED32.2090603@kontrapunkt.com> James O'Gorman wrote: > A "module" is basically each program needed for Box (e.g. bbackupd, > bbstored, etc.) I understand the concept of modules. It's just that I have no idea where to actually go to compile just one module as instructed. > You can actually just type "make" after "configure" and it will build > everything. That's what I always do. Tobias From boxbackup at fluffy.co.uk Fri Jun 29 13:12:29 2007 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Fri, 29 Jun 2007 14:12:29 +0200 Subject: [Box Backup] Compiling boxbackup chris-merge on debian etch? In-Reply-To: References: <467FB654.2070107@kontrapunkt.com> <4683AECC.3010200@kontrapunkt.com> <4684B9D0.8050909@kontrapunkt.com> Message-ID: <4684F72D.7010401@kontrapunkt.com> Chris Wilson wrote: > Is that really a question mark between the quotes, or did it get mangled > by email? yes. Tobias From boxbackup at fluffy.co.uk Fri Jun 29 15:54:06 2007 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Fri, 29 Jun 2007 16:54:06 +0200 Subject: [Box Backup] Compiling boxbackup chris-merge on debian etch? In-Reply-To: <4684F72D.7010401@kontrapunkt.com> References: <467FB654.2070107@kontrapunkt.com> <4683AECC.3010200@kontrapunkt.com> <4684B9D0.8050909@kontrapunkt.com> <4684F72D.7010401@kontrapunkt.com> Message-ID: <46851D0E.2090707@kontrapunkt.com> It IS a question mark. Tobias Balle-Petersen wrote: > Chris Wilson wrote: > >> Is that really a question mark between the quotes, or did it get mangled >> by email? > > yes. > > Tobias > > _______________________________________________ > boxbackup mailing list > boxbackup at fluffy.co.uk > http://lists.warhead.org.uk/mailman/listinfo/boxbackup > From boxbackup at fluffy.co.uk Sat Jun 30 12:51:44 2007 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Sat, 30 Jun 2007 12:51:44 +0100 (BST) Subject: [Box Backup] Compiling boxbackup chris-merge on debian etch? In-Reply-To: <4684B9D0.8050909@kontrapunkt.com> References: <467FB654.2070107@kontrapunkt.com> <4683AECC.3010200@kontrapunkt.com> <4684B9D0.8050909@kontrapunkt.com> Message-ID: Hi Tobias, On Fri, 29 Jun 2007, Tobias Balle-Petersen wrote: > 10. /root/merge/release/bin/bbstored/bbstored -DVT testfiles/bbstored.conf > 09:50:04 Unknown error in getopt: returned '?' I've added some extra debugging to chris/merge. Please could you update to the latest version and try this again, and send me the complete output? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software |