From pjalajas at gigalock.com Mon Aug 1 18:49:35 2011 From: pjalajas at gigalock.com (Peter Jalajas, GigaLock Backup Services) Date: Mon, 1 Aug 2011 13:49:35 -0400 Subject: [Boxbackup-dev] Connection statistics NET_IN patch? Message-ID: Hi Chris, One of the methods I use from the server side to confirm that my clients are backing up, is to look at the "Connection statistics" "IN=" values. For large clients, though, the IN value can be quite large, even though no significant number of files are being backed up. I'm guess that is because the Client and Server are just exchanging long listings of files. Here is an example from my log: Jul 29 15:46:49 srv bbstored client=0x99999999[7083]: NOTICE: Connection statistics for BACKUP-99999999: IN=110 OUT=1534 Jul 29 19:49:30 srv bbstored client=0x99999999[7959]: NOTICE: Login from Client ID 0x99999999 Read/Write Jul 29 19:49:49 srv bbstored client=0x99999999[7959]: NOTICE: Session finished for Client ID 0x99999999 Jul 29 19:49:49 srv bbstored client=0x99999999[7959]: NOTICE: Connection statistics for BACKUP-99999999: IN=825 OUT=27193 Jul 29 23:50:02 srv bbstored client=0x99999999[8491]: NOTICE: Login from Client ID 0x99999999 Read/Write Jul 29 23:50:19 srv bbstored client=0x99999999[8491]: NOTICE: Session finished for Client ID 0x99999999 Jul 29 23:50:19 srv bbstored client=0x99999999[8491]: NOTICE: Connection statistics for BACKUP-99999999: IN=51646 OUT=156 Jul 30 03:52:53 srv bbstored client=0x99999999[9562]: NOTICE: Login from Client ID 0x99999999 Read/Write Jul 30 03:53:03 srv bbstored client=0x99999999[9562]: NOTICE: Session finished for Client ID 0x99999999 Jul 30 03:53:03 srv bbstored client=0x99999999[9562]: NOTICE: Connection statistics for BACKUP-99999999: IN=89 OUT=653 All of the action for that client happened at Jul 29 23:50:19. You can see I cut several strings from the default output already; my next step was to replace "IN=.*OUT.*\ " with the result of the calculation of "IN minus OUT"--if that number is large > 0, then some significant backup is happening.) I was about to add some code to my daily test script to do that calculation, but thought something like this (see the +++) might be acceptable for the masses: In: http://www.boxbackup.com/trac/browser/box/chris/general/bin/bbstored/BackupStoreDaemon.cpp?rev=1855 355 BOX_INFO("Connection statistics for " << commonName << ":" 356 " IN=" << s.GetBytesRead() << 357 " OUT=" << s.GetBytesWritten() << +++ " NET_IN=" << (s.GetBytesRead() - s.GetBytesWritten()) << 358 " TOTAL=" << (s.GetBytesRead() + s.GetBytesWritten())); What do you think? Thanks, Pete From chris at qwirx.com Mon Aug 1 23:22:39 2011 From: chris at qwirx.com (Chris Wilson) Date: Mon, 1 Aug 2011 23:22:39 +0100 (BST) Subject: [Boxbackup-dev] Latest Box Backup on Windows In-Reply-To: References: Message-ID: Hi Pete, Sorry for the delay in replying. On Mon, 11 Jul 2011, Peter Jalajas, GigaLock Backup Services wrote: >> Per http://www.boxbackup.org/trac/wiki/CompileWithVisualC I'm >> downloading Visual C++ 2010 Express, SlikSVN, and Perl now... > > Can you please confirm these steps in the procedure at: > https://www.boxbackup.org/trac/wiki/CompileWithVisualC > ------------- > cd \openssl-1.0.0d > perl Configure VC-WIN32 --prefix=\openssl` > ms\do_ms > nmake -f ms\ntdll.mak > nmake -f ms\ntdll.mak install > ------------- Well, it works for me, I'm not sure why it doesn't work for you. > After much flailing, involving running the prescribed commands several > times each with slightly different ignorant edits, But this might have something to do with it. > I'm getting this > result at the moment: [...] > CPUID_OBJ =x86cpuid.o This is what I have too. Could you check whether "#define OPENSSL_CPUID_OBJ" appears in your crypto/opensslconf.h file? It could be that OpenSSL was at some point configured for NO_ASM, and mem.obj was built with that setting, which creates a dependency on the _cleanse_ctr symbol which you have but I don't. You could try: nmake -f ms\ntdll.mak clean nmake -f ms\ntdll.mak and see if it then builds correctly. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \__/_/_/_//_/___/ | We are GNU : free your mind & your software | From chris at qwirx.com Mon Aug 1 22:54:20 2011 From: chris at qwirx.com (Chris Wilson) Date: Mon, 1 Aug 2011 22:54:20 +0100 (BST) Subject: [Boxbackup-dev] Latest Box Backup on Windows In-Reply-To: References: Message-ID: Hi Pete, On Mon, 11 Jul 2011, Peter Jalajas, GigaLock Backup Services wrote: > I then tried creating a Scheduled Task to do the same, but got these: > --- > WARNING: Quick compare used -- file attributes are not checked. > Failed to open 'C:\Documents and Settings\All Users\Documents': Access > is denied. (5) > WARNING: Exception thrown: CommonException(OSFileError) (C:\Documents > and Settings\All Users\Documents) at BackupQueries.cpp(1615) > --- > Not sure why I don't have permissions when run as a Scheduled Task. Which user does the Scheduled Task run as? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \__/_/_/_//_/___/ | We are GNU : free your mind & your software | From chris at qwirx.com Mon Aug 1 23:29:00 2011 From: chris at qwirx.com (Chris Wilson) Date: Mon, 1 Aug 2011 23:29:00 +0100 (BST) Subject: [Boxbackup-dev] Latest Box Backup on Windows In-Reply-To: References: Message-ID: Hi Pete, On Mon, 11 Jul 2011, Peter Jalajas, GigaLock Backup Services wrote: > While awaiting input re my openssl problem from my other email, I > figured I would try to move forward with some of the other compiling > steps, and got the following "Can't open..." errors in the "Configure > Box Backup" step. > > Suggestions welcome. Maybe the "Can't open..." "Configure Box Backup" > errors below are inconsequential? Or, maybe I just need to build > openssl first? Sorry, that one is my fault, please update to latest svn and run win32.bat again. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \__/_/_/_//_/___/ | We are GNU : free your mind & your software | From chris at qwirx.com Mon Aug 1 23:30:28 2011 From: chris at qwirx.com (Chris Wilson) Date: Mon, 1 Aug 2011 23:30:28 +0100 (BST) Subject: [Boxbackup-dev] Latest Box Backup on Windows In-Reply-To: <4E1C94A6.1090703@invis.net> References: <4E1C94A6.1090703@invis.net> Message-ID: Hi Charles, On Tue, 12 Jul 2011, Charles Lecklider wrote: > On 12/07/2011 05:06, Peter Jalajas, GigaLock Backup Services wrote: >> Dang. Thought I'd try the experimental work in progress MinGW compilation from >> https://www.boxbackup.org/trac/wiki/CompileWithMinGW > > Not sure how much of a rush you're in, but once I get my new laptop in a > few weeks I'll be back on my branch.... Yay! Welcome back! > IIRC, the perl script for OpenSSL doesn't generate a makefile that works > properly with VC10 - I had to build a project from scratch. It did work for me, I'm sorry if it doesn't work for you. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \__/_/_/_//_/___/ | We are GNU : free your mind & your software | From pjalajas at gigalock.com Tue Aug 2 03:26:15 2011 From: pjalajas at gigalock.com (Peter Jalajas, GigaLock Backup Services) Date: Mon, 1 Aug 2011 22:26:15 -0400 Subject: [Boxbackup-dev] Latest Box Backup on Windows In-Reply-To: References: <4E1C94A6.1090703@invis.net> Message-ID: Hi Chris and Charles, On Mon, Aug 1, 2011 at 6:30 PM, Chris Wilson wrote: > Hi Charles, > > On Tue, 12 Jul 2011, Charles Lecklider wrote: > >> On 12/07/2011 05:06, Peter Jalajas, GigaLock Backup Services wrote: >>> >>> Dang. ?Thought I'd try the experimental work in progress MinGW >>> compilation from >>> https://www.boxbackup.org/trac/wiki/CompileWithMinGW >> >> Not sure how much of a rush you're in, but once I get my new laptop in a >> few weeks I'll be back on my branch.... > > Yay! Welcome back! > >> IIRC, the perl script for OpenSSL doesn't generate a makefile that works >> properly with VC10 - I had to build a project from scratch. > > It did work for me, I'm sorry if it doesn't work for you. I've moved on, but I'm long-term interested in compiling Box Backup on Windows. I think there are 3 compiling environment options on the table: #1. Using MS Visual C++ 2010 Express #2. Using MinGW. #3. Using MinGW in Cygwin. I guess I'm not really interested in investing any more time in #1 for political and hassle reasons. I have no preference between #2 or #3. But I could be swayed by you. No rush--I look forward to your input, Charles! Thanks! Pete From chris at qwirx.com Tue Aug 2 09:49:54 2011 From: chris at qwirx.com (Chris Wilson) Date: Tue, 2 Aug 2011 09:49:54 +0100 (BST) Subject: [Boxbackup-dev] Latest Box Backup on Windows In-Reply-To: References: <4E1C94A6.1090703@invis.net> Message-ID: Hi Pete, On Mon, 1 Aug 2011, Peter Jalajas, GigaLock Backup Services wrote: > I've moved on, but I'm long-term interested in compiling Box Backup on > Windows. I think there are 3 compiling environment options on the > table: > #1. Using MS Visual C++ 2010 Express > #2. Using MinGW. > #3. Using MinGW in Cygwin. > I guess I'm not really interested in investing any more time in #1 for > political and hassle reasons. I have no preference between #2 or #3. > But I could be swayed by you. No rush--I look forward to your input, > Charles! #1 is the only one likely to ever support VSS, since the necessary COM interfaces aren't sufficiently documented by Microsoft to create a working interoperable set of headers for free compilers. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \__/_/_/_//_/___/ | We are GNU : free your mind & your software | From pjalajas at gigalock.com Wed Aug 3 04:23:14 2011 From: pjalajas at gigalock.com (Peter Jalajas, GigaLock Backup Services) Date: Tue, 2 Aug 2011 23:23:14 -0400 Subject: [Boxbackup-dev] Latest Box Backup on Windows In-Reply-To: References: <4E1C94A6.1090703@invis.net> Message-ID: Hi Chris, On Tue, Aug 2, 2011 at 4:49 AM, Chris Wilson wrote: > Hi Pete, > > On Mon, 1 Aug 2011, Peter Jalajas, GigaLock Backup Services wrote: > >> I've moved on, but I'm long-term interested in compiling Box Backup on >> Windows. ?I think there are 3 compiling environment options on the >> table: >> #1. ?Using MS Visual C++ 2010 Express >> #2. ?Using MinGW. >> #3. ?Using MinGW in Cygwin. >> I guess I'm not really interested in investing any more time in #1 for >> political and hassle reasons. ?I have no preference between #2 or #3. >> But I could be swayed by you. ?No rush--I look forward to your input, >> Charles! > > #1 is the only one likely to ever support VSS, since the necessary COM > interfaces aren't sufficiently documented by Microsoft to create a working > interoperable set of headers for free compilers. Ugh... So, would compiling with #1 mean that if one wanted to use VSS, one wouldn't need to download http://www.microsoft.com/download/en/details.aspx?id=23490 to create a temporary or non-persistent snapshot before each sync, perhaps with a cmd/batch file a la http://msdn.microsoft.com/en-us/library/bb530726(v=vs.85).aspx#accessing_nonpersistent_shadow_copies I see now that Visual C++ 2010 Express is no cost, but requires registration. Downloading now on my new Win7 laptop.... Thanks, Chris, Pete From lists at invis.net Thu Aug 4 11:52:58 2011 From: lists at invis.net (Charles Lecklider) Date: Thu, 04 Aug 2011 11:52:58 +0100 Subject: [Boxbackup-dev] Latest Box Backup on Windows In-Reply-To: References: <4E1C94A6.1090703@invis.net> Message-ID: <4E3A7A0A.3040207@invis.net> On 03/08/2011 04:23, Peter Jalajas, GigaLock Backup Services wrote: > I see now that Visual C++ 2010 Express is no cost, but requires > registration. Downloading now on my new Win7 laptop.... Express has a number of problems, not least of which is no x64 support. Once I get my branch merged back into trunk I plan to create regular builds - signed exes, MSI installer, x86 and x64. Until then, if you go the Express route I can only wish you luck ;-) -C From chris at qwirx.com Thu Aug 4 21:29:03 2011 From: chris at qwirx.com (Chris Wilson) Date: Thu, 4 Aug 2011 21:29:03 +0100 (BST) Subject: [Boxbackup-dev] Latest Box Backup on Windows In-Reply-To: <4E3A7A0A.3040207@invis.net> References: <4E1C94A6.1090703@invis.net> <4E3A7A0A.3040207@invis.net> Message-ID: Hi Charles, On Thu, 4 Aug 2011, Charles Lecklider wrote: > On 03/08/2011 04:23, Peter Jalajas, GigaLock Backup Services wrote: >> I see now that Visual C++ 2010 Express is no cost, but requires >> registration. Downloading now on my new Win7 laptop.... > > Express has a number of problems, not least of which is no x64 support. Are you sure there's no x64 support? I thought I saw options for it in the target architecture for the C++ compiler, didn't try it though. > Once I get my branch merged back into trunk I plan to create regular > builds - signed exes, MSI installer, x86 and x64. Are you happy to merge yourself or can I be of any assistance? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \__/_/_/_//_/___/ | We are GNU : free your mind & your software | From trac at boxbackup.org Sat Aug 6 12:00:00 2011 From: trac at boxbackup.org (trac at boxbackup.org) Date: Sat, 6 Aug 2011 12:00:00 +0100 (BST) Subject: [Boxbackup-dev] Current open tickets Message-ID: <20110806110001.2264918BADC@www.boxbackup.org> Note: to view an indiviual ticket, use: https://www.boxbackup.org/trac/ticket/(number) The following is a listing of current problems submitted by Box Backup users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Ticket Owner Component Summary - ------ ------ ------------- ------------------------------------------------------------ n 4 martin box libraries Port Box Backup to AIX n 6 box libraries Contribute code: SMTP client, HTTP server, Database drivers, n 7 box libraries Improve restore speed on local repositories n 8 chris box libraries Improve handling of directories with many files n 13 chris bbackupd Fix file locking on Windows n 14 chris bbackupd Fix large file issues on Windows n 16 chris bbackupquery Restore deleted directories may fail a 17 chris bbackupquery List files using wildcards a 20 chris bbackupctl bbackupctl reload reports prior settings n 45 ben bbackupd File diff performance patch (reduced disk IO and wall time n 46 chris bbackupd bbackupd only ever saves reverse diffs, corrupted files on s n 47 chris bbackupd Account numbers greater than 2^31 (0x7fffffff) do not work c n 48 chris bbackupd Locations that don't exist on first run are never tried agai n 49 chris bbackupd ID map (rename tracking) broken since [288] n 50 chris bbackupquery No way to capture stderr under Windows n 51 chris bbackupd No way to force bbackupd to re-upload files under Windows n 52 chris bbackupd Unable to control the maintenance of old vs. deleted files n 53 chris bbackupd Comparing root directory locations does not work under Windo n 54 chris bbackupd Locations not found on disk (e.g. unmounted filesystems) can n 55 chris bbackupd Should store and preserve directory timestamps n 56 bbackupquery Windows: User can polute restore directory by adding a trail n 57 ben bbackupd Create boxbackupresume and other files in DataDirectory n 58 ben bbackupd bbackupquery connection timeout results in error message, sh n 59 ben bbackupd Inconsistent treatment of NotifyScript between Box Backup an n 60 ben bbstored Case sensitivity between bbstored-certs and Boxi n 61 ben bbackupd File statistics: Log the number of uploaded files in additio n 62 ben bbackupd Backups of deleted files may be removed very quickly by hous a 63 chris bbackupd Support hard links in directories n 65 ben bbackupd Some file attributes under Windows are not backed up n 66 ben bbackupd Windows ACL support a 67 chris bbackupd Add mutexes for Win32 (client) to enable detection of runnin n 68 ben bbackupd More details when ReadError occurs n 69 bbackupquery CRTL+C closes bbackupquery console window under Windows n 70 ben bbackupd Non-ascii character cause error for notifyscript path n 71 ben bbackupd bbackupd.log gets randomly deleted n 72 test suite Patch intercept.h and intercept.c for NetBSD 4 and 5 n 74 bbackupquery Reconnect bbackupquery automatically, or at least have a "co n 75 ben bbackupd Restore times wrong, times on store correct 38 tickets total. From james at netinertia.co.uk Mon Aug 8 23:53:18 2011 From: james at netinertia.co.uk (James O'Gorman) Date: Mon, 8 Aug 2011 23:53:18 +0100 Subject: [Boxbackup-dev] QDBM missing from distribution generator Message-ID: <20110808225318.GB59084@netinertia.co.uk> Hi Chris, Looks like qdbm/ is missing from the distribution generator. I guess it needs to be added under the 'LICENSE none' section, but not sure whether it should go in the common or boxbackup distribution file. I'll see about adding a check to the CI system to build the distribution too. James From trac at boxbackup.org Sat Aug 13 12:00:01 2011 From: trac at boxbackup.org (trac at boxbackup.org) Date: Sat, 13 Aug 2011 12:00:01 +0100 (BST) Subject: [Boxbackup-dev] Current open tickets Message-ID: <20110813110001.39B43194B7D@www.boxbackup.org> Note: to view an indiviual ticket, use: https://www.boxbackup.org/trac/ticket/(number) The following is a listing of current problems submitted by Box Backup users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Ticket Owner Component Summary - ------ ------ ------------- ------------------------------------------------------------ n 4 martin box libraries Port Box Backup to AIX n 6 box libraries Contribute code: SMTP client, HTTP server, Database drivers, n 7 box libraries Improve restore speed on local repositories n 8 chris box libraries Improve handling of directories with many files n 13 chris bbackupd Fix file locking on Windows n 14 chris bbackupd Fix large file issues on Windows n 16 chris bbackupquery Restore deleted directories may fail a 17 chris bbackupquery List files using wildcards a 20 chris bbackupctl bbackupctl reload reports prior settings n 45 ben bbackupd File diff performance patch (reduced disk IO and wall time n 46 chris bbackupd bbackupd only ever saves reverse diffs, corrupted files on s n 47 chris bbackupd Account numbers greater than 2^31 (0x7fffffff) do not work c n 48 chris bbackupd Locations that don't exist on first run are never tried agai n 49 chris bbackupd ID map (rename tracking) broken since [288] n 50 chris bbackupquery No way to capture stderr under Windows n 51 chris bbackupd No way to force bbackupd to re-upload files under Windows n 52 chris bbackupd Unable to control the maintenance of old vs. deleted files n 53 chris bbackupd Comparing root directory locations does not work under Windo n 54 chris bbackupd Locations not found on disk (e.g. unmounted filesystems) can n 55 chris bbackupd Should store and preserve directory timestamps n 56 bbackupquery Windows: User can polute restore directory by adding a trail n 57 ben bbackupd Create boxbackupresume and other files in DataDirectory n 58 ben bbackupd bbackupquery connection timeout results in error message, sh n 59 ben bbackupd Inconsistent treatment of NotifyScript between Box Backup an n 60 ben bbstored Case sensitivity between bbstored-certs and Boxi n 61 ben bbackupd File statistics: Log the number of uploaded files in additio n 62 ben bbackupd Backups of deleted files may be removed very quickly by hous a 63 chris bbackupd Support hard links in directories n 65 ben bbackupd Some file attributes under Windows are not backed up n 66 ben bbackupd Windows ACL support a 67 chris bbackupd Add mutexes for Win32 (client) to enable detection of runnin n 68 ben bbackupd More details when ReadError occurs n 69 bbackupquery CRTL+C closes bbackupquery console window under Windows n 70 ben bbackupd Non-ascii character cause error for notifyscript path n 71 ben bbackupd bbackupd.log gets randomly deleted n 72 test suite Patch intercept.h and intercept.c for NetBSD 4 and 5 n 74 bbackupquery Reconnect bbackupquery automatically, or at least have a "co n 75 ben bbackupd Restore times wrong, times on store correct 38 tickets total. From trac at boxbackup.org Sat Aug 20 12:00:01 2011 From: trac at boxbackup.org (trac at boxbackup.org) Date: Sat, 20 Aug 2011 12:00:01 +0100 (BST) Subject: [Boxbackup-dev] Current open tickets Message-ID: <20110820110001.52F5B194BA9@www.boxbackup.org> Note: to view an indiviual ticket, use: https://www.boxbackup.org/trac/ticket/(number) The following is a listing of current problems submitted by Box Backup users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Ticket Owner Component Summary - ------ ------ ------------- ------------------------------------------------------------ n 4 martin box libraries Port Box Backup to AIX n 6 box libraries Contribute code: SMTP client, HTTP server, Database drivers, n 7 box libraries Improve restore speed on local repositories n 8 chris box libraries Improve handling of directories with many files n 13 chris bbackupd Fix file locking on Windows n 14 chris bbackupd Fix large file issues on Windows n 16 chris bbackupquery Restore deleted directories may fail a 17 chris bbackupquery List files using wildcards a 20 chris bbackupctl bbackupctl reload reports prior settings n 45 ben bbackupd File diff performance patch (reduced disk IO and wall time n 46 chris bbackupd bbackupd only ever saves reverse diffs, corrupted files on s n 47 chris bbackupd Account numbers greater than 2^31 (0x7fffffff) do not work c n 48 chris bbackupd Locations that don't exist on first run are never tried agai n 49 chris bbackupd ID map (rename tracking) broken since [288] n 50 chris bbackupquery No way to capture stderr under Windows n 51 chris bbackupd No way to force bbackupd to re-upload files under Windows n 52 chris bbackupd Unable to control the maintenance of old vs. deleted files n 53 chris bbackupd Comparing root directory locations does not work under Windo n 54 chris bbackupd Locations not found on disk (e.g. unmounted filesystems) can n 55 chris bbackupd Should store and preserve directory timestamps n 56 bbackupquery Windows: User can polute restore directory by adding a trail n 57 ben bbackupd Create boxbackupresume and other files in DataDirectory n 58 ben bbackupd bbackupquery connection timeout results in error message, sh n 59 ben bbackupd Inconsistent treatment of NotifyScript between Box Backup an n 60 ben bbstored Case sensitivity between bbstored-certs and Boxi n 61 ben bbackupd File statistics: Log the number of uploaded files in additio n 62 ben bbackupd Backups of deleted files may be removed very quickly by hous a 63 chris bbackupd Support hard links in directories n 65 ben bbackupd Some file attributes under Windows are not backed up n 66 ben bbackupd Windows ACL support a 67 chris bbackupd Add mutexes for Win32 (client) to enable detection of runnin n 68 ben bbackupd More details when ReadError occurs n 69 bbackupquery CRTL+C closes bbackupquery console window under Windows n 70 ben bbackupd Non-ascii character cause error for notifyscript path n 71 ben bbackupd bbackupd.log gets randomly deleted n 72 test suite Patch intercept.h and intercept.c for NetBSD 4 and 5 n 74 bbackupquery Reconnect bbackupquery automatically, or at least have a "co n 75 ben bbackupd Restore times wrong, times on store correct 38 tickets total. From chris at qwirx.com Sat Aug 27 10:47:54 2011 From: chris at qwirx.com (Chris Wilson) Date: Sat, 27 Aug 2011 11:47:54 +0200 (CAT) Subject: [Boxbackup-dev] QDBM missing from distribution generator In-Reply-To: <20110808225318.GB59084@netinertia.co.uk> References: <20110808225318.GB59084@netinertia.co.uk> Message-ID: Hi James, On Mon, 8 Aug 2011, James O'Gorman wrote: > Looks like qdbm/ is missing from the distribution generator. > > I guess it needs to be added under the 'LICENSE none' section, but not > sure whether it should go in the common or boxbackup distribution file. I guess you did this already, thanks :) Cheers, Chris. From chris at qwirx.com Sat Aug 27 11:39:40 2011 From: chris at qwirx.com (Chris Wilson) Date: Sat, 27 Aug 2011 12:39:40 +0200 (CAT) Subject: [Boxbackup-dev] Latest Box Backup on Windows In-Reply-To: References: <4E1C94A6.1090703@invis.net> Message-ID: Hi Pete, On Tue, 2 Aug 2011, Peter Jalajas, GigaLock Backup Services wrote: >>> I've moved on, but I'm long-term interested in compiling Box Backup on >>> Windows. ?I think there are 3 compiling environment options on the >>> table: >>> #1. ?Using MS Visual C++ 2010 Express >> >> #1 is the only one likely to ever support VSS, since the necessary COM >> interfaces aren't sufficiently documented by Microsoft to create a working >> interoperable set of headers for free compilers. > > So, would compiling with #1 mean that if one wanted to use VSS, one > wouldn't need to download > http://www.microsoft.com/download/en/details.aspx?id=23490 > to create a temporary or non-persistent snapshot before each sync, > perhaps with a cmd/batch file a la > http://msdn.microsoft.com/en-us/library/bb530726(v=vs.85).aspx#accessing_nonpersistent_shadow_copies Yes, that's correct, it has built-in support for VSS, but it's highly experimental and the only test report I've received so far is that it crashes, although it works for me and I haven't figured out why it crashes for him yet. Cheers, Chris. From james at netinertia.co.uk Sat Aug 27 11:44:09 2011 From: james at netinertia.co.uk (James O'Gorman) Date: Sat, 27 Aug 2011 11:44:09 +0100 Subject: [Boxbackup-dev] QDBM missing from distribution generator In-Reply-To: References: <20110808225318.GB59084@netinertia.co.uk> Message-ID: <20110827104407.GH70806@netinertia.co.uk> On Sat, Aug 27, 2011 at 11:47:54AM +0200, Chris Wilson wrote: > Hi James, > > On Mon, 8 Aug 2011, James O'Gorman wrote: > > > Looks like qdbm/ is missing from the distribution generator. > > > > I guess it needs to be added under the 'LICENSE none' section, but not > > sure whether it should go in the common or boxbackup distribution file. > > I guess you did this already, thanks :) Ah, yep, I figured it out eventually :-) James From trac at boxbackup.org Sat Aug 27 12:00:00 2011 From: trac at boxbackup.org (trac at boxbackup.org) Date: Sat, 27 Aug 2011 12:00:00 +0100 (BST) Subject: [Boxbackup-dev] Current open tickets Message-ID: <20110827110001.18C3B199D6F@www.boxbackup.org> Note: to view an indiviual ticket, use: https://www.boxbackup.org/trac/ticket/(number) The following is a listing of current problems submitted by Box Backup users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Ticket Owner Component Summary - ------ ------ ------------- ------------------------------------------------------------ n 4 martin box libraries Port Box Backup to AIX n 6 box libraries Contribute code: SMTP client, HTTP server, Database drivers, n 7 box libraries Improve restore speed on local repositories n 8 chris box libraries Improve handling of directories with many files n 13 chris bbackupd Fix file locking on Windows n 14 chris bbackupd Fix large file issues on Windows n 16 chris bbackupquery Restore deleted directories may fail a 17 chris bbackupquery List files using wildcards a 20 chris bbackupctl bbackupctl reload reports prior settings n 45 ben bbackupd File diff performance patch (reduced disk IO and wall time n 46 chris bbackupd bbackupd only ever saves reverse diffs, corrupted files on s n 47 chris bbackupd Account numbers greater than 2^31 (0x7fffffff) do not work c n 48 chris bbackupd Locations that don't exist on first run are never tried agai n 49 chris bbackupd ID map (rename tracking) broken since [288] n 50 chris bbackupquery No way to capture stderr under Windows n 51 chris bbackupd No way to force bbackupd to re-upload files under Windows n 52 chris bbackupd Unable to control the maintenance of old vs. deleted files n 53 chris bbackupd Comparing root directory locations does not work under Windo n 54 chris bbackupd Locations not found on disk (e.g. unmounted filesystems) can n 55 chris bbackupd Should store and preserve directory timestamps n 56 bbackupquery Windows: User can polute restore directory by adding a trail n 57 ben bbackupd Create boxbackupresume and other files in DataDirectory n 58 ben bbackupd bbackupquery connection timeout results in error message, sh n 59 ben bbackupd Inconsistent treatment of NotifyScript between Box Backup an n 60 ben bbstored Case sensitivity between bbstored-certs and Boxi n 61 ben bbackupd File statistics: Log the number of uploaded files in additio n 62 ben bbackupd Backups of deleted files may be removed very quickly by hous a 63 chris bbackupd Support hard links in directories n 65 ben bbackupd Some file attributes under Windows are not backed up n 66 ben bbackupd Windows ACL support a 67 chris bbackupd Add mutexes for Win32 (client) to enable detection of runnin n 68 ben bbackupd More details when ReadError occurs n 69 bbackupquery CRTL+C closes bbackupquery console window under Windows n 70 ben bbackupd Non-ascii character cause error for notifyscript path n 71 ben bbackupd bbackupd.log gets randomly deleted n 72 test suite Patch intercept.h and intercept.c for NetBSD 4 and 5 n 74 bbackupquery Reconnect bbackupquery automatically, or at least have a "co n 75 ben bbackupd Restore times wrong, times on store correct 38 tickets total. From chris at qwirx.com Sat Aug 27 12:17:02 2011 From: chris at qwirx.com (Chris Wilson) Date: Sat, 27 Aug 2011 13:17:02 +0200 (CAT) Subject: [Boxbackup-dev] What does this mean? In-Reply-To: <4E0CEFF6.4090705@molgaard.org> References: <4DF81CDF.60104@molgaard.org> <4DFA5508.8020100@molgaard.org> <4DFB8B36.3040609@molgaard.org> <4E003656.1010104@molgaard.org> <4E0CDA69.5000501@molgaard.org> <4E0CEFF6.4090705@molgaard.org> Message-ID: Hi Sune, On Thu, 30 Jun 2011, Sune M?lgaard wrote: >> Thanks! You helped me to find a bug with reading the old-style >> BackupStoreInfo headers. Please could you update to the latest trunk and >> build a new bbstored to see if it fixes the problem? > > NP, but now I get : > > Jun 30 23:49:16 jadis bbstored client=0x075ab23f[27724]: WARNING: Exception > thrown: BackupStoreException(StoreInfoBlockDeltaMakesValueNegative) at > BackupStoreInfo.cpp(499) [...] > I'll run a check fix and retry and see if that helps... Did the check fix solve the problem? Have you had any recurrence since? Cheers, Chris. From chris at qwirx.com Sun Aug 28 16:46:10 2011 From: chris at qwirx.com (Chris Wilson) Date: Sun, 28 Aug 2011 17:46:10 +0200 (CAT) Subject: [Boxbackup-dev] Connection statistics NET_IN patch? In-Reply-To: References: Message-ID: Hi Pete, On Mon, 1 Aug 2011, Peter Jalajas, GigaLock Backup Services wrote: > All of the action for that client happened at Jul 29 23:50:19. You > can see I cut several strings from the default output already; my next > step was to replace "IN=.*OUT.*\ " with the result of the calculation > of "IN minus OUT"--if that number is large > 0, then some significant > backup is happening.) > > I was about to add some code to my daily test script to do that > calculation, but thought something like this (see the +++) might be > acceptable for the masses: > > In: http://www.boxbackup.com/trac/browser/box/chris/general/bin/bbstored/BackupStoreDaemon.cpp?rev=1855 > 355 BOX_INFO("Connection statistics for " << commonName << ":" > 356 " IN=" << s.GetBytesRead() << > 357 " OUT=" << s.GetBytesWritten() << > +++ " NET_IN=" << (s.GetBytesRead() - s.GetBytesWritten()) << > 358 " TOTAL=" << (s.GetBytesRead() + s.GetBytesWritten())); > > What do you think? Committed. Cheers, Chris. From sune at molgaard.org Sun Aug 28 19:00:17 2011 From: sune at molgaard.org (=?ISO-8859-1?Q?Sune_M=F8lgaard?=) Date: Sun, 28 Aug 2011 20:00:17 +0200 Subject: [Boxbackup-dev] What does this mean? In-Reply-To: References: <4DF81CDF.60104@molgaard.org> <4DFA5508.8020100@molgaard.org> <4DFB8B36.3040609@molgaard.org> <4E003656.1010104@molgaard.org> <4E0CDA69.5000501@molgaard.org> <4E0CEFF6.4090705@molgaard.org> Message-ID: <4E5A8231.4000103@molgaard.org> Chris Wilson wrote: > > Did the check fix solve the problem? Have you had any recurrence since? > > Cheers, Chris. Hi Chris, Sorry for not getting back earlier, but yes, it seemed to do the trick. IIRC, I had one more (possibly unrelated) incident of an exception later, which was remedied by a trunk check fix as well. Sorry for not reporting that, since in hindsight it might have been helpful for preventing corruptions later on, but it was late at night, and it was fixed immediately. Worth noting, however, is that whenever I reboot the client machine that holds that specific account, I will get a backup-error email - the cause of which I cannot pinpoint in the logs, but will get a backup-ok email shortly afterwards, so it might just be caused by some or other service being started prematurely. That said, however, the backup-ok email actually says that there is an error, instead of saying what I believe it means, that there was a successful backup, immediately following a previous error? Cheers, Sune -- Sleep -- the most beautiful experience in life -- except drink. - W. C. Fields From chris at qwirx.com Sun Aug 28 20:22:06 2011 From: chris at qwirx.com (Chris Wilson) Date: Sun, 28 Aug 2011 21:22:06 +0200 (CAT) Subject: [Boxbackup-dev] What does this mean? In-Reply-To: <4E5A8231.4000103@molgaard.org> References: <4DF81CDF.60104@molgaard.org> <4DFA5508.8020100@molgaard.org> <4DFB8B36.3040609@molgaard.org> <4E003656.1010104@molgaard.org> <4E0CDA69.5000501@molgaard.org> <4E0CEFF6.4090705@molgaard.org> <4E5A8231.4000103@molgaard.org> Message-ID: Hi Sune, On Sun, 28 Aug 2011, Sune M?lgaard wrote: > Sorry for not getting back earlier, but yes, it seemed to do the trick. Great, thanks :) > IIRC, I had one more (possibly unrelated) incident of an exception > later, which was remedied by a trunk check fix as well. Sorry for not > reporting that, since in hindsight it might have been helpful for > preventing corruptions later on, but it was late at night, and it was > fixed immediately. OK, if you see it again, or anything like it, please let us know. > Worth noting, however, is that whenever I reboot the client machine that > holds that specific account, I will get a backup-error email - the cause > of which I cannot pinpoint in the logs, but will get a backup-ok email > shortly afterwards, so it might just be caused by some or other service > being started prematurely. What exactly does the email say? What does your notify script say about backup-error? > That said, however, the backup-ok email actually says that there is an > error, instead of saying what I believe it means, that there was a > successful backup, immediately following a previous error? That's odd. It should not report anything at all for a backup-ok event. What does the notify script say about backup-ok? Did you upgrade from a previous version of Box Backup and keep your old notify script? Cheers, Chris.