From trac at boxbackup.org Sat Apr 2 12:00:00 2011 From: trac at boxbackup.org (trac at boxbackup.org) Date: Sat, 2 Apr 2011 12:00:00 +0100 (BST) Subject: [Boxbackup-dev] Current open tickets Message-ID: <20110402110000.94962E73AC@www.boxbackup.org> Note: to view an indiviual ticket, use: https://www.boxbackup.org/trac/ticket/(number) The following is a listing of current problems submitted by Box Backup users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Ticket Owner Component Summary - ------ ------ ------------- ------------------------------------------------------------ n 4 martin box libraries Port Box Backup to AIX n 6 box libraries Contribute code: SMTP client, HTTP server, Database drivers, n 7 box libraries Improve restore speed on local repositories n 8 chris box libraries Improve handling of directories with many files n 13 chris bbackupd Fix file locking on Windows n 14 chris bbackupd Fix large file issues on Windows n 16 chris bbackupquery Restore deleted directories may fail a 17 chris bbackupquery List files using wildcards a 20 chris bbackupctl bbackupctl reload reports prior settings n 45 ben bbackupd File diff performance patch (reduced disk IO and wall time n 46 chris bbackupd bbackupd only ever saves reverse diffs, corrupted files on s n 47 chris bbackupd Account numbers greater than 2^31 (0x7fffffff) do not work c n 48 chris bbackupd Locations that don't exist on first run are never tried agai n 49 chris bbackupd ID map (rename tracking) broken since [288] n 50 chris bbackupquery No way to capture stderr under Windows n 51 chris bbackupd No way to force bbackupd to re-upload files under Windows n 52 chris bbackupd Unable to control the maintenance of old vs. deleted files n 53 chris bbackupd Comparing root directory locations does not work under Windo n 54 chris bbackupd Locations not found on disk (e.g. unmounted filesystems) can n 55 chris bbackupd Should store and preserve directory timestamps n 56 bbackupquery Windows: User can polute restore directory by adding a trail n 57 ben bbackupd Create boxbackupresume and other files in DataDirectory n 58 ben bbackupd bbackupquery connection timeout results in error message, sh n 59 ben bbackupd Inconsistent treatment of NotifyScript between Box Backup an n 60 ben bbstored Case sensitivity between bbstored-certs and Boxi n 61 ben bbackupd File statistics: Log the number of uploaded files in additio n 62 ben bbackupd Backups of deleted files may be removed very quickly by hous a 63 chris bbackupd Support hard links in directories n 65 ben bbackupd Some file attributes under Windows are not backed up n 66 ben bbackupd Windows ACL support a 67 chris bbackupd Add mutexes for Win32 (client) to enable detection of runnin n 68 ben bbackupd More details when ReadError occurs n 69 bbackupquery CRTL+C closes bbackupquery console window under Windows n 70 ben bbackupd Non-ascii character cause error for notifyscript path n 71 ben bbackupd bbackupd.log gets randomly deleted n 72 test suite Patch intercept.h and intercept.c for NetBSD 4 and 5 n 74 bbackupquery Reconnect bbackupquery automatically, or at least have a "co n 75 ben bbackupd Restore times wrong, times on store correct 38 tickets total. From trac at boxbackup.org Sat Apr 16 12:00:02 2011 From: trac at boxbackup.org (trac at boxbackup.org) Date: Sat, 16 Apr 2011 12:00:02 +0100 (BST) Subject: [Boxbackup-dev] Current open tickets Message-ID: <20110416110002.F2BB5E78C8@www.boxbackup.org> Note: to view an indiviual ticket, use: https://www.boxbackup.org/trac/ticket/(number) The following is a listing of current problems submitted by Box Backup users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Ticket Owner Component Summary - ------ ------ ------------- ------------------------------------------------------------ n 4 martin box libraries Port Box Backup to AIX n 6 box libraries Contribute code: SMTP client, HTTP server, Database drivers, n 7 box libraries Improve restore speed on local repositories n 8 chris box libraries Improve handling of directories with many files n 13 chris bbackupd Fix file locking on Windows n 14 chris bbackupd Fix large file issues on Windows n 16 chris bbackupquery Restore deleted directories may fail a 17 chris bbackupquery List files using wildcards a 20 chris bbackupctl bbackupctl reload reports prior settings n 45 ben bbackupd File diff performance patch (reduced disk IO and wall time n 46 chris bbackupd bbackupd only ever saves reverse diffs, corrupted files on s n 47 chris bbackupd Account numbers greater than 2^31 (0x7fffffff) do not work c n 48 chris bbackupd Locations that don't exist on first run are never tried agai n 49 chris bbackupd ID map (rename tracking) broken since [288] n 50 chris bbackupquery No way to capture stderr under Windows n 51 chris bbackupd No way to force bbackupd to re-upload files under Windows n 52 chris bbackupd Unable to control the maintenance of old vs. deleted files n 53 chris bbackupd Comparing root directory locations does not work under Windo n 54 chris bbackupd Locations not found on disk (e.g. unmounted filesystems) can n 55 chris bbackupd Should store and preserve directory timestamps n 56 bbackupquery Windows: User can polute restore directory by adding a trail n 57 ben bbackupd Create boxbackupresume and other files in DataDirectory n 58 ben bbackupd bbackupquery connection timeout results in error message, sh n 59 ben bbackupd Inconsistent treatment of NotifyScript between Box Backup an n 60 ben bbstored Case sensitivity between bbstored-certs and Boxi n 61 ben bbackupd File statistics: Log the number of uploaded files in additio n 62 ben bbackupd Backups of deleted files may be removed very quickly by hous a 63 chris bbackupd Support hard links in directories n 65 ben bbackupd Some file attributes under Windows are not backed up n 66 ben bbackupd Windows ACL support a 67 chris bbackupd Add mutexes for Win32 (client) to enable detection of runnin n 68 ben bbackupd More details when ReadError occurs n 69 bbackupquery CRTL+C closes bbackupquery console window under Windows n 70 ben bbackupd Non-ascii character cause error for notifyscript path n 71 ben bbackupd bbackupd.log gets randomly deleted n 72 test suite Patch intercept.h and intercept.c for NetBSD 4 and 5 n 74 bbackupquery Reconnect bbackupquery automatically, or at least have a "co n 75 ben bbackupd Restore times wrong, times on store correct 38 tickets total. From trac at boxbackup.org Sat Apr 23 12:00:00 2011 From: trac at boxbackup.org (trac at boxbackup.org) Date: Sat, 23 Apr 2011 12:00:00 +0100 (BST) Subject: [Boxbackup-dev] Current open tickets Message-ID: <20110423110000.EA402E7A7D@www.boxbackup.org> Note: to view an indiviual ticket, use: https://www.boxbackup.org/trac/ticket/(number) The following is a listing of current problems submitted by Box Backup users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Ticket Owner Component Summary - ------ ------ ------------- ------------------------------------------------------------ n 4 martin box libraries Port Box Backup to AIX n 6 box libraries Contribute code: SMTP client, HTTP server, Database drivers, n 7 box libraries Improve restore speed on local repositories n 8 chris box libraries Improve handling of directories with many files n 13 chris bbackupd Fix file locking on Windows n 14 chris bbackupd Fix large file issues on Windows n 16 chris bbackupquery Restore deleted directories may fail a 17 chris bbackupquery List files using wildcards a 20 chris bbackupctl bbackupctl reload reports prior settings n 45 ben bbackupd File diff performance patch (reduced disk IO and wall time n 46 chris bbackupd bbackupd only ever saves reverse diffs, corrupted files on s n 47 chris bbackupd Account numbers greater than 2^31 (0x7fffffff) do not work c n 48 chris bbackupd Locations that don't exist on first run are never tried agai n 49 chris bbackupd ID map (rename tracking) broken since [288] n 50 chris bbackupquery No way to capture stderr under Windows n 51 chris bbackupd No way to force bbackupd to re-upload files under Windows n 52 chris bbackupd Unable to control the maintenance of old vs. deleted files n 53 chris bbackupd Comparing root directory locations does not work under Windo n 54 chris bbackupd Locations not found on disk (e.g. unmounted filesystems) can n 55 chris bbackupd Should store and preserve directory timestamps n 56 bbackupquery Windows: User can polute restore directory by adding a trail n 57 ben bbackupd Create boxbackupresume and other files in DataDirectory n 58 ben bbackupd bbackupquery connection timeout results in error message, sh n 59 ben bbackupd Inconsistent treatment of NotifyScript between Box Backup an n 60 ben bbstored Case sensitivity between bbstored-certs and Boxi n 61 ben bbackupd File statistics: Log the number of uploaded files in additio n 62 ben bbackupd Backups of deleted files may be removed very quickly by hous a 63 chris bbackupd Support hard links in directories n 65 ben bbackupd Some file attributes under Windows are not backed up n 66 ben bbackupd Windows ACL support a 67 chris bbackupd Add mutexes for Win32 (client) to enable detection of runnin n 68 ben bbackupd More details when ReadError occurs n 69 bbackupquery CRTL+C closes bbackupquery console window under Windows n 70 ben bbackupd Non-ascii character cause error for notifyscript path n 71 ben bbackupd bbackupd.log gets randomly deleted n 72 test suite Patch intercept.h and intercept.c for NetBSD 4 and 5 n 74 bbackupquery Reconnect bbackupquery automatically, or at least have a "co n 75 ben bbackupd Restore times wrong, times on store correct 38 tickets total. From james at netinertia.co.uk Sun Apr 24 12:56:04 2011 From: james at netinertia.co.uk (James O'Gorman) Date: Sun, 24 Apr 2011 12:56:04 +0100 Subject: [Boxbackup-dev] File/dir permissions in test suite Message-ID: <20110424115604.GD2320@netinertia.co.uk> Hi all (mostly Chris I guess :-) ) I've noticed that the build bots occasionally bomb out when trying to clean up after a run due to some odd permissions on files and directories creating during the restore part of the debug test suite. $ ls -l build/build_Trunk_1677/debug/test/bbackupd/testfiles/restore-test/Test1 total 16 drwxr-xr-x 2 bitten bitten 4096 Apr 23 23:48 dir23 -rwxr--r-- 1 bitten bitten 4090 Oct 13 2003 f45.df drwxr-xr-x 6 bitten bitten 4096 Apr 23 23:48 spacetest lrwxrwxrwx 1 bitten bitten 5 Apr 23 23:48 symlink1 -> df324 lrwxrwxrwx 1 bitten bitten 7 Apr 23 23:48 symlink2 -> dire23d lrwxrwxrwx 1 bitten bitten 15 Apr 23 23:48 symlink3 -> x1/dsfdsfs98.fd dr-xr-xr-x 3 bitten bitten 4096 Apr 23 23:48 x1 No write permission on the x1 directory means that non-root users can't remove files inside it. $ ls -l build/build_Trunk_1677/debug/test/bbackupd/testfiles/restore-test/Test1/x1/ total 4 drw-rw-rw- 2 bitten bitten 4096 Apr 24 00:11 cxfxcv No execute permission on this dir means that 'rm -r' canot chdir() into it. I guess this is intentional as part of the restore test to verify permissions, but we might need a way to reset permissions once the test has finished. I've noticed this issue on Linux and OS X, but not FreeBSD. (Not sure about Solaris as the build never gets that far!) It looks like the tests are all in C++ so I'm not able to fix this myself :-) James From chris at qwirx.com Sun Apr 24 15:48:19 2011 From: chris at qwirx.com (Chris Wilson) Date: Sun, 24 Apr 2011 16:48:19 +0200 (CAT) Subject: [Boxbackup-dev] File/dir permissions in test suite In-Reply-To: <20110424115604.GD2320@netinertia.co.uk> References: <20110424115604.GD2320@netinertia.co.uk> Message-ID: Hi James, On Sun, 24 Apr 2011, James O'Gorman wrote: > I've noticed that the build bots occasionally bomb out when trying to > clean up after a run due to some odd permissions on files and > directories creating during the restore part of the debug test suite. [...] > $ ls -l build/build_Trunk_1677/debug/test/bbackupd/testfiles/restore-test/Test1/x1/ > total 4 > drw-rw-rw- 2 bitten bitten 4096 Apr 24 00:11 cxfxcv > > No execute permission on this dir means that 'rm -r' canot chdir() into > it. > > I guess this is intentional as part of the restore test to verify > permissions, but we might need a way to reset permissions once the test > has finished. I've noticed this issue on Linux and OS X, but not > FreeBSD. (Not sure about Solaris as the build never gets that far!) Yes, it is deliberate. I'm not sure how to clean up within the test in a way that always happens even if the test aborts, but doesn't change the state too much during manual testing. Would it be possible to do this in bitten before cleaning up? chmod -R u+rwx . Cheers, Chris. From chris at qwirx.com Sun Apr 24 14:49:45 2011 From: chris at qwirx.com (Chris Wilson) Date: Sun, 24 Apr 2011 15:49:45 +0200 (CAT) Subject: [Boxbackup-dev] File/dir permissions in test suite In-Reply-To: <20110424115604.GD2320@netinertia.co.uk> References: <20110424115604.GD2320@netinertia.co.uk> Message-ID: Hi James, On Sun, 24 Apr 2011, James O'Gorman wrote: > No write permission on the x1 directory means that non-root users can't > remove files inside it. > > $ ls -l build/build_Trunk_1677/debug/test/bbackupd/testfiles/restore-test/Test1/x1/ > total 4 > drw-rw-rw- 2 bitten bitten 4096 Apr 24 00:11 cxfxcv > > No execute permission on this dir means that 'rm -r' canot chdir() into > it. > > I guess this is intentional as part of the restore test to verify > permissions, but we might need a way to reset permissions once the test > has finished. I've noticed this issue on Linux and OS X, but not > FreeBSD. (Not sure about Solaris as the build never gets that far!) Yes it is intentional. It gets cleaned up by the test if the test passes, but if the test fails then it may abort without cleaning up. I'm not sure what to do about this as I don't know how it fails and ends up in this state. I'd rather not interfere too much in the normal test scripts, as it could be useful if the test fails to analyse the situation as it was left. If it possible for bitten to simply run: chmod -R a+rwx testfiles after the test finishes, and before cleaning up? Cheers, Chris. From james at netinertia.co.uk Sun Apr 24 16:54:32 2011 From: james at netinertia.co.uk (James O'Gorman) Date: Sun, 24 Apr 2011 16:54:32 +0100 Subject: [Boxbackup-dev] File/dir permissions in test suite In-Reply-To: References: <20110424115604.GD2320@netinertia.co.uk> Message-ID: <20110424155432.GE2320@netinertia.co.uk> Hi Chris, On Sun, Apr 24, 2011 at 03:49:45PM +0200, Chris Wilson wrote: > Yes it is intentional. It gets cleaned up by the test if the test passes, > but if the test fails then it may abort without cleaning up. I'm not sure > what to do about this as I don't know how it fails and ends up in this > state. > > I'd rather not interfere too much in the normal test scripts, as it could > be useful if the test fails to analyse the situation as it was left. If it > possible for bitten to simply run: > > chmod -R a+rwx testfiles > > after the test finishes, and before cleaning up? I thought that might be the case, but thought I'd check in case it was a bug. I've made a change to the bitten recipe. A couple of the slaves are re-running the tests now... James From trac at boxbackup.org Sat Apr 30 12:00:00 2011 From: trac at boxbackup.org (trac at boxbackup.org) Date: Sat, 30 Apr 2011 12:00:00 +0100 (BST) Subject: [Boxbackup-dev] Current open tickets Message-ID: <20110430110000.BDDA1185801@www.boxbackup.org> Note: to view an indiviual ticket, use: https://www.boxbackup.org/trac/ticket/(number) The following is a listing of current problems submitted by Box Backup users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Ticket Owner Component Summary - ------ ------ ------------- ------------------------------------------------------------ n 4 martin box libraries Port Box Backup to AIX n 6 box libraries Contribute code: SMTP client, HTTP server, Database drivers, n 7 box libraries Improve restore speed on local repositories n 8 chris box libraries Improve handling of directories with many files n 13 chris bbackupd Fix file locking on Windows n 14 chris bbackupd Fix large file issues on Windows n 16 chris bbackupquery Restore deleted directories may fail a 17 chris bbackupquery List files using wildcards a 20 chris bbackupctl bbackupctl reload reports prior settings n 45 ben bbackupd File diff performance patch (reduced disk IO and wall time n 46 chris bbackupd bbackupd only ever saves reverse diffs, corrupted files on s n 47 chris bbackupd Account numbers greater than 2^31 (0x7fffffff) do not work c n 48 chris bbackupd Locations that don't exist on first run are never tried agai n 49 chris bbackupd ID map (rename tracking) broken since [288] n 50 chris bbackupquery No way to capture stderr under Windows n 51 chris bbackupd No way to force bbackupd to re-upload files under Windows n 52 chris bbackupd Unable to control the maintenance of old vs. deleted files n 53 chris bbackupd Comparing root directory locations does not work under Windo n 54 chris bbackupd Locations not found on disk (e.g. unmounted filesystems) can n 55 chris bbackupd Should store and preserve directory timestamps n 56 bbackupquery Windows: User can polute restore directory by adding a trail n 57 ben bbackupd Create boxbackupresume and other files in DataDirectory n 58 ben bbackupd bbackupquery connection timeout results in error message, sh n 59 ben bbackupd Inconsistent treatment of NotifyScript between Box Backup an n 60 ben bbstored Case sensitivity between bbstored-certs and Boxi n 61 ben bbackupd File statistics: Log the number of uploaded files in additio n 62 ben bbackupd Backups of deleted files may be removed very quickly by hous a 63 chris bbackupd Support hard links in directories n 65 ben bbackupd Some file attributes under Windows are not backed up n 66 ben bbackupd Windows ACL support a 67 chris bbackupd Add mutexes for Win32 (client) to enable detection of runnin n 68 ben bbackupd More details when ReadError occurs n 69 bbackupquery CRTL+C closes bbackupquery console window under Windows n 70 ben bbackupd Non-ascii character cause error for notifyscript path n 71 ben bbackupd bbackupd.log gets randomly deleted n 72 test suite Patch intercept.h and intercept.c for NetBSD 4 and 5 n 74 bbackupquery Reconnect bbackupquery automatically, or at least have a "co n 75 ben bbackupd Restore times wrong, times on store correct 38 tickets total.