From lists at ebourne.me.uk Sat Dec 4 00:19:16 2010 From: lists at ebourne.me.uk (Martin Ebourne) Date: Sat, 04 Dec 2010 10:49:16 +1030 Subject: [Boxbackup-dev] [Box Backup-commit] COMMIT r2817 - box/invisnet/perfhack1/lib/server In-Reply-To: <20101203110554.9B4041857CB@www.boxbackup.org> References: <20101203110554.9B4041857CB@www.boxbackup.org> Message-ID: <1291421956.3168.6.camel@avenin.ebourne.me.uk> On Fri, 2010-12-03 at 11:05 +0000, subversion at boxbackup.org wrote: > Author: invisnet > Date: 2010-12-03 11:05:53 +0000 (Fri, 03 Dec 2010) > New Revision: 2817 > > Modified: > box/invisnet/perfhack1/lib/server/SocketStreamTLS.cpp > Log: > Disable Naggle This is probably a bad idea. Given especially that box is designed for low bandwidth links, this is likely to increase bandwidth usage. Certainly tcp nodelay is not going to be relevant on the LAN usage case which as already discussed is very slow. Sounds to me if verify is slow over a long distance link rather than disabling nagle it would be worth reworking the protocol to reduce round trips. Cheers, Martin From lists at invis.net Sat Dec 4 01:13:45 2010 From: lists at invis.net (Charles Lecklider) Date: Sat, 04 Dec 2010 01:13:45 +0000 Subject: [Boxbackup-dev] [Box Backup-commit] COMMIT r2817 - box/invisnet/perfhack1/lib/server In-Reply-To: <1291421956.3168.6.camel@avenin.ebourne.me.uk> References: <20101203110554.9B4041857CB@www.boxbackup.org> <1291421956.3168.6.camel@avenin.ebourne.me.uk> Message-ID: <4CF995C9.8030903@invis.net> On 04/12/2010 00:19, Martin Ebourne wrote: > This is probably a bad idea. Given especially that box is designed for > low bandwidth links, this is likely to increase bandwidth usage. For a stock 0.11, yes, you'd be right. However, with the larger buffers in that branch it doesn't create any more packets than would be sent with Nagle enabled. > Certainly tcp nodelay is not going to be relevant on the LAN usage case > which as already discussed is very slow. It more than quadrupled the backup speed of a Maildir over a Gbit LAN. In other more normal usage it won't change much. > Sounds to me if verify is slow over a long distance link rather than > disabling nagle it would be worth reworking the protocol to reduce round > trips. I intend to make it an option, not the default - it only makes a difference on a LAN. -C From trac at boxbackup.org Sat Dec 4 12:00:01 2010 From: trac at boxbackup.org (trac at boxbackup.org) Date: Sat, 4 Dec 2010 12:00:01 +0000 (GMT) Subject: [Boxbackup-dev] Current open tickets Message-ID: <20101204120001.97435185C31@www.boxbackup.org> Note: to view an indiviual ticket, use: https://www.boxbackup.org/trac/ticket/(number) The following is a listing of current problems submitted by Box Backup users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Ticket Owner Component Summary - ------ ------ ------------- ------------------------------------------------------------ n 4 martin box libraries Port Box Backup to AIX n 6 box libraries Contribute code: SMTP client, HTTP server, Database drivers, n 7 box libraries Improve restore speed on local repositories n 8 chris box libraries Improve handling of directories with many files n 13 chris bbackupd Fix file locking on Windows n 14 chris bbackupd Fix large file issues on Windows n 16 chris bbackupquery Restore deleted directories may fail a 17 chris bbackupquery List files using wildcards a 20 chris bbackupctl bbackupctl reload reports prior settings n 45 ben bbackupd File diff performance patch (reduced disk IO and wall time n 46 chris bbackupd bbackupd only ever saves reverse diffs, corrupted files on s n 47 chris bbackupd Account numbers greater than 2^31 (0x7fffffff) do not work c n 48 chris bbackupd Locations that don't exist on first run are never tried agai n 49 chris bbackupd ID map (rename tracking) broken since [288] n 50 chris bbackupquery No way to capture stderr under Windows n 51 chris bbackupd No way to force bbackupd to re-upload files under Windows n 52 chris bbackupd Unable to control the maintenance of old vs. deleted files n 53 chris bbackupd Comparing root directory locations does not work under Windo n 54 chris bbackupd Locations not found on disk (e.g. unmounted filesystems) can n 55 chris bbackupd Should store and preserve directory timestamps n 56 bbackupquery Windows: User can polute restore directory by adding a trail n 57 ben bbackupd Create boxbackupresume and other files in DataDirectory n 58 ben bbackupd bbackupquery connection timeout results in error message, sh n 59 ben bbackupd Inconsistent treatment of NotifyScript between Box Backup an n 60 ben bbstored Case sensitivity between bbstored-certs and Boxi n 61 ben bbackupd File statistics: Log the number of uploaded files in additio n 62 ben bbackupd Backups of deleted files may be removed very quickly by hous a 63 chris bbackupd Support hard links in directories n 65 ben bbackupd Some file attributes under Windows are not backed up n 66 ben bbackupd Windows ACL support a 67 chris bbackupd Add mutexes for Win32 (client) to enable detection of runnin n 68 ben bbackupd More details when ReadError occurs n 69 bbackupquery CRTL+C closes bbackupquery console window under Windows n 70 ben bbackupd Non-ascii character cause error for notifyscript path n 71 ben bbackupd bbackupd.log gets randomly deleted n 72 test suite Patch intercept.h and intercept.c for NetBSD 4 and 5 n 74 bbackupquery Reconnect bbackupquery automatically, or at least have a "co n 75 ben bbackupd Restore times wrong, times on store correct 38 tickets total. From james at netinertia.co.uk Sat Dec 4 12:48:45 2010 From: james at netinertia.co.uk (James O'Gorman) Date: Sat, 4 Dec 2010 12:48:45 +0000 Subject: [Boxbackup-dev] [Box Backup-commit] COMMIT r2818 - in box/invisnet/vs2010/0.11: bin/bbackupctl bin/bbackupctl/win32 bin/bbackupd/win32 bin/bbackupquery bin/bbackupquery/win32 lib/backupclient lib/backupclient/win32 In-Reply-To: <20101203171400.835C71858B0@www.boxbackup.org> References: <20101203171400.835C71858B0@www.boxbackup.org> Message-ID: <1D7C4FFD-F8FC-4D79-94A8-61C1587B1B1D@netinertia.co.uk> Love the icons! Good work! I made an icon some time back too when I was looking doing something for OS X. I basically took the main logo from the website and fiddled with it a bit. I've attached it... let's see if it makes it to the list :-) James -------------- next part -------------- A non-text attachment was scrubbed... Name: Box Backup.ico Type: image/ico Size: 75246 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: Box Backup.icns Type: image/icns Size: 52026 bytes Desc: not available URL: -------------- next part -------------- On 3 Dec 2010, at 17:14, subversion at boxbackup.org wrote: > Author: invisnet > Date: 2010-12-03 17:13:58 +0000 (Fri, 03 Dec 2010) > New Revision: 2818 > > Added: > box/invisnet/vs2010/0.11/bin/bbackupctl/win32/ > box/invisnet/vs2010/0.11/bin/bbackupctl/win32/bbackupctl.ico > box/invisnet/vs2010/0.11/bin/bbackupctl/win32/bbackupctl.rc > box/invisnet/vs2010/0.11/bin/bbackupctl/win32/resource.h > box/invisnet/vs2010/0.11/bin/bbackupd/win32/bbackupd.ico > box/invisnet/vs2010/0.11/bin/bbackupd/win32/bbackupd.rc > box/invisnet/vs2010/0.11/bin/bbackupd/win32/resource.h > box/invisnet/vs2010/0.11/bin/bbackupquery/win32/ > box/invisnet/vs2010/0.11/bin/bbackupquery/win32/bbackupquery.ico > box/invisnet/vs2010/0.11/bin/bbackupquery/win32/bbackupquery.rc > box/invisnet/vs2010/0.11/bin/bbackupquery/win32/resource.h > box/invisnet/vs2010/0.11/lib/backupclient/win32/ > box/invisnet/vs2010/0.11/lib/backupclient/win32/bbackupclient.rc > box/invisnet/vs2010/0.11/lib/backupclient/win32/resource.h > Log: > Add icon and version info resources. From lists at ebourne.me.uk Sat Dec 4 14:13:41 2010 From: lists at ebourne.me.uk (Martin Ebourne) Date: Sun, 05 Dec 2010 00:43:41 +1030 Subject: [Boxbackup-dev] [Box Backup-commit] COMMIT r2817 - box/invisnet/perfhack1/lib/server In-Reply-To: <4CF995C9.8030903@invis.net> References: <20101203110554.9B4041857CB@www.boxbackup.org> <1291421956.3168.6.camel@avenin.ebourne.me.uk> <4CF995C9.8030903@invis.net> Message-ID: <1291472021.3168.9.camel@avenin.ebourne.me.uk> On Sat, 2010-12-04 at 01:13 +0000, Charles Lecklider wrote: > > Certainly tcp nodelay is not going to be relevant on the LAN usage case > > which as already discussed is very slow. > > It more than quadrupled the backup speed of a Maildir over a Gbit LAN. > In other more normal usage it won't change much. > > > Sounds to me if verify is slow over a long distance link rather than > > disabling nagle it would be worth reworking the protocol to reduce round > > trips. > > I intend to make it an option, not the default - it only makes a > difference on a LAN. That's somewhat surprising, and contrary to normal expectation. Did you figure out the reason why this is? Would be interesting to analyse a packet captures to understand this fully. Cheers, Martin From lists at invis.net Sat Dec 4 15:31:41 2010 From: lists at invis.net (Charles Lecklider) Date: Sat, 04 Dec 2010 15:31:41 +0000 Subject: [Boxbackup-dev] [Box Backup-commit] COMMIT r2818 - in box/invisnet/vs2010/0.11: bin/bbackupctl bin/bbackupctl/win32 bin/bbackupd/win32 bin/bbackupquery bin/bbackupquery/win32 lib/backupclient lib/backupclient/win32 In-Reply-To: <1D7C4FFD-F8FC-4D79-94A8-61C1587B1B1D@netinertia.co.uk> References: <20101203171400.835C71858B0@www.boxbackup.org> <1D7C4FFD-F8FC-4D79-94A8-61C1587B1B1D@netinertia.co.uk> Message-ID: <4CFA5EDD.3000409@invis.net> On 04/12/2010 12:48, James O'Gorman wrote: > Love the icons! Good work! I can't claim much credit for them.... Ben kindly sent me the original artwork, which happened to have a nice square 'b' already. I just dropped it into Axialis IconWorkshop and added some stock overlays - hardly the world's greatest artistic endeavour. > I made an icon some time back too when I was looking doing something > for OS X. I basically took the main logo from the website and fiddled > with it a bit. I've attached it... let's see if it makes it to the > list :-) Very similar to my first attempt at Windows icons, only quite a lot better ;-) -C From james at netinertia.co.uk Sat Dec 4 17:48:38 2010 From: james at netinertia.co.uk (James O'Gorman) Date: Sat, 4 Dec 2010 17:48:38 +0000 Subject: [Boxbackup-dev] [Box Backup-commit] COMMIT r2818 - in box/invisnet/vs2010/0.11: bin/bbackupctl bin/bbackupctl/win32 bin/bbackupd/win32 bin/bbackupquery bin/bbackupquery/win32 lib/backupclient lib/backupclient/win32 In-Reply-To: <4CFA5EDD.3000409@invis.net> References: <20101203171400.835C71858B0@www.boxbackup.org> <1D7C4FFD-F8FC-4D79-94A8-61C1587B1B1D@netinertia.co.uk> <4CFA5EDD.3000409@invis.net> Message-ID: <22D983BB-111D-4B76-A392-88F92C8AC700@netinertia.co.uk> On 4 Dec 2010, at 15:31, Charles Lecklider wrote: > On 04/12/2010 12:48, James O'Gorman wrote: >> Love the icons! Good work! > > I can't claim much credit for them.... > > Ben kindly sent me the original artwork, which happened to have a nice > square 'b' already. I just dropped it into Axialis IconWorkshop and > added some stock overlays - hardly the world's greatest artistic endeavour. Ah, I see! Good to see them in the source tree now, though. >> I made an icon some time back too when I was looking doing something >> for OS X. I basically took the main logo from the website and fiddled >> with it a bit. I've attached it... let's see if it makes it to the >> list :-) > > Very similar to my first attempt at Windows icons, only quite a lot > better ;-) I can't quite remember how I did it now. I used the icon creator that comes with XCode, but can't remember if that's what did the gradient background. Feel free to use them if you like though. James From trac at boxbackup.org Sat Dec 11 12:00:01 2010 From: trac at boxbackup.org (trac at boxbackup.org) Date: Sat, 11 Dec 2010 12:00:01 +0000 (GMT) Subject: [Boxbackup-dev] Current open tickets Message-ID: <20101211120001.737DE185B65@www.boxbackup.org> Note: to view an indiviual ticket, use: https://www.boxbackup.org/trac/ticket/(number) The following is a listing of current problems submitted by Box Backup users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Ticket Owner Component Summary - ------ ------ ------------- ------------------------------------------------------------ n 4 martin box libraries Port Box Backup to AIX n 6 box libraries Contribute code: SMTP client, HTTP server, Database drivers, n 7 box libraries Improve restore speed on local repositories n 8 chris box libraries Improve handling of directories with many files n 13 chris bbackupd Fix file locking on Windows n 14 chris bbackupd Fix large file issues on Windows n 16 chris bbackupquery Restore deleted directories may fail a 17 chris bbackupquery List files using wildcards a 20 chris bbackupctl bbackupctl reload reports prior settings n 45 ben bbackupd File diff performance patch (reduced disk IO and wall time n 46 chris bbackupd bbackupd only ever saves reverse diffs, corrupted files on s n 47 chris bbackupd Account numbers greater than 2^31 (0x7fffffff) do not work c n 48 chris bbackupd Locations that don't exist on first run are never tried agai n 49 chris bbackupd ID map (rename tracking) broken since [288] n 50 chris bbackupquery No way to capture stderr under Windows n 51 chris bbackupd No way to force bbackupd to re-upload files under Windows n 52 chris bbackupd Unable to control the maintenance of old vs. deleted files n 53 chris bbackupd Comparing root directory locations does not work under Windo n 54 chris bbackupd Locations not found on disk (e.g. unmounted filesystems) can n 55 chris bbackupd Should store and preserve directory timestamps n 56 bbackupquery Windows: User can polute restore directory by adding a trail n 57 ben bbackupd Create boxbackupresume and other files in DataDirectory n 58 ben bbackupd bbackupquery connection timeout results in error message, sh n 59 ben bbackupd Inconsistent treatment of NotifyScript between Box Backup an n 60 ben bbstored Case sensitivity between bbstored-certs and Boxi n 61 ben bbackupd File statistics: Log the number of uploaded files in additio n 62 ben bbackupd Backups of deleted files may be removed very quickly by hous a 63 chris bbackupd Support hard links in directories n 65 ben bbackupd Some file attributes under Windows are not backed up n 66 ben bbackupd Windows ACL support a 67 chris bbackupd Add mutexes for Win32 (client) to enable detection of runnin n 68 ben bbackupd More details when ReadError occurs n 69 bbackupquery CRTL+C closes bbackupquery console window under Windows n 70 ben bbackupd Non-ascii character cause error for notifyscript path n 71 ben bbackupd bbackupd.log gets randomly deleted n 72 test suite Patch intercept.h and intercept.c for NetBSD 4 and 5 n 74 bbackupquery Reconnect bbackupquery automatically, or at least have a "co n 75 ben bbackupd Restore times wrong, times on store correct 38 tickets total. From trac at boxbackup.org Sat Dec 18 12:00:00 2010 From: trac at boxbackup.org (trac at boxbackup.org) Date: Sat, 18 Dec 2010 12:00:00 +0000 (GMT) Subject: [Boxbackup-dev] Current open tickets Message-ID: <20101218120001.0FF6518544D@www.boxbackup.org> Note: to view an indiviual ticket, use: https://www.boxbackup.org/trac/ticket/(number) The following is a listing of current problems submitted by Box Backup users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Ticket Owner Component Summary - ------ ------ ------------- ------------------------------------------------------------ n 4 martin box libraries Port Box Backup to AIX n 6 box libraries Contribute code: SMTP client, HTTP server, Database drivers, n 7 box libraries Improve restore speed on local repositories n 8 chris box libraries Improve handling of directories with many files n 13 chris bbackupd Fix file locking on Windows n 14 chris bbackupd Fix large file issues on Windows n 16 chris bbackupquery Restore deleted directories may fail a 17 chris bbackupquery List files using wildcards a 20 chris bbackupctl bbackupctl reload reports prior settings n 45 ben bbackupd File diff performance patch (reduced disk IO and wall time n 46 chris bbackupd bbackupd only ever saves reverse diffs, corrupted files on s n 47 chris bbackupd Account numbers greater than 2^31 (0x7fffffff) do not work c n 48 chris bbackupd Locations that don't exist on first run are never tried agai n 49 chris bbackupd ID map (rename tracking) broken since [288] n 50 chris bbackupquery No way to capture stderr under Windows n 51 chris bbackupd No way to force bbackupd to re-upload files under Windows n 52 chris bbackupd Unable to control the maintenance of old vs. deleted files n 53 chris bbackupd Comparing root directory locations does not work under Windo n 54 chris bbackupd Locations not found on disk (e.g. unmounted filesystems) can n 55 chris bbackupd Should store and preserve directory timestamps n 56 bbackupquery Windows: User can polute restore directory by adding a trail n 57 ben bbackupd Create boxbackupresume and other files in DataDirectory n 58 ben bbackupd bbackupquery connection timeout results in error message, sh n 59 ben bbackupd Inconsistent treatment of NotifyScript between Box Backup an n 60 ben bbstored Case sensitivity between bbstored-certs and Boxi n 61 ben bbackupd File statistics: Log the number of uploaded files in additio n 62 ben bbackupd Backups of deleted files may be removed very quickly by hous a 63 chris bbackupd Support hard links in directories n 65 ben bbackupd Some file attributes under Windows are not backed up n 66 ben bbackupd Windows ACL support a 67 chris bbackupd Add mutexes for Win32 (client) to enable detection of runnin n 68 ben bbackupd More details when ReadError occurs n 69 bbackupquery CRTL+C closes bbackupquery console window under Windows n 70 ben bbackupd Non-ascii character cause error for notifyscript path n 71 ben bbackupd bbackupd.log gets randomly deleted n 72 test suite Patch intercept.h and intercept.c for NetBSD 4 and 5 n 74 bbackupquery Reconnect bbackupquery automatically, or at least have a "co n 75 ben bbackupd Restore times wrong, times on store correct 38 tickets total. From trac at boxbackup.org Sat Dec 25 12:00:01 2010 From: trac at boxbackup.org (trac at boxbackup.org) Date: Sat, 25 Dec 2010 12:00:01 +0000 (GMT) Subject: [Boxbackup-dev] Current open tickets Message-ID: <20101225120001.25C481854DB@www.boxbackup.org> Note: to view an indiviual ticket, use: https://www.boxbackup.org/trac/ticket/(number) The following is a listing of current problems submitted by Box Backup users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Ticket Owner Component Summary - ------ ------ ------------- ------------------------------------------------------------ n 4 martin box libraries Port Box Backup to AIX n 6 box libraries Contribute code: SMTP client, HTTP server, Database drivers, n 7 box libraries Improve restore speed on local repositories n 8 chris box libraries Improve handling of directories with many files n 13 chris bbackupd Fix file locking on Windows n 14 chris bbackupd Fix large file issues on Windows n 16 chris bbackupquery Restore deleted directories may fail a 17 chris bbackupquery List files using wildcards a 20 chris bbackupctl bbackupctl reload reports prior settings n 45 ben bbackupd File diff performance patch (reduced disk IO and wall time n 46 chris bbackupd bbackupd only ever saves reverse diffs, corrupted files on s n 47 chris bbackupd Account numbers greater than 2^31 (0x7fffffff) do not work c n 48 chris bbackupd Locations that don't exist on first run are never tried agai n 49 chris bbackupd ID map (rename tracking) broken since [288] n 50 chris bbackupquery No way to capture stderr under Windows n 51 chris bbackupd No way to force bbackupd to re-upload files under Windows n 52 chris bbackupd Unable to control the maintenance of old vs. deleted files n 53 chris bbackupd Comparing root directory locations does not work under Windo n 54 chris bbackupd Locations not found on disk (e.g. unmounted filesystems) can n 55 chris bbackupd Should store and preserve directory timestamps n 56 bbackupquery Windows: User can polute restore directory by adding a trail n 57 ben bbackupd Create boxbackupresume and other files in DataDirectory n 58 ben bbackupd bbackupquery connection timeout results in error message, sh n 59 ben bbackupd Inconsistent treatment of NotifyScript between Box Backup an n 60 ben bbstored Case sensitivity between bbstored-certs and Boxi n 61 ben bbackupd File statistics: Log the number of uploaded files in additio n 62 ben bbackupd Backups of deleted files may be removed very quickly by hous a 63 chris bbackupd Support hard links in directories n 65 ben bbackupd Some file attributes under Windows are not backed up n 66 ben bbackupd Windows ACL support a 67 chris bbackupd Add mutexes for Win32 (client) to enable detection of runnin n 68 ben bbackupd More details when ReadError occurs n 69 bbackupquery CRTL+C closes bbackupquery console window under Windows n 70 ben bbackupd Non-ascii character cause error for notifyscript path n 71 ben bbackupd bbackupd.log gets randomly deleted n 72 test suite Patch intercept.h and intercept.c for NetBSD 4 and 5 n 74 bbackupquery Reconnect bbackupquery automatically, or at least have a "co n 75 ben bbackupd Restore times wrong, times on store correct 38 tickets total.