From boxbackup at fluffy.co.uk Sun Mar 2 23:56:21 2008 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Sun, 2 Mar 2008 23:56:21 +0000 (GMT) Subject: [Box Backup] Manually deleting files In-Reply-To: <47B03A04.4070202@3ait.co.uk> References: <4799B1F2.3010800@3ait.co.uk> <62EAD2CB-343A-49D8-9B3E-33172351B1E8@mbrown.co.uk> <4799C489.8090103@3ait.co.uk> <47B03A04.4070202@3ait.co.uk> Message-ID: Hi Oli, On Mon, 11 Feb 2008, Oli wrote: >>> If I could convince it to do a backup run, it would probably mark as >>> deleted a few. >> >> Box Backup 0.11 (rc1) will do a backup run and delete excluded files >> even if the store is full (or at least it should, please let me know if >> it doesn't). > > I've just upgraded to 0.11RC2 on client and server, and I set up my > excluded files list to include various directories and files which are > very large. > > I had also previously increased the store size and done a backup run, > unfortunately it filled up again - otherwise I was hoping to fix it this > way first. > > Anyhoo, just upgraded and tried it, but unfortunately it doesn't seem to > have gone through and deleted the newly excluded files, so my store is > still full. Sorry for not getting back to you earlier. I'm trying to reproduce the problem by writing a unit test for the correct behaviour. Unfortunately it's taking a long time, as this is a difficult test to write and I haven't yet put enough effort into it. Please be assured that I am working on it and I fully intend to resolve this issue before releasing the next 0.11 release candidate. However, it may take another couple of weeks. If you need a workaround in the mean time, let me know and I'll do my best to find you one quickly. To all: this means that the next release candidate will now be due on the 14th March. Apologies for the delay. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \__/_/_/_//_/___/ | We are GNU : free your mind & your software | From boxbackup at fluffy.co.uk Tue Mar 4 08:34:45 2008 From: boxbackup at fluffy.co.uk (Jarkko Haapalainen) Date: Tue, 4 Mar 2008 10:34:45 +0200 Subject: [Box Backup] ExtendedLogging = yes Message-ID: <4FF3EAFF-D255-4CDD-8F8D-6EC19E6A5576@viidakko.fi> Hi, I have "ExtendedLogging = yes" in /etc/box/bbackupd.conf, but I don't see any "debug" lines in my system log file (/var/log/system.log, mac os x). So where those all messages should go or is my configuration wrong? Best regards, Jarkko Haapalainen From boxbackup at fluffy.co.uk Tue Mar 4 08:51:28 2008 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Tue, 4 Mar 2008 08:51:28 +0000 (GMT) Subject: [Box Backup] ExtendedLogging = yes In-Reply-To: <4FF3EAFF-D255-4CDD-8F8D-6EC19E6A5576@viidakko.fi> References: <4FF3EAFF-D255-4CDD-8F8D-6EC19E6A5576@viidakko.fi> Message-ID: Hi Jarkko, On Tue, 4 Mar 2008, Jarkko Haapalainen wrote: > I have "ExtendedLogging = yes" in /etc/box/bbackupd.conf, but I don't see any > "debug" lines in my system log file (/var/log/system.log, mac os x). > > So where those all messages should go or is my configuration wrong? They are sent, but at a very low verbosity level. Try running the daemon with -V as well to see them. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \__/_/_/_//_/___/ | We are GNU : free your mind & your software | From boxbackup at fluffy.co.uk Tue Mar 4 13:11:52 2008 From: boxbackup at fluffy.co.uk (Jarkko Haapalainen) Date: Tue, 4 Mar 2008 15:11:52 +0200 Subject: [Box Backup] ExtendedLogging = yes In-Reply-To: References: <4FF3EAFF-D255-4CDD-8F8D-6EC19E6A5576@viidakko.fi> Message-ID: Hmm.. Is there such thing on 0.10 in client side? sh-3.2# bbackupd -V Box Backup Client v0.10, (c) Ben Summers and contributors 2003-2006 bbackupd: failed to start: failed to open configuration file: -Vsh-3.2# sh-3.2# bbackupd /etc/box/bbackupd.conf -V Box Backup Client v0.10, (c) Ben Summers and contributors 2003-2006 Last works, but doesn't give any extra. -- Jarkko Haapalainen )( Koodiviidakko Oy +358 44 2844274 Chris Wilson kirjoitti 4.3.2008 kello 10.51: > Hi Jarkko, > > On Tue, 4 Mar 2008, Jarkko Haapalainen wrote: > >> I have "ExtendedLogging = yes" in /etc/box/bbackupd.conf, but I >> don't see any "debug" lines in my system log file (/var/log/ >> system.log, mac os x). >> >> So where those all messages should go or is my configuration wrong? > > They are sent, but at a very low verbosity level. Try running the > daemon with -V as well to see them. > > Cheers, Chris. > -- > _____ __ _ > \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | > / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | > \__/_/_/_//_/___/ | We are GNU : free your mind & your software | > _______________________________________________ > boxbackup mailing list > boxbackup at fluffy.co.uk > http://lists.warhead.org.uk/mailman/listinfo/boxbackup > From boxbackup at fluffy.co.uk Wed Mar 5 00:56:13 2008 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Wed, 5 Mar 2008 00:56:13 +0000 (GMT) Subject: [Box Backup] ExtendedLogging = yes In-Reply-To: References: <4FF3EAFF-D255-4CDD-8F8D-6EC19E6A5576@viidakko.fi> Message-ID: Hi Jarkko, On Tue, 4 Mar 2008, Jarkko Haapalainen wrote: > Hmm.. Is there such thing on 0.10 in client side? > > sh-3.2# bbackupd -V > Box Backup Client v0.10, (c) Ben Summers and contributors 2003-2006 > bbackupd: failed to start: failed to open configuration file: -Vsh-3.2# > sh-3.2# bbackupd /etc/box/bbackupd.conf -V > Box Backup Client v0.10, (c) Ben Summers and contributors 2003-2006 > > Last works, but doesn't give any extra. Sorry, no, it's been added since 0.10. You should not need to do anything extra to get the extended logs in your syslog. Perhaps your syslog filtering is set up incorrectly? Try something like this in /etc/syslog.conf: local6.* -/var/log/box and then check /var/log/box for extended logs. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \__/_/_/_//_/___/ | We are GNU : free your mind & your software | From boxbackup at fluffy.co.uk Wed Mar 5 07:17:39 2008 From: boxbackup at fluffy.co.uk (Jarkko Haapalainen) Date: Wed, 5 Mar 2008 09:17:39 +0200 Subject: [Box Backup] ExtendedLogging = yes In-Reply-To: References: <4FF3EAFF-D255-4CDD-8F8D-6EC19E6A5576@viidakko.fi> Message-ID: <541A69C9-5134-4907-B664-B3954731F7C7@viidakko.fi> Great thanks! That worked. Now I see a lot what is going on, maybe too much ;) Best regards, Jarkko Chris Wilson kirjoitti 5.3.2008 kello 2.56: > Hi Jarkko, > > On Tue, 4 Mar 2008, Jarkko Haapalainen wrote: > >> Hmm.. Is there such thing on 0.10 in client side? >> >> sh-3.2# bbackupd -V >> Box Backup Client v0.10, (c) Ben Summers and contributors 2003-2006 >> bbackupd: failed to start: failed to open configuration file: - >> Vsh-3.2# >> sh-3.2# bbackupd /etc/box/bbackupd.conf -V >> Box Backup Client v0.10, (c) Ben Summers and contributors 2003-2006 >> >> Last works, but doesn't give any extra. > > Sorry, no, it's been added since 0.10. You should not need to do > anything extra to get the extended logs in your syslog. Perhaps your > syslog filtering is set up incorrectly? Try something like this in / > etc/syslog.conf: > > local6.* -/var/log/box > > and then check /var/log/box for extended logs. > > Cheers, Chris. > -- > _____ __ _ > \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | > / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | > \__/_/_/_//_/___/ | We are GNU : free your mind & your software | > _______________________________________________ > boxbackup mailing list > boxbackup at fluffy.co.uk > http://lists.warhead.org.uk/mailman/listinfo/boxbackup > From boxbackup at fluffy.co.uk Wed Mar 12 14:49:51 2008 From: boxbackup at fluffy.co.uk (Jody Belka) Date: Wed, 12 Mar 2008 14:49:51 +0000 Subject: [Box Backup] Removing backup locations from the store Message-ID: <20080312144951.GA1891@pimb.org> Hi, I've got a backup location that I want to remove completely from the store. For the moment I've added Exclude entries into the config so that nothing is visible within the location, but how would I go about removing it completely? Oh, and I'm running build 1857 on windows, connecting to 0.11rc1 on linux. All seems to be working nicely so far, except for Boxi (0.0.7), which has problems talking to the server, giving a "Conection Protocol_HandshakeFailed" error. On the server side, that matches up with a ConnectionException(Conn_Protocol_HandshakeFailed) at Protocol.cpp(195). J -- Jody Belka knew (at) pimb (dot) org From boxbackup at fluffy.co.uk Wed Mar 12 19:53:25 2008 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Wed, 12 Mar 2008 19:53:25 +0000 (GMT) Subject: [Box Backup] Removing backup locations from the store In-Reply-To: <20080312144951.GA1891@pimb.org> References: <20080312144951.GA1891@pimb.org> Message-ID: Hi Jody, On Wed, 12 Mar 2008, Jody Belka wrote: > I've got a backup location that I want to remove completely from the > store. For the moment I've added Exclude entries into the config so that > nothing is visible within the location, but how would I go about > removing it completely? Just remove the definition from your bbackupd.conf file and restart bbackupd. It will be deleted after bbackupd has been running for about 48 hours. > Oh, and I'm running build 1857 on windows, connecting to 0.11rc1 on > linux. All seems to be working nicely so far, except for Boxi (0.0.7), > which has problems talking to the server, giving a "Conection > Protocol_HandshakeFailed" error. On the server side, that matches up > with a ConnectionException(Conn_Protocol_HandshakeFailed) at > Protocol.cpp(195). Sorry, Boxi is probably not compatible with 0.10+ servers as it's based on 0.09 code. I'm afraid it's quite badly out of date. I am trying to find time to get it up to date but it's been hard. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \__/_/_/_//_/___/ | We are GNU : free your mind & your software | From boxbackup at fluffy.co.uk Wed Mar 12 20:06:12 2008 From: boxbackup at fluffy.co.uk (Peter Jalajas, GigaLock Backup Services) Date: Wed, 12 Mar 2008 16:06:12 -0400 Subject: [Box Backup] Removing backup locations from the store In-Reply-To: References: <20080312144951.GA1891@pimb.org> Message-ID: <74d01c7a0803121306q3bedf53frbe672ec0c513a793@mail.gmail.com> Hi Chris, 1) Does waiting 48 hours actually physically delete the files from the server, or does it just mark them as deleted? I thought files marked as deleted just stay there until needed to make room under the soft limit. 2) How _are_ the files deleted on the server anyway? Is it a simple rm, or is it a shred? (Since we don't trust the server, maybe it doesn't matter...) 3) Have you ever thought about making a java gui? I played around with the eclipse and netbeans IDEs a few weeks back, and they look like they have a lot of potential, especially netbeans as I recall. Thanks, Pete On 3/12/08, Chris Wilson wrote: > Hi Jody, > > On Wed, 12 Mar 2008, Jody Belka wrote: > > Just remove the definition from your bbackupd.conf file and restart > bbackupd. It will be deleted after bbackupd has been running for about 48 > hours. > Sorry, Boxi is probably not compatible with 0.10+ servers as it's based on > 0.09 code. I'm afraid it's quite badly out of date. I am trying to find > time to get it up to date but it's been hard. > From boxbackup at fluffy.co.uk Wed Mar 12 20:21:29 2008 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Wed, 12 Mar 2008 20:21:29 +0000 (GMT) Subject: [Box Backup] Removing backup locations from the store In-Reply-To: <74d01c7a0803121306q3bedf53frbe672ec0c513a793@mail.gmail.com> References: <20080312144951.GA1891@pimb.org> <74d01c7a0803121306q3bedf53frbe672ec0c513a793@mail.gmail.com> Message-ID: Hi Pete, On Wed, 12 Mar 2008, Peter Jalajas, GigaLock Backup Services wrote: > 1) Does waiting 48 hours actually physically delete the files from the > server, or does it just mark them as deleted? I thought files marked as > deleted just stay there until needed to make room under the soft limit. It marks them as deleted, which is all that it can do, yes. The server will actually delete them when it needs to make more room for new files. It shouldn't make any difference except that you have the possibility to undelete them if you change your mind. > 2) How _are_ the files deleted on the server anyway? Is it a simple rm, > or is it a shred? (Since we don't trust the server, maybe it doesn't > matter...) Just a simple unlink, and no it doesn't matter as they are encrypted and unreadable by the server anyway. > 3) Have you ever thought about making a java gui? I played around with > the eclipse and netbeans IDEs a few weeks back, and they look like they > have a lot of potential, especially netbeans as I recall. I did think about it when I started the project, and decided against it for three reasons: * Java does not have enough access to underlying filesystem properties such as extended attributes, without native extensions, which makes it unportable again and makes the build process difficult. * Java GUIs are dead slow. Yes, even with SWT. I wanted a small, fast application. * The existing code to interface with the server is all written in C++, I didn't want to rewrite it all or to create native wrappers for it, as this would again lead to unportability and make the build process difficult. I still wanted a cross-platform portable GUI so I decided to learn wx and use that instead. I'm still pretty glad that I did. There would be no (even partially) working Boxi by now if I hadn't. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \__/_/_/_//_/___/ | We are GNU : free your mind & your software | From boxbackup at fluffy.co.uk Thu Mar 13 12:46:26 2008 From: boxbackup at fluffy.co.uk (kiru) Date: Thu, 13 Mar 2008 13:46:26 +0100 Subject: [Box Backup] bbackupd false notification Message-ID: <47D92222.9090708@mikroweb.hu> Hi list, I'm running the bbackupd daemon with the -V argument, and I see only the following messages in the syslog: --- Box Backup (bbackupd)[28220]: NOTICE: Finished scan of local files Box Backup (bbackupd)[28220]: NOTICE: About to notify administrator about event backup-finish, running script '/etc/box/bbackupd/NotifySysadmin.sh backup-finish' Box Backup (bbackupd)[28220]: NOTICE: File statistics: total file size uploaded 4192095, bytes already on server 0, encoded size 2801312 --- but I receive messages in every half hour with the following subject: "BACKUP PROBLEM on host mikroweb.hu (unknown)". Why is this? How can I eliminate this? regards, kiru From boxbackup at fluffy.co.uk Thu Mar 13 12:57:04 2008 From: boxbackup at fluffy.co.uk (kiru) Date: Thu, 13 Mar 2008 13:57:04 +0100 Subject: [Box Backup] Re: bbackupd false notification In-Reply-To: <47D92222.9090708@mikroweb.hu> References: <47D92222.9090708@mikroweb.hu> Message-ID: <47D924A0.6090003@mikroweb.hu> kiru wrote: > Hi list, > > I'm running the bbackupd daemon with the -V argument, and I see only the > following messages in the syslog: > > --- > Box Backup (bbackupd)[28220]: NOTICE: Finished scan of local files > Box Backup (bbackupd)[28220]: NOTICE: About to notify administrator > about event backup-finish, running script > '/etc/box/bbackupd/NotifySysadmin.sh backup-finish' > Box Backup (bbackupd)[28220]: NOTICE: File statistics: total file size > uploaded 4192095, bytes already on server 0, encoded size 2801312 > --- > > but I receive messages in every half hour with the following subject: > "BACKUP PROBLEM on host mikroweb.hu (unknown)". > > Why is this? How can I eliminate this? > > regards, > kiru > > I have forgotten some kind of information to write: OS: debian linux boxbackup ver: 0.11rc1 regards, kiru From boxbackup at fluffy.co.uk Thu Mar 13 21:19:11 2008 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Thu, 13 Mar 2008 21:19:11 +0000 (GMT) Subject: [Box Backup] bbackupd false notification In-Reply-To: <47D92222.9090708@mikroweb.hu> References: <47D92222.9090708@mikroweb.hu> Message-ID: Hi Kiru, On Thu, 13 Mar 2008, kiru wrote: > I'm running the bbackupd daemon with the -V argument, and I see only the > following messages in the syslog: > > --- > Box Backup (bbackupd)[28220]: NOTICE: Finished scan of local files > Box Backup (bbackupd)[28220]: NOTICE: About to notify administrator about > event backup-finish, running script '/etc/box/bbackupd/NotifySysadmin.sh > backup-finish' > Box Backup (bbackupd)[28220]: NOTICE: File statistics: total file size > uploaded 4192095, bytes already on server 0, encoded size 2801312 > --- > > but I receive messages in every half hour with the following subject: "BACKUP > PROBLEM on host mikroweb.hu (unknown)". > > Why is this? How can I eliminate this? Thanks for the concise and accurate description! I believe that you have upgraded from 0.10 and you have not reconfigured Box Backup by running bbackupd-config. The old notify script is still in place in /etc/box/bbackupd/NotifySysadmin.sh and does not know anything about the backup-finish event, so it reports an unknown error. The easiest way to fix it is to edit the NotifySysadmin script by hand, find the line that starts with "else", and add these three lines before it: elif [ "\$1" = backup-start -o "\$1" = backup-finish ]; then # do nothing by default true Please let me know if that helps and I'll add it to the Upgrading section of the Wiki (did you read that by the way?) Cheers, Chris. -- _ ___ __ _ / __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Mon Mar 17 18:14:02 2008 From: boxbackup at fluffy.co.uk (kiru) Date: Mon, 17 Mar 2008 19:14:02 +0100 Subject: [Box Backup] bbackupd false notification In-Reply-To: References: <47D92222.9090708@mikroweb.hu> Message-ID: <47DEB4EA.1010207@mikroweb.hu> Chris Wilson wrote: > Hi Kiru, > > On Thu, 13 Mar 2008, kiru wrote: > >> I'm running the bbackupd daemon with the -V argument, and I see only >> the following messages in the syslog: >> >> --- >> Box Backup (bbackupd)[28220]: NOTICE: Finished scan of local files >> Box Backup (bbackupd)[28220]: NOTICE: About to notify administrator >> about event backup-finish, running script >> '/etc/box/bbackupd/NotifySysadmin.sh backup-finish' >> Box Backup (bbackupd)[28220]: NOTICE: File statistics: total file size >> uploaded 4192095, bytes already on server 0, encoded size 2801312 >> --- >> >> but I receive messages in every half hour with the following subject: >> "BACKUP PROBLEM on host mikroweb.hu (unknown)". >> >> Why is this? How can I eliminate this? > > Thanks for the concise and accurate description! > > I believe that you have upgraded from 0.10 and you have not reconfigured > Box Backup by running bbackupd-config. The old notify script is still in > place in /etc/box/bbackupd/NotifySysadmin.sh and does not know anything > about the backup-finish event, so it reports an unknown error. > > The easiest way to fix it is to edit the NotifySysadmin script by hand, > find the line that starts with "else", and add these three lines before it: > > elif [ "\$1" = backup-start -o "\$1" = backup-finish ]; then > # do nothing by default > true > > Please let me know if that helps and I'll add it to the Upgrading > section of the Wiki (did you read that by the way?) > > Cheers, Chris. Thank you for your response. I included the following sentence in the bash file: --- elif [ $1 = backup-start -o $1 = backup-finish ] then exit else --- This helps, and now bbackupd working withouth problems. (You can attach it in the wiki ;-)) regards, kiru From boxbackup at fluffy.co.uk Mon Mar 17 22:12:33 2008 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Mon, 17 Mar 2008 22:12:33 +0000 (GMT) Subject: [Box Backup] bbackupd false notification In-Reply-To: <47DEB4EA.1010207@mikroweb.hu> References: <47D92222.9090708@mikroweb.hu> <47DEB4EA.1010207@mikroweb.hu> Message-ID: Hi Kiru, On Mon, 17 Mar 2008, kiru wrote: >>> I receive messages in every half hour with the following subject: >>> "BACKUP PROBLEM on host mikroweb.hu (unknown)". >>> >>> Why is this? How can I eliminate this? >> >> The easiest way to fix it is to edit the NotifySysadmin script by hand, >> find the line that starts with "else", and add these three lines before it: >> >> elif [ "\$1" = backup-start -o "\$1" = backup-finish ]; then >> # do nothing by default >> true >> >> Please let me know if that helps and I'll add it to the Upgrading >> section of the Wiki (did you read that by the way?) > > Thank you for your response. > I included the following sentence in the bash file: > --- > elif [ $1 = backup-start -o $1 = backup-finish ] > then > exit > else > --- > > This helps, and now bbackupd working withouth problems. (You can attach > it in the wiki ;-)) Thanks for testing and for the reminder, you helped me to spot a problem with the script fragment and I've fixed that on the wiki now. Did you read the Upgrading section on the wiki? If not, how could we make it easier to find? Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \__/_/_/_//_/___/ | We are GNU : free your mind & your software | From boxbackup at fluffy.co.uk Tue Mar 18 11:26:33 2008 From: boxbackup at fluffy.co.uk (kiru) Date: Tue, 18 Mar 2008 12:26:33 +0100 Subject: [Box Backup] bbackupd false notification In-Reply-To: References: <47D92222.9090708@mikroweb.hu> <47DEB4EA.1010207@mikroweb.hu> Message-ID: <47DFA6E9.2080507@mikroweb.hu> Chris Wilson wrote: > Thanks for testing and for the reminder, you helped me to spot a problem > with the script fragment and I've fixed that on the wiki now. > > Did you read the Upgrading section on the wiki? If not, how could we No, I not readed the wiki page because I wanted to make a clean install but with my config files. > make it easier to find? > > Cheers, Chris. Maybe with a better structured webpage? For example: menu on the top of the page? (documentation, download, etc.) regards, kiru From boxbackup at fluffy.co.uk Tue Mar 18 19:26:59 2008 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Tue, 18 Mar 2008 19:26:59 +0000 (GMT) Subject: [Box Backup] bbackupd false notification In-Reply-To: <47DFA6E9.2080507@mikroweb.hu> References: <47D92222.9090708@mikroweb.hu> <47DEB4EA.1010207@mikroweb.hu> <47DFA6E9.2080507@mikroweb.hu> Message-ID: Hi Kiru, On Tue, 18 Mar 2008, kiru wrote: > No, I not readed the wiki page because I wanted to make a clean install but > with my config files. > > > make it easier to find? > > Maybe with a better structured webpage? For example: menu on the top of > the page? (documentation, download, etc.) Thanks for your suggestions. Please could you have a look at the wiki now and see if it's easier to find the Upgrading page and clearer that you would need to read it? Any more suggestions on improving the documentation would be gratefully received (from anyone). Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | We are GNU : free your mind & your software | From boxbackup at fluffy.co.uk Wed Mar 19 16:47:20 2008 From: boxbackup at fluffy.co.uk (Kjell Christian Bruheim) Date: Wed, 19 Mar 2008 17:47:20 +0100 Subject: [Box Backup] bbstored Message-ID: <47E14398.1000708@supportingit.com> Hi all! I'm currently having some problems with my boxbackup. I've installed 0.10 sable form a tarball, did ./configure, make make install-server. I did run all config scripts and set up certificates, set up a client to test and when everything seems to be ok. It is not. When I start the bbstored on the server nothing happends. No logs, no pidfile and no prossess. Is there something else i need to do? I get the client software running on the windows machine, but i can't get the server to start it seems... Server running CentOS 4.6 Client running Windows XP Pro Kjell From boxbackup at fluffy.co.uk Wed Mar 19 21:14:47 2008 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Wed, 19 Mar 2008 21:14:47 +0000 (GMT) Subject: [Box Backup] bbstored In-Reply-To: <47E14398.1000708@supportingit.com> References: <47E14398.1000708@supportingit.com> Message-ID: Hi Kjell, On Wed, 19 Mar 2008, Kjell Christian Bruheim wrote: > I'm currently having some problems with my boxbackup. I've installed > 0.10 sable form a tarball, did ./configure, make make install-server. > > I did run all config scripts and set up certificates, set up a client to > test and when everything seems to be ok. It is not. When I start the > bbstored on the server nothing happends. No logs, no pidfile and no > prossess. Is there something else i need to do? No logs at all? That's highly unusual. What you've done should have just worked. I'd appreciate it if you could try Box Backup 0.11rc2, as that would make debugging much easier. See http://www.boxbackup.org/trac/wiki/Installation for details of how to get it. Run with the -DV options for more debugging. Otherwise, did you check all your log files in /var/log? It's possible that your syslogd configuration sends the logs somewhere else than /var/log/messages. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | We are GNU : free your mind & your software | From boxbackup at fluffy.co.uk Thu Mar 20 03:20:23 2008 From: boxbackup at fluffy.co.uk (Peter Jalajas, GigaLock Backup Services) Date: Wed, 19 Mar 2008 23:20:23 -0400 Subject: [Box Backup] bbstored In-Reply-To: References: <47E14398.1000708@supportingit.com> Message-ID: <74d01c7a0803192020i28f08f42rd082c1854775025a@mail.gmail.com> On my newest server, the boxbackup logs show up in /var/log/daemon.log. /var/log/daemon.log.0:Mar 19 07:09:39 ts4 bbstored[26452]: Connection statistics for BACKUP-10004018: IN=274222 OUT=43273 TOTAL=317495 Not sure why, and too busy to figure it out at the moment. On 3/19/08, Chris Wilson wrote: > No logs at all? That's highly unusual. What you've done should have just > worked. > > Otherwise, did you check all your log files in /var/log? It's possible > that your syslogd configuration sends the logs somewhere else than > /var/log/messages. From boxbackup at fluffy.co.uk Thu Mar 20 03:57:45 2008 From: boxbackup at fluffy.co.uk (Kjell Christian Bruheim) Date: Thu, 20 Mar 2008 04:57:45 +0100 Subject: [Box Backup] bbstored In-Reply-To: References: <47E14398.1000708@supportingit.com> Message-ID: <47E1E0B9.109@supportingit.com> Chris Wilson wrote: > Hi Kjell, > > On Wed, 19 Mar 2008, Kjell Christian Bruheim wrote: > > >> I'm currently having some problems with my boxbackup. I've installed >> 0.10 sable form a tarball, did ./configure, make make install-server. >> >> I did run all config scripts and set up certificates, set up a client to >> test and when everything seems to be ok. It is not. When I start the >> bbstored on the server nothing happends. No logs, no pidfile and no >> prossess. Is there something else i need to do? >> > > No logs at all? That's highly unusual. What you've done should have just > worked. > > I'd appreciate it if you could try Box Backup 0.11rc2, as that would make > debugging much easier. See http://www.boxbackup.org/trac/wiki/Installation > for details of how to get it. Run with the -DV options for more debugging. > > Otherwise, did you check all your log files in /var/log? It's possible > that your syslogd configuration sends the logs somewhere else than > /var/log/messages. > > Cheers, Chris. > Hi there and thanks for the reply! Got it working just nicely towards a Windows client. Just an config error it seemed. Thanks for the hint of /var/log/messages Kjell From boxbackup at fluffy.co.uk Thu Mar 20 21:36:43 2008 From: boxbackup at fluffy.co.uk (Kjell Christian Bruheim) Date: Thu, 20 Mar 2008 22:36:43 +0100 Subject: [Box Backup] Backups Message-ID: <47E2D8EB.3080302@supportingit.com> Hi everyone! I've been testing boxbackup on my systems for a day now, and it works like a dream. But i have a question to the sync part of it. If a file is deleted localy, is there any settings in configfiles so they are not deleted remotly in the backup aswell?? Kjell -new to linux- From boxbackup at fluffy.co.uk Fri Mar 21 04:34:34 2008 From: boxbackup at fluffy.co.uk (Per Reedtz Thomsen) Date: Thu, 20 Mar 2008 21:34:34 -0700 Subject: [Box Backup] Backups In-Reply-To: <47E2D8EB.3080302@supportingit.com> References: <47E2D8EB.3080302@supportingit.com> Message-ID: <47E33ADA.7070006@reedtz.com> On 3/20/08 2:36 PM, Kjell Christian Bruheim wrote: > Hi everyone! > > I've been testing boxbackup on my systems for a day now, and it works > like a dream. But i have a question to the sync part of it. > > If a file is deleted localy, is there any settings in configfiles so > they are not deleted remotly in the backup aswell?? Kjell, Deleted files are not deleted from the backup store until there is no room left there. To find files that were deleted locally, use the 'd' option to the list command in bbackupquery: query > ls -dt 00017834 f----- 2007-09-19T23:00:53 file1 0001c7d0 f-X--- 2008-03-12T22:36:31 file2 0001c7d3 -d---- 1970-01-01T00:00:00 dir1 0001c7d7 -d---- 1970-01-01T00:00:00 dir2 0001ca3c f----- 2008-03-17T19:47:56 file3 0001ca3d f----- 2008-03-17T19:50:45 file4 shows you current and deleted files, as well as a timestamp. the X denotes a deleted file; so file2 is deleted on the local machine. You can retrieve the file using the 'get -i' command: 'get -i 1c7d0 file2.restored' will restore the deleted file2 to a file called file2.restored... query> list -odt 00017834 f----- 2007-09-19T23:00:53 file1 0001c417 f--o-- 2008-03-04T20:11:46 file2 0001c7cf f--o-- 2008-03-12T22:35:23 file2 0001c7d0 f-X--- 2008-03-12T22:36:31 file3 0001c7d1 f--o-- 2008-03-12T22:38:36 file2 0001c7d2 f--o-- 2008-03-12T18:14:11 file4 0001c7d3 -d---- 1970-01-01T00:00:00 dir1 0001c7d7 -d---- 1970-01-01T00:00:00 dir2 0001ca3c f----- 2008-03-17T19:47:56 file5 0001ca40 f--o-- 2008-03-17T20:26:50 file2 0001ca41 f--o-- 2008-03-17T20:26:38 file4 0001cb49 f----- 2008-03-19T15:09:27 file2 0001cb4a f----- 2008-03-19T18:06:08 file4 This example shows how the 'o' option lets you see old versions of the same file. There are 6 versions of file2, and 3 of file4. The 'o' in the file listing denotes that this is an older version of the file. Note that the most recent version (at the bottom of the listing) has no 'o' in the flags, so that is the most recent. Finally the help command in bbackupquery is your friend. 'help list' will give you all the details on the file listing command. 'help' gives you a list of all the commands... Hope this helps. Thanks, Per -- Per Reedtz Thomsen | Reedtz Consulting, LLC | F: 209 883 4119 V: 209 883 4102 | pthomsen at reedtz.com | C: 209 996 9561 GPG ID: 1209784F | Yahoo! Chat: pthomsen | AIM: pthomsen From boxbackup at fluffy.co.uk Sun Mar 23 13:23:46 2008 From: boxbackup at fluffy.co.uk (Kjell Christian Bruheim) Date: Sun, 23 Mar 2008 14:23:46 +0100 Subject: [Box Backup] Wildcards in BackupLocations Message-ID: <47E659E2.4010008@supportingit.com> Hi all! Is it posseble to use wildcards in the backuplocations in the client file? I.E. i want to make it backup "my documents" on a windows client nomather who logs on: %userprofile%\my documents\ Cheers Kjell From boxbackup at fluffy.co.uk Sun Mar 23 13:50:39 2008 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Sun, 23 Mar 2008 13:50:39 +0000 (GMT) Subject: [Box Backup] Wildcards in BackupLocations In-Reply-To: <47E659E2.4010008@supportingit.com> References: <47E659E2.4010008@supportingit.com> Message-ID: Hi Kjell, On Sun, 23 Mar 2008, Kjell Christian Bruheim wrote: > Is it posseble to use wildcards in the backuplocations in the client > file? I.E. i want to make it backup "my documents" on a windows client > nomather who logs on: %userprofile%\my documents\ I woulnd't consider that a wildcard but an environment variable. I don't think it will work right now. And even if it did, I don't think it will do what you want. Let's say user A logs in and Box Backup backs up all their data to account 1 on the server. Then user B logs in with a completely different set of files in their home directory. Box Backup will delete all of User A's files on the server and upload User B's files instead. Then User A logs in again, and all of User B's files get deleted on the server, and so on. Cheers, Chris. -- _ ___ __ _ / __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Sun Mar 23 14:13:56 2008 From: boxbackup at fluffy.co.uk (Kjell Christian Bruheim) Date: Sun, 23 Mar 2008 15:13:56 +0100 Subject: [Box Backup] Wildcards in BackupLocations In-Reply-To: References: <47E659E2.4010008@supportingit.com> Message-ID: <47E665A4.9020703@supportingit.com> Chris Wilson wrote: > Hi Kjell, > > On Sun, 23 Mar 2008, Kjell Christian Bruheim wrote: > >> Is it posseble to use wildcards in the backuplocations in the client >> file? I.E. i want to make it backup "my documents" on a windows >> client nomather who logs on: %userprofile%\my documents\ > > I woulnd't consider that a wildcard but an environment variable. I > don't think it will work right now. And even if it did, I don't think > it will do what you want. > > Let's say user A logs in and Box Backup backs up all their data to > account 1 on the server. Then user B logs in with a completely > different set of files in their home directory. Box Backup will delete > all of User A's files on the server and upload User B's files instead. > Then User A logs in again, and all of User B's files get deleted on > the server, and so on. > > Cheers, Chris. The idea was to use %USERNAME% as remote folder name and %USERPROFILE%\My documents as local folder to store like this: %USERNAME% { Path = %USERPROFILE%\My documents\ } I was kinda hoping this would solve the problem. But it does not recognize the %VARIABLE% :( And my knowledge of environment variables is not that good. Is there anywhere i can read me to some knowledge about it?? From boxbackup at fluffy.co.uk Sun Mar 23 15:17:46 2008 From: boxbackup at fluffy.co.uk (James O'Gorman) Date: Sun, 23 Mar 2008 15:17:46 +0000 Subject: [Box Backup] Wildcards in BackupLocations In-Reply-To: <47E665A4.9020703@supportingit.com> References: <47E659E2.4010008@supportingit.com> <47E665A4.9020703@supportingit.com> Message-ID: <20080323151746.GL15350@netinertia.co.uk> On Sun, Mar 23, 2008 at 03:13:56PM +0100, Kjell Christian Bruheim wrote: > The idea was to use %USERNAME% as remote folder name and %USERPROFILE%\My > documents as local folder to store like this: > > %USERNAME% > { > Path = %USERPROFILE%\My documents\ > } > > I was kinda hoping this would solve the problem. But it does not recognize > the %VARIABLE% :( Why not just have one store called "Users" which points to C:\Documents and Settings"? Something like: users { Path = C:\Documents and Settings ExcludeDirsRegex = .* AlwaysIncludeDirsRegex = My Documents$ } NB: This is untested, so may not be exactly right. James From boxbackup at fluffy.co.uk Sun Mar 23 15:24:49 2008 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Sun, 23 Mar 2008 15:24:49 +0000 (GMT) Subject: [Box Backup] Wildcards in BackupLocations In-Reply-To: <20080323151746.GL15350@netinertia.co.uk> References: <47E659E2.4010008@supportingit.com> <47E665A4.9020703@supportingit.com> <20080323151746.GL15350@netinertia.co.uk> Message-ID: Hi James and Kjell, On Sun, 23 Mar 2008, James O'Gorman wrote: >> I was kinda hoping this would solve the problem. But it does not recognize >> the %VARIABLE% :( No, it is not designed to recognise any such environment variables. Even if it did, you would still have other problems: * Locations belonging to other users would be seen as "redundant" (no longer needed) when bbackupd starts, and deleted on the store after a timeout (2 days by default). * All users' files on the store end up in the same account and encrypted with the same key, so it's not safe to give them access to their own home directories anyway. Which makes James' suggestion the best answer I can think of: > Why not just have one store called "Users" which points to C:\Documents > and Settings"? Something like: Unfortunately I think these settings will not work: > users > { > Path = C:\Documents and Settings > ExcludeDirsRegex = .* > AlwaysIncludeDirsRegex = My Documents$ > } as the My Documents paths are usually: c:\Documents and Settings\user1\My Documents c:\Documents and Settings\user2\My Documents etc. and ExcludeDirsRegex = .* will exclude all the user directories, so Box will never descend into them and find the My Documents within. Also, I think (but I'm not sure) that the regex must match the entire path, not just the end of it. So this configuration might work better: Path = C:\Documents and Settings ExcludeDirsRegex = C:\Documents and Settings\[^\]*\.* AlwaysIncludeDirsRegex = .*\My Documents Cheers, Chris. -- _ ___ __ _ / __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer | \ _/_/_/_//_/___/ | We are GNU-free your mind-and your software | From boxbackup at fluffy.co.uk Sun Mar 23 15:32:49 2008 From: boxbackup at fluffy.co.uk (James O'Gorman) Date: Sun, 23 Mar 2008 15:32:49 +0000 Subject: [Box Backup] Wildcards in BackupLocations In-Reply-To: References: <47E659E2.4010008@supportingit.com> <47E665A4.9020703@supportingit.com> <20080323151746.GL15350@netinertia.co.uk> Message-ID: <20080323153248.GM15350@netinertia.co.uk> On Sun, Mar 23, 2008 at 03:24:49PM +0000, Chris Wilson wrote: > Unfortunately I think these settings will not work: Mmm, I thought something wasn't quite right there... > and ExcludeDirsRegex = .* will exclude all the user directories, so Box will > never descend into them and find the My Documents within. Also, I think (but > I'm not sure) that the regex must match the entire path, not just the end of > it. So this configuration might work better: > > Path = C:\Documents and Settings > ExcludeDirsRegex = C:\Documents and Settings\[^\]*\.* > AlwaysIncludeDirsRegex = .*\My Documents That makes much more sense. James From boxbackup at fluffy.co.uk Tue Mar 25 10:18:16 2008 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Tue, 25 Mar 2008 11:18:16 +0100 Subject: [Box Backup] [OT ] - Products that connect many disk to a server? Message-ID: <47E8D168.80100@kontrapunkt.com> Hello... I'm happily using boxbackup, but need to build a server with a lot of diskspace. I feel that traditional RAID-products are expensive and overkill (Am I wrong) in my situation (using disks for backup). What I really want to do is to attach a bunch of disks (8+) and run software-raid on my Debian server. I have found these interesting looking products: http://www.macgurus.com/productpages/sata/BurlyPortMultiEncl.php http://www.datoptic.com/cgi-bin/web.cgi?product=RM12_S2P&detail=yes Any suggestions or comments on the subject from other bb-users? Thanks, Tobias From boxbackup at fluffy.co.uk Tue Mar 25 13:09:33 2008 From: boxbackup at fluffy.co.uk (Jody Belka) Date: Tue, 25 Mar 2008 13:09:33 +0000 Subject: [Box Backup] data store question Message-ID: <20080325130933.GS1891@pimb.org> Hi, I just wanted to check something about my understanding of the datastore. I believe it's the case that files can be stored as a delta against another object in the store, right. So you could have object 1 | | v object 2 - delta against object 1 | | v object 3 - delta against object 2 First I want to check I've got that correct? Then, assuming that it is, let's say that the store want's to free up some space. Does it have to keep objects 1 and 2 around, or is it able in some way to merge things back together? Also, again assuming the above to hold true, can more than one object exist as a delta against the same single object? eg, is this possible? object 1 / \ / \ / \ / \ object 2 object 3 (delta v 1) (delta v 1) J -- Jody Belka knew (at) pimb (dot) org From boxbackup at fluffy.co.uk Tue Mar 25 15:16:14 2008 From: boxbackup at fluffy.co.uk (Victor Meirans) Date: Tue, 25 Mar 2008 17:16:14 +0200 Subject: [Box Backup] [OT ] - Products that connect many disk to a server? In-Reply-To: <47E8D168.80100@kontrapunkt.com> References: <47E8D168.80100@kontrapunkt.com> Message-ID: <47E9173E.8040004@virtualis.lv> Interesting... Are they available in Europe? I am also planing a BB server, so, if possible, could you please share your opinion about another piece of hardware... It's an Intel Storage Server SSR212MC2. I would like to use FreeBSD on it, or RedHat or SuSE (which is better for BB?) if there are driver issues with it. Link to product page: http://www.intel.com/support/motherboards/server/ssr212mc2/ Thanks in advance. -- ViC on 2008.03.25 12:18 Tobias Balle-Petersen said the following: > Hello... > > I'm happily using boxbackup, but need to build a server with a lot of > diskspace. I feel that traditional RAID-products are expensive and > overkill (Am I wrong) in my situation (using disks for backup). > > What I really want to do is to attach a bunch of disks (8+) and run > software-raid on my Debian server. > > I have found these interesting looking products: > http://www.macgurus.com/productpages/sata/BurlyPortMultiEncl.php > http://www.datoptic.com/cgi-bin/web.cgi?product=RM12_S2P&detail=yes > > > Any suggestions or comments on the subject from other bb-users? > > > Thanks, > Tobias > > > > _______________________________________________ > boxbackup mailing list > boxbackup at fluffy.co.uk > http://lists.warhead.org.uk/mailman/listinfo/boxbackup > From boxbackup at fluffy.co.uk Tue Mar 25 17:10:36 2008 From: boxbackup at fluffy.co.uk (Per Reedtz Thomsen) Date: Tue, 25 Mar 2008 10:10:36 -0700 Subject: [Box Backup] [OT ] - Products that connect many disk to a server? In-Reply-To: <47E8D168.80100@kontrapunkt.com> References: <47E8D168.80100@kontrapunkt.com> Message-ID: <47E9320C.7070206@reedtz.com> On 3/25/08 3:18 AM, Tobias Balle-Petersen wrote: > Hello... > > I'm happily using boxbackup, but need to build a server with a lot of > diskspace. I feel that traditional RAID-products are expensive and > overkill (Am I wrong) in my situation (using disks for backup). > > What I really want to do is to attach a bunch of disks (8+) and run > software-raid on my Debian server. > > I have found these interesting looking products: > http://www.macgurus.com/productpages/sata/BurlyPortMultiEncl.php > http://www.datoptic.com/cgi-bin/web.cgi?product=RM12_S2P&detail=yes > > > Any suggestions or comments on the subject from other bb-users? In looking around a bit I found this: http://www.norcotek.com/item_detail.php?categoryid=12&modelno=ds1220 which is a 12-bay eSata enclosure, which can be had for $840 (without drives). I have no experience with Norco or any affiliation with them at all, so I don't know if they are any better or worse than other stuff... If I were building a backup server today, that's probably what I'd do: a server with one or more eSata controllers, and one or more boxes like this. Load on bb store server is very low (at least in my case), so there is no reason to worry too much about CPU, etc. My $0.02, Per -- Per Reedtz Thomsen | Reedtz Consulting, LLC | F: 209 883 4119 V: 209 883 4102 | pthomsen at reedtz.com | C: 209 996 9561 GPG ID: 1209784F | Yahoo! Chat: pthomsen | AIM: pthomsen From boxbackup at fluffy.co.uk Tue Mar 25 17:47:47 2008 From: boxbackup at fluffy.co.uk (Richard Hurt) Date: Tue, 25 Mar 2008 13:47:47 -0400 Subject: [Box Backup] [OT ] - Products that connect many disk to a server? In-Reply-To: <47E9320C.7070206@reedtz.com> References: <47E8D168.80100@kontrapunkt.com> <47E9320C.7070206@reedtz.com> Message-ID: <712ba87c0803251047o7b1e4a30u42208cb0923e24a1@mail.gmail.com> I am starting to use a small box by Coraid (http://www.coraid.com). Its an ATA over Ethernet (AoE) RAID box and not exactly what your asking for but its close. I got the smallest rack mount one (EtherDrive SR421) and it holds up to 4 SATA drives. Basically, instead of installing 2-3 SATA cards in your box you just need an extra Ethernet port and your good to go. It does internal RAID and its supposed to also support expanding into multiple cabinets. Like I said, I'm just getting started with it and haven't had much experience at all (and none with it and BB). The build on the hardware is just OK; it looks like some generic 1U server modified for their use, not a purpose build box. The only complaint I have so far is the fan noise. Either I have a bad fan or they need to update the firmware so that they are temp controlled. :/ Later... Richard On Tue, Mar 25, 2008 at 1:10 PM, Per Reedtz Thomsen wrote: > On 3/25/08 3:18 AM, Tobias Balle-Petersen wrote: > > Hello... > > > > I'm happily using boxbackup, but need to build a server with a lot of > > diskspace. I feel that traditional RAID-products are expensive and > > overkill (Am I wrong) in my situation (using disks for backup). > > > > What I really want to do is to attach a bunch of disks (8+) and run > > software-raid on my Debian server. > > > > I have found these interesting looking products: > > http://www.macgurus.com/productpages/sata/BurlyPortMultiEncl.php > > http://www.datoptic.com/cgi-bin/web.cgi?product=RM12_S2P&detail=yes > > > > > > Any suggestions or comments on the subject from other bb-users? > In looking around a bit I found this: > http://www.norcotek.com/item_detail.php?categoryid=12&modelno=ds1220 > which is a 12-bay eSata enclosure, which can be had for $840 (without > drives). I have no experience with Norco or any affiliation with them at > all, so I don't know if they are any better or worse than other stuff... > > If I were building a backup server today, that's probably what I'd do: a > server with one or more eSata controllers, and one or more boxes like > this. Load on bb store server is very low (at least in my case), so > there is no reason to worry too much about CPU, etc. > > My $0.02, > Per > > -- > Per Reedtz Thomsen | Reedtz Consulting, LLC | F: 209 883 4119 > V: 209 883 4102 | pthomsen at reedtz.com | C: 209 996 9561 > GPG ID: 1209784F | Yahoo! Chat: pthomsen | AIM: pthomsen > > _______________________________________________ > boxbackup mailing list > boxbackup at fluffy.co.uk > http://lists.warhead.org.uk/mailman/listinfo/boxbackup > From boxbackup at fluffy.co.uk Tue Mar 25 21:08:48 2008 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Tue, 25 Mar 2008 21:08:48 +0000 (GMT) Subject: [Box Backup] data store question In-Reply-To: <20080325130933.GS1891@pimb.org> References: <20080325130933.GS1891@pimb.org> Message-ID: Hi Jody, On Tue, 25 Mar 2008, Jody Belka wrote: > I just wanted to check something about my understanding of the > datastore. I believe it's the case that files can be stored as a delta > against another object in the store, right. So you could have > > object 1 > | > | > v > object 2 - delta against object 1 > | > | > v > object 3 - delta against object 2 > > > First I want to check I've got that correct? I believe so, yes. > Then, assuming that it is, let's say that the store want's to free up > some space. Does it have to keep objects 1 and 2 around, or is it able > in some way to merge things back together? It merges "object 1" and "object 2" to create a new "object 2", which no longer depends on "object 1", and then deletes "object 1". > Also, again assuming the above to hold true, can more than one object > exist as a delta against the same single object? eg, is this possible? > > object 1 > / \ > / \ > / \ > / \ > object 2 object 3 > (delta v 1) (delta v 1) I don't believe so at the moment. The automatic merging code would be made a lot more complex by this kind of structure. And the diffing code would be made a lot more complex by creating it in the first place. Box Backup only diffs against previous versions of the same file, so it could never end up with a tree structure like this. However, you might find that object 3 is a newer version of objects 1 and 2, but only in practice depends on blocks in object 1. You could view that as a tree structure if you choose, or equivalently that object 3 depends on the completely reconstructed object 2 (not just the difference blocks), which itself contains blocks from object 1, which is a linear structure. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | We are GNU : free your mind & your software | From boxbackup at fluffy.co.uk Tue Mar 25 23:11:51 2008 From: boxbackup at fluffy.co.uk (Jamie Neil) Date: Tue, 25 Mar 2008 23:11:51 +0000 Subject: [Box Backup] [OT ] - Products that connect many disk to a server? In-Reply-To: <47E8D168.80100@kontrapunkt.com> References: <47E8D168.80100@kontrapunkt.com> Message-ID: <47E986B7.60306@versado.net> Tobias Balle-Petersen wrote: > What I really want to do is to attach a bunch of disks (8+) and run > software-raid on my Debian server. I run software raid on most of my Debian servers. The only disadvantages that I'm aware of are: 1) Not hotswap (although I've been told that it is possible given the right hardware). 2) No battery backed write-back cache. > Any suggestions or comments on the subject from other bb-users? The system we were considering was a Chenbro RM215: http://www.chenbro.com/corporatesite/products_detail.php?serno=47 Which holds up to 8 3.5" SATA drives in 2U, and a Tyan Tomcat S2925 mainboard: http://www.tyan.com/product_board_detail.aspx?pid=169 which has 6 onboard SATA ports and takes ECC memory. With 8*500GB drives (RAID5 with hot spare), an extra SATA controller, CPU and memory, it comes to about ?1000, which is 30p/GB. We're also considering the Dell PowerEdge 1900. It doesn't have caddies, and it's much bigger (5U), but it's well engineered, can take up to 8 3.5" SATA drives, and a base system with 2 (throwaway) drives will only set you back ?600, so once you add a bunch of third party drives it comes out to about the same price. Space used to be an issue for us, but now it's much more about power - it's hard to completely fill up a rack on a normal power feed. -- Jamie Neil | | 0870 7777 454 Versado I.T. Services Ltd. | http://versado.net/ | 0845 450 1254 From boxbackup at fluffy.co.uk Wed Mar 26 12:54:31 2008 From: boxbackup at fluffy.co.uk (Ben Bennett) Date: Wed, 26 Mar 2008 08:54:31 -0400 Subject: [Box Backup] [OT ] - Products that connect many disk to a server? In-Reply-To: <47E986B7.60306@versado.net> References: <47E8D168.80100@kontrapunkt.com> <47E986B7.60306@versado.net> Message-ID: <20080326125431.GA8663@ayup.limey.net> I too am a big fan of linux software RAID. I like the ability to poke through the different levels of things from the OS. I've used it to save off one of the sub-disks in a failed RAID (remotely) to restore when a good disk was swapped in. (Shoestring budget didn't have enough money for a spare IDE port in the box). Also it gets you away from the vendor-specific superblocks which ties you to hardware. With the recent upgrades (background scans, bitmap for partial recovery, RAID-5 and 6 resizing, etc.) the linux md stuff has become really impressive. Anyway... I have a bunch of PATA and SATA inside my large case. And I have a cheap eSATA 1-drive enclosure that performs well. I've been keeping my eye on these for when I need more space: - SATA Enclosures: http://www.cooldrives.com/sataenclosures.html - SATA Port Multipliers: http://www.cooldrives.com/cosapomubrso.html - Multilane SATA: http://www.cooldrives.com/multilane-adapter-kit.html -ben On Tue, Mar 25, 2008 at 11:11:51PM +0000, Jamie Neil wrote: > Tobias Balle-Petersen wrote: >> What I really want to do is to attach a bunch of disks (8+) and run >> software-raid on my Debian server. > > I run software raid on most of my Debian servers. The only disadvantages > that I'm aware of are: > > 1) Not hotswap (although I've been told that it is possible given the right > hardware). > > 2) No battery backed write-back cache. > >> Any suggestions or comments on the subject from other bb-users? > > The system we were considering was a Chenbro RM215: > > http://www.chenbro.com/corporatesite/products_detail.php?serno=47 > > Which holds up to 8 3.5" SATA drives in 2U, and a Tyan Tomcat S2925 > mainboard: > > http://www.tyan.com/product_board_detail.aspx?pid=169 > > which has 6 onboard SATA ports and takes ECC memory. > > With 8*500GB drives (RAID5 with hot spare), an extra SATA controller, CPU > and memory, it comes to about ?1000, which is 30p/GB. > > We're also considering the Dell PowerEdge 1900. It doesn't have caddies, > and it's much bigger (5U), but it's well engineered, can take up to 8 3.5" > SATA drives, and a base system with 2 (throwaway) drives will only set you > back ?600, so once you add a bunch of third party drives it comes out to > about the same price. Space used to be an issue for us, but now it's much > more about power - it's hard to completely fill up a rack on a normal power > feed. > > -- > Jamie Neil | | 0870 7777 454 > Versado I.T. Services Ltd. | http://versado.net/ | 0845 450 1254 > _______________________________________________ > boxbackup mailing list > boxbackup at fluffy.co.uk > http://lists.warhead.org.uk/mailman/listinfo/boxbackup From boxbackup at fluffy.co.uk Fri Mar 28 05:39:18 2008 From: boxbackup at fluffy.co.uk (Jamuel P. Starkey) Date: Thu, 27 Mar 2008 22:39:18 -0700 (PDT) Subject: [Box Backup] bbstored logging Warnings for Incoming Connection In-Reply-To: References: <477C01AF.4090000@guno.nl> Message-ID: <2238.75.23.59.6.1206682758.squirrel@webmail.gcisys.com> Hi, Can anyone explain why the bbstored logs the following warning: Mar 27 23:36:18 83210-db1 Box Backup (bbstored)[27638]: WARNING: Message from child process 2627: Incoming connection from 208.97.196.5 port 22171 Mar 27 23:36:18 83210-db1 Box Backup (bbstored)[2627]: NOTICE: Login from Client ID 0x6ea9d0fa Read/Write Mar 27 23:36:23 83210-db1 Box Backup (bbstored)[2627]: NOTICE: Session finished for Client ID 0x6ea9d0fa Mar 27 23:39:13 83210-db1 Box Backup (bbstored)[27638]: WARNING: Message from child process 2638: Incoming connection from 208.97.196.5 port 22213 Mar 27 23:39:13 83210-db1 Box Backup (bbstored)[2638]: NOTICE: Login from Client ID 0x0cf3482c Read/Write Mar 27 23:39:17 83210-db1 Box Backup (bbstored)[2638]: NOTICE: Session finished for Client ID 0x0cf3482c Mar 28 00:06:50 83210-db1 Box Backup (bbstored)[27638]: WARNING: Message from child process 2772: Incoming connection from 208.97.196.5 port 22724 Mar 28 00:06:51 83210-db1 Box Backup (bbstored)[2772]: NOTICE: Login from Client ID 0x06126556 Read/Write Mar 28 00:06:52 83210-db1 Box Backup (bbstored)[2772]: NOTICE: Session finished for Client ID 0x06126556 I'm running BoxBackup v0.11rc2 on RHEL5. I do have multiple clients attaching (via NAT) from the source address listed (208.97.196.5) but they (obviously) have different Account ID's. Thanks in advance! Cheers, JPS From boxbackup at fluffy.co.uk Fri Mar 28 09:16:19 2008 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Fri, 28 Mar 2008 10:16:19 +0100 Subject: [Box Backup] [OT ] - Products that connect many disk to a server? In-Reply-To: <20080326125431.GA8663@ayup.limey.net> References: <47E8D168.80100@kontrapunkt.com> <47E986B7.60306@versado.net> <20080326125431.GA8663@ayup.limey.net> Message-ID: <47ECB763.6060400@kontrapunkt.com> Hello Ben. Thank you for the thoughts and links. The site you linked to only ship within th US :( Does anyone know of companies selling stuff like this in Europe? Thanks, Tobias Ben Bennett wrote: > Anyway... I have a bunch of PATA and SATA inside my large case. And I > have a cheap eSATA 1-drive enclosure that performs well. I've been > keeping my eye on these for when I need more space: > - SATA Enclosures: http://www.cooldrives.com/sataenclosures.html > - SATA Port Multipliers: http://www.cooldrives.com/cosapomubrso.html > - Multilane SATA: http://www.cooldrives.com/multilane-adapter-kit.html From boxbackup at fluffy.co.uk Fri Mar 28 09:35:42 2008 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Fri, 28 Mar 2008 09:35:42 +0000 (GMT) Subject: [Box Backup] bbstored logging Warnings for Incoming Connection In-Reply-To: <2238.75.23.59.6.1206682758.squirrel@webmail.gcisys.com> References: <477C01AF.4090000@guno.nl> <2238.75.23.59.6.1206682758.squirrel@webmail.gcisys.com> Message-ID: Hi Jamuel, On Thu, 27 Mar 2008, Jamuel P. Starkey wrote: > Can anyone explain why the bbstored logs the following warning: > > Mar 27 23:36:18 83210-db1 Box Backup (bbstored)[27638]: WARNING: Message from child process 2627: Incoming connection from 208.97.196.5 port 22171 Sorry, it's a bug, it should have been a NOTICE. I thought I'd fixed this already, will check again. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | We are GNU : free your mind & your software | From boxbackup at fluffy.co.uk Fri Mar 28 10:21:12 2008 From: boxbackup at fluffy.co.uk (Tobias Balle-Petersen) Date: Fri, 28 Mar 2008 11:21:12 +0100 Subject: [Box Backup] [OT ] - Products that connect many disk to a server? In-Reply-To: <712ba87c0803251047o7b1e4a30u42208cb0923e24a1@mail.gmail.com> References: <47E8D168.80100@kontrapunkt.com> <47E9320C.7070206@reedtz.com> <712ba87c0803251047o7b1e4a30u42208cb0923e24a1@mail.gmail.com> Message-ID: <47ECC698.9090703@kontrapunkt.com> Hello Richard. Looks interesting. I'm reading up on AoE. There is an older article on the subject here if anyones interested: http://www.linuxjournal.com/article/8149 Thanks, Tobias Richard Hurt wrote: > I am starting to use a small box by Coraid (http://www.coraid.com). From boxbackup at fluffy.co.uk Sat Mar 29 19:11:54 2008 From: boxbackup at fluffy.co.uk (Tom Albers) Date: Sat, 29 Mar 2008 20:11:54 +0100 Subject: [Box Backup] Change of the trac page Marketplace. Message-ID: <3790108.SiZViBltfo@kovoks.nl> --nextPart2700769.RXQzvLba6K Content-Type: text/plain Content-Transfer-Encoding: 7Bit Hi there, Thanks for all the work on BoxBackup. Could someone with Powers change: http://www.boxbackup.org/trac/wiki/Marketplace It now reads: Own-it is based in The Netherlands. Although not currently advertised on the site, we are accepting clients who want to backup. Prices are available on request, just sent an email to kovoks at kovoks.nl for more information. Cam you change it to: Own-it is based in The Netherlands. Own-it provides online backup facilities based on BoxBackup. There is a 50 euro setup fee and the monthly costs equal the amount of gigabytes. So 30 euro/month for 30GB space. Order online on the website (dutch) or mail kovoks at kovoks.nl. Tom Albers Own-It --nextPart2700769.RXQzvLba6K-- From boxbackup at fluffy.co.uk Sat Mar 29 20:13:06 2008 From: boxbackup at fluffy.co.uk (James O'Gorman) Date: Sat, 29 Mar 2008 20:13:06 +0000 Subject: [Box Backup] Change of the trac page Marketplace. In-Reply-To: <3790108.SiZViBltfo@kovoks.nl> References: <3790108.SiZViBltfo@kovoks.nl> Message-ID: <20080329201305.GN15350@netinertia.co.uk> Hi Tom, On Sat, Mar 29, 2008 at 08:11:54PM +0100, Tom Albers wrote: > Hi there, > > Thanks for all the work on BoxBackup. > > Could someone with Powers change: > http://www.boxbackup.org/trac/wiki/Marketplace E-mail me off-list with a preferred username and I will create a trac account for you. James From boxbackup at fluffy.co.uk Sat Mar 29 20:14:40 2008 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Sat, 29 Mar 2008 20:14:40 +0000 (GMT) Subject: [Box Backup] Change of the trac page Marketplace. In-Reply-To: <3790108.SiZViBltfo@kovoks.nl> References: <3790108.SiZViBltfo@kovoks.nl> Message-ID: Hi Tom, On Sat, 29 Mar 2008, Tom Albers wrote: > Thanks for all the work on BoxBackup. You're welcome :-) > Could someone with Powers change: > http://www.boxbackup.org/trac/wiki/Marketplace > > It now reads: > Own-it is based in The Netherlands. Although not currently advertised on the site, we are accepting clients who want to backup. Prices are available on request, just sent an email to kovoks at kovoks.nl for more information. > > Cam you change it to: > Own-it is based in The Netherlands. Own-it provides online backup facilities based on BoxBackup. There is a 50 euro setup fee and the monthly costs equal the amount of gigabytes. So 30 euro/month for 30GB space. Order online on the website (dutch) or mail kovoks at kovoks.nl. Done. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | We are GNU : free your mind & your software | From boxbackup at fluffy.co.uk Mon Mar 31 06:29:41 2008 From: boxbackup at fluffy.co.uk (Jamuel P. Starkey) Date: Sun, 30 Mar 2008 22:29:41 -0700 (PDT) Subject: [Box Backup] Raw File Encryption Key Management In-Reply-To: References: <3790108.SiZViBltfo@kovoks.nl> Message-ID: <1878.75.23.59.6.1206941381.squirrel@webmail.gcisys.com> Hi, >From the docs I surmise that the raw file encryption key file contains two keys: one AES and one Blowfish. Can some describe the file/container that encapsulates these keys? I tried a cursory Google search for a description of raw encryption keys and didn't get very far . . . Are there any suggestions for a means to export these keys? Or even to transform the keys into another format for archival purposes? Any information you can provide with respect to the raw file encryption keys would be greatly appreciated. Cheers, JPS From boxbackup at fluffy.co.uk Mon Mar 31 09:29:16 2008 From: boxbackup at fluffy.co.uk (Chris Wilson) Date: Mon, 31 Mar 2008 09:29:16 +0100 (BST) Subject: [Box Backup] Raw File Encryption Key Management In-Reply-To: <1878.75.23.59.6.1206941381.squirrel@webmail.gcisys.com> References: <3790108.SiZViBltfo@kovoks.nl> <1878.75.23.59.6.1206941381.squirrel@webmail.gcisys.com> Message-ID: Hi Jamuel, On Sun, 30 Mar 2008, Jamuel P. Starkey wrote: > >From the docs I surmise that the raw file encryption key file contains > >two keys: one AES and one Blowfish. Can some describe the > >file/container > that encapsulates these keys? I tried a cursory Google search for a > description of raw encryption keys and didn't get very far . . . > > Are there any suggestions for a means to export these keys? Or even to > transform the keys into another format for archival purposes? No, they are not designed to be separated, they are useless without each the other, and they are not designed to be useful or used for any purpose at all other than Box Backup. Just archive the .raw file. It's just what you need to restore files. As far as I know there is no container, they are just just pulled out at fixed offsets and lengths from the binary file. See lib/backupclient/BackupClientCryptoKeys.cpp. > Any information you can provide with respect to the raw file encryption > keys would be greatly appreciated. docs/backup/backup_encryption.txt is the only one that I know of, apart from the source itself. Cheers, Chris. -- _____ __ _ \ __/ / ,__(_)_ | Chris Wilson <0000 at qwirx.com> - Cambs UK | / (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer | \ _/_/_/_//_/___/ | We are GNU : free your mind & your software |