[Box Backup-dev] Re: [Box Backup] ChrisMerge_1828

[Chris Wilson]

Hi Pete,

On Wed, 19 Sep 2007, Peter Jalajas, TebucoSafe Backups wrote:

> Hi Chris,
>
>> Which log messages need full paths?
>
> In the past, when we launch the service on Windows, and we view the Event Viewer records, we just
> see a filename with no path, which was hard to debug.  But, with your new LogAllFileAccess, I
> guess I could say ignore this request--nevermind.

But it should definitely not be required to enable LogAllFileAccess, 
except for debugging configurations and specific issues as to why certain 
files are not being backed up.

If you are seeing something other than full paths in messages where it 
would be useful to see a full path (not including ExtendedLogging protocol 
logs) I would be very interested to hear it.

> I'm trying to think of a way to help prevent clogging our clients' 
> outbound pipes during the backup of large files during the day.  I'm 
> thinking that maybe there is an obvious spot in the code, into which you 
> could put a configurable few milliseconds of sleep between uploads of 
> file blocks?  (Upload a 2K block, sleep, upload the next block, sleep, 
> and so on. If my math is correct, a 100MB upload at 300Kbps would take 
> about 40 minutes to upload, hogging the pipe.  That file would have 
> 50,000 2KB blocks, and so, adding a 10 ms sleep after each 2KB block 
> upload would insert about 8 minutes of bandwidth availability into that 
> 40-minute period.) (Maybe later versions could have that sleep time 
> different for different dayparts.)

I'm not sure how helpful this would be. Box Backup is designed to stream 
data continuously, routers drop packets when available bandwidth is 
exceeded, and TCP recovers by dropping the sending rate. It should 
automatically share the available bandwidth between all well-behaved 
users. If it doesn't, then I'd be interested to hear about it. If it does, 
then it should lead to more efficient backups than any random delay 
inserted between streaming file uploads.

If you need to maintain more bandwidth for other net access while bbackupd 
is streaming uploads, then I think that implementing QoS on your router, 
or possibly setting appropriate TOS bits on the bbackupd connection, might 
be the way to achieve it.

> I'm setting up your S3 account now...

Thanks! Not sure when I'll have time to do anything with it, but it 
shouldn't cost you anything while I don't.

Cheers, Chris.
-- 
_____ __     _
\  __/ / ,__(_)_  | Chris Wilson <0000 at qwirx.com> - Cambs UK |
/ (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Perl/SQL/HTML Developer |
\ _/_/_/_//_/___/ | We are GNU-free your mind-and your software |