[Box Backup] No housekeeping?

Chris Wilson chris at qwirx.com
Wed Feb 1 09:44:47 GMT 2012


Hi Peter,

On Sun, 29 Jan 2012, Peter Hall wrote:

> I was unable to use -o, but I ran "bbstored -DV" and have attached the log of "grep bbstored /var/log/messages".
> 
> Strangely enough, you can see in the log that housekeeping seems to be alive and well, and have continously deleted items up until now, but I can't see any difference in used space on the store:
> # bbstoreaccounts info 1
>           Account ID: 0x00000001
>       Last object ID: 0x1106496
>                 Used:  243199227 blocks,  927.73 GB,  99% |*************** |
>            Old files:    3849197 blocks,   14.68 GB,   1% |                |
>        Deleted files:  127779108 blocks,  487.44 GB,  52% |********        |
>          Directories:     451080 blocks,    1.72 GB,   0% |                |
>           Soft limit:  230400000 blocks,  878.91 GB,  94% |*************** |
>           Hard limit:  243200000 blocks,  927.73 GB, 100% |****************|
>  Client store marker: 17851542
> 
> (I have terminated the client while try to get to the bottom of this problem, so it't not filling up the store.)
> 
> I know that there is a very large number of small files in the store, 
> and some of those large collections are possibly deleted. Could bbstored 
> be ineffient in deleting large amount of files (rough estimate: 
> 50000-100000 in one directory)?

It might be. But I did notice that housekeeping was running for three days 
without finishing in your log. The block counts are not updated while 
housekeeping is running, only when it finishes. So is it possible that 
housekeeping did actually finish and remove enough files to bring the 
store back under the soft limit, and you didn't notice that the block 
counts have finally been reduced?

> ERROR:   Housekeeping on account 0x00000001 found and fixed wrong block 
> counts: used (243199923,243199227), old (3849882,3849197), deleted 
> (127779749,127779108), dirs (451091,451080)

That's unusual, but without a complete and detailed log I wouldn't be able 
to diagnose how that happened. In any case the differences are small, so 
it's likely just not accounting for a deletion properly, which is a minor 
bug.

Cheers, Chris.
-- 
_____ __     _
\  __/ / ,__(_)_  | Chris Wilson <chris+sig at qwirx.com> Cambs UK |
/ (_/ ,\/ _/ /_ \ | Security/C/C++/Java/Ruby/Perl/SQL Developer |
\__/_/_/_//_/___/ | We are GNU : free your mind & your software |


More information about the Boxbackup mailing list