[Box Backup-commit] [boxbackup/boxbackup] 2820af: Add support for S3-compatible ETag headers to S3Si...

GitHub noreply at github.com
Mon Aug 7 21:02:02 BST 2017


  Branch: refs/heads/s3_support_merge
  Home:   https://github.com/boxbackup/boxbackup
  Commit: 2820af7928807fc2c62fbc16e75da964e18fd673
      https://github.com/boxbackup/boxbackup/commit/2820af7928807fc2c62fbc16e75da964e18fd673
  Author: Chris Wilson <chris+github at qwirx.com>
  Date:   2017-08-07 (Mon, 07 Aug 2017)

  Changed paths:
    M lib/httpserver/S3Simulator.cpp
    M test/httpserver/testhttpserver.cpp

  Log Message:
  -----------
  Add support for S3-compatible ETag headers to S3Simulator


  Commit: 09c0e9e5119a26491bd06c3314fa5eb546d48966
      https://github.com/boxbackup/boxbackup/commit/09c0e9e5119a26491bd06c3314fa5eb546d48966
  Author: Chris Wilson <chris+github at qwirx.com>
  Date:   2017-08-07 (Mon, 07 Aug 2017)

  Changed paths:
    M lib/httpserver/S3Client.cpp
    M lib/httpserver/S3Client.h
    M lib/httpserver/S3Simulator.cpp
    M lib/httpserver/S3Simulator.h
    M modules.txt
    M test/httpserver/testhttpserver.cpp

  Log Message:
  -----------
  Add support for If-None-Match header to S3Client and S3Simulator

This allows the client to only download a file if it doesn't match the one in
the local cache, which makes it possible to use the cache very efficiently.


  Commit: 017642701d0de7669550866ec6124581a6c51296
      https://github.com/boxbackup/boxbackup/commit/017642701d0de7669550866ec6124581a6c51296
  Author: Chris Wilson <chris+github at qwirx.com>
  Date:   2017-08-07 (Mon, 07 Aug 2017)

  Changed paths:
    M test/bbackupd/testbbackupd.cpp

  Log Message:
  -----------
  Rename setup_test_bbackupd() in test/bbackupd

The name of this utility function was confusing with the SETUP_TEST_BBACKUPD
macro which served an entirely different purpose, so I renamed it to
prepare_test_with_client_daemon().


  Commit: 65aa45ce63ce38df99cc6e635f18679adf321529
      https://github.com/boxbackup/boxbackup/commit/65aa45ce63ce38df99cc6e635f18679adf321529
  Author: Chris Wilson <chris+github at qwirx.com>
  Date:   2017-08-07 (Mon, 07 Aug 2017)

  Changed paths:
    M lib/backupstore/BackupAccountControl.cpp
    M lib/backupstore/BackupAccountControl.h
    M lib/backupstore/BackupCommands.cpp
    M lib/backupstore/BackupStoreContext.cpp
    M lib/backupstore/BackupStoreContext.h

  Log Message:
  -----------
  Make GetBlockSize() use BackupFileSystem

Refactor BackupAccountControl, BackupStoreContext and BackupCommands to call
BackupFileSystem to get the block size of the filesystem. It's a start.


  Commit: d3d1add6aeab6c11483a5ddbbef433e4a8724b50
      https://github.com/boxbackup/boxbackup/commit/d3d1add6aeab6c11483a5ddbbef433e4a8724b50
  Author: Chris Wilson <chris+github at qwirx.com>
  Date:   2017-08-07 (Mon, 07 Aug 2017)

  Changed paths:
    M lib/backupstore/StoreTestUtils.h
    M lib/server/makeprotocol.pl.in

  Log Message:
  -----------
  Protocol generator: record last error message received

Store this as a string (as well as the error code) so that we can report it to
the user, for example in test failure messages.


  Commit: 14fdd6abe961514bb99a88500c5ce6dc2d6e006d
      https://github.com/boxbackup/boxbackup/commit/14fdd6abe961514bb99a88500c5ce6dc2d6e006d
  Author: Chris Wilson <chris+github at qwirx.com>
  Date:   2017-08-07 (Mon, 07 Aug 2017)

  Changed paths:
    M lib/common/Logging.h
    M lib/server/Socket.cpp

  Log Message:
  -----------
  Improve error message on hostname lookup failure

Throw exceptions with a message, including the OS error, which means retrieving
it properly from the winsock library on Windows.


  Commit: dc649a6f5bdc25576d603ad541e4c9a5bd79b202
      https://github.com/boxbackup/boxbackup/commit/dc649a6f5bdc25576d603ad541e4c9a5bd79b202
  Author: Chris Wilson <chris+github at qwirx.com>
  Date:   2017-08-07 (Mon, 07 Aug 2017)

  Changed paths:
    M infrastructure/m4/boxbackup_tests.m4

  Log Message:
  -----------
  Make narrowing conversions an error

E.g. on ARM64 with unsigned chars, this is a real error, and causes the build
to fail:
https://buildd.debian.org/status/fetch.php?pkg=boxbackup&arch=arm64&ver=0.11.1~r2837-4&stamp=1485057548&raw=0

(cherry picked from commit 3433291fc5bfbbdc87385796c26c44699edf5c0c)


  Commit: 90315349c93559cdf577a2b77ab7ce0e975ab432
      https://github.com/boxbackup/boxbackup/commit/90315349c93559cdf577a2b77ab7ce0e975ab432
  Author: Chris Wilson <chris+github at qwirx.com>
  Date:   2017-08-07 (Mon, 07 Aug 2017)

  Changed paths:
    M infrastructure/cmake/CMakeLists.txt
    M infrastructure/m4/boxbackup_tests.m4
    M lib/intercept/intercept.cpp
    M lib/intercept/intercept.h

  Log Message:
  -----------
  Fix incorrect detection of the need to intercept lxstat

For some reason, #if defined __GNUC__ && __GNUC__ >= 2 was true on OSX,
resulting in intercepts not working properly.  It was also broken on MIPS64,
causing test/raidfile to fail with errors like: TEST FAILURE: Condition
[TestGetFileSize(stripe1fn) == fs1] failed at testraidfile.cpp:415

https://buildd.debian.org/status/fetch.php?pkg=boxbackup&arch=mips64el&ver=0.11.1~r2837-4&stamp=1485060478&raw=0

Now we detect when to intercept Linux' lxstat syscall using autoconf macros.
We also detect whether to intercept stat64 (instead of stat) based on whether
the stat64 function exists.

(cherry picked from commit a042c9951fabc1fb4f57e6d13d739192dda76025)

Fix d2775d5b


  Commit: acea1e03e1a7808df6291a234b1715f0ab8cff0e
      https://github.com/boxbackup/boxbackup/commit/acea1e03e1a7808df6291a234b1715f0ab8cff0e
  Author: Chris Wilson <chris+github at qwirx.com>
  Date:   2017-08-07 (Mon, 07 Aug 2017)

  Changed paths:
    M lib/common/BoxTime.cpp

  Log Message:
  -----------
  Increase precision of timing on Windows.

Should hopefully reduce random failures of timing-dependent tests which
rely on subsecond precision for accuracy.

(cherry picked from commit c845b2e39fffeb560983a301d810616a6495469d)
(cherry picked from commit ce7e000d43a91dcd0d39ee3a505521e700875556)


  Commit: 06303743d7f0c3bba2b56fb957ccb1abef8df418
      https://github.com/boxbackup/boxbackup/commit/06303743d7f0c3bba2b56fb957ccb1abef8df418
  Author: Chris Wilson <chris+github at qwirx.com>
  Date:   2017-08-07 (Mon, 07 Aug 2017)

  Changed paths:
    M infrastructure/cmake/windows/CMakeLists.txt

  Log Message:
  -----------
  Switch PCRE back to an official release


  Commit: 36acbe9dfcb77dc5d63d796e1514945a7b10a503
      https://github.com/boxbackup/boxbackup/commit/36acbe9dfcb77dc5d63d796e1514945a7b10a503
  Author: Chris Wilson <chris+github at qwirx.com>
  Date:   2017-08-07 (Mon, 07 Aug 2017)

  Changed paths:
    M infrastructure/cmake/windows/CMakeLists.txt

  Log Message:
  -----------
  Remove BoxBackup install step from Windows unibuild

We don't need to install anything in C:\Program Files\BoxBackup, and often
don't have permission to do that anyway.


  Commit: 01589e4858e16e5cd0d91ed21cdf711b8e89bf56
      https://github.com/boxbackup/boxbackup/commit/01589e4858e16e5cd0d91ed21cdf711b8e89bf56
  Author: Chris Wilson <chris+github at qwirx.com>
  Date:   2017-08-07 (Mon, 07 Aug 2017)

  Changed paths:
    M infrastructure/cmake/windows/CMakeLists.txt

  Log Message:
  -----------
  Upgrade to OpenSSL 1.0.2l

Run OpenSSL tests after building it for Windows Unibuild


  Commit: e767f3d0bd4556a2ef4136f6bd368279a2a5b57d
      https://github.com/boxbackup/boxbackup/commit/e767f3d0bd4556a2ef4136f6bd368279a2a5b57d
  Author: Chris Wilson <chris+github at qwirx.com>
  Date:   2017-08-07 (Mon, 07 Aug 2017)

  Changed paths:
    M lib/raidfile/RaidFileWrite.cpp

  Log Message:
  -----------
  Improve exception messages from RaidFileWrite

Use THROW_SYS_FILE_ERROR to include the system error message in the exception
message. Replace calls to BOX_LOG_SYS_ERROR where previously used.


  Commit: 7683001bb37ed0769d6beaf7a440bf1202c8f0e9
      https://github.com/boxbackup/boxbackup/commit/7683001bb37ed0769d6beaf7a440bf1202c8f0e9
  Author: Chris Wilson <chris+github at qwirx.com>
  Date:   2017-08-07 (Mon, 07 Aug 2017)

  Changed paths:
    M .travis.yml

  Log Message:
  -----------
  Travis CI: exclude (don't build) tags created by AppVeyor

AppVeyor creates new tags for each release (binary build), which have the same
git commit that we already built, so building it again is a waste.


  Commit: 646ab9f63c7546bde838bfd9a327ae1b1be41da0
      https://github.com/boxbackup/boxbackup/commit/646ab9f63c7546bde838bfd9a327ae1b1be41da0
  Author: Chris Wilson <chris+github at qwirx.com>
  Date:   2017-08-07 (Mon, 07 Aug 2017)

  Changed paths:
    M lib/httpserver/HTTPResponse.h
    M lib/httpserver/S3Client.cpp

  Log Message:
  -----------
  Add ResponseCodeString shortcut to HTTPResponse

Useful for debug logging and exception messages.

Add the actual HTTP response to the exception message in
S3Client::CheckResponse, to help with debugging.


  Commit: b3579582a8d9891edd8adfb3566a47cf4765201d
      https://github.com/boxbackup/boxbackup/commit/b3579582a8d9891edd8adfb3566a47cf4765201d
  Author: Chris Wilson <chris+github at qwirx.com>
  Date:   2017-08-07 (Mon, 07 Aug 2017)

  Changed paths:
    M lib/httpserver/HTTPRequest.cpp
    M lib/httpserver/HTTPRequest.h
    M lib/httpserver/S3Simulator.cpp

  Log Message:
  -----------
  Add option to include parameters in HTTPRequest::GetRequestURI

This is needed to support the ListBucket command.


Compare: https://github.com/boxbackup/boxbackup/compare/c8e3b1fb62c7...b3579582a8d9


More information about the Boxbackup-commit mailing list