From cccb8b99b9dc6a6fe240966ca461dcd525c371d8c8aeab988ba8fe9eae179bf6 Mon Sep 17 00:00:00 2001 From: Martin Pluskal Date: Mon, 9 Oct 2023 15:10:20 +0000 Subject: [PATCH] Accepting request 1116481 from home:amanzini:branches:server:database - update to 8.6.7 * Fixed a bug where compaction read under non direct IO still falls back to RocksDB internal prefetching after file system's prefetching returns non-OK status other than Status::NotSupported() * For non direct IO, eliminate the file system prefetching attempt for compaction read when Options::compaction_readahead_size is 0 - update to 8.6.6 * Fix a bug with atomic_flush=true that can cause DB to stuck after a flush fails * Fix a bug where RocksDB (with atomic_flush=false) can delete output SST files of pending flushes when a previous concurrent flush fails * When the compressed secondary cache capacity is reduced to 0, it should be completely disabled. Before this fix, inserts and lookups would still go to the backing LRUCache - update to 8.6.5 * Fixed a bug where rocksdb.file.read.verify.file.checksums.micros is not populated. - update to 8.6.4 * Public API change: Add a column family option default_temperature that is used for file reading accounting purpose, such as io statistics, for files that don't have an explicitly set temperature. - update to 8.6.3 * Fix a bug where if there is an error reading from offset 0 of a file from L1+ and that the file is not the first file in the sorted run, data can be lost in compaction and read/scan can return incorrect results. * Fix a bug where iterator may return incorrect result for DeleteRange() users if there was an error reading from a file. - update to 8.6.2 * Fix for async_io where during seek, when reading a block for seeking a target key in a file without any readahead, the iterator aligned the read on a page boundary and reading more than necessary. This increased the storage read bandwidth usage. - update to 8.6.1 * Options::compaction_readahead_size 's default value is changed from 0 to 2MB. * Compaction read performance will regress when Options::compaction_readahead_size is explicitly set to 0 - update to 8.6.0 * Added enhanced data integrity checking on SST files with new format_version=6. * Add a new feature to trim readahead_size during scans upto upper_bound when iterate_upper_bound is specified. * RocksDB will compare the number of input keys to the number of keys processed after each compaction. * Add a CF option bottommost_file_compaction_delay to allow specifying the delay of bottommost level single-file compactions. * Add support to allow enabling / disabling user-defined timestamps feature for an existing column family in combination with the in-Memtable only feature. * Implement a new admission policy for the compressed secondary cache that admits blocks evicted from the primary cache with the hit bit set. * Add a column family option memtable_max_range_deletions that limits the number of range deletions in a memtable. * Add PutEntity API in sst_file_writer * Add timeout in microsecond option to WaitForCompactOptions * New statistics rocksdb.file.read.{get|multiget|db.iterator|verify.checksum|verify.file.checksums}.micros measure read time of block-based SST tables or blob files during db open, Get(), MultiGet(), using db iterator, VerifyFileChecksums() and VerifyChecksum(). They require stats level greater than StatsLevel::kExceptDetailedTimers. OBS-URL: https://build.opensuse.org/request/show/1116481 OBS-URL: https://build.opensuse.org/package/show/server:database/rocksdb?expand=0&rev=24 --- rocksdb-8.0.0-reproducible.patch | 6 ++-- rocksdb-8.0.0-rpath.patch | 6 ++-- rocksdb-8.0.0-shared-liburing.patch | 6 ++-- rocksdb-8.5.4.tar.gz | 3 -- rocksdb-8.6.7.tar.gz | 3 ++ rocksdb.changes | 48 +++++++++++++++++++++++++++++ rocksdb.spec | 2 +- 7 files changed, 61 insertions(+), 13 deletions(-) delete mode 100644 rocksdb-8.5.4.tar.gz create mode 100644 rocksdb-8.6.7.tar.gz diff --git a/rocksdb-8.0.0-reproducible.patch b/rocksdb-8.0.0-reproducible.patch index ec647ab..c45d1d5 100644 --- a/rocksdb-8.0.0-reproducible.patch +++ b/rocksdb-8.0.0-reproducible.patch @@ -1,7 +1,7 @@ -Index: rocksdb-8.5.3/Makefile +Index: rocksdb-8.6.7/Makefile =================================================================== ---- rocksdb-8.5.3.orig/Makefile -+++ rocksdb-8.5.3/Makefile +--- rocksdb-8.6.7.orig/Makefile ++++ rocksdb-8.6.7/Makefile @@ -787,9 +787,12 @@ ROCKSDB_PATCH = $(shell grep -E "ROCKSDB # the file needs to already exist or else the build will fail ifndef NO_UPDATE_BUILD_VERSION diff --git a/rocksdb-8.0.0-rpath.patch b/rocksdb-8.0.0-rpath.patch index 4d8dae9..e5fdf45 100644 --- a/rocksdb-8.0.0-rpath.patch +++ b/rocksdb-8.0.0-rpath.patch @@ -1,7 +1,7 @@ -Index: rocksdb-8.5.3/tools/CMakeLists.txt +Index: rocksdb-8.6.7/tools/CMakeLists.txt =================================================================== ---- rocksdb-8.5.3.orig/tools/CMakeLists.txt -+++ rocksdb-8.5.3/tools/CMakeLists.txt +--- rocksdb-8.6.7.orig/tools/CMakeLists.txt ++++ rocksdb-8.6.7/tools/CMakeLists.txt @@ -1,3 +1,5 @@ +set(CMAKE_SKIP_BUILD_RPATH TRUE) + diff --git a/rocksdb-8.0.0-shared-liburing.patch b/rocksdb-8.0.0-shared-liburing.patch index fa53760..06bd07e 100644 --- a/rocksdb-8.0.0-shared-liburing.patch +++ b/rocksdb-8.0.0-shared-liburing.patch @@ -1,7 +1,7 @@ -Index: rocksdb-8.5.3/cmake/modules/Finduring.cmake +Index: rocksdb-8.6.7/cmake/modules/Finduring.cmake =================================================================== ---- rocksdb-8.5.3.orig/cmake/modules/Finduring.cmake -+++ rocksdb-8.5.3/cmake/modules/Finduring.cmake +--- rocksdb-8.6.7.orig/cmake/modules/Finduring.cmake ++++ rocksdb-8.6.7/cmake/modules/Finduring.cmake @@ -7,7 +7,7 @@ find_path(uring_INCLUDE_DIR NAMES liburing.h) diff --git a/rocksdb-8.5.4.tar.gz b/rocksdb-8.5.4.tar.gz deleted file mode 100644 index ac69e67..0000000 --- a/rocksdb-8.5.4.tar.gz +++ /dev/null @@ -1,3 +0,0 @@ -version https://git-lfs.github.com/spec/v1 -oid sha256:d0c9a70a42d38c9684557ed4741910b5fea2ffbf95db8d52edfae1c03f1cc4e9 -size 12764804 diff --git a/rocksdb-8.6.7.tar.gz b/rocksdb-8.6.7.tar.gz new file mode 100644 index 0000000..7b2ae3d --- /dev/null +++ b/rocksdb-8.6.7.tar.gz @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cdb2fc3c6a556f20591f564cb8e023e56828469aa3f76e1d9535c443ba1f0c1a +size 12806059 diff --git a/rocksdb.changes b/rocksdb.changes index c8417b3..5abac13 100644 --- a/rocksdb.changes +++ b/rocksdb.changes @@ -1,3 +1,51 @@ +------------------------------------------------------------------- +Mon Oct 9 13:51:07 UTC 2023 - Andrea Manzini + +- update to 8.6.7 + * Fixed a bug where compaction read under non direct IO still falls back to RocksDB internal prefetching after file system's prefetching returns non-OK status other than Status::NotSupported() + * For non direct IO, eliminate the file system prefetching attempt for compaction read when Options::compaction_readahead_size is 0 + +- update to 8.6.6 + * Fix a bug with atomic_flush=true that can cause DB to stuck after a flush fails + * Fix a bug where RocksDB (with atomic_flush=false) can delete output SST files of pending flushes when a previous concurrent flush fails + * When the compressed secondary cache capacity is reduced to 0, it should be completely disabled. Before this fix, inserts and lookups would still go to the backing LRUCache + +- update to 8.6.5 + * Fixed a bug where rocksdb.file.read.verify.file.checksums.micros is not populated. + +- update to 8.6.4 + * Public API change: Add a column family option default_temperature that is used for file reading accounting purpose, such as io statistics, for files that don't have an explicitly set temperature. + +- update to 8.6.3 + * Fix a bug where if there is an error reading from offset 0 of a file from L1+ and that the file is not the first file in the sorted run, data can be lost in compaction and read/scan can return incorrect results. + * Fix a bug where iterator may return incorrect result for DeleteRange() users if there was an error reading from a file. + +- update to 8.6.2 + * Fix for async_io where during seek, when reading a block for seeking a target key in a file without any readahead, the iterator aligned the read on a page boundary and reading more than necessary. This increased the storage read bandwidth usage. + +- update to 8.6.1 + * Options::compaction_readahead_size 's default value is changed from 0 to 2MB. + * Compaction read performance will regress when Options::compaction_readahead_size is explicitly set to 0 + +- update to 8.6.0 + * Added enhanced data integrity checking on SST files with new format_version=6. + * Add a new feature to trim readahead_size during scans upto upper_bound when iterate_upper_bound is specified. + * RocksDB will compare the number of input keys to the number of keys processed after each compaction. + * Add a CF option bottommost_file_compaction_delay to allow specifying the delay of bottommost level single-file compactions. + * Add support to allow enabling / disabling user-defined timestamps feature for an existing column family in combination with the in-Memtable only feature. + * Implement a new admission policy for the compressed secondary cache that admits blocks evicted from the primary cache with the hit bit set. + * Add a column family option memtable_max_range_deletions that limits the number of range deletions in a memtable. + * Add PutEntity API in sst_file_writer + * Add timeout in microsecond option to WaitForCompactOptions + * New statistics rocksdb.file.read.{get|multiget|db.iterator|verify.checksum|verify.file.checksums}.micros measure read time of block-based SST tables or blob files during db open, Get(), MultiGet(), using db iterator, VerifyFileChecksums() and VerifyChecksum(). They require stats level greater than StatsLevel::kExceptDetailedTimers. + * Add close_db option to WaitForCompactOptions to call Close() after waiting is done. + * Add a new compression option CompressionOptions::checksum for enabling ZSTD's checksum feature to detect corruption during decompression. + * Mark Options::access_hint_on_compaction_start related APIs as deprecated. + * Statistics rocksdb.sst.read.micros now includes time spent on multi read and async read into the file + * For Universal Compaction users, periodic compaction (option periodic_compaction_seconds) will be set to 30 days by default if block based table is used. + * Fix a bug in FileTTLBooster that can cause users with a large number of levels (more than 65) to see errors like "runtime error: shift exponent .. is too large.." + + ------------------------------------------------------------------- Wed Sep 27 16:56:46 UTC 2023 - Andreas Stieger diff --git a/rocksdb.spec b/rocksdb.spec index 5dd15c2..6bc4479 100644 --- a/rocksdb.spec +++ b/rocksdb.spec @@ -20,7 +20,7 @@ %define lib_name librocksdb8 %bcond_with jemalloc Name: rocksdb -Version: 8.5.4 +Version: 8.6.7 Release: 0 Summary: Library for embeddable, persistent and fast key-value store License: (Apache-2.0 OR GPL-2.0-only) AND BSD-2-Clause