diff --git a/docs/products/kafka/concepts/kafka-tiered-storage.rst b/docs/products/kafka/concepts/kafka-tiered-storage.rst index f2fb489537..6f0f69f320 100644 --- a/docs/products/kafka/concepts/kafka-tiered-storage.rst +++ b/docs/products/kafka/concepts/kafka-tiered-storage.rst @@ -1,14 +1,20 @@ -Tiered storage overview -========================== +Tiered storage in Aiven for Apache Kafka® overview +===================================================== Tiered storage in Aiven for Apache Kafka® allows you to manage your data more efficiently by leveraging two distinct storage types—local disk and remote cloud storage options like AWS S3 and Google Cloud Storage. This feature offers a tailored approach to data storage, allowing you to allocate frequently accessed data to high-speed local disks while offloading less critical or infrequently accessed data to more cost-effective remote storage solutions. Tiered storage enables you to indefinitely store data on specific topics without running out of space. Once enabled, it is configured per topic, giving you granular control over data storage needs. +.. important:: + + Aiven for Apache Kafka® tiered storage is an early availability feature, which means it has some restrictions on the functionality and service level agreement. It is intended for non-production environments, but you can test it with production-like workloads to assess the performance. To enable this feature, navigate to the :doc:`Feature preview ` page within your user profile. + .. note:: - - Tiered storage for Aiven for Apache Kafka® is support from Apache Kafka version 3.6 or higher + - Tiered storage for Aiven for Apache Kafka® is supported starting from Apache Kafka® version 3.6. - Azure blob storage is not yet supported for tiered storage in Aiven for Apache Kafka. +Benefits of tiered storage +---------------------------- Tiered storage offers multiple benefits, including: * **Scalability:** With tiered storage in Aiven for Apache Kafka, storage and computing are effectively decoupled, enabling them to scale independently. This flexibility ensures that while the storage capacity can expand almost infinitely with cloud solutions, compute resources can also be adjusted based on demand, thus eliminating any concerns about storage or processing limitations. @@ -42,4 +48,5 @@ Related reading * :doc:`Guarantees ` * :doc:`Backups ` * :doc:`Limiations ` +* Enabled tiered storage for Aiven for Apache Kafka® service diff --git a/docs/products/kafka/concepts/tiered-storage-guarantees.rst b/docs/products/kafka/concepts/tiered-storage-guarantees.rst index 8ede2ce70a..bf9b4710dc 100644 --- a/docs/products/kafka/concepts/tiered-storage-guarantees.rst +++ b/docs/products/kafka/concepts/tiered-storage-guarantees.rst @@ -16,3 +16,10 @@ Let's say you have a topic with a **total retention threshold** of **1000 GB** a * If tiered storage is enabled per topic, older segments will be uploaded immediately to remote storage, irrespective of whether the local retention threshold of 200 GB is exceeded. Data will be deleted from local storage only after it has been safely transferred to remote storage. * If the total size of the data exceeds 1000 GB, Apache Kafka will begin deleting the oldest data from remote storage. + +Related reading +---------------- + +* :doc:`Tiered storage in Aiven for Apache Kafka® overview ` +* :doc:`How tiered storage works in Aiven for Apache Kafka® ` +* Enabled tiered storage for Aiven for Apache Kafka® service \ No newline at end of file diff --git a/docs/products/kafka/concepts/tiered-storage-how-it-works.rst b/docs/products/kafka/concepts/tiered-storage-how-it-works.rst index 6c9635cc49..d6db204ef4 100644 --- a/docs/products/kafka/concepts/tiered-storage-how-it-works.rst +++ b/docs/products/kafka/concepts/tiered-storage-how-it-works.rst @@ -43,3 +43,15 @@ Security Segments are encrypted with 256-bit AES encryption before being uploaded to the remote storage. The encryption keys are not shared with the cloud storage provider and generally do not leave Aiven machines. + + +Related reading +---------------- + +* :doc:`Tiered storage in Aiven for Apache Kafka® overview ` +* :doc:`Guarantees ` +* :doc:`Backups ` +* :doc:`Limiations ` +* Enabled tiered storage for Aiven for Apache Kafka® service + + diff --git a/docs/products/kafka/concepts/tiered-storage-limitations.rst b/docs/products/kafka/concepts/tiered-storage-limitations.rst index 7d4f005b99..e7efd57596 100644 --- a/docs/products/kafka/concepts/tiered-storage-limitations.rst +++ b/docs/products/kafka/concepts/tiered-storage-limitations.rst @@ -11,3 +11,10 @@ Limitations * Increasing the local retention threshold won't move segments already uploaded to remote storage back to local storage. This change only affects new data segments. * If you enable tiered storage on a service, you can't migrate the service to a different region or cloud, except for moving to a virtual cloud in the same region. For migration to a different region or cloud, contact `Aiven support `_. + +Related reading +---------------- + +* :doc:`Tiered storage in Aiven for Apache Kafka® overview ` +* :doc:`How tiered storage works in Aiven for Apache Kafka® ` +* Enabled tiered storage for Aiven for Apache Kafka® service \ No newline at end of file