Exploring the trade-offs between zero-copy and copy architectures
Nice analysis.
There is just one addition from StreamNative.
There is an option to use Lakehouse Tiered Storage [1] - that will work with Pulsar API and Kafka API so it can include Transactions and Compaction with Kafka.
BTW compaction is possible with URSA clusters. [2]
[1] - https://streamnative.io/blog/ursa-everywhere-lakehouse-native-future-data-streaming#ursa-storage-extension-for-classic-pulsar-lakehouse-for-all-deployments
[2] - https://docs.streamnative.io/cloud/build/kafka-clients/compatibility/kafka-protocol-and-features#supported-topic-configs
no apache flink and apache spark that have direct support from apache iceberg ?
Nice analysis.
There is just one addition from StreamNative.
There is an option to use Lakehouse Tiered Storage [1] - that will work with Pulsar API and Kafka API so it can include Transactions and Compaction with Kafka.
BTW compaction is possible with URSA clusters. [2]
[1] - https://streamnative.io/blog/ursa-everywhere-lakehouse-native-future-data-streaming#ursa-storage-extension-for-classic-pulsar-lakehouse-for-all-deployments
[2] - https://docs.streamnative.io/cloud/build/kafka-clients/compatibility/kafka-protocol-and-features#supported-topic-configs
no apache flink and apache spark that have direct support from apache iceberg ?