SnapLogic recently released an update to our Confluent Kafka Snap pack containing a number of important enhancements. In this article, we take a closer look at the Kafka Consumer Snap’s new Output Mode setting, and how it can be used to achieve reliable, high-throughput performance for some common use cases where it’s important to process records in batches.
Imagine a use case with these requirements:
Step by Step Guide
The total number of confirmed COVID-19 cases, worldwide, now exceeds one million.
Many resources are available on the Internet to help us track and understand the growth of this pandemic, including the dashboard operated by the Johns Hopkins University Center for Systems Science and Engineering. This dashboard is backed by a data repository published on GitHub. Even though the source data is high quality, it requires significant structural transformation for an effective visualization. SnapLogic Intelligent Integration Platform handles the transformations easily.
In this article, I will walk through the construction of a SnapLogic pipeline, which reads…
Principal Engineer @ SnapLogic