Ingestion at Scale: Open Source Pipelines for Getting Data Into Open...- Anurag Gupta & Kevin Fallis

Ingestion at Scale: Open Source Pipelines for Getting Data Into OpenSearch - Anurag Gupta, Chronosphere & Kevin Fallis, Amazon Web Services OpenSearch powers many critical use cases across analytics, observability, and security – However, OpenSearch is only as useful as the data you feed into it. In this session, we will explore how to data into OpenSearch from a variety of inputs. We will discuss open source tools like Fluent Bit, Data Prepper, and OpenTelemetry Collector and cover their integrations. We will also talk about different types of data such as logs, metrics, and traces and how to leverage these tools and schemas to power a variety of OpenSearch use cases. In addition to talking about different open source tools we will walk through real-world examples of architecture, deployment patterns, and lessons learned from production environments.