Druid Summit - Tel Aviv
Druid Summit – Tel Aviv
October 27, 2022
Today, digital organisations need real-time insights delivered through internal and external applications. This requires developers, like you, to build apps that bring together streaming data and interactive analytics to push real-time visibility to the next level. But with 100’s of databases out there how do you know what the right architecture is.
Do you find yourself asking – how can I ingest millions of events per second? How can I analyse billions of rows interactively in seconds? How can I scale to thousands of end-users concurrently without a steep expense?
Apache Druid provides the flexibility, efficiency, and resilience needed to support your analytics applications at scale, for streaming and batch data.
Join us on Thursday 27 October for an insightful event to learn from data professionals and industry experts and Imply, about how to build an analytics architecture to power your applications.
We’re finalising an amazing agenda, places are limited so reserve your place now!
Speakers
Vadim Ogievetsky / Co-founder / Imply
Vadim is a co-author of the open source Apache Druid® project and co-founder and CXO at Imply. Prior to Imply he worked at Metamarkets (acquired by Snapchat). Vadim holds an M.S. in Computer Science from Stanford University. At Stanford he was part of the Data Visualization group where he contributed to Protovis and D3.js.
Elad Eldor / Data Ops Team Leader / ironSource
Elad Eldor is a data platform team leader at the mobile division of ironSource, working mainly with Druid, Kafka, Presto and Spark on AWS. He has 12 years of experience as a java software engineer and 5 years as an SRE in big data linux-based clusters. Prior to ironSource, Elad was an SRE at Verint (Cognyte), where he developed big data applications (using spark, hadoop and kafka) and handled the reliability and scalability of spark and kafka clusters in production. His main interests are JVM tuning, performance tuning and cost reduction of big data clusters (Kafka, Druid, Spark, Presto
Jonathan Kaplan / DataOps Engineer / ironSource
Jonathan Kaplan is a DataOps Engineer at ironSource, specializing in performance tuning and deployment of Big Data technologies such as Druid, Redshift, Presto and Spark on EMR. Prior to joining ironSource, Jonathan was a DBA Team Lead at the IDF Intelligence, and a Data Engineering Team Lead as part of the IDF Covid-19 Task Force with the Israeli Ministry of Health.
Alon Becker / Data Engineer / Ziprecruiter
Jonathan Kaplan is a DataOps Engineer at ironSource, specializing in performance tuning and deployment of Big Data technologies such as Druid, Redshift, Presto and Spark on EMR. Prior to joining ironSource, Jonathan was a DBA Team Lead at the IDF Intelligence, and a Data Engineering Team Lead as part of the IDF Covid-19 Task Force with the Israeli Ministry of Health.
Boaz Wiesner / DevOps Engineer / Singular
Boaz is a DevOps Engineer at Singular, and works daily on challenges ranging from operating data pipelines at scale to managing complex customer facing Druid clusters. Before joining Singular, Boaz was a DevOps Engineer for the IDF Intelligence Unit, and dealt with critical, high risk systems in complex environments.
Agenda
| 09.30 | Registration and networking |
| 10.00 | Welcome – Imply |
| 10.10 | How Druid Works
Vadim Ogievetsky, Co-founder & CXO, Imply |
| 10.55 | Using Druid at high throughput for fast queries at low cost
ironSource exposed a Druid cluster for its external users, called Real Time Pivot, which runs at a scale of 2-3M events/sec, with tens of TBs added per day, while serving parallel queries within 1-2 seconds. We managed not only to achieve the goals of high throughput without getting backlogs and serving parallel queries with low latency, but we did all that at minimal hardware cost. In our presentation we’ll elaborate on how we achieved these three goals Elad Eldor & Jonathan Kaplan, ironSource |
| 11.40 | Democratizing data for self-service analytics
Chen Bekor, Principal Partner Solution Architect, AWS |
| 12.00 | Networking break |
| 12.20 | Ziprecruiters Philosophy of Managing Infrastructure
Ziprecruiter chose to do things ‘around’, druid, putting validators before ingesting the ingestion spec into Druid and, in addition to that, Ziprecruiter built tooling around batch ingestion. This session explains why, how and why this is important to Ziprecruiter. Alon Becker, Data Engineer, Ziprecruiter |
| 12.50 | Pushing the Limits of Druid Real-time with Data Sharding
Most Druid applications aim for sub-second analytics queries – but this becomes difficult when dealing with large volumes of real-time data. We’ll take you through our series of engineering and ops efforts that ultimately helped us reach sub-second real-time queries at scale with Druid by using a custom data sharding mechanism.
Boaz Wiesner, DevOps Engineer, Singular |
| 13.20 | Networking Lunch |
Afternoon – your choice of session/s: (tea/coffee refills @ 15.00)
| 14.00 – 17.00 Imply Accreditation Program Apache Druid Basics Training – Imply |
14.00 – 15.00 On the spot demos |
16.00 – 17.00 Ask the Architect continued… |
| 17:10 | Closing followed by networking and drinks |
Agenda subject to change without notification