What: Adform Journey is the unique event full of inspirational speeches and training talks by Adform speakers. Explore the Big Data world with Adform! We are going to share our personal experiences and practical suggestions for technologies such as Hadoop, HP Vertica, MS SQL Server and many others.
Who should come? We invite all developers, data analysts, dev-ops and other experts in the field who want to solve big data challenges and connect with their industry peers.
When: 24 october, 2015
Where: EventSpace.by, Kastryčnickaja vulica, 220000 Minsk, Belarus
Registration is mandatory, participation is free: http://adform-journey.eventbrite.com
11:00 - 11:20 Keynote, Dionizas Antipenkovas
11:20 - 12:00 Data Management Platform under the hood, Bugaev Roman
Adform DMP is a central hub of our company, powered by machine learning and driven by big data technologies. DMP allows us to collect massive datasets (seamlessly and rapidly), integrate, manage those large volumes of data from numerous data sources, and activate them for our customers. Let’s see what is at the backstage of DMP.
12:00 - 12:45 Smart as Einstein (Adform Data API), Rokas Balevicius
Big Data without access is just a very expensive set of ones and zeros. It is paramount for great reporting solution what your user is able to access data in a way that matters to him and not only access it, but access it simply and naturally.
API is a great solution to such a problem. But devil is in the details. Sounds easy until you understand that you have to support multiple data warehouse solutions and ad-hock data slices.
In this presentation I will share the experience and lessons learned from building and consuming such a data API (project code name – Einstein).
12:45 - 13:45 Lunch
13:45 - 14:30 Refining ETL. Going realtime with Storm, Ernestas Vaiciukevičius
Sometimes serving reports with data as old as few hours or even minutes is not enough, clients want to see what happens in real time. Traditional batch based ETL (extract – transform – load) techniques, which served for years, are unable to cope with our current needs. In this talk we will tell about our journey from batch based ETL to stream processing. So, if you want to hear how we run cluster, manage resources with mesos and do stream processing with storm, come to this presentation.
14:30 - 15:15 TBD, Aleksandr Kublickij
15:15 - 15:30 Coffee break
15:30 - 16:15 Journey to Vertica+ROLAP Solution, Ramunas Balukonis
Most companies still uses old-fashioned MS MOLAP solutions, wasting time on development, scaling, HW and licenses. In this session we'll talk about Adform's experiences transitioning to a Vertica+ROLAP solution. The talk will cover:
- Why we decided to start using disrupting technology instead of optimizing existing ones;
- When sexy SQL defeats elegant MDX;
- About the nightmare we faced before the transition and how we reconnected wagons from one running train into another. We'll also discuss resources benefits that resulted from the transition;
- Vertica+ROLAP optimization tips;
- How Vertica falls within the Hadoop data lake and our philosophy for Big Data disaster recovery.
16:15 - 17:00 Navigating through BigData Swamp, Ramunas Urbonas
This is a war story. It tells about a small victory in the war, that we‘re currently losing. The story starts like this: „Adform Big Data Lake was born as a small and beautiful pool. A single spring of fresh water was feeding the Lake. Time passed and more and more springs were bringing the precious water to the Lake. People of the Adform were very happy to see it. But one day terrible Evil started growing in the darkest depths of the Lake...“