MavenCode’s Product Manager and Data Pipeline Architect, Timo Mechler, and Data Engineer, Charles Adetiloye, are not new to the space (both worked in the industry for more than a decade) but their backgrounds could not be any more different. Timo worked in the energy commodity markets with particular focus on building out scalable research platforms for energy commodities trading (including data collection, data analysis, data modeling), and Charles consulted and implemented large-scale data processing, AI/ML software platforms across different industry verticals and previously worked with Lightbend, Twitter, Starbucks, and a few other startups and Fortune 500 companies.
At Reactive Summit in Montreal on October 23, 2018, they are combining years of their expertise in one talk “Lessons Learned: Building Scalable & Elastic Akka Clusters on Google Managed Kubernetes”. Meet Timo and Charles and learn why you should join them at Reactive Summit.
What’s your background and what sparked your interest in distributed systems?
Charles: My background is in Systems Engineering and I have been working or consulting for the past 15 years with various companies building large-scale distributed systems. It has been very interesting to watch the evolution of the Industry in the past few years, from when applications ran on coarse monolithic back-end infrastructure – Application Servers – to what we have now where large-scale systems are composable from independent asynchronous subsystems running as Containerized Microservices. I have always been interested in this kind of event-driven reactive system, which seems more natural and more intuitive to understand.
Timo: My background is in data science and data analytics, having spent almost a decade working as a power and natural gas analyst/strategist for energy trading desks, building out scalable data event-driven research platforms. During my time in the industry I have seen the size, complexity, and amount of energy related data continued to grow exponentially, which lead my interest into cloud-based distributed systems and large-scale data modeling. I’m excited to continue further my knowledge with the Reactive paradigm, and look forward to applying it to solve massively scalable data science challenges.
What problems do you solve as a part of your day-to-day job?
We build cloud-agnostic ML and AI data pipeline platforms for our customers, allowing them to ingest streaming data or batched datasets in various forms and from different systems; e.g. IoT devices, clickstreams, etc. We train models from these ingested streams of data at different time intervals and then we deploy them as microservices for near real-time inferencing. This is purely an all event-driven system and none of what we do today would have been easier or better implemented without the knowledge we have acquired in recent years working in this domain. We are able to ingest data streams from our queues with Akka microservices, and scaling them up as needed during periods of surging demand. Furthermore, we build continuously refined models from our ingested datasets and use the results for recommendations. All of this is working essentially autonomously most of the time, and idempotent to any external disturbance!
Reactive is a new buzzword for many traditional developers. What is your prediction for its importance in application development over the next couple of years?
Reactive is no longer a buzzword – in our opinion, we are living in the future already! Building composable software systems driven by events now seems simply natural for us at MavenCode. A lot of companies are still catching up to these trends, and we get quite a few calls from companies reaching out to us and trying to figure out how they embrace this new Reactive paradigm!
What is the biggest challenge companies deploying distributed Reactive systems are facing?
- Limited talent pool out there, the few good guys out there are already hired
- Re-orientation or education of developers
- Rapidly changing tool sets – a lot of things are still evolving
What is the best solution for this challenge?
More events like the Reactive Summit will really go a long way to help. We are still at the early stage of this new paradigm, and we are predicting a huge avalanche in this space in the next 2-3 years.
What is your most ambitious professional dream that you hope to achieve one day?
Building and growing a software company that utilizes continuing advances in machine learning and artificial intelligence together with cutting-edge Reactive paradigms to build scalable software platforms that provide users all over the world with the ability to more easily solve the toughest data challenges in the physical sciences, healthcare, energy, and other industries.
Who should attend your talk at Reactive Summit and what will they learn?
System Architects, Developers and anyone interested in learning about the next cool thing out there. It’s always good to live on the edge as long as you don’t fall off 🙂
Whom would you like to connect with at the conference?
We are out here for everyone – we do training, consulting and who knows there may even be a prospective investor out there for us – we will find out 🙂
Don’t miss Timo and Charles’ talk “Lessons Learned: Building Scalable & Elastic Akka Clusters on Google Managed Kubernetes” at Reactive Summit on October 23, 2018. There are only 600 tickets available so book yours now.