Kafka, Pinterest, Kenner discussed on Software Engineering Daily


Pinter arrest is a visual feed of ideas products clothing and recipes millions of users browse pinterest to find images and text that are tailored to their interests like most companies pinterest started with a large monolithic application that served all requests as pinch arrests engineering resources expanded some of the architecture was broken up into microsoft mrs and doc arrived which made the system easier to reason about to serve users with better feeds pinterest built a machine learning pipeline using kafka spark and presto user events are generated from the frontend logged onto kafka and aggregated to build machine learning models these models are deployed into docker containers much like the production micro services are kinneary jungle is a senior software engineer pinterest and she joins the show to talk about her experiences at the company breaking up the monolith architect in a machine learning pipeline and deploying those models inter production kenner is also writing a book on the topic and she's going to be speaking at strata data conference in san jose march fifth through eighth i'm also going to be there just walking around hanging out and seeing talks so if you're going to be attending the strategy to conference let me know you can also get a twenty percent discount on a ticket by entering the code p c s e d and with that let's get to this episode of software engineering daily if you are on call and you get page at two a m are you sure you have all the data you need at your fingertips are you worried that you're going to be surprised by things that you missed errors or even security vulnerabilities because you don't have the right visibility into your application you shouldn't be worried you have worked hard to build an amazing modern application for your customers even worrying over the details and donning every i and crossing every t you deserve an analytics tool that was built to those same standards an analytics tool that will be there for you when you need it the most sumo logic is a cloud native machine data analytics service that helps you run and secure your modern application if you are feeling the pain of managing your own log event and performance metrics data check out sumo logic dot com slash s e daily even if you have your.

Coming up next