Pieterjan is a senior data science consultant at Business and Decision with experience in a wide range of domains, incl. anomaly detection, optimisation and recommendation systems, geo spatial analysis, the creation of advanced visualisations and social network analysis.
Passionate about building innovative and lasting data science solutions, Pieterjan focuses on making the most of typically large data sets using different technologies like R, Microsoft Azure and Spark.
5 ways how Azure Databricks made our life easier!
Receiving signals from over 4000 endpoints every second results in a large amount of data to ingest, process, analyse, visualize and create predictive models on. We used Azure Databricks to process this data and during our talk we will discuss how Azure Databricks facilitated our data science process.
We’ll share insights on how we went from raw signal data to visualisations in PowerBI, combining different data science languages like Spark and R and benefiting from Azure Databricks features like auto scaling and job scheduling.