Knowledge Zone
Get to know us, discover our interests, projects and training courses.

Big Data Analytics
July 1, 2024
How to enable AQE partitions pruning on a cached Spark dataset
In this article, we delve deep into Spark 3's AQE framework, focusing on the coalesce and caching mechanisms of its shuffle partitions.
.png)
Big Data Analytics
May 20, 2024
Spark danger: pivot is an action!
When delving into crafting a new and efficient Spark job, or optimising an existing one, multiple implementation and design choices may have a significant impact on the job’s performance. One of the most prominent aspects influencing a Spark job’s efficiency is the fundamental difference between actions and transformations.
.png)
MLOps
May 6, 2024
MLOps on Azure
Dive into the world of MLOps on Azure with our comprehensive guide. This article serves as a gateway to understanding the symbiotic relationship between building MLOps platform and Azure.
.png)
Data Management
April 15, 2024
No more cargo cult around data platform migration to GCP
Today, we aim to share our firsthand experience with transitioning existing data platforms to GCP (Google Cloud Platform). Our narrative will not only highlight the advantages of cloud migration but also shed light on the potential challenges encountered throughout the process.

Recruitment
April 4, 2024
Recruitment Report Generator - How Datumo automated recruitment processes
Dive into the success story of how Datumo utilized automation to accelerate recruitment processes, making it seamless and comfortable for all departments and employees. Explore the transformative power of our in-house solution and witness the remarkable time savings and enhanced productivity it brings to the table.

Big Data Analytics
March 18, 2024
Optimizing Big Data Cloud Costs: Key Insights from Our Latest Webinar
In the digital realm where data reigns supreme, managing cloud expenses is no longer just an option, it is absolutely vital. With this in mind, have you evaluated your cloud spending recently? Are you fully aware of where your resources are allocated and confident that no hidden costs are draining your budget? If these issues have crossed your mind, our recent webinar may hold the answers you seek.