About the Client

merXu is an online B2B trading company operating in all countries of the European Union. They connect verified buyers and sellers representing a diverse range of businesses, from small and medium-sized enterprises to large entities. merXu provides a seamless trading experience, enabling businesses to easily search and connect with potential partners, negotiate deals, and complete transactions.

Complication

merXu’s main objective is to modernize their data platform to effectively handle the rapid increase in data volume. Improved automation, standardization, and proper monitoring are critical to meet future analytical requirements.

The challenge involves replacing existing solutions with suitable Google Cloud Platform services and implementing tools that ensure seamless operation of the platform. So as to accelerate the migration process, merXu has sought the support of Datumo. By collaborating with us, they attained a reliable and user-friendly data platform, a robust monitoring system, and valuable knowledge transfer. These benefits enhance analytical capabilities, ensure uninterrupted operations, and empower their teams to effectively manage the platform. 

The Value We Delivered

• Reliable and User-Friendly Data Ecosystem: A Big Data platform built with GCP services that caters to the Client’s needs of automation, standardization and proper monitoring, as well as empowering analysts to smoothly perform complex business intelligence tasks.
• Robust Monitoring System: In the event of any issues, the Client's support team receives transparent and comprehensive information, enabling them to quickly identify and resolve any potential disruptions. This minimizes downtime, ensures smooth operations, and enhances customer satisfaction.
• Knowledge Transfer: Datumo actively shares Google Cloud and data engineering best practices with merXu's teams. This knowledge transfer equips the Client's personnel with the necessary skills and expertise to effectively manage and maintain the platform independently. It fosters self-sufficiency and reduces dependence on external support, resulting in long-term cost savings and operational efficiency.

Innovative solutions and advanced technologies

The first step is to introduce the core tool for the solution - Apache Airflow. It replaces a bunch of crontab jobs with an automated and reliable service. Due to merXu requirements deployment on GKE is used instead of Cloud Composer. Datumo experts prepare pipelines utilizing Airflow, BigQuery, GCS and other Google Cloud Platform services to process and handle data. Data backups are configured to guarantee that the platform is prepared for any eventuality, ensuring business continuity. Monitoring alerts are added to draw attention to such issues as quickly as possible. Chosen solutions and implementation are generic, allowing us to easily introduce new data pipelines addressing complicated business requirements.

With improvements introduced by Datumo, creating and managing core data pipelines becomes reliable and easy - for most common tasks providing a few configuration values is sufficient to get a robust, multi-service solution out of the box. All data reaches BigQuery uninterruptedly, hence merXu’s teams can smoothly perform complex analysis and queries. With monitored orchestration based on Apache Airflow, all processes are properly executed ensuring strict dependency and failure handling.

‍