The C2RP, Carif-Oref of the Hauts-de-France region in France, provides resources and tools to regional stakeholders in order to support the implementation of national and regional policies related to employment, training, and career guidance.

In this context, C2RP engaged TRIMANE, the single-award provider under a national framework agreement dedicated to the decision-making needs of Carif-Orefs, to modernize its data management practices and ensure continuity in data integration and analysis.

Two major projects were carried out for C2RP:

1. The implementation of a decision-making data warehouse to modernize, centralize, and ensure data reliability.

2. The migration of the existing data warehouse to a more scalable open-source solution, following the end of support for Talend Open Studio.

Both projects addressed common and complementary strategic and technical needs:

• Modernize tools and processes to improve data practices.

• Establish a shared repository ensuring reliable and accessible data.

• Optimize analysis of data from heterogeneous sources and enable temporal analyses.

• Strengthen internal teams’ autonomy in data and tool management.

• Mitigate risks related to technological obsolescence by adopting a sustainable and scalable solution.

To meet C2RP’s expectations, TRIMANE deployed a structured approach, combining technical expertise with human support. Each project was designed to ensure progressive and sustainable modernization.

1. Implementation of a decision-making data warehouse

• Technical architecture design: Detailed modeling of the data warehouse using the PostgreSQL database management system, along with the implementation of the necessary technical components to optimize data management.

• Data engineering : Development of integration flows via the Talend ETL to feed the data warehouse.

• Data analysis : Extraction and exploitation of data to meet analysis needs related to training and employment.

• Team support : User training on the Tableau data visualization solution, enabling the creation of interactive and customized dashboards.

2. Migration to Mage.AI

Following the end of support for Talend Open Studio,, TRIMANE supported C2RP in migrating to a more scalable open-source solution.

After an in-depth analysis of functional and technical requirements, Mage.AI was selected as the new ETL solution. The migration was carried out in several steps, with particular attention paid to operational continuity and team autonomy.

• Target architecture implementation : Creation of development, testing, and production environments with Mage.AI, combined with Docker for container management and advanced monitoring.

• Migration of existing flows :

  • Legacy Talend jobs were converted into pipelines under Mage.AI.

  • Rigorous unit testing was performed to guarantee the reliability of migrated processes.

  • Comprehensive technical documentation was produced to facilitate knowledge transfer and pipeline maintenance by internal teams.

  • Pipelines were deployed to production using automated deployment via Git, ensuring versioning and full traceability of source code changes.

• Team training : Training sessions were organized to guide C2RP teams in using Mage.AI. These sessions strengthened their autonomy in operating the solution, particularly for integrating new data sources or adapting existing pipelines.

Thanks to this dual intervention, C2RP now benefits from a modern, reliable, and scalable infrastructure that fully meets the challenges of centralization, quality, and accessibility of data. These projects also strengthened internal teams’ autonomy in managing and exploiting data.

The migration to Mage.AI delivered immediate and long-term benefits:

• Centralized orchestration of processes, with a clear and user-friendly interface.

• Automated pipeline deployment, ensuring better traceability and faster updates.

• Simplified supervision via a dedicated portal, enabling real-time monitoring and rapid anomaly detection.

• Automated source code versioning via Git, ensuring traceability of every evolution and facilitating collaborative work.

• Simplified infrastructure management with Docker containers, ensuring portability, easier maintenance, and fast deployment.

• Full conversion of Talend jobs into Mage.AI pipelines, ensuring operational continuity and paving the way for future enhancements.

This technical transformation enabled C2RP to operate with a more agile and resilient information system. Automation, centralization, and reliability of processes now allow internal teams to respond more quickly to business needs, exploit data more effectively, and secure the infrastructure in the long run.

Testimonial from C2RP

“We are fully satisfied with the training delivered by TRIMANE. The quality of the content, the trainers’ teaching skills, and the organization of the sessions ensured effective and structured learning. The rich and comprehensive program trained us in Tableau, Data Governance, and the key tools required to build our data warehouse.

We were able to centralize, structure, and historicize our multi-source data, while automating our processes. These improvements have proven to be a real time-saver and productivity boost for our service, allowing us to optimize our work.

A high-quality support we highly recommend.”
— Sandra PEROUMAL ELLAMA, Research Officer at C2RP