Azure Data Engineer

“Are you ready to work on cutting-edge enterprise data platforms while collaborating with top-tier teams?”

We are looking for an experienced Data Engineer with a solid technical background in Cloud & Data managed services, a passion for learning and self-development, and a proactive approach to problem-solving to join our dynamic team.

In this role, you will be responsible for managing our customers’ cloud-based enterprise data platforms, working closely with customers, support teams, and subject matter experts to ensure the efficient, reliable, and secure operation of high-quality data platforms.

What You’ll Do:

• Maintain efficient data pipelines from diverse internal and external sources, ensuring high quality and governance.
• Maintain and optimize ingestion, transformation, translation, cleansing, and publishing processes.
• Optimize performance by monitoring and enhancing pipeline scalability, cost, and efficiency.
• Utilize observability tools to proactively identify issues.
• Manage the transition and onboarding of in-house or customer-developed data platforms into managed services.
• Collaborate with teams both internally and externally to ensure seamless onboarding, operation, and enhancements to deployed data solutions.
• Advise and guide customers on data management, security, and data governance.
• Demonstrate a passion for learning and innovation in data, stay updated with big data trends and best practices to continuously innovate.
• Play an active role in the ongoing development of Cloud Direct’s Data Managed Services portfolio.

What We’re Looking For:

• 3+ years as a Data Engineer or similar role.
• Experience with Azure Data Bricks, Azure Data Factory (ADF), Synapse, Azure Event Hubs, Fabric & Purview.
• Proficient in implementing and maintaining data pipelines with Azure Data Factory.
• In-depth knowledge of Data Lake/Medallion Architecture.
• Skilled in data modelling and ETL.
• Supporting a Lamba architecture including both batch and real-time data streams.
• Processing structured, semi-structured and unstructured data.
• Knowledge of the Azure security model, including RBAC, Key Vault and Managed Identities.
• Understanding of Cost management and optimisation of Azure resources.
• Basic networking, including integration runtime, data gateway, and VNet data gateway.
• Knowledge of data partitioning and optimisation techniques.
• Experience in source code control using Azure DevOps and Git.
• Interpreting telemetry and metrics using tools such as Azure Monitor and Azure Advisor.

What We Offer:

• Responsible Time off (uncapped annual leave)
• Group Life Cover /Disability Income Cover/ Trauma Insurance Cover (Injury / Disability)
• Fitness Cash Contribution
• Pension Fund Contribution
• Medical Insurance Contribution
• Employee Assistance Programme
• Enhanced Maternity & Paternity Leave
• Endless Growth Opportunities: We provide ample opportunities for professional development, mentoring, and advancement.
• Culture of Excellence: We foster a high-performance culture that recognizes and rewards exceptional talent.

At Cloud Direct, we believe that diversity, equity, and inclusion are essential to our success. We are committed to creating a workplace where everyone feels valued, respected, and empowered. We welcome applicants from all backgrounds and strive to build a team that reflects the diverse communities we serve. We encourage candidates of all races, ethnicities, genders, sexual orientations, ages, abilities, and socioeconomic statuses to apply.