<p>Data Engineer – Databricks / Azure / AI Analytics</p><p><br></p><p>You must be able to obtain and maintain a public trust clearance,</p><p><br></p><p>Position Overview</p><p>We are seeking a highly capable Data Engineer to design and support scalable data pipelines and analytics environments within a cloud-based Azure data platform. This role focuses on building modern data solutions using Databricks, Spark, and distributed data architectures, supporting enterprise-level analytics and AI initiatives.</p><p>The ideal candidate brings hands-on expertise in Databricks engineering, cloud data pipelines, and data integration, along with strong collaboration skills to translate business requirements into technical solutions. This position offers the opportunity to work on large-scale data platforms and support advanced analytics and AI-driven workloads.</p><p><br></p><p>Key Responsibilities</p><p>Data Engineering & Pipeline Development</p><ul><li>Design, build, and optimize data pipelines using Databricks and Spark</li><li>Implement Medallion architecture and scalable data processing workflows</li><li>Develop ingestion pipelines for structured, streaming, and unstructured datasets</li></ul><p>Cloud & Platform Integration</p><ul><li>Work with Azure services (Data Factory, Storage, Functions, Log Analytics)</li><li>Integrate data across multiple sources to enable high-quality analytics</li><li>Support hybrid cloud initiatives and evolving data platforms</li></ul><p>Data Management & Optimization</p><ul><li>Ensure data quality, integrity, and accessibility across systems</li><li>Monitor pipeline performance and optimize cost, scalability, and efficiency</li><li>Support data governance, cataloging, and compliance standards</li></ul><p>Platform Operations & Support</p><ul><li>Troubleshoot performance issues, cluster stability, and configuration management</li><li>Support end-user requests and provide front-line platform support</li><li>Implement monitoring, logging, and alerting solutions</li></ul><p>DevOps & Automation</p><ul><li>Develop and maintain CI/CD pipelines and infrastructure-as-code (IaC)</li><li>Automate deployment and data workflows for improved efficiency</li><li>Support continuous delivery within Agile environments</li></ul>