<p>Data Engineer – Databricks / Azure / AI Analytics</p><p><br></p><p>You must be able to obtain and maintain a public trust clearance,</p><p><br></p><p>Position Overview</p><p>We are seeking a highly capable Data Engineer to design and support scalable data pipelines and analytics environments within a cloud-based Azure data platform. This role focuses on building modern data solutions using Databricks, Spark, and distributed data architectures, supporting enterprise-level analytics and AI initiatives.</p><p>The ideal candidate brings hands-on expertise in Databricks engineering, cloud data pipelines, and data integration, along with strong collaboration skills to translate business requirements into technical solutions. This position offers the opportunity to work on large-scale data platforms and support advanced analytics and AI-driven workloads.</p><p><br></p><p>Key Responsibilities</p><p>Data Engineering &amp; Pipeline Development</p><ul><li>Design, build, and optimize data pipelines using Databricks and Spark</li><li>Implement Medallion architecture and scalable data processing workflows</li><li>Develop ingestion pipelines for structured, streaming, and unstructured datasets</li></ul><p>Cloud &amp; Platform Integration</p><ul><li>Work with Azure services (Data Factory, Storage, Functions, Log Analytics)</li><li>Integrate data across multiple sources to enable high-quality analytics</li><li>Support hybrid cloud initiatives and evolving data platforms</li></ul><p>Data Management &amp; Optimization</p><ul><li>Ensure data quality, integrity, and accessibility across systems</li><li>Monitor pipeline performance and optimize cost, scalability, and efficiency</li><li>Support data governance, cataloging, and compliance standards</li></ul><p>Platform Operations &amp; Support</p><ul><li>Troubleshoot performance issues, cluster stability, and configuration management</li><li>Support end-user requests and provide front-line platform support</li><li>Implement monitoring, logging, and alerting solutions</li></ul><p>DevOps &amp; Automation</p><ul><li>Develop and maintain CI/CD pipelines and infrastructure-as-code (IaC)</li><li>Automate deployment and data workflows for improved efficiency</li><li>Support continuous delivery within Agile environments</li></ul>

<p>You must be able to obtain and maintain a public trust clearance,</p><p><br></p><p>Required Qualifications</p><ul><li>Bachelor’s degree in Computer Science or related field</li><li>3+ years of experience in data engineering / cloud development</li><li>Hands-on expertise with Databricks and Apache Spark</li><li>Strong experience with Python and distributed data processing</li><li>Experience building data ingestion pipelines and ETL workflows</li><li>Experience working with cloud platforms (Azure preferred, AWS acceptable)</li><li>Strong understanding of data governance, quality, and security practices</li><li>Ability to communicate technical solutions to both technical and business stakeholders</li></ul><p>Preferred Qualifications</p><ul><li>Databricks Data Engineer certification</li><li>Experience with Azure Data Factory, Functions, Storage Services</li><li>Familiarity with AI / advanced analytics workflows</li><li>Experience with CI/CD pipelines and Agile methodologies</li><li>Knowledge of FinOps / cloud cost optimization practices</li></ul><p><br></p>

<h3 class="rh-display-3--rich-text">Technology Doesn't Change the World, People Do.^®</h3> <p>Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.</p> <p>Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. <a href="https://www.roberthalf.com/us/en/mobile-app" target="_blank">Download the Robert Half app</a> and get 1-tap apply, notifications of AI-matched jobs, and much more.</p> <p>All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit <a href="https://roberthalf.gobenefits.net/" target="_blank">roberthalf.gobenefits.net</a> for more information.</p> <p>© 2025 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking “Apply Now,” you’re agreeing to Robert Half’s <a href="https://www.roberthalf.com/us/en/terms">Terms of Use</a> and <a href="https://www.roberthalf.com/us/en/privacy">Privacy Notice</a>.</p>