Lead Data Engineer
<p>Robert Half is seeking a Lead Cloud Data Engineer to provide technical leadership in the design, development, and optimization of scalable cloud-based data solutions supporting enterprise reporting, analytics, and business operations. This position will focus heavily on Azure Databricks, leading complex data integration initiatives, establishing engineering standards, and helping shape the organization's cloud data architecture.</p><p><br></p><p>The ideal candidate combines strong hands-on data engineering experience with the ability to lead technical design, solve complex data challenges, and guide other engineers. This individual will work closely with the Data Architect, business stakeholders, and technical teams to develop reliable, high-performing data solutions. Experience with manufacturing environments or ERP data is highly valued.</p><p><br></p><p><strong>Residency Requirement:</strong> Candidates must currently reside in Wisconsin to be considered for this position.</p><p>Flexible hybrid/remote work schedule, with occasional onsite for meetings.</p><p><br></p><p>Key Responsibilities</p><ul><li>Lead the technical design, development, and optimization of scalable ETL/ELT pipelines using Azure Databricks, PySpark, Python, and SQL.</li><li>Partner closely with the Data Architect to design cloud data solutions, establish engineering standards, and contribute to long-term data architecture decisions.</li><li>Lead complex data integration initiatives involving ERP, manufacturing, supply chain, inventory, finance, and other enterprise systems.</li><li>Design and implement cloud-based lakehouse solutions using Delta Lake and Medallion Architecture.</li><li>Provide technical direction on data modeling, ingestion frameworks, pipeline orchestration, and data transformation strategies.</li><li>Develop reusable engineering frameworks, coding standards, and best practices to improve scalability, reliability, and maintainability.</li><li>Integrate Azure Databricks with Azure Data Factory, Azure Data Lake Storage, and other cloud services.</li><li>Lead troubleshooting and root cause analysis for complex production issues, optimizing pipelines and Databricks environments for performance and cost efficiency.</li><li>Establish and promote best practices for data quality, validation, governance, security, and monitoring.</li><li>Collaborate directly with business stakeholders, analysts, and IT teams to translate complex business requirements into scalable technical solutions.</li><li>Mentor other data engineers, provide technical guidance, and lead code reviews and design discussions.</li><li>Support CI/CD practices, automated deployments, and continuous improvement initiatives across the data engineering environment.</li></ul><p><br></p>
<ul><li>5–8+ years of experience in data engineering, cloud data development, or a related field.</li><li>At least 2 years of hands-on experience developing solutions in Azure Databricks, with demonstrated experience designing complex data pipelines and solutions.</li><li>Advanced proficiency with Python, PySpark, SQL, ETL/ELT development, and data modeling.</li><li>Strong experience with Azure Data Factory, Azure Data Lake Storage, and cloud-based data warehousing or lakehouse environments.</li><li>Strong understanding of Delta Lake, Apache Spark, Medallion Architecture, and modern data architecture concepts.</li><li>Experience leading technical design decisions and delivering complex data engineering solutions.</li><li>Proven ability to troubleshoot, optimize, and support enterprise-scale production data pipelines.</li><li>Experience with Git, Azure DevOps, CI/CD, and engineering standards for cloud data platforms.</li><li>Ability to provide technical guidance, mentor engineers, and collaborate with architects and business stakeholders.</li><li>Bachelor's degree in a related field or equivalent combination of education and experience.</li></ul><p>Preferred Qualifications</p><ul><li>Experience designing and supporting enterprise data solutions in manufacturing or industrial environments.</li><li>Familiarity with ERP systems, particularly Infor M3, and manufacturing data related to production, inventory, supply chain, or finance.</li><li>Experience with Snowflake, Microsoft Fabric, Power BI, or other cloud data platforms.</li><li>Experience implementing Unity Catalog, data governance frameworks, and cloud security practices.</li><li>Experience with streaming data, real-time analytics, or AI/ML data preparation.</li><li>Familiarity with Infrastructure as Code tools such as Terraform or Bicep.</li><li>Azure or Databricks certifications.</li></ul><p>Work Environment</p><ul><li>Flexible hybrid arrangement for Wisconsin residents, with occasional onsite meetings in Green Bay based on business or project needs.</li><li>No fixed weekly in-office requirement.</li><li>Opportunity to work closely with the Data Architect and influence the direction of enterprise cloud data engineering initiatives.</li><li>Technical leadership role with responsibility for guiding engineering practices, mentoring team members, and contributing to architecture decisions.</li></ul><p><br></p>
<h3 class="rh-display-3--rich-text">Technology Doesn't Change the World, People Do.<sup>®</sup></h3>
<p>Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.</p>
<p>Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. <a href="https://www.roberthalf.com/us/en/mobile-app" target="_blank">Download the Robert Half app</a> and get 1-tap apply, notifications of AI-matched jobs, and much more.</p>
<p>All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit <a href="https://roberthalf.gobenefits.net/" target="_blank">roberthalf.gobenefits.net</a> for more information.</p>
<p>© 2025 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking “Apply Now,” you’re agreeing to Robert Half’s <a href="https://www.roberthalf.com/us/en/terms">Terms of Use</a> and <a href="https://www.roberthalf.com/us/en/privacy">Privacy Notice</a>.</p>
- Green Bay, WI
- onsite
- Permanent / Full Time
-
130000 - 140000 USD / Yearly
- <p>Robert Half is seeking a Lead Cloud Data Engineer to provide technical leadership in the design, development, and optimization of scalable cloud-based data solutions supporting enterprise reporting, analytics, and business operations. This position will focus heavily on Azure Databricks, leading complex data integration initiatives, establishing engineering standards, and helping shape the organization's cloud data architecture.</p><p><br></p><p>The ideal candidate combines strong hands-on data engineering experience with the ability to lead technical design, solve complex data challenges, and guide other engineers. This individual will work closely with the Data Architect, business stakeholders, and technical teams to develop reliable, high-performing data solutions. Experience with manufacturing environments or ERP data is highly valued.</p><p><br></p><p><strong>Residency Requirement:</strong> Candidates must currently reside in Wisconsin to be considered for this position.</p><p>Flexible hybrid/remote work schedule, with occasional onsite for meetings.</p><p><br></p><p>Key Responsibilities</p><ul><li>Lead the technical design, development, and optimization of scalable ETL/ELT pipelines using Azure Databricks, PySpark, Python, and SQL.</li><li>Partner closely with the Data Architect to design cloud data solutions, establish engineering standards, and contribute to long-term data architecture decisions.</li><li>Lead complex data integration initiatives involving ERP, manufacturing, supply chain, inventory, finance, and other enterprise systems.</li><li>Design and implement cloud-based lakehouse solutions using Delta Lake and Medallion Architecture.</li><li>Provide technical direction on data modeling, ingestion frameworks, pipeline orchestration, and data transformation strategies.</li><li>Develop reusable engineering frameworks, coding standards, and best practices to improve scalability, reliability, and maintainability.</li><li>Integrate Azure Databricks with Azure Data Factory, Azure Data Lake Storage, and other cloud services.</li><li>Lead troubleshooting and root cause analysis for complex production issues, optimizing pipelines and Databricks environments for performance and cost efficiency.</li><li>Establish and promote best practices for data quality, validation, governance, security, and monitoring.</li><li>Collaborate directly with business stakeholders, analysts, and IT teams to translate complex business requirements into scalable technical solutions.</li><li>Mentor other data engineers, provide technical guidance, and lead code reviews and design discussions.</li><li>Support CI/CD practices, automated deployments, and continuous improvement initiatives across the data engineering environment.</li></ul><p><br></p>
- 2026-11-20T00:00:00Z