Search jobs now Find the right job type for you Explore how we help job seekers Contract talent Permanent talent Learn how we work with you Executive search Finance and Accounting Technology Marketing and Creative Legal Administrative and Customer Support Technology Risk, Audit and Compliance Finance and Accounting Digital, Marketing and Customer Experience Legal Operations Human Resources 2026 Salary Guide Demand for Skilled Talent Report Building Future-Forward Tech Teams Job Market Outlook Press Room Salary and hiring trends Adaptive working Competitive advantage Work/life balance Inclusion Browse jobs Find your next hire Our locations
AI Data Engineer – Azure & Databricks
<p>About the Role</p><p>Our client is seeking an AI Data Engineer to design, build, and optimize data and AI pipelines within a modern Azure Databricks Lakehouse environment. This role sits at the intersection of data engineering, machine learning enablement, and cloud‑scale analytics, supporting advanced AI initiatives across the organization.</p><p>You will work closely with data scientists, ML engineers, and business stakeholders to deliver high‑quality data products, feature pipelines, and production‑ready AI workflows that power predictive analytics, generative AI, and operational intelligence</p><p><br></p><p>Key Responsibilities</p><ul><li>Design and build scalable data pipelines using Azure Databricks, Spark, and Delta Lake</li><li>Develop and optimize ETL/ELT workflows across Azure Data Lake Storage</li><li>Implement AI‑ready data architectures including feature stores and vector stores</li><li>Productionize ML and generative AI models using MLflow and Databricks Model Serving</li><li>Create and maintain medallion architecture for analytics and AI workloads</li><li>Develop SQL and PySpark transformations for large‑scale datasets</li><li>Integrate Azure services such as Data Factory, Event Hub, and Functions</li><li>Ensure data governance and security using Unity Catalog and RBAC</li><li>Monitor and optimize Databricks clusters for cost and performance</li><li>Support CI/CD automation using Azure DevOps</li></ul><p><br></p>
<p>Required Qualifications</p><ul><li>Hands‑on experience with Azure Databricks including Spark, Delta Lake, and MLflow</li><li>Strong proficiency in Python and SQL</li><li>Experience with Azure data services such as Data Factory, Data Lake, and Synapse</li><li>Background in data engineering supporting analytics, ML, or AI applications</li><li>Understanding of machine learning pipelines and feature engineering</li><li>Experience with distributed data processing using Spark</li><li>Knowledge of CI/CD practices in Azure DevOps</li><li>Strong problem‑solving and communication skills</li></ul><p>Preferred Qualifications</p><ul><li>Experience with vector databases such as Pinecone or Azure AI Search</li><li>Familiarity with generative AI workflows including embeddings and RAG</li><li>Exposure to Lakehouse architecture in enterprise environments</li><li>Oil and gas or industrial domain experience</li></ul><p><br></p>
<h3 class="rh-display-3--rich-text">Technology Doesn't Change the World, People Do.<sup>®</sup></h3> <p>Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.</p> <p>Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. <a href="https://www.roberthalf.com/us/en/mobile-app" target="_blank">Download the Robert Half app</a> and get 1-tap apply, notifications of AI-matched jobs, and much more.</p> <p>All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit <a href="https://roberthalf.gobenefits.net/" target="_blank">roberthalf.gobenefits.net</a> for more information.</p> <p>© 2025 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking “Apply Now,” you’re agreeing to <a href="https://www.roberthalf.com/us/en/terms">Robert Half’s Terms of Use</a>.</p>
  • Houston, TX
  • remote
  • Temporary
  • - USD / Hourly
  • <p>About the Role</p><p>Our client is seeking an AI Data Engineer to design, build, and optimize data and AI pipelines within a modern Azure Databricks Lakehouse environment. This role sits at the intersection of data engineering, machine learning enablement, and cloud‑scale analytics, supporting advanced AI initiatives across the organization.</p><p>You will work closely with data scientists, ML engineers, and business stakeholders to deliver high‑quality data products, feature pipelines, and production‑ready AI workflows that power predictive analytics, generative AI, and operational intelligence</p><p><br></p><p>Key Responsibilities</p><ul><li>Design and build scalable data pipelines using Azure Databricks, Spark, and Delta Lake</li><li>Develop and optimize ETL/ELT workflows across Azure Data Lake Storage</li><li>Implement AI‑ready data architectures including feature stores and vector stores</li><li>Productionize ML and generative AI models using MLflow and Databricks Model Serving</li><li>Create and maintain medallion architecture for analytics and AI workloads</li><li>Develop SQL and PySpark transformations for large‑scale datasets</li><li>Integrate Azure services such as Data Factory, Event Hub, and Functions</li><li>Ensure data governance and security using Unity Catalog and RBAC</li><li>Monitor and optimize Databricks clusters for cost and performance</li><li>Support CI/CD automation using Azure DevOps</li></ul><p><br></p>
  • 2025-12-31T14:18:53Z

AI Data Engineer – Azure & Databricks Job in Houston, TX | Robert Half