<p>We are looking for a Data Engineer to join the client’s User Platforms organization. This role will be responsible for building and scaling the data foundation that powers experimentation, causal analysis, product optimization, and decision-making across Disney+, Hulu, ESPN+, and other streaming products.</p><p><br></p><p><strong>Key Responsibilities:</strong></p><p>· Design, develop, and maintain scalable experimentation data platforms supporting A/B testing, geo experiments, feature launches, and product analytics.</p><p>· Build and optimize batch and streaming data pipelines that ingest, transform, validate, and serve large-scale user behavior, product, and engagement datasets.</p><p>· Create reusable experimentation frameworks, datasets, and tooling that enable teams to efficiently define experiments, measure outcomes, and analyze results.</p><p>· Design dimensional models, analytical data products, and feature-ready datasets optimized for analytics, experimentation, and machine learning use cases.</p><p>· Implement automated data quality validation, monitoring, lineage tracking, testing, and governance controls to ensure reliable and trustworthy experiment results.</p><p>· Develop production-ready deployment workflows, CI/CD pipelines, observability solutions, and operational processes for data products and services.</p><p>· Collaborate with Product Managers, Software Engineers, Data Scientists, and Analytics teams to translate business requirements into scalable technical solutions.</p><p>· Drive best practices for data architecture, engineering standards, experimentation methodologies, and platform reliability.</p><p>· Mentor engineers and promote a culture of technical excellence, innovation, experimentation, and continuous improvement.</p>
<p>We are looking for a senior Data Engineer. This position combines architectural leadership with hands-on development across a modern cloud data ecosystem, with a strong focus on building dependable, scalable, and efficient data solutions. The role will help shape engineering standards, strengthen platform governance, and support high-quality data delivery for enterprise analytics and emerging AI-driven use cases.</p><p><br></p><p>Responsibilities:</p><p>• Provide technical direction to engineering teams and guide the successful execution of complex data platform initiatives.</p><p>• Create and enhance robust data pipelines and reusable data products that support scalable analytics and reporting needs.</p><p>• Develop and refine cloud-based data solutions using Snowflake, dbt, Fivetran, and Azure services.</p><p>• Build automation-first, metadata-driven processing frameworks to improve consistency, maintainability, and operational efficiency.</p><p>• Design curated data structures using established modeling approaches such as Data Vault, Kimball, and dimensional modeling.</p><p>• Improve platform performance through tuning, cost management, and scalability planning across data workloads.</p><p>• Establish and reinforce best practices for data quality, governance, lineage tracking, observability, and CI/CD delivery.</p><p>• Support Azure-based integration, storage, compute, and DevOps capabilities required for reliable end-to-end data operations.</p><p>• Enable data foundations that can support advanced analytics, AI/ML initiatives, and modern analytical architectures.</p>
We are looking for a Senior Data Engineer to build modern cloud data solutions that strengthen reporting, analytics, and operational decision-making across the organization. This position is based in Bloomington, Minnesota, and focuses on creating dependable, scalable data products that connect manufacturing and business systems. The ideal candidate brings deep experience with Azure-based engineering tools and a practical approach to performance, governance, and collaboration.<br><br>Responsibilities:<br>• Create and enhance cloud-based data pipelines using Azure Databricks, PySpark, Python, SQL, and related Azure technologies to support enterprise data needs.<br>• Develop efficient ingestion processes for operational and business data sources, including manufacturing, Industrial IoT, quality, supply chain, inventory, and finance systems.<br>• Establish reusable engineering frameworks and technical standards that improve consistency, maintainability, and delivery speed across data initiatives.<br>• Build and manage lakehouse environments using Delta Lake and Medallion Architecture, organizing data through Bronze, Silver, and Gold layers.<br>• Design data structures that support dashboards, advanced analytics, artificial intelligence, and machine learning applications.<br>• Maintain documentation, metadata, data lineage records, and operational procedures to support reliable platform operations.<br>• Integrate Databricks with services such as Azure Data Factory, Azure Data Lake Storage Gen2, Azure Key Vault, Microsoft Fabric, Power BI, and Azure DevOps.<br>• Monitor platform performance and resolve production issues by tuning clusters, workflows, and notebooks for reliability, scalability, and cost control.<br>• Embed data quality checks, governance practices, security controls, and compliant access management into engineering workflows, including role-based access through Unity Catalog.<br>• Collaborate with business partners, analysts, architects, and fellow engineers while contributing to Agile planning, reviews, and mentorship of entry-level team members.
We are looking for a Senior Data Engineer to strengthen our data foundation and help deliver reliable, scalable information solutions across Minneapolis, Minnesota. In this role, you will create and optimize modern data platforms that power analytics, reporting, and machine learning initiatives. You will collaborate with technical and business partners to turn complex source data into trusted, accessible assets that support better decisions across the organization.<br><br>Responsibilities:<br>• Build and maintain scalable data pipelines that ingest, transform, and deliver information from a variety of enterprise and operational data sources.<br>• Design data models and warehouse structures that improve reporting performance, support analytics use cases, and enable long-term scalability.<br>• Develop and orchestrate ETL and ELT workflows using cloud-based and workflow automation tools to ensure dependable data movement across systems.<br>• Create batch and near-real-time processing solutions that provide timely, accurate datasets for downstream applications and analytical teams.<br>• Write efficient, well-structured Python and SQL code to cleanse, transform, and validate large and complex datasets.<br>• Monitor pipeline health, investigate failures, and tune jobs for reliability, cost control, and overall platform performance.<br>• Establish data quality checks, testing routines, and governance practices to maintain consistency, integrity, and compliance across the data environment.<br>• Partner with architects, analysts, data scientists, AI/ML engineers, and DevOps teams to support production-ready data products, automated deployments, and reproducible machine learning workflows.
We are looking for a Senior Data Engineer to create and enhance cloud-based data platforms that power reporting, analytics, and operational insight across manufacturing and business functions in Bloomington, Minnesota. This position focuses on building dependable, scalable data solutions in Azure while working closely with cross-functional teams to turn complex data needs into practical products. The ideal candidate brings strong hands-on engineering expertise, a quality-first mindset, and the ability to support secure, high-performance data environments that enable informed decision-making.<br><br>Responsibilities:<br>• Create, enhance, and support scalable cloud data pipelines using Azure Databricks, PySpark, Python, SQL, and related Azure technologies.<br>• Develop robust ingestion processes that bring together data from operational, financial, supply chain, inventory, quality, and industrial systems for downstream use.<br>• Establish reusable engineering frameworks, coding standards, and implementation patterns that improve consistency, maintainability, and delivery speed.<br>• Build and manage lakehouse solutions with Delta Lake and a Medallion architecture approach across raw, refined, and curated data layers.<br>• Design data structures and models that effectively support dashboards, business intelligence, advanced analytics, and machine learning initiatives.<br>• Maintain data lineage, metadata, technical documentation, and operational procedures to support transparency and long-term platform reliability.<br>• Integrate Databricks with services such as Azure Data Factory, Azure Data Lake Storage Gen2, Azure Key Vault, Microsoft Fabric, Power BI, and Azure DevOps.<br>• Monitor platform performance and costs by tuning clusters, workflows, notebooks, and scheduled jobs while resolving production issues with durable fixes.<br>• Apply governance, privacy, security, and data quality standards, including governed access controls, validation rules, and audit capabilities within engineering workflows.<br>• Collaborate with stakeholders, architects, analysts, and fellow engineers in Agile delivery processes, while providing guidance and mentorship to less experienced team members.
<p>We're seeking a hands-on Senior Data Engineer to lead the design, optimization, and evolution of a growing data platform. This role will focus on building scalable data pipelines, improving data quality, optimizing database performance, and supporting enterprise reporting and analytics initiatives. <strong>This role is FULLY ONSITE in Newport Beach, CA</strong></p><p><br></p><p>What You'll Do</p><ul><li>Design and maintain scalable ETL/ELT pipelines</li><li>Optimize PostgreSQL databases and complex SQL workloads</li><li>Lead data migration and integration efforts from legacy systems</li><li>Build data quality, validation, and deduplication processes</li><li>Develop solutions within a cloud data warehouse environment (Snowflake)</li><li>Implement monitoring, alerting, and reliability best practices</li><li>Partner with business and technical stakeholders to deliver trusted data solutions</li></ul><p><br></p>
<p>We are looking for an AWS Senior Data Engineer to join a long-term contract opportunity in Southern California. This onsite role requires a highly experienced data engineering specialist who can build resilient, scalable data platforms and support enterprise analytics through well-architected cloud solutions. The ideal candidate will bring deep expertise in AWS-based data ecosystems, modern ETL development, and data warehousing, while maintaining a strong focus on quality, security, and performance.</p><p><br></p><p>Responsibilities:</p><p>• Build and support cloud-based data pipelines that move and transform large volumes of data using AWS services such as S3, Glue, Athena, Redshift, Spectrum, Lambda, and MWAA/Airflow.</p><p>• Create scalable ETL and ELT workflows with Python, PySpark, Apache Spark, or Scala to deliver reliable datasets for reporting, analytics, and operational use.</p><p>• Strengthen data quality by implementing validation rules, exception handling, monitoring, and cleansing processes across integration pipelines.</p><p>• Improve platform efficiency by tuning queries, refining workflow design, and addressing processing bottlenecks to meet performance targets and cost expectations.</p><p>• Partner with analysts, technical teams, and business stakeholders to convert data needs into technical designs and production-ready engineering solutions.</p><p>• Maintain dependable data availability for business intelligence initiatives by ensuring pipelines are stable, timely, and aligned with service-level requirements.</p><p>• Produce and update technical documentation while supporting adherence to data governance, security controls, and regulatory expectations.</p><p>• Contribute to secure data lake operations through access management, policy enforcement, and governance practices within AWS Lake Formation and related cloud services.</p>
<p>Robert Half Technology is seeking <strong>experienced Senior Data Engineers</strong> to support a client in the insurance industry. These individuals will play a key role in designing, developing, and maintaining scalable data pipelines, integrating data across multiple systems, and supporting cloud-based data engineering initiatives.</p><p> </p><p>The ideal candidates will have strong hands-on experience with Microsoft SQL Server, Python, cloud technologies, and modern data engineering practices. This role requires individuals who can independently develop and optimize data solutions, manage complex data integrations, and support both inbound and outbound data flows.</p><p><strong> </strong></p><p><strong>Location:</strong> 100% Remote</p><p><strong>Duration:</strong> 6-month contract-to-hire</p><p><strong>Pay rate: </strong>$45-$55/hourly</p><p><strong> </strong></p><p><strong>Key Responsibilities</strong></p><ul><li>Design, develop, and maintain scalable data pipelines and data integration solutions to support business and operational needs.</li><li>Develop, optimize, and maintain SQL queries, stored procedures, and database processes within Microsoft SQL Server.</li><li>Build and manage ETL/ELT processes to extract, transform, and load data across multiple platforms and systems.</li><li>Utilize Python and Pandas for data transformation, processing, automation, and analysis.</li><li>Develop and maintain cloud-based data solutions using AWS services, including Lambda, Glue, and EC2, or comparable Azure technologies.</li><li>Design and support API integrations, event-driven architectures, and event bus technologies to facilitate inbound and outbound data exchanges.</li><li>Work with Snowflake and other data platforms to support data ingestion, transformation, and integration.</li><li>Implement and maintain CI/CD pipelines to support automated deployments and data engineering best practices.</li><li>Troubleshoot data pipeline issues, optimize performance, and ensure data accuracy, reliability, and consistency.</li><li>Collaborate with cross-functional teams, including software engineers, architects, analysts, and business stakeholders, to deliver scalable data solutions.</li><li>Support data governance, data quality, and integration best practices across enterprise systems.</li></ul>
<p>We are seeking a <strong>Senior Data Engineer</strong> to join a growing data and analytics team responsible for building modern, cloud-based data platforms that drive business intelligence, reporting, and advanced analytics. This role is ideal for someone with deep expertise in <strong>Microsoft Azure</strong>, <strong>Microsoft Fabric</strong>, and modern data engineering practices.</p><p>You will be responsible for designing and developing scalable data solutions, optimizing data pipelines, and helping shape the organization's data architecture strategy. The ideal candidate is both hands-on and strategic, with experience building enterprise data platforms in Azure and Fabric environments.</p><p>Responsibilities</p><ul><li>Design, develop, and maintain enterprise data solutions using <strong>Microsoft Fabric</strong> and <strong>Azure Data Services</strong>.</li><li>Build and optimize scalable ETL/ELT pipelines for structured and unstructured data sources.</li><li>Develop and manage data lakes, lakehouses, warehouses, and semantic models.</li><li>Design data integration solutions using Fabric Data Factory, Dataflows, and Azure Data Factory.</li><li>Implement data governance, security, quality, and monitoring frameworks.</li><li>Partner with business stakeholders to understand reporting and analytics requirements.</li><li>Support Power BI developers by building trusted, high-quality data models and datasets.</li><li>Optimize data storage, query performance, and platform scalability.</li><li>Develop data architecture standards, best practices, and documentation.</li><li>Collaborate with application development teams to integrate operational systems with enterprise analytics platforms.</li><li>Support real-time and batch data processing initiatives.</li><li>Participate in architecture reviews, code reviews, and technical leadership activities.</li></ul><p><br></p>
We are looking for an experienced Lead Data Engineer to shape and scale modern data solutions for a growing organization. This role is ideal for a senior, detail-oriented individual who enjoys working in a dynamic environment, contributing both strategically and hands-on across engineering initiatives. The ideal candidate brings strong technical depth in cloud-based data platforms, a practical approach to data architecture, and the ability to guide engineers while partnering effectively with business stakeholders.<br><br>Responsibilities:<br>• Lead the design, development, and maintenance of scalable data pipelines and warehouse solutions using Python, Snowflake, and Azure-based technologies.<br>• Define data architecture standards that improve reliability, usability, and long-term scalability across the data environment.<br>• Drive performance tuning and optimization efforts for data processing workflows, storage structures, and query execution.<br>• Establish and strengthen data quality practices by implementing validation, monitoring, and governance measures across datasets and pipelines.<br>• Serve as a senior technical leader who can step into managerial responsibilities, providing direction, feedback, and support to engineering team members.<br>• Mentor engineers through code reviews, technical coaching, and knowledge sharing to elevate team capability and engineering consistency.<br>• Partner closely with business teams and technical stakeholders to translate operational and analytical needs into effective data solutions.<br>• Contribute hands-on to ETL development and cloud data platform enhancements, with exposure to Databricks considered an advantage.<br>• Act as a key point of coordination between business priorities and technical execution to ensure data initiatives deliver measurable value.
<p>We are looking for a Staff Data Engineer to shape the direction of enterprise data platforms in Brookfield, Wisconsin. In this role, you will guide technical decisions, partner with engineering and leadership teams, and build scalable solutions across hybrid environments. This position focuses on delivering secure, high-performing data capabilities that support both internal operations and client-facing data products while maintaining strong governance and privacy standards. <strong><em>Health care industry experience is strongly desired. </em></strong></p><p><br></p><p>Responsibilities:</p><p>• Provide senior technical guidance on data platform architecture, serving as a key advisor to engineering partners and business leaders.</p><p>• Design and evolve scalable frameworks for ingesting, transforming, storing, and governing high-value data across warehouse and lakehouse environments.</p><p>• Lead delivery of complex data initiatives by aligning project scope, coordinating contributors, and communicating progress, risks, and outcomes to stakeholders.</p><p>• Establish and uphold data governance, lineage, auditability, and stewardship practices, including administration of cataloging capabilities that improve visibility and control.</p><p>• Develop and enforce data security standards, including least-privilege access models and protections for sensitive and de-identified healthcare information.</p><p>• Architect and optimize robust batch, streaming, and event-driven pipelines that improve reliability, resilience, and processing efficiency at enterprise scale.</p><p>• Build and enhance cloud-based data solutions using Databricks, Delta Live Tables, Python, Scala, and ETL technologies to support diverse structured and unstructured datasets.</p><p>• Create and maintain infrastructure as code with Terraform and related deployment assets to strengthen platform consistency, scalability, and operational efficiency.</p><p>• Develop APIs and integration patterns that connect internal platforms and external systems, enabling dependable data exchange with third-party applications and client solutions.</p><p>• Monitor platform performance, manage pipeline health, and partner with the business on cost-conscious designs that balance transparency, value, and long-term sustainability.</p>
We are looking for a Data Engineer to help build and maintain scalable data solutions that support critical business operations within the brokerage industry. This role is based in Chicago, Illinois, and focuses on designing reliable data pipelines, improving data accessibility, and enabling efficient processing across large datasets. The ideal candidate brings strong technical expertise in modern data engineering tools and enjoys working in a fast-paced environment where data quality, performance, and consistency are essential.<br><br>Responsibilities:<br>• Design, develop, and optimize data pipelines that support ingestion, transformation, and delivery of large-scale datasets.<br>• Build and maintain ETL workflows to ensure accurate, timely, and dependable movement of data across platforms.<br>• Use Python and Apache Spark to process complex data efficiently and improve overall pipeline performance.<br>• Work with Apache Hadoop technologies to manage distributed data storage and computation for high-volume workloads.<br>• Implement streaming and messaging solutions with Apache Kafka to support near-real-time data integration needs.<br>• Partner with cross-functional teams to understand data requirements and translate business needs into technical solutions.<br>• Monitor data processes, troubleshoot issues, and resolve bottlenecks to maintain system reliability and data integrity.<br>• Contribute to enhancements involving data platform changes or internal process updates as part of ongoing engineering initiatives.
<p>Lead Data Engineer</p><p>Salary: Up to $160,000 Location:</p><p>On-Site | South Los Angeles Area</p><p>Employment Type: Full-Time</p><p><br></p><p>Build the Foundation for Enterprise Analytics</p><p><br></p><p>We are seeking a Lead Data Engineer to drive the architecture, modernization, and expansion of a growing enterprise data platform built within the Microsoft Azure ecosystem. This is a highly visible technical leadership role where you'll help shape the future of data across multiple business functions by building scalable, secure, and high-performing data solutions.</p><p><br></p><p>If you're passionate about Databricks, cloud data platforms, and mentoring engineering teams while remaining hands-on with development, this is an opportunity to make a significant impact.</p><p><br></p><p>What You'll Do</p><ul><li>Lead the design, implementation, and optimization of an enterprise Azure Databricks Lakehouse environment utilizing Bronze, Silver, and Gold data layers.</li><li>Architect and execute migrations from SQL Server and legacy platforms into modern cloud-native data solutions.</li><li>Develop and optimize large-scale ETL/ELT pipelines supporting operational reporting, business intelligence, advanced analytics, and data science initiatives.</li><li>Integrate data from multiple enterprise systems, APIs, operational platforms, and third-party sources.</li><li>Establish best practices for data engineering, data modeling, testing, CI/CD, monitoring, governance, and production support.</li><li>Implement and maintain data governance frameworks, security controls, lineage tracking, and access management.</li><li>Lead code reviews, technical design discussions, and engineering standards across the data team.</li><li>Mentor and support data engineers while fostering a culture of technical excellence.</li><li>Partner closely with business stakeholders, analysts, and data scientists to deliver trusted, scalable data products.</li></ul><p>For immediate consideration, apply now and direct message Reid Gormly on LINKEDIN</p>
<p>We are seeking a highly skilled Big Data Engineer to design, build, and optimize scalable data platforms that support enterprise analytics, reporting, machine learning, and business intelligence initiatives. The ideal candidate will have experience developing large-scale data pipelines, managing cloud-based data ecosystems, and implementing high-performance data solutions that enable data-driven decision-making across the organization. Key Responsibilities Design, develop, and maintain large-scale data processing systems and data pipelines. Build and optimize ETL/ELT workflows for structured, semi-structured, and unstructured data sources. Develop scalable solutions using distributed computing frameworks such as Apache Spark, Hadoop, and Kafka. Collaborate with Data Scientists, Analysts, Architects, and business stakeholders to support analytical and operational requirements. Integrate data from multiple internal and external systems while ensuring data quality and integrity. Design and implement cloud-native data solutions within AWS, Azure, or Google Cloud environments. Monitor, troubleshoot, and improve the performance, reliability, and scalability of data platforms. Implement data governance, security, compliance, and access control standards. Support real-time and batch data processing requirements. Document architectures, workflows, and technical specifications to ensure operational excellence.</p>
We are looking for a Data Engineer to strengthen reporting and data capabilities for distribution operations in Minneapolis, Minnesota. In this role, you will turn information from sales, inventory, warehouse, vendor, and point-of-sale platforms into practical insights that support branch leaders, purchasing teams, and senior decision-makers. The position focuses on creating reliable data solutions that improve inventory planning, pricing visibility, and day-to-day operational performance across a multi-site distribution environment.<br><br>Responsibilities:<br>• Design, build, and maintain data pipelines that consolidate information from ERP, point-of-sale, warehouse, vendor, and sales systems.<br>• Develop dashboards and operational reports that help business teams monitor inventory movement, pricing performance, margin trends, and service levels.<br>• Write and optimize SQL queries to extract, validate, and transform data from platforms such as SQL Server, Postgres, and distribution-focused ERP systems.<br>• Partner with branch management, purchasing, and leadership teams to translate business questions into clear analytics and reporting solutions.<br>• Ensure data quality and consistency by investigating discrepancies, validating source data, and improving reporting logic across systems.<br>• Support analysis of inventory health by tracking metrics such as turns, fill rate, reorder thresholds, and safety stock performance.<br>• Produce insights that help identify opportunities to improve replenishment decisions, operational efficiency, and pricing accuracy across multiple branches or warehouses.<br>• Contribute to reporting and integration work involving business systems and connected commerce platforms when operational data needs evolve.
<p>Robert Half is seeking a <strong>Contract Data Engineer</strong> to support our client’s data and analytics initiatives. In this role, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure that enable efficient data ingestion, transformation, and delivery. The ideal candidate has strong experience working with modern data platforms, cloud environments, and large-scale datasets.</p><p><br></p><p><strong>Key Responsibilities:</strong></p><ul><li><strong>Data Pipeline Development:</strong> Design, build, and maintain scalable ETL / ELT pipelines to ingest, transform, and deliver data from multiple sources.</li><li><strong>Data Architecture:</strong> Develop and optimize data models, schemas, and warehouse structures to support analytics, reporting, and business intelligence needs.</li><li><strong>Cloud Data Platforms:</strong> Work within cloud environments such as <strong>AWS, Azure, or GCP</strong> to deploy and manage data solutions.</li><li><strong>Data Warehousing:</strong> Design and support enterprise data warehouses using platforms such as <strong>Snowflake, Redshift, BigQuery, or Azure Synapse</strong>.</li><li><strong>Big Data Processing:</strong> Develop solutions using big data technologies such as <strong>Spark, Databricks, Kafka, and Hadoop</strong> when required.</li><li><strong>Performance Optimization:</strong> Tune queries, pipelines, and storage solutions for performance, scalability, and cost efficiency.</li><li><strong>Data Quality & Reliability:</strong> Implement monitoring, validation, and alerting processes to ensure data accuracy, integrity, and availability.</li><li><strong>Collaboration:</strong> Work closely with Data Analysts, Data Scientists, Software Engineers, and business stakeholders to understand requirements and deliver data solutions.</li><li><strong>Documentation:</strong> Maintain detailed documentation for pipelines, data flows, and system architecture.</li></ul><p><br></p>
<p>We are looking for a Data Engineer to support data-driven initiatives for a services environment in Southern California. This Long-term Contract position focuses on building reliable data pipelines, improving data availability, and enabling scalable processing for analytics and operational needs. The ideal candidate brings strong hands-on experience with modern data engineering tools and can work across large data sets with accuracy and efficiency.</p><p><br></p><p><strong>Role :</strong></p><ul><li>Design, develop, maintain, and optimize business intelligence solutions, ETL workflows, reporting systems, and data integration processes.</li><li>Collaborate with business, analytics, and technical teams to gather requirements and deliver reporting and analytics solutions.</li><li>Develop and maintain data models, SQL scripts, stored procedures, dashboards, and reporting solutions.</li><li>Build, optimize, and support ETL pipelines across on-premises and cloud environments.</li><li>Troubleshoot and resolve complex reporting, data quality, performance, and integration issues.</li><li>Validate reporting logic, data transformations, and reporting accuracy.</li><li>Perform performance tuning for SQL queries, stored procedures, ETL workflows, and reporting platforms.</li><li>Participate in architecture discussions and provide technical recommendations aligned with business objectives.</li><li>Create and maintain technical documentation including solution designs, data mappings, and operational procedures.</li><li>Participate in code reviews and enforce development, reporting, and data governance standards.</li><li>Mentor junior developers through technical guidance and knowledge-sharing activities.</li><li>Support Agile delivery activities including sprint planning, backlog refinement, and project execution.</li><li>Collaborate with stakeholders and leadership teams to support business intelligence initiatives.</li><li>Drive continuous improvement initiatives related to reporting quality, analytics performance, and operational efficiency.</li></ul><p><br></p><p><br></p><p><br></p>
<p><strong>Robert Half</strong> is actively partnering with an Austin-based client to identify a <strong>Data Engineer (contract).</strong> In this role, you will focuse on designing and scaling modern data platforms, building high-performance data pipelines, and delivering reliable datasets that support analytics, machine learning, and customer-facing applications. <strong>This role is hybrid in Austin, Tx. </strong></p><p><br></p><p><strong>Key Responsibilities:</strong></p><ul><li>Design, build, and optimize scalable data platforms with a focus on reliability, performance, and operational efficiency.</li><li>Develop and maintain batch and real-time data pipelines using cloud-native technologies and modern data processing frameworks.</li><li>Build and support data ingestion, transformation, and storage solutions that serve internal applications, analytics platforms, and customer-facing systems.</li><li>Improve data processing efficiency, platform scalability, and infrastructure utilization.</li><li>Troubleshoot and resolve production issues involving data quality, pipeline performance, and platform reliability.</li><li>Support on-call rotations and respond to critical data platform incidents when required.</li><li>Collaborate with product, engineering, and data stakeholders to translate business requirements into scalable technical solutions.</li><li>Evaluate and implement new technologies related to data processing, AI/ML workflows, and platform observability.</li><li>Contribute to architecture reviews, technical design discussions, and long-term platform strategy.</li><li>Promote engineering best practices through code reviews, documentation, testing, and knowledge sharing.</li><li>Lead complex data engineering projects from initial design through deployment and operational support.</li><li>Support the ongoing growth and modernization of enterprise data capabilities.</li></ul>
We are seeking a highly skilled Big Data Engineer to design, build, and optimize scalable data platforms that support enterprise analytics, reporting, machine learning, and business intelligence initiatives. The ideal candidate will have experience developing large-scale data pipelines, managing cloud-based data ecosystems, and implementing high-performance data solutions that enable data-driven decision-making across the organization. Key Responsibilities Design, develop, and maintain large-scale data processing systems and data pipelines. Build and optimize ETL/ELT workflows for structured, semi-structured, and unstructured data sources. Develop scalable solutions using distributed computing frameworks such as Apache Spark, Hadoop, and Kafka. Collaborate with Data Scientists, Analysts, Architects, and business stakeholders to support analytical and operational requirements. Integrate data from multiple internal and external systems while ensuring data quality and integrity. Design and implement cloud-native data solutions within AWS, Azure, or Google Cloud environments. Monitor, troubleshoot, and improve the performance, reliability, and scalability of data platforms. Implement data governance, security, compliance, and access control standards. Support real-time and batch data processing requirements. Document architectures, workflows, and technical specifications to ensure operational excellence.
<p>We are looking for a Principal Data Engineer to shape and lead a modern enterprise data platform serving multiple business lines. This position will define the architectural direction for a Microsoft Fabric-based environment, guide engineering best practices, and partner closely with data and IT leaders to support long-term growth. The role is ideal for a senior technical expert who combines deep hands-on engineering capability with strong mentorship and platform strategy experience.</p><p><br></p><p>Responsibilities:</p><p>• Lead the design and ongoing evolution of a Microsoft Fabric lakehouse environment, establishing a scalable architecture across raw, refined, and curated data layers.</p><p>• Create and support robust data integration workflows that bring information together from more than 30 enterprise applications and operational platforms.</p><p>• Set technical standards for data engineering, including coding practices, solution design patterns, documentation, and review processes.</p><p>• Mentor data engineers through hands-on coaching, collaborative development, and detailed code feedback to strengthen team capability.</p><p>• Partner with data and IT leadership to align platform architecture with business priorities and future expansion needs.</p><p>• Develop high-quality data pipelines using modern tools and frameworks such as SQL, Python, Spark, and PySpark within cloud-based data ecosystems.</p><p>• Evaluate new technologies, architectural approaches, and data platform trends, then provide informed recommendations for adoption.</p><p>• Support governance and platform reliability by promoting strong lineage, quality, performance, and scalable engineering practices.</p><p>• Contribute to cross-platform interoperability initiatives, including environments that may involve Databricks, governance tooling, and enterprise data services.</p>
<p>We are looking for a Data Engineer to help shape and strengthen the organization’s data warehouse and analytics capabilities. This role will focus on building reliable data solutions that support reporting, business intelligence, and operational decision-making across the company. The ideal candidate brings strong technical depth in data engineering, enjoys solving complex integration challenges, and works effectively with both IT colleagues and business stakeholders.</p><p><br></p><p>Responsibilities:</p><p>• Design and enhance scalable data warehouse structures and integration pipelines that support analytics, reporting, and cross-system data flow.</p><p>• Develop, test, and maintain ETL processes that move data from varied source systems into staging, warehouse, and downstream reporting environments.</p><p>• Partner with business teams and technical peers to translate functional needs into practical data solutions and system designs.</p><p>• Improve database performance by tuning SQL, refining indexing strategies, and addressing issues identified through execution plan analysis.</p><p>• Create and support dashboards, reports, and data visualizations using tools such as Power BI, Tableau, and similar business intelligence platforms.</p><p>• Perform data validation, auditing, and quality checks to protect accuracy, consistency, and compliance across critical datasets.</p><p>• Provide production support for data platforms, integrations, and reporting solutions, resolving issues and maintaining dependable system performance.</p><p>• Contribute to agile delivery efforts by participating in development, testing, and quality assurance activities across databases, middleware, and analytics applications</p>
<p>The Data Engineer will develop and maintain scalable data pipelines and cloud-based data solutions that support analytics and business intelligence initiatives.</p><p>Responsibilities</p><ul><li>Design and build ETL/ELT processes.</li><li>Develop data pipelines using Python and SQL.</li><li>Optimize data warehouse performance.</li><li>Work with stakeholders to gather data requirements.</li><li>Support data governance and quality initiatives.</li></ul><p><br></p>
We are looking for an experienced Data Engineer to join our team in Illinois. This role is suited for a self-directed, technically strong individual who can navigate complex data challenges, influence architectural decisions, and contribute to stronger engineering standards across the team. The ideal candidate brings deep expertise in modern data technologies and a practical approach to building reliable, scalable solutions in a fast-moving environment.<br><br>Responsibilities:<br>• Design, build, and maintain scalable data pipelines that support large-volume processing and analytics needs.<br>• Take ownership of complex engineering initiatives from discovery through delivery, making sound technical decisions with minimal oversight.<br>• Develop and optimize distributed data solutions using technologies such as Apache Spark, Hadoop, and Kafka.<br>• Create robust ETL workflows that ensure data quality, consistency, and availability across multiple systems.<br>• Partner with cross-functional teams to define integration approaches, support API connectivity, and enable dependable data exchange.<br>• Improve system performance through testing, troubleshooting, and targeted optimization of data processing workloads.<br>• Contribute to architecture discussions by recommending effective patterns for scalable, maintainable data platforms.<br>• Support the broader engineering team by sharing knowledge, guiding technical best practices, and helping raise overall delivery quality.
<p><strong>Data Pipeline Development & Integration</strong></p><ul><li>Design, build, and maintain scalable ETL/ELT pipelines to extract, transform, and load data from multiple sources.</li><li>Develop automated data integration solutions supporting enterprise applications, analytics, and reporting.</li><li>Integrate structured and semi-structured data from APIs, relational databases, cloud platforms, and third-party systems.</li><li>Develop batch and real-time data processing solutions.</li><li>Troubleshoot pipeline failures, data inconsistencies, and performance bottlenecks.</li></ul><p><strong>Data Warehousing & Architecture</strong></p><ul><li>Design and optimize enterprise data warehouses, data lakes, and lakehouse architectures.</li><li>Develop efficient data models, schemas, and transformations to support business intelligence and analytics.</li><li>Build and maintain cloud-based data solutions using AWS, Microsoft Azure, or Google Cloud.</li><li>Optimize SQL queries, database performance, and data processing workloads.</li><li>Implement data partitioning, indexing, and storage optimization strategies.</li></ul><p><strong>Data Quality & Governance</strong></p><ul><li>Develop automated data validation, monitoring, and quality assurance processes.</li><li>Ensure data accuracy, consistency, reliability, and availability across enterprise systems.</li><li>Implement data governance standards, access controls, and security best practices.</li><li>Maintain documentation for data pipelines, architecture, and transformation logic.</li><li>Support compliance with organizational data privacy and security requirements.</li></ul><p><strong>Cloud Engineering & Automation</strong></p><ul><li>Develop and maintain cloud-native data pipelines and processing workflows.</li><li>Utilize orchestration tools such as Apache Airflow, Azure Data Factory, or similar technologies.</li><li>Implement CI/CD practices for data engineering workflows.</li><li>Automate data processing, monitoring, and infrastructure deployment.</li><li>Collaborate with DevOps and infrastructure teams to improve scalability and reliability.</li></ul><p><strong>Analytics & AI Support</strong></p><ul><li>Partner with business intelligence and analytics teams to deliver reliable datasets for reporting and dashboards.</li><li>Develop curated data models supporting Power BI, Tableau, and other visualization platforms.</li><li>Build data pipelines supporting machine learning, predictive analytics, and AI applications.</li><li>Collaborate with AI engineers and data scientists to prepare, transform, and deliver data for model development and production applications.</li><li>Identify opportunities to improve business processes through better data integration and automation.</li></ul><p><br></p><p><br></p>
We are looking for a Data Engineer to support healthcare data initiatives for ambulatory operations in Philadelphia, Pennsylvania. This Long-term Contract position will focus on designing and maintaining scalable data pipelines, improving data accessibility, and enabling reliable reporting across clinical and operational environments. The role suits someone who communicates effectively, works well with cross-functional teams, and brings strong experience with modern cloud data platforms and healthcare data systems.<br><br>Responsibilities:<br>• Build and optimize end-to-end data pipelines using Databricks, Snowflake, Azure, and related cloud technologies to support ambulatory operational data needs.<br>• Develop ETL and ELT workflows that ingest, transform, and validate data from healthcare platforms, including Epic Ambulatory and other enterprise sources.<br>• Collaborate with analysts, operational stakeholders, and technical teams to translate business needs into dependable data solutions and well-structured datasets.<br>• Create and maintain data integrations using tools such as Azure Data Factory, Azure Data Lake, Apache Spark, Kafka, Hadoop, and AWS Glue where appropriate.<br>• Ensure data quality, consistency, and performance by monitoring pipeline execution, troubleshooting issues, and implementing scalable engineering practices.<br>• Support the development of a core data engineering function for the team by establishing reusable frameworks, standards, and documentation.<br>• Partner with healthcare and hospital-based stakeholders to deliver data assets that improve operational visibility and decision-making.<br>• Contribute to architecture discussions, code reviews, and process improvements while communicating clearly with both technical and non-technical audiences.