<p>We are looking for a Principal Data Engineer to shape and lead a modern enterprise data platform serving multiple business lines. This position will define the architectural direction for a Microsoft Fabric-based environment, guide engineering best practices, and partner closely with data and IT leaders to support long-term growth. The role is ideal for a senior technical expert who combines deep hands-on engineering capability with strong mentorship and platform strategy experience.</p><p><br></p><p>Responsibilities:</p><p>• Lead the design and ongoing evolution of a Microsoft Fabric lakehouse environment, establishing a scalable architecture across raw, refined, and curated data layers.</p><p>• Create and support robust data integration workflows that bring information together from more than 30 enterprise applications and operational platforms.</p><p>• Set technical standards for data engineering, including coding practices, solution design patterns, documentation, and review processes.</p><p>• Mentor data engineers through hands-on coaching, collaborative development, and detailed code feedback to strengthen team capability.</p><p>• Partner with data and IT leadership to align platform architecture with business priorities and future expansion needs.</p><p>• Develop high-quality data pipelines using modern tools and frameworks such as SQL, Python, Spark, and PySpark within cloud-based data ecosystems.</p><p>• Evaluate new technologies, architectural approaches, and data platform trends, then provide informed recommendations for adoption.</p><p>• Support governance and platform reliability by promoting strong lineage, quality, performance, and scalable engineering practices.</p><p>• Contribute to cross-platform interoperability initiatives, including environments that may involve Databricks, governance tooling, and enterprise data services.</p>
Position: Principal Data Engineer | Direct Hire Permanent<br>Location: Remote<br>Salary: $180,000 - $225,000 base plus SIGNIFICANT bonus and or equity potential<br><br>*** For immediate and confidential consideration, please send a message to MEREDITH CARLE on LinkedIn or send an email to me with your resume. My email can be found on my LinkedIn page. ***<br><br>Build the data foundation that powers analytics, AI, and enterprise decision-making.<br>We’re hiring a Principal Data Engineer to design and deliver a modern, scalable data platform from the ground up. This is a high-impact, hands-on role where you’ll lead architecture decisions, build production-grade pipelines, and enable secure, multi-tenant data capabilities that support everything from reporting to advanced AI use cases.<br><br>What You’ll Own<br> • Design and build a modern data platform across ingestion, transformation, storage, and consumption<br> • Develop scalable batch and real-time pipelines across diverse data sources (relational, event, document)<br> • Establish data architecture standards, modeling practices, and engineering frameworks<br> • Create secure, multi-tenant data environments with strong governance and access controls<br> • Build data models and serving layers for reporting, self-service analytics, and AI workloads<br> • Evaluate and implement cloud data technologies for performance, cost, and scalability<br> • Partner with engineering and business leaders to align data strategy with company priorities<br> • Guide vendors and external partners while enforcing internal data standards and quality<br><br>What You Bring<br> • 10+ years of experience in data engineering, including large-scale architecture ownership<br> • Strong programming skills in Python and experience with tools like Spark, Kafka, or similar<br> • Expertise building batch and streaming pipelines in cloud environments (AWS preferred)<br> • Deep knowledge of data modeling for both transactional and analytical systems<br> • Hands-on experience with Snowflake, Redshift, or modern data platforms<br> • Strong understanding of data governance, privacy, and secure data design<br> • Experience with ETL frameworks, testing, and CI/CD-driven data workflows<br> • Ability to clearly communicate technical strategy and tradeoffs to senior stakeholders<br><br>Why This Role<br> • Architect and build a next-generation data platform from foundational level<br> • Direct impact on analytics, product insights, and AI capabilities<br> • High ownership, visibility, and influence across engineering and leadership<br> • Opportunity to define standards, tooling, and long-term data strategy<br><br>If you’re a hands-on data engineer who enjoys building scalable platforms and shaping how data is leveraged across an organization, this is a high-impact opportunity to lead from the front.<br><br><br>*** For immediate and confidential consideration, please send a message to MEREDITH CARLE on LinkedIn or send an email to me with your resume. My email can be found on my LinkedIn page. Also, you may contact me by office: 515-303-4654 or mobile: 515-771-8142. Or one click apply on our Robert Half website. No third party inquiries please. Our client cannot provide sponsorship and cannot hire C2C. ***
Position: Principal Data Engineer | Direct Hire Permanent<br>Location: Remote<br>Salary: $225,000 - 300,000 base plus bonus potential<br>*** For immediate and confidential consideration, please send a message to MEREDITH CARLE on LinkedIn or send an email to me with your resume. My email can be found on my LinkedIn page. ***<br><br>Build the data foundation that powers analytics, AI, and enterprise decision-making.<br>We’re hiring a Principal Data Engineer to design and deliver a modern, scalable data platform from the ground up. This is a high-impact, hands-on role where you’ll lead architecture decisions, build production-grade pipelines, and enable secure, multi-tenant data capabilities that support everything from reporting to advanced AI use cases.<br><br>What You’ll Own<br> • Design and build a modern data platform across ingestion, transformation, storage, and consumption<br> • Develop scalable batch and real-time pipelines across diverse data sources (relational, event, document)<br> • Establish data architecture standards, modeling practices, and engineering frameworks<br> • Create secure, multi-tenant data environments with strong governance and access controls<br> • Build data models and serving layers for reporting, self-service analytics, and AI workloads<br> • Evaluate and implement cloud data technologies for performance, cost, and scalability<br> • Partner with engineering and business leaders to align data strategy with company priorities<br> • Guide vendors and external partners while enforcing internal data standards and quality<br><br>What You Bring<br> • 10+ years of experience in data engineering, including large-scale architecture ownership<br> • Strong programming skills in Python and experience with tools like Spark, Kafka, or similar<br> • Expertise building batch and streaming pipelines in cloud environments (AWS preferred)<br> • Deep knowledge of data modeling for both transactional and analytical systems<br> • Hands-on experience with Snowflake, Redshift, or modern data platforms<br> • Strong understanding of data governance, privacy, and secure data design<br> • Experience with ETL frameworks, testing, and CI/CD-driven data workflows<br> • Ability to clearly communicate technical strategy and tradeoffs to senior stakeholders<br><br>Why This Role<br> • Architect and build a next-generation data platform from foundational level<br> • Direct impact on analytics, product insights, and AI capabilities<br> • High ownership, visibility, and influence across engineering and leadership<br> • Opportunity to define standards, tooling, and long-term data strategy<br><br>If you’re a hands-on data engineer who enjoys building scalable platforms and shaping how data is leveraged across an organization, this is a high-impact opportunity to lead from the front.
<p>We are looking for a Data Engineer to help shape and strengthen the organization’s data warehouse and analytics capabilities. This role will focus on building reliable data solutions that support reporting, business intelligence, and operational decision-making across the company. The ideal candidate brings strong technical depth in data engineering, enjoys solving complex integration challenges, and works effectively with both IT colleagues and business stakeholders.</p><p><br></p><p>Responsibilities:</p><p>• Design and enhance scalable data warehouse structures and integration pipelines that support analytics, reporting, and cross-system data flow.</p><p>• Develop, test, and maintain ETL processes that move data from varied source systems into staging, warehouse, and downstream reporting environments.</p><p>• Partner with business teams and technical peers to translate functional needs into practical data solutions and system designs.</p><p>• Improve database performance by tuning SQL, refining indexing strategies, and addressing issues identified through execution plan analysis.</p><p>• Create and support dashboards, reports, and data visualizations using tools such as Power BI, Tableau, and similar business intelligence platforms.</p><p>• Perform data validation, auditing, and quality checks to protect accuracy, consistency, and compliance across critical datasets.</p><p>• Provide production support for data platforms, integrations, and reporting solutions, resolving issues and maintaining dependable system performance.</p><p>• Contribute to agile delivery efforts by participating in development, testing, and quality assurance activities across databases, middleware, and analytics applications</p>
<p>Robert Half is working with a client in the Atlanta area seeking a Senior Lead Data Engineer.</p><ul><li>Lead the design, development, and optimization of enterprise data platforms and data warehouse solutions</li><li>Drive the migration and modernization of legacy data environments to Snowflake</li><li>Architect and build scalable ETL/ELT pipelines that support analytics, reporting, and business intelligence initiatives</li><li>Design and maintain high-performance data models, data architectures, and data integration frameworks</li><li>Implement data quality, governance, monitoring, and performance optimization best practices</li><li>Serve as the technical lead for data engineering initiatives and help define the long-term data strategy and roadmap</li><li>Partner closely with business stakeholders, product teams, and technical leadership to translate requirements into scalable solutions</li><li>Utilize Airflow and/or Astronomer to orchestrate and manage complex data workflows</li><li>Develop solutions leveraging Python, SQL, Snowflake, and cloud-based data technologies</li><li>Mentor and guide other engineers while influencing technical direction and engineering standards</li><li>Evaluate and implement modern data engineering tools, frameworks, and best practices</li><li>Support the growth and scalability of the organization's data ecosystem while ensuring reliable, trusted, and accessible data</li></ul>
<p>We are looking for Data Engineering and Analytics Engineering professionals interested in exploring new opportunities with growing organizations across the Pittsburgh market. We are partnering with multiple companies that are investing in modern data platforms, cloud infrastructure, and enterprise analytics initiatives.</p><p><br></p><p><strong>Location:</strong> Pittsburgh, PA (Hybrid, Remote, and Onsite Opportunities Available)</p><p><strong>Compensation:</strong> $80,000 - $160,000+ depending on experience and position</p><p><strong>Schedule:</strong> Full-Time</p><p><br></p><p><strong>Opportunities May Include:</strong></p><ul><li>Data Engineer</li><li>Senior Data Engineer</li><li>Analytics Engineer</li><li>Data Platform Engineer</li><li>Data Warehouse Engineer</li><li>Cloud Data Engineer</li><li>ETL/ELT Developer</li><li>Data Architect</li><li>Lead Data Engineer</li></ul><p><strong>Responsibilities:</strong></p><ul><li>Design, develop, and maintain scalable data pipelines and data platforms</li><li>Build and optimize ETL/ELT processes supporting analytics and business operations</li><li>Develop and manage cloud-based data solutions and data warehouses</li><li>Partner with analytics, business, and technology teams to deliver trusted data products</li><li>Ensure data quality, reliability, governance, and performance across enterprise environments</li><li>Automate data workflows and support modern data engineering best practices</li><li>Support reporting, analytics, AI, and machine learning initiatives through effective data architecture</li></ul>
<p>Lead Data Engineer</p><p>Salary: Up to $160,000 Location:</p><p>On-Site | South Los Angeles Area</p><p>Employment Type: Full-Time</p><p><br></p><p>Build the Foundation for Enterprise Analytics</p><p><br></p><p>We are seeking a Lead Data Engineer to drive the architecture, modernization, and expansion of a growing enterprise data platform built within the Microsoft Azure ecosystem. This is a highly visible technical leadership role where you'll help shape the future of data across multiple business functions by building scalable, secure, and high-performing data solutions.</p><p><br></p><p>If you're passionate about Databricks, cloud data platforms, and mentoring engineering teams while remaining hands-on with development, this is an opportunity to make a significant impact.</p><p><br></p><p>What You'll Do</p><ul><li>Lead the design, implementation, and optimization of an enterprise Azure Databricks Lakehouse environment utilizing Bronze, Silver, and Gold data layers.</li><li>Architect and execute migrations from SQL Server and legacy platforms into modern cloud-native data solutions.</li><li>Develop and optimize large-scale ETL/ELT pipelines supporting operational reporting, business intelligence, advanced analytics, and data science initiatives.</li><li>Integrate data from multiple enterprise systems, APIs, operational platforms, and third-party sources.</li><li>Establish best practices for data engineering, data modeling, testing, CI/CD, monitoring, governance, and production support.</li><li>Implement and maintain data governance frameworks, security controls, lineage tracking, and access management.</li><li>Lead code reviews, technical design discussions, and engineering standards across the data team.</li><li>Mentor and support data engineers while fostering a culture of technical excellence.</li><li>Partner closely with business stakeholders, analysts, and data scientists to deliver trusted, scalable data products.</li></ul><p>For immediate consideration, apply now and direct message Reid Gormly on LINKEDIN</p>
<p><strong>Lead Data Engineer</strong></p><p><br></p><p><strong>Company Overview</strong> </p><p>A media organization is seeking a Lead Data Engineer to support enterprise data, analytics, and emerging technology initiatives. This role offers the opportunity to lead technical projects, mentor engineers, and help shape the organization's data strategy.</p><p><br></p><p><strong>Role Summary</strong> </p><p>The Lead Data Engineer will be a hands-on technical leader responsible for data engineering, analytics, automation, and AI-related initiatives. This role combines individual contribution, technical direction, team mentorship, and cross-functional collaboration.</p><p><br></p><p><strong>Key Responsibilities</strong></p><ul><li>Lead the design, development, and support of enterprise data solutions.</li><li>Provide technical leadership and establish development best practices.</li><li>Oversee data pipelines, integrations, reporting, and automation initiatives.</li><li>Partner with business and technology stakeholders to prioritize work and deliver solutions.</li><li>Monitor data quality, reliability, and operational performance.</li><li>Mentor team members and support their technical development.</li><li>Evaluate emerging technologies and identify opportunities for innovation.</li></ul>
<p><strong>Robert Half is working with a client who is looking to hire a Data Engineer</strong> to support a growing enterprise data and analytics initiative. This individual will help build and modernize the data pipelines, integrations, and cloud-based data infrastructure used across the organization.</p><p>The ideal candidate has experience working with large datasets, modern cloud data platforms, and production-grade ETL/ELT pipelines. This role will work closely with Data Architects, Analytics Engineers, BI teams, and business stakeholders as the organization expands its enterprise data capabilities.</p><p>Responsibilities</p><ul><li>Design, build, and maintain scalable ETL/ELT data pipelines.</li><li>Integrate structured and unstructured data from multiple enterprise systems.</li><li>Develop and optimize data models used for analytics and reporting.</li><li>Build solutions within cloud data environments such as Azure, AWS, or GCP.</li><li>Monitor data pipelines for performance, reliability, and data quality.</li><li>Partner with analysts, architects, and application teams to understand data requirements.</li><li>Support the migration of legacy data workloads to modern cloud platforms.</li><li>Develop reusable frameworks and automation for data processing.</li></ul><p><br></p>
<p>Robert Half is seeking a <strong>Contract Data Engineer</strong> to support our client’s data and analytics initiatives. In this role, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure that enable efficient data ingestion, transformation, and delivery. The ideal candidate has strong experience working with modern data platforms, cloud environments, and large-scale datasets.</p><p><br></p><p><strong>Key Responsibilities:</strong></p><ul><li><strong>Data Pipeline Development:</strong> Design, build, and maintain scalable ETL / ELT pipelines to ingest, transform, and deliver data from multiple sources.</li><li><strong>Data Architecture:</strong> Develop and optimize data models, schemas, and warehouse structures to support analytics, reporting, and business intelligence needs.</li><li><strong>Cloud Data Platforms:</strong> Work within cloud environments such as <strong>AWS, Azure, or GCP</strong> to deploy and manage data solutions.</li><li><strong>Data Warehousing:</strong> Design and support enterprise data warehouses using platforms such as <strong>Snowflake, Redshift, BigQuery, or Azure Synapse</strong>.</li><li><strong>Big Data Processing:</strong> Develop solutions using big data technologies such as <strong>Spark, Databricks, Kafka, and Hadoop</strong> when required.</li><li><strong>Performance Optimization:</strong> Tune queries, pipelines, and storage solutions for performance, scalability, and cost efficiency.</li><li><strong>Data Quality & Reliability:</strong> Implement monitoring, validation, and alerting processes to ensure data accuracy, integrity, and availability.</li><li><strong>Collaboration:</strong> Work closely with Data Analysts, Data Scientists, Software Engineers, and business stakeholders to understand requirements and deliver data solutions.</li><li><strong>Documentation:</strong> Maintain detailed documentation for pipelines, data flows, and system architecture.</li></ul><p><br></p>
<p>Robert Half is seeking an experienced <strong>Senior Data Engineer</strong> to support a <strong>law firm based in Seattle, Washington</strong> with the continued development and modernization of its enterprise data environment. This role will focus heavily on <strong>Databricks, dimensional modeling, PySpark, and Unity Catalog</strong>, with responsibility for ingesting, transforming, and preparing data from multiple enterprise systems for reporting and analytics.</p><p> </p><p><strong>Duration:</strong> 6-month contract</p><p><strong>Location:</strong> 100% Remote – preferred to work PST or CST</p><p><strong>Pay rate: </strong>$65-$75/hour (W2)</p><p> </p><p><strong>Responsibilities</strong></p><ul><li>Design, develop, and maintain scalable data pipelines and data models within <strong>Databricks</strong>.</li><li>Build and optimize <strong>dimensional data models</strong> to support enterprise reporting and analytics.</li><li>Develop data transformation and processing workflows using <strong>PySpark</strong>.</li><li>Ingest data from enterprise source systems, including <strong>Workday, Elite/Elite 3E, and Salesforce</strong>.</li><li>Move data through the <strong>Medallion Architecture</strong>, including Bronze, Silver, and Gold layers.</li><li>Clean, normalize, transform, and prepare source data for downstream analytics and reporting.</li><li>Utilize <strong>Unity Catalog</strong> to support data governance, security, organization, and access management.</li><li>Prepare curated datasets for consumption and reporting within <strong>Power BI</strong>.</li><li>Partner with business and technical stakeholders to understand reporting needs and demonstrate data within Power BI.</li><li>Troubleshoot data connectivity and integration issues involving <strong>APIs, Postman, firewall rules, and certificates</strong>.</li><li>Ensure data pipelines and models are scalable, reliable, and aligned with data engineering best practices.</li></ul><p><br></p>
The Data Engineer II will play a vital role in our Data transformation journey — helping move the organization toward a future state where decision-makers have the right data, in real time, when they need it. This role is responsible for driving the execution of key data projects, including data management, data conversions, ongoing ingestion pipelines, and data platform engineering and operations. The ideal candidate will work across systems and teams to ensure data flows seamlessly, reliably, and securely throughout the enterprise, supporting both strategic initiatives and day-to-day operations. <br> Duties and Responsibilities: <br> Develop an understanding of our current data landscape Administer and optimize Snowflake and other data platforms to ensure performance and alignment with business goals including role/permission management performance tuning, cost optimization, and capacity planning. Manage operations of the Data Warehouse, Middleware/Azure Enterprise Service Bus (ESB), Cognos, and related analytics tools. Provide secondary support for Data Integration & Platform Engineering responsibilities, including assisting with system maintenance, data pipeline operations, and platform enhancements. Stay informed on emerging data technologies and trends, sharing insights to help identify opportunities for innovation and improved data use. Help implement scalable and efficient data solutions that improve business insights and operational performance. Collaborate with IT and business stakeholders to support data access, usability, and consistency across departments. Participate in the integration of new tools and systems, ensuring seamless functionality and data accuracy. Provide advanced support by resolving escalated issues from Data Engineer I, ensuring timely and effective resolution of complex technical challenges. Contribute to a collaborative, high-performing team culture by supporting peers and sharing knowledge. Enforce data governance policies, ensuring data is secure, consistent, and compliant with regulations. Support efforts to meet financial regulations and cybersecurity standards in all data-related systems. Administrator and/or deliver configuration requests in our Azure ESB environment to Banking Core System through APIs. Design and develop pipelines for additional data vendors Recommend, implement and maintain best practices for the environment Ability to illustrate and maintain the enterprise’s data systems architecture Complies with all applicable banking laws and regulations, including, but not limited to the Bank Secrecy Act, must be eligible to work in the U.S. Patriot Act, and related anti-money laundering statutes, and federal consumer protection legislation and regulations. Builds working knowledge of all applicable laws and regulations. Other duties as assigned
<p>We are looking for a Data Engineer to design, build, and maintain scalable data pipelines on Microsoft Azure. This role will support enterprise reporting, analytics, and machine learning initiatives by ensuring the availability and integrity of critical business data.</p><p>Responsibilities</p><ul><li>Design and develop ETL/ELT data pipelines</li><li>Build and maintain Azure data platforms and data lakes</li><li>Integrate data from APIs, databases, and third-party systems</li><li>Develop data models supporting analytics and reporting</li><li>Optimize database and pipeline performance</li><li>Implement data quality and monitoring solutions</li><li>Collaborate with analysts, developers, and business users</li></ul><p><br></p>
<p>We are looking for a Data Engineer to build and enhance reporting and data solutions that help teams make informed business decisions across the organization. This role partners with groups such as asset management, acquisitions, accounting, and HR to translate business needs into scalable dashboards, reliable data pipelines, and actionable insights. Based in Los Angeles, California, the position is ideal for someone who combines strong technical depth with the ability to explain findings clearly to a range of stakeholders.</p><p><br></p><p>Responsibilities:</p><p>• Create and refine dashboards, reports, and automated data outputs using tools such as Python, Excel, and Power BI to support operational and strategic reporting needs.</p><p>• Examine large and varied datasets to uncover meaningful trends, performance indicators, and opportunities for improvement.</p><p>• Guide and support entry-level BI team members by reviewing work, sharing best practices, and contributing to their career growth.</p><p>• Partner with stakeholders across multiple business functions to define reporting goals, gather technical requirements, and deliver effective data solutions.</p><p>• Translate technical concepts and analytical results into clear recommendations for non-technical audiences.</p><p>• Contribute to cross-department initiatives that improve data availability, reporting consistency, and overall usability of business information.</p><p>• Develop and maintain queries, procedures, and data workflows to support extraction, transformation, and loading activities across reporting environments.</p><p>• Monitor data quality through validation checks, issue resolution, and routine audits to maintain accuracy and reliability.</p><p>• Administer BI platforms with attention to performance, access control, and system stability while assisting users with adoption and training.</p><p><br></p><p>For immediate consideration, apply now and direct message Reid Gormly on LinkedIn</p>
<p>We are looking for a Staff Database Engineer to provide technical leadership for a global cloud data environment supporting large-scale, distributed business operations in Utah. This contract-to-hire position will focus on building and improving secure, highly available database platforms across AWS while partnering with engineering teams to strengthen performance, resilience, and scalability. The role is ideal for someone who brings deep database expertise, strong automation skills, and a practical approach to supporting modern data pipelines and enterprise applications.</p><p><br></p><p>Responsibilities:</p><p>• Lead the design and ongoing improvement of multi-region database environments across AWS to support globally distributed workloads.</p><p>• Administer and enhance a mix of relational and non-relational platforms, including Snowflake, PostgreSQL, DynamoDB, DocumentDB, Cosmos DB, and MongoDB.</p><p>• Drive database migration efforts between cloud platforms, regional deployments, and legacy environments while minimizing operational risk.</p><p>• Improve system performance through thoughtful indexing, query refinement, capacity planning, and scalable data architecture decisions.</p><p>• Strengthen availability and cost efficiency by tuning database platforms for enterprise-scale throughput, resiliency, and low-latency access.</p><p>• Support data ingestion and ETL workflows by collaborating on services and orchestration tools used across cloud-based pipeline ecosystems.</p><p>• Establish secure connectivity patterns, access controls, encryption standards, and secrets management practices for database services.</p><p>• Build and maintain backup, recovery, and disaster preparedness processes, including point-in-time restore capabilities and continuity planning.</p><p>• Expand monitoring and operational visibility using cloud and third-party observability tools, and take ownership of production incident response when needed.</p><p>• Create and maintain technical documentation such as runbooks, operational procedures, and architecture decision records to support long-term platform reliability</p>
We are looking for a Contract Data Engineer to strengthen analytics and reporting capabilities for a business operating across multiple data platforms. This role is based in San Francisco, California, and is ideal for someone who can evaluate an existing data ecosystem, advise on practical improvements, and deliver hands-on solutions. The right candidate will connect information from several systems, shape scalable data structures, and partner closely with business stakeholders to turn reporting needs into reliable insights.<br><br>Responsibilities:<br>• Evaluate the current data architecture and identify opportunities to improve scalability, usability, and reporting effectiveness.<br>• Design and build data pipelines that combine information from multiple platforms into a cohesive and dependable reporting environment.<br>• Develop and enhance Power BI dashboards and reporting solutions that provide stronger visibility into business performance.<br>• Organize and model data within lake and warehouse environments to support accurate analytics and long-term maintainability.<br>• Work directly with business partners to gather requirements, translate goals into technical solutions, and deliver actionable insights.<br>• Lead hands-on implementation work across the data stack while also recommending the most effective path for future-state architecture.<br>• Support ongoing expansion of data lake and reporting capabilities to improve access to trusted, well-structured information.
<p>We are looking for a Data Platform Engineer to join a 4-month contract opportunity based in Norman, Oklahoma. This role owns the storage, retention and pipeline-correctness workstream. This is data engineering, not cloud </p><p>infrastructure.</p><p><br></p><p>What they will actually do</p><p>▪ Own the storage and pipeline backlog across the ingestion and processing repositories</p><p>▪ Event ordering and bitemporal modelling: separating event time from ingestion time, deterministic replay</p><p>▪ Atomic snapshot publication with schema admission and rollback</p><p>▪ Design the historical layer on object storage so it can be queried economically and answer as-of </p><p>questions correctly — file format, partitioning, compaction, and whether the canonical layer moves </p><p>onto a managed table format</p><p>▪ Reconcile the operational database and the historical store so a point-in-time question returns one </p><p>answer rather than two</p><p>▪ Evidence immutability and retention: object-lock semantics, preventing overwrite of stored evidence, </p><p>validated recovery paths</p><p>▪ Pipeline durability: idempotent runs, completeness receipts, restore testing</p><p>▪ Support production cutover in month 4 — this seat does not roll off early</p>
We are looking for a Data Engineer to join a Long-term Contract opportunity based in Cincinnati, Ohio. This role will help shape enterprise-grade data applications by combining strong engineering practices with thoughtful user-focused delivery, supporting solutions that turn complex information into reliable business insights. The position works closely with cross-functional teams to build scalable data pipelines, enable high-quality analytics, and contribute to modern application experiences that are secure, dependable, and easy to use.<br><br>Responsibilities:<br>• Design and build scalable data pipelines that collect, transform, and deliver enterprise data for analytics and application use.<br>• Develop and maintain ETL workflows using Python, Apache Spark, Hadoop, and Kafka to support reliable movement of large and complex datasets.<br>• Partner with business, analytics, backend, and cloud teams to translate reporting and decision-support needs into practical data engineering solutions.<br>• Establish reusable standards for data integration, quality checks, and processing patterns to improve consistency across products.<br>• Optimize data workflows for performance, stability, and maintainability in production environments.<br>• Support secure integration between data platforms, governed datasets, and downstream applications or APIs.<br>• Contribute to testing, monitoring, and troubleshooting practices to ensure dependable data availability and issue resolution.<br>• Document data processes, technical decisions, and implementation standards so teams can scale solutions more effectively.
We are looking for an experienced Data Engineer for a permanent opportunity in Northern, Virginia. In this role, you will design reliable data solutions that support analytics and business decision-making while helping improve the overall data environment. The ideal candidate brings strong technical depth in modern data engineering practices and enjoys building scalable systems from the ground up. <br> Responsibilities: • Design, develop, and maintain robust data pipelines that collect, transform, and deliver high-quality data for reporting and analysis. • Create and optimize data models that support business intelligence, analytics, and operational use cases across the organization. • Build and manage ETL workflows using Python and related technologies to ensure efficient movement of data between systems. • Work with large-scale data processing tools such as Apache Spark and Hadoop to handle complex and high-volume datasets. • Integrate streaming and batch data sources using technologies such as Apache Kafka to support timely and reliable data availability. • Collaborate with analysts, engineers, and business stakeholders to translate data needs into scalable engineering solutions. • Improve data warehouse performance, structure, and reliability to support accurate and accessible enterprise data. • Use dbt and other modern data transformation practices to organize, test, and document datasets effectively.
We are looking for a Data Engineer to create and enhance scalable data solutions that strengthen business intelligence capabilities across the organization. This role partners with technology leaders, software teams, delivery stakeholders, and external partners to turn business needs into reliable technical outcomes. The position is well suited to someone who thrives in an agile setting, works confidently with minimal supervision, and collaborates effectively across teams. This opportunity is based in Nashville, Tennessee.<br><br>Responsibilities:<br>• Build and refine scalable data pipelines and platform components that support reporting, analytics, and enterprise intelligence initiatives.<br>• Assess modern cloud and big data technologies, gain working knowledge of new tools quickly, and recommend practical options based on business needs.<br>• Translate technical and business requirements into clearly defined tasks, implementation plans, and measurable deliverables.<br>• Write maintainable, efficient, and high-quality code that supports stable and dependable data solutions.<br>• Review existing processes and code for gaps or performance issues, then propose and implement improvements.<br>• Adjust priorities effectively in response to evolving project demands, timelines, and stakeholder expectations.<br>• Take ownership of delivered solutions by documenting design decisions and explaining functionality to team members and partners.<br>• Contribute to additional data engineering efforts that advance organizational goals and strengthen outcomes for end users.
We are looking for a Data Engineer to help shape and expand a cloud-focused data environment that supports analytics, operational reporting, automation, and emerging AI use cases. Based in Brookfield, Wisconsin, this position works across technical and business teams to deliver dependable data solutions that improve access, accuracy, and usability. The role is ideal for someone who thrives on translating complex data needs into scalable engineering outcomes and values collaboration, problem-solving, and continuous improvement.<br><br>Responsibilities:<br>• Design, build, and maintain scalable data pipelines that move and transform information for analytics, reporting, and operational needs.<br>• Partner with business stakeholders, analysts, software developers, and leaders to understand data requirements and turn them into reliable engineering solutions.<br>• Develop and refine data models and platform architecture to support performance, flexibility, and long-term growth.<br>• Implement ETL processes that integrate data from multiple sources while improving consistency, completeness, and accessibility.<br>• Use Python and distributed data technologies such as Apache Spark and Hadoop to process large and complex datasets efficiently.<br>• Support streaming and event-driven data workflows using tools such as Apache Kafka where real-time data delivery is needed.<br>• Monitor data quality, troubleshoot pipeline issues, and optimize workflows to ensure dependable delivery and strong system performance.<br>• Contribute to ongoing enhancements of the data platform by identifying opportunities to improve scalability, automation, and engineering standards.
We are looking for an experienced Senior Data Engineer to help design and enhance scalable data platforms that support critical business operations in Houston, Texas. This role is ideal for someone who enjoys building reliable pipelines, improving data accessibility, and working with modern big data technologies in a service-focused environment. The successful candidate will play a key role in shaping data architecture, enabling analytics, and maintaining high standards for performance, quality, and governance.<br><br>Responsibilities:<br>• Design, build, and optimize large-scale data pipelines that collect, transform, and deliver data from multiple sources.<br>• Develop robust ETL workflows using Python and Spark to support reporting, analytics, and operational data needs.<br>• Implement and maintain data solutions across distributed processing environments, including Hadoop and Azure Databricks.<br>• Create streaming and batch data integrations using Kafka and related technologies to ensure timely and dependable data movement.<br>• Collaborate with analysts, engineers, and business stakeholders to translate requirements into scalable technical solutions.<br>• Monitor pipeline performance, troubleshoot data issues, and apply improvements that increase reliability and efficiency.<br>• Establish data quality controls, validation processes, and documentation to support governance and long-term maintainability.<br>• Contribute to platform enhancements and technical initiatives, including changes to data infrastructure or internal processing frameworks when needed.
We are looking for a Data Engineer to join a Contract engagement supporting people analytics and HR-focused data initiatives in Philadelphia, Pennsylvania. This role is centered on designing, building, and refining scalable data pipelines and curated data assets using Azure Databricks and Azure Data Factory. The ideal candidate will be comfortable working hands-on with complex source data, translating business needs into reliable transformations, and delivering production-ready solutions with minimal oversight.<br><br>Responsibilities:<br>• Design, build, and maintain robust ETL and ELT workflows that support HR and workforce data products.<br>• Develop scalable data transformations using Python, SQL, Spark, and Azure Databricks to prepare high-quality datasets for downstream use.<br>• Orchestrate and monitor pipeline execution through Azure Data Factory to ensure dependable and timely data delivery.<br>• Analyze existing source systems and data structures to map requirements and create efficient ingestion and transformation logic.<br>• Partner with stakeholders across HR and analytics teams to turn business questions into practical engineering solutions.<br>• Improve data quality, performance, and reliability by applying modern engineering standards, testing practices, and documentation.<br>• Support integrations across HRIS and related platforms, including contributing to interface development where needed.<br>• Create production-ready datasets that enable reporting, workforce analysis, and broader people data initiatives.
We are looking for a Data Engineer to help build reliable data solutions that support reporting, analytics, and day-to-day business decisions in Princeton, New Jersey. This position focuses on creating scalable data flows, improving platform performance, and organizing data for efficient access across teams. The ideal candidate brings strong technical depth in pipeline development, database technologies, and cloud-based data environments.<br><br>Responsibilities:<br>• Build, enhance, and support scalable ETL workflows that move and transform data from multiple sources into trusted analytical platforms.<br>• Create and refine data models, storage structures, and warehouse solutions to improve accessibility, efficiency, and long-term maintainability.<br>• Monitor data processes to identify issues, strengthen reliability, and maintain high standards for accuracy, consistency, and performance.<br>• Partner with analytics, engineering, and business stakeholders to understand data needs and deliver practical data solutions.<br>• Optimize SQL Server and related data systems to support efficient querying, integration, and operational stability.<br>• Implement and maintain orchestration processes using tools such as Airflow or comparable workflow technologies.<br>• Contribute to cloud-based data infrastructure initiatives across platforms such as Azure and other enterprise cloud environments.
We are looking for an experienced Lead Data Engineer to oversee the design, implementation, and management of advanced data infrastructure in Houston, Texas. This role requires expertise in architecting scalable solutions, optimizing data pipelines, and ensuring data quality to support analytics, machine learning, and real-time processing. The ideal candidate will have a deep understanding of Lakehouse architecture and Medallion design principles to deliver robust and governed data solutions.<br><br>Responsibilities:<br>• Develop and implement scalable data pipelines to ingest, process, and store large datasets using tools such as Apache Spark, Hadoop, and Kafka.<br>• Utilize cloud platforms like AWS or Azure to manage data storage and processing, leveraging services such as S3, Lambda, and Azure Data Lake.<br>• Design and operationalize data architecture following Medallion patterns to ensure data usability and quality across Bronze, Silver, and Gold layers.<br>• Build and optimize data models and storage solutions, including Databricks Lakehouses, to support analytical and operational needs.<br>• Automate data workflows using tools like Apache Airflow and Fivetran to streamline integration and improve efficiency.<br>• Lead initiatives to establish best practices in data management, facilitating knowledge sharing and collaboration across technical and business teams.<br>• Collaborate with data scientists to provide infrastructure and tools for complex analytical models, using programming languages like Python or R.<br>• Implement and enforce data governance policies, including encryption, masking, and access controls, within cloud environments.<br>• Monitor and troubleshoot data pipelines for performance issues, applying tuning techniques to enhance throughput and reliability.<br>• Stay updated with emerging technologies in data engineering and advocate for improvements to the organization's data systems.