Search jobs now Find the right job type for you Explore how we help job seekers Contract talent Permanent talent Learn how we work with you Executive search Finance and Accounting Technology Marketing and Creative Legal Administrative and Customer Support Technology Risk, Audit and Compliance Finance and Accounting Digital, Marketing and Customer Experience Legal Operations Human Resources 2026 Salary Guide Demand for Skilled Talent Report Building Future-Forward Tech Teams Job Market Outlook Press Room Salary and hiring trends Adaptive working Competitive advantage Work/life balance Inclusion Browse jobs Find your next hire Our locations

290 results for Big Data Engineer jobs

Data Engineer
  • Los Angeles, CA
  • onsite
  • Temporary
  • 55.41 - 64.00 USD / Hourly
  • <p>**** For Faster response on the position, please send a message to Jimmy Escobar on LinkedIn or send an email to Jimmy.Escobar@roberthalf(.com) with your resume. You can also call my office number at 424-270-9193****</p><p><br></p><p>We are looking for a skilled Data Engineer to join our team on a long-term contract basis in Los Angeles, California. In this role, you will design, build, and maintain robust data infrastructure to support business operations and analytics. This position offers an opportunity to work with cutting-edge technologies and contribute to impactful projects. This position is a hybrid that is 3 days a week on-site and 2 days remote.</p><p><br></p><p>Responsibilities:</p><p>• Develop and implement scalable data pipelines using Apache Spark, Hadoop, and other big data technologies.</p><p>• Collaborate with cross-functional teams to understand and translate business requirements into technical solutions.</p><p>• Create and maintain ETL processes to ensure data integrity and accessibility.</p><p>• Manage and monitor large-scale data processing systems, ensuring seamless operation.</p><p>• Design and deploy solutions for real-time data streaming using Apache Kafka.</p><p>• Perform advanced data analytics to support business decision-making.</p><p>• Troubleshoot and resolve issues related to data infrastructure and applications.</p><p><br></p>
  • 2026-02-05T08:48:37Z
Data Engineer
  • New Braunfels, TX
  • onsite
  • Permanent
  • 100000.00 - 125000.00 USD / Yearly
  • Key Responsibilities:<br><br>· Design, develop, and maintain scalable backend systems to support data warehousing and data lake initiatives.<br><br>· Build and optimize ETL/ELT processes to extract, transform, and load data from various sources into centralized data repositories.<br><br>· Develop and implement integration solutions for seamless data exchange between systems, applications, and platforms.<br><br>· Collaborate with data architects, analysts, and other stakeholders to define and implement data models, schemas, and storage solutions.<br><br>· Ensure data quality, consistency, and security by implementing best practices and monitoring frameworks.<br><br>· Monitor and troubleshoot data pipelines and systems to ensure high availability and performance.<br><br>· Stay up-to-date with emerging technologies and trends in data engineering and integration to recommend improvements and innovations.<br><br>· Document technical designs, processes, and standards for the team and stakeholders.<br><br><br><br>Qualifications:<br><br>· Bachelor’s degree in Computer Science, Engineering, or a related field; equivalent experience considered.<br><br>· Proven experience as a Data Engineer with 5 or more years of experience; or in a similar backend development role.<br><br>· Strong proficiency in programming languages such as Python, Java, or Scala.<br><br>· Hands-on experience with ETL/ELT tools and frameworks (e.g., Apache Airflow, Talend, Informatica, etc.).<br><br>· Extensive knowledge of relational and non-relational databases (e.g., SQL, NoSQL, PostgreSQL, MongoDB).<br><br>· Expertise in building and managing enterprise data warehouses (e.g., Snowflake, Amazon Redshift, Google BigQuery) and data lakes (e.g., AWS S3, Azure Data Lake).<br><br>· Familiarity with cloud platforms (AWS, Azure, Google Cloud) and their data services.<br><br>· Experience with API integrations and data exchange protocols (e.g., REST, SOAP, JSON, XML).<br><br>· Solid understanding of data governance, security, and compliance standards.<br><br>· Strong analytical and problem-solving skills with attention to detail.<br><br>· Excellent communication and collaboration abilities.<br><br><br><br>Preferred Qualifications:<br><br>· Certifications in cloud platforms (AWS Certified Data Analytics, Azure Data Engineer, etc.)<br><br>· Experience with big data technologies (e.g., Apache Hadoop, Spark, Kafka).<br><br>· Knowledge of data visualization tools (e.g., Tableau, Power BI) for supporting downstream analytics.<br><br>· Familiarity with DevOps practices and tools (e.g., Docker, Kubernetes, Jenkins).
  • 2026-01-26T23:48:40Z
Data Engineer
  • Nashville, TN
  • remote
  • Temporary
  • 48.00 - 58.00 USD / Hourly
  • <p>Robert Half is seeking a <strong>Contract Data Engineer</strong> to support our client’s data and analytics initiatives. In this role, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure that enable efficient data ingestion, transformation, and delivery. The ideal candidate has strong experience working with modern data platforms, cloud environments, and large-scale datasets.</p><p><br></p><p><strong>Key Responsibilities:</strong></p><ul><li><strong>Data Pipeline Development:</strong> Design, build, and maintain scalable ETL / ELT pipelines to ingest, transform, and deliver data from multiple sources.</li><li><strong>Data Architecture:</strong> Develop and optimize data models, schemas, and warehouse structures to support analytics, reporting, and business intelligence needs.</li><li><strong>Cloud Data Platforms:</strong> Work within cloud environments such as <strong>AWS, Azure, or GCP</strong> to deploy and manage data solutions.</li><li><strong>Data Warehousing:</strong> Design and support enterprise data warehouses using platforms such as <strong>Snowflake, Redshift, BigQuery, or Azure Synapse</strong>.</li><li><strong>Big Data Processing:</strong> Develop solutions using big data technologies such as <strong>Spark, Databricks, Kafka, and Hadoop</strong> when required.</li><li><strong>Performance Optimization:</strong> Tune queries, pipelines, and storage solutions for performance, scalability, and cost efficiency.</li><li><strong>Data Quality & Reliability:</strong> Implement monitoring, validation, and alerting processes to ensure data accuracy, integrity, and availability.</li><li><strong>Collaboration:</strong> Work closely with Data Analysts, Data Scientists, Software Engineers, and business stakeholders to understand requirements and deliver data solutions.</li><li><strong>Documentation:</strong> Maintain detailed documentation for pipelines, data flows, and system architecture.</li></ul><p><br></p>
  • 2026-01-29T15:58:42Z
Data Engineer - Lead
  • Houston, TX
  • onsite
  • Permanent
  • 175000.00 - 225000.00 USD / Yearly
  • We are looking for an experienced Lead Data Engineer to oversee the design, implementation, and management of advanced data infrastructure in Houston, Texas. This role requires expertise in architecting scalable solutions, optimizing data pipelines, and ensuring data quality to support analytics, machine learning, and real-time processing. The ideal candidate will have a deep understanding of Lakehouse architecture and Medallion design principles to deliver robust and governed data solutions.<br><br>Responsibilities:<br>• Develop and implement scalable data pipelines to ingest, process, and store large datasets using tools such as Apache Spark, Hadoop, and Kafka.<br>• Utilize cloud platforms like AWS or Azure to manage data storage and processing, leveraging services such as S3, Lambda, and Azure Data Lake.<br>• Design and operationalize data architecture following Medallion patterns to ensure data usability and quality across Bronze, Silver, and Gold layers.<br>• Build and optimize data models and storage solutions, including Databricks Lakehouses, to support analytical and operational needs.<br>• Automate data workflows using tools like Apache Airflow and Fivetran to streamline integration and improve efficiency.<br>• Lead initiatives to establish best practices in data management, facilitating knowledge sharing and collaboration across technical and business teams.<br>• Collaborate with data scientists to provide infrastructure and tools for complex analytical models, using programming languages like Python or R.<br>• Implement and enforce data governance policies, including encryption, masking, and access controls, within cloud environments.<br>• Monitor and troubleshoot data pipelines for performance issues, applying tuning techniques to enhance throughput and reliability.<br>• Stay updated with emerging technologies in data engineering and advocate for improvements to the organization's data systems.
  • 2026-02-17T00:43:41Z
Data Engineer
  • Lockbourne, OH
  • onsite
  • Permanent
  • 120000.00 - 150000.00 USD / Yearly
  • <p>We are looking for a skilled and innovative Data Engineer to join our team in Grove City, Ohio. In this role, you will be responsible for designing and implementing advanced data pipelines, ensuring the seamless integration and accessibility of data across various systems. As a key player in our analytics and data infrastructure efforts, you will contribute to building a robust and scalable data ecosystem to support AI and machine learning initiatives.</p><p><br></p><p>Responsibilities:</p><p>• Design and develop scalable data pipelines to ingest, process, and transform data from multiple sources.</p><p>• Optimize data models to support analytics, forecasting, and AI/ML applications.</p><p>• Collaborate with internal teams and external partners to enhance data engineering capabilities.</p><p>• Implement and enforce data governance, security, and quality standards across hybrid cloud environments.</p><p>• Work closely with analytics and data science teams to ensure seamless data accessibility and integration.</p><p>• Develop and maintain data products and services to enable actionable insights.</p><p>• Troubleshoot and improve the performance of data workflows and storage systems.</p><p>• Align data systems across departments to create a unified and reliable data infrastructure.</p><p>• Support innovation by leveraging big data tools and frameworks such as Databricks and Spark.</p>
  • 2026-02-10T14:53:56Z
Data Engineer
  • Montvale, NJ
  • onsite
  • Permanent
  • 125000.00 - 140000.00 USD / Yearly
  • <p>We are seeking a highly skilled Data Engineer to design, build, and manage our data infrastructure. The ideal candidate is an expert in writing complex SQL queries, designing efficient database schemas, and developing ETL/ELT pipelines. This role ensures data accuracy, accessibility, and performance optimization to support business intelligence, analytics, and reporting initiatives.</p><p><br></p><p><strong><em><u>Key Responsibilities</u></em></strong></p><p><br></p><p><strong>Database Design & Management</strong></p><ul><li>Design, develop, and maintain relational databases, including SQL Server, PostgreSQL, and Oracle, as well as cloud-based data warehouses.</li></ul><p><strong>Strategic SQL & Data Engineering</strong></p><ul><li>Develop advanced, optimized SQL queries, stored procedures, and functions to process and analyze large, complex datasets and deliver actionable business insights.</li></ul><p><strong>Data Pipeline Automation & Orchestration</strong></p><ul><li>Build, automate, and orchestrate ETL/ELT workflows using SQL, Python, and cloud-native tools to integrate and transform data from diverse, distributed sources.</li></ul><p><strong>Performance Optimization</strong></p><ul><li>Tune SQL queries and optimize database schemas through indexing, partitioning, and normalization to improve data retrieval and processing performance.</li></ul><p><strong>Data Integrity & Security</strong></p><ul><li>Ensure data quality, consistency, and integrity across systems.</li><li>Implement data masking, encryption, and role-based access control (RBAC).</li></ul><p><strong>Documentation</strong></p><ul><li>Maintain comprehensive technical documentation, including database schemas, data dictionaries, and ETL workflows.</li></ul>
  • 2026-02-06T17:38:38Z
Data Engineer
  • St Louis, MO
  • onsite
  • Temporary
  • 64.00 - 90.00 USD / Hourly
  • <p><strong>Data Engineer (Contract) – St. Louis, MO</strong></p><p><strong>Overview:</strong></p><p>Our company is seeking an experienced Data Engineer to join our team for a contract engagement in St. Louis, MO. As a Data Engineer, you will play a critical role in designing, building, and maintaining robust data pipelines and architectures to support advanced analytics and business intelligence initiatives.</p><p><strong>Key Responsibilities:</strong></p><ul><li>Develop, construct, test, and maintain scalable data architectures and data pipelines.</li><li>Integrate data from diverse sources (structured and unstructured) for analytics and reporting.</li><li>Optimize database performance and ensure data quality.</li><li>Implement data security, privacy standards, and compliance protocols.</li><li>Collaborate with data scientists, analysts, and business stakeholders to gather requirements and deliver effective data solutions.</li><li>Troubleshoot and resolve data-related issues and bottlenecks.</li><li>Automate data ingestion and transformation processes.</li><li>Support ongoing data management, documentation, and best practices.</li></ul>
  • 2026-02-03T16:48:41Z
Data Engineer
  • Cincinnati, OH
  • remote
  • Temporary
  • 48.45 - 56.10 USD / Hourly
  • We are looking for a skilled Data Engineer to join our team on a long-term contract basis. This position offers the opportunity to work remotely while contributing to critical data management and integration efforts. The ideal candidate will have hands-on experience with customer master data in ECC6, and the ability to create, maintain, and manage data effectively.<br><br>Responsibilities:<br>• Develop and maintain customer master data within ECC6, ensuring data accuracy and consistency.<br>• Create new customer profiles and manage existing ones, maintaining high standards of data integrity.<br>• Support the integration process by working with custom tables related to customer data.<br>• Collaborate with cross-functional teams to ensure seamless data flow and effective data management.<br>• Utilize tools such as Apache Spark, Python, and ETL processes to extract, transform, and load data efficiently.<br>• Leverage Apache Hadoop for scalable data storage and processing solutions.<br>• Implement Apache Kafka to enable real-time data streaming and integration.<br>• Troubleshoot and resolve data-related issues, ensuring system reliability.<br>• Provide documentation and training to stakeholders on data management processes.<br>• Stay updated on industry best practices and emerging technologies to enhance data engineering workflows.
  • 2026-02-13T21:14:02Z
Data Engineer
  • the Woodlands, TX
  • onsite
  • Permanent
  • 120000.00 - 140000.00 USD / Yearly
  • We are looking for a skilled Data Engineer to design and implement robust technical solutions for enterprise applications. This role involves creating scalable and secure cloud-native systems on Azure, while collaborating closely with stakeholders to meet business requirements. The ideal candidate will possess strong expertise in data architecture and integration strategies, ensuring high engineering standards and seamless orchestration across systems.<br><br>Responsibilities:<br>• Design and maintain comprehensive technical architectures for enterprise applications, ensuring scalability and security.<br>• Develop integration strategies across multiple systems, including manufacturing, field service, and customer portals.<br>• Collaborate with the Principal Architect to define data contracts and establish effective integration patterns.<br>• Partner with teams in Product, AI/ML Engineering, and business units to translate requirements into functional solutions.<br>• Create reference implementations and frameworks to streamline development processes.<br>• Oversee system-level orchestration and elevate engineering standards across projects.<br>• Implement cloud-native solutions on Azure, leveraging modern tools and technologies.<br>• Provide technical guidance and mentorship to engineering teams, fostering best practices.<br>• Continuously monitor and improve system performance, addressing issues proactively.
  • 2026-01-26T21:53:40Z
Data Engineer
  • Memphis, TN
  • onsite
  • Permanent
  • 115000.00 - 130000.00 USD / Yearly
  • <p><strong>Data Pipeline Development</strong></p><ul><li>Design, build, and optimize scalable ETL/ELT pipelines to support analytics and operational workflows.</li><li>Ingest structured, semi-structured, and unstructured data from multiple internal and external sources.</li><li>Automate and orchestrate data workflows using tools like Airflow, Azure Data Factory, AWS Glue, or similar.</li></ul><p><strong>Data Architecture & Modeling</strong></p><ul><li>Develop and maintain data models, data marts, and data warehouses (relational, dimensional, and/or cloud-native).</li><li>Implement best practices for data partitioning, performance optimization, and storage management.</li><li>Work with BI developers, data scientists, and analysts to ensure datasets are structured to meet business needs.</li></ul><p><strong>Cloud Engineering & Storage</strong></p><ul><li>Build and maintain cloud data environments (Azure, AWS, GCP), including storage, compute, and security components.</li><li>Deploy and manage scalable data systems such as Snowflake, Databricks, BigQuery, Redshift, or Synapse.</li><li>Optimize cloud data cost, performance, and governance.</li></ul><p><strong>Data Quality & Reliability</strong></p><ul><li>Implement data validation, error handling, and monitoring to ensure accuracy, completeness, and reliability.</li><li>Troubleshoot pipeline failures, performance issues, and data discrepancies.</li><li>Maintain documentation and data lineage for transparency and auditability.</li></ul><p><strong>Collaboration & Cross‑Functional Support</strong></p><ul><li>Partner with product, engineering, and analytics teams to translate business requirements into technical solutions.</li><li>Support self-service analytics initiatives by preparing high-quality datasets and data products.</li><li>Provide technical guidance on data best practices and engineering standards.</li></ul><p><br></p><p><br></p>
  • 2026-02-10T18:41:25Z
Data Engineer
  • Boca Raton, FL
  • onsite
  • Temporary
  • - USD / Hourly
  • <p>The Database Engineer will design, develop, and maintain database solutions that meet the needs of our business and clients. You will be responsible for ensuring the performance, availability, and security of our database systems while collaborating with software engineers, data analysts, and IT teams.</p><p> </p><p><strong>Key Responsibilities:</strong></p><ul><li>Design, implement, and maintain highly available and scalable database systems (e.g., SQL, NoSQL).</li><li>Optimize database performance through indexing, query optimization, and capacity planning.</li><li>Create and manage database schemas, tables, stored procedures, and triggers.</li><li>Develop and maintain ETL (Extract, Transform, Load) processes for data integration.</li><li>Ensure data integrity and consistency across distributed systems.</li><li>Monitor database performance and troubleshoot issues to ensure minimal downtime.</li><li>Collaborate with software development teams to design database architectures that align with application requirements.</li><li>Implement data security best practices, including encryption, backups, and access controls.</li><li>Stay updated on emerging database technologies and recommend solutions to enhance efficiency.</li><li>Document database configurations, processes, and best practices for internal knowledge sharing.</li></ul><p><br></p>
  • 2026-02-16T20:43:43Z
Data Engineer
  • Washington, DC
  • remote
  • Temporary
  • 60.00 - 75.00 USD / Hourly
  • <p>Since it’s 2026, the Data Engineering landscape in DC has shifted heavily toward <strong>Cloud-Native architectures</strong> and <strong>GenAI-ready pipelines</strong>. Robert Half typically recruits for both their internal corporate teams and their high-end consulting arm (Protiviti).</p><p>Here is a tailored job description based on current 2026 market standards and Robert Half’s specific hiring trends in the District.</p><p><br></p><p>Job Title: Data Engineer</p><p><strong>Location:</strong> Washington, DC (Hybrid – Downtown DC Office)</p><p><strong>Company:</strong> Robert Half </p><p><strong>Employment Type: </strong>Contract-to-Hire</p><p>Role Overview</p><p>As a Data Engineer at Robert Half, you will be the backbone of our data-driven decision-making process. You aren't just "moving data"; you are architecting the flow of information that powers our localized market analytics and global recruitment engines. In the DC market, this often involves handling high-compliance data environments and integrating cutting-edge AI frameworks into traditional ETL workflows.</p><p><br></p><p><br></p>
  • 2026-02-16T15:58:41Z
Data Engineer
  • Peekskill, NY
  • remote
  • Permanent
  • 100000.00 - 151000.00 USD / Yearly
  • <p>Essential Duties and Responsibilities:</p><p> · Knowledge of database coding and tables; as well as general database management</p><p> · Understanding of client management, support, and communicating progress and timelines accordingly</p><p> · Organizes and/or leads Informatics projects in the implementation/use of new data warehouse tools and systems</p><p> · Ability to train new hires; as well as lead in training of new client staff members</p><p> · Understanding data schema and the analysis of database performance and accuracy</p><p> · Understanding of ETL tools, OLAP design, and data quality processes</p><p> · Knowledge of Business Intelligence life cycle: planning, design, development, validation, deployment, documentation, and ongoing support</p><p> · Working knowledge of electronic medical records software (eCW, Nextgen, etc) and the backend storage of that data</p><p> · Ability to generate effective probability modeling and statistics as it pertains to healthcare outcomes and financial risks</p><p> · Ability to manage sometimes lengthy and complicated projects from throughout the life cycle and meet the deadlines associated with these projects</p><p> · Development, maintenance, technical support of various reports and dashboards</p><p> · Knowledge of Microsoft® SQL including coding language, creation of tables, stored procedures, and query design</p><p> · Fundamental understanding of outpatient healthcare workflows</p><p> · Knowledge of relational database concepts and flat/formatted file processing.</p><p> · Possesses strong commitment to data validation processes in order to ensure accuracy of reporting (internal quality control)</p><p> · Possesses a firm grasp of patient confidentiality and system security practices to prevent HIPAA and other security violations.</p><p> · Knowledge of IBM Cognos® or other database reporting software such as SAS, SPSS, and Crystal Reports</p><p> · Ability to meet the needs of other members of the Informatics department to maximize efficiency and minimize complexity of end-user products</p><p><br></p><p>Requirements:</p><p> · Education: Bachelor's Degree</p><p> · Proven experience as a dbt Developer or in a similar Data Engineer role.</p><p> · Expert-level SQL skills — capable of writing, tuning, and debugging complex queries across large datasets.</p><p> · Strong experience with Snowflake or comparable data warehouse technologies (BigQuery, Redshift, etc.).</p><p> · Proficiency in Python for scripting, automation, or data manipulation.</p><p> · Solid understanding of data warehousing concepts, modeling, and ELT workflows.</p><p> · Familiarity with Git or other version control systems.</p><p> · Experience working with cloud-based platforms such as AWS, GCP, or Azure.</p><p><br></p><p><br></p>
  • 2026-01-27T22:53:41Z
Data Engineer
  • Baltimore, MD
  • remote
  • Temporary
  • 60.00 - 75.00 USD / Hourly
  • <p>As a Data Engineer at Robert Half, you will be the backbone of our data-driven decision-making process. You aren't just "moving data"; you are architecting the flow of information that powers our localized market analytics and global recruitment engines. In the DC market, this often involves handling high-compliance data environments and integrating cutting-edge AI frameworks into traditional ETL workflows.</p>
  • 2026-02-16T15:58:41Z
Senior Data Engineer
  • Denver, CO
  • onsite
  • Permanent
  • 160000.00 - 180000.00 USD / Yearly
  • <p>We are looking for an experienced Senior Data Engineer to join our team in Denver, Colorado. In this role, you will design and implement data solutions that drive business insights and operational efficiency. You will collaborate with cross-functional teams to manage data pipelines, optimize workflows, and ensure the integrity and security of data systems.</p><p><br></p><p>Responsibilities:</p><p>• Develop and maintain robust data pipelines to process and transform large datasets effectively.</p><p>• Advise on tools / technologies to implement. </p><p>• Collaborate with stakeholders to understand data requirements and translate them into technical solutions.</p><p>• Design and implement ETL processes to facilitate seamless data integration.</p><p>• Optimize data workflows and ensure system performance meets organizational needs.</p><p>• Work with Apache Spark, Hadoop, and Kafka to build scalable data systems.</p><p>• Create and maintain SQL queries for data extraction and analysis.</p><p>• Ensure data security and integrity by adhering to best practices.</p><p>• Troubleshoot and resolve issues in data systems to minimize downtime.</p><p>• Provide technical guidance and mentorship to less experienced team members.</p><p>• Stay updated on emerging technologies to enhance data engineering practices.</p>
  • 2026-01-24T00:08:39Z
Data Engineer
  • Jacksonville, FL
  • onsite
  • Temporary
  • - USD / Hourly
  • <p>We’re seeking a Data Engineer to build and maintain scalable data pipelines that power analytics, reporting, and machine learning across the organization. You’ll turn raw data into clean, reliable, and accessible datasets that drive business decisions.</p><p>What You’ll Do</p><ul><li>Design and maintain data warehouses and data lakes</li><li>Build ETL/ELT pipelines integrating data from multiple systems</li><li>Optimize performance for large-scale datasets</li><li>Ensure data quality, security, and governance</li><li>Collaborate with analysts and ML teams to create analytics-ready datasets</li><li>Automate workflows and monitoring</li></ul><p><br></p>
  • 2026-02-02T14:23:42Z
Data Engineer
  • Alpharetta, GA
  • onsite
  • Temporary
  • 56.00 - 58.00 USD / Hourly
  • <p>Position Overview</p><p>We are seeking a Data Engineer Engineer to support and enhance a Databricks‑based data platform during its development phase. This role is focused on building reliable, scalable data solutions early in the lifecycle—not production firefighting.</p><p>The ideal candidate brings hands‑on experience with Databricks, PySpark, Python, and a working understanding of Azure cloud services. You will partner closely with Data Engineering teams to ensure pipelines, notebooks, and workflows are designed for long‑term scalability and production readiness.</p><p><br></p><p>Key Responsibilities</p><ul><li>Develop and enhance Databricks notebooks, jobs, and workflows</li><li>Write and optimize PySpark and Python code for distributed data processing</li><li>Assist in designing scalable and reliable data pipelines</li><li>Apply Spark performance best practices: partitioning, caching, joins, file sizing</li><li>Work with Delta Lake tables, schemas, and data models</li><li>Perform data validation and quality checks during development cycles</li><li>Support cluster configuration, sizing, and tuning for development workloads</li><li>Identify performance bottlenecks early and recommend improvements</li><li>Partner with Data Engineers to prepare solutions for future production rollout</li><li>Document development standards, patterns, and best practices</li></ul>
  • 2026-01-23T20:58:35Z
Data Engineer
  • Houston, TX
  • onsite
  • Permanent
  • 150000.00 - 180000.00 USD / Yearly
  • Data Engineer,Data Engineer,,Data Engineer,Data Engineer,,,Data Engineer,Data En
  • 2026-01-30T16:53:42Z
Data Engineer
  • Oldwick, NJ
  • onsite
  • Permanent
  • 120000.00 - 135000.00 USD / Yearly
  • <p>The Data Engineer role focuses on designing, building, and optimizing scalable data solutions that support diverse business needs. This position requires the ability to work independently while collaborating effectively in a fast-paced, agile environment. The individual in this role partners with cross-functional teams to gather data requirements, recommend enhancements to existing data pipelines and architectures, and ensure the reliability, performance, and efficiency of data processes.</p><p>Responsibilities</p><ul><li>Support the team’s adoption and continued evolution of the Databricks platform, leveraging features such as Delta Live Tables, workflows, and related tooling</li><li>Design, develop, and maintain data pipelines that extract data from relational sources, load it into a data lake, transform it as needed, and publish it to a Databricks-based lakehouse environment</li><li>Optimize data pipelines and processing workflows to improve performance, scalability, and overall efficiency</li><li>Implement data quality checks and validation logic to ensure data accuracy, consistency, and completeness</li><li>Create and maintain documentation including data mappings, data definitions, architectural diagrams, and data flow diagrams</li><li>Develop proof-of-concepts to evaluate and validate new technologies, tools, or data processes</li><li>Deploy, manage, and support code across non-production and production environments</li><li>Investigate, troubleshoot, and resolve data-related issues, including identifying root causes and implementing fixes</li><li>Identify performance bottlenecks and recommend optimization strategies, including database tuning and query performance improvements</li></ul>
  • 2026-01-26T17:38:36Z
Data Engineer
  • Oldwick, NJ
  • onsite
  • Permanent
  • 120000.00 - 135000.00 USD / Yearly
  • <p>We are looking for a skilled Data Engineer to design and enhance scalable data solutions that meet diverse business objectives. This role involves collaborating with cross-functional teams to identify data requirements, improve existing pipelines, and ensure efficient data processing. The ideal candidate will bring expertise in server-side development, database management, and software deployment, working in a dynamic and fast-paced environment.</p><p><br></p><p>Responsibilities</p><ul><li>Enhance and optimize existing data storage platforms, including relational and NoSQL databases, to improve data accessibility, performance, and persistence</li><li>Apply advanced database techniques such as tuning, indexing, views, and stored procedures to support efficient and reliable data management</li><li>Develop server-side Python services utilizing concurrency patterns such as asynchronous programming and multi-threading, and leveraging libraries such as NumPy and Pandas</li><li>Design, build, and maintain APIs using modern frameworks, with experience across communication protocols including gRPC and socket-based implementations</li><li>Create, manage, and maintain CI/CD pipelines using DevOps and artifact management tools to enable efficient and reliable software delivery</li><li>Design and deploy applications in enterprise Linux environments, ensuring stability, performance, and scalability</li><li>Partner with cross-functional teams to gather requirements and deliver technical solutions aligned with business objectives</li><li>Follow software development lifecycle best practices to ensure high-quality, maintainable, and secure solutions</li><li>Work effectively in iterative, fast-paced development environments while consistently delivering high-quality outcomes on schedule</li></ul><p><br></p>
  • 2026-01-26T17:38:36Z
Data Engineer
  • Jacksonville, FL
  • remote
  • Permanent
  • 120000.00 - 130000.00 USD / Yearly
  • We are looking for an experienced Data Engineer to join our team in Jacksonville, Florida. In this role, you will take the lead in designing and building a cutting-edge Azure lakehouse platform that enables business leaders to access analytics through natural language queries. This position combines hands-on technical expertise with leadership responsibilities, offering an opportunity to mentor a team of skilled engineers while driving innovation.<br><br>Responsibilities:<br>• Architect and develop a robust Azure lakehouse platform, utilizing Azure Data Lake Gen2, Delta Lake, and PySpark to create efficient data pipelines.<br>• Implement a semantic layer and metric store to ensure consistent data translation and definitions across the organization.<br>• Design and maintain real-time and batch data pipelines, incorporating medallion architecture, schema evolution, and data contracts.<br>• Build retrieval systems for large language models (LLMs) using Azure OpenAI and vectorized Delta tables to support chat-based analytics.<br>• Ensure data quality, lineage, and observability through tools like Great Expectations and Unity Catalog, while optimizing costs through partitioning and compaction.<br>• Develop automated systems for anomaly detection and alerting using Azure ML pipelines and Event Grid.<br>• Collaborate with product and operations teams to translate complex business questions into actionable data models and queries.<br>• Lead and mentor a team of data and Python engineers, establishing best practices in CI/CD, code reviews, and documentation.<br>• Ensure compliance with security, privacy, and governance standards by designing and implementing robust data handling protocols.
  • 2026-01-21T15:13:50Z
Data Engineer
  • Philadelphia, PA
  • onsite
  • Temporary
  • - USD / Hourly
  • <p>Robert Half is hiring a highly skilled and innovative Intelligent Automation Engineer to design, develop, and deploy advanced automation solutions using Microsoft Power Automate, Python, and AI technologies. This role is ideal for a hands-on technologist passionate about streamlining business processes, integrating systems, and applying cutting-edge AI to drive intelligent decision-making. This role is a hybrid position based in Philadelphia. For consideration, please apply directly. </p><p><br></p><p>Key Responsibilities</p><ul><li>Design and implement end-to-end automation workflows using Microsoft Power Automate (Cloud & Desktop).</li><li>Develop Python scripts and APIs to support automation, system integration, and data pipeline management.</li><li>Integrate Power Automate with Azure services (Logic Apps, Functions, AI Services, App Insights) and enterprise platforms such as SharePoint, Dynamics 365, and Microsoft Teams.</li><li>Apply Generative AI, LLMs, and Conversational AI to enhance automation with intelligent, context-aware interactions.</li><li>Leverage Agentic AI frameworks (LangChain, AutoGen, CrewAI, OpenAI Function Calling) to build dynamic, adaptive automation solutions.</li></ul>
  • 2026-01-22T15:34:06Z
Data Engineer
  • Jacksonville, FL
  • remote
  • Contract / Temporary to Hire
  • - USD / Hourly
  • <p>Design and manage data pipelines, ensuring optimized performance for analytics and reporting. Support BI tools to provide actionable insights for decision-making.</p>
  • 2026-02-10T15:23:45Z
Data Engineer
  • Houston, TX
  • remote
  • Temporary
  • 59.00 - 62.00 USD / Hourly
  • <p>We are seeking a Data Governance & Data Quality Platform Engineer responsible for the technical administration, integration, and optimization of enterprise data governance and data quality tools such as Atlan and DQ Labs / Monte Carlo. This role ensures these platforms are scalable, secure, integrated across enterprise data ecosystems, and maintained for high availability and performance. The position also supports automation, data quality monitoring, and compliance reporting initiatives across the organization.</p><p><br></p><p>Key Responsibilities</p><p><br></p><p>1. Platform Engineering & Administration</p><ul><li>Configure and maintain Atlan for metadata management, lineage tracking, and governance workflows</li><li>Configure DQ Labs / data quality tools for data profiling, rule creation, and monitoring dashboards</li><li>Manage user roles, authentication, SSO, RBAC, and security settings across governance platforms</li></ul><p>2. Integration & Automation</p><ul><li>Develop and maintain integrations between data sources, databases, data lakes, and BI tools</li><li>Automate metadata ingestion and data quality checks using APIs, Python scripts, or ETL frameworks</li><li>Configure connectors for enterprise data and analytics platforms</li></ul><p>3. Performance, Scalability & Reliability</p><ul><li>Monitor system health and optimize performance across governance and data quality environments</li><li>Apply patches, updates, and troubleshoot technical issues as needed</li><li>Implement logging, alerting, and proactive monitoring across the platform ecosystem</li></ul><p>4. Technical Support & Issue Resolution</p><ul><li>Provide Tier 3 support for platform‑related issues</li><li>Debug integration failures and resolve configuration conflicts</li><li>Collaborate with vendors for advanced troubleshooting, feature requests, and roadmap alignment</li></ul><p>5. Security & Compliance</p><ul><li>Ensure platforms comply with security and data privacy standards (e.g., GDPR, CCPA)</li><li>Implement encryption, access controls, and audit logging</li><li>Support compliance reporting and risk assessments using platform governance features and data quality metrics</li></ul>
  • 2026-01-15T14:19:04Z
Data Engineer
  • Keller, TX
  • remote
  • Permanent
  • 145000.00 - 165000.00 USD / Yearly
  • <p>We are looking for a skilled Data Engineer to join a dynamic healthcare organization in the DFW area. In this role, you will play a pivotal part in transforming data operations by building foundational systems for predictive analytics and strategic insights. This position offers a unique opportunity to design and implement data solutions that directly impact clinical and financial decision-making processes.</p><p><br></p><p>Responsibilities:</p><p>• Develop and manage data pipelines and storage systems to ensure seamless reporting and data accessibility.</p><p>• Design forecasting models and predictive analytics to transform retrospective data into actionable insights.</p><p>• Create and maintain dashboards and visualizations that present clinical and financial performance metrics clearly and effectively.</p><p>• Collaborate with leadership to identify strategic metrics and deliver data-driven insights that influence organizational decisions.</p><p>• Act as the subject matter expert for data architecture and analytics, providing guidance and best practices.</p><p>• Implement and optimize ETL processes to streamline data integration and transformation.</p><p>• Utilize tools such as Apache Spark, Python, and Apache Hadoop to develop robust data solutions.</p><p>• Ensure data integrity and accuracy across all reporting and analytics platforms.</p><p>• Leverage BI platforms, with a preference for Power BI, to enhance data visualization and reporting.</p><p>• Monitor and troubleshoot data systems to maintain efficiency and performance.</p>
  • 2026-01-15T13:08:58Z
2