Search jobs now Find the right job type for you Explore how we help job seekers Contract talent Permanent talent Learn how we work with you Executive search Finance and Accounting Technology Marketing and Creative Legal Administrative and Customer Support Technology Risk, Audit and Compliance Finance and Accounting Digital, Marketing and Customer Experience Legal Operations Human Resources 2026 Salary Guide Demand for Skilled Talent Report Building Future-Forward Tech Teams Job Market Outlook Press Room Salary and hiring trends Adaptive working Competitive advantage Work/life balance Inclusion Browse jobs Find your next hire Our locations

265 results for Big Data Engineer jobs

Data Engineer
  • Woodland Hills, CA
  • onsite
  • Permanent
  • 140000.00 - 175000.00 USD / Yearly
  • <p><strong>Data Engineer (Hybrid, Los Angeles)</strong></p><p><strong>Location:</strong> Los Angeles, California</p><p><strong>Compensation:</strong> $140,000 - $175,000 per year</p><p><strong>Work Environment:</strong> Hybrid, with onsite requirements</p><p>Are you passionate about crafting highly-scalable and performant data systems? Do you have expertise in Azure Databricks, Spark SQL, and real-time data pipelines? We are searching for a talented and motivated <strong>Data Engineer</strong> to join our team in Los Angeles. You'll work in a hybrid environment that combines onsite collaboration with the flexibility of remote work.</p><p><strong>Key Responsibilities:</strong></p><ul><li>Design, develop, and implement data pipelines and ETL workflows using cutting-edge Azure technologies (e.g., Databricks, Synapse Analytics, Synapse Pipelines).</li><li>Manage and optimize big data processes, ensuring scalability, efficiency, and data accuracy.</li><li>Build and work with real-time data pipelines leveraging technologies such as Kafka, Event Hubs, and Spark Streaming.</li><li>Apply advanced skills in Python and Spark SQL to build data solutions for analytics and machine learning.</li><li>Collaborate with business analysts and stakeholders to implement impactful dashboards using Power BI.</li><li>Architect and support the seamless integration of diverse data sources into a central platform for analytics, reporting, and model serving via ML Flow.</li></ul><p><br></p>
  • 2025-12-01T18:29:06Z
Data Engineer
  • Atlanta, GA
  • remote
  • Temporary
  • 59.38 - 68.75 USD / Hourly
  • We are looking for a highly skilled Data Engineer to join our team on a contract basis in Atlanta, Georgia. This role focuses on optimizing data processes and infrastructure, ensuring efficient data management and performance. The ideal candidate will possess expertise in modern data engineering tools and technologies.<br><br>Responsibilities:<br>• Optimize data indexing and address fragmentation issues to enhance system performance.<br>• Develop and maintain data pipelines using ETL processes to ensure accurate data transformation and integration.<br>• Utilize Apache Spark for scalable data processing and analytics.<br>• Implement and manage big data solutions with Apache Hadoop.<br>• Design and deploy real-time data streaming frameworks using Apache Kafka.<br>• Collaborate with cross-functional teams to identify and resolve data-related challenges.<br>• Monitor and improve system performance by analyzing data usage and storage trends.<br>• Write efficient code in Python to support data engineering tasks.<br>• Document processes and maintain clear records of data workflows and optimizations.<br>• Ensure data security and compliance with organizational standards.
  • 2025-11-20T13:19:03Z
Data Engineer
  • Little Rock, AR
  • onsite
  • Permanent
  • 90000.00 - 115000.00 USD / Yearly
  • <p>We are seeking a skilled Data Engineer to join our team and help design, build, and maintain robust data pipelines and infrastructure. This role is critical for enabling data-driven decision-making across the organization. You will work closely with analysts, developers, and business stakeholders to ensure data is accurate, accessible, and secure.</p><p><br></p><p><strong>Key Responsibilities</strong></p><ul><li>Design, develop, and optimize scalable data pipelines and ETL processes.</li><li>Integrate data from multiple sources into centralized data platforms.</li><li>Implement and maintain data models, schemas, and storage solutions.</li><li>Ensure data quality, integrity, and compliance with security standards.</li><li>Collaborate with cross-functional teams to support analytics and reporting needs.</li><li>Monitor and troubleshoot data workflows for performance and reliability.</li></ul><p><br></p><p><br></p>
  • 2025-12-08T16:53:36Z
Data Engineer
  • Los Angeles, CA
  • onsite
  • Permanent
  • 100000.00 - 130000.00 USD / Yearly
  • We are looking for a skilled Data Engineer to join our team in Los Angeles, California. This role focuses on designing and implementing advanced data solutions to support innovative advertising technologies. The ideal candidate will have hands-on experience with large datasets, cloud platforms, and machine learning, and will play a critical role in shaping our data infrastructure.<br><br>Responsibilities:<br>• Develop and maintain robust data pipelines to ensure seamless data extraction, transformation, and loading processes.<br>• Design scalable architectures that support machine learning models and advanced analytics.<br>• Collaborate with cross-functional teams to deliver business intelligence tools, reporting solutions, and analytical dashboards.<br>• Implement real-time data streaming solutions using platforms like Apache Kafka and Apache Spark.<br>• Optimize database performance and ensure efficient data storage and retrieval.<br>• Build and manage resilient data science programs and personas to support AI initiatives.<br>• Lead and mentor a team of data scientists, machine learning engineers, and data architects.<br>• Design and implement strategies for maintaining large datasets, ensuring data integrity and accessibility.<br>• Create detailed technical documentation for workflows, processes, and system architecture.<br>• Stay up-to-date with emerging technologies to continuously improve data engineering practices.
  • 2025-12-05T21:08:37Z
Data Engineer
  • Spring Valley, CA
  • onsite
  • Permanent
  • 150000.00 - 175000.00 USD / Yearly
  • <p>Robert Half is currently partnering with a well-established company in San Diego that is looking for a Senior Data Engineer, experienced in BigQuery, DBT (Data Build Tool), and GCP. This position is full time (permanent placement) that is 100% onsite in San Diego. We are looking for a Principal Data Engineer that is passionate about optimizing systems with advanced techniques in partitioning, indexing, and Google Sequences for efficient data processing. Must have experience in DBT!</p><p>Responsibilities:</p><ul><li>Design and implement scalable, high-performance data solutions on GCP.</li><li>Develop data pipelines, data warehouses, and data lakes using GCP services (BigQuery, and DBT, etc.).</li><li>Build and maintain ETL/ELT pipelines to ingest, transform, and load data from various sources.</li><li>Ensure data quality, integrity, and security throughout the data lifecycle.</li><li>Design, develop, and implement a new version of a big data tool tailored to client requirements.</li><li>Leverage advanced expertise in DBT (Data Build Tool) and Google BigQuery to model and transform data pipelines.</li><li>Optimize systems with advanced techniques in partitioning, indexing, and Google Sequences for efficient data processing.</li><li>Collaborate cross-functionally with product and technical teams to align project deliverables with client goals.</li><li>Monitor, debug, and refine the performance of the big data tool throughout the development lifecycle.</li></ul><p><strong>Minimum Qualifications:</strong></p><ul><li>5+ years of experience in a data engineering role in GCP .</li><li>Proven experience in designing, building, and deploying data solutions on GCP.</li><li>Strong expertise in SQL, data warehouse design, and data pipeline development.</li><li>Understanding of cloud architecture principles and best practices.</li><li>Proven experience with DBT, BigQuery, and other big data tools.</li><li>Advanced knowledge of partitioning, indexing, and Google Sequences strategies.</li><li>Strong problem-solving skills with the ability to manage and troubleshoot complex systems.</li><li>Excellent written and verbal communication skills, including the ability to explain technical concepts to non-technical stakeholders.</li><li>Experience with Looker or other data visualization tools.</li></ul>
  • 2025-11-23T23:19:11Z
Data Engineer
  • Houston, TX
  • onsite
  • Temporary
  • 66.50 - 77.00 USD / Hourly
  • We are looking for a skilled Data Engineer to join our team in Houston, Texas. In this long-term contract role, you will design and implement data solutions, ensuring efficient data processing and management. The ideal candidate will have expertise in handling large-scale data systems and a passion for optimizing workflows.<br><br>Responsibilities:<br>• Develop and maintain scalable data pipelines using modern tools and frameworks.<br>• Implement data transformation processes to ensure efficient storage and retrieval.<br>• Collaborate with cross-functional teams to design and optimize data architecture.<br>• Utilize Apache Spark and Python to process and analyze large datasets.<br>• Manage and monitor data workflows, ensuring high performance and reliability.<br>• Integrate and maintain ETL processes to streamline data operations.<br>• Work with Apache Kafka and Hadoop to enhance system capabilities.<br>• Troubleshoot and resolve issues related to data systems and workflows.<br>• Ensure data security and compliance with industry standards.<br>• Document processes and provide technical support to stakeholders.
  • 2025-11-24T17:44:16Z
Data Engineer
  • Sugar Land, TX
  • remote
  • Temporary
  • 47.50 - 55.00 USD / Hourly
  • <p>We are looking for a skilled Data Engineer to join our team on a long-term contract basis in Houston, Texas. The ideal candidate will play a key role in designing, implementing, and maintaining data applications while ensuring alignment with organizational data standards. This position requires expertise in handling large-scale data processing and a collaborative approach to problem-solving.</p><p><br></p><p>Responsibilities:</p><p>• Collaborate with teams to design and implement applications utilizing both established and emerging technology platforms.</p><p>• Ensure all applications adhere to organizational data management standards.</p><p>• Develop and optimize queries, stored procedures, and reports using SQL Server to address user requests.</p><p>• Work closely with team members to monitor application performance and ensure quality.</p><p>• Communicate effectively with users and management to resolve issues and provide updates.</p><p>• Create and maintain technical documentation and application procedures.</p><p>• Ensure compliance with change management and security protocols.</p>
  • 2025-11-24T17:44:16Z
Data Engineer
  • Los Angeles, CA
  • onsite
  • Permanent
  • 100000.00 - 130000.00 USD / Yearly
  • <p>we are seeking a <strong>Data Engineer</strong> to join its growing data team in West LA. This role is perfect for someone early in their data engineering career who wants to work with modern data stacks, cloud technologies, and high-impact analytics projects in a collaborative, fast-paced environment.</p><p><br></p><p> <strong>Compensation:</strong> $100–130K + 5% bonus (flexible for strong candidates)</p><p><br></p><p><strong>About the Role</strong></p><p>In this position, you’ll support the full data lifecycle—from ingesting and transforming raw data to building pipelines, reporting tools, and analytics infrastructure that empower teams across the business. You’ll work with Python, SQL, cloud platforms, ETL solutions, and visualization tools, contributing to the evolution of next-generation data systems supporting large-scale digital operations.</p><p><br></p><p><strong>What You'll Do</strong></p><ul><li>Build, maintain, and optimize ETL/ELT pipelines using tools such as Talend, SSIS, or Informatica</li><li>Work hands-on with cloud platforms (any cloud; GCP preferred) to support data workflows</li><li>Develop reports and dashboards using visualization tools (Looker, Tableau, Power BI, etc.)</li><li>Collaborate with product, analytics, and engineering teams to deliver reliable datasets and insights</li><li>Own data issues end-to-end — from collection and extraction to cleaning and validation</li><li>Support data architecture, pipeline resilience, and performance tuning</li><li>Assist in maintaining and scaling datasets, data models, and analytics environments</li><li>Contribute to real-time streaming initiatives (a plus)</li></ul><p><br></p>
  • 2025-12-05T21:08:37Z
Data Engineer
  • Jacksonville, FL
  • onsite
  • Temporary
  • - USD / Hourly
  • <p>We’re looking for a <strong>Data Engineer</strong> to design, build, and maintain scalable data pipelines and platforms that support analytics, reporting, and data-driven decision-making. This role is ideal for someone who enjoys working with large datasets, modern cloud data stacks, and collaborating closely with analytics, BI, and application teams.</p><p><br></p><p><strong>What You’ll Do</strong></p><ul><li>Design, build, and maintain <strong>ETL/ELT pipelines</strong> for structured and semi-structured data</li><li>Develop and optimize <strong>data models</strong> for analytics and reporting use cases</li><li>Ingest data from multiple sources including APIs, databases, and third-party platforms</li><li>Ensure data quality, reliability, and performance across pipelines</li><li>Work with stakeholders to understand data requirements and translate them into scalable solutions</li><li>Monitor and troubleshoot pipeline failures and data inconsistencies</li><li>Implement data governance, security, and best practices</li><li>Document data flows, schemas, and operational processes</li></ul><p><br></p>
  • 2025-12-16T13:43:35Z
Senior Data Engineer (Python Expertise)
  • Houston, TX
  • onsite
  • Permanent
  • - USD / Yearly
  • <p><strong>About the Role: </strong>We’re seeking a <strong>Senior Data Engineer</strong> with deep expertise in <strong>Python</strong> to design and implement scalable data solutions for complex, high-volume environments. This role involves building robust data pipelines, optimizing workflows, and collaborating with analytics teams to deliver actionable insights.</p><p><br></p><p><strong>Key Responsibilities:</strong></p><ul><li>Develop and maintain advanced <strong>Python-based ETL pipelines</strong> for large-scale data processing.</li><li>Integrate data from multiple sources into secure, high-performance data platforms.</li><li>Collaborate with data scientists and business analysts to enable predictive analytics and reporting.</li><li>Implement best practices for data governance, security, and compliance.</li><li>Optimize data workflows for speed, reliability, and scalability.</li></ul><p><br></p>
  • 2025-12-10T16:14:51Z
Data Engineer
  • Cleveland, OH
  • remote
  • Temporary
  • - USD / Hourly
  • We are looking for a skilled Data Engineer to join our team in Cleveland, Ohio. This long-term contract position offers the opportunity to contribute to the development and optimization of data platforms, with a primary focus on Snowflake and Apache Airflow technologies. You will play a key role in ensuring efficient data management and processing to support critical business needs.<br><br>Responsibilities:<br>• Design, develop, and maintain data pipelines using Snowflake and Apache Airflow.<br>• Collaborate with cross-functional teams to implement scalable data solutions.<br>• Optimize data processing workflows to ensure high performance and reliability.<br>• Monitor and troubleshoot issues within the Snowflake data platform.<br>• Develop ETL processes to support data integration and transformation.<br>• Work with tools such as Apache Spark, Hadoop, and Kafka to manage large-scale data operations.<br>• Implement robust data warehousing strategies to support business intelligence initiatives.<br>• Analyze and resolve data-related technical challenges promptly.<br>• Provide support and guidance during Snowflake deployments across subsidiaries.<br>• Document processes and ensure best practices for data engineering are followed.
  • 2025-12-16T21:43:49Z
Data Engineer
  • Woodland Hills, CA
  • onsite
  • Permanent
  • 140000.00 - 170000.00 USD / Yearly
  • <p><strong>Data Engineer – CRM Integration (Hybrid in San Fernando Valley)</strong></p><p><strong>Location:</strong> San Fernando Valley (Hybrid – 3x per week onsite)</p><p><strong>Compensation:</strong> $140K–$170K annual base salary</p><p><strong>Job Type:</strong> Full Time, Permanent</p><p><strong>Overview:</strong></p><p>Join our growing technology team as a Data Engineer with a focus on CRM data integration. This permanent role will play a key part in supporting analytics and business intelligence across our organization. The position offers a collaborative hybrid environment and highly competitive compensation.</p><p><strong>Responsibilities:</strong></p><ul><li>Design, develop, and optimize data pipelines and workflows integrating multiple CRM systems (Salesforce, Dynamics, HubSpot, Netsuite, or similar).</li><li>Build and maintain scalable data architectures for analytics and reporting.</li><li>Manage and advance CRM data integrations, including real-time and batch processing solutions.</li><li>Deploy ML models, automate workflows, and support model serving using Azure Databricks (ML Flow experience preferred).</li><li>Utilize Azure Synapse Analytics & Pipelines for high-volume data management.</li><li>Write advanced Python and Spark SQL code for ETL, transformation, and analytics.</li><li>Collaborate with BI and analytics teams to deliver actionable insights using PowerBI.</li><li>Support streaming solutions with technologies like Kafka, Event Hubs, and Spark Streaming.</li></ul><p><br></p>
  • 2025-12-01T18:33:56Z
Data Engineer
  • Alpharetta, GA
  • onsite
  • Temporary
  • 80.00 - 90.00 USD / Hourly
  • <p><strong>Description of Position</strong></p><p> The Data Engineer builds and maintains data pipelines, integrations, and analytical datasets that support reporting, operations, and advanced analytics. This role focuses on data ingestion, transformation, and modeling across cloud and enterprise data platforms.</p><p>The position works closely with analytics, engineering, and business teams to ensure data accuracy, availability, and performance.</p>
  • 2025-12-18T19:50:12Z
Data Engineer
  • Calabasas, CA
  • onsite
  • Permanent
  • 120000.00 - 160000.00 USD / Yearly
  • <p><strong>Senior Data Engineer</strong></p><p><strong>Location:</strong> Calabasas, CA (Fully Remote if outside 50 miles)</p><p> <strong>Compensation:</strong> $140K–$160K </p><p> <strong>Reports to:</strong> Director of Data Engineering</p><p>Our entertainment client is seeking a <strong>Senior Data Engineer</strong> to design, build, and optimize enterprise data pipelines and cloud infrastructure. This hands-on role focuses on implementing scalable data architectures, developing automation, and driving modern data engineering best practices across the company.</p><p><br></p><p><strong>Key Responsibilities:</strong></p><ul><li>Design and maintain ELT/ETL pipelines in Snowflake, Databricks, and AWS.</li><li>Build and orchestrate workflows using Python, SQL, Airflow, and dbt.</li><li>Implement medallion/lakehouse architectures and event-driven pipelines.</li><li>Manage AWS services (Lambda, EC2, S3, Glue) and infrastructure-as-code (Terraform).</li><li>Optimize data performance, quality, and governance across systems.</li></ul><p>For immediate consideration, direct message Reid Gormly on Linkedin and Apply Now!</p>
  • 2025-12-19T23:04:24Z
Data Engineer
  • Encino, CA
  • onsite
  • Permanent
  • 130000.00 - 170000.00 USD / Yearly
  • <p><strong>Data Engineer (On-Site, West Los Angeles CA)</strong></p><p><br></p><p>We’re seeking an experienced <strong>Data Engineer</strong> to help modernize and centralize enterprise data architecture, enabling scalable analytics and AI applications. This on-site role collaborates closely with business and technology teams to unify data from platforms such as Microsoft Dynamics 365, Adobe Experience Platform, and Power BI—transforming fragmented data sources into a cohesive, AI-ready foundation.</p><p><br></p><p><strong>Key Responsibilities:</strong></p><ul><li>Design and implement a centralized, scalable data model using medallion/Lakehouse architecture.</li><li>Build and optimize data pipelines using Azure SQL DB, PostgreSQL, Microsoft Fabric, and Kafka.</li><li>Integrate and manage data from diverse systems including D365, Adobe Experience Platform, and API-based sources.</li><li>Ensure data quality, governance, and compliance across the lifecycle.</li><li>Develop reusable, production-ready data assets for analytics and AI/ML workloads.</li></ul><p><br></p><p>For immediate consideration, apply now and message Reid Gormly on LinkedIN today!</p>
  • 2025-12-15T23:04:39Z
Data Engineer
  • Roseville, MN
  • remote
  • Temporary
  • 30.00 - 50.00 USD / Hourly
  • We are looking for a skilled Data Engineer to join our team on a contract basis in Roseville, Minnesota. In this role, you will be responsible for designing and implementing efficient data pipelines, ensuring seamless data processing and integration to support organizational goals. The ideal candidate will have expertise in Python programming, AWS services, and data transformation techniques.<br><br>Responsibilities:<br>• Develop and maintain efficient data pipelines for extraction, transformation, and storage.<br>• Create and manage APIs to facilitate seamless data access and integration across systems.<br>• Utilize AWS tools such as Lambda and S3 to design and implement scalable solutions.<br>• Perform data cleansing and transformation to ensure accuracy and usability for analytics.<br>• Write Python scripts to automate data extraction and processing workflows.<br>• Collaborate with various teams to gather data requirements and deliver tailored solutions.<br>• Maintain data quality and ensure compliance with security standards and organizational policies.<br>• Optimize data processes for performance and scalability.<br>• Provide technical guidance and support for data-related projects.
  • 2025-12-17T13:44:17Z
Data Engineer
  • Watertown, MA
  • onsite
  • Permanent
  • 120000.00 - 170000.00 USD / Yearly
  • <p>We're seeking a Data Engineer to design, build, and optimize data pipelines supporting advanced analytics, AI, and machine learning initiatives for a client in Watertown, MA. This role combines technical expertise with collaboration across IT and business teams to deliver scalable, secure, and impactful data solutions. This role is onsite 4 days a week in Watertown. </p><p><strong>Responsibilities</strong></p><ul><li>Develop and manage data pipelines using Python, SQL Server, Snowflake, and Azure Data Factory.</li><li>Optimize T-SQL code and database structures for performance and reliability.</li><li>Integrate analytics and machine learning outputs into business workflows.</li><li>Ensure compliance with data governance and security standards.</li><li>Collaborate with stakeholders to refine requirements and deliver solutions.</li><li>Support BI tools such as Power BI, Tableau, and SQL Server BI stack.</li></ul><p><br></p>
  • 2025-12-02T13:13:35Z
Data Engineer
  • Raleigh, NC
  • onsite
  • Permanent
  • 110000.00 - 125000.00 USD / Yearly
  • We are looking for an experienced Data Engineer to join our team in Raleigh, North Carolina. In this position, you will play a pivotal role in designing, developing, and managing data solutions that support organizational decision-making. The ideal candidate will have a strong background in data engineering and a desire to grow into Data Architecture responsibilities.<br><br>Responsibilities:<br>• Design and implement data pipelines to extract sales data and integrate it into Snowflake using Snowpipe.<br>• Collaborate with executive leadership and vendors to ensure data solutions align with business objectives.<br>• Develop and maintain APIs to connect various systems and streamline data flow.<br>• Optimize data security and access controls within Snowflake, ensuring compliance with organizational standards.<br>• Participate in data modeling updates, focusing on improving principles, solutions, and methodologies.<br>• Work closely with a small team of data analysts, engineers, and managers to address diverse engineering challenges.<br>• Monitor and enhance data pipeline performance through testing, governance, and continuous delivery.<br>• Provide input on enterprise data architecture strategies, including logical, conceptual, and physical data models.
  • 2025-12-03T18:33:49Z
Data Engineer
  • Broomfield, CO
  • remote
  • Temporary
  • 43.54 - 50.41 USD / Hourly
  • We are looking for an experienced Data Engineer to join our team on a contract basis in Broomfield, Colorado. This position is focused on leveraging advanced tools and methodologies to optimize data workflows and systems within an apparel manufacturing environment. The ideal candidate will bring deep expertise in Astronomer, Airflow, and related technologies, ensuring efficient data orchestration and transformation processes.<br><br>Responsibilities:<br>• Optimize and deploy Astronomer workflows, ensuring best practices for storage, synchronization, and execution.<br>• Transfer data from Databricks into Astronomer and upgrade to the latest version of Astronomer.<br>• Design and implement decoupled architectures using Airflow to streamline transformation logic.<br>• Customize orchestration settings in Astronomer to enhance flow efficiency and scalability.<br>• Address challenges associated with Cosmos by managing complex DAGs and automating tasks where possible.<br>• Configure advanced Airflow settings to support seamless project execution and upgrades.<br>• Collaborate with cross-functional teams to ensure data workflows align with organizational objectives.<br>• Utilize Astronomer as a primary tool for orchestrating, deploying, and executing data pipelines.<br>• Provide expertise in Airflow 2 and prepare for future upgrades to Airflow 3.<br>• Troubleshoot and resolve issues within data workflows and systems in a timely manner.
  • 2025-12-08T16:14:10Z
Data Engineer
  • Jacksonville, FL
  • remote
  • Temporary
  • - USD / Hourly
  • <p>The Data Engineer will design, build, and maintain scalable data pipelines that support analytics and reporting needs. This role focuses on data ingestion, transformation, and cloud-based architecture.</p>
  • 2025-12-24T16:29:02Z
Sr. Data Engineer
  • Oldwick, NJ
  • onsite
  • Permanent
  • 140000.00 - 150000.00 USD / Yearly
  • <p>We are looking for an experienced Senior Data Engineer to join our team. This role involves designing and implementing scalable data solutions, optimizing data workflows, and driving innovation in data architecture. The ideal candidate will possess strong leadership qualities and a passion for problem-solving in a fast-paced, cutting-edge environment.</p><p><br></p><p>Responsibilities:</p><p>• Develop high-performance data systems, including databases, APIs, and data integration pipelines, to support scalable solutions.</p><p>• Design and implement metadata-driven architectures and automate deployment processes using infrastructure-as-code principles.</p><p>• Promote best practices in software engineering, such as code reviews, testing, and continuous integration/delivery (CI/CD).</p><p>• Establish and maintain a robust data governance framework to ensure compliance and data integrity.</p><p>• Monitor processes and implement improvements, including query optimization, code refactoring, and efficiency enhancements.</p><p>• Leverage cloud platforms, particularly Azure and Databricks, to improve system architecture and scalability.</p><p>• Conduct data quality checks and build procedures to address and resolve data issues effectively.</p><p>• Create and maintain documentation for data architecture, standards, and best practices.</p><p>• Provide technical leadership to the team, guiding design discussions and fostering innovation in data infrastructure.</p><p>• Identify and implement opportunities for process optimization and automation to improve operational efficiency.</p>
  • 2025-12-18T19:50:12Z
Data Engineer
  • Parsippany, NJ
  • onsite
  • Permanent
  • 120000.00 - 150000.00 USD / Yearly
  • We are looking for a skilled Data Engineer to design, develop, and maintain data systems that support critical business operations and analytics. This role requires collaboration with various teams to ensure data integrity, reliability, and scalability. You will play a pivotal role in optimizing data workflows and implementing robust solutions to meet organizational needs.<br><br>Responsibilities:<br>• Develop and maintain scalable data pipelines to integrate information from various sources.<br>• Create and manage data models, tables, and warehouses using platforms such as Redshift, BigQuery, or Snowflake.<br>• Implement automated workflows and data quality checks to guarantee accurate and consistent datasets.<br>• Collaborate with cross-functional teams to understand and address their data requirements.<br>• Enhance query efficiency by applying techniques such as indexing, partitioning, and dataset restructuring.<br>• Ensure adherence to best practices in data governance, security, and comprehensive documentation.<br>• Troubleshoot and resolve issues related to data pipelines and infrastructure.<br>• Incorporate tools like Airflow, dbt, or Kafka to streamline data processing and management.<br>• Support real-time data processing and streaming initiatives.<br>• Facilitate the integration of DevOps tools like Docker, Terraform, or CI/CD pipelines into data systems.
  • 2025-11-24T16:13:46Z
Data Engineer
  • Seguin, TX
  • onsite
  • Permanent
  • 105000.00 - 120000.00 USD / Yearly
  • We are looking for a skilled Data Engineer to join our team in Seguin, Texas. In this role, you will focus on designing, implementing, and optimizing data solutions that drive business decisions and innovation. Your expertise will be crucial in developing scalable systems, ensuring data quality, and collaborating with cross-functional teams to create impactful strategies.<br><br>Responsibilities:<br>• Develop and implement scalable data pipelines to integrate various sources into the organization’s data systems.<br>• Design and maintain data models and schemas across diverse environments, ensuring alignment with company standards.<br>• Simplify data architecture by creating reusable services and identifying cost-saving opportunities.<br>• Optimize data workflows for enhanced performance, reliability, and cost efficiency.<br>• Define and execute long-term technology strategies, incorporating innovations in analytics and data platforms.<br>• Ensure data quality by establishing and managing standards, guidelines, and processes.<br>• Perform database installation, configuration, and maintenance to support high-performance environments.<br>• Conduct proactive monitoring and optimization of database queries and indexes.<br>• Implement robust backup, recovery, and disaster recovery plans for database systems.<br>• Collaborate with stakeholders to translate business requirements into effective data models and solutions.
  • 2025-12-10T16:14:51Z
Data Engineer
  • Philadelphia, PA
  • onsite
  • Temporary
  • - USD / Hourly
  • <p>Robert Half is hiring a highly skilled and innovative Intelligent Automation Engineer to design, develop, and deploy advanced automation solutions using Microsoft Power Automate, Python, and AI technologies. This role is ideal for a hands-on technologist passionate about streamlining business processes, integrating systems, and applying cutting-edge AI to drive intelligent decision-making. This role is a hybrid position based in Philadelphia. For consideration, please apply directly. </p><p><br></p><p>Key Responsibilities</p><ul><li>Design and implement end-to-end automation workflows using Microsoft Power Automate (Cloud & Desktop).</li><li>Develop Python scripts and APIs to support automation, system integration, and data pipeline management.</li><li>Integrate Power Automate with Azure services (Logic Apps, Functions, AI Services, App Insights) and enterprise platforms such as SharePoint, Dynamics 365, and Microsoft Teams.</li><li>Apply Generative AI, LLMs, and Conversational AI to enhance automation with intelligent, context-aware interactions.</li><li>Leverage Agentic AI frameworks (LangChain, AutoGen, CrewAI, OpenAI Function Calling) to build dynamic, adaptive automation solutions.</li></ul>
  • 2025-12-11T15:04:52Z
Data Engineer
  • Johnson City, TX
  • onsite
  • Permanent
  • 100000.00 - 130000.00 USD / Yearly
  • We are looking for a skilled Data Engineer to join our team in Johnson City, Texas. In this role, you will design and optimize data solutions to enable seamless data transfer and management in Snowflake. You will work collaboratively with cross-functional teams to enhance data accessibility and support data-driven decision-making across the organization.<br><br>Responsibilities:<br>• Design, develop, and implement ETL solutions to facilitate data transfer between diverse sources and Snowflake.<br>• Optimize the performance of Snowflake databases by constructing efficient data structures and utilizing indexes.<br>• Develop and maintain automated, scalable data pipelines within the Snowflake environment.<br>• Deploy and configure monitoring tools to ensure optimal performance of the Snowflake platform.<br>• Collaborate with product managers and agile teams to refine requirements and deliver solutions.<br>• Create integrations to accommodate growing data volume and complexity.<br>• Enhance data models to improve accessibility for business intelligence tools.<br>• Implement systems to ensure data quality and availability for stakeholders.<br>• Write unit and integration tests while documenting technical work.<br>• Automate testing and deployment processes in Snowflake within Azure.
  • 2025-12-05T08:04:10Z
2