301 results for Big Data Engineer in Metrics

Data Engineer

Dallas, TX
onsite
Permanent
135000.00 - 160000.00 USD / Yearly
We are looking for a Senior Data Engineer to develop and optimize enterprise data systems that support analytics and digital solutions. In this role, you will design and implement robust data architectures, ensuring seamless data integration and transformation processes across the organization. Your expertise will drive the creation of reliable pipelines and scalable infrastructure, enabling advanced analytics and machine learning capabilities. Responsibilities: • Design and implement scalable data pipelines using Databricks, Spark, and Delta Lake to support enterprise-level analytics. • Develop and maintain efficient data models tailored for AI, analytics, and operational systems. • Lead Master Data Management initiatives to establish unified and accurate data records across platforms. • Create batch and near-real-time data processing workflows for structured and semi-structured datasets. • Collaborate with AI and software development teams to ensure delivery of high-quality datasets for machine learning. • Define and enforce data architecture standards, ensuring scalability, reliability, and governance. • Troubleshoot and optimize data systems to maintain performance and reliability in complex environments. • Partner with cloud and IT teams to integrate modern data platforms and ensure seamless functionality.
2026-03-11T17:04:01Z

Senior Data Engineer

Woodbury, MN
onsite
Permanent
140000.00 - 155000.00 USD / Yearly
We are looking for an experienced Senior Data Engineer to join our team in Woodbury, Minnesota. In this role, you will play a key part in designing and optimizing data systems, ensuring scalability and reliability for business-critical operations. The ideal candidate will have a strong background in data engineering and a passion for leveraging technology to drive impactful solutions. Responsibilities: • Redesign and optimize complex business logic embedded in Postgres functions to improve functionality. • Develop scalable database schemas and create data models that are optimized for analytics and AI applications. • Implement database partitioning, indexing, and performance tuning to ensure data growth is supported efficiently. • Build and maintain production-grade data pipelines from data ingestion to end-user consumption. • Establish robust processes for data quality assurance, monitoring, and operational reliability within pipelines. • Troubleshoot and resolve data-related and performance issues directly in production environments. • Collaborate with cross-functional teams to ensure seamless integration of data systems into business processes.
2026-03-11T14:58:42Z

Senior Data Engineer

Edgewood, NY
onsite
Permanent
110000.00 - 140000.00 USD / Yearly
We are looking for a highly skilled Senior Data Engineer to join our team in Edgewood, New York. This role is ideal for someone who is detail oriented and has expertise in developing scalable data pipelines, modeling data structures, and optimizing data infrastructure for performance and reliability. The right candidate will play a key role in shaping our data engineering function and collaborating with cross-functional teams to deliver impactful solutions. Responsibilities: • Design and maintain efficient and scalable data pipelines to support various operational and commercial systems. • Develop and manage modern data warehouse infrastructure using tools such as BigQuery and dbt. • Integrate, transform, and organize data from multiple sources into structured, queryable formats. • Create and manage logical and physical data models to enhance analytics and reporting capabilities. • Collaborate with stakeholders to enable self-service reporting and build dashboards using platforms like Looker and Looker Studio. • Implement best practices for data engineering, including testing, monitoring, and ensuring pipeline reliability. • Optimize the performance, scalability, and cost-efficiency of data pipelines and warehouses. • Partner with engineering, operations, and business teams to translate data needs into scalable solutions. • Contribute to the improvement of engineering processes, coding standards, and documentation. • Mentor team members and support onboarding as the team grows.
2026-02-26T15:38:45Z

Data Engineer

Newtown Square, PA
remote
Temporary
- USD / Hourly
We are looking for an experienced Data Engineer to join our team in Newtown Square, Pennsylvania. In this long-term contract position, you will play a pivotal role in designing and implementing robust data solutions to support organizational goals. This is an exciting opportunity to lead the development of modern data architectures and collaborate with diverse teams to drive impactful results. Responsibilities: • Lead the implementation of an enterprise Snowflake data lake, ensuring timely delivery and optimal performance. • Oversee the integration of multiple data sources, including Oracle Financials, PostgreSQL, and Salesforce, into a unified data platform. • Collaborate with finance teams to facilitate a transition to a 12-month accounting calendar and support accelerated financial close processes. • Develop and maintain multi-source analytics dashboards to enhance operational insights and decision-making. • Manage day-to-day operations of the Snowflake platform, focusing on performance tuning and cost optimization. • Ensure data quality and reliability, providing business users with a trustworthy platform. • Document architectural designs, data workflows, and operational procedures to support sustainable data management. • Coordinate with external vendors to meet project deadlines and ensure successful implementations.
2026-03-26T13:08:42Z

Data Engineer

Houston, TX
onsite
Contract / Temporary to Hire
79.16 - 91.66 USD / Hourly
We are looking for a highly skilled Data Engineer to join our team in Houston, Texas. This Contract to permanent position offers an exciting opportunity to work on cutting-edge data solutions and collaborate with cross-functional teams to deliver impactful results. The ideal candidate will possess strong technical expertise and a passion for creating efficient and scalable data systems. Responsibilities: • Design and implement scalable data architectures to support business needs and analytics requirements. • Develop and optimize ETL pipelines for data extraction, transformation, and loading across diverse data sources. • Collaborate with stakeholders to gather requirements and translate them into technical solutions. • Utilize tools such as Apache Spark, Hadoop, and Kafka to manage large-scale data processing and real-time streaming. • Ensure data quality and security by implementing best practices and conducting thorough testing. • Develop and maintain technical documentation related to system design, development processes, and operational workflows. • Work with Agile teams to deliver solutions efficiently while actively participating in sprints and ceremonies. • Troubleshoot and resolve issues in existing data systems to maintain optimal performance. • Provide guidance and conduct code reviews for entry level team members. • Stay updated on emerging technologies and recommend improvements to enhance data engineering practices.
2026-03-19T13:48:43Z

Sr. Python Data Engineer

Boston, MA
remote
Permanent
160000.00 - 180000.00 USD / Yearly
Data Engineer (Python / AWS)Location: Remote (Northeast / Greater Boston area preferred)Type: Full-TimeLevel: Mid-to-Senior Individual ContributorAbout the RoleWe are looking for a strong individual contributor who excels in the Python data ecosystem and enjoys building reliable, scalable data pipelines. This role sits within a data engineering group responsible for integrating large volumes of data from external partners and transforming it into usable datasets for internal teams. You’ll work with modern cloud tools while also helping our team gradually transition away from a legacy platform.This position is ideal for someone who wants to stay hands-on, focus on technical execution, and remain in an IC role for the next several years. We’re not looking for someone who is aiming to move immediately into architecture or leadership.This team is fully distributed, and although candidates in the Boston area can go into the office, the rest of the group is remote. Anyone local may occasionally sit with other teams when on site. What You’ll Do<ul><li>Build and maintain ETL pipelines that ingest, clean, and aggregate data received from external vendors and large enterprise partners.</li><li>Develop Python‑based data processing workflows deployed on AWS cloud services.</li><li>Work with tools such as AWS Glue, Airflow, dbt, and PySpark to support data transformations and pipeline orchestration.</li><li>Help modernize existing workflows and assist in the gradual migration away from a legacy data system.</li><li>Collaborate with internal stakeholders to understand data needs, define requirements, and ensure reliable integration of partner data feeds.</li><li>Troubleshoot pipeline issues, optimize performance, and improve overall system stability.</li><li>Contribute to best practices around code quality, testing, documentation, and data governance.</li></ul>
2026-03-10T19:18:46Z

Data Engineer

Grand Rapids, MI
onsite
Permanent
110000.00 - 140000.00 USD / Yearly
We are looking for a talented Data Engineer to join our team in Grand Rapids, Michigan. In this role, you will focus on designing, building, and optimizing robust data solutions using Snowflake and other cloud-based technologies. You will work closely with business intelligence and analytics teams to deliver scalable, high-performance data pipelines that support organizational goals. Responsibilities: • Design and implement scalable data models, schemas, and tables within Snowflake, including staging, integration, and presentation layers. • Develop and optimize data pipelines using Snowflake tools such as Snowpipe, Streams, Tasks, and stored procedures. • Ensure data security and access through role-based controls and best practices for data sharing. • Build and maintain ETL pipelines leveraging tools like dbt, Matillion, Fivetran, Informatica, or Azure-native solutions. • Integrate data from diverse sources such as APIs, IoT devices, and NoSQL databases to create unified datasets. • Enhance performance by utilizing clustering, partitioning, caching, and efficient warehouse sizing strategies. • Collaborate with cloud technologies such as AWS, Azure, or Google Cloud to support Snowflake infrastructure and operations. • Implement automated workflows and CI/CD processes for seamless deployment of data solutions. • Maintain high standards for data accuracy, completeness, and reliability while supporting governance and documentation. • Work closely with analytics, reporting, and business teams to troubleshoot issues and deliver scalable solutions.
2026-03-03T14:48:42Z

Data Engineer IV

Philadelphia, PA
onsite
Temporary
55.00 - 65.00 USD / Hourly
Senior Data EngineerLocation: Philadelphia, PA (Hybrid/Onsite as required)Employment Type: 39 Week Contract, Potential for ExtensionProject Focus: Salesforce → Databricks Data MigrationAbout the RoleWe are seeking a Senior Data Engineer to support a major Salesforce data migration initiative. This role is centered around building, optimizing, and maintaining high‑quality data pipelines that feed into Databricks, with a strong emphasis on Spark/PySpark and Python-based ETL development. The engineer will work closely with a senior team member, participate in Agile ceremonies, and contribute to the development of a core CRM data platform.Key ResponsibilitiesData Engineering & Development<ul><li>Develop ETL jobs and data pipelines that migrate and integrate data between Salesforce, AWS, and Databricks.</li><li>Build, test, and maintain scalable data pipelines on AWS + Databricks environments.</li><li>Use Python as a primary language for data engineering tasks and ETL job creation.</li><li>Utilize Spark and PySpark for all high‑volume processing and transformation work (must‑have).</li><li>Support integration and pipeline development, including Mulesoft-related components.</li><li>Conduct documentation, testing, QA, and post‑delivery support for all data engineering outputs.</li><li>Identify and mitigate risks, including eliminating single points of failure (SPOFs).</li></ul>Infrastructure & DevOps Collaboration<ul><li>Use Terraform for infrastructure provisioning and environment management.</li><li>Set up and manage CI/CD pipelines using Concourse or GitHub Actions to ensure consistent and reliable deployments.</li><li>Troubleshoot pipeline issues, resolve defects efficiently, and maintain reliable operations.</li></ul>Cross-Team Collaboration<ul><li>Partner with engineering, architecture, and technical product teams to translate requirements into scalable data solutions.</li><li>Contribute to best practices, knowledge-sharing, and continuous improvement across the engineering organization.</li><li>Participate in weekly Scrum ceremonies and collaborate in an Agile environment.</li></ul>
2026-03-26T15:58:41Z

Data Engineer

Jacksonville, FL
onsite
Temporary
- USD / Hourly
OverviewWe are looking for a Data Engineer to design, build, and maintain data solutions that enable reporting, analytics, and informed decision‑making.Responsibilities<ul><li>Design and maintain data pipelines and data models</li><li>Extract, transform, and load (ETL) data from multiple sources</li><li>Develop dashboards, reports, and analytics for business users</li><li>Ensure data accuracy, integrity, and governance</li><li>Collaborate with stakeholders to understand reporting needs</li></ul>
2026-03-18T21:48:44Z

Data Engineer

Denton, TX
onsite
Permanent
100000.00 - 120000.00 USD / Yearly
Our client is looking for an experienced Data Governance Analyst to join their growing team. They need someone who can: Lead the development and implementation of data governance frameworks to support academic, administrative, and research data needs across the university system. Establish data stewardship roles and clarify data ownership for key institutional domains such as student information, financial aid, HR, research compliance, and finance. Create and enforce data policies, standards, and procedures to improve data quality, accuracy, accessibility, and security across campuses and departments. Ensure compliance with higher-ed regulatory and reporting requirements (e.g., FERPA, IPEDS, NCAA, state reporting), and coordinate with Legal, IT Security, and Institutional Compliance teams. Implement and optimize governance technology (data catalog, lineage, and quality tools) to support system-wide reporting, analytics, and decision support. Promote data literacy and provide training to faculty, staff, and administrators to enhance responsible and effective data use. Facilitate collaboration across academic units, administrative offices, and central IT to align governance efforts with institutional priorities and operational needs. Monitor data quality and governance KPIs, report progress to leadership, and drive continuous improvement to support strategic planning, accreditation, and institutional research initiatives. Expereince as a Data Governance analyst. They have a fragmented Data Governance framework in place, and the goal is for this person to unify it across the enterprise. The ideal candidate will be a data Governance Analyst looking for a more challenging opportunity to lead the implementation of Purview and advancing our data governance practices. Administration experience with Microsoft Purview or a similar tool like Collibra, Informatica, Databricks, Etc. This role will be assisting to connect Microsoft Fabric to Purview. Experience with Microsoft Purview is preferred. They have the Data Security layer of Purview implemented. This role will be working with the Microsoft partner implement the Data Governance layer (Unified Data Catalogue, Data Quality, Data Lineage, Data Health management.) See attached overview. Excellent communication skills. Someone who will lead change and help advance their DG practice. Get buy in from stakeholders.
2026-03-17T17:48:44Z

Data Engineer

Columbus, OH
onsite
Temporary
45.00 - 55.00 USD / Hourly
We are looking for an experienced Senior Data Engineer to join our team on a contract basis in Columbus, Ohio. In this role, you will take the lead in designing, building, and optimizing data pipelines to support enterprise-wide data initiatives. You will collaborate with cross-functional teams, ensuring that data solutions are aligned with business needs while maintaining high standards of data quality and consistency. This position offers an excellent opportunity to mentor team members and contribute as a technical leader while driving innovation in data engineering. Responsibilities:• Design, develop, and maintain scalable data pipelines to support data-driven decision-making across the organization.• Collaborate with data scientists and business analysts to refine data requirements and ensure seamless integration for analytics initiatives.• Implement automation in data integration processes to enhance efficiency and scalability.• Train team members and other stakeholders in data preparation techniques to improve data accessibility and usability.• Ensure data quality by testing for accuracy, consistency, and compliance with business rules.• Partner with data governance teams to promote curated data content for reuse and standardization.• Provide leadership and mentorship to team members, fostering growth and collaboration within the team.• Analyze emerging technologies and assess their potential impact on data engineering processes.• Work closely with stakeholders to understand business needs and deliver tailored data solutions.• Demonstrate attention to detail while building strong relationships across departments.
2026-04-01T16:18:48Z

Data Architect

Green Bay, WI
onsite
Permanent
140000.00 - 170000.00 USD / Yearly
Robert Half is seeking an experienced Data Architect to design and lead scalable, secure, and high-performing enterprise data solutions. This role will focus on building next-generation cloud data platforms, driving adoption of modern analytics technologies, and ensuring alignment with governance and security standards. You’ll serve as a hands-on technical leader, partnering closely with engineering, analytics, and business teams to architect data platforms that enable advanced analytics and AI/ML initiatives. This position blends deep technical expertise with strategic thinking to help unlock the value of data across the organization. Key Responsibilities:<ul><li>Design and implement end-to-end data architecture for big data and advanced analytics platforms.</li><li>Architect and build Delta Lake–based lakehouse environments from the ground up, including DLT pipelines, PySpark jobs, workflows, Unity Catalog, and Medallion architecture.</li><li>Develop scalable data models that meet performance, security, and governance requirements.</li><li>Configure and optimize clusters, notebooks, and workflows to support ETL/ELT pipelines.</li><li>Integrate cloud data platforms with supporting services such as data storage, orchestration, secrets management, and analytics tools.</li><li>Establish and enforce best practices for data governance, security, and cost optimization.</li><li>Collaborate with data engineers, analysts, and stakeholders to translate business requirements into technical solutions.</li><li>Provide technical leadership and mentorship to team members.</li><li>Monitor, troubleshoot, and optimize data pipelines to ensure reliability and efficiency.</li><li>Ensure compliance with organizational and regulatory standards related to data privacy and security.</li><li>Create and maintain documentation for architecture, processes, and governance standards.</li></ul>
2026-03-27T01:18:41Z

Data Engineer

Greenville, SC
onsite
Permanent
- USD / Yearly
Robert Half is hiring! We are looking for an experienced Data Engineer to join our team in Greenville, South Carolina. This role offers an exciting opportunity to work with modern data technologies, ensuring the efficient operation and optimization of data pipelines and systems. The ideal candidate will bring a strong technical background, leadership skills, and a proactive approach to maintaining and improving data infrastructure. Responsibilities:• Oversee daily data loads and ensure the smooth operation of data pipelines and related systems.• Troubleshoot and resolve issues such as pipeline failures, performance bottlenecks, schema mismatches, and cloud resource disruptions.• Conduct root-cause analyses and implement permanent solutions to prevent recurring issues.• Maintain and optimize existing data processes, refactoring or retiring outdated workflows as necessary.• Design and build scalable data ingestion pipelines using technologies such as Azure Data Factory, Databricks, and Synapse Pipelines.• Collaborate with teams to create and improve operational runbooks, monitoring dashboards, and incident response workflows.• Develop reusable ingestion patterns for platforms like Guidewire DataHub, InfoCenter, and other business data sources.• Lead the implementation of real-time and event-driven data engineering solutions to enable operational insights and automation.• Partner with architects to modernize data workloads using advanced frameworks like Delta Lake and Medallion Architecture.• Mentor entry-level engineers, enforce coding best practices, and review code to ensure quality and compliance.
2026-03-11T12:23:45Z

Data Engineer

Houston, TX
onsite
Contract / Temporary to Hire
- USD / Hourly
We are looking for a skilled Data Engineer to join our team in Houston, Texas. In this Contract to permanent position, you will play a key role in designing, developing, and optimizing data solutions while collaborating with cross-functional teams to deliver impactful results. This role offers an excellent opportunity to contribute to innovative projects and mentor other developers. Responsibilities: • Design and implement scalable data solutions using tools such as Apache Spark, Hadoop, and Kafka. • Build and maintain efficient ETL processes to ensure seamless data transformation and integration. • Collaborate with product owners, business analysts, and stakeholders to gather requirements and translate them into technical solutions. • Optimize and troubleshoot complex data workflows to enhance performance and reliability. • Lead technical discussions and provide architectural guidance for best practices and development standards. • Mentor entry level developers and conduct code reviews to ensure high-quality deliverables. • Integrate data solutions with existing systems and third-party tools using APIs and cloud platforms. • Stay updated with the latest data engineering technologies and proactively recommend improvements. • Work within Agile/Scrum teams to deliver solutions aligned with user stories and project goals. • Ensure compliance with security and quality standards through thorough documentation and testing.
2026-04-01T00:04:36Z

Senior Data Engineer - Python

West Des Moines, IA
remote
Temporary
- USD / Hourly
We are looking for an experienced Senior Data Engineer with a strong background in Python and modern data engineering tools to join our team in West Des Moines, Iowa. This is a long-term contract position that requires expertise in designing, building, and optimizing data pipelines and working with cloud-based data warehouses. If you thrive in a collaborative environment and have a passion for transforming raw data into actionable insights, we encourage you to apply. Responsibilities: • Develop, debug, and optimize Python-based data pipelines using frameworks such as Flask, Django, or FastAPI. • Design and implement data transformations in a data warehouse using tools like dbt, ensuring high-quality analytics-ready datasets. • Utilize Amazon Redshift and Snowflake for managing large-scale data storage and performing advanced querying and optimization. • Automate data integration processes using platforms like Fivetran and orchestration tools such as Prefect or Airflow. • Build reusable and maintainable data models to improve performance and scalability for analytics and reporting. • Conduct data analysis and visualization leveraging Python libraries such as NumPy, Pandas, TensorFlow, and PyTorch. • Manage version control for data engineering projects using Git and GitHub. • Ensure data quality through automated testing and validation processes. • Document workflows, code, and data transformations following best practices for readability and maintainability. • Optimize cloud-based data warehouse and lake platforms for performance and integration of new data sources.
2026-03-06T14:58:40Z

Data Engineer

Columbus, OH
onsite
Temporary
38.00 - 44.00 USD / Hourly
We are looking for an experienced Data Engineer to join our team on a contract basis in Columbus, Ohio. In this role, you will take on a leadership position, driving the development and optimization of data pipelines that support enterprise-wide analytics and decision-making. You will also play a key role in mentoring team members, fostering collaboration, and ensuring the integrity and quality of data across various business functions. Responsibilities:• Design, develop, and maintain efficient data pipelines to support enterprise analytics and reporting.• Collaborate with business analysts and data science teams to refine data requirements and ensure alignment with organizational goals.• Enhance and automate data integration and management processes to improve operational efficiency.• Lead efforts to ensure data quality by testing for accuracy, consistency, and conformity to business rules.• Provide training and guidance to team members and other stakeholders on data pipelining and preparation techniques.• Partner with data governance teams to promote vetted content into the curated data catalog for reuse.• Stay updated on emerging technologies and assess their impact on current systems and processes.• Offer leadership, coaching, and mentorship to team members, encouraging attention to detail in their development.• Work closely with stakeholders to understand business needs and ensure solutions meet those requirements.• Perform additional duties as assigned to support organizational objectives.
2026-03-23T21:38:44Z

Data Engineer

Washington, DC
remote
Temporary
40.00 - 59.50 USD / Hourly
Data Modeling and Analysis<ul><li>Design data models and optimize performance: Creating the structure of data relationships ensuring efficient data retrieval and calculations.</li><li>Create calculated columns and measures: Using DAX to calculate derived values and aggregate metrics.</li><li>Perform exploratory data analysis (EDA): Using BI tools to explore data, identify trends, and patterns.</li><li>Apply advanced data analysis techniques (e.g., statistical analysis, time series analysis, predictive modeling).</li><li>Integrate machine learning models into Power BI dashboards.</li><li>Experience building semantic models</li></ul>Dashboard Development and Visualization<ul><li>Designing dashboards: Creating visually appealing and interactive dashboards.</li><li>Creating visualizations: Using charts, graphs, and other visual elements to represent data.</li><li>Implementing interactivity: Adding filters, slicers, and drill-down capabilities.</li><li>Expertise in SQL and DAX and knowledge of Python, R.</li><li>Strong proficiency in Power BI.</li><li>Data modeling and visualization skills.</li><li>Strong problem-solving skills to address technical challenges and data quality issues.</li><li>Analytical skills with capacity to analyze complex data problems and draw meaningful insights.</li></ul>
2026-03-18T21:48:44Z

Senior / Lead Database Engineer

Radnor, PA
onsite
Permanent
140000.00 - 150000.00 USD / Yearly
The Opportunity: Be part of a dynamic team that designs, develops, and optimizes data solutions supporting enterprise-level products across diverse industries. This role provides a clear track to higher-level positions, including Lead Data Engineer and Data Architect, for those who demonstrate vision, initiative, and impact. Key Responsibilities: Design, develop, and optimize relational database objects and data models using Microsoft SQL Server and Snowflake. Build and maintain scalable ETL/ELT pipelines for batch and streaming data using SSIS and cloud-native solutions. Integrate and utilize Redis for caching, session management, and real-time analytics. Develop and maintain data visualizations and reporting solutions using Sigma Computing, SSRS, and other BI tools. Collaborate across engineering, analytics, and product teams to deliver impactful data solutions. Ensure data security, governance, and compliance across all platforms. Participate in Agile Scrum ceremonies and contribute to continuous improvement within the data engineering process. Support database deployments using DevOps practices, including version control (Git) and CI/CD pipelines (Azure DevOps, Flyway, Octopus, SonarQube). Troubleshoot and resolve performance, reliability, and scalability issues across the data platform. Mentor entry level team members and participate in design/code reviews.
2026-03-05T20:23:48Z

AWS Data Engineer

Atlanta, GA
remote
Temporary
50.00 - 55.00 USD / Hourly
Position Summary:<ul><li>We are looking for a Data Operations Engineer to support and oversee the automated data‑pipeline environment built on AWS. This position bridges data engineering and customer operations, ensuring that incoming datasets are processed accurately, consistently, and securely within established ingestion and transformation frameworks.</li><li>Key responsibilities include monitoring automated workflows, troubleshooting processing failures, validating data quality, and helping onboard new customers by aligning their data formats to a standardized internal model.</li><li>The role requires strong proficiency in SQL and Python, practical experience with AWS services, and the ability to communicate effectively with external customers when data issues arise.</li></ul>Responsibilities:Data Pipeline Monitoring & Operations:<ul><li>Monitor automated batch and streaming data pipelines in AWS</li><li>Identify, troubleshoot, and resolve data processing failures</li><li>Investigate file‑level errors, schema mismatches, and transformation issues</li><li>Perform root‑cause analysis and document resolutions</li><li>Ensure data integrity, completeness, and timeliness across environments</li><li>Escalate architectural or systemic issues to the Data Engineering team</li></ul>Customer Data Onboarding & Implementation:<ul><li>Collaborate directly with customers to understand their file formats and data structures</li><li>Create and maintain mapping templates to align customer data to a normalized data model</li><li>Validate sample files and run tests on ingestion workflows</li><li>Configure ingestion parameters within predefined frameworks</li><li>Support customer go‑live processes and initial data processing cycles</li></ul>Data Quality & Continuous Improvement:<ul><li>Write SQL queries to validate data accuracy and research anomalies</li><li>Develop lightweight Python scripts for validation, transformation checks, or automation tasks</li><li>Improve monitoring processes, internal documentation, and operational playbooks</li><li>Work with engineering teams to strengthen platform reliability and observability</li></ul>Customer & Cross‑Functional Collaboration:<ul><li>Communicate clearly with customers regarding file issues or data discrepancies</li><li>Partner with internal teams including Data Engineering, Product, and Support</li><li>Provide feedback to enhance scalability, resilience, and overall platform performance</li></ul>
2026-03-27T16:04:24Z

Senior Database Engineer

Salt Lake City, UT
remote
Contract / Temporary to Hire
65.00 - 73.00 USD / Hourly
We are looking for a Senior Database Engineer to provide expert technical leadership for our global, cloud-based data infrastructure. This role involves designing, operating, and optimizing scalable, secure, and resilient database systems to support enterprise-scale workloads across AWS and Azure. As this is a Contract position with the possibility of becoming permanent, it offers an excellent opportunity to contribute to the development of cutting-edge database solutions while collaborating with cross-functional teams. Responsibilities: • Design and manage multi-region database architectures across AWS and Azure to support geo-distributed workloads. • Architect and maintain relational, NoSQL, and document databases such as Snowflake, PostgreSQL, DynamoDB, Cosmos DB, and MongoDB. • Lead hands-on database migrations between cloud platforms and legacy systems with a focus on scalability and reliability. • Implement indexing strategies, optimize queries, and establish scaling patterns for handling large datasets and real-time applications. • Enhance database performance to ensure high availability, low latency, and cost efficiency at an enterprise level. • Support and refine data ingestion workflows and pipeline integrations using tools like AWS Glue, Step Functions, Lambda, and Azure Data Factory. • Collaborate with Data Engineering teams to develop streaming solutions using Kafka, Kinesis, and AWS services. • Apply robust security measures, including encryption, access controls, and secrets management, to protect database systems. • Develop disaster recovery strategies and maintain backup solutions to ensure data integrity and availability. • Monitor database systems using tools like CloudWatch, Azure Monitor, and Datadog, ensuring optimal reliability and performance.
2026-03-12T21:23:42Z

Sr. AWS Data Engineer

Atlanta, GA
remote
Contract / Temporary to Hire
60.00 - 67.00 USD / Hourly
Position Summary:<ul><li>We are looking for a Data Operations Engineer to support and oversee the automated data‑pipeline environment built on AWS. This position bridges data engineering and customer operations, ensuring that incoming datasets are processed accurately, consistently, and securely within established ingestion and transformation frameworks.</li><li>Key responsibilities include monitoring automated workflows, troubleshooting processing failures, validating data quality, and helping onboard new customers by aligning their data formats to a standardized internal model.</li><li>The role requires strong proficiency in SQL and Python, practical experience with AWS services, and the ability to communicate effectively with external customers when data issues arise.</li></ul>Responsibilities:Data Pipeline Monitoring & Operations:<ul><li>Monitor automated batch and streaming data pipelines in AWS</li><li>Identify, troubleshoot, and resolve data processing failures</li><li>Investigate file‑level errors, schema mismatches, and transformation issues</li><li>Perform root‑cause analysis and document resolutions</li><li>Ensure data integrity, completeness, and timeliness across environments</li><li>Escalate architectural or systemic issues to the Data Engineering team</li></ul>Customer Data Onboarding & Implementation:<ul><li>Collaborate directly with customers to understand their file formats and data structures</li><li>Create and maintain mapping templates to align customer data to a normalized data model</li><li>Validate sample files and run tests on ingestion workflows</li><li>Configure ingestion parameters within predefined frameworks</li><li>Support customer go‑live processes and initial data processing cycles</li></ul>Data Quality & Continuous Improvement:<ul><li>Write SQL queries to validate data accuracy and research anomalies</li><li>Develop lightweight Python scripts for validation, transformation checks, or automation tasks</li><li>Improve monitoring processes, internal documentation, and operational playbooks</li><li>Work with engineering teams to strengthen platform reliability and observability</li></ul>Customer & Cross‑Functional Collaboration:<ul><li>Communicate clearly with customers regarding file issues or data discrepancies</li><li>Partner with internal teams including Data Engineering, Product, and Support</li><li>Provide feedback to enhance scalability, resilience, and overall platform performance</li></ul>
2026-03-27T15:58:47Z

Data Engineer

Foxborough, MA
onsite
Temporary
59.38 - 68.75 USD / Hourly
We are looking for a skilled Data Engineer to join our team in Foxborough, Massachusetts, on a long-term contract basis. In this role, you will design, optimize, and maintain data pipelines and storage solutions, leveraging modern tools to ensure high performance and reliability. This position offers an exciting opportunity to collaborate across teams and implement cutting-edge practices in data engineering and analytics. Responsibilities: • Optimize Amazon Redshift performance by configuring distribution keys, sort keys, and fine-tuning queries. • Develop and maintain robust data pipelines using AWS Glue and orchestrate workflows with Airflow. • Manage semantic layers and metadata to support reliable analytics and AI-driven insights. • Implement best practices for data partitioning, compression, and columnar storage formats. • Monitor and troubleshoot data workflows to ensure high availability, reliability, and automated observability. • Automate data processing tasks using Python and AWS native tools. • Enforce data security and governance policies, including row- and column-level controls, using Lake Formation and AWS services. • Oversee compliance monitoring and auditing through CloudWatch, CloudTrail, and similar tools. • Continuously refine and improve data architecture by adopting emerging AWS best practices and patterns. • Collaborate closely with Operations, Data Governance, and other teams to align with standards and achieve delivery objectives.
2026-03-24T11:48:43Z

AWS/Databricks Engineer

Houston, TX
onsite
Temporary
- USD / Hourly
We are looking for an experienced AWS/Databricks Engineer to join our team in Houston, Texas. This is a long-term contract position ideal for professionals with a strong background in data engineering and cloud technologies. The role will focus on leveraging Python and Databricks to optimize data processes and enhance system performance. Responsibilities: • Develop and implement scalable data engineering solutions using Python and Databricks. • Collaborate with cross-functional teams to design and optimize data workflows. • Migrate and enhance existing Python scripts to Databricks for improved functionality. • Utilize cloud technologies to support data integration and analytics processes. • Implement algorithms and data visualization methods to present actionable insights. • Design and maintain APIs to streamline data interactions and integrations. • Work with tools like Apache Kafka, Spark, and Hadoop to manage large-scale data systems. • Perform data analysis and develop strategies to improve system efficiency. • Ensure high-quality data pipelines and address performance bottlenecks. • Stay updated on emerging trends in data engineering and recommend innovative solutions.
2026-03-09T13:33:41Z

Senior AWS Engineer

Torrance, CA
onsite
Temporary
50.00 - 55.00 USD / Hourly
We are seeking an experienced Senior Data Engineer to support and enhance enterprise business intelligence and analytics environments. This role focuses on designing, building, and maintaining scalable data pipelines and cloud‑based data platforms using AWS services. The ideal candidate brings deep hands‑on experience with AWS Glue, PySpark, Redshift, and serverless architectures, along with strong SQL and data analysis skills.This role will collaborate closely with architecture, security, compliance, and development teams to ensure data solutions are performant, secure, and compliant with regulatory requirements. Key Responsibilities<ul><li>Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue with PySpark for large‑scale data processing</li><li>Develop and support serverless integrations using AWS Lambda for event‑driven workflows and system integrations</li><li>Design and optimize Amazon Redshift data warehouse solutions, including:</li><li>Advanced SQL analytics</li><li>Stored procedures</li><li>Performance tuning</li><li>Lead implementation of secure vendor file transfer and ingestion solutions using AWS Transfer Family</li><li>Design and implement database migration and replication pipelines using AWS Database Migration Service (DMS)</li><li>Build and manage workflow orchestration using Apache Airflow or similar orchestration tools</li><li>Analyze data quality, transformation logic, and pipeline performance using SQL and data analysis techniques</li><li>Troubleshoot and resolve production data pipeline and integration issues across AWS services</li><li>Provide technical guidance to development team members on:</li><li>AWS best practices</li><li>Cost optimization</li><li>Performance optimization</li><li>Partner with enterprise architecture, security, and compliance teams to ensure SOX and regulatory compliance</li></ul>
2026-03-26T21:56:41Z

Data Integration Developer

Modesto, CA
onsite
Temporary
55.00 - 62.00 USD / Hourly
Our client in Modesto is seeking a Data Integration Engineer to support the build-out of their BHRS data platform and modern analytics environment. This is a 6‑month contract role that requires 100% onsite work. Key Responsibilities: •Build, test, and deploy data pipelines using Azure Data Factory, AzureFunctions, and/or custom scripts to ingest data from multiple source systemsinto the BHRS data platform.•Extend the existing SmartCare API integration to pull additional datasets andensure comprehensive EHR data coverage for the dashboard.•Develop new integrations with state-level systems (BHIS, CalOMS, CSI) andcounty internal systems (financial, HR/workforce, compliance tracking) usingAPIs, SFTP, flat file ingestion, or database connectors as appropriate.•Write data transformation and cleansing logic (SQL, Python, or C#) tonormalize, deduplicate, validate, and prepare source data for the analyticaldata model.•Implement error handling, logging, retry logic, and alerting for all datapipelines to ensure reliability and rapid troubleshooting.•Replace placeholder/dummy data in the existing dashboard with live data feeds,validating accuracy and completeness against source systems.•Support the Solutions Architect in implementing the data model, including tablecreation, stored procedures, views, and indexing.•Write and maintain unit tests and integration tests for data pipelines andtransformation logic.•Document all integrations, data mappings, transformation rules, and pipelineconfigurations for ongoing maintenance and knowledge transfer.
2026-04-01T20:54:08Z

1 3