Add your latest resume to match with open positions.

183 results for Big Data Engineer jobs

Data Engineer

Greenville, SC
onsite
Permanent / Full Time
0 - 0 USD / Yearly
We are looking for a Data Engineer to support and enhance critical data operations in Greenville, South Carolina. This role focuses on keeping data platforms dependable, efficient, and scalable across both real-time and scheduled workflows. The ideal candidate will bring strong technical expertise in cloud-based data environments and a proactive approach to improving performance, automation, and data reliability. Responsibilities: • Oversee the health and performance of data pipelines that run across Snowflake, Kafka, and connected platforms. • Investigate operational issues affecting data ingestion, transformation, or downstream delivery and drive timely resolution. • Maintain stable batch and streaming processes by improving resiliency, uptime, and overall execution efficiency. • Administer Snowflake resources, including warehouses, databases, permissions, and usage optimization. • Manage Kafka infrastructure by tuning clusters, topics, partitions, and consumer group behavior for reliable throughput. • Create and maintain automated solutions for deployment, monitoring, failure recovery, and routine workflow support. • Develop operational scripts and utilities using Python, Bash, and related tools to reduce manual effort and improve consistency. • Contribute to CI/CD practices that strengthen the release and maintenance process for data infrastructure. • Partner with engineering and analytics teams to improve pipeline design, data performance, and delivery accuracy. • Support data governance, security, compliance, and data quality standards through validation checks and alerting frameworks.
2026-06-08T00:00:00Z

Data Engineer

Washington, DC
onsite
Temporary / Contract
55 - 60 USD / Hourly
Data Engineer – Databricks / Azure / AI Analytics You must be able to obtain and maintain a public trust clearance, Position OverviewWe are seeking a highly capable Data Engineer to design and support scalable data pipelines and analytics environments within a cloud-based Azure data platform. This role focuses on building modern data solutions using Databricks, Spark, and distributed data architectures, supporting enterprise-level analytics and AI initiatives.The ideal candidate brings hands-on expertise in Databricks engineering, cloud data pipelines, and data integration, along with strong collaboration skills to translate business requirements into technical solutions. This position offers the opportunity to work on large-scale data platforms and support advanced analytics and AI-driven workloads. Key ResponsibilitiesData Engineering & Pipeline Development<ul><li>Design, build, and optimize data pipelines using Databricks and Spark</li><li>Implement Medallion architecture and scalable data processing workflows</li><li>Develop ingestion pipelines for structured, streaming, and unstructured datasets</li></ul>Cloud & Platform Integration<ul><li>Work with Azure services (Data Factory, Storage, Functions, Log Analytics)</li><li>Integrate data across multiple sources to enable high-quality analytics</li><li>Support hybrid cloud initiatives and evolving data platforms</li></ul>Data Management & Optimization<ul><li>Ensure data quality, integrity, and accessibility across systems</li><li>Monitor pipeline performance and optimize cost, scalability, and efficiency</li><li>Support data governance, cataloging, and compliance standards</li></ul>Platform Operations & Support<ul><li>Troubleshoot performance issues, cluster stability, and configuration management</li><li>Support end-user requests and provide front-line platform support</li><li>Implement monitoring, logging, and alerting solutions</li></ul>DevOps & Automation<ul><li>Develop and maintain CI/CD pipelines and infrastructure-as-code (IaC)</li><li>Automate deployment and data workflows for improved efficiency</li><li>Support continuous delivery within Agile environments</li></ul>
2026-06-02T00:00:00Z

Data Engineer

Kalamazoo, MI
remote
Permanent / Full Time
150000 - 225000 USD / Yearly
We are looking for a senior-level Data Engineer to shape and deliver a scalable data platform in Kalamazoo, Michigan. This role combines strategic architecture with hands-on engineering, creating reliable data products that support reporting, advanced analytics, and AI-driven solutions. The ideal candidate will build secure, multi-tenant data capabilities with strong attention to privacy, governance, and long-term platform quality. Responsibilities: • Lead the design of a modern data platform that supports ingestion, transformation, storage, and consumption across analytical and operational use cases. • Build and maintain robust batch and streaming pipelines that move data from relational systems, object storage, document databases, and event sources into centralized platforms. • Define data architecture standards, modeling approaches, and engineering practices that improve consistency, reliability, and scalability across the organization. • Create multi-tenant data solutions with strong isolation controls, secure access patterns, and governance measures built into the platform design. • Develop data models and serving layers that enable enterprise reporting, self-service analytics, and AI or machine learning workloads. • Evaluate cloud-based data services, processing frameworks, and warehouse technologies to ensure the platform meets performance, cost, and security expectations. • Partner with product, engineering, and leadership teams to explain technical decisions, highlight risks, and align platform investments with business priorities. • Oversee external vendors and implementation partners by reviewing recommendations, challenging misaligned approaches, and enforcing internal data standards.
2026-06-18T00:00:00Z

Data Engineer

Atlanta, GA
onsite
Permanent / Full Time
95000 - 110000 USD / Yearly
ONSITESeeking a Data Engineer to build and optimize scalable data pipelines and platforms supporting enterprise analytics, reporting, and AI initiatives. Responsibilities<ul><li>Build ETL/ELT pipelines (batch & streaming)</li><li>Design scalable data architectures (Lakehouse, warehouse)</li><li>Ensure data quality, governance, and security</li><li>Optimize performance, cost, and reliability</li><li>Partner with analytics, BI, and engineering teams</li></ul>
2026-06-15T00:00:00Z

Data Engineer

Miami, FL
onsite
Temporary / Contract
50 - 60 USD / Hourly
We are looking for a talented Data Engineer to join our team in Miami, Florida. This long-term contract position offers the opportunity to work on cutting-edge technologies and contribute to the development of efficient data pipelines and processes. The ideal candidate will have a strong background in data engineering and a passion for delivering high-quality solutions that drive business success. Responsibilities:• Design and implement scalable data pipelines using Snowflake, Python, and other relevant tools.• Collaborate with stakeholders to gather and refine data requirements, ensuring alignment with business needs.• Develop and maintain data models to support analytics, reporting, and operational processes.• Optimize data warehouse performance by tuning queries and managing resources effectively.• Ensure data quality through rigorous testing and governance protocols.• Implement security and compliance measures to protect sensitive data.• Research and integrate emerging technologies to enhance system capabilities.• Support ETL processes for data extraction, transformation, and loading.• Work with technologies such as Apache Spark, Hadoop, and Kafka to manage and process large datasets.• Provide technical guidance and support to team members and stakeholders.
2026-06-18T00:00:00Z

Data Engineer

Westchester, IL
remote
Temporary / Contract
70 - 80 USD / Hourly
We are looking for a Data Engineer to join a team on a Long-term Contract assignment. This position will play a key role in strengthening an established Microsoft Fabric environment by building scalable data solutions that improve reliability, accessibility, and business value. The ideal candidate brings strong technical depth in modern data engineering, paired with the ability to evaluate data design choices thoughtfully and communicate effectively with stakeholders. You will work with business-facing data needs while helping shape well-structured datasets that support reporting, analytics, and long-term platform maturity. Responsibilities:• Expand and enhance an existing Microsoft Fabric data platform to improve performance, consistency, and downstream usability.• Develop layered data solutions using Bronze, Silver, and Gold design principles, with particular attention to delivering trusted and analytics-ready Gold datasets.• Create and refine data models that support accurate reporting by evaluating data relationships, structure, quality, and business context.• Build ingestion and transformation pipelines for Salesforce data along with additional source systems used across the organization.• Contribute to the evolution of reporting and warehousing practices by reducing dependence on legacy approaches and spreadsheet-driven processes.• Work autonomously on technical deliverables while providing clear updates on milestones, design decisions, dependencies, and potential issues.• Partner with business stakeholders to understand reporting needs and translate them into effective data structures that support analytics and visualization tools.• Use data engineering technologies such as Python, Spark, ETL frameworks, and related platform capabilities to deliver scalable solutions.• Support report-oriented data design by preparing curated datasets that align with Power BI and other business intelligence use cases.
2026-06-18T00:00:00Z

Data Engineer

Chicago, IL
onsite
Temporary to Hire
55.4135 - 64.163 USD / Hourly
We are looking for a Data Engineer to join a real estate and property organization in Chicago, Illinois on a contract-to-permanent basis. This role is ideal for a hands-on builder who can create and improve modern data pipelines, manage core data platforms, and support reliable data delivery across the business. You will work within the Azure ecosystem to develop scalable solutions that connect multiple data sources, strengthen data quality, and enable informed decision-making. Responsibilities: • Design, build, and enhance end-to-end data pipelines using Microsoft Fabric and/or Azure Data Factory for production use. • Manage and improve the data environment with a strong ownership mindset, ensuring performance, reliability, and maintainability. • Integrate data from varied sources such as APIs, databases, and flat files into structured, usable datasets. • Develop data models and schema designs that support reporting, analytics, and downstream business needs. • Monitor data quality and implement validation checks, troubleshooting issues through root cause analysis and continuous optimization. • Create scalable cloud-based data solutions within Azure that support long-term operational and analytical goals. • Partner with cross-functional stakeholders to translate business questions into practical data engineering solutions. • Contribute to orchestration, automation, and ongoing support of data workflows using modern engineering tools and programming languages.
2026-06-22T00:00:00Z

Data Engineer

Beverly Hills, CA
remote
Temporary / Contract
50 - 53 USD / Hourly
We are looking for a Data Engineer to support a long-term contract assignment in Beverly Hills, California. This position focuses on preparing, validating, and organizing access-related data to help deliver reliable site deployments and ensure accurate user provisioning across connected systems. The role works closely with Facilities, Identity, Security, and vendor teams to improve data quality, support implementation activities, and maintain consistent rollout processes across locations. Responsibilities: • Collaborate with Facilities and cross-functional partners to collect, cleanse, and verify access control information before deployment activities begin. • Reconcile user, badge, and permission records across legacy tools, Workday, Active Directory, and related platforms to maintain consistent data alignment. • Build and validate migration files, import templates, and assignment lists needed for loading records into Genea and associated systems. • Execute data upload activities with internal stakeholders and external vendors, then perform detailed checks to confirm completeness and accuracy. • Translate site and business access needs into structured mappings that connect users with the appropriate access groups and permissions. • Coordinate with Identity and Security teams to ensure access group design aligns with Active Directory, Okta, and established governance standards. • Support go-live and cutover efforts by preparing final data sets, applying last-minute updates, and assisting teams during rollout windows. • Maintain clear documentation for templates, mappings, validation steps, and repeatable processes while incorporating lessons learned for future deployments. • Provide post-launch support by troubleshooting data issues, correcting access assignments, and helping sites transition into steady-state operations.
2026-06-26T00:00:00Z

Data Engineer

Atlanta, GA
onsite
Temporary to Hire
47.5 - 60 USD / Hourly
We are looking for a Data Engineer to join an opportunity in Atlanta, Georgia. In this role, you will design and support reliable data solutions that enable efficient reporting, analytics, and downstream business insights across cloud-based platforms. The ideal candidate brings strong engineering fundamentals, enjoys working with diverse data sets, and can help shape scalable architecture in a collaborative enterprise environment. Responsibilities:• Design, build, and maintain robust data pipelines that move and transform information from a variety of internal and external sources.• Develop efficient integration processes to unify structured and unstructured data for analytics, reporting, and operational use cases.• Improve the speed, reliability, and scalability of existing data workflows through tuning, monitoring, and process optimization.• Create and refine data models that support business intelligence, advanced analytics, and decision-making needs.• Administer and enhance cloud-based data environments across modern platforms, ensuring stability, security, and performance.• Partner closely with analytics and business teams to understand data needs and deliver accessible, high-quality datasets.• Implement ETL solutions using Python, Spark, and cloud-native services to support enterprise data operations.• Contribute to best practices for data engineering, documentation, and cross-functional collaboration within a consultative delivery model
2026-06-18T00:00:00Z

Data Engineer

Conshohocken, PA
remote
Permanent / Full Time
100000 - 150000 USD / Yearly
We are looking for a Data Engineer to join a growing team in Conshohocken, Pennsylvania within the financial services industry. In this role, you will build and enhance modern data pipelines and warehouse structures that support reporting, analytics, and business decision-making. You will partner with technical and business teams to deliver reliable, well-governed data solutions using Python, Azure Synapse Analytics, and related cloud technologies. Responsibilities: • Build and support scalable data pipelines using Python, including PySpark, within Azure Synapse Analytics notebooks and pipeline workflows. • Design, load, and maintain warehouse structures in a massively parallel processing environment, applying dimensional modeling concepts such as facts and dimensions. • Ingest and transform data from a range of sources, including APIs, databases, and flat files, to create dependable datasets for downstream use. • Improve the efficiency and reliability of Azure Synapse processes by tuning queries, refining workloads, and addressing performance constraints. • Partner with data architects, analysts, and other stakeholders to translate business needs into practical data models and engineering solutions. • Establish validation routines and data quality controls to promote completeness, consistency, and accuracy across datasets. • Monitor scheduled jobs and pipeline activity, troubleshoot failures, and implement corrective actions to maintain service levels. • Document data flows, transformation logic, technical configurations, and operating procedures to support maintainability and knowledge sharing. • Apply security, privacy, and governance standards to data solutions while supporting broader data platform initiatives such as lakes, lakehouses, and cataloging practices.
2026-06-25T00:00:00Z

Data Engineer

Austin, TX
onsite
Temporary / Contract
50 - 60 USD / Hourly
Data EngineerOnsite | Austin, TX | Contract <ul><li>Design, build, and maintain scalable data pipelines and ETL/ELT processes</li><li>Develop and manage data architectures such as data warehouses, data lakes, and lakehouses</li><li>Ingest and integrate data from multiple sources (databases, APIs, streaming platforms)</li><li>Ensure data quality, integrity, and reliability across systems</li><li>Optimize data processing, storage, and query performance</li><li>Collaborate with data analysts, data scientists, and business teams to support analytics and reporting needs</li><li>Implement automation for data workflows, monitoring, and error handling</li><li>Troubleshoot and resolve data pipeline issues and performance bottlenecks</li><li>Support batch and real‑time data processing frameworks</li><li>Document data models, pipelines, and data engineering processes</li></ul>
2026-06-18T00:00:00Z

Data Engineer

Carmichael, CA
onsite
Temporary / Contract
60 - 70 USD / Hourly
We are looking for a Data Engineer to support education-focused data initiatives through a Contract engagement based in Carmichael, California. This role will design and enhance reliable data pipelines that turn complex source information into trusted, well-structured datasets for reporting, analysis, and future advanced use cases. The ideal candidate brings strong engineering judgment, clear communication skills, and hands-on experience building scalable solutions in cloud-based environments. Responsibilities: • Build and maintain multi-stage data pipelines that organize raw, refined, and curated data for downstream business and analytics use. • Develop incremental processing workflows that efficiently capture updates and propagate changes across datasets with accuracy and consistency. • Create approaches for matching and unifying records across separate platform instances where identifiers may overlap or conflict. • Establish data lineage, traceability, and audit controls so datasets can be validated and reviewed with confidence. • Implement and manage workflow orchestration for scheduled and event-driven pipeline execution using cloud-native or equivalent automation tools. • Write production-quality pipeline code in Python and TypeScript to support ingestion, transformation, and delivery of data assets. • Leverage AWS services such as Lambda and S3 to build resilient, scalable components for data processing workloads. • Partner with technical and non-technical stakeholders to explain design decisions, clarify tradeoffs, and align solutions with operational needs. • Prepare data models and pipeline outputs that can support future AI and machine learning applications, including training and inference workflows.
2026-06-29T00:00:00Z

Data Engineer

Nashville, TN
remote
Permanent / Full Time
120000 - 130000 USD / Yearly
We are looking for a fully remote Data Engineer to support and enhance a modern data environment serving critical business reporting and analytics needs. This role will focus on maintaining reliable warehouse operations while expanding scalable data pipelines and improving how information is integrated across systems. This position is well suited for someone who enjoys hands-on engineering work, thoughtful data design, and close collaboration with technical stakeholders. Responsibilities:• Oversee the daily performance, stability, and upkeep of the data warehouse to ensure dependable access to trusted data.• Design, build, and refine data pipelines that move and transform information efficiently across multiple platforms.• Develop engineering solutions using Python, Spark, and Databricks to support large-scale data processing and analytics workloads.• Create and maintain SQL-based data structures and workflows that improve data quality, usability, and consistency.• Apply sound data modeling practices to organize datasets for reporting, analysis, and downstream application use.• Partner with cross-functional teams to understand integration needs and deliver scalable data solutions aligned with business priorities.• Support cloud-based data movement and orchestration processes, including work involving Azure Data Factory where needed.• Contribute to reporting and visualization readiness by preparing well-structured datasets for tools such as Power BI, Tableau, or Looker.
2026-06-19T00:00:00Z

Data Engineer

Jacksonville, FL
onsite
Permanent / Full Time
120000 - 140000 USD / Yearly
We are looking for an experienced Data Engineer to help design and support scalable cloud-based data platforms in Jacksonville, Florida. This role focuses on building resilient data solutions in Azure, improving end-to-end data processing, and helping ensure strong performance across distributed systems. You will work closely with global engineering partners, contribute technical direction, and support a reliable delivery model in an Agile environment. Responsibilities: • Design, implement, and maintain cloud data infrastructure within Azure, using automation and infrastructure-as-code practices to improve consistency and scalability. • Build and enhance enterprise data pipelines for ingestion, transformation, and processing using Databricks, Apache Spark, and Azure Data Factory. • Provide technical leadership for cloud data platforms by driving architecture decisions that strengthen availability, performance, and long-term scalability. • Collaborate daily with offshore and international engineering teams to align on development priorities, review code, and share technical knowledge across time zones. • Participate actively in Agile ceremonies such as sprint planning, stand-ups, backlog refinement, readiness reviews, and retrospectives to support predictable delivery. • Mentor data engineers through coaching, design guidance, and code review feedback that promotes high engineering standards. • Support production operations by investigating incidents, resolving system bottlenecks, and leading root-cause analysis to improve platform reliability. • Create and maintain architecture documentation, operational runbooks, and technical decision records to support distributed team execution.
2026-06-24T00:00:00Z

Data Engineer

Jacksonville, FL
onsite
Temporary / Contract
0 - 0 USD / Yearly
We are seeking a Data Engineer with strong experience in Microsoft Azure and Databricks to help design, build, and maintain modern cloud-based data solutions. This individual will play a key role in developing scalable data pipelines, optimizing data architectures, and enabling business intelligence and analytics initiatives across the organization.This is an excellent opportunity for someone passionate about cloud technologies, big data, and transforming raw data into actionable insights.Responsibilities<ul><li>Design, develop, and maintain scalable data pipelines in Azure and Databricks</li><li>Build and optimize ETL/ELT processes for structured and unstructured data</li><li>Develop and support data lake, data warehouse, and analytics solutions</li><li>Integrate data from multiple internal and external sources</li><li>Collaborate with business analysts, data scientists, and stakeholders to understand data requirements</li><li>Ensure data quality, integrity, security, and governance standards are met</li><li>Monitor and troubleshoot data workflows and performance issues</li><li>Create and maintain technical documentation and data models</li><li>Support reporting and analytics initiatives by delivering reliable datasets</li></ul>
2026-06-19T00:00:00Z

Data Engineer

Nashville, TN
onsite
Temporary / Contract
58 - 72 USD / Hourly
Robert Half is seeking a Contract Data Engineer to support our client’s data and analytics initiatives. In this role, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure that enable efficient data ingestion, transformation, and delivery. The ideal candidate has strong experience working with modern data platforms, cloud environments, and large-scale datasets. Key Responsibilities:<ul><li>Data Pipeline Development: Design, build, and maintain scalable ETL / ELT pipelines to ingest, transform, and deliver data from multiple sources.</li><li>Data Architecture: Develop and optimize data models, schemas, and warehouse structures to support analytics, reporting, and business intelligence needs.</li><li>Cloud Data Platforms: Work within cloud environments such as AWS, Azure, or GCP to deploy and manage data solutions.</li><li>Data Warehousing: Design and support enterprise data warehouses using platforms such as Snowflake, Redshift, BigQuery, or Azure Synapse.</li><li>Big Data Processing: Develop solutions using big data technologies such as Spark, Databricks, Kafka, and Hadoop when required.</li><li>Performance Optimization: Tune queries, pipelines, and storage solutions for performance, scalability, and cost efficiency.</li><li>Data Quality & Reliability: Implement monitoring, validation, and alerting processes to ensure data accuracy, integrity, and availability.</li><li>Collaboration: Work closely with Data Analysts, Data Scientists, Software Engineers, and business stakeholders to understand requirements and deliver data solutions.</li><li>Documentation: Maintain detailed documentation for pipelines, data flows, and system architecture.</li></ul>
2026-06-23T00:00:00Z

Data Engineer

Chicago, IL
onsite
Temporary to Hire
59.375 - 68.75 USD / Hourly
We are looking for a Data Engineer to join a growing financial services organization in Chicago, Illinois. This contract opportunity with potential for a permanent role is ideal for someone who enjoys building in a developing data environment, contributing to a modern cloud-based platform, and helping shape the next phase of the team’s capabilities. You will work closely with key data stakeholders in a nimble setting where initiative, sound judgment, and adaptability are highly valued. Responsibilities: • Design and support data workflows that collect, refine, and deliver information across a contemporary cloud ecosystem. • Develop and enhance scalable data pipelines using Python and automated ingestion platforms such as Fivetran or comparable tools. • Model and transform datasets within Snowflake to enable reliable analytics and downstream business intelligence reporting. • Collaborate closely with the data architect to expand and improve the organization’s overall data infrastructure. • Contribute to reporting readiness by preparing curated datasets for visualization tools including Power BI and Sigma. • Monitor pipeline performance and resolve data issues to maintain accuracy, consistency, and dependable delivery. • Assess emerging technologies and recommend practical additions to the data stack as business needs evolve. • Work effectively in a fast-paced team environment where priorities can shift and new tooling may be introduced regularly.
2026-06-22T00:00:00Z

Data Engineer

Centennial, CO
onsite
Temporary / Contract
63.3365 - 73.337 USD / Hourly
We are looking for an experienced Data Engineer to join a long-term contract engagement in Colorado. This position centers on designing and improving cloud-based data solutions that support enterprise analytics and AI-driven initiatives. The role is ideal for a hands-on, detail-oriented individual who excels in preparing reliable, scalable data assets and partnering with technical teams in a modern Microsoft-focused environment. Responsibilities: • Design, develop, and enhance scalable data pipelines to support enterprise reporting, analytics, and AI use cases. • Transform, cleanse, and organize complex data from multiple sources so it can be used effectively by downstream engineering and machine learning teams. • Build and maintain robust data workflows in a cloud-based ecosystem using Microsoft Fabric, Synapse Analytics, Azure Data Factory, and Databricks. • Collaborate with data engineers, ML engineers, and other technical stakeholders to create efficient and dependable data architecture. • Monitor pipeline performance and resolve issues related to data quality, reliability, and processing efficiency across platforms. • Orchestrate data ingestion, movement, and transformation processes for large-volume datasets in a backend-focused engineering environment. • Support AI and machine learning initiatives by delivering well-structured datasets optimized for model development and operational use. • Contribute to scalable lakehouse or warehouse-oriented data solutions while helping align engineering practices with cloud data best practices.
2026-06-15T00:00:00Z

Data Engineer

West Los Angeles, CA
onsite
Permanent / Full Time
150000 - 200000 USD / Yearly
We are looking for a Data Engineer to help transform business data into reliable, accessible insights that support decision-making across the organization. This role partners with teams such as asset management, acquisitions, accounting, and HR to build reporting solutions, improve data quality, and streamline access to critical information. Based in Los Angeles, California, the position is well suited for someone who enjoys combining technical expertise with business collaboration in a fast-moving environment. Responsibilities: • Build and enhance dashboards, reports, and automated data workflows using tools such as Python, Excel, and Power BI. • Translate business questions into scalable reporting and analytics solutions by working closely with stakeholders across multiple departments. • Examine large and complex datasets to uncover trends, exceptions, and actionable insights that support operational and strategic decisions. • Design and maintain data extraction, transformation, and loading processes, including query development and performance optimization. • Monitor data accuracy through regular validation, issue resolution, and ongoing improvements to data governance practices. • Support and guide entry-level BI team members by reviewing work, sharing best practices, and encouraging career growth. • Explain technical findings in a clear way to non-technical audiences to promote understanding and adoption of data solutions. • Lead or contribute to cross-functional initiatives that improve data accessibility, usability, and reporting effectiveness across the business. • Administer BI platforms to maintain performance, reliability, and appropriate security controls. • Deliver user support and training to help employees make effective use of reporting tools and interpret data confidently.
2026-06-16T00:00:00Z

Data Engineer

New York, NY
onsite
Temporary / Contract
75 - 75 USD / Hourly
We are looking for a skilled Data Engineer to join our team on a long-term contract basis. In this role, you will play a critical part in managing and organizing data systems, ensuring they are optimized for performance and scalability. Based in New York, New York, this position offers an exciting opportunity to work on cutting-edge data platforms and contribute to impactful business solutions. Responsibilities: • Design, develop, and maintain data pipelines to support efficient data integration and processing. • Implement and manage Snowflake-based data repositories to centralize and secure organizational data. • Utilize Palantir to standardize and analyze data across multiple divisions, ensuring consistency and accuracy. • Develop ETL processes to extract, transform, and load data from various sources into centralized systems. • Collaborate with stakeholders to define data requirements and optimize system performance. • Leverage tools like Apache Spark, Hadoop, and Kafka to build scalable data solutions. • Monitor and troubleshoot data systems to ensure reliability and address any issues promptly. • Deploy advanced analytics and AI models to drive operational efficiencies. • Document processes and provide technical support to ensure smooth implementation and usage of data systems.
2026-06-29T00:00:00Z

Data Scientist

Atlanta, GA
onsite
Permanent / Full Time
120000 - 140000 USD / Yearly
We are looking for a Data Scientist to join a fast-moving IT consulting environment in Atlanta, Georgia. This role focuses on turning complex data into practical business insights, with a strong emphasis on forecasting, predictive modeling, and customer-focused problem solving. The ideal candidate combines advanced machine learning expertise with hands-on data preparation skills and can clearly explain how analytical work influences end users and business outcomes. Responsibilities: • Build, validate, and refine forecasting and predictive models using Python and modern machine learning frameworks for business-driven use cases. • Develop analytical solutions with tools such as scikit-learn, XGBoost, LightGBM, and time-series or deep learning methods based on project needs. • Use Databricks and Apache Spark to process large datasets efficiently and support scalable model development workflows. • Prepare, transform, and organize data by writing queries, performing ETL tasks, and improving data quality for downstream analysis. • Translate technical findings into clear recommendations for clients and stakeholders, emphasizing business impact and user experience. • Partner with customer-facing teams to define problem statements, shape data-driven approaches, and deliver actionable insights in a fast-paced setting. • Apply product thinking when designing models and analytical outputs to ensure solutions align with customer needs and practical use. • Contribute domain knowledge to projects involving retail or consumer goods data, helping tailor models to industry-specific patterns and challenges.
2026-06-10T00:00:00Z

Data Scientist

New York, NY
onsite
Permanent / Full Time
200000 - 225000 USD / Yearly
We are looking for a Data Scientist to join a fast-paced investment environment in New York, New York, where data-driven insight plays a central role in research and decision-making. This position will focus on turning complex datasets into practical analysis, scalable tools, and clear intelligence that support investment ideas. The ideal candidate brings strong technical depth, sound statistical judgment, and the ability to shape loosely defined questions into structured, repeatable research. Responsibilities: • Work closely with investment professionals to create quantitative studies, analytical frameworks, and practical tools that strengthen fundamental research workflows. • Identify promising alternative data sources, assess their relevance and quality, and support their integration into the research process. • Design and execute backtests, predictive models, and exploratory investigations to evaluate and refine investment hypotheses. • Produce and maintain analyst-facing dashboards and reporting views within internal analytics environments. • Convert one-off research requests into repeatable, clearly documented analyses that can be reused and scaled over time. • Partner with engineering teams to define data needs, support ingestion processes, and improve dataset availability for research use.
2026-06-16T00:00:00Z

Data Scientist

Palo Alto, CA
onsite
Temporary / Contract
95 - 100 USD / Hourly
We are looking for a Data Scientist to support AI and machine learning initiatives that advance patient care, research, and operational decision-making in Palo Alto, California. This is a Contract position focused on turning healthcare data into practical, high-impact solutions through model development, validation, and deployment. The role works closely with clinical, research, and operational partners to translate complex problems into scalable analytical approaches while maintaining strong standards for quality, fairness, and performance. Responsibilities: • Create, implement, and support AI- and ML-driven workflows that improve clinical, research, and administrative processes. • Partner with cross-functional stakeholders to define analytical needs and deliver data science solutions aligned with healthcare use cases. • Assess and refine tools, platforms, and methods used to manage model development, deployment, and ongoing lifecycle activities. • Train, test, and validate internally developed or externally sourced machine learning models using hospital data and established quality controls. • Perform bias reviews and model performance checks to help ensure responsible and reliable use of predictive algorithms. • Analyze large-scale healthcare datasets using Python, R, SQL, and cloud-based or distributed computing environments. • Work alongside clinicians and researchers to adapt analytical methods for real-world use in care delivery and related settings.
2026-06-23T00:00:00Z

Data Engineer I

Washington, DC
remote
Temporary / Contract
44 - 47 USD / Hourly
Data Automation Engineer – AI / AWS / AzureWork Arrangement: RemoteClearance Requirement: Ability to obtain Public Trust Position OverviewWe are seeking a highly skilled Data Automation Engineer to design and implement advanced, AI-driven automation solutions across hybrid AWS and Azure environments. This role is focused on building scalable data pipelines, integrating modern cloud services, and leveraging Generative AI technologies to enhance enterprise analytics and operational workflows.The ideal candidate is a hands-on engineer with strong expertise in data engineering, cloud platforms, and automation, combined with the ability to innovate and solve complex technical challenges. This role provides the opportunity to work on mission-critical systems, supporting large-scale data processing, reporting, and AI-enabled applications. Key ResponsibilitiesData Engineering & Pipeline Development<ul><li>Design, build, and maintain scalable data pipelines using AWS services (S3, Glue, Lambda, EMR, DynamoDB)</li><li>Develop and optimize ETL/ELT workflows across hybrid AWS and Azure environments</li><li>Integrate structured, unstructured, and streaming data across enterprise systems</li></ul>AI & Automation Engineering<ul><li>Leverage Generative AI frameworks (AWS Bedrock, Azure OpenAI, LangChain, Hugging Face) to build intelligent automation</li><li>Implement solutions for embeddings, vector generation, and RAG workflows</li><li>Develop AI-driven tools for data quality, anomaly detection, and pipeline optimization</li><li>Build AI-powered copilots for monitoring, troubleshooting, and workflow automation</li></ul>Data Platform Integration & Optimization<ul><li>Engineer real-time and batch ingestion pipelines using Spark, Kafka, and Flume</li><li>Integrate enterprise platforms and CRM data into data pipelines for analytics and reporting</li><li>Optimize SQL performance through stored procedures, indexing, and query tuning</li></ul>Cloud & DevOps Practices<ul><li>Implement CI/CD pipelines using tools such as GitHub, Jenkins, or Azure DevOps</li><li>Develop infrastructure solutions using Infrastructure-as-Code (IaC)</li><li>Ensure cloud security through IAM, RBAC, encryption, and network isolation</li></ul>Collaboration & Delivery<ul><li>Partner with cross-functional teams to gather requirements and deliver solutions</li><li>Support Agile delivery processes and continuous improvement initiatives</li><li>Provide technical troubleshooting and performance optimization across data systems</li></ul>
2026-06-15T00:00:00Z

Data Engineer I

Houston, TX
remote
Temporary / Contract
39 - 44 USD / Hourly
Data Automation Engineer – Azure / AI / Data PlatformsClearance Requirement: ability to obtain Public Trust Position OverviewWe are seeking a highly motivated Data Automation Engineer to design and implement modern, AI‑driven data solutions within a Microsoft Azure-based analytics ecosystem. This role focuses on building scalable pipelines, automating workflows, and integrating advanced analytics and AI capabilities across enterprise data platforms.The ideal candidate brings strong experience in Azure data services, ETL pipeline development, and automation, along with a delivery-focused mindset and the ability to translate complex business requirements into technical solutions. This role supports mission-critical environments and requires eligibility for a Public Trust clearance. Key ResponsibilitiesData Engineering & Pipeline Development<ul><li>Design and implement data pipelines using Azure Data Factory, Synapse, Spark, SQL, and Python</li><li>Build and maintain ETL/ELT workflows across structured and unstructured data sources</li><li>Support data ingestion, transformation, and integration for enterprise analytics platforms</li></ul>Automation & AI Integration<ul><li>Develop automation solutions to improve efficiency, scalability, and reliability of data workflows</li><li>Research and implement AI/ML and Generative AI tools to enhance data processing and insights</li><li>Eliminate bottlenecks through intelligent automation and workflow optimization</li></ul>Data Quality, Governance & Performance<ul><li>Implement data quality, integrity, and metadata management practices</li><li>Monitor and troubleshoot pipelines to ensure high availability and performance</li><li>Perform performance testing, tuning (query optimization, indexing), and pipeline benchmarking</li></ul>Collaboration & Delivery<ul><li>Partner with engineering, DevOps, and business stakeholders to develop solutions</li><li>Participate in Agile/DevOps processes and continuous delivery cycles</li><li>Document pipeline performance, test results, and system improvements</li></ul>
2026-06-15T00:00:00Z