<p><strong>Job Summary:</strong></p><p> The Data Engineer will build and optimize data pipelines, ensuring reliable data collection, storage, and access for analytics and machine learning use cases. This role will work closely with analytics and engineering teams to design scalable data architectures.</p><p><strong>Key Responsibilities:</strong></p><ul><li>Develop and maintain ETL/ELT pipelines for structured and unstructured data.</li><li>Integrate data from multiple sources into cloud data warehouses (Snowflake, BigQuery, Redshift).</li><li>Optimize data storage and retrieval for performance and scalability.</li><li>Collaborate with analysts and data scientists to ensure data quality.</li><li>Implement data governance and security best practices.</li></ul><p><br></p>
<p>The Data Engineer will architect, develop, and maintain high-quality data pipelines and infrastructure to support analytics, reporting, and data science teams. This position requires hands-on expertise in ETL development, cloud platforms, and data warehousing to ensure the availability and accuracy of critical business data.</p>
<p><br></p><ul><li>Design and implement scalable data architectures using Azure services, especially Azure Data Factory</li><li>Build, deploy, and maintain data pipelines for structured and unstructured data</li><li>Lead the integration of Microsoft Fabric into enterprise data solutions</li><li>Collaborate with data scientists to operationalize AI/ML models and embed them into business processes</li><li>Ensure data governance, security, and best practices across the entire data lifecycle</li><li>Partner with cross-functional teams to translate business needs into technical solutions</li></ul><p><br></p><p> Nice to Have</p><ul><li>Microsoft certifications (e.g., Azure Data Engineer, Azure Solutions Architect)</li><li>Experience with Power BI integration</li><li>Exposure to data mesh or data fabric concepts</li></ul><p><br></p><p><br></p>
<p><strong>Data Engineer (Hybrid, Los Angeles)</strong></p><p><strong>Location:</strong> Los Angeles, California</p><p><strong>Compensation:</strong> $140,000 - $175,000 per year</p><p><strong>Work Environment:</strong> Hybrid, with onsite requirements</p><p>Are you passionate about crafting highly-scalable and performant data systems? Do you have expertise in Azure Databricks, Spark SQL, and real-time data pipelines? We are searching for a talented and motivated <strong>Data Engineer</strong> to join our team in Los Angeles. You'll work in a hybrid environment that combines onsite collaboration with the flexibility of remote work.</p><p><strong>Key Responsibilities:</strong></p><ul><li>Design, develop, and implement data pipelines and ETL workflows using cutting-edge Azure technologies (e.g., Databricks, Synapse Analytics, Synapse Pipelines).</li><li>Manage and optimize big data processes, ensuring scalability, efficiency, and data accuracy.</li><li>Build and work with real-time data pipelines leveraging technologies such as Kafka, Event Hubs, and Spark Streaming.</li><li>Apply advanced skills in Python and Spark SQL to build data solutions for analytics and machine learning.</li><li>Collaborate with business analysts and stakeholders to implement impactful dashboards using Power BI.</li><li>Architect and support the seamless integration of diverse data sources into a central platform for analytics, reporting, and model serving via ML Flow.</li></ul><p><br></p>
<p>We are looking for an experienced Senior Data Engineer to join our team in Oxford, Massachusetts. In this role, you will design and maintain data platforms, leveraging cutting-edge technologies to optimize processes and drive analytical insights. This position requires a strong background in Python development, cloud technologies, and big data tools. This role is hybrid, onsite 3 days a week. Candidates must have GC or be USC.</p><p><br></p><p>Responsibilities:</p><p>• Develop, implement, and maintain scalable data platforms to support business needs.</p><p>• Utilize Python and PySpark to design and optimize data workflows.</p><p>• Collaborate with cross-functional teams to integrate data solutions with existing systems.</p><p>• Leverage Snowflake and other cloud technologies to manage and store large datasets.</p><p>• Implement and refine algorithms for data processing and analytics.</p><p>• Work with Apache Spark and Hadoop to build robust data pipelines.</p><p>• Create APIs to enhance data accessibility and integration.</p><p>• Monitor and troubleshoot data platforms to ensure optimal performance.</p><p>• Stay updated on emerging trends in big data and cloud technologies to continuously improve solutions.</p><p>• Participate in technical discussions and provide expertise during team reviews.</p>
We are looking for a skilled Data Engineer to join our team in Carmel, Indiana. This is a long-term contract opportunity for an individual with a strong background in building and optimizing data pipelines and systems. The ideal candidate will have a passion for working with large-scale data and a proven ability to leverage modern tools and technologies to deliver high-quality solutions.<br><br>Responsibilities:<br>• Design, implement, and maintain scalable data pipelines and ETL processes to support business needs.<br>• Develop and optimize solutions using tools such as Apache Spark, Python, and Apache Hadoop.<br>• Manage and integrate streaming data platforms like Apache Kafka to ensure real-time data processing.<br>• Utilize technologies such as AWS Lambda, Step Functions, Glue, and Redshift for cloud-based data solutions.<br>• Collaborate with cross-functional teams to understand data requirements and provide innovative solutions.<br>• Ensure data quality and integrity through rigorous testing and validation processes.<br>• Create and maintain documentation for data workflows, processes, and system architecture.<br>• Implement infrastructure as code using Terraform to enhance system reliability and scalability.<br>• Troubleshoot and resolve data-related technical issues promptly.<br>• Stay updated on emerging trends and technologies in data engineering to continuously improve practices.
<p>We are seeking a <strong>Senior Data Engineer</strong> with deep expertise in <strong>Power BI, Microsoft Fabric, DAX, and SQL</strong> to join our growing analytics team. This role will focus on building and optimizing data models, pipelines, and reporting solutions to support enterprise-wide business intelligence and decision-making. You’ll collaborate closely with analysts, stakeholders, and IT teams to ensure data solutions are scalable, efficient, and insightful.</p><p><strong>Key Responsibilities:</strong></p><ul><li>Design, build, and maintain scalable data pipelines and ETL processes within the Microsoft ecosystem.</li><li>Develop and optimize complex SQL queries, stored procedures, and views for efficient data extraction and transformation.</li><li>Build and enhance <strong>Power BI dashboards</strong> and reports with advanced DAX calculations to provide actionable insights.</li><li>Work with <strong>Microsoft Fabric</strong> to manage data integration, governance, and scalable analytics workloads.</li><li>Partner with business stakeholders to gather requirements and translate them into technical solutions.</li><li>Ensure data accuracy, security, and availability across multiple business units.</li><li>Monitor, troubleshoot, and optimize data infrastructure for performance and cost efficiency.</li><li>Mentor junior team members and contribute to best practices around data engineering and BI.</li></ul><p><br></p>
We are looking for a skilled Data Engineer to join our team in Wayne, Pennsylvania. This is a Contract-to-permanent position that offers a dynamic opportunity to work with large-scale data sets and contribute to data modeling and automation processes. If you're passionate about leveraging advanced tools and technologies to optimize data workflows, we encourage you to apply.<br><br>Responsibilities:<br>• Develop and implement data models for large-scale datasets, focusing on retailer data such as Walmart.<br>• Utilize tools such as Python, Snowflake, and SQL to design and optimize data pipelines.<br>• Automate data workflows through scripting, including Selenium-based web automation tasks.<br>• Collaborate with cross-functional teams to support data integration and analysis for multiple retailers.<br>• Ensure data accuracy and consistency across all platforms and workflows.<br>• Troubleshoot and resolve issues related to data pipelines and automation processes.<br>• Provide technical expertise to enhance data engineering practices and improve system performance.<br>• Document processes and workflows to maintain clarity and facilitate future updates.
We are looking for a skilled Big Data Engineer to join our team in Westfield, Indiana. This role involves leveraging advanced technologies to design, implement, and optimize big data solutions that drive our business objectives. The ideal candidate will have extensive experience in data engineering and a passion for building scalable systems.<br><br>Responsibilities:<br>• Design, develop, and implement scalable big data solutions using Python, Apache Spark, and other relevant technologies.<br>• Build and optimize ETL pipelines to efficiently handle large volumes of structured and unstructured data.<br>• Manage and process data using frameworks such as Apache Hadoop and Apache Kafka.<br>• Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions.<br>• Utilize cloud platforms like Amazon Web Services (AWS) to deploy and maintain data systems.<br>• Ensure the security, reliability, and performance of big data architectures.<br>• Troubleshoot and resolve issues related to data systems and pipelines.<br>• Monitor and analyze system performance to identify opportunities for improvement.<br>• Stay updated on emerging technologies and incorporate them into data engineering practices as appropriate.
We are looking for a skilled Data Engineer to join our team in Johnson City, Texas. In this role, you will design and optimize data solutions to enable seamless data transfer and management in Snowflake. You will work collaboratively with cross-functional teams to enhance data accessibility and support data-driven decision-making across the organization.<br><br>Responsibilities:<br>• Design, develop, and implement ETL solutions to facilitate data transfer between diverse sources and Snowflake.<br>• Optimize the performance of Snowflake databases by constructing efficient data structures and utilizing indexes.<br>• Develop and maintain automated, scalable data pipelines within the Snowflake environment.<br>• Deploy and configure monitoring tools to ensure optimal performance of the Snowflake platform.<br>• Collaborate with product managers and agile teams to refine requirements and deliver solutions.<br>• Create integrations to accommodate growing data volume and complexity.<br>• Enhance data models to improve accessibility for business intelligence tools.<br>• Implement systems to ensure data quality and availability for stakeholders.<br>• Write unit and integration tests while documenting technical work.<br>• Automate testing and deployment processes in Snowflake within Azure.
We are looking for a skilled and driven Data Engineer to join our team in San Juan Capistrano, California. This role centers on building and optimizing data pipelines, integrating systems, and implementing cloud-based data solutions. The ideal candidate will have a strong grasp of modern data engineering tools and techniques and a passion for delivering high-quality, scalable solutions.<br><br>Responsibilities:<br>• Design, build, and optimize scalable data pipelines using tools such as Databricks, Apache Spark, and PySpark.<br>• Develop integrations between internal systems and external platforms, including CRMs like Salesforce and HubSpot, utilizing APIs.<br>• Implement cloud-based data architectures aligned with data mesh principles.<br>• Collaborate with cross-functional teams to model, transform, and ensure the quality of data for analytics and reporting.<br>• Create and maintain APIs while testing and documenting them using tools like Postman and Swagger.<br>• Write efficient and modular Python code to support data processing workflows.<br>• Apply best practices such as version control, CI/CD, and code reviews to ensure robust and maintainable solutions.<br>• Uphold data security, integrity, and governance throughout the data lifecycle.<br>• Utilize cloud services for compute, storage, and orchestration, including platforms like AWS or Azure.<br>• Work within Agile and Scrum methodologies to deliver solutions efficiently and collaboratively.
<p>Are you obsessed with data and thrive on turning complexity into clarity? We’re looking for a <strong>Lead Data Engineer</strong> who lives and breathes Python, knows Snowflake inside out, and can architect scalable solutions in AWS. If you love solving hard problems, building elegant data platforms, and communicating your ideas with clarity and impact—this is your role.</p><p>🔍 What You’ll Do</p><ul><li>Design and implement cloud-native data platforms using <strong>AWS</strong> and <strong>Snowflake</strong></li><li>Build robust data pipelines and services using <strong>Python</strong> and modern engineering practices</li><li>Architect scalable solutions for data ingestion, transformation, and analytics</li><li>Collaborate with analysts, scientists, and business stakeholders to translate ideas into technical reality</li><li>Lead cross-functional teams to deliver high-impact data products</li><li>Migrate legacy systems to cloud-based platforms with minimal disruption</li><li>Define long-term data architecture strategies aligned with business goals</li><li>Mentor junior engineers and champion best practices in design, testing, and deployment</li><li>Communicate complex technical concepts in a way that resonates with non-technical audiences</li></ul><p><br></p>
<p>Hands-On Technical SENIOR Microsoft Stack Data Engineer / On Prem to Cloud Senior ETL Engineer - Position WEEKLY HYBRID position with major flexibility! FULL Microsoft On-Prem stack.</p><p><br></p><p>LOCATION : HYBRID WEEKLY in Des Moines. You must reside in the Des Moines area for weekly onsite . NO travel back and forth and not a remote position! If you live in Des Moines, eventually you can MOSTLY work remote!! This position has upside with training in Azure.</p><p><br></p><p>IMMEDIATE HIRE ! Solve real Business Problems.</p><p><br></p><p>Hands-On Technical SENIOR Microsoft Stack Data Engineer | SENIOR Data Warehouse Engineer / SENIOR Data Engineer / Senior ETL Developer / Azure Data Engineer / ( Direct Hire) who is looking to help modernize, Build out a Data Warehouse, and Lead & Build out a Data Lake in the CLOUD but FIRST REBUILD an OnPrem data warehouse working with disparate data to structure the data for consumable reporting.</p><p><br></p><p>YOU WILL DOING ALL ASPECTS OF Data Engineering. Must have data warehouse & Data Lake skills. You will be in the technical weeds and technical data day to day BUT you could grow to the Technical Leader of this team. ETL skills like SSIS., working with disparate data. SSAS is a Plus! Fact and Dimension Data warehouse experience AND experience.</p><p>Hands-On Technical Hands-On Technical SENIOR Microsoft Stack Data Engineer / SENIOR Data Warehouse / SENIOR Data Engineer / Azure Data Factory Data Engineer This is a Permanent Direct Hire Hands-On Technical Manager of Data Engineering position with one of our clients in Des Moines up to 155K Plus bonus</p><p><br></p><p>PERKS: Bonus, 2 1/2 day weekends !</p>
<p>We are looking for an experienced AWS/IDMC Data Engineer to join our team in Southern California. In this long-term contract position, you will play a key role in designing, developing, and optimizing data integration processes. This onsite role offers the opportunity to collaborate with cross-functional teams, ensuring seamless data workflows and high-performing systems. This role will be sitting onsite 4 days per week.</p><p><br></p><p>Responsibilities:</p><p>• Develop and implement data integration processes using Informatica Intelligent Cloud Services to meet business requirements.</p><p>• Collaborate with business analysts and data architects to design solutions for data transformation and integration.</p><p>• Create, test, and maintain application interfaces using various connectors, including Salesforce and other technologies.</p><p>• Automate and optimize data validation processes to enhance efficiency and reliability.</p><p>• Monitor and troubleshoot data workflows to ensure consistent system performance.</p><p>• Conduct evaluations of existing data landscapes and recommend architectural improvements.</p><p>• Build and optimize data pipelines into Amazon Redshift, ensuring scalability and performance.</p><p>• Utilize distributed data processing tools such as AWS Glue and Spark to manage large-scale data.</p><p>• Apply advanced data modeling techniques to streamline workflows and enhance system operations.</p><p>• Provide technical support and guidance to ensure compliance with best practices in data engineering.</p>
<p>We are looking for an AWS Data Engineer to join our team based in Seattle, WA. This is a long-term contract position where you will play a key role in overseeing complex engineering projects, guiding technical teams, and ensuring the successful integration and maintenance of software systems. The ideal candidate will bring extensive experience in system planning, design, and execution, as well as a strong ability to lead and collaborate across functional areas.</p><p><br></p><p>Responsibilities:</p><p>· Implement data cleansing, enrichment, and standardization processes.</p><p>· Automate batch and streaming data pipelines for real-time analytics. Build solutions for both streaming (Kinesis, MSK, Lambda) and batch processing (Glue, EMR, Step Functions).</p><p>· Ensure pipelines are optimized for scalability, performance, and fault tolerance.</p><p>· Optimize SQL queries, data models, and pipeline performance.</p><p>· Ensure efficient use of cloud-native resources (compute, storage, networking).</p><p>· Design and implement data architecture across data lakes, data warehouses, and lakehouses.</p><p>· Optimize data storage strategies (partitioning, indexing, schema design).</p><p>· Implement data integration from diverse sources (databases, APIs, IoT, third-party systems).</p><p>· Work with Data Scientists, Analysts, and BI developers to deliver clean, well-structured data.</p><p>· Document data assets and processes for discoverability.</p><p>· Training of existing core staff who will maintain infrastructure and pipelines.</p>
<p><strong> AWS Data Engineer</strong></p><p><br></p><p><strong>Position Overview</strong></p><p>We are seeking a skilled IT Data Integration Engineer / AWS Data Engineer to join our team and lead the development and optimization of data integration processes. This role is critical to ensuring seamless data flow across systems, enabling high-quality, consistent, and accessible data to support business intelligence and analytics initiatives. This is a long-term contract role in Southern California.</p><p><strong>Key Responsibilities</strong></p><ul><li>Develop and Maintain Data Integration Solutions</li><li>Design and implement data workflows using AWS Glue, EMR, Lambda, and Redshift.</li><li>Utilize PySpark, Apache Spark, and Python to process large datasets.</li><li>Ensure accurate and efficient ETL (Extract, Transform, Load) operations.</li></ul><p>Ensure Data Quality and Integrity</p><ul><li>Validate and cleanse data to maintain high standards of quality.</li><li>Implement monitoring, validation, and error-handling mechanisms.</li></ul><p>Optimize Data Integration Processes</p><ul><li>Enhance performance and scalability of data workflows on AWS infrastructure.</li><li>Apply data warehousing concepts including star/snowflake schema design and dimensional modeling.</li><li>Fine-tune queries and optimize Redshift performance.</li></ul><p>Support Business Intelligence and Analytics</p><ul><li>Translate business requirements into technical specifications and data pipelines.</li><li>Collaborate with analysts and stakeholders to deliver timely, integrated data.</li></ul><p>Maintain Documentation and Compliance</p><ul><li>Document workflows, processes, and technical specifications.</li><li>Ensure adherence to data governance policies and regulatory standards.</li></ul>
<p>We are looking for a highly skilled Data Engineering and Software Engineering professional to design, build, and optimize our Data Lake and Data Processing platform on AWS. This role requires deep expertise in data architecture, cloud computing, and software development, as well as the ability to define and implement strategies for deployment, testing, and production workflows.</p><p><br></p><p>Key Responsibilities:</p><ul><li>Design and develop a scalable Data Lake and data processing platform from the ground up on AWS.</li><li>Lead decision-making and provide guidance on code deployment, testing strategies, and production environment workflows.</li><li>Define the roadmap for Data Lake development, ensuring efficient data storage and processing.</li><li>Oversee S3 data storage, Delta.io for change data capture, and AWS data processing services.</li><li>Work with Python and PySpark to process large-scale data efficiently.</li><li>Implement and manage Lambda, Glue, Kafka, and Firehose for seamless data integration and processing.</li><li>Collaborate with stakeholders to align technical strategies with business objectives, while maintaining a hands-on engineering focus.</li><li>Drive innovation and cost optimization in data architecture and cloud infrastructure.</li><li>Provide expertise in data warehousing and transitioning into modern AWS-based data processing practices.</li></ul>
We are looking for a skilled Data Engineer to join our team in Chicago, Illinois. In this long-term contract role, you will contribute to the development and maintenance of robust data infrastructures that support business intelligence solutions. If you thrive in a collaborative environment and enjoy solving complex problems, this position offers an excellent opportunity to apply your expertise and drive impactful projects forward.<br><br>Responsibilities:<br>• Design, build, and maintain scalable data infrastructures to support business intelligence needs.<br>• Develop and implement data models and frameworks that optimize data analysis and reporting.<br>• Collaborate with business partners to understand data requirements and deliver effective solutions.<br>• Lead initiatives in business intelligence projects, ensuring alignment with organizational goals.<br>• Apply compliance standards within project scope, document processes, and participate in related activities.<br>• Utilize industry knowledge to enhance data solutions and provide informed recommendations.<br>• Work on the full data warehouse lifecycle, including data analysis, dimensional modeling, and design.<br>• Solve complex problems using proven methodologies and adapt them to new challenges.<br>• Assist team members informally with troubleshooting and knowledge sharing.<br>• Leverage tools such as Apache Spark, Python, Hadoop, Kafka, and ETL processes to optimize data workflows.
<p>We are looking for an experienced Data Engineer to join our team in Houston. In this role, you will design and optimize data pipeline architecture, ensuring the seamless integration and analysis of structured and unstructured data. You will collaborate with stakeholders to deliver reliable and scalable data solutions that align with organizational objectives.</p><p><br></p><p>Responsibilities:</p><p>• Design, develop, and maintain scalable data pipelines using Microsoft Fabric components, including Azure Data Factory, Lakehouse, Data Warehouses, and Dataflows.</p><p>• Implement solutions for extracting, integrating, and processing large volumes of structured and unstructured data.</p><p>• Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver tailored solutions.</p><p>• Optimize and troubleshoot data pipelines to ensure high performance and reliability.</p><p>• Apply data governance and security best practices to maintain data integrity and compliance.</p><p>• Monitor and enhance data infrastructure to ensure scalability and availability.</p><p>• Stay informed on advancements in data engineering and Microsoft Fabric technologies to drive innovation.</p><p>• Manage the Data Platform roadmap, including capacity planning, future-proofing, and optimization.</p><p>• Address data quality issues by tracing lineage, implementing cleansing processes, and ensuring consistency.</p><p>• Coordinate with IT Operations and external vendors to resolve production issues and improve platform capabilities.</p>
We are seeking a Data Engineer to join our team based in Bethesda, Maryland. As part of our Investment Management team, you will play a crucial role in designing and maintaining data pipelines in our Azure Data Lake, implementing data warehousing strategies, and collaborating with various teams to address data engineering needs.<br><br>Responsibilities:<br><br>• Design robust data pipelines within Azure Data Lake to support our investment management operations.<br>• Implement effective data warehousing strategies that ensure efficient storage and retrieval of data.<br>• Collaborate with Power BI developers to integrate data reporting seamlessly and effectively.<br>• Conduct data validation and audits to uphold the accuracy and quality of our data pipelines.<br>• Troubleshoot pipeline processes and optimize them for improved performance.<br>• Work cross-functionally with different teams to address and fulfill data engineering needs with a focus on scalability and reliability.<br>• Utilize Apache Kafka, Apache Pig, Apache Spark, and other cloud technologies for efficient data visualization and algorithm implementation.<br>• Develop APIs and use AWS technologies to ensure seamless data flow and analytics.<br>• Leverage Apache Hadoop for effective data management and analytics.
<p>We are looking for a skilled Software Developer with expertise to join our team in Washington, DC. This is a long-term contract position offering the opportunity to work on innovative projects and contribute to the development of high-quality software solutions. The ideal candidate will possess strong problem-solving skills and collaborate with cross-functional teams to ensure seamless application performance and scalability.</p><p><br></p><p>As a Data Engineer, you will:</p><ul><li>Design and optimize <strong>data ingestion and indexing pipelines</strong></li><li>Work with <strong>structured and unstructured data</strong> to support real-time search capabilities</li><li>Develop and maintain workflows using <strong>Airflow</strong>, <strong>PySpark</strong>, and <strong>Databricks</strong></li><li>Build and deploy infrastructure using <strong>Terraform</strong></li><li>Index data into <strong>Elasticsearch</strong> or <strong>AWS Search</strong> with low latency</li><li>Troubleshoot <strong>networking and cloud infrastructure issues</strong></li><li>Collaborate on potential <strong>API service development</strong> (in planning phase)</li><li>Contribute to infrastructure scalability (possible use of <strong>Kubernetes)</strong></li></ul>
We are looking for a highly skilled Data Engineer to oversee critical database migration projects for enterprise-level systems. In this long-term contract position, you will play a pivotal role in transitioning on-premises DB2 databases to upgraded infrastructure while ensuring system reliability and performance. This role is based in Salt Lake City, Utah, and offers an excellent opportunity to showcase your expertise in DB2 administration and database optimization.<br><br>Responsibilities:<br>• Lead the migration of DB2 11.5 databases to upgraded infrastructure, ensuring seamless transitions and minimal disruption.<br>• Assess and recommend hardware, licensing, and configuration requirements to meet technical and business needs.<br>• Collaborate with internal IT teams to install and validate new equipment, ensuring proper setup and functionality.<br>• Optimize database performance and reliability throughout the migration process.<br>• Provide architectural guidance and design solutions for enhanced database infrastructure.<br>• Document all migration processes and share knowledge with internal teams to ensure long-term system support.<br>• Work closely with stakeholders to align technical solutions with business objectives.<br>• Troubleshoot and resolve complex database issues to maintain system stability.<br>• Offer strategic insights for future database upgrades and enhancements.<br>• Ensure compliance with best practices and industry standards during all phases of the migration.
We are looking for an experienced Data Engineer to join our team in Johns Creek, Georgia, on a Contract to permanent basis. This position offers an exciting opportunity to design and optimize data pipelines, manage cloud systems, and contribute to the scalability of our Azure environment. The ideal candidate will bring advanced technical skills and a collaborative mindset to support critical data infrastructure initiatives.<br><br>Responsibilities:<br>• Develop and enhance data pipelines using Azure Data Factory to ensure efficient data processing and integration.<br>• Manage and administer Azure Managed Instances to support database operations and ensure system reliability.<br>• Implement real-time data replication from on-premises systems to cloud environments to support seamless data accessibility.<br>• Utilize advanced ETL tools and processes to transform and integrate complex data workflows.<br>• Collaborate with cross-functional teams to ensure data integration across systems, with a preference for experience in Salesforce integration.<br>• Leverage real-time streaming technologies such as Confluent Cloud or Apache Kafka to support dynamic data environments.<br>• Optimize data workflows using tools like Apache Spark and Hadoop to enhance processing performance.<br>• Troubleshoot and resolve database-related issues to maintain system stability and performance.<br>• Work closely with stakeholders to understand data requirements and provide innovative solutions.
We are looking for an experienced Data Engineer to join our team on a contract basis in Cleveland, Ohio. This role involves creating scalable data solutions, optimizing database environments, and supporting business intelligence reporting for manufacturing metrics. The ideal candidate will have expertise in modern data engineering practices and a strong ability to collaborate with stakeholders.<br><br>Responsibilities:<br>• Redesign and optimize existing data models to improve efficiency and scalability.<br>• Structure and organize incoming data to ensure seamless integration into reporting systems.<br>• Build advanced time intelligence features within Power BI to enhance reporting capabilities.<br>• Craft operational reports that provide actionable insights on manufacturing metrics.<br>• Develop and implement reporting solutions that deliver measurable business value.<br>• Utilize modern data transformation tools, such as dbt, to streamline workflows.<br>• Support analytical reporting and contract review processes by ensuring accurate data representation.<br>• Assist in establishing a robust database environment that integrates well with Power BI.<br>• Collaborate with stakeholders to understand data requirements and translate them into actionable solutions.<br>• Explore and implement forward-thinking data engineering practices to enhance system performance.
<p>We are looking for a skilled Data Engineer to join our team. In this role, you will play a key part in designing and building scalable data solutions to support our mission of improving cancer care. The ideal candidate will thrive in a collaborative environment and have a strong background in developing robust data pipelines and working with cloud-based platforms.</p><p><br></p><p>Responsibilities:</p><p>• Design and implement scalable, componentized processes to enhance the business intelligence platform.</p><p>• Develop and optimize robust data pipelines to support data integration and transformation.</p><p>• Collaborate with cross-functional teams to translate requirements into actionable tasks and deliverables.</p><p>• Evaluate and utilize big data and cloud technologies to deliver effective solutions.</p><p>• Troubleshoot and resolve technical issues efficiently, while identifying opportunities for process improvements.</p><p>• Maintain clear documentation and communicate effectively with team members about code functionality.</p><p>• Adapt to shifting priorities and requirements in an agile development environment.</p><p>• Implement instrumentation, logging, and alerting practices to ensure system reliability</p>
