We are looking for a skilled Data Engineer to join our team on a contract basis in Cincinnati, Ohio. In this role, you will design, develop, and maintain data pipelines, ensuring effective data processing and integration. Your expertise will help drive the success of our data-driven initiatives.<br><br>Responsibilities:<br>• Develop and optimize scalable data pipelines to efficiently process and transform large datasets.<br>• Implement and maintain ETL processes to ensure accurate data extraction, transformation, and loading.<br>• Work with tools like Apache Spark, Hadoop, and Kafka to manage and process data effectively.<br>• Collaborate with cross-functional teams to understand data requirements and deliver suitable solutions.<br>• Ensure data security, integrity, and high availability across platforms.<br>• Conduct performance tuning of data systems to enhance efficiency and reliability.<br>• Troubleshoot and resolve data-related technical issues promptly.<br>• Create and maintain documentation for data workflows, systems, and processes.<br>• Stay updated on emerging technologies to improve data engineering practices.
<p><strong>Data Engineer (On-Site, West Los Angeles CA)</strong></p><p><br></p><p><strong>Salary:</strong> Up to $160K DOE</p><p><br></p><p>We’re seeking an experienced <strong>Data Engineer</strong> to help modernize and centralize enterprise data architecture, enabling scalable analytics and AI applications. This on-site role collaborates closely with business and technology teams to unify data from platforms such as Microsoft Dynamics 365, Adobe Experience Platform, and Power BI—transforming fragmented data sources into a cohesive, AI-ready foundation.</p><p><br></p><p><strong>Key Responsibilities:</strong></p><ul><li>Design and implement a centralized, scalable data model using medallion/Lakehouse architecture.</li><li>Build and optimize data pipelines using Azure SQL DB, PostgreSQL, Microsoft Fabric, and Kafka.</li><li>Integrate and manage data from diverse systems including D365, Adobe Experience Platform, and API-based sources.</li><li>Ensure data quality, governance, and compliance across the lifecycle.</li><li>Develop reusable, production-ready data assets for analytics and AI/ML workloads.</li></ul><p><br></p><p>For immediate consideration, apply now and message Reid Gormly on LinkedIN today!</p>
<p><strong>Data Engineer (Hybrid, Los Angeles)</strong></p><p><strong>Location:</strong> Los Angeles, California</p><p><strong>Compensation:</strong> $140,000 - $175,000 per year</p><p><strong>Work Environment:</strong> Hybrid, with onsite requirements</p><p>Are you passionate about crafting highly-scalable and performant data systems? Do you have expertise in Azure Databricks, Spark SQL, and real-time data pipelines? We are searching for a talented and motivated <strong>Data Engineer</strong> to join our team in Los Angeles. You'll work in a hybrid environment that combines onsite collaboration with the flexibility of remote work.</p><p><strong>Key Responsibilities:</strong></p><ul><li>Design, develop, and implement data pipelines and ETL workflows using cutting-edge Azure technologies (e.g., Databricks, Synapse Analytics, Synapse Pipelines).</li><li>Manage and optimize big data processes, ensuring scalability, efficiency, and data accuracy.</li><li>Build and work with real-time data pipelines leveraging technologies such as Kafka, Event Hubs, and Spark Streaming.</li><li>Apply advanced skills in Python and Spark SQL to build data solutions for analytics and machine learning.</li><li>Collaborate with business analysts and stakeholders to implement impactful dashboards using Power BI.</li><li>Architect and support the seamless integration of diverse data sources into a central platform for analytics, reporting, and model serving via ML Flow.</li></ul><p><br></p>
<p><strong>Overview</strong></p><p> The Data Engineer is responsible for building and maintaining the data infrastructure that powers analytics, reporting, and data-driven decision-making across the organization. This role requires hands-on experience with data modeling, ETL/ELT development, and modern cloud data platforms. The ideal candidate is skilled at transforming raw data into clean, reliable datasets and optimizing data pipelines for performance and scalability.</p><p><strong>Key Responsibilities</strong></p><ul><li>Design, build, and maintain <strong>data pipelines</strong> and <strong>ETL/ELT workflows</strong> that move and transform data from various sources into centralized data warehouses or data lakes.</li><li>Develop and manage <strong>data models</strong>, schemas, and metadata to ensure consistency, scalability, and performance.</li><li>Work with large, complex datasets using tools like <strong>SQL, Python, and Spark</strong> to automate data ingestion and transformation.</li><li>Collaborate with analysts, data scientists, and business stakeholders to understand data needs and support analytical initiatives.</li><li>Implement and maintain <strong>data quality, governance, and validation processes</strong> to ensure accuracy and reliability.</li><li>Optimize data pipeline performance and cost across cloud environments such as <strong>AWS, Azure, or Google Cloud</strong>.</li><li>Support <strong>data warehouse development</strong> using platforms such as <strong>Snowflake, Redshift, BigQuery, or Synapse</strong>.</li><li>Troubleshoot and resolve data issues in production environments, ensuring minimal downtime and data integrity.</li><li>Maintain documentation for data pipelines, system architecture, and transformation logic.</li><li>Stay current with emerging data engineering technologies and recommend improvements to architecture and process design.</li></ul><p><br></p>
We are looking for an experienced Senior Data Engineer to join our team in Glendale, California. In this long-term contract position, you will play a critical role in ensuring secure and efficient data management across enterprise systems, leveraging cutting-edge tools and methodologies. The ideal candidate will bring expertise in data governance, security, and engineering to support large-scale enterprise environments.<br><br>Responsibilities:<br>• Implement and manage data access governance solutions using tools such as Immuta, SecuPi, or similar technologies.<br>• Develop and maintain data lineage, cataloging, and classification systems with tools like Alation or BigID.<br>• Collaborate with stakeholders to ensure compliance with data security policies and standards.<br>• Design and optimize secure data pipelines and workflows in enterprise environments.<br>• Apply agile and scrum methodologies to manage projects effectively and enhance team collaboration.<br>• Monitor and troubleshoot data systems to ensure optimal performance and security.<br>• Provide expertise in Snowflake configuration and management, ensuring secure data access and storage.<br>• Conduct audits and assessments to identify and mitigate data security risks.<br>• Work closely with cross-functional teams to implement best practices in data governance and engineering.<br>• Stay updated on industry trends and emerging technologies to continuously improve data security strategies.
<p>We are looking for an experienced Senior Data Engineer to join our team in Oxford, Massachusetts. In this role, you will design and maintain data platforms, leveraging cutting-edge technologies to optimize processes and drive analytical insights. This position requires a strong background in Python development, cloud technologies, and big data tools. This role is hybrid, onsite 3 days a week. Candidates must have GC or be USC.</p><p><br></p><p>Responsibilities:</p><p>• Develop, implement, and maintain scalable data platforms to support business needs.</p><p>• Utilize Python and PySpark to design and optimize data workflows.</p><p>• Collaborate with cross-functional teams to integrate data solutions with existing systems.</p><p>• Leverage Snowflake and other cloud technologies to manage and store large datasets.</p><p>• Implement and refine algorithms for data processing and analytics.</p><p>• Work with Apache Spark and Hadoop to build robust data pipelines.</p><p>• Create APIs to enhance data accessibility and integration.</p><p>• Monitor and troubleshoot data platforms to ensure optimal performance.</p><p>• Stay updated on emerging trends in big data and cloud technologies to continuously improve solutions.</p><p>• Participate in technical discussions and provide expertise during team reviews.</p>
<p><strong>Data Engineer (Hybrid, Los Angeles)</strong></p><p><strong>Location:</strong> Los Angeles, California</p><p><strong>Compensation:</strong> $140,000 - $175,000 per year</p><p><strong>Work Environment:</strong> Hybrid, with onsite requirements</p><p>Are you passionate about crafting highly-scalable and performant data systems? Do you have expertise in Azure Databricks, Spark SQL, and real-time data pipelines? We are searching for a talented and motivated <strong>Data Engineer</strong> to join our team in Los Angeles. You'll work in a hybrid environment that combines onsite collaboration with the flexibility of remote work.</p><p><strong>Key Responsibilities:</strong></p><ul><li>Design, develop, and implement data pipelines and ETL workflows using cutting-edge Azure technologies (e.g., Databricks, Synapse Analytics, Synapse Pipelines).</li><li>Manage and optimize big data processes, ensuring scalability, efficiency, and data accuracy.</li><li>Build and work with real-time data pipelines leveraging technologies such as Kafka, Event Hubs, and Spark Streaming.</li><li>Apply advanced skills in Python and Spark SQL to build data solutions for analytics and machine learning.</li><li>Collaborate with business analysts and stakeholders to implement impactful dashboards using Power BI.</li><li>Architect and support the seamless integration of diverse data sources into a central platform for analytics, reporting, and model serving via ML Flow.</li></ul>
<p><strong>Data Engineer (Python / CRM)</strong></p><p><strong>Location:</strong> Hybrid (3 days on-site in Encino, CA)</p><p><strong>Compensation:</strong> Up to $170K DOE</p><p>We are seeking a <strong>Data Engineer</strong> with strong experience in <strong>Python</strong> and <strong>CRM systems </strong>to support data integration and pipeline development across business domains. This role will focus on modernizing data architecture and optimizing end-to-end data flows using <strong>Azure technologies</strong>.</p><p><br></p><p><strong>Key Responsibilities:</strong></p><ul><li>Design, build, and maintain scalable <strong>data pipelines</strong> supporting CRM and related business applications.</li><li>Develop integrations and ETL workflows using <strong>Databricks, Azure Data Factory, Synapse, and ADLS Gen2</strong>.</li><li>Ensure data quality, reliability, and performance across data environments.</li><li>Collaborate with cross-functional teams in Marketing, Finance, and IT to deliver scalable, data-driven solutions.</li><li>Document and optimize data processes while supporting analytics and reporting initiatives.</li></ul><p>For immediate consideration, direct message Reid Gormly on LinkedIN and Apply Today</p>
<p>Job Summary</p><p>We’re looking for a savvy Data Engineer to join the Full-Time Engagement Professionals team at Robert Half. As an Engagement Professional with Robert Half Technology, you’ll enjoy full-time employment with great pay and benefits while being offered a variety of new challenges.</p><p><br></p><p>Robert Half Technology Engagement Professionals enjoy new Data Engineering engagements with diverse clientele, and exposure to new technologies and situations through ever-changing demands of new projects and business challenges.</p><p><br></p><p>Engagement Professionals also have the opportunity to broaden their technical knowledge by working with a variety of industries, as well as learning new technical skills with free access to training modules and courses.</p><p><br></p><p>Working with your Talent Manager, you will meet regularly to discuss and update your career goals and progress.</p><p><br></p><p>Join our Full-Time Engagement Professionals team as a Data Engineer and enjoy the stability of full-time employment with a global organization while growing through the diversity of consulting opportunities!</p>
We are looking for a skilled Data Engineer to join our team in Cleveland, Ohio. This long-term contract position offers the opportunity to contribute to the development and optimization of data platforms, with a primary focus on Snowflake and Apache Airflow technologies. You will play a key role in ensuring efficient data management and processing to support critical business needs.<br><br>Responsibilities:<br>• Design, develop, and maintain data pipelines using Snowflake and Apache Airflow.<br>• Collaborate with cross-functional teams to implement scalable data solutions.<br>• Optimize data processing workflows to ensure high performance and reliability.<br>• Monitor and troubleshoot issues within the Snowflake data platform.<br>• Develop ETL processes to support data integration and transformation.<br>• Work with tools such as Apache Spark, Hadoop, and Kafka to manage large-scale data operations.<br>• Implement robust data warehousing strategies to support business intelligence initiatives.<br>• Analyze and resolve data-related technical challenges promptly.<br>• Provide support and guidance during Snowflake deployments across subsidiaries.<br>• Document processes and ensure best practices for data engineering are followed.
<p><strong>Key Responsibilities</strong></p><ul><li>Design, develop, and maintain efficient, reliable data pipelines and ETL processes using <strong>Microsoft Fabric</strong> or <strong>Databricks</strong> for large-scale data processing.</li><li>Collaborate with stakeholders to understand business requirements and create data solutions that align with technical and business strategies.</li><li>Optimize and improve workflows for data ingestion, transformation, and delivery to ensure high performance at scale.</li><li>Implement scalable architectures for big data processing, ensuring data quality, security, and governance best practices.</li><li>Develop and maintain reusable code to ensure consistency and reliability for future workflows.</li><li>Monitor and troubleshoot production environments, ensuring data systems perform as expected.</li><li>Stay current with emerging technologies, trends, and tools related to cloud-based data engineering platforms.</li></ul>
<p>We are seeking a <strong>Senior Data Engineer</strong> to lead the design, development, and optimization of our data infrastructure and analytics solutions. This role will work closely with cross-functional teams to support data-driven decision making and deliver scalable, high-impact reporting capabilities.</p><p>The ideal candidate has deep experience with <strong>SQL, Python, Power BI, DAX, and Microsoft Fabric</strong>, and can translate complex business needs into efficient data models and automated workflows.</p><p><br></p><p><strong>Key Responsibilities</strong></p><ul><li>Architect, develop, and maintain scalable <strong>data pipelines</strong> and <strong>ETL/ELT workflows</strong>.</li><li>Build and optimize <strong>data models</strong> within <strong>Microsoft Fabric</strong> to support enterprise reporting.</li><li>Develop advanced <strong>Power BI dashboards</strong> and <strong>DAX measures</strong> with strong visual and performance best practices.</li><li>Write and tune complex <strong>SQL</strong> queries and stored procedures for data extraction and transformation.</li><li>Use <strong>Python</strong> for data processing, automation, and integrating various data sources.</li><li>Ensure data quality, governance, lineage, and documentation across analytics systems.</li><li>Collaborate with business stakeholders to understand requirements and deliver actionable insights.</li><li>Drive continuous improvement of data infrastructure and engineering processes.</li></ul><p><br></p>
We are looking for a skilled Data Engineer to join our team in Johnson City, Texas. In this role, you will design and optimize data solutions to enable seamless data transfer and management in Snowflake. You will work collaboratively with cross-functional teams to enhance data accessibility and support data-driven decision-making across the organization.<br><br>Responsibilities:<br>• Design, develop, and implement ETL solutions to facilitate data transfer between diverse sources and Snowflake.<br>• Optimize the performance of Snowflake databases by constructing efficient data structures and utilizing indexes.<br>• Develop and maintain automated, scalable data pipelines within the Snowflake environment.<br>• Deploy and configure monitoring tools to ensure optimal performance of the Snowflake platform.<br>• Collaborate with product managers and agile teams to refine requirements and deliver solutions.<br>• Create integrations to accommodate growing data volume and complexity.<br>• Enhance data models to improve accessibility for business intelligence tools.<br>• Implement systems to ensure data quality and availability for stakeholders.<br>• Write unit and integration tests while documenting technical work.<br>• Automate testing and deployment processes in Snowflake within Azure.
<p>We are looking for an experienced Senior Data Engineer to join our team. This role involves designing and implementing scalable data solutions, optimizing data workflows, and driving innovation in data architecture. The ideal candidate will possess strong leadership qualities and a passion for problem-solving in a fast-paced, cutting-edge environment.</p><p><br></p><p>Responsibilities:</p><p>• Develop high-performance data systems, including databases, APIs, and data integration pipelines, to support scalable solutions.</p><p>• Design and implement metadata-driven architectures and automate deployment processes using infrastructure-as-code principles.</p><p>• Promote best practices in software engineering, such as code reviews, testing, and continuous integration/delivery (CI/CD).</p><p>• Establish and maintain a robust data governance framework to ensure compliance and data integrity.</p><p>• Monitor processes and implement improvements, including query optimization, code refactoring, and efficiency enhancements.</p><p>• Leverage cloud platforms, particularly Azure and Databricks, to improve system architecture and scalability.</p><p>• Conduct data quality checks and build procedures to address and resolve data issues effectively.</p><p>• Create and maintain documentation for data architecture, standards, and best practices.</p><p>• Provide technical leadership to the team, guiding design discussions and fostering innovation in data infrastructure.</p><p>• Identify and implement opportunities for process optimization and automation to improve operational efficiency.</p>
<p>Architect and implement a scalable Azure Data Fabric to unify on-prem and cloud data sources.</p><p>Design and develop ETL/ELT pipelines using Azure Data Factory (ADF/FDF) and potentially Apache Airflow.</p><p>Migrate and optimize data workflows from Snowflake and other platforms into Azure.</p><p>Collaborate with BI and AI teams to connect models to data sources and enable enterprise-wide intelligence.</p><p>Develop in Python and SQL, leveraging modern data engineering practices.</p><p>Support AI initiatives using tools like Enterprise Copilot and OpenAI, integrating models with real-time data.</p><p>Ensure data governance, security, and performance across all layers of the data architecture.</p><p>Mentor and collaborate with cross-functional teams, fostering a culture of innovation and data literacy</p>
<p>Are you obsessed with data and thrive on turning complexity into clarity? We’re looking for a <strong>Lead Data Engineer</strong> who lives and breathes Python, knows Snowflake inside out, and can architect scalable solutions in AWS. If you love solving hard problems, building elegant data platforms, and communicating your ideas with clarity and impact—this is your role.</p><p>🔍 What You’ll Do</p><ul><li>Design and implement cloud-native data platforms using <strong>AWS</strong> and <strong>Snowflake</strong></li><li>Build robust data pipelines and services using <strong>Python</strong> and modern engineering practices</li><li>Architect scalable solutions for data ingestion, transformation, and analytics</li><li>Collaborate with analysts, scientists, and business stakeholders to translate ideas into technical reality</li><li>Lead cross-functional teams to deliver high-impact data products</li><li>Migrate legacy systems to cloud-based platforms with minimal disruption</li><li>Define long-term data architecture strategies aligned with business goals</li><li>Mentor junior engineers and champion best practices in design, testing, and deployment</li><li>Communicate complex technical concepts in a way that resonates with non-technical audiences</li></ul><p><br></p>
<p><strong>Overview:</strong></p><p> We are looking for a Data Engineer with deep experience in AWS and Databricks to support our big data initiatives and analytics platforms.</p><p><strong>Responsibilities:</strong></p><ul><li>Build and maintain scalable data pipelines using AWS Glue, Lambda, and Databricks.</li><li>Integrate data from various sources into a unified data lake.</li><li>Optimize Spark jobs and manage cluster performance.</li><li>Collaborate with cross-functional teams to deliver data solutions.</li><li>Implement data quality checks and monitoring frameworks.</li></ul><p><br></p>
<p>We are looking for an experienced AWS/IDMC Data Engineer to join our team in Southern California. In this long-term contract position, you will play a key role in designing, developing, and optimizing data integration processes. This onsite role offers the opportunity to collaborate with cross-functional teams, ensuring seamless data workflows and high-performing systems. This role will be sitting onsite 4 days per week.</p><p><br></p><p>Responsibilities:</p><p>• Develop and implement data integration processes using Informatica Intelligent Cloud Services to meet business requirements.</p><p>• Collaborate with business analysts and data architects to design solutions for data transformation and integration.</p><p>• Create, test, and maintain application interfaces using various connectors, including Salesforce and other technologies.</p><p>• Automate and optimize data validation processes to enhance efficiency and reliability.</p><p>• Monitor and troubleshoot data workflows to ensure consistent system performance.</p><p>• Conduct evaluations of existing data landscapes and recommend architectural improvements.</p><p>• Build and optimize data pipelines into Amazon Redshift, ensuring scalability and performance.</p><p>• Utilize distributed data processing tools such as AWS Glue and Spark to manage large-scale data.</p><p>• Apply advanced data modeling techniques to streamline workflows and enhance system operations.</p><p>• Provide technical support and guidance to ensure compliance with best practices in data engineering.</p>
<p><strong>Overview:</strong></p><p> We are seeking a skilled Data Engineer with expertise in Azure cloud services and Snowflake to design, build, and maintain scalable data pipelines and infrastructure.</p><p><strong>Responsibilities:</strong></p><ul><li>Develop and optimize data pipelines using Azure Data Factory, Databricks, and Snowflake.</li><li>Implement ETL/ELT processes for structured and unstructured data.</li><li>Collaborate with data scientists and analysts to ensure data availability and quality.</li><li>Monitor and troubleshoot data workflows and performance issues.</li><li>Ensure data security and compliance with governance policies.</li></ul><p><br></p>
We are looking for an experienced Data Engineer to join our team in Brookfield, Wisconsin. This role offers the opportunity to work in a dynamic environment, tackling diverse data engineering challenges while contributing to impactful projects. As a valued team member, you will leverage advanced tools and technologies to design, optimize, and implement data solutions that support organizational goals.<br><br>Responsibilities:<br>• Develop, maintain, and optimize data pipelines to ensure efficient data flow and integration.<br>• Design and implement data models and relational database systems to support analytics and reporting.<br>• Collaborate with cross-functional teams to gather requirements and deliver data solutions aligned with business needs.<br>• Utilize tools such as Apache Spark, Hadoop, and Kafka to process and manage large-scale data.<br>• Perform Extract, Transform, Load (ETL) operations to prepare data for analysis and decision-making.<br>• Create and maintain documentation for data architecture, processes, and workflows.<br>• Monitor and troubleshoot data systems to ensure optimal performance and reliability.<br>• Integrate cloud-based data storage solutions like Snowflake or Azure into existing infrastructure.<br>• Work with data visualization tools, such as Power BI and Tableau, to provide actionable insights.<br>• Stay updated on emerging technologies and trends in data engineering to enhance system capabilities.
<p>We are looking for a highly skilled Data Engineering and Software Engineering professional to design, build, and optimize our Data Lake and Data Processing platform on AWS. This role requires deep expertise in data architecture, cloud computing, and software development, as well as the ability to define and implement strategies for deployment, testing, and production workflows.</p><p><br></p><p>Key Responsibilities:</p><ul><li>Design and develop a scalable Data Lake and data processing platform from the ground up on AWS.</li><li>Lead decision-making and provide guidance on code deployment, testing strategies, and production environment workflows.</li><li>Define the roadmap for Data Lake development, ensuring efficient data storage and processing.</li><li>Oversee S3 data storage, Delta.io for change data capture, and AWS data processing services.</li><li>Work with Python and PySpark to process large-scale data efficiently.</li><li>Implement and manage Lambda, Glue, Kafka, and Firehose for seamless data integration and processing.</li><li>Collaborate with stakeholders to align technical strategies with business objectives, while maintaining a hands-on engineering focus.</li><li>Drive innovation and cost optimization in data architecture and cloud infrastructure.</li><li>Provide expertise in data warehousing and transitioning into modern AWS-based data processing practices.</li></ul>
<p>We are looking for an experienced Data Engineer to join our team in Houston. In this role, you will design and optimize data pipeline architecture, ensuring the seamless integration and analysis of structured and unstructured data. You will collaborate with stakeholders to deliver reliable and scalable data solutions that align with organizational objectives.</p><p><br></p><p>Responsibilities:</p><p>• Design, develop, and maintain scalable data pipelines using Microsoft Fabric components, including Azure Data Factory, Lakehouse, Data Warehouses, and Dataflows.</p><p>• Implement solutions for extracting, integrating, and processing large volumes of structured and unstructured data.</p><p>• Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver tailored solutions.</p><p>• Optimize and troubleshoot data pipelines to ensure high performance and reliability.</p><p>• Apply data governance and security best practices to maintain data integrity and compliance.</p><p>• Monitor and enhance data infrastructure to ensure scalability and availability.</p><p>• Stay informed on advancements in data engineering and Microsoft Fabric technologies to drive innovation.</p><p>• Manage the Data Platform roadmap, including capacity planning, future-proofing, and optimization.</p><p>• Address data quality issues by tracing lineage, implementing cleansing processes, and ensuring consistency.</p><p>• Coordinate with IT Operations and external vendors to resolve production issues and improve platform capabilities.</p>
<p>Design, build, and optimize data pipelines within the Azure ecosystem to enable scalable analytics and business intelligence. You’ll ensure data integrity, availability, and performance across cloud-based solutions.</p>
We are looking for an experienced Data Engineer to join our team in Johns Creek, Georgia, on a Contract to permanent basis. This position offers an exciting opportunity to design and optimize data pipelines, manage cloud systems, and contribute to the scalability of our Azure environment. The ideal candidate will bring advanced technical skills and a collaborative mindset to support critical data infrastructure initiatives.<br><br>Responsibilities:<br>• Develop and enhance data pipelines using Azure Data Factory to ensure efficient data processing and integration.<br>• Manage and administer Azure Managed Instances to support database operations and ensure system reliability.<br>• Implement real-time data replication from on-premises systems to cloud environments to support seamless data accessibility.<br>• Utilize advanced ETL tools and processes to transform and integrate complex data workflows.<br>• Collaborate with cross-functional teams to ensure data integration across systems, with a preference for experience in Salesforce integration.<br>• Leverage real-time streaming technologies such as Confluent Cloud or Apache Kafka to support dynamic data environments.<br>• Optimize data workflows using tools like Apache Spark and Hadoop to enhance processing performance.<br>• Troubleshoot and resolve database-related issues to maintain system stability and performance.<br>• Work closely with stakeholders to understand data requirements and provide innovative solutions.
We are seeking a Data Engineer to join our team based in Bethesda, Maryland. As part of our Investment Management team, you will play a crucial role in designing and maintaining data pipelines in our Azure Data Lake, implementing data warehousing strategies, and collaborating with various teams to address data engineering needs.<br><br>Responsibilities:<br><br>• Design robust data pipelines within Azure Data Lake to support our investment management operations.<br>• Implement effective data warehousing strategies that ensure efficient storage and retrieval of data.<br>• Collaborate with Power BI developers to integrate data reporting seamlessly and effectively.<br>• Conduct data validation and audits to uphold the accuracy and quality of our data pipelines.<br>• Troubleshoot pipeline processes and optimize them for improved performance.<br>• Work cross-functionally with different teams to address and fulfill data engineering needs with a focus on scalability and reliability.<br>• Utilize Apache Kafka, Apache Pig, Apache Spark, and other cloud technologies for efficient data visualization and algorithm implementation.<br>• Develop APIs and use AWS technologies to ensure seamless data flow and analytics.<br>• Leverage Apache Hadoop for effective data management and analytics.
