<p>We are seeking a highly skilled Data Engineer to design, build, and manage our data infrastructure. The ideal candidate is an expert in writing complex SQL queries, designing efficient database schemas, and developing ETL/ELT pipelines. This role ensures data accuracy, accessibility, and performance optimization to support business intelligence, analytics, and reporting initiatives.</p><p><br></p><p><strong><em><u>Key Responsibilities</u></em></strong></p><p><br></p><p><strong>Database Design & Management</strong></p><ul><li>Design, develop, and maintain relational databases, including SQL Server, PostgreSQL, and Oracle, as well as cloud-based data warehouses.</li></ul><p><strong>Strategic SQL & Data Engineering</strong></p><ul><li>Develop advanced, optimized SQL queries, stored procedures, and functions to process and analyze large, complex datasets and deliver actionable business insights.</li></ul><p><strong>Data Pipeline Automation & Orchestration</strong></p><ul><li>Build, automate, and orchestrate ETL/ELT workflows using SQL, Python, and cloud-native tools to integrate and transform data from diverse, distributed sources.</li></ul><p><strong>Performance Optimization</strong></p><ul><li>Tune SQL queries and optimize database schemas through indexing, partitioning, and normalization to improve data retrieval and processing performance.</li></ul><p><strong>Data Integrity & Security</strong></p><ul><li>Ensure data quality, consistency, and integrity across systems.</li><li>Implement data masking, encryption, and role-based access control (RBAC).</li></ul><p><strong>Documentation</strong></p><ul><li>Maintain comprehensive technical documentation, including database schemas, data dictionaries, and ETL workflows.</li></ul>
We are looking for an experienced Data Engineer to join our team in New York, New York. In this role, you will design, build, and maintain data infrastructure to support business intelligence and analytics needs. The ideal candidate will have a strong technical background, a passion for working with complex datasets, and expertise in cloud-based data platforms.<br><br>Responsibilities:<br>• Develop, implement, and optimize ETL pipelines to ensure efficient data processing and integration.<br>• Design and maintain scalable data solutions, including data warehouses and data lakes.<br>• Collaborate with cross-functional teams to identify data requirements and deliver actionable insights.<br>• Utilize Snowflake, AWS, and other cloud-based platforms to manage data infrastructure and ensure performance optimization.<br>• Leverage Python and SQL to build robust data workflows and automate processes.<br>• Employ orchestration tools like Airflow and dbt to streamline data operations.<br>• Support data analytics and visualization efforts by enabling the creation of impactful dashboards using tools such as Tableau.<br>• Work with marketing and product data sources, including platforms like Google Analytics, to extract and integrate valuable insights.<br>• Implement CI/CD pipelines and DevOps practices to enhance data engineering processes.<br>• Ensure data security and compliance across all systems and tools.
We are looking for a highly skilled Senior Data Engineer to join our team in Edgewood, New York. This role is ideal for someone who is detail oriented and has expertise in developing scalable data pipelines, modeling data structures, and optimizing data infrastructure for performance and reliability. The right candidate will play a key role in shaping our data engineering function and collaborating with cross-functional teams to deliver impactful solutions.<br><br>Responsibilities:<br>• Design and maintain efficient and scalable data pipelines to support various operational and commercial systems.<br>• Develop and manage modern data warehouse infrastructure using tools such as BigQuery and dbt.<br>• Integrate, transform, and organize data from multiple sources into structured, queryable formats.<br>• Create and manage logical and physical data models to enhance analytics and reporting capabilities.<br>• Collaborate with stakeholders to enable self-service reporting and build dashboards using platforms like Looker and Looker Studio.<br>• Implement best practices for data engineering, including testing, monitoring, and ensuring pipeline reliability.<br>• Optimize the performance, scalability, and cost-efficiency of data pipelines and warehouses.<br>• Partner with engineering, operations, and business teams to translate data needs into scalable solutions.<br>• Contribute to the improvement of engineering processes, coding standards, and documentation.<br>• Mentor team members and support onboarding as the team grows.
Design, build, and maintain scalable test automation frameworks using tools such as Playwright, Appium, Selenium, Cypress, and others. Collaborate with cross-functional teams to define test strategies and ensure comprehensive test coverage. Develop and maintain automated test scripts in Java, JavaScript, and C#. Integrate automated tests into CI/CD pipelines to support continuous delivery. Analyze test results, identify root causes, and drive resolution of issues. Mentor and support entry level engineers, fostering a culture of continuous learning and improvement. Communicate effectively with stakeholders to report progress, risks, and quality metrics. Solid Manual testing skills. Ability to understand and articulate complicated requirements for test case creation.