We are looking for a skilled Data Engineer to join our team in Chicago, Illinois. This long-term contract role offers an exciting opportunity to contribute to the development and optimization of data systems while working with advanced technologies. The ideal candidate will bring expertise in building efficient data pipelines, managing large datasets, and integrating data processes to support business objectives.<br><br>Responsibilities:<br>• Develop, implement, and maintain scalable data pipelines using tools such as Apache Spark and Hadoop.<br>• Optimize ETL processes to ensure efficient extraction, transformation, and loading of data.<br>• Collaborate with cross-functional teams to understand data needs and design solutions that align with business goals.<br>• Manage large-scale datasets, ensuring data integrity and accuracy.<br>• Integrate data from various sources using Apache Kafka and other relevant technologies.<br>• Monitor and troubleshoot data systems to identify and resolve performance issues.<br>• Create documentation and provide training on data processes to support team operations.<br>• Conduct regular reviews of data architecture to enhance system functionality.<br>• Ensure compliance with data governance and security standards.<br>• Work closely with stakeholders to deliver actionable insights and reporting based on data analytics.
