We are looking for a skilled and driven Data Engineer to join our team in San Juan Capistrano, California. This role centers on building and optimizing data pipelines, integrating systems, and implementing cloud-based data solutions. The ideal candidate will have a strong grasp of modern data engineering tools and techniques and a passion for delivering high-quality, scalable solutions.<br><br>Responsibilities:<br>• Design, build, and optimize scalable data pipelines using tools such as Databricks, Apache Spark, and PySpark.<br>• Develop integrations between internal systems and external platforms, including CRMs like Salesforce and HubSpot, utilizing APIs.<br>• Implement cloud-based data architectures aligned with data mesh principles.<br>• Collaborate with cross-functional teams to model, transform, and ensure the quality of data for analytics and reporting.<br>• Create and maintain APIs while testing and documenting them using tools like Postman and Swagger.<br>• Write efficient and modular Python code to support data processing workflows.<br>• Apply best practices such as version control, CI/CD, and code reviews to ensure robust and maintainable solutions.<br>• Uphold data security, integrity, and governance throughout the data lifecycle.<br>• Utilize cloud services for compute, storage, and orchestration, including platforms like AWS or Azure.<br>• Work within Agile and Scrum methodologies to deliver solutions efficiently and collaboratively.
