Senior Data Engineer

About the job

KPI Partners is seeking a skilled Senior Data Engineer with expertise in Databricks, Unity Catalog, PySpark, Python, and SQL. As a member of our dynamic team, you will be responsible for designing, developing, and maintaining scalable data pipelines and solutions that support our data-driven decision-making processes. Develop and maintain data pipelines using Databricks and PySpark to ensure efficient data processing and transformation. Utilize Unity Catalog to manage and govern data assets and ensure data quality and security. Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and deliver actionable insights. Write efficient and optimized queries using SQL to extract and manipulate data from various sources. Monitor and troubleshoot data pipeline performance, implement improvements, and provide support for data-related issues. Document data engineering processes, architecture, and workflows to ensure knowledge sharing within the team. Bachelor’s degree in computer science, Data Science, or a related field. Proven experience as a Data Engineer or in a similar role with a strong understanding of data engineering principles. Proficiency in Databricks, Unity Catalog, PySpark, Python, and SQL. Experience with data modeling, ETL processes, and data warehousing concepts. Excellent communication skills to convey technical concepts to non-technical stakeholders. Competitive salary and benefits package. Opportunities for professional development and career growth. The chance to work with cutting-edge technologies in the data engineering field. If you are passionate about data engineering and eager to contribute to a fast-paced organization, we encourage you to apply for the Data Engineer position at KPI Partners.