Data Engineer

About the job

Summary: Data Engineer with Machine Learning/Spark/Scala and Java. Responsibilities: Required Skills: • Big Data experience, • 3+ year experience in Java, Python and Scala, Spark and Machine Learning, • Data mining, Data analysis Desirable Skills: • Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.), • Work closely with our engineering team to integrate and build algorithms, • Process unstructured data into a form suitable for analysis – and then do the analysis, • Support business decisions with ad hoc analysis as needed, • Extract data from a variety of relational databases, manipulate, explore data using quantitative, statistical and visualization tools, • Inform the selection of appropriate modelling techniques to ensure that predictive models are developed using rigorous statistical processes, • Establish and maintain effective processes for validating and updating predictive models, • Analyse, model, and forecast health service utilization patterns/trends and create capability to model outcomes of what-if scenarios for novel health care delivery models, • Collaborate with internal business, analytics and data strategy partners to improve efficiency and increase applicability of predictive models into the core software products, • Perform statistical analysis to prioritize to maximize success, • Identify areas for improvement, communicating action plans, • Perform strategic data analysis and research to support business needs, • Identify opportunities to improve productivity via sophisticated statistical modelling, • Explore data to identify opportunities to improve business results, • Develop understanding of business processes, goals and strategy to provide analysis and interpretation to management, • Gain understanding of business needs and necessary analysis where appropriate through internal discussion

Requirements

• Big Data experience
• Java
• Python
• Scala
• Spark
• Machine Learning

Preferred Technologies

• Big Data experience
• Java
• Python
• Scala
• Spark
• Machine Learning