About the job
Hiring: Senior Data / AI Engineer (Databricks) Looking for a hands-on engineer with 6+ years of experience building large-scale data and AI platforms. Key Skills & Experience: • Databricks platform and distributed data processing • Apache Spark ecosystem (PySpark / Spark SQL / Spark Streaming) • Strong programming in Python, PySpark, SQL, or Scala • Designing scalable data pipelines (batch & streaming) • Data architecture, data modeling, and large-scale data processing • Experience with Kafka or similar streaming technologies • Building and managing data pipelines, clusters, notebooks, and jobs in Databricks • Data transformation tasks: cleansing, aggregation, enrichment, normalization • Experience with cloud platforms (Azure / AWS / GCP) • Implementing DataOps / DevOps practices and CI/CD pipelines • Exposure to machine learning frameworks (Spark MLlib, TensorFlow, PyTorch) Experience in designing end-to-end data engineering solutions and migrating data platforms from on-premise to cloud environments is highly valued. Candidates with strong Databricks + Spark + production ML systems experience will be prioritized. If you have built real production data platforms or AI solutions, please DM or share your profile.
Requirements
- Databricks
- Apache Spark
- Python
- PySpark
- SQL
- Scala
- Kafka
- Cloud platforms (Azure/AWS/GCP)
- DataOps
- Machine Learning frameworks
Preferred Technologies
- Databricks
- Apache Spark
- Python
- PySpark
- SQL
- Scala
- Kafka
- Cloud platforms (Azure/AWS/GCP)
- DataOps
- Machine Learning frameworks
About the company
We Win Limited is involved in building large-scale data and AI platforms, focusing on data processing and engineering using advanced technologies such as Databricks and Apache Spark.
Similar Jobs
Senior Data / AI Engineer
We Win Limited
Senior AI Engineer
Senior Data Engineer
Morningstar