Senior Data / AI Engineer

About the job

Hiring: Senior Data / AI Engineer (Databricks) Looking for a hands-on engineer with 6+ years of experience building large-scale data and AI platforms. Key Skills & Experience: • Databricks platform and distributed data processing • Apache Spark ecosystem (PySpark / Spark SQL / Spark Streaming) • Strong programming in Python, PySpark, SQL, or Scala • Designing scalable data pipelines (batch & streaming) • Data architecture, data modeling, and large-scale data processing • Experience with Kafka or similar streaming technologies • Building and managing data pipelines, clusters, notebooks, and jobs in Databricks • Data transformation tasks: cleansing, aggregation, enrichment, normalization • Experience with cloud platforms (Azure / AWS / GCP) • Implementing DataOps / DevOps practices and CI/CD pipelines • Exposure to machine learning frameworks (Spark MLlib, TensorFlow, PyTorch) Experience in designing end-to-end data engineering solutions and migrating data platforms from on-premise to cloud environments is highly valued. Candidates with strong Databricks + Spark + production ML systems experience will be prioritized. If you have built real production data platforms or AI solutions, please DM or share your profile.

Requirements

• Databricks
• Apache Spark
• Python
• PySpark
• SQL
• Scala
• Kafka
• Cloud platforms (Azure/AWS/GCP)
• DataOps
• Machine Learning frameworks

Preferred Technologies

• Databricks
• Apache Spark
• Python
• PySpark
• SQL
• Scala
• Kafka
• Cloud platforms (Azure/AWS/GCP)
• DataOps
• Machine Learning frameworks

About the company

We Win Limited is involved in building large-scale data and AI platforms, focusing on data processing and engineering using advanced technologies such as Databricks and Apache Spark.