Senior Data / AI Engineer (Databricks)

About the job

🚀 Hiring: Senior Data / AI Engineer (Databricks) Looking for a hands-on engineer with 6+ years of experience building large-scale data and AI platforms. Key Skills & Experience: • Databricks platform and distributed data processing • Apache Spark ecosystem (PySpark / Spark SQL / Spark Streaming) • Strong programming in Python, PySpark, SQL, or Scala • Designing scalable data pipelines (batch & streaming) • Data architecture, data modeling, and large-scale data processing • Experience with Kafka or similar streaming technologies • Building and managing data pipelines, clusters, notebooks, and jobs in Databricks • Data transformation tasks: cleansing, aggregation, enrichment, normalization • Experience with cloud platforms (Azure / AWS / GCP) • Implementing DataOps / DevOps practices and CI/CD pipelines • Exposure to machine learning frameworks (Spark MLlib, TensorFlow, PyTorch) Experience in designing end-to-end data engineering solutions and migrating data platforms from on-premise to cloud environments is highly valued. ⚠️ Candidates with strong Databricks + Spark + production ML systems experience will be prioritized. If you have built real production data platforms or AI solutions, please DM or share your profile.

Requirements

• Databricks
• Apache Spark
• Python
• PySpark
• SQL
• Scala
• Data architecture
• Cloud platforms

Preferred Technologies

• Databricks
• Apache Spark
• Python
• PySpark
• SQL
• Scala
• Data architecture
• Cloud platforms