Senior Backend Engineer (Spark, Java & Microservices)

About the job

We are seeking an experienced and passionate Senior Backend Engineer with strong expertise in Apache Spark, Java, and Microservices to join our growing data platform and backend services team. In this role, you will be instrumental in designing, developing, and optimizing our core data processing pipelines and building highly scalable, resilient microservices that handle vast amounts of data and serve critical business functions. Key Responsibilities: • Microservices Development : Design, develop, and maintain high-performance, scalable, and resilient microservices using Java and Spring Boot (or similar frameworks). • API Design : Define, implement, and manage robust RESTful APIs for internal and external consumption, ensuring security, performance, and clear documentation. • Data Pipelines : Build and maintain efficient ETL / ELT pipelines for batch and real-time data processing using Apache Spark, ensuring data quality, reliability, and timeliness. • Optimization : Identify and resolve performance bottlenecks in Spark jobs and Java applications / microservices, optimizing resource utilization and execution times. • Collaboration : Work closely with data scientists, product managers, frontend engineers, and other engineering teams to understand requirements and translate them into technical solutions and API contracts. • Code Quality : Write clean, well-tested, and maintainable code, participating actively in code reviews and promoting best practices (e.g., TDD, BDD, clean architecture) within the team. • Deployment & Operations : Collaborate with DevOps teams to ensure seamless deployment, monitoring, and operational excellence of microservices and data pipelines. • Troubleshooting : Diagnose and resolve complex technical issues related to distributed systems, microservices communication, data processing, and backend services. Required Qualifications: • Experience : 5+ years of professional experience in backend software development, with a significant focus on distributed systems and microservices. • Java Expertise : Strong proficiency in Java, with a deep understanding of object-oriented design principles, concurrency, and experience with the JVM ecosystem. • Microservices Frameworks : Extensive hands-on experience with popular Java frameworks like Spring Boot for building robust and scalable microservices. • API Development : Proven experience in designing, developing, and consuming RESTful APIs. • Spark Expertise : Extensive hands-on experience with Apache Spark (Spark SQL, Spark Streaming, DataFrames, RDDs), including performance tuning and optimization techniques, preferably using the Java API. • Big Data Ecosystem : Experience with big data technologies such as Hadoop, Kafka, Flink, or similar distributed streaming platforms. • Cloud Platforms : Hands-on experience with at least one major cloud provider (AWS, GCP, Azure). • Databases : Experience with both relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., Cassandra, MongoDB, DynamoDB, Redis). • Containerization & Orchestration : Experience with Docker and Kubernetes for deploying and managing microservices. • Version Control : Proficiency with Git and collaborative development workflows. Nice-to-Haves: • Familiarity with CI / CD pipelines (e.g., Jenkins, GitLab CI, GitHub Actions) and DevOps practices. • Experience with monitoring and logging tools for distributed systems (e.g., Prometheus, Grafana, ELK Stack, Splunk, Datadog). • Experience with other JVM languages (e.g., Scala, Kotlin).

Requirements

• Apache Spark
• Java
• Microservices
• ETL
• API

Preferred Technologies

• Apache Spark
• Java
• Microservices
• ETL
• API