XFactor Talent

Data Engineer

XFactor Talent
Halol Not disclosed
14 hours ago
Apply to Job

About the job

Position Title Data Engineer Department R&D Grade/Level/Experience 5+ years of experience in this profile Reporting To Head of R&D/ Senior Manager Digital & Analytics Role Summary This role will serve dual responsibilities: 1. Schema Steward (Metadata Owner) to maintain authoritative metadata standards, IDs, naming conventions, and data definitions across the Data Lake. 2. Data Engineer to ...  build, validate, and maintain extraction and file-drop pipelines fromsystems such as TDMS and PDM, ensuring high-quality, structured, and consistentdataingestion. The role ensures metadata consistency, technical feasibility, and smooth execution ofintegration activities across all phases. Key Responsibilities 1. Metadata Ownership (Schema Steward) • Own and continuously update the Metadata Dictionary for all R&D domains. • Define and standardize unique identifiers such as Variant_ID, Compound_ID,DOE_ID, Test_ID, etc. • Maintain naming conventions, versioning rules, and schema evolution practices. • Validate sample metadata records to ensure adherence to standards. • Ensure metadata consistency across all tools, systems, dashboards, and analyticaluse cases. • Collaborate with IT Architect and functional SMEs to maintain a robust metadatagovernance framework. 2. Data Engineering Responsibilities • Support R&D tools data extraction, cleansing, normalization, and ingestionprocesses. • Design and assist with structured file-drop or automated ingestion pipelines for DataLake loading. • Perform feasibility validation for Phase-2 integration candidates, assessing dataavailability, structure, volume, and integration complexity. • Conduct data discovery and profiling to understand source system nuances. • Collaborate with the Architect to ensure data models comply with designed contractsand metadata rules. • Implement pipeline monitoring, error handling, and data quality checks.

Requirements

  • Data Engineering
  • Metadata Governance
  • ETL
  • Data Transformation

Qualifications

  • Bachelor’s Degree

Preferred Technologies

  • Data Engineering
  • Metadata Governance
  • ETL
  • Data Transformation

Similar Jobs

LTIMindtree

Data Engineer

LTIMindtree

Hyderabad₹ null
YesterdayOn-Site
EY

Data Engineer

EY

HyderabadNot disclosed
2 weeks agoOn-Site
Tata Consultancy Services

Data Engineer

Tata Consultancy Services

IndiaNot disclosed
This MonthOn-Site