About the job
Position Title Data Engineer Department R&D Grade/Level/Experience 5+ years of experience in this profile Reporting To Head of R&D/ Senior Manager Digital & Analytics Role Summary This role will serve dual responsibilities: 1. Schema Steward (Metadata Owner) to maintain authoritative metadata standards, IDs, naming conventions, and data definitions across the Data Lake. 2. Data Engineer to ... build, validate, and maintain extraction and file-drop pipelines fromsystems such as TDMS and PDM, ensuring high-quality, structured, and consistentdataingestion. The role ensures metadata consistency, technical feasibility, and smooth execution ofintegration activities across all phases. Key Responsibilities 1. Metadata Ownership (Schema Steward) • Own and continuously update the Metadata Dictionary for all R&D domains. • Define and standardize unique identifiers such as Variant_ID, Compound_ID,DOE_ID, Test_ID, etc. • Maintain naming conventions, versioning rules, and schema evolution practices. • Validate sample metadata records to ensure adherence to standards. • Ensure metadata consistency across all tools, systems, dashboards, and analyticaluse cases. • Collaborate with IT Architect and functional SMEs to maintain a robust metadatagovernance framework. 2. Data Engineering Responsibilities • Support R&D tools data extraction, cleansing, normalization, and ingestionprocesses. • Design and assist with structured file-drop or automated ingestion pipelines for DataLake loading. • Perform feasibility validation for Phase-2 integration candidates, assessing dataavailability, structure, volume, and integration complexity. • Conduct data discovery and profiling to understand source system nuances. • Collaborate with the Architect to ensure data models comply with designed contractsand metadata rules. • Implement pipeline monitoring, error handling, and data quality checks.
Requirements
- Data Engineering
- Metadata Governance
- ETL
- Data Transformation
Qualifications
- Bachelor’s Degree
Preferred Technologies
- Data Engineering
- Metadata Governance
- ETL
- Data Transformation
Similar Jobs
Data Engineer
LTIMindtree
Data Engineer
EY
Data Engineer
Tata Consultancy Services