Data Engineer
IDFC FIRST Bank
Date: 3 weeks ago
City: Thane, Maharashtra
Contract type: Full time
Job Requirements
Role/ Job Title: Data Engineer - Gen AI
Function/ Department: Data & Analytics
Place of Work: Mumbai
Job Purpose
The data engineer will be working with our data scientists who are building solutions in domain of text, audio and images and tabular data. They will be responsible for working with large volumes of structured and unstructured data in its storage, retrieval and augmentation.
Job & Responsibilities
Graduation: Bachelor of Science (B.Sc) / Bachelor of Technology (B.Tech) / Bachelor of Computer Applications (BCA)
Post-Graduation: Master of Science (M.Sc) /Master of Technology (M.Tech) / Master of Computer Applications (MCA
Experience Range : 5-10 years of relevant experience
Role/ Job Title: Data Engineer - Gen AI
Function/ Department: Data & Analytics
Place of Work: Mumbai
Job Purpose
The data engineer will be working with our data scientists who are building solutions in domain of text, audio and images and tabular data. They will be responsible for working with large volumes of structured and unstructured data in its storage, retrieval and augmentation.
Job & Responsibilities
- Build data engineering pipeline focused on unstructured data pipelines
- Conduct requirements gathering and project scoping sessions with subject matter experts, business users, and executive stakeholders to discover and define business data needs.
- Design, build, and optimize the data architecture and extract, transform, and load (ETL) pipelines to make them accessible for Data Scientists and the products built by them.
- Work on end-to-end data lifecycle from Data Ingestion, Data Transformation and Data Consumption layer, versed with API and its usability
- Drive the highest standards in data reliability, data integrity, and data governance, enabling accurate, consistent, and trustworthy data sets
- A suitable candidate will also demonstrate experience with big data infrastructure inclusive of MapReduce, Hive, HDFS, YARN, HBase, MongoDB, DynamoDB, etc.
- Creating Technical Design Documentation of the projects/pipelines
- Good skills in technical debugging of the code in case of issues. Also, working with git for code versioning
Graduation: Bachelor of Science (B.Sc) / Bachelor of Technology (B.Tech) / Bachelor of Computer Applications (BCA)
Post-Graduation: Master of Science (M.Sc) /Master of Technology (M.Tech) / Master of Computer Applications (MCA
Experience Range : 5-10 years of relevant experience
See more jobs in Thane, Maharashtra