Data Engineer

About the Role

An Engineering company is seeking a skilled Data Engineer to join our Bangalore team, playing a pivotal role in our data-driven roadmap. This position offers the chance to work with a growing team of engineers while leading the development of our next-generation data platform. Join us to contribute to impactful projects that influence multiple business functions and drive our AI initiatives forward.

What You'll Do

• Design and manage the Databricks-centric lakehouse environment according to the medallion architecture.
• Develop and maintain data pipelines that integrate data from numerous applications and microservices, supporting both batch and real-time processing.
• Ensure the platform's scalability to accommodate new cities, business lines, and data sources without hindering performance.
• Oversee metadata management, cataloging, and lineage tracking for precise data traceability.
• Architect a data platform conducive to agentic data consumption, enabling effective interactions with AI agents.
• Create a robust semantic layer to standardize data access across the organization.
• Collaborate with product and AI teams to enhance data analysis methodologies and ensure insightful data delivery.
• Establish and maintain uptime, accuracy, freshness, and latency metrics for business-critical data.

What We're Looking For

• Proficient in Python programming and data engineering best practices.
• Experience with building and managing data platforms in a B2C environment.
• Strong understanding of data governance principles and compliance regulations.
• Familiarity with data lake architectures and real-time data processing methodologies.
• Demonstrated capability in implementing automated data quality and accuracy measures.

Nice to Have

• Experience with AI-driven data applications and frameworks.
• Familiarity with data monitoring and alerting systems.
• Knowledge of data classification and access management techniques.

Why Join

• Be part of an innovative culture that values continuous learning and professional growth.
• Work collaboratively with cross-functional teams and make a significant impact on business success.
• Enjoy a flexible work environment that promotes work-life balance and employee well-being.

If you are interested then share your resume at [email protected] or apply directly through the link.