Lead Data Engineer

AppLogiQ


Date: 3 weeks ago
City: Coimbatore, Tamil Nadu
Contract type: Full time
Job Description

Key Responsibilities :

  • Lead and manage the entire offshore data engineering team, providing guidance, mentorship, and performance management.
  • Foster a collaborative and high-performing team environment.
  • Oversee resource allocation, project planning, and task prioritization.
  • Conduct regular team meetings and provide progress updates to stakeholders.
  • Design and implement effective database solutions and data models to store and retrieve company data.
  • Examine and identify database structural necessities by evaluating client operations, applications, and programming requirements.
  • Assess database implementation procedures to ensure compliance with internal and external regulations.
  • Install and organize information systems to guarantee company functionality.
  • Prepare accurate database design and architecture reports for management and executive teams.
  • Oversee the migration of data from legacy systems to new solutions.
  • Monitor system performance by performing regular tests, troubleshooting, and integrating new features.
  • Recommend solutions to improve new and existing database systems.
  • Design and implement scalable and efficient ETL/ELT processes using Azure Data Factory, Databricks, and other relevant tools.
  • Build and maintain data warehouses and data lakes using Azure Synapse, Snowflake, BigQuery, and Azure Data Lake.
  • Develop and optimize data pipelines for data ingestion, transformation, and loading.
  • Implement data quality checks and validation processes.
  • Support data analytics initiatives by providing access to reliable and accurate data.
  • Develop data visualizations and dashboards using Power BI and Tableau.
  • Collaborate with data scientists and business analysts to translate business requirements into technical solutions.
  • Educate staff members through training and individual support.
  • Work within an Agile Scrum framework.
  • Utilize IT Service Management best practices.
  • Provide Techno-Functional Management.

Mandatory Skills And Expertise

  • Azure SQL
  • Azure Data Factory
  • Azure Data Lake
  • Azure Databricks
  • Azure Synapse
  • Snowflake
  • BigQuery
  • T-SQL
  • DBT
  • ETL/ELT
  • PySpark
  • Data Warehousing
  • Data Analytics
  • Data Visualization

Qualifications

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
  • Proven experience leading and managing data engineering teams.
  • Extensive experience in designing and implementing data solutions on Azure and other cloud platforms.
  • Strong understanding of data warehousing, data modeling, and ETL/ELT concepts.
  • Proficiency in SQL and scripting languages (Python, PySpark).
  • Excellent communication, leadership, and problem-solving skills.
  • Proven experience in client facing roles.

(ref:hirist.tech)
Post a CV

See more jobs in Coimbatore, Tamil Nadu