Data Engineer
Bahwan CyberTek
Role description
- Bachelor’s degree in Computer Science, Computer Engineering, Data Engineering, or a relevant field.
- 5–8+ years of solid understanding in data analytics concepts (data ingestion, data warehouse, data lakes, reporting, etc.).
- 5+ years of experience delivering production ETL pipelines.
- 2+ years of hands-on experience with Databricks (Azure Databricks preferred).
- Built, optimized, and maintained ETL pipelines using Databricks for large-scale data processing.
- Strong experience with PySpark and SQL; proficiency in Python.
- Strong experience in Azure cloud and data platform services including Data Factory, Databricks, databases, ETL/ELT concepts, IAM, and security controls.
- Strong understanding of cloud technologies, data management, big data solutions, machine learning, and AI frameworks.
- Experience with ADF for orchestration and operational monitoring.
- Experience implementing CI/CD practices using GitHub Actions.
- Knowledge/experience in DevOps and Agile methodologies.
- Collaborate with cross teams, infrastructure, and security teams for best and timely delivery.
- Experience with Spark/Delta optimization (partitioning, file sizing, performance tuning).
- Experience in healthcare/Life Sciences is preferred