Data Engineer
WillWare Technologies
Experience: 5+ Years
Role: Data Engineer
Location: Bangalore, Chennai, Hyderabad, Pune, Kolkata
Work Mode: Onsite
Key Responsibilities:
Build and maintain scalable batch and streaming data pipelines.
Develop distributed data processing using Spark, Apache Beam, or Flink.
Orchestrate workflows using Apache Airflow.
Develop data transformations using Python, SQL, and dbt.
Work with GCP or other major cloud platforms.
Ensure data quality, performance, and pipeline reliability.
Collaborate with Analytics and Platform Engineering teams.
Mandatory Skills:
Strong Python & SQL
Apache Airflow
Spark / Apache Beam / Flink
dbt
Cloud experience, preferably GCP
Streaming: Kafka / Pub/Sub
Hands-on experience with AI-assisted coding tools such as GitHub Copilot, Cursor, Gemini Code Assist, etc.
Good to Have: AI-driven data/ML pipelines, data quality/governance, BI/analytics experience.