Data Software Engineer(AWS)_105540
MyCareernet
Key Skills: AWS Cloud, Databricks, Python, Spark, Hadoop, Big Data
Roles and Responsibilities:
- Design and implement scalable batch and streaming data processing solutions using Apache Spark, Python, and Databricks.
- Develop and maintain cloud-based data engineering solutions on AWS.
- Integrate data from relational databases, enterprise applications, files, and other source systems.
- Analyze and improve Spark job performance, reliability, and resource utilization.
- Provide technical guidance on distributed data processing architecture and large-scale data solutions.
Skills Required:
- 5 - 9 years of experience in data engineering, big data, distributed computing, or cloud data platforms.
- Strong hands-on experience with Apache Spark and distributed computing principles.
- Proficiency in Python for data engineering and backend data processing.
- Practical experience designing and implementing data solutions on AWS Cloud.
- Experience with Databricks for data engineering, Spark workloads, and production data pipelines.
Good to Have:
- Experience with Hadoop ecosystem technologies and large-scale Big Data platforms.
Education: Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.