Associate Data Architect I
UST
- 6+ Years of Experience
- Design and develop scalable ETL/ELT pipelines using Databricks and distributed data processing frameworks.
- Build and optimize big data solutions using Apache Spark with Python, Scala, or SQL.
- Develop and maintain data lakes and lakehouse architectures on cloud platforms such as Amazon Web Services, Microsoft Azure, or Google Cloud.
- Implement batch and real-time data ingestion pipelines from multiple structured and unstructured data sources.
- Optimize performance tuning, cluster management, and cost efficiency within Databricks environments.
- Create reusable notebooks, workflows, and jobs using Databricks Workflows and CI/CD best practices.
- Work with Delta Lake, data modeling, partitioning, and schema evolution for reliable data processing.
- Collaborate with data analysts, data scientists, and business stakeholders to deliver high-quality data solutions.
- Ensure data governance, security, monitoring, and compliance standards across enterprise data platforms.
- Troubleshoot production issues, automate operational tasks, and support continuous improvement of data engineering processes.
Skills
data engineering,data processing,apache spark,databricks,
About UST
UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.