BU LVA - Data Engineer - #978142

Lilly


Date: 3 days ago
City: Bengaluru, Karnataka
Contract type: Full time

Business Units Information and Digital Solutions (IDS) is a global organization strategically positioned so that through information and technology leadership and solutions, we create meaningful connections and remarkable experiences, so people feel genuinely cared for. The Business Unit IDS organization is accountable for designing, developing, and supporting commercial or customer engagement services and capabilities that span multipleu00A0Businessu00A0Units (Bio-Medicines, Diabetes, Oncology, International), functions, geographies, and digital channels. The areas supported by Business Unit IDSu00A0includes:u00A0Customer Operations, Marketing and Commercial Operations, Medical Affairs, Market Research,u00A0Pricing, Reimbursement and Access, Customer Support Programs, Digital Production and Distribution,u00A0Global Patient Outcomes, and Real-World Evidence. u00A0u00A0

This position isu00A0responsibleu00A0for developing the process ofu00A0ETL / ELT / File Movementu00A0of data & integrations.u00A0u00A0 Theu00A0key responsibilities will be to processu00A0and move data between different compute and storage services, as well as on-premises data sources at specified intervals.u00A0The employee will also be responsible foru00A0the creation,scheduling,u00A0orchestration,u00A0and management of data pipelines.u00A0

u2022u00A0Competency

Data Engineer

Data engineers are responsible for ensuring the availability and quality of data needed for analysis and business transactions. This includes data integration, acquisition, cleansing, harmonization and transforming raw data into curated datasets for data science, data discovery, and BI/analytics. Responsible for developing, constructing,u00A0testing,u00A0and maintaining data sets and scalable data processing systems.u00A0

Data engineers work closest with Data Architects and Data Scientists. u00A0They also work with business and IT groups beyond the data sphere, understanding the enterprise infrastructure and the many source systems.

Input is raw datasets. u00A0Output is analytics-ready, integrated/curated datasets. u00A0

Key capabilities in this role family include:

u2022u00A0Data Acquisitionu00A0- isu00A0the process of gathering and storing data in a location and format that it can be consumed for data preparation and/or downstream business uses.

u2022u00A0Data Preparationu00A0-u00A0isu00A0an iterative process for exploring, integrating, cleaning, validating and transforming raw data into curated datasets

u2022u00A0Data Publishingu00A0- isu00A0the act of releasing data in consumable form for (re)use by others.

Note:u00A0All data engineer roles should have a foundational set of knowledgeu00A0inu00A0u00A0communication, leadership, teamwork, problem solving skills, solution / blueprint definition, business acumen, architectural processes (e.g. blueprinting, reference architecture, governance, etc.), technical standards, project delivery, and industry knowledge.

Businessu00A0Analysisu00A0and Technical Leadershipu00A0

u2022u00A0Engages with business and proactively seeks opportunities to deliver business value.u00A0u00A0

u2022u00A0Understands business requirements and effectively translates business needs and process into technical terms, and vice versau00A0

u2022u00A0Elicits and definesu00A0requirementsu00A0

u2022u00A0Ensures appropriate business roles are engaged in solution execution.u00A0

u2022u00A0Participates in design reviews to ensure traceability of requirements.u00A0

u2022u00A0Networks with appropriate IT colleagues to determine solutions to meet business partnersu2019 needs.u00A0

u2022u00A0Seeksu00A0opportunities to reuse existing processes and services to streamline support and implementation of key systems.u00A0u00A0

u2022u00A0Stay abreast of tools and technologies to influence IT strategy so that it provides best usage opportunities for business

u2022u00A0Ability to adapt quickly in a constantly changing environment

Must Have:

  • Bacheloru2019s degree in computer science, information technology, management information systems or equivalent work experienceu00A0
  • 4+ years of development experienceu00A0as a data engineer with focus on core tools and technologies like AWS (Lambda, Glue , S3,u00A0 Redshift , Athena, Eventbridge , IAM Roles & Policies), Pyspark, SQL and Tableau.
  • Architect and build high-performance and scalable data pipelines adhering to data lakehouse, data warehouse & data marts standards for optimal storage, retrieval, and processing of data.
  • Develop data profiling and data quality methodologies and embed them into the processes involved in transforming data across the systems.
  • 4+ years of experience in Agile Development and code deployment using Github & CI-CD pipelines.
  • Expertise in the design, datau00A0modelling,u00A0creation, and management of large datasets/data models
  • Ability to work with business owners to define key business requirements and convert to technical specifications
  • Experience with security models and development on large data sets
  • Ensure successful transition of applications to service management team through planning and knowledge transfer
  • Develop expertise of processes and data used by business functions
  • Responsible for system testing, ensuring effective resolution of defects, timely discussion around business issues and appropriate management of resources relevant to data and integration
  • Partner with and influence vendor resources on solution development to ensure understanding of data and technical direction for solutionsu00A0as well as delivery.

Preferred Qualificationsu00A0/ Certificationsu00A0

  • Experience working in regulated environments and with internal systems quality policies and procedures.u00A0
  • Demonstrated experience with a variety of relational database and data warehousing technology such as AWS Redshift, Athena, RDS, BigQuery.
  • Strong experience with ELT/ETL design and implementations in context of large and complex datasets.
  • 2+ years of experience in job orchestration using Airflow.
  • Experience in development and deployment on cloud infrastructure.
  • Pharmaceutical or healthcare industry experience
  • Early drug discovery industry experience
  • Salesforce Health Cloud knowledge/experience is preferred.
  • Defining best practices and developing technical standards, design principals, best practices, and frameworks
  • Technical curiosity and desire to innovate.

Note: When applying internally for a position your current supervisor receives notification that you have applied to the position. We encourage employees to discuss the opportunity with their supervisor prior to applying.

Lillyu00A0does not discriminate on the basis of age, race, color, religion, gender, sexual orientation, gender identity, gender expression, national origin, protected veteran status, disability or any other legally protected status.

#WeAreLilly

Post a CV

Similar Jobs

KYC Specialist -Team Leader

JPMorgan Chase & Co., Bengaluru, Karnataka
3 hours ago
Job DescriptionAs a KYC (Know your customer) analyst, you will provide kyc/AML-related compliance advisory support on matters involving the Global KYC Standards, including policy interpretations and clarifications, change requests. This includes functions such as data collection, completion of the KYC profile, client screening, and English language research, comparing and analyzing client profiles across all lines of business and quality assurance....

Software Engineer

Microsoft, Bengaluru, Karnataka
1 day ago
Have you ever imagined a world with an infinite amount of storage available and accessible to everyone? A place where everyone in the world can easily access their data from anywhere at any time via any means (e.g., mobile phones, tablets, PCs, smart devices, etc.). Did you ever desire a universally accessible storage system to record all the knowledge known...

Associate Healthcare Research & Data Analyst

Clarivate, Bengaluru, Karnataka
1 day ago
We are looking for an individual to join our US Market Access Content Delivery Team in Bangalore. The position reports to the Director/Senior Director in the U.S. The full-time analyst position will analyze and support content pertaining to United States market access, supporting various project management activities. The analyst will be responsible for determining the appropriate techniques to transform data...