About the role:We are seeking a highly skilled and motivated Senior Data Engineer to join our team to help define and build Pharmanovias long-term data management strategy. Pharmanovia is aiming to build a highly autonomous self-service data and analytics platform, which can extract and align data from many best-in-class SaaS platforms (e.g. SAP S4 HANA, Salesforce CRM, Veeva RIMS and others) to deliver efficient business insights to Pharmanovia management and operational teams.As a Senior Data Engineer, you will play a crucial role in defining Pharmanovias long-term data analytics strategy, covering but not limited to:Data Architecture Infrastructure (AWS):Design and implement scalable data architectures to support various data sources and typesSelect appropriate database technologies data warehouses and/or data lakesManage cloud infrastructure to support data processing and storage needData Integration ETL:Develop pipelines to ingest, clean, and integrate data from disparate sourcesAutomate data integration processes to improve efficiency and reliabilityImplementing reporting and visualization tools for data exploration and analysisIdentify and implement optimizations to enhance data processing and query performanceData Analytics:Building analytical capabilities to support self-service data analytical toolsReporting and maintenance of data quality of core datasets and define improvement strategiesDevelop data infrastructure to support potential AI/ML use-casesData Governance:Establishing data governance frameworks, policies, and standardsDefining data ownership, stewardship, and quality management processesImplementing data management practices for data acquisition, storage, integration, and archivalData Security:Ensuring compliance with relevant data privacy regulations (e.g., GDPR, CCPA, HIPAA)Conducting regular audits and assessments to assess and mitigate data security risksIn addition to the above, you will need to demonstrate a good understanding of the real-life use cases for the data to ensure activities are appropriately prioritised and any data issues or concerns that could impact decision making are identified and well communicated. You will be required to collaborate with various technical and non-technical teams across Pharmanovia to understand business problems and deliver solutions appropriate to the business requirements.You should have extensive experience working with the AWS platform as well as additional tools, such as Databricks, and have demonstrated proficiency in designing and managing databases and data platforms.As a Senior Data Engineer, you will play a crucial role in building and optimising our data infrastructure, ensuring scalability, reliability, and efficiency. This role is essential for driving data-driven decision-making and enhancing our ability to extract insights from vast amounts of data.Main responsibilities duties: Collaborate with cross-functional teams to understand business requirements and translate them into scalable, secure, and reliable AWS solutions Support the definition of Pharmanovias long-term data management strategy Define and implement key tools to enact Pharmanovias data management strategy Design and development of data pipelines using AWS services such as Lambda, EC2, S3, RDS, DynamoDB, etc. from a variety of sources (SaaS platforms, excel, email attachments, sFTPs etc) Optimise system performance, reliability, and cost-efficiency through continuous monitoring, troubleshooting, and optimization of AWS resources Ensure compliance with industry standards and regulations (e.g., HIPAA, GDPR) for data security and privacy in AWS environments Implement best practices for infrastructure as code (IaC) using tools like AWS CloudFormation or Terraform to automate provisioning and deployment processes. Stay updated on emerging AWS technologies and trends and evaluate their potential to enhance Pharmanovias cloud infrastructure. Provide technical guidance and mentorship to junior team members, fostering a culture of learning and innovation within the engineering teamAbout you: Bachelors or Masters degree in Computer Science, Engineering, or related field ITIL Foundation desirable Knowledge of ITIL 4 and change management practices Proven experience designing, developing, and deploying cloud-based solutions on AWS In-depth knowledge of AWS services and their use cases, with a focus on compute, storage, networking, security, and monitoring Proficiency in programming languages such as Python, Java, or Node.js, and experience with serverless computing (AWS Lambda) Hands-on experience with containerization technologies (e.g., Docker, Kubernetes) and familiarity with container orchestration on AWS (Amazon EKS) Strong understanding of DevOps principles and experience with CI/CD pipelines using tools like AWS Code Pipeline, Jenkins, or GitLab CI/CD Excellent problem-solving skills and ability to troubleshoot complex issues in distributed systems Effective communication skills with the ability to collaborate effectively with cross-functional teams Service-oriented with excellent customer service persona Great analytical skills, methodical and high attention to detail Creative solution-oriented mindset, and the ability to take own initiative Approachable, helpful, and flexible attitude Strong verbal and written English language skills Ability to travel internationally if required Driving licence.Please use the below link for job application and quicker response.https://lifelancer.com/jobs/view/1e43b34aeeefa044190fed75f4f0f036