Responsibilities:
- Architect Data Platforms on AWS, Databricks, and Snowflake: Design and implement scalable, resilient, and secure data platforms leveraging AWS cloud services, Databricks platform, and Snowflake data warehouse that meet the unique requirements of the pharmaceutical development organization.
- DataOps Implementation: Drive the adoption of DataOps principles and practices to streamline and automate data platform deployment, testing, and operations. Implement continuous integration and continuous delivery (CI/CD) pipelines, version control, and monitoring solutions to enhance agility and reliability.
- Technical Leadership: Provide technical leadership and guidance to development teams in the design and implementation of AWS, Databricks, and Snowflake-based data solutions, ensuring alignment with AWS, Databricks, and Snowflake best practices and architectural standards.
- Requirements Analysis:** Collaborate with stakeholders to gather and analyze business requirements, translating them into technical specifications for AWS, Databricks, and Snowflake-based data platform architecture and design.
- AWS, Databricks, and Snowflake Technology Evaluation: Stay abreast of the latest AWS, Databricks, and Snowflake services and features related to data management, analytics, and cloud computing. Evaluate and recommend appropriate AWS, Databricks, and Snowflake technologies and tools to enhance data platform capabilities.
- Solution Development: Lead the development and implementation of AWS, Databricks, and Snowflake-based data solutions, including data ingestion, storage, processing, and analytics components. Ensure solutions are scalable, performant, and maintainable on all platforms.
- Functional Knowledge of Pharma Development: Utilize functional knowledge of the Development function within the pharmaceutical industry to understand specific data requirements, regulatory constraints, and business processes. Collaborate with stakeholders to ensure data solutions align with business objectives and comply with industry regulations.
- Collaboration: Work closely with cross-functional teams, including data engineers, software developers, business analysts, and project managers, to deliver integrated data solutions on AWS, Databricks, and Snowflake that meet business objectives.
- Documentation: Create and maintain comprehensive documentation, including architectural diagrams, design specifications, and technical documentation, to facilitate knowledge sharing and ensure solution integrity on all platforms.
Qualifications:
- Proven experience (10 years) as a Solutions Architect, with a focus on designing and implementing data platforms on AWS, Databricks, and Snowflake.
- In-depth knowledge of AWS cloud services, Databricks platform, and Snowflake data warehouse.
- Experience implementing DataOps practices and tools, such as CI/CD pipelines, version control systems (e.g., Git), and monitoring solutions.
- Hands-on experience with AWS data migration and integration services, AWS security and compliance practices, Databricks Delta Lake, and Snowflake data modeling and querying.
- Functional knowledge of drug development processes, including clinical trials, regulatory submissions, and pharmacovigilance, is highly desirable.
- Strong proficiency in programming languages such as Python, Java, or Scala.
- Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes) is a plus.
- Excellent communication and interpersonal skills, with the ability to effectively collaborate with diverse stakeholders and articulate complex technical concepts to non-technical audiences.
- Proven track record of successfully delivering complex data projects on AWS, Databricks, and Snowflake on time and within budget.
Preferred Qualifications:
- Relevant certifications (e.g., AWS Certified Solutions Architect - Associate or Professional, Databricks Certified Associate Developer for Apache Spark, Snowflake Certified Professional).
- Experience in the pharmaceutical or healthcare industry.
- Knowledge of GXP