AWS Cloud Solution Architect - Data Engineering & Analytics (12+ Years Experience)
Location : NJ
Responsibilities:
· Collaborate with business stakeholders and data scientists to understand data requirements and translate them into technical solutions.
· Design and architect secure, scalable, and cost-effective data pipelines on AWS utilizing services like S3, Redshift, Glue, EMR, Kinesis, and Lambda.
· Develop and implement data transformation and processing workflows using tools like Microservices, NodeJS, or AWS Glue.
· Select and configure appropriate AWS storage solutions for various data types (structured, semi-structured, unstructured).
· Implement best practices for data security, governance, and compliance throughout the data lifecycle.
· Develop and maintain documentation for designed architectures and data pipelines.
· Automate infrastructure provisioning and configuration management using infrastructure as code (IaC) tools like Terraform or CloudFormation.
· Monitor and optimize the performance and cost efficiency of data pipelines.
· Stay up to date with the latest trends and innovations in cloud technologies, data engineering tools, and data analytics frameworks.
Qualifications:
· 12+ years of experience in data engineering, data architecture, or a related field.
· Proven experience in designing and implementing scalable and secure data pipelines on AWS.
· In-depth knowledge of data engineering principles, data modeling techniques, and data storage solutions.
· Expertise in at least one scripting language like Python or Java and experience with data processing frameworks (Spark, PySpark).
· Experience with AWS services for data management and analytics (S3, Redshift, Glue, EMR, Kinesis, Lambda).
· Strong understanding of data security and governance best practices.
· Excellent communication, collaboration, and problem-solving skills.
· Ability to work independently and as part of a cross-functional team.