Immediate need for a talented
Senior Data Engineer. This is a
12 + months Contract opportunity with long-term potential and is located in
Atlanta, GA. Please review the job description below and contact me ASAP if you are interested.
Job ID: 24-40514
Pay Range: $69.50/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).
Key Responsibilities:
- Design, implement, and maintain Teradata databases.
- Optimize and tune queries for performance.
- Monitor and troubleshoot database issues.
- Develop and maintain ETL (Extract, Transform, Load) processes for data integration and transformation.
- Use tools like Teradata Utilities (e.g., BTEQ, FastLoad, MultiLoad, TPT, etc.).
- Create and maintain data models to support business processes.
- Work with stakeholders to understand data requirements and design solutions.
- Identify and resolve performance bottlenecks in SQL queries, system configuration, or data design.
- Regularly monitor and optimize system performance.
- Implement data security best practices.
- Ensure compliance with data governance policies and regulations.
- Implement and manage Teradata on AWS infrastructure, leveraging AWS services for scalability and performance.
- Manage data migration from on-premises Teradata environments to AWS cloud-based Teradata instances.
- Ensure seamless integration between Teradata and AWS services like S3, Redshift, RDS, and Lambda.
- Design and deploy cloud infrastructure (VPCs, EC2 instances, S3 buckets) to support Teradata environments.
- Implement networking and security best practices in AWS to ensure secure data access and storage.
- Automate infrastructure provisioning, scaling, and monitoring using AWS tools like CloudFormation, Terraform, or AWS CLI.
- Use AWS Lambda for automating ETL processes or handling specific workloads.
- Leverage AWS data services (e.g., Redshift, Athena, Glue) to complement Teradata workloads.
- Implement data pipelines using AWS services for ETL processes, integrating data from various sources into Teradata.
- Implement AWS security best practices, such as IAM roles and policies, to secure Teradata environments in the cloud.
- Ensure compliance with relevant data governance policies, including encryption at rest and in transit.
- Work closely with data architects, analysts, and other stakeholders to understand data needs and deliver solutions.
Key Requirements and Technology Experience:
- In-depth knowledge of Teradata architecture and components (e.g., AMP, Nodes, Parsing Engines, etc.).
- Proficiency in Teradata SQL and Teradata utilities.
- Strong SQL skills for querying and managing relational databases.
- Scripting experience (e.g., Shell, Python) for automating tasks.
- Know tools like Teradata Utilities (e.g., BTEQ, FastLoad, MultiLoad, TPT, etc.).
- Experience with ETL tools and technologies used in Teradata environments.
- Knowledge of query optimization techniques, indexing, partitioning, and workload management in Teradata.
- Strong understanding of data warehousing principles, including star/snowflake schemas, OLAP, and ETL processes.
- Proficiency with core AWS services: EC2, S3, RDS, Lambda, CloudWatch, CloudFormation, etc.
- Experience with AWS networking (VPC, subnets, security groups, NACLs) and security management.
- Familiarity with AWS storage options, such as S3, EFS, and Glacier, in the context of large-scale data storage and retrieval.
- Experience deploying and managing Teradata in AWS cloud environments.
- Knowledge of AWS services that enhance Teradata performance, such as using S3 for staging data or integrating with Redshift for analytics.
- Hands-on experience with AWS CloudFormation, Terraform, or similar tools for automating infrastructure deployment.
- Proficiency in automating ETL pipelines and data processing workflows using AWS Lambda, Step Functions, or AWS Glue.
- Understanding of encryption and security protocols for data stored and processed in AWS.
- Experience implementing compliance standards such as GDPR, HIPAA, or other data protection regulations in cloud environments.
Our client is a leading
Airlines organization and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration.
Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, colour, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
#DOL