Job Title: Data Architect (Energy Domain is Mandatory)
Location: Hybrid in Houston, TX
Duration: Long Term Contract
We are seeking a highly skilled and experienced Data Architect with extensive experience in Snowflake and Databricks. The ideal candidate will have a strong background data migration from RDBMS to Snowflake and Databricks, and a deep understanding of modern data architecture principles. You will need to partner with end-users to understand process, requirements and analyze problems to design solutions and ultimately deliver tangible business value & benefit.
Key Responsibilities
- Design, develop, and implement robust data architecture solutions utilizing modern day data platforms like Snowflake and Databricks.
- Ensure scalable, reliable, and secure data environments that meet business requirements and support advanced analytics.
- Lead the migration of data from traditional RDBMS systems to Snowflake and Databricks environments.
- Architect and design scalable data pipelines and infrastructure to support the organization's data needs.
- Develop and manage ETL processes using Snowflake and Databricks to ensure efficient data extraction, transformation, and loading.
- Optimize ETL workflows to enhance performance and maintain data integrity.
- Ensure seamless data transition with minimal disruption to ongoing operations.
- Monitor and optimize performance of data systems to ensure reliability, scalability, and cost-effectiveness within Snowflake and Databricks environments.
- Collaborate with cross-functional teams, including data engineers, data scientists, analysts, and product managers, to understand data requirements and deliver solutions.
- Define best practices and standards for data engineering/data warehouse processes and ensure adherence to them.
- Evaluate and implement new technologies and tools to improve the efficiency and effectiveness of data pipelines.
- Provide technical leadership and mentorship to junior members of the data engineering team.
- Work closely with DevOps and infrastructure teams to deploy and manage data systems in production environments.
- Ensure that all data solutions comply with organizational policies, industry standards, and regulatory requirements.
- Collaborate with enterprise architects and IT leadership to ensure alignment of data architecture with overall IT architecture and strategies.
Skill And Experience
- BS or MS in Computer Science or relevant experience.
- Extensive experience with Snowflake and Databricks, including ETL processes and data migration.
- Certifications in Snowflake and/or Databricks.
- Experience with additional cloud platforms like AWS, Azure, or GCP.
- Knowledge of big data technologies and frameworks.
- Strong knowledge of data warehousing concepts, data modeling, and SQL.
- Experience with RDBMS systems and transitioning data to modern cloud platforms.
- Proficiency in programming languages such as Python, SQL, and scripting languages.
- Knowledge of data governance frameworks, data quality management practices, and data security principles
- Proficiency in database technologies, including relational databases e.g., SQL Server. In-depth knowledge of data modeling, database design.
- Familiarity with containerization technologies such as Docker and orchestration tools like Kubernetes.
- Excellent problem-solving and analytical skills. Strong communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams.