We are seeking a highly versatile and experienced Data Engineer to join our small and dynamic team. The ideal candidate is a highly versatile individual who thrives in a fast-paced environment and can handle a variety of tasks. You will play a critical role in designing, implementing, optimizing, and maintaining our data-driven applications and infrastructure. Your work will directly contribute to the success of our asset teams by ensuring the availability, accuracy, reliability, and performance of our data systems.
Essential Job Responsibilities
- Architect and maintain robust, scalable, and efficient data infrastructure to support various data-driven applications and analytics initiatives.
- Develop and manage scalable and reliable data pipelines for collecting, processing, and storing large volumes of structured and unstructured data.
- Create and optimize ETL processes to ensure high-quality data is available for analysis and reporting using a variety of data engineering tools like dbt, and spark.
- Integrate data from multiple sources, ensuring data consistency, quality, and accessibility.
- Support the deployment and maintenance of data-driven applications, ensuring they are optimized for performance and scalability.
- Implement and monitor data quality checks and validation processes to ensure accuracy and reliability of data.
- Collaborate with data scientists, analysts, and other stakeholders to understand their data needs and provide timely and effective solutions.
- Monitor and improve the performance of data systems and queries, ensuring efficient data processing and minimal downtime.
- Develop and maintain comprehensive documentation for data pipelines, ETL processes, data models, and data-driven applications.
- Ensure data security and compliance with industry standards and best practices.
- Stay current with industry trends and advancements, continuously seeking opportunities to improve our data infrastructure and processes.
Other Job Responsibilities
- Maintains employee confidence and protects company assets, including intellectual property, by keeping information confidential.
- Maintains technical knowledge by attending educational workshops and reviewing professional publications, establishing personal networks, and participating in professional associations.
- Other duties as assigned by management
Qualifications
- Working knowledge of maintenance management systems or equivalent experience.
- Working knowledge of cloud application infrastructure.
- Exceptional ability in diagnosing and solving technical related issues.
- Ability to conduct application troubleshooting.
- Ability to establish and maintain effective working relationships with employees, supervisors, other departments, officials, and the public.
- Ability to complete multiple, diverse tasks of differing priorities with minimum supervision.
- Excellent written and verbal communication skills, with specific ability to translate complex information system’s information into an organized and presentable manner.
- Ability to travel to remote locations via large and small planes, helicopter or boat. Expectation is quarterly trips to our asset locations.
- Required: Working knowledge of oil and gas industry applications and processes.
Education Requirements
- Bachelor’s Degree from an accredited four-year university or college with a degree in information computer science, engineering, or a closely related field. Additional experience may substitute for education on a year for year basis.