Job Overview
We are seeking a highly skilled Remote Lead Data Engineer with over 7 years of experience in data engineering, particularly within the consumer finance sector or related fields such as consumer loans, collections, and insurance sales. This role requires a robust background in mathematics, statistics, computer science, or data science, along with a proven ability to manage complex data engineering projects.
Key Responsibilities
- Design and manage cloud resources in Amazon Web Services (AWS).
- Execute data ingestion from diverse sources utilizing various technologies, including RDBMS, REST HTTP API, and flat files.
- Leverage Big Data technologies for data processing and transformation, specifically using Spark and cloud services.
- Develop and implement automated data quality checks to ensure the integrity of information entering the platform.
Required Skills
- Advanced proficiency in at least one programming language such as Java, Scala, Python, or C#.
- Extensive production experience with technologies including HDFS, YARN, Hive, Spark, Kafka, Oozie/Airflow, Docker/Kubernetes, and Snowflake.
- Strong capability in data mining and programming tools such as SAS, SQL, R, and Python.
- Familiarity with database technologies such as PostgreSQL, Redshift, and Greenplum.
- Competence in data visualization tools like Tableau or Looker.
- Excellent organizational skills, capable of managing multiple priorities and meeting stringent deadlines.
- Effective written and verbal communication skills, with the ability to convey complex results to non-technical stakeholders.
Qualifications
- Minimum of 7 years of relevant experience as a data engineer in the consumer finance industry or equivalent sectors.
- Strong foundation in mathematics, statistics, computer science, or a related discipline.
- Proven track record of implementing and managing big data solutions.
Career Growth Opportunities
Joining our team as a Remote Lead Data Engineer provides not only an opportunity to work with cutting-edge technologies but also the potential for professional development and advancement within the organization.
Company Culture And Values
We uphold a culture of collaboration and innovation, encouraging our team members to continuously learn and explore new technologies. Our supportive work environment is designed to foster both personal and professional growth.
Employment Type: Full-Time