Senior Data Engineer

Collab.Ai is changing the way teams work by building collaborative tools for projects, wikis, and notes

Responsibilities

As a key player in our team, you will be responsible for designing, building, and managing our data infrastructure, supporting our data-driven decision-making capability

• Design, develop and optimize data ingestion pipelines to handle real-time and batch data streams using a variety of sources

• Utilize your extensive knowledge of Python and AWS to engineer solutions for the transformation, consolidation, and storage of large datasets

• Collaborate with data scientists and other stakeholders to understand data needs and translate them into data systems and pipelines

• Enhance our data ecosystem by leveraging industry best practices for testing, deployment, and runtime environments

• Drive continuous improvements to data reliability, efficiency, and quality

Experience

• We are seeking an experienced Data Engineer with a minimum of 4 years of experience in building data ingestion pipelines for large datasets

• You'll need to be proficient in Python, AWS, and common frameworks used for data ingestion, transformation, and consolidation

• The ideal candidate will be passionate about data, a strong team player, and have a continuous learning mentality

• Hands-on experience building and optimizing large scale data pipelines, architectures, and data sets

• Knowledge of data warehousing concepts, including data modeling, data cleaning, and ETL processes

• Strong understanding of database design and data management principles

• Experience with AWS cloud services

• Strong problem-solving skills, and the ability to analyze data and design solutions to complex data issues

• Excellent communication and teamwork skills, and a passion for data

Collab.ai offer a super competitive cash compensation package including base salary + bonus, equity in the company after one year, free healthcare, gym membership, unlimited vacation and sick days

Collab,ai jobs

Senior Data Engineer