Senior Data Engineer
Collab.Ai is changing the way teams work by building collaborative tools for projects, wikis, and notes
Responsibilities
As a key player in our team, you will be responsible for designing, building, and managing our data infrastructure, supporting our data-driven decision-making capability
• Design, develop and optimize data ingestion pipelines to handle real-time and batch data streams using a variety of sources
• Utilize your extensive knowledge of Python and AWS to engineer solutions for the transformation, consolidation, and storage of large datasets
• Collaborate with data scientists and other stakeholders to understand data needs and translate them into data systems and pipelines
• Enhance our data ecosystem by leveraging industry best practices for testing, deployment, and runtime environments
• Drive continuous improvements to data reliability, efficiency, and quality
Experience
• We are seeking an experienced Data Engineer with a minimum of 4 years of experience in building data ingestion pipelines for large datasets
• You'll need to be proficient in Python, AWS, and common frameworks used for data ingestion, transformation, and consolidation
• The ideal candidate will be passionate about data, a strong team player, and have a continuous learning mentality
• Hands-on experience building and optimizing large scale data pipelines, architectures, and data sets
• Knowledge of data warehousing concepts, including data modeling, data cleaning, and ETL processes
• Strong understanding of database design and data management principles
• Experience with AWS cloud services
• Strong problem-solving skills, and the ability to analyze data and design solutions to complex data issues
• Excellent communication and teamwork skills, and a passion for data
Collab.ai offer a super competitive cash compensation package including base salary + bonus, equity in the company after one year, free healthcare, gym membership, unlimited vacation and sick days