We are looking for an experienced Market Data Engineer to join our team. The ideal candidate will have a strong background in Python, cloud technologies, and extensive experience working with tick data and building robust tick data pipelines. The role involves designing, implementing, and maintaining our market data processing systems, ensuring high availability, performance, and scalability.
RESPONSIBILITIES
• Design and develop high-performance tick data pipelines to process and analyze large volumes of financial market data.
• Utilize cloud technologies to optimize data processing and storage solutions.
• Collaborate with other engineers and trading teams to define data requirements and integrate market data into our products and services.
• Ensure data quality and integrity by implementing robust data validation and error handling mechanisms.
• Continuously improve data processing latency and throughput to meet the needs of high-frequency trading environments.
• Develop and maintain documentation for data pipelines and architectures.
QUALIFICATIONS
- Experience working in analytics engineering, data science, or other highly analytical, data-oriented roles.
- Commercially-minded, pragmatic analytics engineer with a keen interest in core development of data products.
- Proficient in SQL and dbt within a cloud data warehouse environment (e.g., Snowflake, BigQuery, Redshift). Python (or R) experience is highly desirable.
- Experienced in working with multiple external datasets, including cleaning, merging, and manipulating data.
- Enjoy writing code and applying critical thinking to use data in solving real-world business problems across different industries.