Job Title: Data Architect/Engineer
Location: Jersey City, NJ (Hybrid, 3 Days Onsite/Week)
Duration: 12 Months,
About The Team And Platform
The Data and Reporting platform is a cross-product system for client reporting and downstream applications. It provides various reports (e.g., real-time trades, positions, Initial and Variation Margin, Positions and Balances, internal reporting, downstream data feeds, etc.) for both external and internal clients. A significant ongoing initiative is to modernize this scalable data and reporting platform and establish a robust data quality framework and process.
Roles And Responsibilities
- Implement data quality frameworks and measures, automated data quality validation, and dashboard monitoring processes with automated alerts.
- Design data architecture standards and principles, including data integrity, reference data, data models, and metadata standards for the data platform.
- Evaluate and review overall data flow adherence to data architecture standards, review with stakeholders, and enhance data governance oversight with change management processes.
- Assess complex data flows and identify opportunities to simplify end-to-end data processes.
- Perform data and process analysis to identify data issues and root causes, and implement resolutions.
- Collaborate with Support to troubleshoot urgent production data issues and implement fixes.
- Evaluate and recommend tools and frameworks for data management and data engineering capabilities.
- Collaborate with architecture and business users to review architecture designs and technical solutions to secure buy-in.
- Develop scalable and resilient data pipelines with real-time and batch processes into a data warehouse.
- Support reporting applications and downstream changes and testing.
Qualifications
- 10-15+ years of experience in leading scalable data architecture and data pipeline developments.
- Strong communication and problem-solving skills.
- 5+ years of hands-on experience with Python applications and data pipelines for batch and streaming of large data sets.
- 10+ years of experience in designing and building enterprise data architecture, solution engineering, and data standards.
- Strong relational database development experience in Oracle, SQL, or NoSQL databases, and advanced SQL/procedures.
- Solid development experience in data lake/big data platforms (e.g., HDFS/Spark/S3, Snowflake, Cloudera) and data mesh technology.
- Experience in data model design for a large data warehouse.
- Experience in DevOps and CI/CD pipelines.
- Understanding of scalability and performance management.
- Excellent communication and presentation skills.
- Innovative ideas and a can-do attitude.
- Experience in data science/machine learning is a plus.
- Experience with BI tools (e.g., Tableau, Power BI) is a plus.
- Experience in Java development is a plus.
Education
- Bachelor’s degree/University degree or equivalent experience in computer science, statistics, or engineering.