Databricks Architect (Financial Services Domain)
Location: New Jersey
Job Type: Full-Time
Department: Data Architect/ Engineering - Apache Spark, SQL, and data modeling
Position Overview:
As a Databricks Architect, you will be responsible for designing and implementing scalable data solutions using Databricks to enhance our analytics capabilities. Your expertise in the financial services domain will be essential in shaping our data architecture, ensuring compliance, and optimizing performance for data-driven decision-making.
Key Responsibilities:
- Architecture Design: Lead the design and implementation of scalable data architectures using Databricks, focusing on performance, reliability, and security within the financial services sector.
- Data Engineering: Collaborate with data engineers and analysts to develop ETL processes, data pipelines, and data models that support analytics and reporting needs.
- Cloud Integration: Oversee the integration of Databricks with cloud platforms (e.g., AWS, Azure) and other data tools, ensuring seamless data flow and accessibility.
- Compliance & Security: Ensure that all data solutions comply with financial regulations and best practices in data governance, privacy, and security.
- Performance Optimization: Monitor and optimize the performance of Databricks workloads, implementing best practices to enhance processing efficiency.
- Collaboration: Work closely with cross-functional teams, including data scientists, business analysts, and IT, to understand requirements and deliver impactful data solutions.
- Mentorship & Training: Provide guidance and mentorship to team members on Databricks technologies and best practices, fostering a culture of continuous learning.
Qualifications:
- Education: Bachelor s degree in Computer Science, Information Technology, or a related field. Master s degree preferred.
- Experience:5+ years of experience in data architecture, data engineering, or analytics, with at least 2 years specifically working with Databricks.
- Strong experience in the financial services domain, with a deep understanding of industry-specific data challenges and compliance requirements.
- Technical Skills: Proficiency in Apache Spark, SQL, and data modeling.
- Familiarity with cloud services (AWS, Azure) and data storage solutions (e.g., Delta Lake, Azure Data Lake).
- Experience with BI tools (e.g., Tableau, Power BI) is a plus.
- Soft Skills: Excellent problem-solving skills and a strategic mindset.
- Strong communication and interpersonal skills, with the ability to collaborate effectively with diverse teams.