One of our prestigious client is looking for Azure Databricks Engineer at Princeton, NJ. If interested please share me your updated resume at nikhil@aquilasysinc.com
Role - Azure Databricks Engineer
Duration – contract long term
Location – Princeton, NJ
MUST HAVE : Capital Markets / Investment Banking domain experience
Job description
- ·Hands on development experience and understanding in designing and developing data processing patterns to simplify the complexity of real-world data engineering architecture.
- Patterns which are cost- efficient and scalable provide performance and reliability of a modern Lakehouse, with low latency of streaming.
- ·Understand the design and develop the standard framework modules, high performance services and client libraries for big data using one or more tools from AWS, Azure, Kubernetes, Spark, DBT, Databricks and snowflake, AWS S3, Azure Blob Store, data virtualization tools (Starburst, Dremio).
- ·Hands on experience in operationalizing tens of hundreds of data pipelines, deploy, test & upgrade pipelines and best practices to eliminate operational burdens for managing and building high quality data pipelines.
- ·Experience in query optimizer and execution engine that's fast, tuning free, scalability, ACID transactions and time travel patterns using spark jobs, DBT on Databricks and snowflake.
- ·Quickly evaluate various technologies and complete POC driving architecture design for the applications.
- ·Work in complex environment with multi location teams.
- ·Work in team of agile developers.