Trident Consulting is seeking a "
Big Data Principal " for one of our clients in
" Pennington, NJ " A global leader in business and technology services
Role : Big Data Principal
Location : Pennington, NJ
Job type : Contract
Job Description
- Hands on development experience and understanding in designing and developing data processing patterns to simplify the complexity of real-world data engineering architecture. Patterns which are cost- efficient and scalable provide performance and reliability of a modern Lakehouse, with low latency of streaming.
- Understand the design and develop the standard framework modules, high performance services and client libraries for big data using one o rmore tools from AWS, Azure, Kubernetes, Spark, DBT, Databricks and snowflake, AWS S3, Azure Blob Store.
- Hands on experience in operationalizing tens of hundreds of data pipelines, deploy, test & upgrade pipelines and best practices to
- Eliminate operational burdens for managing and building high quality data pipelines.
- Experience in query optimizer and execution engine that's fast, tuning free, scalability, ACID transactions and time travel patterns using spark jobs, DBT on Databricks and snowflake.
- Quickly evaluate various technologies and complete POC driving architecture design for the applications.
- Working complex environment with multi location teams.
- Working team of agile developers.
About Trident: Trident Consulting is an award-winning IT/engineering staffing company founded in 2005 and headquartered in San Ramon, CA. We specialize in placing high-quality vetted technology
Some Of Our Recent Awards Include
2022, 2021, 2020 Inc. 5000 fastest-growing private companies in America 2022, 2021 SF Business Times 100 fastest-growing private companies in Bay Area.