If you are passionate about working on business problems that can be solved using structured and unstructured data at large scale, Tiger Analytics would like to talk to you.
We are looking to recruit a Lead Data Engineer (Azure-Databricks) in Dallas, TX in a hybrid role.
Required:
· Expertise in Python and experience writing Azure functions.
· Experience using Event Hub for data integrations.
· Hands on expertise in: Implementing analytical data stores in Azure platform using ADLS/Azure data factory /Data Bricks and Cosmos DB (mongo/graph API)
· Experience ingesting using Azure data factory, Complex ETL using Data Bricks.
· Eagerness to learn new technologies on the fly and ship to production
· Building and Implementing data ingestion and curation process developed using Big data tools such as Spark(Scala/python/Java), Data bricks, Delta lake, Hive, HDFS, Sqoop ,Kafka, Kerberos, Impala etc.
· Hands on expertise in: Implementing analytical data stores in Azure platform using ADLS/ADF/Data Bricks and Cosmos DB and CDP 7x
· Ingesting huge volumes data from various platforms for Analytics needs and writing high-performance, reliable and maintainable ETL code Strong
· SQL knowledge and data analysis skills for data anomaly detection and data quality assurance.
· Strong SQL knowledge and data analysis skills for data anomaly detection and data quality assurance.
· Strong analytic skills related to working with unstructured datasets
· · Strong experience in building designing Data warehouses, data stores for analytics consumption. (real time as well as batch use cases)
You would need valid work authorization to work in the US.
Benefits
This position offers an excellent opportunity for significant career development in a fast-growing and challenging entrepreneurial environment with a high degree of individual responsibility.