Company Description
Astreya is the leading IT solutions provider for some of the world's most recognizable and innovative organizations. Our journey started in 2001 in the heart of Silicon Valley and reaches thirty-three countries with over 2200+ IT professionals. We enable businesses to make better decisions, achieve operational efficiency and gain a competitive edge. The Astreya advantage is centered around focus and clear- vision, world-class talent, and innovative technology: Creativity is in our DNA. Our dedicated Software and Service Innovation teams bring best-in-class technology and tools to bear for our clients.
Role Description
This is a full-time remote role for a Senior Data Engineer - Python. As a Senior Data Engineer, you will be responsible for building and maintaining scalable data pipelines and data integration solutions. You will collaborate with cross-functional teams to design and implement data models and data integration processes. You will also optimize data systems and work with large datasets to extract meaningful insights that drive business decisions.
Job Duties/Essential Functions
- Development of data pipelines and tables for consolidation and standardization of data related BI analytics use cases and data sources, as well as enablement of data transformation in a multi-DB construct, including but not limited to: Hive, ODS, MySQL, Scuba, in support of business unit and partner team’s objectives
- Development of visualizations, as a combination of new development and enhancements to existing BI dashboards, to support and enhance reporting on metrics and KPIs.
- Development and optimization of advanced workflow capabilities, predictive and resource optimization models, as prioritized with the team Project Manager.
- Proven and extensive experience of Python and R programming, data extraction and data manipulation.
- Widely experience and proficiency in various python libraries like SciPy, NumPy, PyTorch, Matplotlib, Pandas.
- Works in tandem with data architects and BI engineers to design data pipelines and recommends ongoing optimization of data storage, data ingestion, data quality and orchestration.
- Design, develop, & implement ETL/ELT processes using .standard integration platforms
- Implements big data and NoSQL solutions by developing scalable data processing platforms to drive high-value insights to the organization.
- Identifies, designs, and implements internal process improvements: automating manual processes, optimizing data delivery.
- Identifies ways to improve data reliability, efficiency and quality of data management.
- Communicates technical concepts to non-technical audiences both in written and verbal form.
- Performs peer reviews for other data engineer’s work.
- Regular and reliable workplace attendance at your assigned location.
Qualifications
- Overall 6+ yrs of IT experience in the information Industry
- 5+ years’ experience engineering and deploying data pipelines with large and complex datasets.
- 5+ years’ hands on experience with Data integration platforms
- 5+ years’ experience with Data Modeling, ETL, and Data Warehousing.
- 4+ years experience with design/building data pipelines using Python. Experience with implementing NumPy, SciPy, Matplotlib, Pandas and Keras.
- Development experience in Hadoop ecosystem Pig, Hive, HBase, Spark, Scala, Kafka
- Experience in programming languages like C++, Java
- Extensive experience working with various data sources (SQL,Oracle database, flat files (csv, delimited), Web API, XML.
- Experience with Data visualization tools like Tableau, MS Power BI and Qlik
- Experience with Hive and HiveQL
- Advanced SQL skills required. Solid understanding of relational databases and business data; ability to write complex SQL queries against a variety of data sources.
- Strong understanding of database storage concepts (data lake, relational databases, NoSQL, Graph, data warehousing).
- Able to work in a fast-paced agile development environment.
What can Astreya offer you?
- Employment in the fast-growing IT space providing you with a variety of career options
- Opportunity to work with some of the biggest firms in the world as part of the Astreya delivery network
- Introduction to new ways of working and awesome technologies
- Career paths to help you establish where you want to go
- Focus on internal promotion and internal mobility - we love to build teams from within
- Free 24/7 accessible Professional Development through LinkedIn Learning and other online courses to give you opportunities to up skill at your own pace
- Education Assistance
- Dedicated management to provide you with on point leadership and care
- Numerous on the job perks
- Market competitive compensation and insurance, health and wellness benefits
Additional Information
Astreya Partners is an equal employment and affirmative action employer. We evaluate qualified applicants on merit and business needs and not on race, color, religion, creed, gender, sexual orientation, national origin, ancestry, age, disability, genetic information, marital status, veteran status or any other factor protected by law.