Company
Compassus
Position Summary
The Data Engineer is responsible for modeling the Compassus values of Compassion, Integrity, Excellence, Teamwork, and Innovation and for promoting the Compassus philosophy, using the 6 Pillars of Success as the foundation. S/he is responsible for upholding the Code of Ethical Conduct and for promoting positive working relationships within the company, among all departments, and all external stakeholders. The Data Engineer is responsible for designing, developing, and maintaining data pipelines in Azure Data Factory to support our organization's data structures like Enterprise Data Warehouse, Data Marts and Semantic layer data. S/he utilizes their strong background in data, design, development, integration, testing and ETL processes, as well as expertise with Azure Data Factory.
Position Specific Responsibilities
- Designs and develops data pipelines using Azure Data Factory to support data integration and ETL processes.
- Works with business stakeholders to understand data requirements and translate them into technical specifications.
- Develops and maintains data processing and transformation logic using SQL in Azure Data Factory.
- Optimizes data pipelines for performance, scalability, and reliability.
- Troubleshoots issues with data pipelines and provide timely resolutions.
- Implements data security and access controls to protect sensitive data.
- Collaborates with cross-functional teams to develop and integrate data from various sources and systems.
- Documents data pipeline design, development, and maintenance processes.
- Performs other duties as assigned.
Education And/or Experience
- Bachelor's degree in Computer Science, Engineering, or a related field required.
- Minimum of three (3) years of experience in data integration and ETL processes required.
- Strong experience with Azure Data Factory and Azure services, such as Azure Blob Storage, Azure SQL Database, and Azure Data Lake Storage required.
- Experience with SQL and programming languages, such as Python and PowerShell required.
- Familiarity with data warehousing and BI tools, such as Power BI and Azure Analysis Services preferred.
Skills
- Mathematical Skills: Ability to add, subtract, multiply, and divide in all units of measure, using whole numbers, common fractions, and decimals. Ability to compute rate, ratio, and percentage.
- Language Skills: Ability to read, analyze, and interpret general business periodicals, professional journals, technical procedures, or governmental regulations. Ability to write reports, business correspondence, and procedure manuals. Ability to effectively present information and respond to questions from leaders, team members, investors, and external parties. Strong written and verbal communications.
- Other Skills and Abilities: Ability to understand, read, write, and speak English. Articulates and embraces integrated healthcare at home philosophy. Solid understanding of data modeling and data management principles, including relational and normal form data with various schemas. Extensive ability to create semantic layer data for consumption in reporting and analytics products. Strong analytical and problem-solving skills. Excellent communication and collaboration skills.
Physical Demands and Work Environment: The demands of this role necessitate a team member to effectively perform essential functions. Adaptations can be made to accommodate team members with disabilities. Regular standing, walking, and manual dexterity are fundamental, along with the ability to lift and move objects up to 25 pounds. Visual acuity requirements include close and distance vision, color and peripheral vision, depth perception, and the ability to adjust focus. This description provides a general overview and may vary by role and department, capturing the nuanced demands and conditions inherent to positions in our organization.
At Compassus, including all Compassus affiliates, diversity, equity, and inclusion are fundamental to our Pillars of Success. We are committed to creating a fair work environment where our team members feel welcomed, highly valued, and respected. As an equal opportunity employer, all qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.