Responsibilities
Kforce's client in Spring, TX that is seeking a Data Engineer responsible for supporting the design, development, and maintenance of data pipelines and data processing systems. They will utilize technologies such as Azure, Spark SQL, SQL Server, Azure Data Factory, Azure Databricks, Azure DevOps, Data build Tool (DBT), Git, Power BI, Azure Synapse Analytics, and Azure Databricks. Working under the guidance of senior data engineers, the Data Engineer will play a crucial role in ensuring the availability, reliability, and scalability of the data infrastructure and in supporting the organizational data-products within the company. Responsibilities:
- Data pipeline development: Collaborate with the data engineering team to develop and
maintain data pipelines, ETL processes, and data integration workflows using Azure Data Factory,
- Ensure the timely and accurate movement of data between systems
- Data processing and transformation: Develop & Assist in implementing/maintaining data
processing and transformation logic using Azure Synapse Analytics, Spark SQL or Databricks
- Extract insights from raw data and transform it into meaningful and structured formats in our
data products
- Azure service utilization: Work with Azure services such as SQL Server, Azure Data Factory, Azure Synapse and Azure Databricks & DBT to build and manage data infrastructure components
- Version control and collaboration: Utilize Azure DevOps and Git for version control and
collaborate effectively with the team to manage code repositories and ensure proper documentation and knowledge sharing
- Azure DevOps integration: Assist in integrating data engineering workflows with Azure DevOps for CICD and automated testing
- Data Modelling, visualization and reporting: Exposure to Power BI or similar reporting tools
Requirements
- 5-7 years of experience in data engineering or related roles
- Hands-on experience with Azure services: Data Factory, Synapse, and Databricks.
Azure Synapse Analytics, Spark SQL, and other relevant technologies
- Proficiency in SQL programming, including SQL Server and MPP systems
- Familiarity with Spark SQL or Databricks for data processing
- Experience in DevOps practices for CI/CD and testing in data & analytics teams
- Experience with Power BI for data visualization
- Proven experience in Azure Synapse Analytics, Synapse Pipelines or Databricks
- Strong problem-solving skills and attention to detail
- Effective communication and teamwork skills
- Self-motivated with a passion for learning in data engineering
- In-depth understanding of data warehousing concepts and data modeling
- Proficiency in data pipeline development and data integration
- Solid understanding of source control (preferably git or azure devops) and branching techniques
- Strong analytical skills for complex data sets and issue troubleshooting
Desired
- Experience with Azure
- Familiarity with Delta Lake core and Parquet files
- Experience with DBT (Data Build Tool)
- Working understanding of Spark Pool and/or Python
- Strong DBT (Data Build Tool) experience is a plus
The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.
We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.
Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.
This job is not eligible for bonuses, incentives or commissions.
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.