Responsibilities
Kforce has a client that is seeking a Data Engineer in Minneapolis, MN. Duties Include:
- Data Engineer will register data pipelines in Azure, onboard the dataset and enable data processing in Azure
- Build Airflow dags and ensure scheduling is inbuilt with integration
- Apply DevOps mindset, take ownership of production success, optimize operation success via automation/active alerting/self-healing, and lead the resolution of production issues to ensure high-availability and performance
- Develop high-quality code, define best engineering practice, perform peer code reviews to ensure successful deliverable with engineering excellence
- Document engineering artifacts such as technical design document, flowcharts, system context diagrams, code comments etc.
- Collaborate cross-functionally with product owner, data scientists, business users, project managers and other engineers to achieve elegant solutions
- Collaborate with other engineers on the team to elevate technology and consistently apply best
- Data Engineer will execute true end-to-end development and testing of software products in an agile lifecycle; Partnering with key technical and business stakeholders, ensure the quality of the final product through manual and automated tests, and support the new software as it is moved to production
Requirements
- Experience in managing big data sets - 10 years or higher
- Experience building microservices based applications - 5+ years
- Knowledge of Spark-Scala or Spark-SQL, Spark-Py - minimum 5 years
- Experience in Utilizing tools such as Maven, Docker, Kubernetes, Kibana, ELK, Jenkins, and frameworks such as Spring Boot to develop and deploy microservices - 4+ years
- Experience using CICD processes for application software integration and deployment using Maven, Git, and Jenkins - 4+ years
- Experience building scalable and resilient applications in private or public cloud environments and cloud technologies - 4+ years
- Experience in airflow, elastic, Azure - 3 years or higher
- Experience in Azure, Kubernetes, PostGres
The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.
We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.
Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.
This job is not eligible for bonuses, incentives or commissions.
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
By clicking “Apply Today” you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating via text by using key words such as STOP.
