Job Overview
We are seeking a highly skilled and motivated Software Engineer to join our dynamic team on a contract basis. In this role, you will have the opportunity to contribute to significant projects involving the creation and maintenance of API interfaces, data ingestion and transformation, and collaboration with fellow developers to ensure efficient system functionality.
Key Responsibilities
- Design and enhance API interfaces to integrate with MySQL backend databases hosted on AWS ECS using Python.
- Ingest data from various sources into the Enterprise Data Lake.
- Transform data and generate common tables utilizing PySpark and SQL.
- Load transformed data back into MySQL from the Enterprise Data Lake.
- Analyze data leveraging SQL and PySpark for insights.
- Manage and update AWS resources to ensure optimal performance.
- Collaborate with front-end developers to establish API specifications.
- Develop test scripts in Python to verify data replication processes.
- Liaise with the product manager and end-users to collect requirements and facilitate a seamless development workflow.
Required Skills
- 3-5 years of experience in SQL, Python, and cloud computing (AWS preferred).
- Proficiency in Python, SQL, and PySpark.
- Strong knowledge of AWS services, including IAM, Lambda, S3, RDS, ECS, and EC2.
- Practical experience in developing jobs and pipelines within Databricks.
- Familiarity with Docker and containerization concepts, along with REST API development using Python.
Qualifications
- A degree in Computer Science or a related field is preferred.
- Demonstrated experience in software engineering, particularly with SQL and Python.
Career Growth Opportunities
This position offers substantial potential for career advancement as you engage in innovative projects within a supportive environment that values professional development.
Company Culture And Values
Become part of a collaborative and inclusive remote work environment that fosters innovation and creative problem-solving, making it an ideal setting for those who thrive in a fast-paced and dynamic atmosphere.
Why Join Us?
You will have the chance to work on impactful projects while building your professional network and honing your skills in a technology-driven environment. This role is designed for individuals who are passionate about technology and eager to contribute to high-quality results.
Employment Type: Contractor