At OpsGuru, we're a people-first, customer-obsessed company motivated by our passion for empowering organizations of all sizes to embrace the power of Cloud technology through impactful, reliable and scalable consultancy services.
Our team is made up of technical experts, creatives, salespeople, and many more. We work together to drive our mission forward and raise the bar for our customers daily, bringing their vision to life. We strive to be a workplace of inspired minds by fostering an environment that encourages innovative thinking, where everyone can grow and contribute to achieving their goals.
Our long-term vision is to continue being an innovative and inspiring company that our customers and employees admire, and we invite you to join us!
About the role:
As a Data Engineer, you will be part of the OpsGuru professional services team architecting, designing, automating, and deploying production-grade data services and flows on behalf of our customers to a variety of public clouds such as AWS, Google Cloud and Azure.
What you'll be doing:
- Building and optimizing ETL/ELT processes for efficiency and reliability, employing modern tools such as Dbt, Glue, and custom scripts in Python, Scala, or Java.
- Building robust data pipelines that integrate data science and machine learning models, leveraging Spark, Airflow, and MLflow.
- Implementing and maintaining scalable data storage and computation solutions, including Data Lakes, Data Warehouses, and NoSQL databases, to support advanced analytics and AI-driven applications.
- Developing and maintaining real-time data processing and analytics platforms using Kafka, Spark Streaming, Kinesis, Pub Sub, and other streaming technologies to enable instant insights and decision-making.
- Establishing credibility and build impactful relationships with our customers
Your skills & experience:
- 5+ years of hands-on experience in data engineering, with a proven track record of designing and implementing large-scale data processing and analytics systems.
- 2+ years of experience working with AI/ML models in production environments, including experience with machine learning frameworks (e.g., TensorFlow, PyTorch) and model deployment and monitoring tools.
- 3+ years’ of experience in production database architectures (such as MySQL, PostgreSQL, MS SQL Server, Oracle) and data pipeline development
- Demonstrated knowledge of software development tools and methodologies
- Deep understanding of data modeling, data architecture, and data storage strategies for both structured and unstructured data.
- Strong foundation in distributed systems and big data technologies, with extensive experience in at least a few of the following: Spark, Hadoop, Kafka, Airflow, MLflow, Cassandra, ElasticSearch.
- Expertise in cloud platforms and services for data and ML workloads (AWS, Google Cloud, Azure), including managed services (e.g., AWS Sagemaker, Google AI Platform, Azure ML) and serverless computing.
- Excellent problem-solving abilities and strong communication skills, capable of effectively articulating complex technical concepts to non-technical stakeholders.
- A Bachelor’s or Master’s degree in Computer Science, Engineering, Mathematics, Statistics, or a related field, with additional certifications or coursework in data science and machine learning highly regarded.
- Demonstrated ability to adapt to new technologies and learn quickly
What's in it for you:
Compensation & Perks
- Competitive compensation package as a contractor
Flexibility
- Remote first work environment
- Flexible work hours & location
At OpsGuru, we encourage employees to bring their whole, authentic selves to work. By sharing and embracing unique backgrounds, experiences, and perspectives, we learn from each other, innovate, and create a dynamic environment where we can be and achieve our best.
We're dedicated to ensuring each member feels a sense of belonging, safety, and respect. At OpsGuru, your unique voice is heard and embraced, and you meaningfully contribute to decision-making and the organization's growth.
OpsGuru is committed to an equitable employee experience, opportunity, and support. If you require accommodations or support during the recruitment process, please email us at hr@opsguru.io.