At TechnologyOne, we are obsessed with simplifying life for our customers and helping them adapt to the changing world around us. As we continue to grow, we're looking for an experienced Data Engineer to join our team and contribute to groundbreaking advancements in Artificial Intelligence (AI) and Machine Learning (ML).
As a Data Engineer at TechnologyOne, you will play a pivotal role in shaping the future of our AI/ML-powered data platform. You will be a key member of the Data Team, working on the design and implementation of Databricks to support advanced AI and Machine Learning initiatives. You will guide the business on how data should be emitted, ingested, and stored to drive AI/ML capabilities within our data platform.
What you'll be doing…
- <li data-leveltext="" data-aria-posinset="1" data-listid="1" data-font="Symbol" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-level="1">Contributing to solution designs that align with both operational and analytical needs, ensuring seamless integration of AI/ML technologies and transitioning them into production for data and AI-powered analytical products.
- <li data-aria-posinset="2" data-leveltext="" data-listid="1" data-font="Symbol" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-level="1">Leading efforts to transition away from AWS Kinesis and OpenSearch, incorporating AI/ML data patterns to enhance performance and analytics.
- <li data-aria-level="1" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-font="Symbol" data-listid="1" data-aria-posinset="3" data-leveltext="">Collaborating with cross-functional teams to design effective data ingestion patterns that support AI/ML models, adhering to enterprise strategies with a focus on data security and access control.
- <li data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-level="1" data-leveltext="" data-aria-posinset="4" data-font="Symbol" data-listid="1">Delivering high-performing, secure, and cost-effective cloud-based data solutions, including monitoring mechanisms to facilitate real-time solution management and AI model optimization.
- <li data-font="Symbol" data-listid="1" data-leveltext="" data-aria-posinset="5" data-aria-level="1" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}">Implementing data quality control processes to ensure accuracy, integrity, and consistency, particularly for AI/ML applications across all layers of the data platform.
- <li data-leveltext="" data-aria-posinset="6" data-listid="1" data-font="Symbol" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-level="1">Continuously monitoring and optimizing data pipelines, troubleshooting issues, and improving performance to ensure the reliability and efficiency of AI/ML-powered solutions.
Your Talents…
- <li data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-level="1" data-leveltext="" data-aria-posinset="7" data-listid="1" data-font="Symbol">Proven experience developing and delivering data platform solutions on Databricks & AWS, with a focus on supporting AI/ML workflows.
- <li data-leveltext="" data-aria-posinset="8" data-font="Symbol" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-level="1">Expertise in using Databricks to deliver high-quality ETL, stream, and batch workflows optimized for AI/ML processes.
- <li data-leveltext="" data-aria-posinset="9" data-listid="1" data-font="Symbol" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-level="1">Experience in implementing solutions for infrastructure and application performance monitoring, especially in the context of emitting events for AI/ML query engines in a scalable, performant, and cost-effective manner.
- <li data-leveltext="" data-aria-posinset="10" data-listid="1" data-font="Symbol" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-level="1">Proven engineering experience in Python, Spark, and SQL, with an understanding of how these technologies integrate with AI/ML pipelines.
- <li data-leveltext="" data-aria-posinset="11" data-listid="1" data-font="Symbol" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-level="1">Ability to translate business requirements into technical solutions that drive AI/ML initiatives.
- <li data-aria-level="1" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-font="Symbol" data-listid="1" data-leveltext="" data-aria-posinset="12">Experience designing and managing Terraform modules and deployments for AI/ML data infrastructure.