OctoML Accelerates ML Innovation Across Arm Hardware and Embedded Environments
October 21, 2021
News
OctoML announced a collaboration with Arm to deploy next-generation machine learning (ML) applications and models across its suite of hardware.
The partnership is designed to enable Arm partners to upload machine learning models to the OctoML platform and receive optimized and packaged versions of the model fine-tuned to Arm hardware.
Arm is also contributing engineering effort to Apache TVM which provides companies developing ML on Arm technology one unified software stack to deploy models seamlessly across microcontrollers, GPUs, NPUs, and CPUs.
Apache TVM is a software framework that provides a unified layer between the machine learning frameworks—like PyTorch, TensorFlow—and the array of hardware solutions available. According to the companies, this means that ML models can be deployed anywhere from cloud to edge to mobile.
Arm's open source efforts in providing Apache TVM support to Arm Cortex-A processors, Cortex-M processors, Arm Mali-GPUs and Arm Ethos-NPUs, is designed to ensures that data scientists, software and embedded developers can now use a single software stack that works on the chips based on Arm technology.
Built on the Apache TVM open source framework, OctoML's Platform provides an automation framework that optimizes trained models to achieve optimal performance across hardware endpoints and cloud services—without compromising accuracy. The platformis enabled to address the challenge of optimizing ML models to match the resources at the edge, which opens up opportunities for a new wave of intelligent apps.
For more information, visit here.
Tiera Oliver is the assistant managing editor at Embedded Computing Design. She is responsible for web content editing, product news, and story development. She also manages, edits, and develops content for ECD podcasts, including Embedded Insiders.
She utilizes her expertise in journalism and content management to oversee editorial content, coordinate with editors, and ensure high-quality output across web, print, and multimedia platforms. She manages diverse projects, assists in the production of digital magazines, and hosts company podcasts by conducting in-depth interviews with industry leaders to deliver engaging and insightful discussions.
Tiera attended Northern Arizona University, where she received her bachelor's in journalism and political science. She was also a news reporter for the student-led newspaper, The Lumberjack.
