SOLIS – The MLOps journey from data acquisition to actionable insights

by   Razvan Ciobanu, et al.

Machine Learning operations is unarguably a very important and also one of the hottest topics in Artificial Intelligence lately. Being able to define very clear hypotheses for actual real-life problems that can be addressed by machine learning models, collecting and curating large amounts of data for model training and validation followed by model architecture search and actual optimization and finally presenting the results fits very well the scenario of Data Science experiments. This approach however does not supply the needed procedures and pipelines for the actual deployment of machine learning capabilities in real production grade systems. Automating live configuration mechanisms, on the fly adapting to live or offline data capture and consumption, serving multiple models in parallel either on edge or cloud architectures, addressing specific limitations of GPU memory or compute power, post-processing inference or prediction results and serving those either as APIs or with IoT based communication stacks in the same end-to-end pipeline are the real challenges that we try to address in this particular paper. In this paper we present a unified deployment pipeline and freedom-to-operate approach that supports all above requirements while using basic cross-platform tensor framework and script language engines.


page 1

page 2

page 3

page 4


PRETZEL: Opening the Black Box of Machine Learning Prediction Serving Systems

Machine Learning models are often composed of pipelines of transformatio...

InferLine: ML Inference Pipeline Composition Framework

The dominant cost in production machine learning workloads is not traini...

Serverless Model Serving for Data Science

Machine learning (ML) is an important part of modern data science applic...

AnoML-IoT: An End to End Re-configurable Multi-protocol Anomaly Detection Pipeline for Internet of Things

The rapid development in ubiquitous computing has enabled the use of mic...

Understanding the Benefits of Hardware-Accelerated Communication in Model-Serving Applications

It is commonly assumed that the end-to-end networking performance of edg...

MLCask: Efficient Management of Component Evolution in Collaborative Data Analytics Pipelines

With the ever-increasing adoption of machine learning for data analytics...

SINGA-Easy: An Easy-to-Use Framework for MultiModal Analysis

Deep learning has achieved great success in a wide spectrum of multimedi...

Please sign up or login with your details

Forgot password? Click here to reset