Kubeflow brings Kubernetes to machine learning workloads

Kubeflow brings Kubernetes to machine learning workloads

Now in beta, the open source Kubeflow project aims to help deploy a machine learning stack on the Kubernetes container orchestration system.

The Kubeflow machine learning toolkit project is intended to help deploy machine learning workloads across multiple nodes but where breaking up and distributing a workload can add computational overhead and complexity. Kubernetes itself is tasked with making it easier to manage distributed workloads, while Kubeflow centers on making the running of these workloads portable, scalable, and simple. Scripts and configuration files are part of the project. Users can customize their configuration and run scripts to deploy containers to a chosen environment.

To help management deployments, Kubeflow works with Version 0.11.0 or later of the Ksonnet framework, for writing and deploying Kubernetes configurations to clusters. Kubernetes 1.8 or later is required, in a cluster configuration. Kubeflow also works with the following technologies:

  • TensorFlow machine learning models, which can be trained for use on premises or in the cloud.
  • Jupyter notebooks, to manage TensorFlow training jobs.
  • Seldon Core, a platform for deploying machine learning models on Kubernetes.

Kubeflow extends the Kubernetes API by adding custom resource definitions to a cluster, so Kubernetes can treat machine learning workloads as first-class citizens. Described by the open source project as being cloud-native, Kubeflow also integrates with the Ambassador for Ingress and Pachyderm projects for management of data science pipelines. Plans call for extending Kubeflow beyond TensorFlow, with backing considered for the PyTorch and MXNet deep learning frameworks. 

Where to download Kubeflow

You can download Kubeflow from GitHub.

IDG Insider

PREVIOUS ARTICLE

« Microsoft tags Windows 10 1809 with the catchy name 'October 2018 Update'

NEXT ARTICLE

AMD's 16-core Ryzen Threadripper 2950X processor hits stores today »
author_image
IDG News Service

The IDG News Service is the world's leading daily source of global IT news, commentary and editorial resources. The News Service distributes content to IDG's more than 300 IT publications in more than 60 countries.

  • Mail

Recommended for You

Future-proofing the Middle East

Keri Allan looks at the latest trends and technologies

FinancialForce profits from PSA investment

Martin Veitch's inside track on today’s tech trends

Amazon Cloud looms over China: Bezos enters Alibaba home ground

Lewis Page gets down to business across global tech

Poll

Do you think your smartphone is making you a workaholic?