Loading…
View analytic
Tuesday, December 5 • 5:30pm - 5:35pm
Lightning Talk: How Kubernetes is Helpful for Accelerating Machine Learning Research and Engineering [I] - Hitoshi Mitake, NTT Labs

Sign up or log in to save this to your schedule and see who's attending!

In this lightning talk, the presenter shares his experience on helping machine learning research and engineering with kubernetes. k8s is not only a tool for managing microservices but also helpful for executing batch jobs like learning phase of deep learning frameworks and stateful services that provides data for the learning tasks. The presenter and his collaborators has been building and managing k8s cluster for TensorFlow learning tasks and HDFS as its learning data source. In addition, thanks to the pluggable scheduler architecture of k8s, their custom scheduler enshorts execution the learning tasks effecitvely and hides usage of network equipments and complex heterogeneous computational devices (e.g. GPUs) from researchers.

Speakers
avatar for Hitoshi Mitake

Hitoshi Mitake

Research Engineer, NTT Labs.
Hitoshi Mitake is a software engineer working for NTT Laboratories. He has been working on distributed storage systems for 5 years. His recent activities includes developing etcd, especially auth related stuff, as one of the maintainers. He is also working on techniques of effectively... Read More →



Tuesday December 5, 2017 5:30pm - 5:35pm
Ballroom A, Level 1