Skip to content
This repository was archived by the owner on Jun 6, 2024. It is now read-only.

Latest commit

 

History

History

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 

README.md

Microsoft FrameworkLauncher

FrameworkLauncher (or Launcher for short) is an OpenPAI subproject and standalone component, that is built to orchestrate all kinds of applications on YARN and Kubernetes through the same interface without making changes to the applications themselves.

These applications include but not limited to:

  • Long-Running Services (DeepLearning Serving, HBase, Kafka, etc)
  • Batch Jobs (DeepLearning Training, KDTree Building, etc)
  • Streaming Jobs (Data Processing, etc).

YARN FrameworkLauncher

FrameworkLauncher Natively Supports YARN: YARN FrameworkLauncher.

Note, it ALSO includes scheduling features, such as Topology-Aware Gpu Scheduling.

Kubernetes FrameworkLauncher

FrameworkLauncher Natively Supports Kubernetes: Kubernetes FrameworkController.

Note, it does NOT includes scheduling features, for the scheduling counterpart, we have already splitted it to another dedicated project: HiveDScheduler, and you can directly leverage it with the Kubernetes FrameworkController.