Tune Yarn - CPU assignment by YARN should limit CPU number for each job

Tune Yarn

You can set CPU limit using yarn.scheduler.maximum-allocation-vcores and yarn.nodemanager.resource.cpu-vcores in yarn-site.xml. decription is below

yarn.scheduler.maximum-allocation-vcores: controls the maximum vcores that any submitted job can request.

yarn.nodemanager.resource.cpu-vcores: controls how many vcores can be scheduled on a particular NodeManager instance.