Streams Yarn Tags Support

The Streams Yarn Application Master supports Streams Resource Tags for specifying sizes of containers required for services. One can specify properties on any resource tag to indicate the size of the container required. If multiple tags and properties are present, the largest of the values is used when requesting a particular container. The following is a sample of tag properties that can be specified.

memory=8192
cores=2

• The memory property is the maximum amount of memory in MB that will be requested for the container.
• The cores property is the maximum amount of cpu cores that will be requested for the container.

Note that the tag properties should be applied before the resources are requested to be effective.

Refer to the Apache Yarn documentation on how the memory and cores are mapped to actual resources. The default memory/cpu values for various types of resources are specified here