Commit used by the 21.06 TensorRT NGC container

Changelog

Added

• Add switch for batch-agnostic mode in NMS plugin
• Add missing model.py in uff_custom_plugin sample

Changed

• Update to Polygraphy v0.29.2
• Update to ONNX-GraphSurgeon v0.3.9
• Fix numerical errors for float type in NMS/batchedNMS plugins
• Update demoBERT input dimensions to match Triton requirement #1051
• Optimize TLT MaskRCNN plugins:
  • enable fp16 precision in multilevelCropAndResizePlugin and multilevelProposeROIPlugin
  • Algorithms optimization for NMS kernels and ROIAlign kernel
  • Fix invalid cuda config issue when bs is larger than 32
  • Fix issues found on Jetson NANO

Removed

• Removed fcplugin from demoBERT to improve inference latency on GA100/Turing