Features

• benchmark: tui based benchmarking tool
• router: Clear cache on error
• server: Add mypy-protobuf
• server: reduce mlp and attn in one op for flash neox
• image: aws sagemaker compatible image

Fix

• server: avoid try/except to determine the kind of AutoModel
• server: fix flash neox rotary embedding