Based on transformers v4.5.1

New

• Allow different reduction factors for different adapter layers (@hSterz via #161)
• Allow dynamic dropping of adapter layers in load_adapter() (@calpt via #172)
• Add method get_adapter() to retrieve weights of an adapter (@hSterz via #169)

Changed

• Re-add adapter_names argument to model forward() methods (@calpt via #176)

Fixed

• Fix resolving of adapter from Hub when multiple options available (@Aaronsom via #164)
• Fix & improve adapter saving/ loading using Trainer class (@calpt via #178)