v0.1.14
版本发布时间: 2024-02-28 16:47:19
InternLM/xtuner最新发布版本:v0.1.23(2024-07-22 20:19:23)
What's Changed
- set dev version by @LZHgrla in https://github.com/InternLM/xtuner/pull/341
- [Feature] More flexible
TrainLoop
by @LZHgrla in https://github.com/InternLM/xtuner/pull/348 - [Feature]Support CEPH by @pppppM in https://github.com/InternLM/xtuner/pull/266
- [Improve] Add
--repetition-penalty
forxtuner chat
by @LZHgrla in https://github.com/InternLM/xtuner/pull/351 - [Feature] Support MMBench DDP Evaluate by @pppppM in https://github.com/InternLM/xtuner/pull/300
- [Fix]
KeyError
ofencode_fn
by @LZHgrla in https://github.com/InternLM/xtuner/pull/361 - [Fix] Fix
batch_size
of full fine-tuing LLaVA-InternLM2 by @LZHgrla in https://github.com/InternLM/xtuner/pull/360 - [Fix] Remove
system
foralpaca_map_fn
by @LZHgrla in https://github.com/InternLM/xtuner/pull/363 - [Fix] Use
DEFAULT_IMAGE_TOKEN
instead of'<image>'
by @LZHgrla in https://github.com/InternLM/xtuner/pull/353 - [Feature] Support internlm sft by @HIT-cwh in https://github.com/InternLM/xtuner/pull/302
- [Fix] Add
attention_mask
fordefault_collate_fn
by @LZHgrla in https://github.com/InternLM/xtuner/pull/371 - [Fix] Update requirements by @LZHgrla in https://github.com/InternLM/xtuner/pull/369
- [Fix] Fix rotary_base, add
colors_map_fn
toDATASET_FORMAT_MAPPING
and rename 'internlm_repo' to 'intern_repo' by @HIT-cwh in https://github.com/InternLM/xtuner/pull/372 - update by @HIT-cwh in https://github.com/InternLM/xtuner/pull/377
- Delete useless codes and refactor process_untokenized_datasets by @HIT-cwh in https://github.com/InternLM/xtuner/pull/379
- [Feature] support flash attn 2 in internlm1, internlm2 and llama by @HIT-cwh in https://github.com/InternLM/xtuner/pull/381
- [Fix] Fix installation docs of mmengine in
intern_repo_dataset.md
by @LZHgrla in https://github.com/InternLM/xtuner/pull/384 - [Fix] Update InternLM2
apply_rotary_pos_emb
by @LZHgrla in https://github.com/InternLM/xtuner/pull/383 - [Feature] support saving eval output before save checkpoint by @HIT-cwh in https://github.com/InternLM/xtuner/pull/385
- fix lr scheduler setting by @gzlong96 in https://github.com/InternLM/xtuner/pull/394
- [Fix] Remove pre-defined
system
ofalpaca_zh_map_fn
by @LZHgrla in https://github.com/InternLM/xtuner/pull/395 - [Feature] Support
Qwen1.5
by @LZHgrla in https://github.com/InternLM/xtuner/pull/407 - [Fix] Fix no space in chat output using InternLM2. (#357) by @KooSung in https://github.com/InternLM/xtuner/pull/404
- [Fix] typo:
--system-prompt
to--system-template
by @LZHgrla in https://github.com/InternLM/xtuner/pull/406 - [Improve] Add
output_with_loss
for dataset process by @LZHgrla in https://github.com/InternLM/xtuner/pull/408 - [Fix] Fix dispatch to support transformers>=4.36 & Add USE_TRITON_KERNEL environment variable by @HIT-cwh in https://github.com/InternLM/xtuner/pull/411
- [Feature]Add InternLM2-Chat-1_8b full config by @KMnO4-zx in https://github.com/InternLM/xtuner/pull/396
- [Fix] Fix extract_json_objects by @fanqiNO1 in https://github.com/InternLM/xtuner/pull/419
- [Fix] Fix pth_to_hf error by @LZHgrla in https://github.com/InternLM/xtuner/pull/426
- [Feature] Support
Gemma
by @PommesPeter in https://github.com/InternLM/xtuner/pull/429 - add refcoco to llava by @LKJacky in https://github.com/InternLM/xtuner/pull/425
- [Fix] Inconsistent BatchSize of
LengthGroupedSampler
by @LZHgrla in https://github.com/InternLM/xtuner/pull/436 - bump version to v0.1.14 by @LZHgrla in https://github.com/InternLM/xtuner/pull/431
New Contributors
- @gzlong96 made their first contribution in https://github.com/InternLM/xtuner/pull/394
- @KooSung made their first contribution in https://github.com/InternLM/xtuner/pull/404
- @KMnO4-zx made their first contribution in https://github.com/InternLM/xtuner/pull/396
- @fanqiNO1 made their first contribution in https://github.com/InternLM/xtuner/pull/419
- @PommesPeter made their first contribution in https://github.com/InternLM/xtuner/pull/429
- @LKJacky made their first contribution in https://github.com/InternLM/xtuner/pull/425
Full Changelog: https://github.com/InternLM/xtuner/compare/v0.1.13...v0.1.14