What's Changed

• Replace FastAPI with Flask by @rjwharry in https://github.com/Marker-Inc-Korea/AutoRAG/pull/657
• Mock all OpenAI Embeddings at the test code for outside contributors by @vkehfdl1 in https://github.com/Marker-Inc-Korea/AutoRAG/pull/659
• Add basic dataset schema for new 'beta' version of data creation by @vkehfdl1 in https://github.com/Marker-Inc-Korea/AutoRAG/pull/663
• Add AutoParse baseline and module 'langchain_parse' and 'clova' by @bwook00 in https://github.com/Marker-Inc-Korea/AutoRAG/pull/660
• Add llamaparse module by @bwook00 in https://github.com/Marker-Inc-Korea/AutoRAG/pull/666
• replace yaml.dump with yaml.safe_dump by @rjwharry in https://github.com/Marker-Inc-Korea/AutoRAG/pull/669
• Add table hybrid parse module by @bwook00 in https://github.com/Marker-Inc-Korea/AutoRAG/pull/668
• [Data Creation Refactoring] Add generate qa set features by @vkehfdl1 in https://github.com/Marker-Inc-Korea/AutoRAG/pull/678
• Add more data creation methods by @vkehfdl1 in https://github.com/Marker-Inc-Korea/AutoRAG/pull/680
• add (auto)chunk and its first module llama_index_chunk by @bwook00 in https://github.com/Marker-Inc-Korea/AutoRAG/pull/681
• [Data Creation Refactoring] Add don't know filter at data creation and its docs by @vkehfdl1 in https://github.com/Marker-Inc-Korea/AutoRAG/pull/686
• [Chunk] Add "path" and "start_end_idx" at chunk return by @bwook00 in https://github.com/Marker-Inc-Korea/AutoRAG/pull/685
• add override at Raw and Chunker from_parquet classmethod by @vkehfdl1 in https://github.com/Marker-Inc-Korea/AutoRAG/pull/692
• [Chunk] Add langchain chunk module by @bwook00 in https://github.com/Marker-Inc-Korea/AutoRAG/pull/693
• Fix bug when use vllm in multi-gpu environment by @vkehfdl1 in https://github.com/Marker-Inc-Korea/AutoRAG/pull/697
• Add chunk method at Raw schema and test whole pipeline to generate initial dataset. by @vkehfdl1 in https://github.com/Marker-Inc-Korea/AutoRAG/pull/698
• fix an issue with loading HuggingfaceLLM models by @jis478 in https://github.com/Marker-Inc-Korea/AutoRAG/pull/652
• [Bug] Modify to kiwipiepy version 0.18.0 or higher by @bwook00 in https://github.com/Marker-Inc-Korea/AutoRAG/pull/704
• refactor existing metric python files with input schema by @Eastsidegunn in https://github.com/Marker-Inc-Korea/AutoRAG/pull/667
• dump version 0.2.16 by @vkehfdl1 in https://github.com/Marker-Inc-Korea/AutoRAG/pull/705

New Contributors

• @jis478 made their first contribution in https://github.com/Marker-Inc-Korea/AutoRAG/pull/652

Full Changelog: https://github.com/Marker-Inc-Korea/AutoRAG/compare/v0.2.15...v0.2.16