New Core Features

• [RAG] Web search engine as a retriever for RAG and as a tool by @czelabueno in https://github.com/langchain4j/langchain4j/pull/642
• [RAG] Option to return retrieved Contents/TextSegments when using AI Services by @KaisNeffati in https://github.com/langchain4j/langchain4j/pull/1015
• [RAG] (Experimental) SQL database content retriever (SqlDatabaseContentRetriever) by @langchain4j in https://github.com/langchain4j/langchain4j/pull/1056
• LLM Observability: Part 1 (OpenAI) by @langchain4j in https://github.com/langchain4j/langchain4j/pull/1058

New Integrations

• Cohere: embedding model by @stephanj in https://github.com/langchain4j/langchain4j/pull/1145
• Google: web search engine by @czelabueno in https://github.com/langchain4j/langchain4j/pull/641
• Tavily: web search engine by @kuraleta in https://github.com/langchain4j/langchain4j/pull/676
• Jina: embedding model by @lucifer-Hell in https://github.com/langchain4j/langchain4j/pull/997
• Jina: scoring (re-ranking) model by @One16-KS in https://github.com/langchain4j/langchain4j/pull/1053
• Azure Cosmos DB for NoSQL: embedding store by @aayush3011 in https://github.com/langchain4j/langchain4j/pull/1115

Notable Changes

• Azure OpenAI: migrate from functions to tools by @jdubois in https://github.com/langchain4j/langchain4j/pull/529
• Vertex AI Gemini: support system messages and parallel tools by @glaforge in https://github.com/langchain4j/langchain4j/pull/1141
• PgVector: implement metadata filtering (3 implementations: JSON, JSONB and separate columns) by @humcqc in https://github.com/langchain4j/langchain4j/pull/851
• PgVector: implement removal (all, by ID, by IDs, by filter) by @humcqc in https://github.com/langchain4j/langchain4j/pull/1113
• Weaviate: implement storing metadata and support gRPC by @ehsavoie in https://github.com/langchain4j/langchain4j/pull/800
• AWS Bedrock: add streaming model for Anthropic by @michalkozminski in https://github.com/langchain4j/langchain4j/pull/1006
• OpenAI: allow adding custom HTTP headers by @ProstoSanja in https://github.com/langchain4j/langchain4j/pull/858

Breaking Changes

• Anthropic: migrate from Gson to Jackson by @langchain4j in https://github.com/langchain4j/langchain4j/pull/1043
• Judge0: extract into a separate module by @anunnakian in https://github.com/langchain4j/langchain4j/pull/1051
• Judge0: change package name by @anunnakian in https://github.com/langchain4j/langchain4j/pull/1136

Other Changes

• fix Example with Spring Boot url typo in README by @Kugaaa in https://github.com/langchain4j/langchain4j/pull/959
• Create a Code of Conduct by @jdubois in https://github.com/langchain4j/langchain4j/pull/825
• Update to actions/checkout@v4 and actions/setup-java@v4 by @jdubois in https://github.com/langchain4j/langchain4j/pull/824
• fix ollama client response handle by @HashJang in https://github.com/langchain4j/langchain4j/pull/867
• Update to Azure Identity 1.12.0 by @jdubois in https://github.com/langchain4j/langchain4j/pull/912
• Fix #876 by @1402564807 in https://github.com/langchain4j/langchain4j/pull/925
• #904 Support advanced POJO/JSON extraction features by @remyohajinwa in https://github.com/langchain4j/langchain4j/pull/975
• Refactor the code to avoid duplication between integrations by @karesti in https://github.com/langchain4j/langchain4j/pull/845
• Bump com.azure:azure-storage-common from 12.24.3 to 12.24.4 by @jdubois in https://github.com/langchain4j/langchain4j/pull/1017
• Bump com.azure:azure-search-documents from 11.6.3 to 11.6.4 by @jdubois in https://github.com/langchain4j/langchain4j/pull/1016
• Bump dashscope-sdk-java from 2.10.1 to 2.13.0. by @jiangsier-xyz in https://github.com/langchain4j/langchain4j/pull/1024
• Bump com.azure:azure-storage-blob from 12.25.3 to 12.25.4 by @jdubois in https://github.com/langchain4j/langchain4j/pull/1018
• Upgrade to com.azure:azure-ai-openai 1.0.0-beta.8 by @jdubois in https://github.com/langchain4j/langchain4j/pull/991
• fix: introduce OpenAIAsyncClient for AzureOpenAiStreamingChatModel by @emivoz in https://github.com/langchain4j/langchain4j/pull/879
• [BUG] Introduce parser supplier support in FileSystemDocumentLoader by @KaisNeffati in https://github.com/langchain4j/langchain4j/pull/1031
• Bugfix/fix 0 retry times by @VaderKai in https://github.com/langchain4j/langchain4j/pull/981
• Ollama add OkhttpClient inject by @Martin7-1 in https://github.com/langchain4j/langchain4j/pull/911
• Bump com.azure:azure-identity from 1.12.0 to 1.12.1. by @jdubois in https://github.com/langchain4j/langchain4j/pull/1082
• feat : create llama3 model image by @rajadilipkolli in https://github.com/langchain4j/langchain4j/pull/1083
• Handle misconfigured tools by @anunnakian in https://github.com/langchain4j/langchain4j/pull/1054
• Fix #1124: preserve metadata during query compression by @langchain4j in https://github.com/langchain4j/langchain4j/pull/1133
• Adding missing -azure-ai-search and azure-cosmos-mongo-vcore to the BOM by @agoncal in https://github.com/langchain4j/langchain4j/pull/1127
• Upgrade com.azure:azure-storage-common from 12.24.4 to 12.25.0. by @jdubois in https://github.com/langchain4j/langchain4j/pull/1130
• Upgrade com.azure:azure-storage-blob from 12.25.4 to 12.26.0 by @jdubois in https://github.com/langchain4j/langchain4j/pull/1131
• Fix #935 by @langchain4j in https://github.com/langchain4j/langchain4j/pull/1119
• Instructions for adding base langchain4j dependency by @thesteve0 in https://github.com/langchain4j/langchain4j/pull/1138
• AzureAiSearchEmbeddingStore - add "indexName" to the builder by @jdubois in https://github.com/langchain4j/langchain4j/pull/1084
• add logs for OllamaClient by @HashJang in https://github.com/langchain4j/langchain4j/pull/662
• Support GTP-4o with Azure OpenAI by @jdubois in https://github.com/langchain4j/langchain4j/pull/1144
• gpt-o by @kuraleta in https://github.com/langchain4j/langchain4j/pull/1099
• New Mistral open mixtral8x22b model by @czelabueno in https://github.com/langchain4j/langchain4j/pull/978
• [Documentation] Mistral open mixtral8x22b docs by @czelabueno in https://github.com/langchain4j/langchain4j/pull/979
• Fix: #950 ZhipuAiChatModel does not support tools without parameters by @1402564807 in https://github.com/langchain4j/langchain4j/pull/999

New Contributors

• @HashJang made their first contribution in https://github.com/langchain4j/langchain4j/pull/867
• @ProstoSanja made their first contribution in https://github.com/langchain4j/langchain4j/pull/858
• @humcqc made their first contribution in https://github.com/langchain4j/langchain4j/pull/851
• @emivoz made their first contribution in https://github.com/langchain4j/langchain4j/pull/879
• @KaisNeffati made their first contribution in https://github.com/langchain4j/langchain4j/pull/1031
• @VaderKai made their first contribution in https://github.com/langchain4j/langchain4j/pull/981
• @ehsavoie made their first contribution in https://github.com/langchain4j/langchain4j/pull/800
• @anunnakian made their first contribution in https://github.com/langchain4j/langchain4j/pull/1054
• @thesteve0 made their first contribution in https://github.com/langchain4j/langchain4j/pull/1138
• @lucifer-Hell made their first contribution in https://github.com/langchain4j/langchain4j/pull/997
• @One16-KS made their first contribution in https://github.com/langchain4j/langchain4j/pull/1053

Full Changelog: https://github.com/langchain4j/langchain4j/compare/0.30.0...0.31.0