New Features

• Graph Enhancements -

  • De-duplication of nodes: User is provided with the option to select and merge nodes to eliminate redundancy and improve accuracy. #566
  • Post processing jobs: After extracting the knowledge graph, users can select from a range of post-processing jobs to fine-tune it. These options include:KNN Semantic Similarity Graph of chunks, Full-Text Index on Database Labels and Entity Embeddings Generation. #627

• Interactive graph visualization: User can highlight nodes/relations and also search node properties. #696

• Data table filtering - Users can refine the data displayed in the UI table by Filtering by file status/source/type/model or Sorting by Column #589, #664

• Vector dimensions mismatch - The application checks for compatible vector indexes in the user's graph database. If an incompatible index exists, an error message will appear and users can choose to create a new, compatible vector index. #594

• Hybrid search for chunks - The Graph+Vector+FullText retriever indexes nodes and relationships by their string properties using a FullText Index. This allows for efficient retrieval of graph data, specifically from chunk nodes. The 'keyword' index is automatically created if it doesn't exist when this mode is selected. #611, #670

Enhancements

• Graph Visualization for each document based on lexical graph or full knowledge graph with entities. #575

• OpenAI's LLMs as the default option. For users seeking to run OpenAI-compatible LLMs locally, simply provide the API key, base URL, and model name. The code will seamlessly transition to using ChatOpenAI from langchain. #588

• Concurrent File Processing Enhancements -

  • Batch Processing: Files are now processed in batches for efficient performance, regardless of whether the user selects a specific number of files or uses the "Select All" checkbox.
  • State Persistence: File processing status is maintained even after page refreshes. Waiting files will continue processing once ongoing tasks are completed.
  • Dynamic Batching: If the number of files to be processed is less than the batch size, the remaining capacity will be filled with additional files, ensuring optimal processing. #665

Bug Fixes

• User Interface Improvements -

  • Chat Detail Accuracy: Corrected an issue where incorrect retrieval information was displayed when viewing details of previous chat answers.
  • Enhanced UI Clarity: Improved UI elements for better clarity, including tooltips for the model dropdown, enhancements to the graph visualization, and a "Clear Schema" button. #572

• Data Integrity and Functionality -

  • Label and Relationship Sanitization: Improved data integrity by removing backticks from labels and relationship types. #547
  • Visualization Query Accuracy: Fixed an issue where the visualization query was pulling data from unintended documents, ensuring accurate results. #590

• General Bug Fixes -

  • Addressed several other existing bugs to enhance overall application stability and functionality. #584, #684