Release Notes for Version 1.0.2

What's New

1. New features

• Adds Astra vector store support https://github.com/Dataherald/dataherald/commit/6f3989282391badbcd3ec448b4447e99cd85a3c5
• Adds MS SQL Server support https://github.com/Dataherald/dataherald/commit/078c17dfa8a78b5fe6e88bdb2f3a94c7bdfa235d
• Adds Streaming endpoint to show intermediate steps https://github.com/Dataherald/dataherald/commit/1205d8a9e165ad7dfed68c449a7df926fb637909
• Adds support to Pinecone serverless https://github.com/Dataherald/dataherald/commit/7906f03eb0f5a2d05e6e829d53295e5451c6831c
• Adds intermediate steps in the SQL Generation response https://github.com/Dataherald/dataherald/commit/3dbd483d4d145403adbd8344d8b593d923be1f3c
• Adds LangSmith metadata param(langsmith_metadata) to easily filter https://github.com/Dataherald/dataherald/commit/cf88a1bba40c7b33dae849e460f5a571c517101f
• Stores the db dialect when a db connection is created https://github.com/Dataherald/dataherald/commit/809ac310957f838af6df866e294b18702069b3a3

2. Improvements and fixes

• Adds logs when a request fails https://github.com/Dataherald/dataherald/commit/09f65c62024821ef16f67a0acc9e35849b4b2ebf
• Adds descriptions to the new agent https://github.com/Dataherald/dataherald/commit/faf07de048d4269758031cf6207832819083ebb9
• Fixes malformed LLM output https://github.com/Dataherald/dataherald/commit/4190b4d6a93b151e39b84536a42c58a7928b07e6
• Documents error codes https://github.com/Dataherald/dataherald/commit/e94c788d5f301024a3e973e7b21c4c916c1bdcb7
• Fixes the running query forever issue https://github.com/Dataherald/dataherald/commit/cfb1d5bb6997ad2875e43e6f1300e631d6e36f27
• Fixes the error parsing handler https://github.com/Dataherald/dataherald/commit/8751410ae6d3aecd43b5bd7f0c8c91b46c537fb7
• Added Click House Hyperloglog support to improve the scaninng https://github.com/Dataherald/dataherald/commit/61a92c9aef35805cd4074807df85a0baf14ad17f
• Fixes SQL generation https://github.com/Dataherald/dataherald/commit/5160e8d537a615751330517004d96340ad96247f
• Fixes background scanner process in Parallel https://github.com/Dataherald/dataherald/commit/88ee8fa6af79f26feec3974099b9da7620029725
• Fixes error handling for golden SQL additions https://github.com/Dataherald/dataherald/commit/8efb00f13b43fd903b236c501a293d0a1fb5910d

3. Migration Script

• Purpose: To facilitate a smooth transition from version 1.0.1 to version 1.0.2, we've introduced a migration script.
• Data Modifications: The script performs the following actions:
  • Decrypts all the db connection uri column
  • Executes a regex method to retrieve the db dialect.
  • Stores dialect column in database_connections mongo collection.

To run the migration script, use the following command:

docker-compose exec app python3 -m dataherald.scripts.populate_dialect_db_connection

New Contributors

• @santurini https://github.com/Dataherald/dataherald/issues/424
• @java668 https://github.com/Dataherald/dataherald/issues/431
• @toliver38 https://github.com/Dataherald/dataherald/issues/396 https://github.com/Dataherald/dataherald/issues/395
• @Harshitdy https://github.com/Dataherald/dataherald/issues/443
• @zhanpengjie https://github.com/Dataherald/dataherald/issues/446