# Release Notes
Summary of the latest updates in MyScale, including new features, improvements, and important bug fixes.
If a new version of MyScaleDB with fixes is available, we recommend that you upgrade at the next available opportunity. For instructions on upgrading your DB version, refer to this guide.
Keep in mind that after each release involving console changes, there might be web interface updates that require a refresh for proper functionality.
For any inquiries about these features or upgrades, don't hesitate to reach out to Support & Help.
# October 10, 2024
# MyScaleDB v1.8.0
Features & Improvements
- Add support for multiple
distance()
functions in a single query. - Resolve score calculation error in distributed hybrid search.
- Improve filterd vector search performance by intrudcing a setting for parallel reading in
performPrefilter()
. - Enhance
TextSearch()
andHybridSearch()
to support multi-column FTS indexing.
# September 5, 2024
# MyScaleDB v1.7.1
Highlight Features
- Add support for full-text search across multiple text columns.
Features & Improvements
- Optimize queries per second (QPS) for TextSearch during inserts.
- Optimize filter search for large datasets.
- Implement parallel reading in
performPrefilter()
.
Fixes
- Correct BM25 calculation error in distributed text search.
- Correct distance results for Cosine distance in two-stage vector search.
- Address various bugs in the full-text search function.
- Fix segmentation fault when executing parallel text search selects with FINAL.
- Fix a critical issue with removing the FTS index cache directory.
- Resolve error when performing hybrid search on distributed tables.
- Resolve the "failed to load Tantivy index file" error when deleting parts.
- Resolve the tantivy index loading error.
# July 31, 2024
# MyScaleDB v1.6.4
Features & Improvements
- Add a query setting,
enable_fts_index_for_string_functions
, to disable the FTS index for string functions by default. - Add the
icu
multilingual tokenizer for the FTS index.
Fixes
- Fix the vector search performance issue related to low filter ratios.
# July 10, 2024
# MyScaleDB v1.6.3
Features & Improvements
- Support basic paging operations for hybrid, vector, and text searches.
Fixes
- Fix
TextSearch()
performance degradation after lightweight delete.
# June 19, 2024
# MyScaleDB v1.6.2
Highlight Features
- Add
HybridSearch()
function.
Features & Improvements
- Enable NVMe SSD cache reuse after server restart.
- Improve
SELECT
performance whenPREWHERE
includes the partition key.
Fixes
- Resolve the bug that the configured throttler cannot take effect when writing data to S3.
- Fix a bug where the MSTG index returns fewer than the top K results.
- Optimize logic for loading FTS indexes.
# May 14, 2024
# MyScaleDB v1.5.4
Fixes
- Resolve the problem of mismatched checksums of FTS indexes from different replicas, which was introduced in v1.5.3.
# April 30, 2024
# MyScaleDB v1.5.3
Fixes
- Resolve the problem that caused the MSTG vector index to fail to build after a server restart, which was introduced in v1.4.0.
# April 29, 2024
# MyScaleDB v1.5.2
Highlight Features
- Support full-text search with BM25 scoring using the Tantivy index. For more details, visit our blog (opens new window) and documentations of text search and hybrid search.
Features & Improvements
- Conduct an in-depth refactoring of the vector index.
- Add default vector index type.
# April 18, 2024
# MyScaleDB v1.4.0
Highlight Features
- Add support for multiple column vector indexes.
Fixes
- Resolve an issue where canceling a vector index build causing the index to freeze.
- Address an issue where the vector index might not update properly when using the ReplicatedMergeTree engine.
Features & Improvements
- Refactor vector index manager.
# March 14, 2024
# MyScaleDB v1.3.1
Highlight Features
- Add support for indexing vectors consisting of binary data types. For more information on binary vector indexing, click here.
Fixes
- Remove unused MergeTreeSetting
max_queue_size_to_consider_replica_as_synced
. - Fix a crash related to the serialization of vector index of type MSTG.
- Resolve a fatal error occurring during the merge task in the
generateRowIdsMap()
function.
Features & Improvements
- Support reloading vector index cache ratio.
# January 30, 2024
# MyScaleDB v1.3.0
Highlight Features
Consider lightweight deleted rows when selecting parts to merge.
This feature improves the timely cleanup of data marked as deleted in ClickHouse and has been contributed back to the community. You can find more information about it on pull request #58223 (opens new window).
Fixes
- Fix the error that occurs when vector search uses parameters.
# January 10, 2024
# MyScaleDB v1.2.3
TIP
This release contains performance improvements and bug fixes since v1.2.2. We recommend that you upgrade at the next available opportunity.
Highlight Features
- Improve the search performance of MSTG with two-stage search.
Fixes
- Resolve segmentation fault in
VectorIndexWriter
.
Features & Improvements
- Optimize vector index checksums by calculating them during serialization.
- Introduce
enable_brute_force_vector_search
query setting, set to false by default.
# January 4, 2024
# MyScaleDB v1.2.2
Fixes
- Remove vector/fetch tmp folder immediately when an error occurs.
# December 28, 2023
# MyScaleDB v1.2.1
Fixes
- Improve logs for vector index load failure.
- Exclude vector index files when check data part.
- Fix vector index info for merged part with no vector index built.
Features & Improvements
- Backport UDFs-related features for embedding and reranking functions.
# December 7, 2023
# MyScaleDB v1.2.0
Fixes
- Fix vector index re-loading issue when part got moved to another disk.
- Split the thread limiter for brute force and vector indexes.
- Fix settings & metrics of vector index memory management.
- Fix index node bugs, handle upgrade scenarios, and control Zookeeper's status directory through the new setting.
Features & Improvements
- Improve memory management for vector index.
# November 23, 2023
# MyScaleDB v1.0.2
Fixes
- Rebuild vector index if the checksum check failed.
- Limit the memory and threads used by bruteforce search.
# November 17, 2023
# MyScaleDB v1.0.0
TIP
This release contains performance improvements and bug fixes since v0.10.10. We recommend that you upgrade at the next available opportunity.
Fixes
- Fix remaining vector index files in DROP VECTOR INDEX.
Features & Improvements
- Backport related features of BACKUP.
- Add vector index checksums.
- Reduce memory usage of MSTG.
# October 26, 2023
# MyScaleDB v0.10.10
- Fix narrow filtered vector search.
# October 19, 2023
# MyScaleDB v0.10.9
TIP
This release contains performance improvements and bug fixes since v0.10.8. We recommend that you upgrade at the next available opportunity.
Fixes
- Improve narrow filtered vector search.
Features & Improvements
- Upgrade the MSTG vector index and improve memory tracking.
- Improve the stability of decouple data parts.
# Console Changes
Features and Improvements
- We have introduced an organizational management feature designed to enhance your control over your organization. For more details, please refer to the Organization and Roles.
# October 12, 2023
# MyScaleDB v0.10.8
Fixes
- Correct the issue where the distance() function fails to execute when using arrayMap in the WITH clause.
- Incorporate UUID into vector index folder path for uniqueness.
- Resolve bug impacting DELETE and UPDATE functions on JSON columns.
- Backport #52634 (opens new window).
# September 21, 2023
# MyScaleDB v0.10.7
Fixes
- Fix abnormal cancellation of build vector index.
- Optimize ALTER operations for Replicated databases with one shard by backporting fix from #51049 (opens new window).
- Correct vector index status when MEMORY_LIMIT_EXCEEDED occurs during vector index build.
- Immediately destroy vector index pointer after load error to prevent cache folder removal outside of critical section.
- Disallow definition of multiple vector indices.
# Console Changes
Features and Improvements
- We have introduced a Go Client connection method in the Connection Details, enhancing MyScale's ability to better cater to the diverse needs of our users. For more details, please refer to Go Client.
Fixes
- We have enhanced the display of the sidebar and page UI to elevate the user interaction experience.
# August 30, 2023
# MyScaleDB v0.10.4
Fixes
- Throw an exception to prevent crash when MSTG data size is too small.
- Restrict
ALTER UPDATE
use on columns with a vector index to maintain data integrity. - Correct a bug that leads to missing checksum files of vector index.
Features & Improvements
- Refine the decouple data part pipeline including removing delete bitmaps.
# August 24, 2023
# MyScaleDB v0.10.3
Fixes
- Make the
metric_type
parameter of vector indexes case-insensitive. - Resolve error in vector index log.
# Console Changes
Features and Improvements
- The cluster monitoring now includes a memory usage panel, aiding users in gaining a clearer understanding of cluster utilization.
- Enhance the UI of the Support & Help page for an even more elevated user experience.
Fixes
- Rectify the display issue with the sidebar UI.
# August 18, 2023
# MyScaleDB v0.10.1
TIP
This release contains performance improvements and bug fixes since v0.10.0. We recommend that you upgrade at the next available opportunity.
Fixes
- Correct heap overflow in DenseBitmap.
- Resolve "too many parts" error on ReplicatedMergeTree.
Features & Improvements
- Decrease memory consumption of brute force vector search.
- Introduce
primary_key_cache_size
setting to limit the size of primary key cache.
# August 11, 2023
# MyScaleDB v0.10.0
This version of MyScaleDB is a fork from ClickHouse v23.3.2.37.
# August 10, 2023
# Console Changes
Features and Improvements
- We have introduced the Support & Help module, enabling users to submit requests for assistance through the Web console. For more details, please refer to Support & Help.
- Standard plan users have the ability to modify the replicas of existing clusters, allowing for scaling capabilities. For more details, please refer to Cluster Configuration Modification.
# July 27, 2023
# Console Changes
- MyScale is introducing support for users to upgrade their billing plan online, further enhancing the payment functionality and improving user convenience. For more details, please refer to the Billing and Pricing Plan.
# July 6, 2023
# Console Changes
Features and Improvements
- MyScale now empowers users to upgrade their DB version, which enhances cluster performance, introduces new features, and fixes bugs. For more details, please refer to Updating the DB Version.
# June 15, 2023
# Console Changes
Features and Improvements
- Standard plan users have the ability to modify the replicas of existing clusters, allowing for scaling capabilities.
- The default port for MyScale has been changed to 443, while still supporting access through port 8443.
# June 1, 2023
# Console Changes
- We've introduced the Standard Plan, enabling users to upgrade and support clusters with larger pod sizes and multiple replicas. For more information, see our Pricing Plan.
# May 18, 2023
# Console Changes
Features and Improvements
- MyScale now supports custom idle periods, enabling automatic service resumption upon receipt of any requests during the idle state.
# May 11, 2023
# Console Changes
Features and Improvements
- We have launched our latest MSTG algorithm, which now surpasses the vector performance of advanced specialized vector databases. Discover more about this major upgrade now!
- We have supplemented sample datasets for Movie Recommendation and Abstractive QA, which facilitate users to explore and experience MyScale.
- Cluster monitoring feature has been added to help users monitor the running status of clusters. For more details, please refer to Cluster Monitoring.
- We have added the Usage module, which allows users to easily understand the usage and cost of clusters. For more details, please refer to Monitoring Usage.
- The interface for creating clusters and importing sample data has been optimized to enhance user experience.
- The statistics tab in query results has been improved, for more details please refer to View Results.
# April 20, 2023
# Console Changes
Features and Improvements
- The SQL statement structure for vector search has been optimized to ensure greater compliance with SQL standards. To learn more about these changes, please refer to the Basic Vector Search and Vector Search with Filters sections of the Vector Search.
# April 13, 2023
# Console Changes
Features and Improvements
- Support for SQL format, syntax highlight, and auto-completion to make writing queries easier and more efficient.
- Shortcut keys have been added to the SQL editor for faster access to commonly used functions.
- The database tree has been added to the SQL editor, allowing users to easily navigate between different databases and tables.
- Query results can now be copied and exported as CSV, JSON, or TSV files, making it easier to work with the data outside of MyScale.
# March 16, 2023
# Console Changes
Features and Improvements
- Optimizing guidance for novice users.
- Revise the method for users to obtain connection information. For more details, please refer to Connection Details.
- We have introduced sample datasets and provided corresponding query commands to facilitate users in exploring MyScale.
- To augment the security of user accounts, we now enable users to generate a new cluster password.
Fixes
- Fixed issue where high-dimensional vectors could not be displayed in query results.
# March 14, 2023
We are pleased to share the release notes of our product MyScale and look forward to embarking on this journey with you.