Announcement

Storage Resizing Now Available in Marqo Cloud

September 18, 2024
2
mins read
We’re excited to announce that storage resizing is now available in Marqo Cloud! Whether you're managing a small project or scaling up for large-scale deployments, this feature offers a powerful new way to enhance your index management, ensuring you have the capacity and performance you need.

What’s New?

Any indexes that were created in Marqo Cloud after July 30th, now have access to storage resizing. This feature is available for all accounts, and if you're using Marqo Cloud, you should already have access to it. You can find it in the Edit index option when managing your existing indexes.

How Does Storage Resizing Work?

When you're adding more documents or expanding your dataset, your Marqo index might need more storage to handle the load. Storage resizing makes it possible to add shards to your index. Adding shards increases the storage capacity, allowing your index to grow seamlessly alongside your data.

This is perfect for dynamic use cases where you expect your data volume to increase over time. Instead of worrying about running out of space, simply scale up your index by adding shards!

Performance Boost with Replicas

For those focused on performance and redundancy, the storage resizing feature also allows you to add replicas to your indexes. Replicas improve:

  • Redundancy: If an outage occurs or a node goes down, replicas ensure that your data is still available, providing a robust safety net for your applications.
  • Throughput: More replicas mean your index can handle higher volumes of traffic, improving performance during spikes in activity or when serving multiple concurrent queries.

By adding replicas, you’re not just scaling storage—you’re ensuring your index can handle high-demand environments while maintaining fast query responses and data reliability.

How to Enable Storage Resizing on Marqo Cloud

1. Create or Find Your Index

Navigate to the Indexes section on Marqo Cloud and navigate to an existing index or create an index, if you haven’t already. Then click on your index.

2. Navigate to ‘Edit Index’

Click the three dots in the top righthand corner of your index and click Edit.

3. Editing Your Storage Shard

From here you can add shards and/or replicas as outlined in the image below. Please note that we don't currently support scaling down shards or replicas.

Changing your storage shard type is a feature that will be coming to Marqo Cloud soon.

Upcoming Features

The following features aren't currently supported by Marqo but are in development and will be released soon:

  • Support for scaling down the number of shards
  • Support for scaling down the number of replicas
  • Support changing the storage class

Conclusion

The new storage resizing feature in Marqo Cloud offers you the flexibility to grow your indexes in line with your data and traffic needs. Whether it's increasing storage capacity with shards or boosting performance and redundancy with replicas, you now have the tools to scale confidently.

Ready to take advantage of this new feature? Log in to Marqo Cloud today and try out the new storage resizing options!

Ellie Sleightholm
Head of Software Developer Relations