MariaDB Spider is a storage engine that supports federation and sharding across multiple MySQL or MariaDB servers. It helps distribute data and workloads, making it useful for scaling large datasets, balancing traffic, and improving data retrieval through parallel processing.
Murali September 10, 2026
Spider storage engine was introduced in MariaDB 10.0.4 as an alpha version. After a long wait, the Spider Engine became stable in MariaDB 10.3.7.
Spider storage engine comes with built-in sharding features that support partitioning and XA transactions. When a table is created with Spider, the table creates links to the remote server (MySQL / MariaDB).
For example,
If the table is created on the Spider Node(10.100.10.10) with Spider Engine, then the table creates a link to connect the Backend Server (10.100.10.15).
It supports both MySQL and MariaDB servers as backend servers.
Currently, Spider Storage Engine has two types:
Entire data will be kept on remote data nodes.
To use spider, you need a minimum of two or more instances of MariaDB or MySQL, typically running on separate hosts
In federation, application sends traffic to Spider node and spider decides on which data node it has to get the data. The data nodes are the MariaDB servers that actually store the table data and in our case, 10.100.10.15 and 10.100.10.18.
In order for this to work, you need to configure the data nodes to accept queries from the Spider node.
This feature will keep the table data partitioned across different remote backend data nodes (Shards).
As architecture shows, When a table is created in spider node using sharding, data will get split across data nodes as per the partitioned mentioned in the spider node.
Sharding in spider is splitting up (or horizontally partition) big tables among several isolated DB instances, called a database shard. We can divide huge tables and load share the traffic to multiple shard servers by using spider.How to shard the data is really interesting. You just mention the native partition in spider node. Lets say, we created Table1 with 2 hash partition in spider node. Part 1 of data will store in 10.100.10.15 and Part 2 of data will get stored in 10.100.10.18 server. You can use all partitioning rules(key, range, hash, and so on).
MariaDB Spider provides a practical way to distribute data and workloads across multiple MySQL or MariaDB servers. Federation can help distribute reads and maintain copies of data, while sharding allows large tables to be divided across multiple backend nodes.
At Mafiree, we help businesses design, optimize, and manage database environments to handle large-scale workloads with better performance, scalability, and reliability.
In the next blog, we would explain a use case where we have faced issue with huge data set and how we have achieved horizontal sharding using Spider storage engine.
Miru IT Park, Vallankumaranvillai,
Nagercoil, Tamilnadu - 629 002.
Unit 303, Vanguard Rise,
5th Main, Konena Agrahara,
Old Airport Road, Bangalore - 560 017.
Call: +91 6383016411
Email: sales@mafiree.com