SYSTEM Statements
RELOAD EMBEDDED DICTIONARIES
Reload all Internal dictionaries.
By default, internal dictionaries are disabled.
Always returns Ok.
regardless of the result of the internal dictionary update.
RELOAD DICTIONARIES
Reloads all dictionaries that have been successfully loaded before.
By default, dictionaries are loaded lazily (see dictionaries_lazy_load), so instead of being loaded automatically at startup, they are initialized on first access through dictGet function or SELECT from tables with ENGINE = Dictionary. The SYSTEM RELOAD DICTIONARIES
query reloads such dictionaries (LOADED).
Always returns Ok.
regardless of the result of the dictionary update.
Syntax
SYSTEM RELOAD DICTIONARIES [ON CLUSTER cluster_name]
RELOAD DICTIONARY
Completely reloads a dictionary dictionary_name
, regardless of the state of the dictionary (LOADED / NOT_LOADED / FAILED).
Always returns Ok.
regardless of the result of updating the dictionary.
SYSTEM RELOAD DICTIONARY [ON CLUSTER cluster_name] dictionary_name
The status of the dictionary can be checked by querying the system.dictionaries
table.
SELECT name, status FROM system.dictionaries;
RELOAD MODELS
This statement and SYSTEM RELOAD MODEL
merely unload catboost models from the clickhouse-library-bridge. The function catboostEvaluate()
loads a model upon first access if it is not loaded yet.
Unloads all CatBoost models.
Syntax
SYSTEM RELOAD MODELS [ON CLUSTER cluster_name]
RELOAD MODEL
Unloads a CatBoost model at model_path
.
Syntax
SYSTEM RELOAD MODEL [ON CLUSTER cluster_name] <model_path>
RELOAD FUNCTIONS
Reloads all registered executable user defined functions or one of them from a configuration file.
Syntax
RELOAD FUNCTIONS [ON CLUSTER cluster_name]
RELOAD FUNCTION [ON CLUSTER cluster_name] function_name
RELOAD ASYNCHRONOUS METRICS
Re-calculates all asynchronous metrics. Since asynchronous metrics are periodically updated based on setting asynchronous_metrics_update_period_s, updating them manually using this statement is typically not necessary.
RELOAD ASYNCHRONOUS METRICS [ON CLUSTER cluster_name]
DROP DNS CACHE
Clears ClickHouse’s internal DNS cache. Sometimes (for old ClickHouse versions) it is necessary to use this command when changing the infrastructure (changing the IP address of another ClickHouse server or the server used by dictionaries).
For more convenient (automatic) cache management, see disable_internal_dns_cache, dns_cache_max_entries, dns_cache_update_period parameters.
DROP MARK CACHE
Clears the mark cache.
DROP REPLICA
Dead replicas of ReplicatedMergeTree
tables can be dropped using following syntax:
SYSTEM DROP REPLICA 'replica_name' FROM TABLE database.table;
SYSTEM DROP REPLICA 'replica_name' FROM DATABASE database;
SYSTEM DROP REPLICA 'replica_name';
SYSTEM DROP REPLICA 'replica_name' FROM ZKPATH '/path/to/table/in/zk';
Queries will remove the ReplicatedMergeTree
replica path in ZooKeeper. It is useful when the replica is dead and its metadata cannot be removed from ZooKeeper by DROP TABLE
because there is no such table anymore. It will only drop the inactive/stale replica, and it cannot drop local replica, please use DROP TABLE
for that. DROP REPLICA
does not drop any tables and does not remove any data or metadata from disk.
The first one removes metadata of 'replica_name'
replica of database.table
table.
The second one does the same for all replicated tables in the database.
The third one does the same for all replicated tables on the local server.
The fourth one is useful to remove metadata of dead replica when all other replicas of a table were dropped. It requires the table path to be specified explicitly. It must be the same path as was passed to the first argument of ReplicatedMergeTree
engine on table creation.
DROP DATABASE REPLICA
Dead replicas of Replicated
databases can be dropped using following syntax:
SYSTEM DROP DATABASE REPLICA 'replica_name' [FROM SHARD 'shard_name'] FROM DATABASE database;
SYSTEM DROP DATABASE REPLICA 'replica_name' [FROM SHARD 'shard_name'];
SYSTEM DROP DATABASE REPLICA 'replica_name' [FROM SHARD 'shard_name'] FROM ZKPATH '/path/to/table/in/zk';
Similar to SYSTEM DROP REPLICA
, but removes the Replicated
database replica path from ZooKeeper when there's no database to run DROP DATABASE
. Please note that it does not remove ReplicatedMergeTree
replicas (so you may need SYSTEM DROP REPLICA
as well). Shard and replica names are the names that were specified in Replicated
engine arguments when creating the database. Also, these names can be obtained from database_shard_name
and database_replica_name
columns in system.clusters
. If the FROM SHARD
clause is missing, then replica_name
must be a full replica name in shard_name|replica_name
format.
DROP UNCOMPRESSED CACHE
Clears the uncompressed data cache. The uncompressed data cache is enabled/disabled with the query/user/profile-level setting use_uncompressed_cache. Its size can be configured using the server-level setting uncompressed_cache_size.
DROP COMPILED EXPRESSION CACHE
Clears the compiled expression cache. The compiled expression cache is enabled/disabled with the query/user/profile-level setting compile_expressions.
DROP QUERY CACHE
SYSTEM DROP QUERY CACHE;
SYSTEM DROP QUERY CACHE TAG '<tag>'
Clears the query cache. If a tag is specified, only query cache entries with the specified tag are deleted.
DROP FORMAT SCHEMA CACHE
Clears cache for schemas loaded from format_schema_path.
Supported formats:
- Protobuf
SYSTEM DROP FORMAT SCHEMA CACHE [FOR Protobuf]
FLUSH LOGS
Flushes buffered log messages to system tables, e.g. system.query_log. Mainly useful for debugging since most system tables have a default flush interval of 7.5 seconds. This will also create system tables even if message queue is empty.
SYSTEM FLUSH LOGS [ON CLUSTER cluster_name]
RELOAD CONFIG
Reloads ClickHouse configuration. Used when configuration is stored in ZooKeeper. Note that SYSTEM RELOAD CONFIG
does not reload USER
configuration stored in ZooKeeper, it only reloads USER
configuration that is stored in users.xml
. To reload all USER
config use SYSTEM RELOAD USERS
SYSTEM RELOAD CONFIG [ON CLUSTER cluster_name]
RELOAD USERS
Reloads all access storages, including: users.xml, local disk access storage, replicated (in ZooKeeper) access storage.
SYSTEM RELOAD USERS [ON CLUSTER cluster_name]
SHUTDOWN
Normally shuts down ClickHouse (like service clickhouse-server stop
/ kill {$pid_clickhouse-server}
)
KILL
Aborts ClickHouse process (like kill -9 {$ pid_clickhouse-server}
)
Managing Distributed Tables
ClickHouse can manage distributed tables. When a user inserts data into these tables, ClickHouse first creates a queue of the data that should be sent to cluster nodes, then asynchronously sends it. You can manage queue processing with the STOP DISTRIBUTED SENDS, FLUSH DISTRIBUTED, and START DISTRIBUTED SENDS queries. You can also synchronously insert distributed data with the distributed_foreground_insert setting.
STOP DISTRIBUTED SENDS
Disables background data distribution when inserting data into distributed tables.
SYSTEM STOP DISTRIBUTED SENDS [db.]<distributed_table_name> [ON CLUSTER cluster_name]
FLUSH DISTRIBUTED
Forces ClickHouse to send data to cluster nodes synchronously. If any nodes are unavailable, ClickHouse throws an exception and stops query execution. You can retry the query until it succeeds, which will happen when all nodes are back online.
You can also override some settings via SETTINGS
clause, this can be useful to avoid some temporary limitations, like max_concurrent_queries_for_all_users
or max_memory_usage
.
SYSTEM FLUSH DISTRIBUTED [db.]<distributed_table_name> [ON CLUSTER cluster_name] [SETTINGS ...]
Each pending block is stored in disk with settings from the initial INSERT query, so that is why sometimes you may want to override settings.
START DISTRIBUTED SENDS
Enables background data distribution when inserting data into distributed tables.
SYSTEM START DISTRIBUTED SENDS [db.]<distributed_table_name> [ON CLUSTER cluster_name]
STOP LISTEN
Closes the socket and gracefully terminates the existing connections to the server on the specified port with the specified protocol.
However, if the corresponding protocol settings were not specified in the clickhouse-server configuration, this command will have no effect.
SYSTEM STOP LISTEN [ON CLUSTER cluster_name] [QUERIES ALL | QUERIES DEFAULT | QUERIES CUSTOM | TCP | TCP WITH PROXY | TCP SECURE | HTTP | HTTPS | MYSQL | GRPC | POSTGRESQL | PROMETHEUS | CUSTOM 'protocol']
- If
CUSTOM 'protocol'
modifier is specified, the custom protocol with the specified name defined in the protocols section of the server configuration will be stopped. - If
QUERIES ALL [EXCEPT .. [,..]]
modifier is specified, all protocols are stopped, unless specified withEXCEPT
clause. - If
QUERIES DEFAULT [EXCEPT .. [,..]]
modifier is specified, all default protocols are stopped, unless specified withEXCEPT
clause. - If
QUERIES CUSTOM [EXCEPT .. [,..]]
modifier is specified, all custom protocols are stopped, unless specified withEXCEPT
clause.
START LISTEN
Allows new connections to be established on the specified protocols.
However, if the server on the specified port and protocol was not stopped using the SYSTEM STOP LISTEN command, this command will have no effect.
SYSTEM START LISTEN [ON CLUSTER cluster_name] [QUERIES ALL | QUERIES DEFAULT | QUERIES CUSTOM | TCP | TCP WITH PROXY | TCP SECURE | HTTP | HTTPS | MYSQL | GRPC | POSTGRESQL | PROMETHEUS | CUSTOM 'protocol']
Managing MergeTree Tables
ClickHouse can manage background processes in MergeTree tables.
STOP MERGES
Provides possibility to stop background merges for tables in the MergeTree family:
SYSTEM STOP MERGES [ON CLUSTER cluster_name] [ON VOLUME <volume_name> | [db.]merge_tree_family_table_name]
DETACH / ATTACH
table will start background merges for the table even in case when merges have been stopped for all MergeTree tables before.
START MERGES
Provides possibility to start background merges for tables in the MergeTree family:
SYSTEM START MERGES [ON CLUSTER cluster_name] [ON VOLUME <volume_name> | [db.]merge_tree_family_table_name]
STOP TTL MERGES
Provides possibility to stop background delete old data according to TTL expression for tables in the MergeTree family:
Returns Ok.
even if table does not exist or table has not MergeTree engine. Returns error when database does not exist:
SYSTEM STOP TTL MERGES [ON CLUSTER cluster_name] [[db.]merge_tree_family_table_name]
START TTL MERGES
Provides possibility to start background delete old data according to TTL expression for tables in the MergeTree family:
Returns Ok.
even if table does not exist. Returns error when database does not exist:
SYSTEM START TTL MERGES [ON CLUSTER cluster_name] [[db.]merge_tree_family_table_name]
STOP MOVES
Provides possibility to stop background move data according to TTL table expression with TO VOLUME or TO DISK clause for tables in the MergeTree family:
Returns Ok.
even if table does not exist. Returns error when database does not exist:
SYSTEM STOP MOVES [ON CLUSTER cluster_name] [[db.]merge_tree_family_table_name]
START MOVES
Provides possibility to start background move data according to TTL table expression with TO VOLUME and TO DISK clause for tables in the MergeTree family:
Returns Ok.
even if table does not exist. Returns error when database does not exist:
SYSTEM START MOVES [ON CLUSTER cluster_name] [[db.]merge_tree_family_table_name]
SYSTEM UNFREEZE
Clears freezed backup with the specified name from all the disks. See more about unfreezing separate parts in ALTER TABLE table_name UNFREEZE WITH NAME
SYSTEM UNFREEZE WITH NAME <backup_name>
WAIT LOADING PARTS
Wait until all asynchronously loading data parts of a table (outdated data parts) will became loaded.
SYSTEM WAIT LOADING PARTS [ON CLUSTER cluster_name] [db.]merge_tree_family_table_name
Managing ReplicatedMergeTree Tables
ClickHouse can manage background replication related processes in ReplicatedMergeTree tables.
STOP FETCHES
Provides possibility to stop background fetches for inserted parts for tables in the ReplicatedMergeTree
family:
Always returns Ok.
regardless of the table engine and even if table or database does not exist.
SYSTEM STOP FETCHES [ON CLUSTER cluster_name] [[db.]replicated_merge_tree_family_table_name]
START FETCHES
Provides possibility to start background fetches for inserted parts for tables in the ReplicatedMergeTree
family:
Always returns Ok.
regardless of the table engine and even if table or database does not exist.
SYSTEM START FETCHES [ON CLUSTER cluster_name] [[db.]replicated_merge_tree_family_table_name]
STOP REPLICATED SENDS
Provides possibility to stop background sends to other replicas in cluster for new inserted parts for tables in the ReplicatedMergeTree
family:
SYSTEM STOP REPLICATED SENDS [ON CLUSTER cluster_name] [[db.]replicated_merge_tree_family_table_name]
START REPLICATED SENDS
Provides possibility to start background sends to other replicas in cluster for new inserted parts for tables in the ReplicatedMergeTree
family:
SYSTEM START REPLICATED SENDS [ON CLUSTER cluster_name] [[db.]replicated_merge_tree_family_table_name]
STOP REPLICATION QUEUES
Provides possibility to stop background fetch tasks from replication queues which stored in Zookeeper for tables in the ReplicatedMergeTree
family. Possible background tasks types - merges, fetches, mutation, DDL statements with ON CLUSTER clause:
SYSTEM STOP REPLICATION QUEUES [ON CLUSTER cluster_name] [[db.]replicated_merge_tree_family_table_name]
START REPLICATION QUEUES
Provides possibility to start background fetch tasks from replication queues which stored in Zookeeper for tables in the ReplicatedMergeTree
family. Possible background tasks types - merges, fetches, mutation, DDL statements with ON CLUSTER clause:
SYSTEM START REPLICATION QUEUES [ON CLUSTER cluster_name] [[db.]replicated_merge_tree_family_table_name]
STOP PULLING REPLICATION LOG
Stops loading new entries from replication log to replication queue in a ReplicatedMergeTree
table.
SYSTEM STOP PULLING REPLICATION LOG [ON CLUSTER cluster_name] [[db.]replicated_merge_tree_family_table_name]
START PULLING REPLICATION LOG
Cancels SYSTEM STOP PULLING REPLICATION LOG
.
SYSTEM START PULLING REPLICATION LOG [ON CLUSTER cluster_name] [[db.]replicated_merge_tree_family_table_name]
SYNC REPLICA
Wait until a ReplicatedMergeTree
table will be synced with other replicas in a cluster, but no more than receive_timeout
seconds.
SYSTEM SYNC REPLICA [ON CLUSTER cluster_name] [db.]replicated_merge_tree_family_table_name [STRICT | LIGHTWEIGHT [FROM 'srcReplica1'[, 'srcReplica2'[, ...]]] | PULL]
After running this statement the [db.]replicated_merge_tree_family_table_name
fetches commands from the common replicated log into its own replication queue, and then the query waits till the replica processes all of the fetched commands. The following modifiers are supported:
- If a
STRICT
modifier was specified then the query waits for the replication queue to become empty. TheSTRICT
version may never succeed if new entries constantly appear in the replication queue. - If a
LIGHTWEIGHT
modifier was specified then the query waits only forGET_PART
,ATTACH_PART
,DROP_RANGE
,REPLACE_RANGE
andDROP_PART
entries to be processed. Additionally, the LIGHTWEIGHT modifier supports an optional FROM 'srcReplicas' clause, where 'srcReplicas' is a comma-separated list of source replica names. This extension allows for more targeted synchronization by focusing only on replication tasks originating from the specified source replicas. - If a
PULL
modifier was specified then the query pulls new replication queue entries from ZooKeeper, but does not wait for anything to be processed.
SYNC DATABASE REPLICA
Waits until the specified replicated database applies all schema changes from the DDL queue of that database.
Syntax
SYSTEM SYNC DATABASE REPLICA replicated_database_name;
RESTART REPLICA
Provides possibility to reinitialize Zookeeper session's state for ReplicatedMergeTree
table, will compare current state with Zookeeper as source of truth and add tasks to Zookeeper queue if needed.
Initialization of replication queue based on ZooKeeper data happens in the same way as for ATTACH TABLE
statement. For a short time, the table will be unavailable for any operations.
SYSTEM RESTART REPLICA [ON CLUSTER cluster_name] [db.]replicated_merge_tree_family_table_name
RESTORE REPLICA
Restores a replica if data is [possibly] present but Zookeeper metadata is lost.
Works only on readonly ReplicatedMergeTree
tables.
One may execute query after:
- ZooKeeper root
/
loss. - Replicas path
/replicas
loss. - Individual replica path
/replicas/replica_name/
loss.
Replica attaches locally found parts and sends info about them to Zookeeper. Parts present on a replica before metadata loss are not re-fetched from other ones if not being outdated (so replica restoration does not mean re-downloading all data over the network).
Parts in all states are moved to detached/
folder. Parts active before data loss (committed) are attached.
Syntax
SYSTEM RESTORE REPLICA [db.]replicated_merge_tree_family_table_name [ON CLUSTER cluster_name]
Alternative syntax:
SYSTEM RESTORE REPLICA [ON CLUSTER cluster_name] [db.]replicated_merge_tree_family_table_name
Example
Creating a table on multiple servers. After the replica's metadata in ZooKeeper is lost, the table will attach as read-only as metadata is missing. The last query needs to execute on every replica.
CREATE TABLE test(n UInt32)
ENGINE = ReplicatedMergeTree('/clickhouse/tables/test/', '{replica}')
ORDER BY n PARTITION BY n % 10;
INSERT INTO test SELECT * FROM numbers(1000);
-- zookeeper_delete_path("/clickhouse/tables/test", recursive=True) <- root loss.
SYSTEM RESTART REPLICA test;
SYSTEM RESTORE REPLICA test;
Another way:
SYSTEM RESTORE REPLICA test ON CLUSTER cluster;
RESTART REPLICAS
Provides possibility to reinitialize Zookeeper sessions state for all ReplicatedMergeTree
tables, will compare current state with Zookeeper as source of true and add tasks to Zookeeper queue if needed
DROP FILESYSTEM CACHE
Allows to drop filesystem cache.
SYSTEM DROP FILESYSTEM CACHE [ON CLUSTER cluster_name]
SYNC FILE CACHE
It's too heavy and has potential for misuse.
Will do sync syscall.
SYSTEM SYNC FILE CACHE [ON CLUSTER cluster_name]
UNLOAD PRIMARY KEY
Unload the primary keys for the given table or for all tables.
SYSTEM UNLOAD PRIMARY KEY [db.]name
SYSTEM UNLOAD PRIMARY KEY
Managing Refreshable Materialized Views
Commands to control background tasks performed by Refreshable Materialized Views
Keep an eye on system.view_refreshes
while using them.
REFRESH VIEW
Trigger an immediate out-of-schedule refresh of a given view.
SYSTEM REFRESH VIEW [db.]name
REFRESH VIEW
Wait for the currently running refresh to complete. If the refresh fails, throws an exception. If no refresh is running, completes immediately, throwing an exception if previous refresh failed.
STOP VIEW, STOP VIEWS
Disable periodic refreshing of the given view or all refreshable views. If a refresh is in progress, cancel it too.
SYSTEM STOP VIEW [db.]name
SYSTEM STOP VIEWS
START VIEW, START VIEWS
Enable periodic refreshing for the given view or all refreshable views. No immediate refresh is triggered.
SYSTEM START VIEW [db.]name
SYSTEM START VIEWS
CANCEL VIEW
If there's a refresh in progress for the given view, interrupt and cancel it. Otherwise do nothing.
SYSTEM CANCEL VIEW [db.]name