Quick Start: How to Manage PieCloudDB Database Virtual Data Warehouse
NOVEMBER 19TH, 2024

To enhance the experience for community users, the PieCloudDB Database Community Edition has completed a comprehensive upgrade in August. Additionally, the PieCloudDB community has specially build the "Quick Start with PieCloudDB Community Edition" series of courses, aimed at helping everyone fully understand the new version and gradually explore the powerful features of PieCloudDB. 


The PieCloudDB Community Edition is available for free download and can be used to experience new product features, personal learning, PoC verification, and other scenarios, making it convenient for community users to quickly experience leading data warehouse virtualization technology. The PieCloudDB Community Edition adopts a fully containerized one-click deployment solution and supports both online and offline installation methods. 

 

Through the Community Edition, users can experience the main features of PieCloudDB, including: 

 

  • Multi-dimensional elastic scaling: Flexibly modify the number of virtual data warehouses and executors on demand. 


  • Advanced kernel features: Multi-layer caching design, SIMD vectorized execution engine, pre-aggregation, data trimming, and other functions. 


  • Multi-tenant, multi-cluster: As a cloud-native virtual data warehouse, it adopts a brand-new eMPP (elastic MPP) architecture with multi-tenant and multi-cluster capabilities. 


  • Storage-compute separation architecture: Achieve independent management of storage and computing resources, with underlying shared storage to eliminate data silos. 

 

This series of courses will be divided into multiple modules, covering content from basic operations to advanced functions, helping everyone understand and manage PieCloudDB in multiple dimensions. The course outline is as follows: 



In the first two courses, we demonstrated the functionality of the PieCloudDB Community Edition website "PieStore" and the installation and deployment of PieCloudDB Community Edition. 


The PieCloudDB Community Edition image provides the pdbcli command-line tool to assist in managing virtual  data warehouses(VDW). This article is the third in the series and will focus on how to use pdbcli for managing PieCloudDB virtual data warehouses, including: creating new virtual data warehouses, starting and stopping virtual data warehouses, elastic scaling of virtual data warehouses, modifying  configuration parameters, and viewing virtual data warehouse information, related commands are as follows: 

 

For more content, please refer to the "Managing PieCloudDB" section in the "PieCloudDB Community Edition Documentation


Creating a New Virtual Data Warehouse

 

After the installation and deployment of PieCloudDB, the system will automatically generate a default virtual data warehouse. If you need to add a new virtual data warehouse, you can execute the following command: 

 

docker exec -it pieclouddb pdbcli cluster create --cluster-size 3 

 

The --cluster-size parameter is used to specify the number of executors in the new virtual data warehouse. 

 

Starting and Stopping Virtual Data Warehouses 


After creating a virtual data warehouse with the pdbcli command, it will be initialized but not running immediately. If you need to start the newly created virtual data warehouse, execute the following command: 

 

docker exec -it pieclouddb pdbcli cluster start --cluster 2 

 

To stop the virtual data warehouse, you can execute: 

 

docker exec -it pieclouddb pdbcli cluster stop --cluster 2 


The --cluster parameter is used to specify the ID of the virtual data warehouse that needs to be started or stopped. 

 

Elastic Scaling of Virtual Data Warehouses 

 

As a cloud-native virtual data warehouse, PieCloudDB supports multi-dimensional elastic scaling. Users can modify the number of executors in the virtual data warehouse as needed with the following command: 

 

docker exec -it pieclouddb pdbcli cluster resize --cluster 2 --cluster-size 4 

 

The --cluster parameter is used to specify the ID of the virtual data warehouse, and --cluster-size is used to modify the number of executors in the virtual data warehouse. 

 

Modifying Virtual Data Warehouse Configuration Parameters 

 

The PieCloudDB Community Edition can modify the configuration parameters of the virtual data warehouse with the pdbcli cluster config command, as follows: 

 

docker exec -it pieclouddb pdbcli cluster config --cluster 2 --name pdb_parallel_factor --value 3

 

The --cluster is used to specify the ID of the virtual data warehouse, --name is used to specify the name of the parameter, and --value is used to specify the modified parameter value. 

 

Viewing Virtual Data Warehouse Information 


In the PieCloudDB Community Edition, users can execute the following command to view detailed information about the virtual data warehouses. This example command will display information about all virtual data warehouses under the default user: 

 

docker exec -it pieclouddb pdbcli cluster list 


To view information about a specific virtual data warehouse, you can use the --cluster parameter to specify the ID of the virtual data warehouse. 


To help everyone more intuitively understand the management process of virtual data warehouses, we have prepared supporting demonstration videos. Welcome to watch! We also welcome you to visit piestore.openpie.com to try out the PieCloudDB Community Edition for free. 

Related Blogs:
no related blog