The data storage structure of nodes within the network hierarchy controls where and how the bots you run store the data they produce.
Session independent data refers to data generated by sensors and indicators, not related to trading sessions.

As explained in the sorting of tasks page, data mines data is sorted by exchange, market, and the corresponding data mine, sensor or indicator bot, and bot product. That is, most of the nodes in this section of the hierarchy play an organizational role.

Many of them require references to the nodes that delimit the context for which the data is applicable. For example, the market data products node must reference one of the installed markets, in particular, the market on which the data mining operation is run. These references help other entities understand the context to which the data belongs to.

Whenever you create data mining tasks manually from within the Network hierarchy (as opposed to using the install market function under the exchange markets node of the Crypto Ecosystem hierarchy), you need to create the proper definitions for the storage of data mines data.


Data Mines Data

Exchange Data Products

Market Data Products

Data Mine Products

Bot Products

Data Product Folder

Data Product

Data Product

Exchange Data Products

The exchange data products node organizes data mines data by exchange. That is, each exchange installed in the system has an exchange data products node grouping all market data products nodes corresponding to the said exchange.

The exchange data products node must reference the exchange of choice. This reference constraints the rest of the definitions to the context of the said exchange.

When representing an exchange featured in the system’s icons library, the standard exchange data tasks icon is replaced by the exchange’s logo.

Click to learn more about exchange data products

Adding an Exchange Data Products Node

To add a specific exchange data products node, select Add Exchange Data Products on the parent node menu.

You may also add exchange data products nodes in bulk for all exchanges that may have been previously defined in the Crypto Ecosystem hierarchy. To do that, select Add Missing Exchanges on the parent node menu. An exchange data products node is created for each defined exchange, each with the corresponding reference.

Market Data Products

A market data products node represents the group of data products generated in a specific market.

The market data products node must reference a market defined in the Crypto Ecosystem hierarchy.

This node may spawn individual data products or may deploy data products in bulk organized by data mine and by bots. See the data products node for the details.

Click to learn more about market data products

Adding a Market Data Products Node

To add a market data products node, select Add Market Data on the parent node menu.

You may also add market data products nodes in bulk for all markets that may have been previously defined in the Crypto Ecosystem hierarchy. To do that, select Add Missing Markets on the parent node menu. A market data products node is created for each defined market, each with the corresponding reference.

Data Mine Products

Data mine products are references established with data mines to facilitate establishing data product references with multiple products in the given data mine.

The node may be used as an organizational device, simply to arrange bot products. However, the smart use of the node involves automating the deployment of multiple data products.

The use of the data mine products node is optional, as data products may also exist outside of data mine products nodes.

Click to learn more about data mine products

Adding a Data Mine Products Node

To add a data mine products node, select Add Data Mine Products on the parent node menu. This action adds the node but does not establish a reference with any data mine.

The smarter use of the node involves using the Add All Data Mine Products option on the parent node menu. This action creates a data mine products node for each data mine in the workspace, establishing a reference with the corresponding data mines. This is the first step in the direction of quickly setting up multiple data products when needed.

Bot Products

A bot products node is an organizational device used to arrange data products corresponding to a specific bot.

The device exists as an offspring of a data or trading mine products node, and does not require a reference to a bot in the given data or trading mine.

The use of the bot products node is optional, as data products may also exist outside of bot products.

Click to learn more about bot products

Adding a Bot Products Node

To add a bot products node, select Add Bot Products on the parent node menu.

The bot products node may also be created automatically. When created using the Add All Data Products option on the data mine products node, the node inherits the label of the corresponding bot in the corresponding data mine.

Data Product Folder

A data product folder node is an organizational device used to map the arrangement of product definition folders as may exist in the bot definition of the corresponding data or trading mine.

The use of the data product folder node is optional, as data products may also exist outside of data product folders.

Click to learn more about data product folders

Adding a Data Product Folder Node

To add the data product folder node, select Add Data Product Folder on the parent node menu.

Data Product

A data product represents the collection of datasets generated by the instance of a bot as defined in the corresponding data mine or trading mine.

Data products exist in the context of trading mines data and data mines data nodes. In the first case, a data product is the collection of datasets generated by an instance of a trading bot as defined in a trading mine, running a trading session. In the latter case, it is the collection of datasets generated by either a sensor bot or an indicator bot instance, as defined in a data mine, and running a data mining task.

A data product node must reference a product definition in the corresponding bot.

Click to learn more about data products

Adding a Data Product Node

To add a single data product, select Add Data Product on the market trading products, market data products, bot products, or data products folder node menus.

In cases in which multiple data products must be added, you may use the option to create data products in bulk.

Select the Add All Data Products option on the data or trading mine products node menu. This adds a bot products node for each bot in the data or trading mine, and a data product for each product definition of each bot.

You may use this option after manually adding a data or trading mine products node and manually establishing the reference with the desired data mine, or after adding all data or trading mine data products, by which the references with data or trading mines are established automatically.