Difference between revisions of "Internet Computer performance"

From Internet Computer Wiki
Jump to: navigation, search
Line 1: Line 1:
 
This post describes the DFINITY Foundation's performance evaluation of the Internet Computer. We will periodically update the numbers on this page to reflect performance improvements realized over time.
 
This post describes the DFINITY Foundation's performance evaluation of the Internet Computer. We will periodically update the numbers on this page to reflect performance improvements realized over time.
  
Scalability of the Internet Computer comes from partitioning the IC into subnetworks, aka subnets. Subnets process update calls from ingress messages independently from other subnets. They can scale up by adding more subnets at the cost of having more network traffic (as applications then need to potentially communicate across subnets). In its current form, the IC should be able to scale out to hundreds of subnets.
+
Scalability of the Internet Computer comes from partitioning the IC into subnet blockchains. Every subnet blockchain can process update calls from ingress messages independently from other subnets. The IC can scale up by adding more subnets at the cost of having more network traffic (as applications then need to potentially communicate across subnets). In its current form, the IC should be able to scale out to hundreds of subnets.
  
 
Query calls are read-only calls that are processed locally on each node. Scalability comes from adding more nodes, either to an existing subnet (at the cost of making consensus i.e. update calls more expensive) or as new subnet.
 
Query calls are read-only calls that are processed locally on each node. Scalability comes from adding more nodes, either to an existing subnet (at the cost of making consensus i.e. update calls more expensive) or as new subnet.

Revision as of 16:57, 10 November 2021

This post describes the DFINITY Foundation's performance evaluation of the Internet Computer. We will periodically update the numbers on this page to reflect performance improvements realized over time.

Scalability of the Internet Computer comes from partitioning the IC into subnet blockchains. Every subnet blockchain can process update calls from ingress messages independently from other subnets. The IC can scale up by adding more subnets at the cost of having more network traffic (as applications then need to potentially communicate across subnets). In its current form, the IC should be able to scale out to hundreds of subnets.

Query calls are read-only calls that are processed locally on each node. Scalability comes from adding more nodes, either to an existing subnet (at the cost of making consensus i.e. update calls more expensive) or as new subnet.

Test setup

We are running all of our experiments concurrently against all subnets other than the NNS and some of the most utilized application subnets to avoid disturbance of active IC users. We send load against those subnets directly and are not using boundary nodes for those experiments. Boundary nodes have additional rate limiting which is currently set slightly more conservative compared to what the IC can handle and running against them therefore is unsuitable for performance evaluation. We are targeting all nodes in every subnet concurrently, much the same as what boundary nodes would be doing if we would use them.

We have installed one counter canister in every subnet. This counter canister is essentially a no-op canister. It only maintains a counter, which can be queries via a query call and incremented via update call. The counter value is not using orthogonal persistence, so the overhead for the execution layer of the IC is minimal. Stressing the counter canister can be seen as a way to determine the system overhead or baseline performance.


Measurements

Update calls

The Internet Computer can currently sustain more than 11_000 updates/second for a period of four minutes, with peaks over 11_500 updates/second.

The update calls we have been measuring here are triggered from Ingress messages sent from outside the IC.

Update Call Performance

Query calls

Arguably more important are query calls, since they contribute with more than 90% of the traffic we are observing on the IC.

Query Call Performance

The Internet Computer can currently process up to 250,000 queries per second. During our experiments, we increment the load incrementally and run each load for a period of 5 minutes.

Conclusion and next steps

The Internet Computer today already shows impressive performance. On top of that, it should be possible to further scale out the IC by:

  • More subnets: This will immediate increase the query and update throughput. While adding subnets might eventually lead to other scalability problems, the IC in its current shape should be able to support hundreds of subnets.
  • Performance improvements: Performance can also be improved by better single machine, network and consensus performance tuning. Increasing the performance by at least an order of magnitude should be possible.