Troubleshoot cardinality in Monitoring MetricSets π
Follow these steps to troubleshoot issues with high cardinality and Monitoring MetricSet configurations.
Troubleshoot high cardinality data π
If the cardinality of your Monitoring MetricSets is high, you might reach your subscription limits and be unable to create new Monitoring MetricSets. This page provides guidance on how to configure your Monitoring MetricSets with efficiency.
Choose between service and endpoint level MetricSets π
The following table outlines the difference between endpoint and service level MetricSets.
Endpoint level MetricSet |
Service Level MetricSet |
---|---|
|
|
The Monitoring MetricSets at the service level are an aggregation of the metric sets at the endpoints level. If you specify the endpoints that are of interest to you in your Monitoring MetricSet, then you can reduce the amount of data.
However, limiting the number of endpoints in your Monitoring MetricSet isnβt always a guaranteed way to reduce your cardinality.
Guidance on how to reduce cardinality π
If you have high cardinality metrics that exceed the system limit or subscription quota for your contract, try these methods to reduce cardinality for your metric set:
Turn off an endpoint MetricSet by choosing Service MMS only.
Add a filter by tag value to reduce the number of results.
Remove or filter down existing Monitoring MetricSets. The cardinality check in APM estimates your total cardinality of existing MMS in addition to your proposed changes.
MetricSets with zero cardinality are not considered valid. If you have zero cardinality, verify that your configuration details are correct, or try again once you are ingesting the relevant tracing data.
If the Monitoring MetricSet times out, try adding filters and running it again.
Provide a list of tag values, or a regular expression.
For more information on troubleshooting high and low cardinality, see Guidelines for working with low and high cardinality data.
Example: How to reduce cardinality through tag filters π
In this example, the custom dimension is customer.id
.
For example, suppose you want to track a checkout workflow on your application. In your environment, this workflow is called the checkout service. You create a Monitoring MetricSet with two endpoints, add-to-cart, and checkout. However, you find that your cardinality is quite high for the Monitoring MetricSet for these two endpoints because there are 10k unique customer IDs for the customer.id
tag associated with these endpoints.To reduce the overall cardinality for this Monitoring Metricset, you can filter by tag values to a smaller subset of customer IDs that are of interest to you instead of needlessly processing 10k unique tags.
Check that your Monitoring MetricSet is set up correctly π
After you set up your Monitoring MetricSet, go to the APM Troubleshooting MetricSet Configuration page to make sure that the status is active. Once your MMS is active, you will start seeing metrics as soon as matching traces arrive.
- For guidance:
When and why you might want to pause, or stop, your MetricSet, see Status of configured MetricSets.