Changes for page Topic Alerting
Last modified by Erik Bakker on 2025/11/19 20:30
From version 40.3
edited by dfirdausy
on 2024/07/18 13:27
on 2024/07/18 13:27
Change comment:
There is no comment for this version
To version 68.1
edited by Erik Bakker
on 2025/11/19 20:30
on 2025/11/19 20:30
Change comment:
There is no comment for this version
Summary
-
Page properties (3 modified, 0 added, 0 removed)
Details
- Page properties
-
- Title
-
... ... @@ -1,1 +1,1 @@ 1 - CustomizeQueueAlerting1 +Topic Alerting - Author
-
... ... @@ -1,1 +1,1 @@ 1 -XWiki. dfirdausy1 +XWiki.ebakker - Content
-
... ... @@ -1,167 +1,80 @@ 1 1 {{container}}{{container layoutStyle="columns"}}((( 2 -In this microlearning, we willfocusonhowyoucan customize yourqueue alertsbyconfiguringthe trigger conditions and thresholds,whichraise an alert andnotify people when those points arepassed.2 +In this microlearning, we’ll explore how to view and customize topic alerts within your eMagiz environment. Customizing these alerts allows you to tailor the trigger conditions and thresholds to better fit your specific needs, enhancing how you monitor and respond to topic activity. We’ll cover the two types of topic triggers available and guide you through configuring them to suit your requirements. This will help you ensure your alerts are as effective and relevant as possible. Should you want to learn more about the standard alerting that eMagiz offers, please check out this [[microlearning>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.Crash Course Platform.crashcourse-platform-manage-alerting-gen3||target="blank"]]. 3 3 4 -. Should you want to learn more about the standard alerting that eMagiz offers, please check out this [[microlearning>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.Crash Course Platform.crashcourse-platform-manage-alerting-gen3||target="blank"]]. 5 - 6 6 Should you have any questions, please contact [[academy@emagiz.com>>mailto:academy@emagiz.com]]. 7 7 6 +{{info}}Note that this documentation explains the latest design of eMagiz Topic Alerting that is introduced in [[Release 253>>Main.Release Information.Release Blogs.253 - Rince Repeat.WebHome||target="blank"]] and the Topic Alerting explained in this page is only applicable for eMagiz models that are running on DSH.{{/info}} 7 + 8 8 == 1. Prerequisites == 9 9 10 10 * Basic knowledge of the eMagiz platform 11 +* Basic knowledge of alerting in the eMagiz platform 11 11 12 12 == 2. Key concepts == 13 13 14 -This microlearning centers configuring dynamic alerting based on triggers you can define as a user. 15 -By defining, we mean: Specifying based on what triggers an alert needs to be raised. 15 +This microlearning focuses on customizing the topic alerts that are existing in each of the environment of your model (i.e., Testing-Acceptance-Production). By customizing we mean further configuring the trigger conditions and thresholds of your topics, so they better suit your needs and requirements. 16 16 17 -* There are five trigger options 18 -** Error message 19 -** Log message 20 -** Queue consumers 21 -** Messages in queue 22 -** Queue throughput 23 -* On the trigger level, the recipients are defined 24 -* On the trigger level, the congestion control is defined 17 +* eMagiz applies the same set of triggers to all topic. 18 +* There are two topic trigger options that eMagiz currently provides: 19 +** Minimum throughput check 20 +** Messages behind check 21 +* Recipients are defined on the topic level. 25 25 26 -== 3. Dynamic Alerting ==23 +== 3. Topic Alerting == 27 27 28 - Toenhance the observabilityof yourintegrationlandscapewhilerunninginthe 3rd generation runtime architecture,wehave added a newfeature toourManage phasecalled "Dynamic Alerts."You can accessthis functionalityvia the "Alerting" menu in Manage. Then,with the help of the "Trigger" overview, you canviewall triggers in your environment.Onthetopof the list, you will see all [["static" alerts>>doc:Main.eMagizAcademy.Microlearnings.Crash Course.CrashCoursePlatform.crashcourse-platform-manage-alerting-gen3||target="blank"]] asdefined by eMagiz belowthatyou will seeall "dynamic" alerts that you and your fellowteam members(withsufficientrights) canview, editand delete.25 +As all our alerting now works is that we have divided them up in various segments that are accessible via Manage. 29 29 30 -We offeralertingonseventypes.27 +[[image:Main.Images.Microlearning.WebHome@crashcourse-platform-manage-alerting-in-emagiz-topic-alerts-overview.png]] 31 31 32 -* Error message 33 -* Log message 34 -* Queue consumers 35 -* Messages in queue 36 -* Queue throughput 37 -* Messages added to topic 38 -* Topic consumer messages behind 29 +Here, when you navigate to Manage->Alerting->Triggers, you will find all the topics that are generated by eMagiz currently existing within your model, along with the trigger conditions and thresholds that are applied to each of these topics. In the following sections, we will discuss how you can tune these topics triggers to your needs. 39 39 40 - [[image:Main.Images.Microlearning.WebHome@novice-alerting-dynamic-alerting--dynamic-alert-trigger-options.png]]31 +{{info}}Contrary to the queue alerting we do not offer any default configuration as eMagiz given the widespread implementation of event streaming in the community which prevents us from defining relevant default triggers that would apply in almost all cases. As a result, the default configuration on topic level is that the alert is **disabled** and **no** thresholds are defined{{/info}} 41 41 42 - First,we will discuss the configuration of each trigger type.Subsequently, we will discuss defining which recipients will be notifiedand how to alter the defaultcongestion controlsettings(as this is the same for each trigger type).33 +=== 3.1 Customize Default Values === 43 43 44 - ===3.1Error message===35 +Changes to the default values will only apply to topic triggers that are set to use the default values, and not to those you have already customized. To modify the default values configured by eMagiz, you can click the "Configure defaults" button at the top of the topic trigger list. 45 45 46 - Ontopofthe"static" alert that isautogeneratedby eMagizonError messages,youcanadd additional"dynamic" alertsthat only trigger when anerror messageis raisedforwhicha specificheadercontains a particularvalue.This is mostlikelyrelevantwhenaspecificerror messagewithcertain characteristics (i.e., a particular header value) needstobe senttoa differentsetof recipients.37 +{{info}}Note that if your account does not have edit rights in Manage for a specific environment, you will see a "View defaults" button instead.{{/info}} 47 47 48 - To definethe trigger, fill in theheader'sname and theexpected value. Ontop of that, youcan fill in a descriptionthat will beaddedtothealertreceived via email. Oncethis is filledin, theconfiguration could look asfollows.39 +[[image:Main.Images.Microlearning.WebHome@novice-alerting-customize-topic-alerting--customize-default-triggers.png]] 49 49 50 - [[image:Main.Images.Microlearning.WebHome@novice-alerting-dynamic-alerting--dynamic-alert-error-message-configuration.png]]41 +Here, you will get a pop-up page where you can configure the default values of your topic triggers. The details of each of the triggers will be discussed in the next section. But, what is important to note here is that, here, you have the "Reset to eMagiz defaults" button to reset the default values to the values provided by eMagiz as defaults (i.e. disabling them). Next to that, at the bottom of the pop-up, you will find the "Update defaults" button, which will apply the default values that you have configured to all topic triggers that are set to use the default values. By clicking this button, the new default values will be put into effect immediately. 51 51 52 - ===3.2Log message ===43 +Additionally, on this page, you can also find the "Notifications" tab that allows you to configure which recipients that you want to receive the notifications from the alerting. If you want to learn more about this notifications and how to configure it, please refer to this [[microlearning>>Main.eMagiz Academy.Microlearnings.Intermediate Level.Alerting.intermediate-alerting-setting-up-notifications-gen3||target="blank"]]. 53 53 54 - Ontopof the "static" alert that is autogenerated by eMagiz on Log messages, you can add additional "dynamic" alertsthatonly trigger when a log message contains a specificphrase. This islikely when you log somethingon which you want to alert when it happens.45 +=== 3.2 Customize Topic Alerting === 55 55 56 - Todefinethe trigger,fillinthephraseyouwant to check.Ontop ofthat, you canfillinadescriptionthatwillbeadded tothealertreceivedviaemail.Once thisis filledin,the configurationcouldlookas follows.47 +Next to customizing the default values for all topic triggers, you can also modify the trigger configurations for individual topics. To customize these topic triggers to better suit your needs, you can click the edit buttons (green paper and pencil buttons) located at the end of each topic trigger. By doing so, you will get a pop-up page that allows you to further customize the conditions and thresholds of your topic triggers, which will be discussed in the following. 57 57 58 - [[image:Main.Images.Microlearning.WebHome@novice-alerting-dynamic-alerting--dynamic-alert-log-message-configuration.png]]49 +==== 3.2.1 Minimum throughput check ==== 59 59 60 - === 3.3 Queueconsumers===51 +[[image:Main.Images.Microlearning.WebHome@novice-alerting-customize-topic-alerting--minimum-throughput-check.png]] 61 61 62 - Ontop ofthe "static"alert that is autogenerated byeMagizonQueue consumers,youcanaddadditional"dynamic"alerts thatonlytriggerwhenthe number ofconsumers on a(specific)set ofqueuesisbelowacertain threshold.53 +{{info}}This alert checks whether a topic receives at least the specified number of messages within a 10-minute window. If the count remains below the threshold for the entire window, a Problem alert is triggered. Please provide the threshold that suites the integration. You can customize this threshold as needed. Additionally, you can specify the instructions to be included in email notifications sent to recipients and in the alert message displayed in the Manage->Alerting->Alerts.{{/info}} 63 63 64 - Todefine the trigger, determine the threshold you want to check (i.e.,2).Subsequently,specify whether on which queues(orall queues)you wanteMagiz to check for this condition.No further action is needed if you want to checkon all queues.55 +==== 3.2.2 Messages behind check ==== 65 65 66 -[[image:Main.Images.Microlearning.WebHome@novice-alerting- dynamic-alerting--dynamic-alert-queue-consumers-all-queues.png]]57 +[[image:Main.Images.Microlearning.WebHome@novice-alerting-customize-topic-alerting--messages-behind-check.png]] 67 67 68 - Youcan uncheckthecheckboxifyouwantto checkonaspecific(setof) queue(s). As a result,the"Add" and"Remove"buttonsaredisplayedbyeMagiz,throughwhichyoucanadd andremovequeuesto the trigger.59 +{{info}}This alert monitors consumer lag and triggers a Problem alert if any consumer group exceeds the defined threshold for 10 consecutive minutes. Please provide the threshold that suites the integration. For more information check out the helptext on the component{{/info}} 69 69 70 -[[image:Main.Images.Microlearning.WebHome@novice-alerting-dynamic-alerting--dynamic-alert-queue-consumers-specific-queues.png]] 71 71 72 - Whenyoupressthe"Add" button,anewpop-upwill appearthrough whichyoucan select thequeuesforwhichyouwant the triggertobeactivated.In this pop-up, you canchooseone(ormore)queues andpressthe"Select"button to addthemto the trigger.62 +{{info}}Upon saving, these custom values will apply immediately, putting the new check into effect. Additionally, you will notice that the "Settings" status of the topic trigger you just customized has changed from "Default" to "Custom". Similarly, on this page, you can also find the "Notifications" tab that allows you to configure which recipients that you want to receive the notifications from the alerting of a specific topic. If you want to learn more about this notifications and how to configure it, please refer to this [[microlearning>>Main.eMagiz Academy.Microlearnings.Intermediate Level.Alerting.intermediate-alerting-setting-up-notifications-gen3||target="blank"]].{{/info}} 73 73 74 -[[image:Main.Images.Microlearning.WebHome@novice-alerting-dynamic-alerting--dynamic-alert-queue-consumers-queue-selection.png]] 75 - 76 -{{info}}Note that when you want to select multiple queues at once, you cannot press "Enter" to Save your selection. In this case, you need to press the "Select" button to save your choice.{{/info}} 77 - 78 -Once you have selected the queue(s) and pressed "Select," eMagiz will close the pop-up and add the queues to the trigger. 79 - 80 -[[image:Main.Images.Microlearning.WebHome@novice-alerting-dynamic-alerting--dynamic-alert-queue-consumers-queue-selection-result.png]] 81 - 82 -=== 3.4 Messages in queue === 83 - 84 -On top of the "static" alert that is autogenerated by eMagiz on Messages in a queue, you can add additional "dynamic" alerts that only trigger when a queue holds more than X messages. Logically, the X can be determined by the user. Subsequently, define whether on which queues (or all queues) you want eMagiz to check for this condition. No further action is needed if you want to check on all queues. 85 - 86 -[[image:Main.Images.Microlearning.WebHome@novice-alerting-dynamic-alerting--dynamic-alert-messages-in-queue-all-queues.png]] 87 - 88 -You can uncheck the checkbox if you want to check on a specific (set of) queue(s). As a result, the "Add" and "Remove" buttons are displayed by eMagiz, through which you can add and remove queues to the trigger. 89 - 90 -{{info}}This process of adding and removing specific queues works identically, as explained in the section on Queue consumers.[[Queue consumers.>>||anchor="H3.3Queueconsumers"]]{{/info}} 91 - 92 -Once you have selected the queue(s) and pressed "Select," eMagiz will close the pop-up and add the queues to the trigger. 93 - 94 -[[image:Main.Images.Microlearning.WebHome@novice-alerting-dynamic-alerting--dynamic-alert-messages-in-queue-queue-selection-result.png]] 95 - 96 -=== 3.5 Queue througput === 97 - 98 -For this category you can add additional "dynamic" alerts that only trigger when the throughput on one or more queues is more or less than X messages per Y minutes. Subsequently, define whether on which queues (or all queues) you want eMagiz to check for this condition. No further action is needed if you want to check on all queues. 99 - 100 -[[image:Main.Images.Microlearning.WebHome@novice-alerting-dynamic-alerting--dynamic-alert-queue-throughput-all-queues.png]] 101 - 102 -You can uncheck the checkbox if you want to check on a specific (set of) queue(s). As a result, the "Add" and "Remove" buttons are displayed by eMagiz, through which you can add and remove queues to the trigger. 103 - 104 -{{info}}This process of adding and removing specific queues works identically, as explained in the section on Queue consumers.[[Queue consumers.>>||anchor="H3.3Queueconsumers"]]{{/info}} 105 - 106 -For this trigger, additional criteria can be configured that allow you to define when eMagiz needs to validate this configuration (i.e., Occurence). With the help of this configuration option, you can specify when the trigger needs to be evaluated. An example could be only on Monday between 04:00 AM and 05:00 AM. 107 - 108 -[[image:Main.Images.Microlearning.WebHome@novice-alerting-dynamic-alerting--dynamic-alert-queue-throughput-occurence-config.png]] 109 - 110 -=== 3.6 Messages added to topic === 111 - 112 -For this category, you can add additional "dynamic" alerts. These alerts only trigger when the messages added to one or more topic is less than X messages per Y minutes. On top of the number of messages (X) and the timeframe (Y), you can define whether to validate this on a specific topic or all topics. Note that the default configuration is that the alert applies to all topics. 113 - 114 -[[image:Main.Images.Microlearning.WebHome@novice-alerting-dynamic-alerting--dynamic-alert-messages-added-to-topic-all-topics.png]] 115 - 116 -You can uncheck the checkbox to check on a specific (set of) topic(s). As a result, the "Add" and "Remove" buttons are displayed by eMagiz, through which you can add and remove topics to the trigger. 117 - 118 -{{info}}This process of adding and removing specific topics works identically, as explained in the section on Queue consumers.[[Queue consumers.>>||anchor="H3.3Queueconsumers"]]{{/info}} 119 - 120 -For this trigger, additional criteria can be configured that allow you to define when eMagiz needs to validate this configuration (i.e., Occurence). With the help of this configuration option, you can specify when the trigger needs to be evaluated. An example could be only on Monday between 04:00 AM and 05:00 AM. 121 - 122 -=== 3.7 Topic consumer lag === 123 - 124 -For this category, you can add additional "dynamic" alerts. These alerts only trigger when one (or more) consumer groups lag by X messages on one (or more) topic(s). Note that the default configuration is that you, as a user, need to specify for which topic(s) the alert applies, as consumers' behavior can vary widely. 125 - 126 -{{info}}This process of adding and removing specific topics works identically, as explained in the section on Queue consumers.[[Queue consumers.>>||anchor="H3.3Queueconsumers"]]{{/info}} 127 - 128 -Once filled in, the solution should look similar as follows. 129 - 130 -[[image:Main.Images.Microlearning.WebHome@novice-alerting-dynamic-alerting--dynamic-alert-topic-consumer-lag-selected-topics.png]] 131 - 132 -=== 3.8 Recipient(s) configuration === 133 - 134 -You can select your recipients when you switch from the "Trigger" to the "Output" tab. In this overview, you can choose both eMagiz users and external recipients. 135 - 136 -[[image:Main.Images.Microlearning.WebHome@novice-alerting-dynamic-alerting--dynamic-alert-recipient-config.png]] 137 - 138 -{{info}}Note that when you define multiple external recipients, you need to separate each email address with a comma to make it work.{{/info}} 139 - 140 -=== 3.9 Congestion control configuration === 141 - 142 -In the same "Output" tab, you can also define the congestion control configuration. The default configuration is that congestion control will be activated once more than ten alerts are triggered in the last ten minutes. So should you want to reduce this number, you can do so here. 143 - 144 -[[image:Main.Images.Microlearning.WebHome@novice-alerting-dynamic-alerting--dynamic-alert-congestion-control-config.png]] 145 - 146 -{{warning}}Note that we advise only reducing the number under the congestion control if the ten default is too high. We do **not** advise deactivating the congestion control as this can cause an explosion in the number of received notifications.{{/warning}} 147 - 148 148 == 4. Key takeaways == 149 149 150 -* There are seven trigger options 151 -** Error message 152 -** Log message 153 -** Queue consumers 154 -** Messages in queue 155 -** Queue throughput 156 -** Messages added to topic 157 -** Topic consumer messages behind 158 -* On the trigger level, the recipients are defined 159 -* On the trigger level, the congestion control is defined 160 -* Default configuration of the congestion control is sufficient in most cases 161 -* When entering multiple external recipients, ensure each email address is separated with a comma 66 +* As a user with the edit rights in Manage of a particular environment, you can modify the default values for all of your topic triggers or customize the trigger configurations of individual topics. 67 +* eMagiz provides four topic trigger options: Minimum throughput check (monitoring the number of messages processed by the topic), Messages behind check (monitoring the consumer lag). 68 +* Once you save your trigger configurations, they will take effect immediately. 162 162 163 163 == 5. Suggested Additional Readings == 164 164 165 -If you are interested in this topic and want more information, please read the help text provided by eMagiz. 166 - 72 +If you are interested in this topic and want more information, please read the help text provided by eMagiz and read the following microlearning. 73 +* [[Crash Courses (Menu)>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.WebHome||target="blank"]] 74 +** [[Crash Course Platform (Navigation)>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.Crash Course Platform.WebHome||target="blank"]] 75 +*** [[Standard Alerting eMagiz (Explanation)>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.Crash Course Platform.crashcourse-platform-manage-alerting-gen3||target="blank"]] 76 +* [[Intermediate (Menu)>>doc:Main.eMagiz Academy.Microlearnings.Intermediate Level.WebHome||target="blank"]] 77 +** [[Alerting (Navigation)>>doc:Main.eMagiz Academy.Microlearnings.Intermediate Level.Alerting.WebHome||target="blank"]] 78 +*** [[Setting up notifications (Explanation)>>doc:Main.eMagiz Academy.Microlearnings.Intermediate Level.Alerting.intermediate-alerting-setting-up-notifications-gen3||target="blank"]] 79 +* [[Topic Alerting (Search Result)>>url:https://docs.emagiz.com/bin/view/Main/Search?sort=score&sortOrder=desc&highlight=true&facet=true&r=1&f_space_facet=0%2FMain.&f_type=DOCUMENT&f_locale=en&f_locale=&f_locale=en&text=%22topic+alerting%22||target="blank"]] 167 167 )))((({{toc/}}))){{/container}}{{/container}}