--- title: ZEN MASTER June 2023 RELEASE NOTES slug: zen-master-june-2023-release-notes docTags: createdAt: 2025-03-21T18:32:07.148Z --- The following updates will be included in the ZEN Master June 13, 2023 release. Features The following new features were implemented in this release: • IDP MOCA Auto-Incidents In this release we have made a major update to IDP Multi-Object Correlation Analysis (MOCA) to auto-generate incidents based on any errors observed by ZEN Master, not just unrecovered packets. Incidents provide a roll-up of errors when they become particularly significant so you can see outages in a single view with context to help you understand what’s going on and how to fix it, and to reduce the noise of low-level alerts. On the left side is the list of affected objects. On the right, the root cause is at the top and related measurement graphs are listed below. The description of the incident shows some root cause details including the shared resource and the incident type. • **Incident Definition and Thresholds** Incidents are reported when there are 3 or more Sources or Targets having errors at the same time that share a common resource, and when at least 50% of the objects that share that resource are experiencing errors at the same time. Errors that happen on these objects within 10 minutes of a previous error are grouped together into the incident. It is possible to have multiple related incidents if there is a period of more than 10 minutes without any errors. In some cases, if there are multiple shared resources the system may also report multiple related incident records. • **Shared Resources** \- Client Network – the network where Source or Target objects are connected. Networks are identified by network ASN (Autonomous System Number), country code, and region code. For example, US\_OH\_123 is a network in Ohio in the United States with ASN 123. \- Server Network – the network where a Broadcaster is connected. \- Network Path – the connection between a Source and a Broadcaster. \- Broadcaster – the shared Zixi Broadcaster. •** Types** Incidents can be of type Network Error or Object Error. Object Error incidents can be triggered by a TR101-CC error on a Source, or a Broadcaster max CPU error, or any error reported in ZEN Master. •** Root Cause, Blast Radius** The Root Cause description for an auto-generated incident includes the incident type, the shared resource, and some details about how many objects that share the shared resource (a network path, for example) are involved in the incident (sometimes called “impact” or “blast radius”) compared to the total number of objects connected. Examples: \- Client Network Error: 57% of Sources (8/14) on network US\_OH\_123 have network errors. \- Object Warning – Network Path: 67% of Targets (4/6) on network path (US\_OH\_123- US\_CA\_456) have Object Errors. In Incident View, Object Error incident records show the relevant errors for the selected time- period for all related objects, as well as network and other measurement graphs. • Table View for Grids. The ZEN Master Grid screen now allows the user to toggle between the standard Grid view, and a List View using the new tables architecture: To toggle the view, choose the list icon from the view icon pair above the Grid: With the new view selected the User gains all the additional filter controls available in standard tables, as well as the displayed / hidden column controls and the ability to generate a quick report. • Broadcaster customization is now available on Azure and GCP Clusters. Already supported for ZEN Master managed AWS Scaling Clusters, customization of a Broadcaster’s name and private / streaming IP settings is now supported for Clusters launched in both Azure and GCP. This can be configured in the Create New Broadcaster dialog when selecting ‘Add Broadcaster’ in the Cluster details section, or via the ZEN Master API: • AgentZ is now available for manual installation without causing a Broadcaster restart. Whilst the AgentZ telemetry gathering tool can still be installed from ZEN Master, it can now also be installed manually on a Broadcaster. Unlike the ZEN Master install, the manual install does not force a Broadcaster restart. The manual AgentZ installer can be downloaded from the Zixi Customer Portal, and instructions are provided in the Zixi AgentZ User Guide. • User management security notifications. A new “Account Management” log object is introduced to log, track, and search for updates and changes to security objects including: \- Users \- Groups \- Roles These log entries are available for Admin user only, and can be searched for in the Event Log filter: All Admin users will receive specific Account Management email notifications for changes to any security objects in the ZEN Master environment: If needed, Admin Users can opt out of receiving these emails in the ‘My Account’ section: • Improved support and useability for AWS Elastic IP’s. When using Elastic IPs for AWS Scaling Clusters, ZEN Master now introduces an option to prevent instances from launching if there are no more designated EIP’s available. The option, included in the Cluster advanced configuration settings, will explicitly prevent AWS from launching a new instance when no further Elastic IP addresses are available, to guard against a Cluster adding a Broadcaster with an unknown public IP address: Regardless, the Cluster now displays available/used Elastic IPs and provides UI warnings when launching instances where there are none are available. • Broadcaster system logs can now be downloaded via the Broadcaster ‘Details’ page. The Broadcaster details page now provides a link to download Broadcaster system logs directly, without the User needing to navigate and log-in to the Broadcaster GUI directly: Additional Improvements and Changes The following additional improvements and changes were implemented in this release: • Filtering in tables now evaluates on Error/Warning message contents: o The event log message is now an option when using ‘Add Filters’ in the Sources and Channels tables: • When selecting transcoding profiles, the list now displays codec. • Private IP streaming now works on Clusters with DTLS enabled. • Improved error handling in case users break ZM AWS IAM role. • Added AWS instance ID to Broadcaster details page. • Renamed VIP tags to Priority. • Disabled AZ rebalance process for AWS Clusters. o This will only affect new or updated Clusters. • Added Pad to CBR options to Demux Sources. • Ignore PCR Accuracy errors when monitoring VBR streams. • Multiplex Sources now support auto-pulls: o Requires Broadcaster v16.7. • Added options to customize the cloud-init launch script on AWS Clusters. • PID mapping changes are now tracked and displayed for all PID mapping modes. • Event log object names are now links to the specific objects. • Created features guide for new Tables. • Automation task delay is now limited to 15 minutes. • ZM Tags now propagate to Azure. • Added Billing Codes to Zixi Push Targets. • Applied new tables everywhere + other UI improvements. Bug Fixes The following issues were resolved: • Fixed duplicate incidents. • Missing SCTE-35 alarm no longer stops working after an hour of missing SCTE messages. • Users unable to reset their own password. • Some fields always blank in Grids. • Editing Inter-Cluster Source no longer creates an infinite loop. • Fixed diagrams showing broken active Broadcaster in some cases. • Fixed unable to enable targets in some cases. • Removed Alternative host from Zixi push output in AWS MediaConnect targets. • Automation tasks will no longer fail if execution takes longer than 3 minutes. • Fixed Grids in Grid Groups missing an All-Good indicator when there is nothing to display in the Grid. • Fixed pull connections to Broadcasters/ZECs not reconnecting on zero bitrate when a better Source is available. • Requires Broadcaster v16.7. • Failover Sources/Channels will now work with auto-pulls. • Added missing force delete options when deleting multiple tags. • ZM will now ignore certain irrelevant Broadcaster errors when redirecting pull connections, e.g. full hard drive. • Update default adaptive FEC settings on Zixi Pull Sources.