mountainss Cloud and Datacenter Management Blog

Microsoft SystemCenter blogsite about virtualization on-premises and Cloud


Leave a comment

Monitoring Microsoft Azure Cloud Services and On-premises Datacenters #Azure #MSOMS #Cloud

Microsoft Azure Monitor

There are a range of tools for monitoring your Azure environment, from the application code running on Azure to the services and infrastructure hosting your application. These tools work together to offer comprehensive cloud monitoring and include:

  • Azure Monitor – the Azure service that operates as a consolidated pipeline for all monitoring data from Azure services. It gives you access to performance metrics and events that describe the operation of the Azure infrastructure and any Azure services you are using. Azure Monitor is a monitoring data pipeline for your Azure environment, and offers that data directly into Log Analytics as well as 3rd party tools where you can gain insight into that data and combine it with data from on premises or other cloud resources.
  • Application Insights – the Azure service that offers application performance monitoring and user analytics. It monitors the code you’ve written and applications you’ve deployed on Azure, on-premises, or other clouds. By instrumenting your application with the Application Insights SDK you can get access to a range of data including response times of dependencies, exception traces, debugging snapshots, and execution profiles. It provides powerful tools for analyzing this application telemetry while developing and operating your application. It deeply integrates with Visual Studio to enable you to get right to the problem line(s) of code so you can fix it, and offers usage analytics to analyze customer usage of your applications for product managers as well.

Overview of Application Insights for DevOps

  • Log Analytics –  is an Azure service that ingests log and metric data from Azure services (via Azure Monitor), Azure VMs, and on-premises or other cloud infrastructure and offers flexible log search and out-of-the box analytics on top of this data. It provides rich tools to analyze data across sources, allows complex queries across all logs, and can proactively alert on specified conditions. You can even collect custom data into its central repository so you can query and visualize it. You can also take advantage of Log Analytic’s built-in solutions to immediately gain insights into the security and functionality of your infrastructure.

Log Analytics Documentation

Azure Monitor enables you to consume telemetry to gain visibility into the performance and health of your workloads on Azure. The most important type of Azure telemetry data is the metrics (also called performance counters) emitted by most Azure resources. Azure Monitor provides several ways to configure and consume these metrics for monitoring and troubleshooting.

Telemetry data is important

Because telemetry data is sending every minute, you get near to real-time monitoring of your data and/or your IT Solution.

Alerts on Azure Monitor data

Azure Monitor provides several ways to interact with metrics, including charting them in the portal, accessing them through the REST API, or querying them using PowerShell or CLI. Here you find a complete list of all metrics currently available with Azure Monitor’s metric pipeline.

There are three types of alerts off of data available from Azure Monitor — metric alerts, near real-time metric alerts (preview) and Activity Log alerts.

  1. Metric alerts – This alert triggers when the value of a specified metric crosses a threshold that you assign. The alert generates a notification when the alert is “Activated” (when the threshold is crossed and the alert condition is met) as well as when it is “Resolved” (when the threshold is crossed again and the condition is no longer met)
  2. Near real-time metric alerts (preview) – These alerts are similar to metric alerts but differ in a few ways. Firstly, as the name suggests these alerts can trigger in near real-time (as fast as 1 min). They also support monitoring multiple(currently two) metrics. The alert generates a notification when the alert is “Activated” (when the thresholds for each metric are crossed at the same time and the alert condition is met) as well as when it is “Resolved” (when at least one metric crosses the threshold again and the condition is no longer met).
  3. Activity log alerts – A streaming log alert that triggers when an Activity Log event is generated that matches filter criteria that you have assigned. These alerts have only one state, “Activated,” since the alert engine simply applies the filter criteria to any new event. These alerts can be used to become notified when a new Service Health incident occurs or when a user or application performs an operation in your subscription, for example, “Delete virtual machine.”

Alerts overview

 

When you go to the Microsoft Azure Portal and click on the left side on Monitor you can start your Solutions and configure them.

To Gain visibility and control across your hybrid cloud with simplified security and operations management there is Microsoft Operations Management Suite (OMS)

Here you find a lot of Hybrid Solutions to monitor and find the benefits of Cloud management with Log Analytics.

Understanding alerts in Log Analytics :

 

Alerts are created by alert rules that automatically run log searches at regular intervals. If the results of the log search match particular criteria then an alert record is created. The rule can then automatically run one or more actions to proactively notify you of the alert or invoke another process. Different types of alert rules use different logic to perform this analysis.

In addition to creating an alert record in the Log Analytics repository, alerts can take the following actions.

  • Email. Send an email to proactively notify you of a detected issue.
  • Runbook. An alert in Log Analytics can start a runbook in Azure Automation. This is typically done to attempt to correct the detected issue. The runbook can be started in the cloud in the case of an issue in Azure or another cloud, or it could be started on a local agent for an issue on a physical or virtual machine.
  • Webhook. An alert can start a webhook and pass it data from the results of the log search. This allows integration with external services such as an alternate alerting system, or it may attempt to take corrective action for an external web site.

Here you find more on Understanding alerts in Log Analytics

To keep you in Control of monitoring, Microsoft made two Mobile Apps :

Microsoft Operations Management Suite Mobile App

Microsoft OMS on my Phone

And you got the Microsoft Azure Mobile App

For Microsoft Azure Monitoring there are all kind of Solutions in the Marketplace available :

Microsoft Azure Marketplace

Conclusion :

Monitoring your IT Solutions is really important for your Application Life Cycle management to get feedback for improvements and to get Customer satisfaction.
With Microsoft Monitoring from the Cloud with Azure and OMS you get more inside information via telemetry and log analytics to keep you Up-To-Date of
your IT Hybrid Infrastructure. Modern Hybrid Cloud Datacenter(s) need a Modern Secure Monitoring environment to keep yourself and your business in Control all the time in this rapidly fast changing IT World.
Monitoring via the Microsoft Cloud gives you :

  • More Security information, Alerts and Advice to prevent security leaks
  • Application improvements in your Life Cycle management
  • Automation of action plans on Events.
  • The Health of your IT Hybrid Cloud Services
  • Makes troubleshooting much easier with Diagnostics logs
  • Integration with on-premises IT Infrastructures
  • OMS assessments, like Active Directory, SQL, Upgrades, Malware, Security & Audits………… and More
  • Great Dashboards for DevOps, IT Administrators, IT Managers, or for your Customers.

To get More information and benefits about Monitoring and diagnostics for your Design ( Best Practices )

Hope this information is helpful to get you in control of monitoring your Hybrid Cloud Solutions.

Advertisements


Leave a comment

#Microsoft System Center Management Pack (CTP) for #SQL Server vNext Replication #Sysctr #SCOM

Microsoft System Center Management Pack (Community Technology Preview) for SQL Server vNext Replication enables the monitoring of Replication as a set of technologies for copying and distributing data and database objects from one database to another and then synchronizing between the databases to maintain consistency.

Here you can download the System Center MP for SQL Server vNext Replication including documentation.

 


Leave a comment

#Microsoft System Center 2016 Management Pack for Microsoft #Azure #Sysctr #SCOM

scom-mp-for-azure

Management Pack Scope

The Management Pack for Microsoft Azure enables you to monitor the availability and performance of Azure resources that are running on Microsoft Azure. The management pack runs on a specified server pool, and then uses Microsoft Azure REST APIs to remotely discover and collect performance information about the specified Microsoft Azure resources.

This management pack focuses on the collection of performance metrics made available by Azure Services that use Azure Resource Manager.

Azure Active Directory is used for authenticating Azure REST API calls.

This management pack queries Azure REST APIs to enumerate the resources running in an Azure subscription and the performance metrics available for each resource.

Virtual machines, web roles, and worker roles can store events and performance counters into Azure table storage by means of Azure diagnostics. If these resources are configured to use Azure diagnostics, this Management Pack can collect these events and performance counters.

Examples of services that can be discovered, and whether performance counters are available for collection, are presented in the table below.

Service Discovered Performance Counters Notes
Application Insights Yes Yes
Automation Yes No
Backup Yes No
BizTalk Yes No
Cloud Service (web and worker roles) Yes Yes
Data Factory Yes Yes
DocumentDB Yes No Metrics are not available in the Add Monitoring wizard
Logic App Yes No
Media Services Yes No Uses Service Management APIs
Mobile Services Yes Yes Uses Service Management APIs
Networks Yes No
Notification Hubs Yes No
Operational Insights Yes No
Redis Cache Yes Yes
Scheduler Yes No
Search Yes No
Service Bus Yes No
SQL Azure Yes Yes
Storage Accounts Yes No
Traffic Manager Yes No Uses Service Management APIs
Virtual Machines Yes Yes Virtual machines also appear as role instances for Cloud Services
Websites Yes Yes

You can download the Microsoft Management Pack for Azure here

microsoft-mvp-cdm-azure-advisor-banner


Leave a comment

Get Started with Microsoft #MSOMS Network Performance (Preview)

network-performance-monitor-preview

OMS Network Performance Monitor (Preview)

This blogpost describes how to set-up and use the Network Performance Monitor solution in OMS, which helps you monitor the performance of your networks-in near real-time-to detect and locate network performance bottlenecks. With the Network Performance Monitor solution, you can monitor the loss and latency between two networks, subnets or servers. Network Performance Monitor detects network issues like traffic blackholing, routing errors, and issues that conventional network monitoring methods are not able to detect. Network Performance Monitor generates alerts and notifies as and when a threshold is breached for a network link. These thresholds can be learned automatically by the system or you can configure them to use custom alert rules. Network Performance Monitor ensures timely detection of network performance issues and localizes the source of the problem to a particular network segment or device.+

You can detect network issues with the solution dashboard which displays summarized information about your network including recent network health events, unhealthy network links, and subnetwork links that are facing high packet loss and latency. You can drill-down into a network link to view the current health status of subnetwork links as well as node-to-node links. You can also view the historical trend of loss and latency at the network, subnetwork, and node-to-node level. You can detect transient network issues by viewing historical trend charts for packet loss and latency and locate network bottlenecks on a topology map. The interactive topology graph allows you to visualize the hop-by-hop network routes and determine the source of the problem. Like any other solutions, you can use Log Search for various analytics requirements to create custom reports based on the data collected by Network Performance Monitor.+

The solution uses synthetic transactions as a primary mechanism to detect network faults. So, you can use it without regard for a specific network device’s vendor or model. It works across on-premises, cloud (IaaS), and hybrid environments. The solution automatically discovers the network topology and various routes in your network.+

Typical network monitoring products focus on monitoring the network device (routers, switches etc.) health but do not provide insights into the actual quality of network connectivity between two points, which Network Performance Monitor does.

If you are new with Microsoft Operations Management Suite, you can download here a Free OMS Subscription Plan to try it your Self

oms-network-performance-2

When you have added the Microsoft OMS Network Performance Monitor (Preview) to your Dashboard you have to install OMS agents and configure them in an easy way to start the Network Performance solution and getting results.

  1. Install OMS Agents.
  2. Configure OMS Agents
  3. Create your Networks.

1. Install OMS Agents :

In order to work with OMS, OMS agents are required to be installed on all servers of interest.

NPM requires agents to be installed on at least 2 servers to monitor the connectivity between them. We recommend that for every subnet that you want to monitor, select two or more servers and install the agent on them. If you are unsure about the topology of your network, simply install the agents on critical workloads for which you want to monitor the network performance.

connected-resources

Here you can download your OMS Agent for your Server

If you are deploying using SCOM you should ignore step 1 and jump directly to step 2

Once the NPM solution is enabled on your OMS workspace the required management packs for NPM will automatically flow down to the machines that are connected to OMS via SCOM.

In case you want to connect SCOM with OMS but haven’t figured out how to do it yet, click on the link below.
oms-operations-manager-connectionHow to Connect SCOM to OMS

2. Configure OMS agents :

Firewall ports are required to be opened on the servers so that the agents can connect to each other.

Run the script without any parameters in a power shell window with administrative privileges. This script creates few registry keys required by NPM and creates windows firewall rules to allow agents to create TCP connections with each other

The port opened by default would be 8084. You have the option of using a custom port by providing the parameter ‘portNumber’ to the script. However, the same port should be used on all the machines where the script is executed.

Note that the script will configure only windows firewall locally. If you have a network firewall you should make sure that it is allowing traffic destined for the TCP port being used by NPM

network-powershell-script

Run the Powershell script as Administrator on your Servers.

3. Create your Networks :

A ‘Network’ in NPM is a container for a bunch of subnets. The Default network is the container for all the subnets that are not contained in any user defined network. In the most likely case the subnets in your organization will be arranged in more than one network and you should create one or more network to logically group your subnets.

You can create network with any name that meets your business requirements and add the subnets to the network.

Once you have saved the configuration for the first time, the solution will start collecting network data. The process usually takes a while. Once the data has been uploaded you should be able to see the solution dashboard with data and graphs. At this point the setup is complete and you can start using the solution

The OMS Performance Monitor Solution needs time to get the information of your network.

after-powershell-script

oms-network-performance-3

I have only one network in my lab environment

oms-network-performance-4

OMS Network Performance Monitor (Preview)

oms-network-performance-5

The issue here is that my switches are not IP V6 ready 😦

trends-in-schedule

After a view days analytics you can make your own custom view

oms-network-performance-7

Here you can plot network performance issues between two Servers

oms-network-performance-8

Everything is fine here 🙂

oms-network-performance-9

When something is wrong you can go directly to the View Node Logs.

oms-network-performance-10

OMS Log analytics results of your Server

When you have a large network with a lot of HOPS like switches and routers you can see where you have latency :

npm-investigation

The OMS NPM solution is still in preview but you can test it in your test environment to learn and get a better network by eliminating your network issues.
When you use the OMS Gateway on-premises you can connect your Servers to Operations Management Suite, here you
find my blogpost for the installation and configuration :

Hybrid IT Connect computers and devices to #MSOMS using the OMS Gateway

Hope this blogpost is useful for you to get your network in Control with Hybrid IT Management of OMS Services.

SCUG Banner


Leave a comment

Get Started with Microsoft #MSOMS Service Map to get in Control #HybridCloud #Winserv #Linux

oms-servicemap-overview

Microsoft OMS Service Map

Service Map automatically discovers application components on Windows and Linux systems and maps the communication between services. It allows you to view your servers as you think of them – as interconnected systems that deliver critical services. Service Map shows connections between servers, processes, and ports across any TCP-connected architecture with no configuration required other than installation of an agent.

If you are new with Microsoft Operations Management Suite, you can download here a Free OMS Subscription Plan to try it your Self

oms-solution-overview-smap

Start the Microsoft OMS Solution Market and select Service Map

oms-servicemap

Click on ADD Solution.

oms-dashboard-with-servicemap-config-tile

Click on the Service Map Tile.

servicemap-agent-1

Download your dependency Agent here.

download-agent

servicemap-agent-software

Run as Administrator

dependency-agent-install-1

agent

Click Finish.

services-dependeny-agent

The Microsoft Dependency Agent is running together with the OMS Agent.

servicemap-in-dashboard

Your first agent is running in Service Map

servicemap-dash-tile

I Added 3 Machines.

hybridcloud01-connection

Service Map of HyperV2016 Server.

hybridcloud01-connection-2 HybridCloud01 Server via the OMS Gateway

hybridcloud01-connection-3

hybridcloud01-connection-5

If you load Server Map from 40.121.165.208

hybridcloud01-connection-6

Microsoft Operations Management Suite (OMS) Service Map Alert view looks like this :

security-alert-service-map

Click on this HybridCloud01 Server alert.

security-alert-service-map-1

Here you can see that I miss a Security Update on this Server.

service-map-features

For this HybridCloud01 Server you can choose more OMS Service Map features to see what is going on with :

  • See a Summary of my Hybridcloud01 Server
  • The properties of my Hybridcloud01 Server
  • Alerts on my HybridCloud01 Server
  • Changes on my HybridCloud01 Server
  • Performance issues on my HybridCloud01 Server
  • Security on my HybridCloud01 Server
  • Updates on my HybridCloud Server

oms-service-map-schedule-view

OMS Service Map Schedule View settings.

oms-gateway-performance

Here you see the OMS Gateway Performance via Service Map.

Here you find more Microsoft technical documentation about Service Map in OMS

SCUG Banner


Leave a comment

Hybrid IT Connect computers and devices to #MSOMS using the OMS Gateway #Winserv #Linux

oms-agents

Instead of each individual agent sending data directly to OMS and requiring a direct Internet connection, all agent data is instead sent through a single computer that has an Internet connection. That computer is where you install and use the gateway. In this scenario, you can install agents on any computers where you want to collect data. The gateway then transfers data from the agents to OMS directly.

Here you can start with downloading the software for Microsoft OMS Gateway

oms-gateway-installer

oms-gateway-install-1

oms-gateway-install-2

oms-gateway-install-3

I used the default port 8080 for the Gateway.

oms-gateway-install-4

oms-gateway-install-5

oms-gateway-install-6

Now the Microsoft OMS Gateway Services is installedoms-gateway-running

Now Microsoft Operations Management Suite Gateway is installed, you can use some Microsoft Powershell Commands :

oms-gateway-powershell-1

oms-gateway-powershell-3

After the installation of the OMS Gateway, I installed the OMS Agent :

oms-connection

Download your OMS Agent here

oms-agent-1

oms-agent-2

oms-agent-3

oms-agent-4

oms-agent-5

Copy => Paste your OMS Workspace ID and Key.

oms-agent-6a

oms-agent-7

oms-agent-8

oms-agent-control

Here you can see the OMS Agent Connection settings.

oms-agent-9

When you wait for a few minutes you will see the connection in the Portal of OMS.

oms-connection

After this I installed the OMS Agent on One of my Domain Controllers with OMS Gateway settings //HyperV2016.hybridcloud4you.nl:8080.

This is what you will see in the Event Viewer of the OMS Gateway Server :

oms-gateway-events-next

Domain Controller 192.168.2.100 is going via the OMS Gateway

oms-agents-in-the-portal

OMS Agent via the Microsoft OMS Gateway

oms-portal

From here you can start with your OMS Solutions 😉

It is also possible to connect your System Center Operations Manager (SCOM) on-premises to the OMS Gateway.
Then you don’t have to connect your SCOM Management Server directly to the internet to OMS.

scom-oms-gateway

SCUG Banner