Cloud and Datacenter Management Blog

Microsoft Hybrid Cloud blogsite about Management

NEW via #MSFTConnect 2017 Microsoft #Azure Databrick

Leave a comment


Today at Microsoft Connect(); we introduced Azure Databricks, an exciting new service in preview that brings together the best of the Apache Spark analytics platform and Azure cloud. As a close partnership between Databricks and Microsoft, Azure Databricks brings unique benefits not present in other cloud platforms. This blog post introduces the technology and new capabilities available for data scientists, data engineers, and business decision-makers using the power of Databricks on Azure.

Azure Databricks Preview

Azure Databricks is an Apache Spark-based analytics platform optimized for the Microsoft Azure cloud services platform. Designed with the founders of Apache Spark, Databricks is integrated with Azure to provide one-click setup, streamlined workflows, and an interactive workspace that enables collaboration between data scientists, data engineers, and business analysts.

Read more on Microsoft Docs what Microsoft Azure Databrick is

Quickstart: Get started with Azure Databricks using the Azure portal :

This quickstart shows how to create an Azure Databricks workspace and an Apache Spark cluster within that workspace. Finally, you learn how to run a Spark job on the Databricks cluster.

Creating Clusters

In Databricks, you can create two different types of resources:
Standard Clusters: Databricksโ€™ standard clusters have lot of configuration options to customize and fine tune your Spark jobs. You can learn more about standard clusters below.
Serverless Pools (BETA): With serverless pools, Databricksโ€™ auto-manages all the resources and you just need to provide the range of instances required for the pool. Serverless pools support only Python and SQL. Serverless pools also auto-configures the resources with right Spark configuration. Visit Serverless Pools to know more about them.

Read more on the Microsoft Azure Blog here:ย  A Technical Overview of Azure Databricks after Microsoft Connect() 2017.

Author: James van den Berg

I'm Microsoft Architect and ICT Specialist and Microsoft MVP Cloud and Datacenter Management

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.