Azure Purview March Updates

Azure Purview March Updates

by | Mar 15, 2022 | Microsoft Purview

Azure Purview updates

Announcements

Last week during SQLBITS, quite a few new updates were announced. I would like to include you in these announcements.

March updates

Support for SAP Business Warehouse (Preview)

Blogpost:

https://techcommunity.microsoft.com/t5/azure-purview-blog/azure-purview-adds-support-for-sap-business-warehouse/ba-p/3253404

Documentation:

https://docs.microsoft.com/en-us/azure/purview/register-scan-sap-bw

Azure Purview SAP BW

Dynamic lineage extraction from Azure SQL Databases (Preview)

Documentation:

https://docs.microsoft.com/en-us/azure/purview/register-scan-azure-sql-database?tabs=sql-authentication#lineagepreview

Video:

 

Certify assets in the Azure Purview data catalog

Blogpost:

https://techcommunity.microsoft.com/t5/azure-purview-blog/certify-assets-in-the-azure-purview-data-catalog/ba-p/3249460

Documentation:

https://docs.microsoft.com/en-us/azure/purview/how-to-certify-assets

Purview_Certified_Datasets

Ability to delete child terms when parent term is deleted

Documentation:

https://docs.microsoft.com/en-us/azure/purview/how-to-create-import-export-glossary

Connect to and manage an on-premises SQL server instance in Azure Purview

Documentation:

https://docs.microsoft.com/en-us/azure/purview/register-scan-on-premises-sql-server

Approval workflow for business terms (Preview)

Before you can start Authoring your workflows make sure you the correct user to the role assignment Workflow administrators, if you haven't done that correctly the option will be greyed out.

Purview_Workflow_Admin

workflow-authoring-experience

Blogpost:

Approval workflow for business glossary

Documentation:

https://docs.microsoft.com/en-us/azure/purview/how-to-workflow-business-terms-approval

Self-service data access workflows for hybrid data estates (Preview)

Purview-data-access-request

Documentation:

https://docs.microsoft.com/en-us/azure/purview/how-to-workflow-self-service-data-access-hybrid

Azure integration runtime supports scanning more source types

Azure Purview now supports scanning Snowflake, Salesforce, PostgreSQL, MySQL, Cassandra and Looker using managed Azure integration runtime.

Blogpost:

https://techcommunity.microsoft.com/t5/azure-purview-blog/azure-integration-runtime-supports-scanning-more-source-types/ba-p/3254148

Documentation:

https://docs.microsoft.com/en-us/azure/purview/manage-integration-runtimes

Localization

Azure Purview is localized in 18 languages. To change the language used, go to the Settings from the top bar and select the desired language from the dropdown.

Purview-Localization

Blogpost:

https://techcommunity.microsoft.com/t5/azure-purview-blog/localization-generally-available-in-azure-purview-studio/ba-p/3249453

Documentation:

https://docs.microsoft.com/en-us/azure/purview/use-azure-purview-studio#localization

My first Virtual session in 2022 for Dataminds

My first Virtual session in 2022 for Dataminds

by | Jan 12, 2022 | Events

DataMinds

This Tuesday I've joined the DataMinds user Group to talk about Azure Purview.

 

Azure Purview

It was the first session of the year for both me and DataMinds. Some great questions during the session, thank you for that.

You can find my slides below on Slideshare:

 
Some useful links:
 
 
 
 
 
 
 
 
 

In case you have any questions left please feel free to ask them via the comment or Socials

My Virtual session DataWeekender 4.2

My Virtual session DataWeekender 4.2

by | Nov 6, 2021 | Events

DataWeekender 4.2

This Saturday I've joined the Van and Spoke at DataWeekender

Azure Purview

I presented a session on Azure Purview Microsoft's answer to Data Governance and Data Lineage

You can find my slides below on Slideshare:

 
Some useful links:
 
 
 
 
 
 
 
 
 

 

As always, in case you have any questions, please feel free to contact me.

In case you have any questions left please feel free to ask them via the comment or Socials

Enable Pattern Rules in Azure Purview

Enable Pattern Rules in Azure Purview

by | Sep 28, 2021 | Microsoft Purview

How can I enable Pattern Rules?

​Pattern Rules

Last night I was preparing for a demo with Azure Purview. As always, I walk through all the activity hubs to see if there are any new options. This time I noticed that the Pattern Rules option was greyed out.

Azure_purview_pattern_rules

Resource Set

To enable this Pattern Rules you need to enable the option Advanced Resource Sets in the Management Activity tab.

Azure_purview_advanced_resource_set

The Resource set was already present in my Purview Account which was created before August 19th, so it was surprise for me that the pattern rules where greyed out for me.
My Demo Purview account was created after August 19th and there differences between the 2 versions and available options/features. What has changed Azure Purview after August 19th can be read in my previously written blog.

Once you have enabled this feature, the Azure Purview team recommends waiting an hour before scanning in new Data Lake data.  After scanning your Data Lake data manual or scheduled, you will see the Resource Sets.

Azure_purview_resource_set

When advanced resource sets feature is on, asset and classification insights will only update twice a day(every 12 hours).

More details on how to create Resource Set Pattern Rules, can be found here.

Costs

When you have enabled Advanced Resource Set feature you will be charged €0.18 per 1 vCore Hour(Free in preview). Billing for processing the resource set data assets is serverless and based on the duration of the processing, which can vary based on the change in partitioned files and resource set profile configured.

If you have any questions regarding the above, please let me know.

Microsoft (Azure) Purview Pricing example

Microsoft (Azure) Purview Pricing example

by | Sep 9, 2021 | Azure, Microsoft Purview

Azure Purview pricing?

Azure Purview is now Microsoft Purview as off April 2022

An updated post can be found here Updated Microsoft Purview Pricing and Applications

 

Note: Billing for Azure Purview will commence November 1, 2021.

Updated October 31st, 2021

Pricing for Elastic Data Map and Scanning for Other Sources are changed and updated in the blog below.

Since my last post on Azure Purview announcements and new functionalities  I got some questions regarding pricing. In the meantime the pricing page has been updated and I’ve created also a new Azure Purview instance in my subscription(after August 18th). Currently most of the Azure Purview components are still free until further Notice. To get more details I still recommend everyone to watch the Azure Purview event from September 28th 2021, https://azuredatagovernance.eventcore.com/

Updated September 29th, 2021

Yesterday Microsoft announced the General Availability of Azure Purview, more on the announcement can be found in the blog from Rohan Kumar

Since September 28, 2021, the price of Azure Purview has been adjusted. The main change is that the use of the Elastic Data Map will remain free until November 1, 2021. To encourage trial of the Elastic Data Map, we are providing all customers free usage of Data Map from August 16, 2021 to October 31, 2021. I’ve updated the pricing details below.

As a small recap:

Azure Purview Elastic Data Map

  Price
Capacity Unit €0.353 per 1 Capacity Unit Hour

Billing for Data Map capacity unit consumption will commence November 1, 2021.

When you have created your Azure Purview after Augusts 18th, you will see that you are currently not charged for the Data Map Units.

Azure_purview_pricing_datamap

As you can see, no charging anymore for Data Map, I’m only charged for my scanning, which I only do manually do save some costs.

Azure_purview_pricing_details

Automated Scanning & Classification

  Price
For Power BI online Free for a limited time
For SQL Server on-prem Free for a limited time
For other data sources €0.540 per 1 vCore Hour

 

Other features

  Price
Resource Set €0.18 per 1 vCore Hour

Billing for scanning duration will commence November 1, 2021.

Pricing Example

Based on the example which is published on the pricing page, I’ve done a Calculation:

Example Scenario:
Data Map can scale capacity elastically based on the request load. Request load is measured in terms of data map operations per second. As a cost control measure, a Data Map is configured by default to elastically scale up to a peak of 8 times the steady state capacity.

For dev/trial usage:

Data Map (Always on): 1 capacity unit x Price per capacity unit per hour x 730 hours per month

Scanning (Pay as you go): Total duration (in minutes) of all scans in a month / 60 min per hour x 32 vCore per scan x €0.540 per vCore per hour

Resource Set: Total duration (in hours) of processing resource set data assets in a month * Price per vCore per hour

The total cost per month for Azure Purview = cost of Data Map + cost of Scanning + cost of Resource Set

Assuming above Scenario that we only use 1 Capacity Unit and use not more then 2 GB of Metadata storage and we scan our data once a week for 2 hours.

Data Map 1 CPU x €0.353 X 730 hours = €257,69

Scanning 4 scans x 2 hours x 32 VCore x €0.540 per vCore per hour = €138,24

Resource Set 4 scans x 1 hour x €0.18 per vCore per hour €0,72

In Total €396,65including 4 scans. If you leave Azure Purview as is and no scanning you base fee will be €257,69.

Like always, in case you have questions, leave them in the comments or send me a message.

Useful links

 
 
 
 
 
Â