Category Archives: Azure SQL Data WareHouse

STEP by STEP ‘Extract, Transform and Load’ Data into Azure Data warehouse with Azure Data Factory

Introduction

In this article we will learn how to use Azure Data Factory to Extract, Transform, Load (ETL) data especially for the data warehousing purposes.

If you are new to Azure Data warehouse, I would like to suggest the below prerequisites.

Prerequisites

  1. SQL Server on-premises installed
  2. Your Enterprise or Demo database available on SQL Server on-premises
  3. Let’s Move ‘On-Prem’ Data Warehouse To ‘Azure SQL Data Warehouse’ With Redgate Data Platform Studio (DPS)
  4. An Azure SQL Data Warehouse account, if you still don’t have one please create ‘Azure SQL Data warehouse here’

If you have some questions on Azure SQL Data Warehouse such as

Why Enterprises Should Now Consider ASDWH Seriously please read here

This is a real time example to schedule ETL from beginning.

Background

Most recently, I got an opportunity to migrate and schedule ETL job from ‘On-Prem’ DWH to ‘Azure SQL Data Warehouse (ASDWH)’.

Getting Started

I am sure that you already have an Azure SQL Data Warehouse (ASDWH), so please LOGIN there and go to the ASDWH

Azure SQL Data Warehouse

Under Common Task of ‘Azure Data Warehouse’, please click on ‘Load Data’ as shown below:

Azure SQL Data Warehouse

After you click the load data the below screen will open, please click Azure Data Factory:-

Azure SQL Data Warehouse

Azure SQL Data Warehouse

Click on the Create Button.

Provide the required details, please note currently 2 versions of Azure Data Factory are available

Azure SQL Data Warehouse

However, I will choose V1 – Version 1, V2 Version which is currently in preview will be used in next article as shown below :-

Azure SQL Data Warehouse

Select location nearest to geography as per your business and click Create

Azure SQL Data Warehouse

And Azure Data Factory is ready

Now we need to schedule ‘Azure Data Factory’ to update the ‘Data warehouse database’, so click ‘Copy Data’,

Azure SQL Data Warehouse

Azure SQL Data Warehouse

As you click on the Copy Data, the below screen will open:-

Azure SQL Data Warehouse

Azure SQL Data Warehouse

Please note ‘Task cadence on Task schedule’ has the following options:-

  1. Run once now
  2. Run regularly on schedule

I’m considering my ‘AzureDataFactory’ as ETL to repeat every day at 8:25 PM until end date time of ‘12/31/2099’. If you want to copy only once, similar to ‘Redgate- Data Copy’   as described here Let’s Move ‘On-Prem’ Data Warehouse To ‘Azure SQL Data Warehouse’ With Redgate Data Platform Studio (DPS)

Click next

Azure SQL Data Warehouse

As my ‘On-Prem’ data warehouse source is SQL Server, so select ‘SQL Server’ as shown above, and click next

Azure SQL Data Warehouse

Here you will be landed to the page and it will ask to Configure Integration.  Click at ‘Launch express setup on this computer’ as shown below,

Azure SQL Data Warehouse

And it will download the gateway as shown below

Azure SQL Data Warehouse

Azure SQL Data Warehouse

Azure SQL Data Warehouse

Azure SQL Data Warehouse

Azure SQL Data Warehouse

Azure SQL Data Warehouse

Azure SQL Data Warehouse

And Click Next

Azure SQL Data Warehouse

Azure SQL Data Warehouse

If no changes are required click Next. As my destination is Azure SQL Data warehouse, I will select it and click next

Azure SQL Data Warehouse

Below screen will appear

Azure SQL Data Warehouse

Below Mapping will be displayed to verify

Azure SQL Data Warehouse

Azure SQL Data Warehouse

Click Next For Final Deployment

Azure SQL Data Warehouse

And with this, you just deployed your first ETL Job- ‘Azure Data Factory’. Just to recall, this job will execute daily. You could change the frequency anytime as per business need.

Thanks again for reading the blog.

In case of any doubt or question, feel free to write message or connect by any social media, I will reply ASAP.

Until next time, keep learning….

Advertisement

Migrate Your On-Premises / Enterprise Data Warehouse Into Azure SQL Data Warehouse

DownLoad- DataWarehouseMigrationUtility

In my previous articles, ‘Introduction To Azure SQL Data Warehouse’ and ‘Azure SQL Data Warehouse – Why Enterprises Should Now Consider It Seriously’, I shared –

  1. What Azure SQL Data Warehouse is
  2. Why Azure SQL Data Warehouse is critical for the enterprise and reasons for the migration

Now, I will share how you can start migrating your data into the Azure SQL Data Warehouse once you have decided to do so. The prerequisites are mentioned below.

Prerequisite

  1. Azure Subscription
  2. Azure SQL Data Warehouse knowledge, refer to ‘Introduction To Azure SQL Data Warehouse’ and DataWarehouseMigrationUtility‘Azure SQL Data Warehouse – Why Enterprises Should Now Consider It Seriously’

Once you have decided to migrate your on-premises or existing Data Warehouse, the next thing that comes to mind is ‘What Next,’ or how to import data. Fortunately, we have a couple of options for importing the data.

  1. Data Warehouse Migration Utility (Preview) that can be downloaded from here
  2. Azure Data Factory
  3. Move the data from ADLS to Azure Blob Storage and use PolyBase to import the data.
  4. SSIS

Considering the reasons from the following scenarios

Azure SQL Data Warehouse

Now, we will discuss how to import data from Data Warehouse Migration Utility. By clicking here the download will start. You need to extract and install it.

Azure SQL Data Warehouse

Click “Next” and check ‘I Accept’.

Azure SQL Data Warehouse

It will install DataWarehouseMigrationUtility on your desktop.

Azure SQL Data Warehouse

Open DataWarehouseMigrationUtility, please note that ‘SOURCE TYPE’ has 2 options:-

  1. SQL Server
  2. Azure SQL Database

‘DESTINATION TYPE’ has ‘Azure SQL Data Warehouse’ as shown below.

Azure SQL Data Warehouse

I am choosing ‘Azure SQL Database’ for this demo.

Azure SQL Data Warehouse

Click “Connect” and look over ‘Migration Settings’ and click ‘Save’.

Azure SQL Data Warehouse

Select ‘Your Database’ database and click ‘check Database Compatibility’. In case of any compatibility issues, it will give ‘Database Compatibility Report’ in Excel sheet, like this.

Azure SQL Data Warehouse

Type of errors

  1. Code Errors – Errors in code like ‘Stored Procedures’ and ‘User Defined Functions’
  2. Object Errors – Errors in Schemas etc…

Fix the related issue and click ‘Migrated Selected’. It will show the objects/ tables needed for migration. Select all or some as per your business need

Azure SQL Data Warehouse

Round Robin – will distribute data equally in the Compute Node. I always choose this as I don’t have to explicitly distribute it. We could check Skew Status, which helps us with ‘Distributed options’.

Once you are done, click on the “Migrate Schema” as shown below.

Azure SQL Data Warehouse

And, this will create ‘Database Schema’.

Azure SQL Data Warehouse

After the Schema gets generated, click “Run Script”.

Azure SQL Data Warehouse

And you have to give your SOURCE, i.e., SQL Server credentials to connect.  It will apply the script like this.

Azure SQL Data Warehouse

Once the schema is applied successfully, the only remaining thing is to migrate the data. So, click “Migrate Data” at the extreme right of the page.

Azure SQL Data Warehouse

Click “Generate”. It will generate a BCP Package at your specified directory.

Azure SQL Data Warehouse

There are two packages that need to be run in sequence, as shown below.

  1. Run Export Package – Export Data from SQL Instance to the place where we are running it.
  2. Run Import Package – Import Data into Azure SQL Data warehouse

You have just migrated your ‘On-Premises/Enterprise Data Warehouse’ to  ‘Azure SQL Data Warehouse’ successfully.

Azure SQL Data Warehouse – Why Enterprises should consider it seriously?

Today we would further explore some of the reasons why enterprise should choose Azure SQL Data Warehouse. If you want to understand the nitty gritty of the Azure Data Warehouse, please go through the ‘Introduction to Azure SQL Data Warehouse’

 

Platform as a Service (PaaS) Offering 

Data Warehouse is offered as a platform as a service in Microsoft’s Azure cloud infrastructure. The service is fully managed, which means you don’t have to pay for hardware or don’t need to spend time on software updates or bother about security.

The users need to pay only for what they need and when they need it.

Built on the SQL Server 

The SQL Data Warehouse extends the T-SQL constructs to create indexes, partitions and stored procedures, which allows to easily migrate to the cloud.  Azure SQL Data Warehouse have complete support and compatibility with SQL tools and offerings.

Elasticity

Azure SQL Data Warehouse is highly ELASTIC in nature. Azure SQL Data Warehouse independently scales compute and storage so customers only pay for the query performance.

You only need to pay for compute power what you used. Scale it up for large queries and scale it back when your production demand is less. If you ‘Pause the service’, you only pay for the storage.

SQL Transparent Data Encryption (TDE) with Bring Your Own Key support

Transparent Data Encryption (TDE) with Bring Your Own Key (BYOK) support for Azure SQL Database and Azure SQL Data Warehouse is under preview. Now you can have control of the keys used for encryption at rest with TDE by storing these master keys in Azure Key Vault.

Polybase

Nowadays, essentially the need to combine structured and unstructured data is quite common. With PolyBase, SQL Data Warehouse offers the ability to combine data sets easily.

In addition, SQL Data Warehouse can query unstructured and semi-structured data stored in Azure Storage or Cloudera using familiar T-SQL skills making it easy to combine data sets no matter where it is stored.

Azure Data Warehouse supports Massively Parallel Processing

Another reason for Azure is its support for Massively Parallel Processing (MPP ) nature.

MPP means one to many relationship. Say if 80% servers got down then also request could be fulfilled.  MPP doesn’t depends on the single machine/limited hardware resources.

Hybrid infra supports

With SQL Data Warehouse you are able to quickly move to the cloud without having to move all of your infrastructure along with it. With the Analytics Platform System, Microsoft Azure and Azure SQL Data Warehouse, you can have the data warehouse solution you need on-premises, in the cloud or a hybrid solution. Microsoft has built-in support for a number of their other tools and data services.

Built-in Backups

Azure SQL Data Warehouse automatically backs up your data by taking database snapshots and creating restore points. You could also do a self-service restore from these backup

Support for Azure Machine Learning

Azure SQL Data Warehouse is supported as both a source and destination for Azure ML Models.

Azure Stream Analytics

Azure Stream Analytics provides real-time, stream processing in the cloud. With ASA, you can query and analyze stream-based data while it is moving. Azure SQL Data Warehouse can be the output destination for Azure Stream Analytics.

 

Why Choose Cloud Over On-Premise Traditional Warehousing?

Some of the reasons:-

  • We do not need large capital expenses to get started with Azure Data Warehouse. We don’t need to procure servers, worry about server configuration, security compliances and also it save a lot of approvals.
  • In another means we do not need staff to maintain hardware, virtualization and operating system.
  • We can scale storage or performance and compute it up or down ‘ON DEMAND’*, while same thing is very cumbersome in the traditional ware house system.
  • Cloud has very High Uptime (99.9%)

 

Hope aforesaid reasons would help you to make your mind for Azure SQL Data Warehouse.

Till next time, ‘Happy Learning’!!

Use Azure IaaS As A Starting Point On Your Cloud Journey

In this article , we will discuss how to leverage business with Azure IaaS (Infrastructure as a Service). We will take a comparative look between Traditional Model vs. Cloud Model.

If you have quesitons about the clous Cloud , please look over the following:

I am sure by the end of this article, we will have a sound rationale for using Cloud Services

Azure

As shown above , in the Traditional on-premise Service Model we have to take care of the Application, Data, Runtime, Server, Storage etc.

But we could use either IaaS, PaaS or SaaS based on individual and business usage

Pay per use

Azure

For Platform as a Service (PaaS), we can benefit from one or all of the Security & Management, Platform Services or Infrastructure Services.

Worldwide Azure Regions Availability

Azure

As of today, there are a total of 34 Azure regions to give support 24/7 to customers in almost every continent.

Geo Redundancy

Azure

Highly promising Geo replications options are available across the globe for Disaster Recovery.

Security

It would not be wrong to say that the data is highly secure in the Cloud, owing to the Security mechanisms at the levels of:

  1. Physical
  2. Infra
  3. Network and
  4. VM

It is shown below.

Azure

Azure Security Center

For details, please refer to this related article:

Azure Security – Solution To Digital Transformation

Azure security center is available to keep an eye out every time for Cloud Resources, as shown below.

Azure

Now, let’s dive deep down into IaaS Core Services.

It’s a combination of the following

  1. Compute
  2. Storage
  3. Networking and
  4. ManagementAzure

Options for the Compute Families

Azure

Azure Storage,

For more details, please refer to my Azure Storage series from 1 to 7,

Azure NoSQL DocumentDB

Azure DocumentDB is a NoSQL document database-as-a-Service from Microsoft Azure is designed for saving, retrieving and managing each record in an internal structure of fields (semi-structured data, documents or keys). DocumentDB is a schema free JSON document database and also support JavaScript. DocumentDB includes built-in high availability, offers predictable performance and supports elastic scale-out. DocumentDB has some exciting features.

  • Tunable, high performance.
  • Multi document transactions.
  • Query over schema free JSON.
  • Automatic Indexing.
  • Easy to learn query grammar.
  • Low-latency access around the globe.
  • Rich SQL queries over schema-free JSON storage.
  • Server side execution of the Application defined JavaScript as stored procedures and triggers.
  • JavaScript language integration for multi-document transactions.
  • Tunable consistency levels for optimal Application performance.
  • Standard JSON storage with RESTful HTTP interfaces.

    Azure

Let’s understand it by performing something practical on the portal. Enter your credentials and login to Azure portal. Go to New, select Storage and click See All because it seems there is no DocumentDB in Featured Apps.

Azure

Select NoSQL and click it. Here, I need to create Document Account.

Azure

Give a name to your account and select API for it. There are two options for selecting API DocumentDB and MongoDB. I’ll discuss MongoDB in my further articles. All steps are same and are related to the previous articles. Click to create DocumentDB Account.

Azure

Under DocumentDB account, I have to create a Collection. It is a logical container for the physical partitions. A collection is like a container for JSON documents and JavaScript Application logic. Click Add Collection to add a new one.

Azure

For a collection, give a name to your collection and its storage capacity to handle collection is up to 10 TB and set a storage capacity for it. Now, there is a Partition key, which is a JSON property within your documents. Partition key is an element within your document. Give a database name to it and click OK button to create a Collection.

Azure

Thus, my collection is ready now.

Azure

Go to Document Explorer, where we can create and upload our documents under our Collection.

Azure

Click Create and you will see a JSON format script with ID and People (partion). You can upload JSON script as well. I’ve given an Id and some data in People Partition. Click Save to save this script.

Azure

Now, go to Query Explorer and run a query.

Azure

The query will be executed successfully and produces the expected result.

Azure

Creating And Using Azure SQL Server And Azure SQL Database

I am going to explain SQL Server and SQL database in Microsoft Azure portal. You can create a database and Server from Azure portal and access it in Visual Studio. Afterwards, you can use it as Entity Framework Designer from the database in any Application.

Let’s login to Azure new portal and create a SQL database.

SQL Server

For creating a database on Azure portal, you have to fill in some details of it. Give a name to your database, subscription name, resource group whatever you want to use, blank database and a Server.

Click Servers, if you want to use an existing SQL Server from the list of the available Servers into your Azure, then you can select it (you must know name and password of the Server). Here, I am going to create a new one.

SQL Server

To create a new Server, follow the steps given below.

  • Server Name – Give a name to your Server.
  • Server Admin Login – Enter user name but make sure that your login name meets the requirements, given below – it’s a SQL identifier and not a typical system name such as an admin, administrator, sa, root, dbmanager, loginmanager etc.
  • Password- Create a password for your Server, which would be used when you connect with it from MS SQL Server Management.
  • Confirm Password – The password should match with the password.
  • Location- Your Server location.

Click to select button to create a new Server.

SQL Server

Just click to create button to create a Server and database.

SQL Server

I want to add it with Microsoft SQL Server. To generate a client IP, click Add Client IP in Firewall Setting.

SQL Server

Here, I am using Visual Studio 2015. My Azure subscription is already connected with Visual Studio Server Explorer. Open SQL Databases under your Azure subscription. You’ll get your database, which you created on Azure portal. I want to open it in Microsoft SQL Server Explorer where we can create the scripts.

SQL Server

In next popup, give a Server name into Server name section, which you created in Azure portal along with the user name and password.

SQL Server

After clicking Connect button, you connect with Explorer. Now, you can create tables.

SQL Server

Add a new table.

SQL Server

After writing table script in to design section, click Update button.

SQL Server

Click Update database to update whole database.

SQL Server

Refresh the table and you will get the expected result.

SQL Server

If you want to connect with it again, then you have to enter only Server password.

SQL Server

Now, you can connect with ADO.NET Entity Data model. Also, you can use an Entity Framework approach.

Fundamentals Of Microsoft Azure Mobile Service

Fundamentals Of Microsoft Azure Mobile Service

Azure

Microsoft Azure Mobile Service gives us the authority to create a Cloud Service Mobile Application. This will leverage us with more flexibility and make an Application more portable.

This is a short introduction of Azure Mobile Service. Now, let’s create and integrate new mobile Service with new or an existing Application. Thus, let’s understand Azure Mobile Service and I am sure, it would mesmerize the users.

Let’s create a new mobile Service

First go to your Azure portal and select the Mobile Service option. Click plus new icon in the bottom of the page.

Azure

Create a new Mobile Service.

After creating Mobile Service, open the Mobile Service and select the dropdown option “CONNECT AN EXISTING WINDOWS OR WINDOWS PHONE APP” below the Get Started option.

Azure

Now, copy the code and paste it in the App.xaml.cs file of your Application. Please focus on the additional instruction, which is right above the code.

Now, create a new class named MyItems, which will make all the necessary tables of your Mobile Service.

  1. class MyItems
  2. {
  3.     [JsonProperty(PropertyName = “id”)]
  4.     public string Id { get; set; }
  5.     [JsonProperty(PropertyName = “message”)]
  6.     public string Message { get; set; }
  7.     [JsonProperty(PropertyName = “location”)]
  8.     public string Location { get; set; }
  9.     [JsonProperty(PropertyName = “Date”)]
  10.     public DateTime Date { get; set; }
  11. }

I have created four attributes namely fieldsID, Message, Location and Date. Please remember for JsonProperty attribute, which we have to install ‘Newtonsoft.JsonNuGet package manager’.

Now, to perform any CRUD operation like insert, update and delete the data in your SQL table, let’s write the code in .cs files.

To begin with, let’s create MainPage.xaml. We need a ListBox to display the data from out Mobile Service table. As there are multiple attributes and columns, here we re showing only Message, Location and Date values.

  1. <ScrollViewer>
  2.     <StackPanel Margin=“10,10,0,0”>
  3.         <ListBox x:Name=“listBox”
  4.                         Margin=“10,10”
  5.                         RequestedTheme=“Dark”
  6.                         FontSize=“20”
  7.                         Background=“White”
  8.                         Foreground=“Black” BorderThickness=“1”
  9.                         BorderBrush=“Transparent” >
  10.             <ListBox.ItemContainerStyle>
  11.                 <Style TargetType=“ListBoxItem”>
  12.                     <Setter Property=“HorizontalContentAlignment” Value=“Stretch”></Setter>
  13.                 </Style>
  14.             </ListBox.ItemContainerStyle>
  15.             <ListBox.ItemTemplate>
  16.                 <DataTemplate>
  17.                     <Border BorderThickness=“0,0,0,1” BorderBrush=“#c0c0c0”>
  18.                         <StackPanel>
  19.                             <TextBlock Foreground=“Black” Text=“{Binding Message}” />
  20.                             <TextBlock Foreground=“Black” Text=“{Binding Location}” />
  21.                             <TextBlock Foreground=“Black” Text=“{Binding Date}” />
  22.                         </StackPanel>
  23.                     </Border>
  24.                 </DataTemplate>
  25.             </ListBox.ItemTemplate>
  26.         </ListBox>
  27.     </StackPanel>
  28. </ScrollViewer>

Listing: 2

Put the code given below in MainPage.cs, which is above the constructor.

  1. /// <summary>
  2. /// Mobile Service
  3. /// </summary>
  4. private MobileServiceCollection<Item, Item> Myitems;
  5. private IMobileServiceTable<Item> itemTable = App.MobileService.GetTable<Item>();

Listing: 3

Now, in constructor; initialize MainPage_Loaded method and implement, as shown below.

  1. public MainPage()
  2. {
  3.     this.InitializeComponent();
  4.     this.Loaded += MainPage_Loaded;
  5. }
  6. async void MainPage_Loaded(object sender, RoutedEventArgs e)
  7. {
  8.     Myitems = await itemTable.ToCollectionAsync();
  9.     this.listBox.ItemsSource = Myitems;
  10. }

Listing: 4

Here, listbox is the name of out ListBox control. Thus, we set an item source as Myitems, which sets Mobile Service table’s values.

If you run the Application, it will show all the data in the ListBox control.

Conclusion

I hope, you understood the basics of Microsoft Windows Azure Mobile Service. Till next time, keep learning.

Azure App Service – API Apps

Microsoft Azure app Service API apps offers secure and flexible development, easy deployment including continous delivery, accessing On-Permises data, Web jobs for background processing, high availability and scaling options for any sized RESTful API Applications. Use frameworks and templates to create RESTful APIs in seconds. Azure API apps are well known for automatic OS patching. You can use any tool or an opearting system to develop your RESTful API with .NET, Java, Node.js, PHP or Python.

  • Fastest and easy way to build productivity developement.
  • Provision and deploy fast and consume API.
  • Simple develop, host access control and authentication.
  • Secure platform, which scales automatically with hybrid connectivity.
  • New Developement experience with API features.
  • API definition for the Website host.
  • Swagger metadata, which is integrated with API app.
  • Easy connectivity with all apps.

    Azure

Source – https://docs.microsoft.com/en-us/azure/app-service-api/app-service-api-apps-why-best-platform

Create a Azure API app Service from Azure portal,;login to your credentials and go to New and select Web+Mobile. In featured apps , you may get API app. If it is not there, then click See all options.

Azure

Type API app and select it from the given list.

Azure

Click Create button to create a new API app.

Azure

Give a name to your API app, your default subscription will be selected by default and I have selected an existing resource group for my app.

App Service Plan/Location is your physical resource, where you host your apps. API app associates with one app Service Plan/Location. You can create a new plan for your app by clicking it.

Azure

You have to choose one pricing tier P1 Premium or S1 Standard or B1 basic for your app.

Azure

Application insights contain tools, which can be used to manage your app behavior. After filling all the necessary details, click Create button to create an API app.

Azure

When your app will create under your selected resource group, a notification appears.

Azure

Whenever your app is created, then you can manage your app such as Deployment settings, Settings, app Service plan, deployment tools, API, Monitoring and some common setting related to the app.

Azure

You can manage and see your app by clicking Overview, where would all the details be, which are available for your app.

Azure

Host your app Service to the existing app on Azure

I’m going to create an Azure API app from Visual Studio 2015 and I will publish it to our existing API app. Thus, let’s create a new solution and give it a name.

Azure

Select Azure API app template from the templates.

Azure

Create a model class by right clicking on Models folder in the solution.

Azure

In the class, I have created three properties.

  1. namespace AzureApiApp.Models
  2. {
  3.     public class Cricketer
  4.     {
  5.         public int Rank { get; set; }
  6.         public string Name { get; set; }
  7.         public string BatingStyle { get; set; }
  8.     }
  9. }}

Let’s add a Web API2 Controller class by right clicking on Controllers folder.

Azure

Give a name to your Controller class.

Azure

Write the code given below into your Controller class, where I’ve returned a list of cricketers.

  1. using AzureApiApp.Models;
  2. using System.Collections.Generic;
  3. using System.Web.Http;
  4. namespace AzureApiApp.Controllers
  5. {
  6.     public class CricketersController : ApiController
  7.     {
  8.         [HttpGet]
  9.         public IEnumerable<Cricketer> Get()
  10.         {
  11.             return new List<Cricketer>()
  12.             {
  13.                 new Cricketer() {
  14.                         Rank = 1, Name = “A.B r DeVilliers “, BatingStyle=“Right Hand Batsman”
  15.                     },
  16.                     new Cricketer() {
  17.                         Rank = 2, Name = “Virat Kohali”, BatingStyle=“Right Hand Batsman”
  18.                     },
  19.                     new Cricketer() {
  20.                         Rank = 3, Name = “David Warner”, BatingStyle=“Left Hand Batsman”
  21.                     },
  22.                     new Cricketer() {
  23.                         Rank = 4, Name = “Martin Gupti”, BatingStyle=“Right Hand Batsman”
  24.                     }
  25.             };
  26.         }
  27.     }
  28. }

Now, it’s time to publish our app to Azure. Right click on the solution and select Publish option.

Azure

Select a target to publish your app and click ext.

Azure

Enter your credentials and you’ll get your Azure Subscription along with the list of Resource Group. If you remember, where I have created an API app in the Default-Web-EastAsia. Expand and select app.

Azure

After clicking OK button, a connection will be created. Click Next button.

Azure

I don’t have any database for this app. Continue clicking on to next.

Azure

Finally, click Publish to publish your app on Azure.

Azure

It can take some time to publish it.

Azure

After a successful attempt, your app Service will be created.

Azure

Your app has been published now you can check your Service data by calling your controller in the Browser.

Azure

In this article, we learned about how can we create an Azure API app and publish it on Azure.

Azure Security – Solution To Digital Transformation

Nowadays, we are moving more and more towards digital transformation, like banking, automobiles, and  other sensitive information. Digital transformation has changed the business world totally and digital transformation is not just about end users in a particular organization or region. The technologies and processes driving digital transformation can help transform IT and also drive business rapidly.

Azure

Why security is important?

For most of us, the recent Zero Day vulnerabilities in iOS are probably still fresh.

Let’s think about what could happen. By clicking a link, we would get a text/message, our device could be jailbroken, and then it would ne completely owned by an attacker with access to literally everything stored and accessed with that device.

This is an incredible reminder of the importance of securing and protecting our people and data.

Given are the examples of most recent security breaches.

Azure

So, we could say that Cyber Security is the number one priority.

Azure

So, not coincidentally, this escalating threat comes at the same time when the surface area you have to protect is also rapidly expanding. This expansion is driven by the always growing number of mobile devices in your network, and these devices are constantly taking your data well beyond the confines of your data center. There is also the growing number of SaaS applications your organization needs or that your employees are already using.

Your operations are most likely run from a different set of datacenters, public and private. For decades, we all have relied on the perimeters of our organizations to act as one of the primary lines of defense from attacks but as our data regularly moves outside of these perimeters to the cloud and cloud-based apps, these boundaries are no longer effective deterrents.

Azure

Azure

  • Do you know which user accounts have been compromised and are being used to access your company or customer information?
  • Can you guarantee that only your employees are accessing corporate resources?
  • Do you know what SaaS apps your employees are using and protect the company data in those apps?
  • Are you confident that corporate data being accessed and stored on mobile devices is secure?
  • Do you know what sensitive/confidential data is being shared with partners?
  • Do you want to know if sensitive/confidential data is assessable without requiring authentication and validation?

So, we could say that after any security threat, these are action items needed to be performed.

  1. Protect
  2. Detect
  3. Respond

    Azure

Azure Active Directory is a comprehensive identity and Access Management cloud solution that provides a robust set of capabilities to manage users and groups. It helps secure access to on-premises and cloud applications, including Microsoft Online services like Office 365 and many non-Microsoft SaaS applications.

How reliable is Azure AD?

The multi-tenant, geo-distributed, high availability design of Azure AD means that you can rely on it for your most critical business needs. Running out of 28 data centers around the world with automated failover, you’ll have the comfort of knowing that Azure AD is highly reliable and that even if a data center goes down, copies of your directory data are live in at least two more regionally dispersed data centers and available for instant access.

Azure

Control and help secure email, documents, and sensitive data that you share outside your company walls. From easy classification to embedded labels and permissions, enhance data protection at all times with Azure Information Protection—no matter where it’s stored or who it’s shared with.

Azure

What is Azure Security Center?

Security Center helps you prevent, detect, and respond to threats with increased visibility into and control over the security of your Azure resources. It provides integrated security monitoring and policy management across your Azure subscriptions, helps detect threats that might otherwise go unnoticed, and works with a broad ecosystem of security solutions.

Key capabilities

Security Center delivers easy-to-use and effective threat prevention, detection, and response capabilities that are built in to Azure. Key capabilities are:

Stage Capability
Prevent Monitors the security state of your Azure resources
Prevent Defines policies for your Azure subscriptions and resource groups based on your company’s security requirements, the types of applications that you use, and the sensitivity of your data
Prevent Uses policy-driven security recommendations to guide service owners through the process of implementing needed controls
Prevent Rapidly deploys security services and appliances from Microsoft and partners
Detect Automatically collects and analyzes security data from your Azure resources, the network, and partner solutions like antimalware programs and firewalls
Detect Leverages global threat intelligence from Microsoft products and services, the Microsoft Digital Crimes Unit (DCU), the Microsoft Security Response Center (MSRC), and external feeds
Detect Applies advanced analytics, including machine learning and behavioral analysis
Respond Provides prioritized security incidents/alerts
Respond Offers insights into the source of the attack and impacted resources
Respond Suggests ways to stop the current attack and help prevent future attacks

I hope this article has increased your understanding about digital transformation. Until next time, keep learning!!

Overview Of Microsoft Azure Storage – Part Seven

This article is based on the Storage tool of Microsoft Azure. In previous articles of the series, we learned all about storage in Microsoft Azure. The Azure Storage tool is one kind of place where you can manage all your Microsoft Azure Storage in a new fashion. You can manage all your storage, even blobs, or files, or tables, or queues in a very fast and easily manner as such as your files. You can directly copy, paste and delete files within the Azure Storage Explorer.

You can download Azure Explorer from this Link or this Link.

Azure

Open the setup of Azure Explorer, and accept the agreement before installation of it.

Azure

The setup will take a default folder in to your system.

Azure

Click on to Next to finish the setup.

Azure

The Azure Storage Explorer has successfully installed, open it and you’ll find that you are connected with your default subscription. You need one storage account on Azure Portal to connect with it. So just go to Azure Portal and create a storage account.

Azure

Now right click on to storage account to add an account from portal.

Azure

A Storage Account has its name and primary and secondary key which is used for accessing a storage account from outside the portal. I’m going to use a storage account name and key to connect with Storage account.

Azure

Here you need to copy your Storage Account name and Account Key from the Azure portal.

Azure

You can get your name and key from the Azure Portal by clicking on to Access keys.

Azure

The keys really help in to connect with outside of the portal where you want to access storage account.

Azure

Copy your Storage Account name and Keys from here and paste it on Azure Storage Explorer.

Azure

After clicking on the next button, you’ll be connected with your Storage Account, now you can perform all operations in one place.

Azure

In fthe ollowing screenshot you can see your storage account is connected with Azure Explorer.

Azure

Under Blob Container, I have a Container which is a set of blobs. Under Container I have three files. Right click on to any file where you can see the properties of any file.

Azure

Notice

If you want to access blobs to the browser or you want to download, you have to change permission of the container  make either the blob or container not private.

Azure

If you’re going to download any file then the file will be saved in Temp folder.

Azure

Copy the path of any file and paste it on directly browser’s url. You will get your expected result on the browser.

Azure

You can access other storages by the Azure Storage Explorer as well.

I hope you enjoyed this series. Thank you