Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

How to deploy a data lake in an Azure Virtual Network ?

  1. Create a VNet

  2. Create a ADLS Gen2 Account

  3. Add Storage Account to the VNet

...

  1. Create Private Endpoints : Select the virtual network and subnet → this ensures that the storage account is accessible only within the VNet.

...

  1. Configure access : Make sure the VNet has the permissions to access the data lake.

How to ensure that our VNet has the necessary permissions to access the storage account or data lake ?

  1. NSG : Create and configure NSG to control inbound amd outbound traffic to the VNet → And add rules to allow traffic from the VNet to the storage account (typically, on ports 443 and 80)

...

  1. Private Endpoints : Create private endpoint for our storage account

  2. RBAC : Assign appropriate roles to users and services that need access to the storage account

...

  1. Firewall and VNet Settings : Add the VNet to the storage account

...