Set up connection from Azure Data Factory to Databricks

Set up connection from Azure Data Factory to Databricks

Both, Azure Data Factory and Azure Databricks offer transformations at scale when it comes to ELT processing. On top of that, ADF allows you to orchestrate the whole solution in an easy way. In a case, when you prefer to use Scala, Python or SQL code in your process, rather than Mapping Data Flow in ADF – you must link ADF to Databricks. I will show you how to do that in two ways.

In this short video, I will present two methods and their differences, and as always the demo:
DEMO 1: Connect via PAT (Personal Access Token)
DEMO 2: Connect via MSI (Managed Identity Authentication)

 

 

Previous Two methods of deployment Azure Data Factory
Next Canvas Apps Components

About author

Kamil Nowinski
Kamil Nowinski 181 posts

Blogger, speaker. Data Platform MVP, MCSE. Senior Data Engineer & data geek. Member of Data Community Poland, co-organizer of SQLDay, Happy husband & father.

View all posts by this author →

You might also like

ASF 017 video invitation

What wasn’t really designed for people of guest’s stature? From who his every good decision does come from? New podcast episode is coming (next Friday) and in the meantime you

Last Week Reading 0 Comments

Last week reading (2018-09-30)

Entire last week was dimmed by MsIgnite, hence take a look at videos from that conference: Microsoft Ignite 2018 Some sessions recorded and available over there. CosmosDB at Ignite 2018

ASF 023 video invitation

I’m happy to announce that the next episode of “Ask SQL Family” podcast is coming. This time our guest is Amit Bansal. We were talking to him during this year’s

0 Comments

No Comments Yet!

You can be first to comment this post!

Leave a Reply