Set up connection from Azure Data Factory to Databricks
Both, Azure Data Factory and Azure Databricks offer transformations at scale when it comes to ELT processing. On top of that, ADF allows you to orchestrate the whole solution in an easy way. In a case, when you prefer to use Scala, Python or SQL code in your process, rather than Mapping Data Flow in ADF – you must link ADF to Databricks. I will show you how to do that in two ways.
In this short video, I will present two methods and their differences, and as always the demo:
DEMO 1: Connect via PAT (Personal Access Token)
DEMO 2: Connect via MSI (Managed Identity Authentication)
About author
You might also like
ASF 021 video invitation (Star Wars Theme)
Since now, we will not keep our guests in secret. We want you to be prepared and wait if you’re interested in. First time 2 vs 2 in #AskSQLFamily podcast.
ASF 015 video invitation
“This was in Dallas, we had our MVP Summit in Dallas and there were only maybe like less than 10 SQL Server MVPs.” Do you want to know who has
Two methods of deployment Azure Data Factory
Azure Data Factory is a fantastic tool which allows you to orchestrate ETL/ELT processes at scale. This post is NOT about what Azure Data Factory is, neither how to use,
0 Comments
No Comments Yet!
You can be first to comment this post!