Posts From Kamil Nowinski
InvalidAbfsRestOperationException in Azure Synapse notebook
Problem The first issue that developers in my team noticed was when they tried to create database with Spark: Error message: org.apache.spark.sql.AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: MetaException(meesage: Got exception: org.apache.hadoop.fs.azurebfs.contracts.exceptions.InvalidAbfsRestOperationException Status code: -1
Mounting ADLS point using Spark in Azure Synapse
Last weekend, I played a bit with Azure Synapse from a way of mounting Azure Data Lake Storage (ADLS) Gen2 in Synapse notebook within API in the Microsoft Spark Utilities
Cloud Formations – A New MVP Led Training Initiative
Hello, data friends! Let me spread a few words about the new MVP led training initiative started by my friend and fellow MVP – Paul Andrew. It’s called Cloud Formations
Discovering diagram of dependencies in Synapse Analytics and ADF pipelines
Documenting objects dependencies of ETL processes is a tough task. Regardless it is SSIS, ADF, pipelines in Azure Synapse or other systems. The reasons for understanding the current solution can
Database projects with SQL Server Data Tools (SSDT)
Last Year (2021) I released a full and comprehensive course about SSDT: developing and maintenance SQL Server database within SQL Server Data Tools in Visual Studio. Thank you to all
Last Week Reading (2022-01-02)
? Press Efficient Upserts into Data Lakes with Databricks Delta When MERGE on data lake is inefficient. Building a Data Mesh Architecture in Azure – part 1 With this post,
Last Week Reading (2021-11-28)
? Press SynapseML: A simple, multilingual, and massively parallel machine learning library Microsoft just announced the release of SynapseML (previously known as MMLSpark) SSH File Transfer Protocol (SFTP) support for
SQL Server 2022 is coming
SQL Server 2022 is still in private preview (Microsoft MVP folks have access to it), but you can now read about the new release before it is released: SQL Server
Skirmishes with automated deployment of Azure Data Factory
When it comes to Azure Data Factory deployment, I always have a few words to say. You might be aware that there are two approaches in this terms. I was
Hobby: Original Batmobile (1989) from Lego
Man does not live by work alone. Everyone needs a hobby, preferably in isolation from their daily work. There is not much to read in this post. As a teenager,
