Open in app
Home
Notifications
Lists
Stories

Write
Bob Blackburn
Bob Blackburn

Home
About

Nov 29, 2021

Add Custom Code Snippets to Azure Data Studio

If you need an intro to Data Studio and the recent addition of notebooks for SQL, Python, Powershell and more see Azure Data Studio for Data Engineers. Azure Data Studio inherits snippets from Visual Studio Code. You can also add your own snippets scripted in JSON. Yes, SSMS has snippets…

Sql Server

3 min read

Add Custom Code Snippets to Azure Data Studio
Add Custom Code Snippets to Azure Data Studio

Aug 12, 2021

Upgrade Data Factory CI/CD with YAML Pipelines and Approvals

Last time we discussed ADF Pipelines in the classic (GUI) interface here. Moving forward it is recommended to use YAML Pipelines. I have been getting a few requests on how. …

Azure Data Factory

6 min read

Upgrade Data Factory CI/CD with YAML Pipelines and Approvals
Upgrade Data Factory CI/CD with YAML Pipelines and Approvals

Published in Plumbers Of Data Science

·Jun 24, 2021

Create a Databricks Load Template with Dynamic Parameters

Moving to Azure and implementing Databricks and Delta Lake for managing your data pipelines is recommended by Microsoft for the Modern Data Warehouse Architecture. Data Factory is used to manage workflow and restart/recovery of failed tasks. Here we will look at a template for Databricks to accept a list of…

Databricks

3 min read

Create a Databricks Load Template with Dynamic Parameters
Create a Databricks Load Template with Dynamic Parameters

Published in Hitachi Solutions Braintrust

·Apr 27, 2021

Manage Database Releases With Pre- and Post-Deployment Scripts

Visual Studio protects you and your data during deployments by making sure you do not delete data by accident. Such mishaps can be caused by shortening a column, dropping a column, and similar data operations. You can disable this. …

Sql Server

4 min read

Manage Database Releases With Pre- and Post-Deployment Scripts
Manage Database Releases With Pre- and Post-Deployment Scripts

Published in Hitachi Solutions Braintrust

·Apr 19, 2021

Manage Cross-Database Development in Visual Studio

When streamlining our database development process, we first must get our databases under source control. Often, the code accesses other databases on the server. Whether it is another in-house database or a vendor database, dependencies make version control harder and deploying to multiple QA and UAT environments time-consuming. Take a…

Sql Server

5 min read

Manage Cross-Database Development in Visual Studio
Manage Cross-Database Development in Visual Studio

Published in Hitachi Solutions Braintrust

·Apr 12, 2021

Create Your First Visual Studio Database Project

Databases should be under source control and have the ability for CI/CD just like application code. Visual Studio gives you this capability. Here, we will show you how to get your databases into a Visual Studio Database Project. Download Visual Studio If you don’t have Visual Studio, download it from here. During the…

Sql Server

5 min read

Create Your First Visual Studio Database Project
Create Your First Visual Studio Database Project

Published in Hitachi Solutions Braintrust

·Apr 7, 2021

3 Steps to Run PowerShell in Azure Data Factory

Azure Data Factory has many capabilities. But no tool is the best at everything. Sometimes you have an existing script that needs to be automated or PowerShell is the best programming option for the task at hand. Currently, ADF does not have a PowerShell task. …

Azure Data Factory

4 min read

3 Steps to Run PowerShell in Azure Data Factory
3 Steps to Run PowerShell in Azure Data Factory

Published in Hitachi Solutions Braintrust

·Mar 8, 2021

3 Steps to Clean and Ingest Flat File Dates

We may have AI and holograms now, but the business world still lives on spreadsheets. So, after we ingest terabytes of data in record time, we will be told our new report will be meaningless without this spreadsheet out on the file system. Here we will review three steps to…

Databricks

3 min read

3 Steps to Clean and Ingest Flat File Dates
3 Steps to Clean and Ingest Flat File Dates

Published in Hitachi Solutions Braintrust

·Feb 6, 2021

Five Databricks Performance Tips to Save Time and Money

As we process more and more data, performance is as critical as ever. The consumers of the data want it as soon as possible. And it seems like Ben Franklin had Cloud Computing in mind with this quote: Time is Money. — Ben Franklin Let’s look at five performance tips: …

Databricks

5 min read

5 Databricks Performance Tips to Save Time and Money
5 Databricks Performance Tips to Save Time and Money

Published in Hitachi Solutions Braintrust

·Nov 2, 2020

Azure Data Factory CI/CD with GitHub and Azure Pipelines

Without source control for Azure Data Factory (ADF), you only have the option to publish your pipeline. And, it has to validate. Now with source control, we can save intermediate work, use branches, and publish when we are ready. The next step is CI/CD. Let’s look at how we can…

Data Factory

8 min read

Azure Data Factory CI/CD with GitHub and Azure Pipelines
Azure Data Factory CI/CD with GitHub and Azure Pipelines
Bob Blackburn

Bob Blackburn

Principal Azure Data Platform Engineer

Following
  • Amardeep Parmar

    Amardeep Parmar

  • Ben Rogojan

    Ben Rogojan

  • Thomas Oppong

    Thomas Oppong

  • Balamurugan Balakreshnan

    Balamurugan Balakreshnan

  • Synced

    Synced

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Knowable