Power Query This option bears a great resemblance to what you might find in Power BI. The same engine that runs Power BI likely runs the Power Query plug‐in. The feature provides an interface for viewing the data from a selected dataset. You can then run through some transformation ideas and see how the data…
The Mapping tab, as shown in Figure 3.59, provides a comparison of the source data to the target data structure. FIGUER 3.59 Azure Synapse Analytics Pipeline Copy data Mapping tab You have the option to change the data order, the column name, and the data type. This is a very powerful feature that can prevent…
When you drag a Copy activity into the pipeline editor canvas, you will see the properties of that activity. Then, when you click the Source tab, you will see something similar to Figure 3.57. Notice that the value shown in the Source Dataset drop‐down box is the one you created in Exercise 3.9. FIGUER 3.57…
FIGUER 3.52 Azure Synapse Analytics data integration dataset formats FIGUER 3.53 Azure Synapse Analytics data integration dataset linked service FIGUER 3.54 Azure Synapse Analytics data integration dataset properties Nothing in this exercise should be new to you, except perhaps Azure Files. For now, the provisioning of these Azure Synapse Analytics hub components is as far…
FIGUER 3.48 Azure Synapse Analytics Data SQL database In addition to creating tables, you can also create external tables, external resources, views, stored procedures, and schemas, and implement security. All the features and capabilities of an Azure SQL database or a dedicated SQL pool are found. These kinds of database incur costs when idle; consider…
If you will be writing code or queries to manage your data analytics solution running on Azure Synapse Analytics, you should consider storing them in a repository. Source repositories like Azure DevOps and GitHub provide features like protection of losing the code, storage of change history and branching. After spending hours, days, and sometimes precious…
In Exercise 3.3 you enabled managed virtual networking during the provisioning of the Azure Synapse Analytics workspace. This feature enables you to configure outbound workspace connectivity with products, applications, and other services that exist outside of the managed virtual network. When you click the Managed Private Endpoints link, you will see some existing private endpoints….
FIGUER 3.42 Adding a workspace package in Azure Synapse Analytics FIGUER 3.43 Consuming a workspace package in Azure Synapse Analytics Configuring the workspace is a very powerful aspect of the platform. As long as your custom code runs with the default installed comments, you can run just about any computation. You are limited only by…
FIGUER 3.45 Azure Synapse Analytics configure GitHub FIGUER 3.46 Azure Synapse Analytics configure GitHub repository FIGUER 3.47 Azure Synapse Analytics configure GitHub saved You should not make public the repository where you store the Azure Synapse Analytics content, because it contains some sensitive information—for example, your Azure subscription number and the general configuration of your…
FIGUER 3.50 Azure Synapse Analytics Data connect Azure Cosmos DB You can use this feature to try out queries and discover what data you have in the container. Then use those findings to perform data transformations or gather business insights. Integration DatasetThe purpose of integration datasets is in its name. Integration datasets provide an interface…