Data Engineering on Microsoft Azure Test 11

Which integration runtime is required for Azure Data Factory to ingest data from the on-premises server?

Select 1 option(s):

Which feature of Spark causes these transformation to be analyzed?

Select 1 option(s):

Which is best described by:
“Focuses on culture highlighting roles that emphasize.”

Select 1 option(s):

Which of the following is best described by:
“An open-source memory optimized system for managing big data workloads, which is used when you want a spark engine for big data processing or data science where you don’t mind that there is no SLA provided. Usually it is of interest to Open Source Professionals and the reason for this product is to overcome the limitations known as SMP systems for big data workloads.”

Select 1 option(s):

Select 1 option(s):

Select 1 option(s):

Select 1 option(s):

Which type of security would typically be best used in for this scenario?

Select 1 option(s):

Select 1 option(s):

You can monitor Azure Stream Analytics jobs by using which of the following? (Select all that apply)

Select 4 option(s):

Select 1 option(s):

Which are Azure Storage supported languages and frameworks? (Select all that apply)

Select 6 option(s):

Which Azure service is the best choice to do this?

Select 1 option(s):

Data classification: Semi-structured because of the need to extend or modify the schema for new products
Operations:
• Customers require a high number of read operations, with the ability to query many fields within the database.
• The business requires a high number of write operations to track its constantly changing inventory.
Latency & throughput: High throughput and low latency.
Transactional support: Because all of the data is both historical and yet changing, transactional support is required.
Which would be the best Azure service to select?

Select 1 option(s):

Which of the following are deployed along with Azure Synapse Analytics? (Select all that apply)

Select 2 option(s):

A junior team member comes to you and asks “Where can I find the Copy Data activity ?”
Which of the below is the correct location?

Select 1 option(s):

The company has 10,000 employees. Most employees are located in Europe. The company supports teams worldwide.
AIM has two main locations: a main office in London, England, and a manufacturing plant in Berlin, Germany.
During events, 100 engineers set up a remote portable office by using a VPN to connect the datacentre in the London office. The portable office is set up and torn down in approximately 20 different countries each year.
AIM runs Microsoft SQL Server in an on-premises virtual machine (VM).
Required:
• Migration of the database to Azure SQL Database
• Synchronize users from Active Directory to Azure Active Directory (Azure AD)
• Configure Azure SQL Database to use an Azure AD user as administrator
Which of the following should be configured?

Select 1 option(s):

The IT team is working on a project to implement a lambda architecture on Microsoft Azure using an open-source big data solution for the purpose of aggregating, processing and maintaining data. During testing it is noted that the analytical data store is performing below expectations and management has come to you with the following requirement specifications.
Requirements:
• The solution must provide data warehousing
• The solution must reduce ongoing management activities
• The solution must deliver SQL query responses under one second
• The solution must create an HDInsight cluster to which fulfills all the listed requirements
As the expert consultant, the IT team is looking to you for direction. Which type of cluster should you advise them to create?

Select 1 option(s):

Azure Synapse Analytics can work by acting as the one stop shop to meet all of your analytical needs in an integrated environment if you do not have an analytical environment in place already.
[?] is a single web UI that allows you to:
• Explore your data estate.
• Develop TSQL scripts and notebooks to interact with the analytical engines.
• Build data integration pipelines for managing data movement.
• Monitor the workloads within the service.
• Manage the components of the service.

Select 1 option(s):

[?] for Storage provides an extra layer of security intelligence that detects unusual and potentially harmful attempts to access or exploit storage accounts. This layer of protection allows you to address threats without being a security expert or managing security monitoring systems.
Security alerts are triggered when anomalies in activity occur. These security alerts are integrated with Azure Security Centre, and are also sent via email to subscription administrators, with details of suspicious activity and recommendations on how to investigate and remediate threats.

Select 1 option(s):

Which of the below is the name of this service?

Select 1 option(s):

Select 1 option(s):

Which would be the best Azure product to use?

Select 1 option(s):

• Data movement activities
• Data transformation activities
• Control activities
Pipelines in Data Factory are defined in JSON format as follows:
JSON
{
“name”: “PipelineName”,
“properties”:
{
“description”: “pipeline description”,
“activities”:
[
],
“parameters”: {
}
}
}
Which of the JSON properties are required? (Select all that apply)

Select 2 option(s):

True or False: Notebook cells are individual blocks of code or text that runs as a group. If you want to skip cells within the group, a simple skip notation in the cell is all that is required.

Select 1 option(s):

Select 2 option(s):

True or False: Multiple users and client programs can perform operations on underlying database objects through a procedure, even if the users and programs do not have direct permissions on those underlying objects.

Select 1 option(s):

• Too many small or very big files – more time opening & closing files rather than reading contents (worse with streaming).
• Partitioning also known as “poor man’s indexing”- breaks down if you picked the wrong fields or when data has many dimensions, high cardinality columns.
• No caching – cloud storage throughput is low (cloud object storage is 20-50MB/s/core vs 300MB/s/core for local SSDs).
As a solution to the challenges with Data Lakes noted above, Delta Lake is a file format that can help you build a data lake comprised of one or many tables in Delta Lake format. Delta Lake integrates tightly with Apache Spark, and uses an open format that is based on Parquet.
Two of the core features of Delta Lake are performing UPSERTS and Time Travel operations.
What does the Time Travel operation do? (Select all that apply)

Select 4 option(s):

When could SQL Auth be used for this connection?

Select 1 option(s):

What is the best action to take?

Select 1 option(s):

These methods are:
• Mapping Data Flows
• Compute Resources
• SSIS Packages
Mapping Data Flows provides a number of different transformations types that enable you to modify data. They are broken down into the following categories:
• Schema modifier transformations
• Row modifier transformations
• Multiple inputs/outputs transformations
Which of the following are valid transformations available in the Mapping Data Flow? (Select all that apply)

Select 6 option(s):

Bruce has come to you because his IT team needs advice on the configuration and synchronization of data between an on-premises Microsoft SQL Server database to Azure SQL Database.
Recently, ad-hoc and reporting queries are being overutilized on the on-premises production instance and your expert advise is required on the following points.
Requirements:
• Execute an initial data synchronization to Azure SQL Database (minimize downtime)
• Execute bi-directional data synchronization after initial synchronization
A synchronization solution must be created and implemented and Bruce and the team look to you as the Azure expert. Which synchronization method should you advise the team to use?

Select 1 option(s):

Which of the following are Azure Storage configuration options? (Select all that apply)

Select 4 option(s):

• Data Protection
• IAM/Auth
• Network
• Compliance
Which of the following comprise Data Protection within Azure Databricks security? (Select five)

Select 5 option(s):

SQL and Spark can directly explore and analyze which types of files stored in the data lake? (Select all that apply)

Select 4 option(s):

Select 1 option(s):

Select 1 option(s):

Select 1 option(s):

In Azure Data Factory, a(n) [?] is a logical grouping of activities that together perform a task.

Select 1 option(s):

A(n) [?] is an orchestration of pipeline activities that includes chaining activities in a sequence, branching, defining parameters at the pipeline level, and passing arguments while invoking the pipeline on demand or from a trigger.

Select 1 option(s):

When working with large data sets, it can take a long time to run the sort of queries that clients need. These queries can’t be performed in real time, and often require algorithms such as MapReduce that operate in parallel across the entire data set. The results are then stored separately from the raw data and used for querying.
One drawback to this approach is that it introduces latency. If processing takes a few hours, a query may return results that are several hours old. Ideally, you would like to get some results in real time (perhaps with some loss of accuracy), and combine these results with the results from the batch analytics.
The Lambda architecture is a big data processing architecture that addresses this problem by combining both batch- and real-time processing methods. It features an append-only immutable data source that serves as system of record. Timestamped events are appended to existing events (nothing is overwritten). Data is implicitly ordered by time of arrival.
The [?] is a vast improvement upon the traditional Lambda architecture. At each stage, we enrich our data through a unified pipeline that allows us to combine batch and streaming workflows through a shared filestore with ACID-compliant transactions.

Select 1 option(s):

• The first reference is the logical Azure Databricks environment in which clusters are created, data is stored (via DBFS), and in which the server resources are housed.
• The second reference is the more common one used within the context of Azure Databricks.
The first step to using Azure Databricks is to create and deploy a Databricks workspace, which is the logical environment. You can do this in the Azure portal.
There are a number of required values to create your Azure Databricks workspace.
Which are they? (Select five)

Select 5 option(s):

[?] provides one-click setup, streamlined workflows, an interactive workspace for Spark-based applications plus it adds capabilities to Apache Spark, including fully managed Spark clusters and an interactive workspace.

Select 1 option(s):

Microsoft Azure Storage is a managed service that provides durable, secure, and scalable storage in the cloud. Azure Files enables you to set up highly available network file shares that can be accessed using the standard Server Message Block (SMB) protocol. This means that multiple VMs can share the same files with both read and write access. You can read the files using the REST interface or the storage client libraries. You can also associate a unique URL to any file to allow fine-grained access to a private file for a set period of time.
Which are common scenarios where File shares can be used? (Select all that apply)

Select 3 option(s):

The database behind the scenes is an ACID-compliant transactional database.
What would be the result?

Select 1 option(s):

True or False: You can access data in the primary storage account directly. There’s no need to provide the secret keys.

Select 1 option(s):

Which are among the file formats supported? (Select six)

Select 6 option(s):

Why is the option not available?

Select 1 option(s):

Select 1 option(s):

Select 1 option(s):

While Jungle.com is happy with the capabilities and performance of Azure Cosmos DB, they are concerned about the cost of executing a large volume of complex analytical queries needed to fulfill their operational reporting requirements.
They want to efficiently access all their operational data stored in Cosmos DB without needing to increase the Azure Cosmos DB throughput and associate cost. They have looked at options for extracting data from their containers to the data lake as it changes, through the Azure Cosmos DB change feed mechanism.
The problem with this approach is the extra service and code dependencies and long-term maintenance of the solution. They could perform bulk exports from a Synapse Pipeline, but then they won’t have the most up-to-date information at any given moment.
Which would be the best action to take?

Select 1 option(s):

Select 1 option(s):

The IT team has an Azure subscription which contains an Azure Storage account and they plan to create an Azure container instance named OShaughnessy001 that will use a Docker image named Source001. Source001 contains a Microsoft SQL Server instance that requires persistent storage. Right now the team is configuring a storage service for OShaughnessy001 and there is debate around which of the following should be used.
As the expert consultant, the team looks to you for direction.
Which should you advise them to use?

Select 1 option(s):

Apache Spark pools for Azure Synapse Analytics uses an Autoscale feature that automatically scales the number of nodes in a cluster instance up and down.
Autoscale continuously monitors the Spark instance and collects which of the following metrics? (Select five)

Select 5 option(s):

There are times though when performance expectations are not met, and it is necessary then to know what aspects of the table structures and architecture can be reviewed and adapted to maximize query performance.
What is the following code intended to accomplish?

Select 1 option(s):

A(n) [?] schema may be defined at query time.

Select 1 option(s):

Which are valid authentication methods in Azure Synapse Analytics? (Select all that apply)

Select 6 option(s):

Azure Synapse Analytics is an integrated analytics platform, which combines data warehousing, big data analytics, data integration, and visualization into a single environment. Azure Synapse Analytics empowers users of all abilities to gain access and quick insights across all of their data, enabling a whole new level of performance and scale.
Diagnostic analytics deals with answering the question [?].

Select 1 option(s):

Which of the following aggregates would you use?

Select 1 option(s):

Select 1 option(s):

Select 1 option(s):

As a Data Engineer, you can transfer and move data in several ways. The most common tool is Azure Data Factory which provides robust resources and nearly 100 enterprise connectors. Azure Data Factory also allows you to transform data by using a wide variety of languages.
Azure has opened the way for technologies that can handle unstructured data at an unlimited scale. This change has shifted the paradigm for loading and transforming data from [?].

Select 1 option(s):

When considering Azure Storage Accounts, which option meets the data diversity requirement?

Select 1 option(s):

Many business application architectures separate transactional and analytical processing into separate systems with data stored and processed on separate infrastructures. These infrastructures are commonly referred to as OLTP (online transaction processing) systems working with operational data, and OLAP (online analytical processing) systems working with historical data, with each system is optimized for their specific task.
Azure Cosmos DB provides … [?]

Select 1 option(s):

Select 1 option(s):