Databricks DATABRICKS-CERTIFIED-ASSOCIATE-DEVELOPER-FOR-APACHE-SPARK dumps - 100% Pass Guarantee!

Which of the following code blocks reads in the JSON file stored at filePath, enforcing the schema expressed in JSON format in variable json_schema, shown in the code block below?

Code block: 1.json_schema = """ 2.{"type": "struct",

3.

"fields": [

4.

{

5.

"name": "itemId",

6.

"type": "integer",

7.

"nullable": true,

8.

"metadata": {}

9.

},

10.

{

11.

"name": "supplier",

12.

"type": "string",

13.

"nullable": true,

14.

"metadata": {}

15.

}

16.

] 17.} 18."""

A. spark.read.json(filePath, schema=json_schema)

B. spark.read.schema(json_schema).json(filePath) 1.schema = StructType.fromJson(json.loads(json_schema)) 2.spark.read.json(filePath, schema=schema)

C. spark.read.json(filePath, schema=schema_of_json(json_schema))

D. spark.read.json(filePath, schema=spark.read.json(json_schema))

In which order should the code blocks shown below be run in order to assign articlesDf a DataFrame that lists all items in column attributes ordered by the number of times these items occur, from most to least often?

Sample of DataFrame articlesDf:

1.

articlesDf = articlesDf.groupby("col")

2.

articlesDf = articlesDf.select(explode(col("attributes")))

3.

articlesDf = articlesDf.orderBy("count").select("col")

4.

articlesDf = articlesDf.sort("count",ascending=False).select("col")

5.

articlesDf = articlesDf.groupby("col").count()

A. 4, 5

B. 2, 5, 3

C. 5, 2

D. 2, 3, 4

E. 2, 5, 4

The code block displayed below contains an error. The code block should return a new DataFrame that only contains rows from DataFrame transactionsDf in which the value in column predError is at least 5.

Find the error.

Code block:

transactionsDf.where("col(predError) >= 5")

A. The argument to the where method should be "predError >= 5".

B. Instead of where(), filter() should be used.

C. The expression returns the original DataFrame transactionsDf and not a new DataFrame. To avoid this, the code block should be transactionsDf.toNewDataFrame().where("col(predError) >= 5").

D. The argument to the where method cannot be a string.

E. Instead of >=, the SQL operator GEQ should be used.

The code block displayed below contains an error. The code block should return a DataFrame where all entries in column supplier contain the letter combination et in this order. Find the error.

Code block:

itemsDf.filter(Column('supplier').isin('et'))

A. The Column operator should be replaced by the col operator and instead of isin, contains should be used.

B. The expression inside the filter parenthesis is malformed and should be replaced by isin('et', 'supplier').

C. Instead of isin, it should be checked whether column supplier contains the letters et, so isin should be replaced with contains. In addition, the column should be accessed using col['supplier'].

D. The expression only returns a single column and filter should be replaced by select.

Which of the following code blocks returns a copy of DataFrame transactionsDf in which column productId has been renamed to productNumber?

A. transactionsDf.withColumnRenamed("productId", "productNumber")

B. transactionsDf.withColumn("productId", "productNumber")

C. transactionsDf.withColumnRenamed("productNumber", "productId")

D. transactionsDf.withColumnRenamed(col(productId), col(productNumber))

E. transactionsDf.withColumnRenamed(productId, productNumber)