Question 490
Spark executors are mostly idle while the notebook driver goes out of memory after calling `toPandas()` on a very large DataFrame. What boundary was crossed?
Explanation
Correct Answer
Distributed Spark partitions do not prevent memory exhaustion if the application explicitly gathers all rows into one driver-side DataFrame.
Incorrect Answers
An oversized `toPandas()` materializes data on the driver regardless of idle executor resources.
KQL external shortcuts are unrelated to driver memory exhaustion from a local Pandas conversion.
Names don't limit how much data is materialized on the notebook driver.





Implementing Data Engineering Solutions Using Microsoft Fabric (DP-700) Practice Tests