File tree Expand file tree Collapse file tree
common/src/main/scala/org/apache/spark/sql/comet/util Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -260,9 +260,9 @@ object Utils extends CometTypeShim with Logging {
260260 * deserializes N separate Arrow IPC streams (one per source partition), which dominates
261261 * build-side time when partition counts are high (e.g. 200+ partitions in TPC-H Q18).
262262 *
263- * We decode and append all source batches into one VectorSchemaRoot on the driver,
264- * then re-serialize once via ArrowStreamWriter. This is done on the driver (not per-task)
265- * so the cost is paid once rather than once per consumer partition.
263+ * We decode and append all source batches into one VectorSchemaRoot on the driver, then
264+ * re-serialize once via ArrowStreamWriter. This is done on the driver (not per-task) so the
265+ * cost is paid once rather than once per consumer partition.
266266 */
267267 def coalesceBroadcastBatches (input : Iterator [ChunkedByteBuffer ]): Array [ChunkedByteBuffer ] = {
268268 val buffers = input.filterNot(_.size == 0 ).toArray
You can’t perform that action at this time.
0 commit comments