MCPcopy
hub / github.com/dask/dask / _layer

Method _layer

dask/dataframe/dask_expr/_concat.py:295–325  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

293class StackPartition(Concat):
294
295 def _layer(self):
296 dsk, i = {}, 0
297 kwargs = self._kwargs.copy()
298 kwargs["ignore_order"] = self.ignore_order
299 ctr = 0
300 meta = strip_unknown_categories(self._meta)
301 for df in self._frames:
302 try:
303 check_meta(df._meta, self._meta)
304 match = True
305 except (ValueError, TypeError):
306 match = False
307
308 for i in range(df.npartitions):
309 if match:
310 dsk[(self._name, ctr)] = df._name, i
311 else:
312 dsk[(self._name, ctr)] = (
313 apply,
314 methods.concat,
315 [
316 [meta, (df._name, i)],
317 self.axis,
318 self.join,
319 False,
320 True,
321 ],
322 kwargs,
323 )
324 ctr += 1
325 return dsk
326
327 def _lower(self):
328 return

Callers

nothing calls this directly

Calls 3

strip_unknown_categoriesFunction · 0.90
check_metaFunction · 0.90
copyMethod · 0.45

Tested by

no test coverage detected