MCPcopy Create free account
hub / github.com/dask/dask / _layer

Method _layer

dask/dataframe/dask_expr/_concat.py:291–321  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

289class StackPartition(Concat):
290
291 def _layer(self):
292 dsk, i = {}, 0
293 kwargs = self._kwargs.copy()
294 kwargs["ignore_order"] = self.ignore_order
295 ctr = 0
296 meta = strip_unknown_categories(self._meta)
297 for df in self._frames:
298 try:
299 check_meta(df._meta, self._meta)
300 match = True
301 except (ValueError, TypeError):
302 match = False
303
304 for i in range(df.npartitions):
305 if match:
306 dsk[(self._name, ctr)] = df._name, i
307 else:
308 dsk[(self._name, ctr)] = (
309 apply,
310 methods.concat,
311 [
312 [meta, (df._name, i)],
313 self.axis,
314 self.join,
315 False,
316 True,
317 ],
318 kwargs,
319 )
320 ctr += 1
321 return dsk
322
323 def _lower(self):
324 return

Callers

nothing calls this directly

Calls 3

strip_unknown_categoriesFunction · 0.90
check_metaFunction · 0.90
copyMethod · 0.45

Tested by

no test coverage detected