Pop from the abandoned list

Helper for masks across fields; returns the mid count, post_mask may be 0

Primitive aligned allocation

linear check if the free list contains a specific element

Index a block in a page

Extend the capacity (up to reserved) by initializing a free list We do at most `MI_MAX_EXTEND` to avoid touching too much memory Note: we also experim

unit > 0 : size in binary bytes unit == 0: count as decimal unit < 0 : count in binary

Reserve a range of regular OS memory

note: can be called on abandoned pages

Note: may still return NULL if committing the memory failed

note: can be called on abandoned segments

note: can be called on abandoned segments

Thread free flag helpers

Unmap and unlink any mmapped segments that don't contain used chunks */

private:

Determines whether an event with a given Level and Keyword would be considered as enabled based on the state of the specified context. Note that you m

Adjust and optimize the size class properties for the given class

Deallocate the given block

Deallocate the given large memory block from the given heap

Deallocate the given small/medium memory block from the given heap

Extract a number of memory page spans from the global cache for small/medium blocks

Insert span into thread cache, releasing to global cache if overflow

Lookup a memory heap from heap ID

Reallocate the given block to the given size

Purge the arenas; if `force_purge` is true, amenable parts are purged even if not yet expired

Set `count` bits at `bitmap_idx` to 0 atomically Returns `true` if all `count` bits were 1 previously.

regular free

free retired pages: we don't need to look at the entire queues since we only retire pages that are at the head position in a queue.

----------------------------------------------------------- Do any delayed frees (put there by other threads if they deallocated in a full page)

The main allocation function

Generic allocation routine if the fast path (`alloc.c:mi_page_malloc`) does not succeed. Note: in debug mode the size includes MI_PADDING_SIZE and mig