Permit super-MaxAllocSize allocations with MemoryContextAllocHuge().
authorNoah Misch <noah@leadboat.com>
Thu, 27 Jun 2013 18:53:57 +0000 (14:53 -0400)
committerNoah Misch <noah@leadboat.com>
Thu, 27 Jun 2013 18:53:57 +0000 (14:53 -0400)
commit263865a48973767ce8ed7b7788059a38a24a9f37
tree282d6522ada24adc923ea869c01b9d94f02685db
parent9ef86cd994e9f2a684996df994d4657e84a6c0bb
Permit super-MaxAllocSize allocations with MemoryContextAllocHuge().

The MaxAllocSize guard is convenient for most callers, because it
reduces the need for careful attention to overflow, data type selection,
and the SET_VARSIZE() limit.  A handful of callers are happy to navigate
those hazards in exchange for the ability to allocate a larger chunk.
Introduce MemoryContextAllocHuge() and repalloc_huge().  Use this in
tuplesort.c and tuplestore.c, enabling internal sorts of up to INT_MAX
tuples, a factor-of-48 increase.  In particular, B-tree index builds can
now benefit from much-larger maintenance_work_mem settings.

Reviewed by Stephen Frost, Simon Riggs and Jeff Janes.
src/backend/utils/mmgr/aset.c
src/backend/utils/mmgr/mcxt.c
src/backend/utils/sort/tuplesort.c
src/backend/utils/sort/tuplestore.c
src/include/utils/memutils.h
src/include/utils/palloc.h
src/include/utils/tuplesort.h