From 76004205fd1c9313912e51fd476a0500ee92e3b2 Mon Sep 17 00:00:00 2001 From: Adam Sawicki Date: Fri, 7 Feb 2020 17:18:35 +0100 Subject: [PATCH] Add documentation chapter about VK_AMD_device_coherent_memory extension usage Regenerated Doxygen documentation. --- docs/html/allocation_annotation.html | 16 +- docs/html/annotated.html | 20 +- docs/html/choosing_memory_type.html | 16 +- docs/html/classes.html | 37 +- docs/html/custom_memory_pools.html | 16 +- docs/html/defragmentation.html | 20 +- docs/html/deprecated.html | 6 +- docs/html/functions.html | 13 + docs/html/functions_vars.html | 13 + docs/html/globals.html | 20 +- docs/html/globals_eval.html | 6 + docs/html/globals_func.html | 6 + docs/html/globals_type.html | 6 + docs/html/index.html | 1 + docs/html/lost_allocations.html | 12 +- docs/html/memory_mapping.html | 22 +- docs/html/pages.html | 5 +- docs/html/quick_start.html | 12 +- docs/html/search/all_0.js | 15 +- docs/html/search/all_1.js | 12 +- docs/html/search/all_10.js | 16 +- docs/html/search/all_11.js | 289 +- docs/html/search/all_12.html | 30 + docs/html/search/all_12.js | 150 + docs/html/search/all_2.js | 8 +- docs/html/search/all_3.js | 12 +- docs/html/search/all_4.js | 4 +- docs/html/search/all_5.js | 2 +- docs/html/search/all_6.js | 2 +- docs/html/search/all_7.js | 2 +- docs/html/search/all_8.js | 28 +- docs/html/search/all_9.js | 2 +- docs/html/search/all_a.js | 2 +- docs/html/search/all_b.js | 41 +- docs/html/search/all_c.js | 2 +- docs/html/search/all_d.js | 6 +- docs/html/search/all_e.js | 6 +- docs/html/search/all_f.js | 2 +- docs/html/search/classes_0.js | 38 +- docs/html/search/classes_1.html | 30 + docs/html/search/classes_1.js | 22 + docs/html/search/defines_0.js | 2 +- docs/html/search/defines_1.js | 12 +- docs/html/search/enums_0.js | 12 +- docs/html/search/enumvalues_0.js | 78 +- docs/html/search/files_0.js | 2 +- docs/html/search/functions_0.js | 96 +- docs/html/search/pages_0.js | 2 +- docs/html/search/pages_1.js | 6 +- docs/html/search/pages_2.js | 6 +- docs/html/search/pages_3.js | 2 +- docs/html/search/pages_4.js | 2 +- docs/html/search/pages_5.js | 2 +- docs/html/search/pages_6.js | 2 +- docs/html/search/pages_7.js | 4 +- docs/html/search/pages_8.js | 4 +- docs/html/search/pages_9.js | 5 +- docs/html/search/typedefs_0.js | 4 +- docs/html/search/typedefs_1.js | 52 +- docs/html/search/variables_0.js | 13 +- docs/html/search/variables_1.js | 12 +- docs/html/search/variables_2.js | 2 +- docs/html/search/variables_3.js | 6 +- docs/html/search/variables_4.js | 4 +- docs/html/search/variables_5.js | 2 +- docs/html/search/variables_6.js | 26 +- docs/html/search/variables_7.js | 2 +- docs/html/search/variables_8.js | 37 +- docs/html/search/variables_9.js | 2 +- docs/html/search/variables_a.js | 2 +- docs/html/search/variables_b.js | 2 +- docs/html/search/variables_c.js | 16 +- docs/html/search/variables_d.js | 36 +- docs/html/struct__-members.html | 86 + docs/html/struct__.html | 232 + .../html/struct_vma_defragmentation_info.html | 2 +- ...vma_defragmentation_pass_info-members.html | 81 + .../struct_vma_defragmentation_pass_info.html | 127 + ...efragmentation_pass_move_info-members.html | 82 + ...ct_vma_defragmentation_pass_move_info.html | 137 + docs/html/vk__mem__alloc_8h.html | 132 +- docs/html/vk__mem__alloc_8h_source.html | 29780 ++++++++-------- docs/html/vk_amd_device_coherent_memory.html | 98 + docs/html/vk_khr_dedicated_allocation.html | 6 +- src/vk_mem_alloc.h | 60 +- 85 files changed, 17011 insertions(+), 15235 deletions(-) create mode 100644 docs/html/search/all_12.html create mode 100644 docs/html/search/all_12.js create mode 100644 docs/html/search/classes_1.html create mode 100644 docs/html/search/classes_1.js create mode 100644 docs/html/struct__-members.html create mode 100644 docs/html/struct__.html create mode 100644 docs/html/struct_vma_defragmentation_pass_info-members.html create mode 100644 docs/html/struct_vma_defragmentation_pass_info.html create mode 100644 docs/html/struct_vma_defragmentation_pass_move_info-members.html create mode 100644 docs/html/struct_vma_defragmentation_pass_move_info.html create mode 100644 docs/html/vk_amd_device_coherent_memory.html diff --git a/docs/html/allocation_annotation.html b/docs/html/allocation_annotation.html index 9c0cca1..c4f42ab 100644 --- a/docs/html/allocation_annotation.html +++ b/docs/html/allocation_annotation.html @@ -112,18 +112,18 @@ Allocation names
Note
Passing string name to VMA allocation doesn't automatically set it to the Vulkan buffer or image created with it. You must do it manually using an extension like VK_EXT_debug_utils, which is independent of this library.
-
VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT
Definition: vk_mem_alloc.h:2388
-
VmaAllocationCreateInfo::pUserData
void * pUserData
Custom general-purpose pointer that will be stored in VmaAllocation, can be read as VmaAllocationInfo...
Definition: vk_mem_alloc.h:2482
+
VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT
Definition: vk_mem_alloc.h:2464
+
VmaAllocationCreateInfo::pUserData
void * pUserData
Custom general-purpose pointer that will be stored in VmaAllocation, can be read as VmaAllocationInfo...
Definition: vk_mem_alloc.h:2558
vmaGetAllocationInfo
void vmaGetAllocationInfo(VmaAllocator allocator, VmaAllocation allocation, VmaAllocationInfo *pAllocationInfo)
Returns current information about specified allocation and atomically marks it as used in current fra...
VmaAllocation
Represents single memory allocation.
-
VMA_MEMORY_USAGE_GPU_ONLY
Definition: vk_mem_alloc.h:2285
+
VMA_MEMORY_USAGE_GPU_ONLY
Definition: vk_mem_alloc.h:2361
vmaCreateImage
VkResult vmaCreateImage(VmaAllocator allocator, const VkImageCreateInfo *pImageCreateInfo, const VmaAllocationCreateInfo *pAllocationCreateInfo, VkImage *pImage, VmaAllocation *pAllocation, VmaAllocationInfo *pAllocationInfo)
Function similar to vmaCreateBuffer().
-
VmaAllocationCreateInfo::usage
VmaMemoryUsage usage
Intended usage of memory.
Definition: vk_mem_alloc.h:2451
-
VmaAllocationInfo::pUserData
void * pUserData
Custom general-purpose pointer that was passed as VmaAllocationCreateInfo::pUserData or set using vma...
Definition: vk_mem_alloc.h:2818
+
VmaAllocationCreateInfo::usage
VmaMemoryUsage usage
Intended usage of memory.
Definition: vk_mem_alloc.h:2527
+
VmaAllocationInfo::pUserData
void * pUserData
Custom general-purpose pointer that was passed as VmaAllocationCreateInfo::pUserData or set using vma...
Definition: vk_mem_alloc.h:2894
vmaCreateBuffer
VkResult vmaCreateBuffer(VmaAllocator allocator, const VkBufferCreateInfo *pBufferCreateInfo, const VmaAllocationCreateInfo *pAllocationCreateInfo, VkBuffer *pBuffer, VmaAllocation *pAllocation, VmaAllocationInfo *pAllocationInfo)
-
VmaAllocationCreateInfo::flags
VmaAllocationCreateFlags flags
Use VmaAllocationCreateFlagBits enum.
Definition: vk_mem_alloc.h:2445
-
VmaAllocationCreateInfo
Definition: vk_mem_alloc.h:2442
-
VmaAllocationInfo
Parameters of VmaAllocation objects, that can be retrieved using function vmaGetAllocationInfo().
Definition: vk_mem_alloc.h:2780
+
VmaAllocationCreateInfo::flags
VmaAllocationCreateFlags flags
Use VmaAllocationCreateFlagBits enum.
Definition: vk_mem_alloc.h:2521
+
VmaAllocationCreateInfo
Definition: vk_mem_alloc.h:2518
+
VmaAllocationInfo
Parameters of VmaAllocation objects, that can be retrieved using function vmaGetAllocationInfo().
Definition: vk_mem_alloc.h:2856
Generated by   diff --git a/docs/html/annotated.html b/docs/html/annotated.html index 453ca9e..3b2de48 100644 --- a/docs/html/annotated.html +++ b/docs/html/annotated.html @@ -76,15 +76,17 @@ $(function() {  CVmaDefragmentationContextRepresents Opaque object that represents started defragmentation process  CVmaDefragmentationInfoDeprecated. Optional configuration parameters to be passed to function vmaDefragment()  CVmaDefragmentationInfo2Parameters for defragmentation - CVmaDefragmentationStatsStatistics returned by function vmaDefragment() - CVmaDeviceMemoryCallbacksSet of callbacks that the library will call for vkAllocateMemory and vkFreeMemory - CVmaPoolRepresents custom memory pool - CVmaPoolCreateInfoDescribes parameter of created VmaPool - CVmaPoolStatsDescribes parameter of existing VmaPool - CVmaRecordSettingsParameters for recording calls to VMA functions. To be used in VmaAllocatorCreateInfo::pRecordSettings - CVmaStatInfoCalculated statistics of memory usage in entire allocator - CVmaStatsGeneral statistics from current state of Allocator - CVmaVulkanFunctionsPointers to some Vulkan functions - a subset used by the library + CVmaDefragmentationPassInfoParameters for incremental defragmentation steps + CVmaDefragmentationPassMoveInfo + CVmaDefragmentationStatsStatistics returned by function vmaDefragment() + CVmaDeviceMemoryCallbacksSet of callbacks that the library will call for vkAllocateMemory and vkFreeMemory + CVmaPoolRepresents custom memory pool + CVmaPoolCreateInfoDescribes parameter of created VmaPool + CVmaPoolStatsDescribes parameter of existing VmaPool + CVmaRecordSettingsParameters for recording calls to VMA functions. To be used in VmaAllocatorCreateInfo::pRecordSettings + CVmaStatInfoCalculated statistics of memory usage in entire allocator + CVmaStatsGeneral statistics from current state of Allocator + CVmaVulkanFunctionsPointers to some Vulkan functions - a subset used by the library diff --git a/docs/html/choosing_memory_type.html b/docs/html/choosing_memory_type.html index d3facd4..29e930c 100644 --- a/docs/html/choosing_memory_type.html +++ b/docs/html/choosing_memory_type.html @@ -128,15 +128,15 @@ Dedicated allocations
VmaAllocation
Represents single memory allocation.
-
VMA_MEMORY_USAGE_GPU_ONLY
Definition: vk_mem_alloc.h:2285
-
VmaAllocationCreateInfo::requiredFlags
VkMemoryPropertyFlags requiredFlags
Flags that must be set in a Memory Type chosen for an allocation.
Definition: vk_mem_alloc.h:2456
-
VmaAllocationCreateInfo::usage
VmaMemoryUsage usage
Intended usage of memory.
Definition: vk_mem_alloc.h:2451
+
VMA_MEMORY_USAGE_GPU_ONLY
Definition: vk_mem_alloc.h:2361
+
VmaAllocationCreateInfo::requiredFlags
VkMemoryPropertyFlags requiredFlags
Flags that must be set in a Memory Type chosen for an allocation.
Definition: vk_mem_alloc.h:2532
+
VmaAllocationCreateInfo::usage
VmaMemoryUsage usage
Intended usage of memory.
Definition: vk_mem_alloc.h:2527
vmaCreateBuffer
VkResult vmaCreateBuffer(VmaAllocator allocator, const VkBufferCreateInfo *pBufferCreateInfo, const VmaAllocationCreateInfo *pAllocationCreateInfo, VkBuffer *pBuffer, VmaAllocation *pAllocation, VmaAllocationInfo *pAllocationInfo)
-
VMA_ALLOCATION_CREATE_MAPPED_BIT
Set this flag to use a memory that will be persistently mapped and retrieve pointer to it.
Definition: vk_mem_alloc.h:2362
-
VmaAllocationCreateInfo::flags
VmaAllocationCreateFlags flags
Use VmaAllocationCreateFlagBits enum.
Definition: vk_mem_alloc.h:2445
-
VmaAllocationCreateInfo
Definition: vk_mem_alloc.h:2442
-
VmaAllocationCreateInfo::preferredFlags
VkMemoryPropertyFlags preferredFlags
Flags that preferably should be set in a memory type chosen for an allocation.
Definition: vk_mem_alloc.h:2461
-
VmaAllocationCreateInfo::memoryTypeBits
uint32_t memoryTypeBits
Bitmask containing one bit set for every memory type acceptable for this allocation.
Definition: vk_mem_alloc.h:2469
+
VMA_ALLOCATION_CREATE_MAPPED_BIT
Set this flag to use a memory that will be persistently mapped and retrieve pointer to it.
Definition: vk_mem_alloc.h:2438
+
VmaAllocationCreateInfo::flags
VmaAllocationCreateFlags flags
Use VmaAllocationCreateFlagBits enum.
Definition: vk_mem_alloc.h:2521
+
VmaAllocationCreateInfo
Definition: vk_mem_alloc.h:2518
+
VmaAllocationCreateInfo::preferredFlags
VkMemoryPropertyFlags preferredFlags
Flags that preferably should be set in a memory type chosen for an allocation.
Definition: vk_mem_alloc.h:2537
+
VmaAllocationCreateInfo::memoryTypeBits
uint32_t memoryTypeBits
Bitmask containing one bit set for every memory type acceptable for this allocation.
Definition: vk_mem_alloc.h:2545
Generated by   diff --git a/docs/html/classes.html b/docs/html/classes.html index 6f4ae01..8401103 100644 --- a/docs/html/classes.html +++ b/docs/html/classes.html @@ -69,28 +69,31 @@ $(function() { - - - - - - - - - - - - + - + - - - - + + + + + + + + + + + + + + + + + +
  v  
VmaAllocationInfo   VmaDefragmentationContext   VmaDeviceMemoryCallbacks   VmaRecordSettings   
VmaAllocator   VmaDefragmentationInfo   VmaPool   VmaStatInfo   
VmaAllocation   VmaAllocatorCreateInfo   VmaAllocator    VmaDefragmentationInfo2   VmaPoolCreateInfo   VmaPool    VmaStats   
VmaAllocationCreateInfo   VmaBudget   VmaDefragmentationStats   VmaPoolStats   
VmaAllocatorCreateInfo   VmaDefragmentationPassInfo   VmaPoolCreateInfo    VmaVulkanFunctions   
VmaAllocation   VmaBudget   VmaDefragmentationPassMoveInfo   VmaPoolStats   
VmaAllocationCreateInfo   VmaDefragmentationContext   VmaDefragmentationStats   VmaRecordSettings   
VmaAllocationInfo   VmaDefragmentationInfo   VmaDeviceMemoryCallbacks   VmaStatInfo   
v
diff --git a/docs/html/custom_memory_pools.html b/docs/html/custom_memory_pools.html index c46b4ab..d305b6b 100644 --- a/docs/html/custom_memory_pools.html +++ b/docs/html/custom_memory_pools.html @@ -176,21 +176,21 @@ Buddy allocation algorithm -
VmaPoolCreateInfo::memoryTypeIndex
uint32_t memoryTypeIndex
Vulkan memory type index to allocate this pool from.
Definition: vk_mem_alloc.h:2607
-
VmaAllocationCreateInfo::pool
VmaPool pool
Pool that this allocation should be created in.
Definition: vk_mem_alloc.h:2475
+
VmaPoolCreateInfo::memoryTypeIndex
uint32_t memoryTypeIndex
Vulkan memory type index to allocate this pool from.
Definition: vk_mem_alloc.h:2683
+
VmaAllocationCreateInfo::pool
VmaPool pool
Pool that this allocation should be created in.
Definition: vk_mem_alloc.h:2551
vmaDestroyPool
void vmaDestroyPool(VmaAllocator allocator, VmaPool pool)
Destroys VmaPool object and frees Vulkan device memory.
VmaAllocation
Represents single memory allocation.
-
VMA_MEMORY_USAGE_GPU_ONLY
Definition: vk_mem_alloc.h:2285
+
VMA_MEMORY_USAGE_GPU_ONLY
Definition: vk_mem_alloc.h:2361
vmaCreatePool
VkResult vmaCreatePool(VmaAllocator allocator, const VmaPoolCreateInfo *pCreateInfo, VmaPool *pPool)
Allocates Vulkan device memory and creates VmaPool object.
-
VmaPoolCreateInfo::maxBlockCount
size_t maxBlockCount
Maximum number of blocks that can be allocated in this pool. Optional.
Definition: vk_mem_alloc.h:2632
-
VmaPoolCreateInfo
Describes parameter of created VmaPool.
Definition: vk_mem_alloc.h:2604
+
VmaPoolCreateInfo::maxBlockCount
size_t maxBlockCount
Maximum number of blocks that can be allocated in this pool. Optional.
Definition: vk_mem_alloc.h:2708
+
VmaPoolCreateInfo
Describes parameter of created VmaPool.
Definition: vk_mem_alloc.h:2680
VmaPool
Represents custom memory pool.
vmaFindMemoryTypeIndexForBufferInfo
VkResult vmaFindMemoryTypeIndexForBufferInfo(VmaAllocator allocator, const VkBufferCreateInfo *pBufferCreateInfo, const VmaAllocationCreateInfo *pAllocationCreateInfo, uint32_t *pMemoryTypeIndex)
Helps to find memoryTypeIndex, given VkBufferCreateInfo and VmaAllocationCreateInfo.
-
VmaAllocationCreateInfo::usage
VmaMemoryUsage usage
Intended usage of memory.
Definition: vk_mem_alloc.h:2451
+
VmaAllocationCreateInfo::usage
VmaMemoryUsage usage
Intended usage of memory.
Definition: vk_mem_alloc.h:2527
vmaCreateBuffer
VkResult vmaCreateBuffer(VmaAllocator allocator, const VkBufferCreateInfo *pBufferCreateInfo, const VmaAllocationCreateInfo *pAllocationCreateInfo, VkBuffer *pBuffer, VmaAllocation *pAllocation, VmaAllocationInfo *pAllocationInfo)
vmaDestroyBuffer
void vmaDestroyBuffer(VmaAllocator allocator, VkBuffer buffer, VmaAllocation allocation)
Destroys Vulkan buffer and frees allocated memory.
-
VmaAllocationCreateInfo
Definition: vk_mem_alloc.h:2442
-
VmaAllocationInfo
Parameters of VmaAllocation objects, that can be retrieved using function vmaGetAllocationInfo().
Definition: vk_mem_alloc.h:2780
+
VmaAllocationCreateInfo
Definition: vk_mem_alloc.h:2518
+
VmaAllocationInfo
Parameters of VmaAllocation objects, that can be retrieved using function vmaGetAllocationInfo().
Definition: vk_mem_alloc.h:2856
Generated by   diff --git a/docs/html/defragmentation.html b/docs/html/defragmentation.html index 8fc1c94..b21f76c 100644 --- a/docs/html/defragmentation.html +++ b/docs/html/defragmentation.html @@ -210,22 +210,22 @@ Writing custom defragmentation algorithm -
VmaDefragmentationInfo2::allocationCount
uint32_t allocationCount
Number of allocations in pAllocations array.
Definition: vk_mem_alloc.h:3128
+
VmaDefragmentationInfo2::allocationCount
uint32_t allocationCount
Number of allocations in pAllocations array.
Definition: vk_mem_alloc.h:3206
VmaAllocator
Represents main object of this library initialized.
vmaGetAllocationInfo
void vmaGetAllocationInfo(VmaAllocator allocator, VmaAllocation allocation, VmaAllocationInfo *pAllocationInfo)
Returns current information about specified allocation and atomically marks it as used in current fra...
vmaDefragmentationEnd
VkResult vmaDefragmentationEnd(VmaAllocator allocator, VmaDefragmentationContext context)
Ends defragmentation process.
-
VmaDefragmentationInfo2::maxGpuBytesToMove
VkDeviceSize maxGpuBytesToMove
Maximum total numbers of bytes that can be copied while moving allocations to different places using ...
Definition: vk_mem_alloc.h:3177
-
VmaDefragmentationInfo2::commandBuffer
VkCommandBuffer commandBuffer
Optional. Command buffer where GPU copy commands will be posted.
Definition: vk_mem_alloc.h:3191
-
VmaDefragmentationInfo2
Parameters for defragmentation.
Definition: vk_mem_alloc.h:3122
+
VmaDefragmentationInfo2::maxGpuBytesToMove
VkDeviceSize maxGpuBytesToMove
Maximum total numbers of bytes that can be copied while moving allocations to different places using ...
Definition: vk_mem_alloc.h:3255
+
VmaDefragmentationInfo2::commandBuffer
VkCommandBuffer commandBuffer
Optional. Command buffer where GPU copy commands will be posted.
Definition: vk_mem_alloc.h:3269
+
VmaDefragmentationInfo2
Parameters for defragmentation.
Definition: vk_mem_alloc.h:3200
vmaBindBufferMemory
VkResult vmaBindBufferMemory(VmaAllocator allocator, VmaAllocation allocation, VkBuffer buffer)
Binds buffer to allocation.
-
VmaDefragmentationInfo2::maxGpuAllocationsToMove
uint32_t maxGpuAllocationsToMove
Maximum number of allocations that can be moved to a different place using transfers on GPU side,...
Definition: vk_mem_alloc.h:3182
-
VmaDefragmentationInfo2::maxCpuBytesToMove
VkDeviceSize maxCpuBytesToMove
Maximum total numbers of bytes that can be copied while moving allocations to different places using ...
Definition: vk_mem_alloc.h:3167
+
VmaDefragmentationInfo2::maxGpuAllocationsToMove
uint32_t maxGpuAllocationsToMove
Maximum number of allocations that can be moved to a different place using transfers on GPU side,...
Definition: vk_mem_alloc.h:3260
+
VmaDefragmentationInfo2::maxCpuBytesToMove
VkDeviceSize maxCpuBytesToMove
Maximum total numbers of bytes that can be copied while moving allocations to different places using ...
Definition: vk_mem_alloc.h:3245
vmaDefragmentationBegin
VkResult vmaDefragmentationBegin(VmaAllocator allocator, const VmaDefragmentationInfo2 *pInfo, VmaDefragmentationStats *pStats, VmaDefragmentationContext *pContext)
Begins defragmentation process.
-
VmaDefragmentationInfo2::pAllocationsChanged
VkBool32 * pAllocationsChanged
Optional, output. Pointer to array that will be filled with information whether the allocation at cer...
Definition: vk_mem_alloc.h:3143
-
VmaAllocationInfo
Parameters of VmaAllocation objects, that can be retrieved using function vmaGetAllocationInfo().
Definition: vk_mem_alloc.h:2780
+
VmaDefragmentationInfo2::pAllocationsChanged
VkBool32 * pAllocationsChanged
Optional, output. Pointer to array that will be filled with information whether the allocation at cer...
Definition: vk_mem_alloc.h:3221
+
VmaAllocationInfo
Parameters of VmaAllocation objects, that can be retrieved using function vmaGetAllocationInfo().
Definition: vk_mem_alloc.h:2856
VmaDefragmentationContext
Represents Opaque object that represents started defragmentation process.
-
VmaDefragmentationInfo2::pAllocations
VmaAllocation * pAllocations
Pointer to array of allocations that can be defragmented.
Definition: vk_mem_alloc.h:3137
-
VmaDefragmentationInfo2::maxCpuAllocationsToMove
uint32_t maxCpuAllocationsToMove
Maximum number of allocations that can be moved to a different place using transfers on CPU side,...
Definition: vk_mem_alloc.h:3172
+
VmaDefragmentationInfo2::pAllocations
VmaAllocation * pAllocations
Pointer to array of allocations that can be defragmented.
Definition: vk_mem_alloc.h:3215
+
VmaDefragmentationInfo2::maxCpuAllocationsToMove
uint32_t maxCpuAllocationsToMove
Maximum number of allocations that can be moved to a different place using transfers on CPU side,...
Definition: vk_mem_alloc.h:3250
Generated by   diff --git a/docs/html/deprecated.html b/docs/html/deprecated.html index 27f376e..6d34bd9 100644 --- a/docs/html/deprecated.html +++ b/docs/html/deprecated.html @@ -67,9 +67,11 @@ $(function() {
Member vmaDefragment (VmaAllocator allocator, VmaAllocation *pAllocations, size_t allocationCount, VkBool32 *pAllocationsChanged, const VmaDefragmentationInfo *pDefragmentationInfo, VmaDefragmentationStats *pDefragmentationStats)
-
This is a part of the old interface. It is recommended to use structure VmaDefragmentationInfo2 and function vmaDefragmentationBegin() instead.
+
This is a part of the old interface. It is recommended to use structure VmaDefragmentationInfo2 and function vmaDefragmentationBegin() instead.
Member VmaDefragmentationInfo
-
This is a part of the old interface. It is recommended to use structure VmaDefragmentationInfo2 and function vmaDefragmentationBegin() instead.
+
This is a part of the old interface. It is recommended to use structure VmaDefragmentationInfo2 and function vmaDefragmentationBegin() instead.
+
Member vmaResizeAllocation (VmaAllocator allocator, VmaAllocation allocation, VkDeviceSize newSize)
+
In version 2.2.0 it used to try to change allocation's size without moving or reallocating it. In current version it returns VK_SUCCESS only if newSize equals current allocation's size. Otherwise returns VK_ERROR_OUT_OF_POOL_MEMORY, indicating that allocation's size could not be changed.
diff --git a/docs/html/functions.html b/docs/html/functions.html index e431b8c..9bdc200 100644 --- a/docs/html/functions.html +++ b/docs/html/functions.html @@ -64,6 +64,9 @@ $(function() {
Here is a list of all class members with links to the classes they belong to:

- a -

- o -

@@ -231,6 +241,9 @@ $(function() {
  • pMappedData : VmaAllocationInfo
    • +
  • pMoves +: VmaDefragmentationPassInfo +
  • pool : VmaAllocationCreateInfo
    • diff --git a/docs/html/functions_vars.html b/docs/html/functions_vars.html index c3050ea..52f4bda 100644 --- a/docs/html/functions_vars.html +++ b/docs/html/functions_vars.html @@ -64,6 +64,9 @@ $(function() {  

    - a -

    - o -

    @@ -231,6 +241,9 @@ $(function() {
  • pMappedData : VmaAllocationInfo
    • +
  • pMoves +: VmaDefragmentationPassInfo +
  • pool : VmaAllocationCreateInfo
    • diff --git a/docs/html/globals.html b/docs/html/globals.html index e846b79..5b65750 100644 --- a/docs/html/globals.html +++ b/docs/html/globals.html @@ -132,6 +132,9 @@ $(function() {
  • VMA_ALLOCATION_CREATE_WITHIN_BUDGET_BIT : vk_mem_alloc.h
    • +
  • VMA_ALLOCATOR_CREATE_AMD_DEVICE_COHERENT_MEMORY_BIT +: vk_mem_alloc.h +
  • VMA_ALLOCATOR_CREATE_EXT_MEMORY_BUDGET_BIT : vk_mem_alloc.h
    • @@ -156,6 +159,9 @@ $(function() {
  • VMA_DEFRAGMENTATION_FLAG_BITS_MAX_ENUM : vk_mem_alloc.h
    • +
  • VMA_DEFRAGMENTATION_FLAG_INCREMENTAL +: vk_mem_alloc.h +
  • VMA_MEMORY_BUDGET : vk_mem_alloc.h
    • @@ -246,6 +252,9 @@ $(function() {
  • VmaAllocatorCreateInfo : vk_mem_alloc.h
    • +
  • vmaBeginDefragmentationPass() +: vk_mem_alloc.h +
  • vmaBindBufferMemory() : vk_mem_alloc.h
    • @@ -298,7 +307,7 @@ $(function() { : vk_mem_alloc.h
  • VmaDefragmentationFlagBits -: vk_mem_alloc.h +: vk_mem_alloc.h
  • VmaDefragmentationFlags : vk_mem_alloc.h @@ -309,6 +318,12 @@ $(function() {
  • VmaDefragmentationInfo2 : vk_mem_alloc.h
    • +
  • VmaDefragmentationPassInfo +: vk_mem_alloc.h +
    • +
  • VmaDefragmentationPassMoveInfo +: vk_mem_alloc.h +
  • VmaDefragmentationStats : vk_mem_alloc.h
    • @@ -327,6 +342,9 @@ $(function() {
  • VmaDeviceMemoryCallbacks : vk_mem_alloc.h
    • +
  • vmaEndDefragmentationPass() +: vk_mem_alloc.h +
  • vmaFindMemoryTypeIndex() : vk_mem_alloc.h
    • diff --git a/docs/html/globals_eval.html b/docs/html/globals_eval.html index 6a3b55d..df02a7f 100644 --- a/docs/html/globals_eval.html +++ b/docs/html/globals_eval.html @@ -115,6 +115,9 @@ $(function() {
  • VMA_ALLOCATION_CREATE_WITHIN_BUDGET_BIT : vk_mem_alloc.h
    • +
  • VMA_ALLOCATOR_CREATE_AMD_DEVICE_COHERENT_MEMORY_BIT +: vk_mem_alloc.h +
  • VMA_ALLOCATOR_CREATE_EXT_MEMORY_BUDGET_BIT : vk_mem_alloc.h
    • @@ -133,6 +136,9 @@ $(function() {
  • VMA_DEFRAGMENTATION_FLAG_BITS_MAX_ENUM : vk_mem_alloc.h
    • +
  • VMA_DEFRAGMENTATION_FLAG_INCREMENTAL +: vk_mem_alloc.h +
  • VMA_MEMORY_USAGE_CPU_COPY : vk_mem_alloc.h
    • diff --git a/docs/html/globals_func.html b/docs/html/globals_func.html index b5b5b97..e9b5bd9 100644 --- a/docs/html/globals_func.html +++ b/docs/html/globals_func.html @@ -76,6 +76,9 @@ $(function() {
  • vmaAllocateMemoryPages() : vk_mem_alloc.h
    • +
  • vmaBeginDefragmentationPass() +: vk_mem_alloc.h +
  • vmaBindBufferMemory() : vk_mem_alloc.h
    • @@ -136,6 +139,9 @@ $(function() {
  • vmaDestroyPool() : vk_mem_alloc.h
    • +
  • vmaEndDefragmentationPass() +: vk_mem_alloc.h +
  • vmaFindMemoryTypeIndex() : vk_mem_alloc.h
    • diff --git a/docs/html/globals_type.html b/docs/html/globals_type.html index ba083d9..85acd76 100644 --- a/docs/html/globals_type.html +++ b/docs/html/globals_type.html @@ -104,6 +104,12 @@ $(function() {
  • VmaDefragmentationInfo2 : vk_mem_alloc.h
    • +
  • VmaDefragmentationPassInfo +: vk_mem_alloc.h +
    • +
  • VmaDefragmentationPassMoveInfo +: vk_mem_alloc.h +
  • VmaDefragmentationStats : vk_mem_alloc.h
    • diff --git a/docs/html/index.html b/docs/html/index.html index bbfb810..87f0161 100644 --- a/docs/html/index.html +++ b/docs/html/index.html @@ -150,6 +150,7 @@ Table of contents
  • Device memory allocation callbacks
  • Device heap memory limit
  • VK_KHR_dedicated_allocation
    • +
  • VK_AMD_device_coherent_memory
  • General considerations
      diff --git a/docs/html/lost_allocations.html b/docs/html/lost_allocations.html index 72922c4..6f71cc3 100644 --- a/docs/html/lost_allocations.html +++ b/docs/html/lost_allocations.html @@ -121,15 +121,15 @@ $(function() {
      vmaTouchAllocation
      VkBool32 vmaTouchAllocation(VmaAllocator allocator, VmaAllocation allocation)
      Returns VK_TRUE if allocation is not lost and atomically marks it as used in current frame.
      -
      VMA_ALLOCATION_CREATE_CAN_BECOME_LOST_BIT
      Definition: vk_mem_alloc.h:2375
      +
      VMA_ALLOCATION_CREATE_CAN_BECOME_LOST_BIT
      Definition: vk_mem_alloc.h:2451
      VmaAllocation
      Represents single memory allocation.
      -
      VMA_MEMORY_USAGE_GPU_ONLY
      Definition: vk_mem_alloc.h:2285
      -
      VMA_ALLOCATION_CREATE_CAN_MAKE_OTHER_LOST_BIT
      Definition: vk_mem_alloc.h:2382
      -
      VmaAllocationCreateInfo::usage
      VmaMemoryUsage usage
      Intended usage of memory.
      Definition: vk_mem_alloc.h:2451
      +
      VMA_MEMORY_USAGE_GPU_ONLY
      Definition: vk_mem_alloc.h:2361
      +
      VMA_ALLOCATION_CREATE_CAN_MAKE_OTHER_LOST_BIT
      Definition: vk_mem_alloc.h:2458
      +
      VmaAllocationCreateInfo::usage
      VmaMemoryUsage usage
      Intended usage of memory.
      Definition: vk_mem_alloc.h:2527
      vmaCreateBuffer
      VkResult vmaCreateBuffer(VmaAllocator allocator, const VkBufferCreateInfo *pBufferCreateInfo, const VmaAllocationCreateInfo *pAllocationCreateInfo, VkBuffer *pBuffer, VmaAllocation *pAllocation, VmaAllocationInfo *pAllocationInfo)
      vmaDestroyBuffer
      void vmaDestroyBuffer(VmaAllocator allocator, VkBuffer buffer, VmaAllocation allocation)
      Destroys Vulkan buffer and frees allocated memory.
      -
      VmaAllocationCreateInfo::flags
      VmaAllocationCreateFlags flags
      Use VmaAllocationCreateFlagBits enum.
      Definition: vk_mem_alloc.h:2445
      -
      VmaAllocationCreateInfo
      Definition: vk_mem_alloc.h:2442
      +
      VmaAllocationCreateInfo::flags
      VmaAllocationCreateFlags flags
      Use VmaAllocationCreateFlagBits enum.
      Definition: vk_mem_alloc.h:2521
      +
      VmaAllocationCreateInfo
      Definition: vk_mem_alloc.h:2518
      Generated by   diff --git a/docs/html/memory_mapping.html b/docs/html/memory_mapping.html index f5c3e9c..3d776e8 100644 --- a/docs/html/memory_mapping.html +++ b/docs/html/memory_mapping.html @@ -182,20 +182,20 @@ Finding out if memory is mappable
      vmaUnmapMemory
      void vmaUnmapMemory(VmaAllocator allocator, VmaAllocation allocation)
      Unmaps memory represented by given allocation, mapped previously using vmaMapMemory().
      VmaAllocator
      Represents main object of this library initialized.
      vmaGetMemoryTypeProperties
      void vmaGetMemoryTypeProperties(VmaAllocator allocator, uint32_t memoryTypeIndex, VkMemoryPropertyFlags *pFlags)
      Given Memory Type Index, returns Property Flags of this memory type.
      -
      VMA_MEMORY_USAGE_CPU_ONLY
      Definition: vk_mem_alloc.h:2295
      +
      VMA_MEMORY_USAGE_CPU_ONLY
      Definition: vk_mem_alloc.h:2371
      VmaAllocation
      Represents single memory allocation.
      -
      VMA_MEMORY_USAGE_GPU_ONLY
      Definition: vk_mem_alloc.h:2285
      +
      VMA_MEMORY_USAGE_GPU_ONLY
      Definition: vk_mem_alloc.h:2361
      vmaMapMemory
      VkResult vmaMapMemory(VmaAllocator allocator, VmaAllocation allocation, void **ppData)
      Maps memory represented by given allocation and returns pointer to it.
      -
      VmaAllocationInfo::pMappedData
      void * pMappedData
      Pointer to the beginning of this allocation as mapped data.
      Definition: vk_mem_alloc.h:2813
      -
      VmaAllocationCreateInfo::usage
      VmaMemoryUsage usage
      Intended usage of memory.
      Definition: vk_mem_alloc.h:2451
      -
      VmaAllocationInfo::pUserData
      void * pUserData
      Custom general-purpose pointer that was passed as VmaAllocationCreateInfo::pUserData or set using vma...
      Definition: vk_mem_alloc.h:2818
      +
      VmaAllocationInfo::pMappedData
      void * pMappedData
      Pointer to the beginning of this allocation as mapped data.
      Definition: vk_mem_alloc.h:2889
      +
      VmaAllocationCreateInfo::usage
      VmaMemoryUsage usage
      Intended usage of memory.
      Definition: vk_mem_alloc.h:2527
      +
      VmaAllocationInfo::pUserData
      void * pUserData
      Custom general-purpose pointer that was passed as VmaAllocationCreateInfo::pUserData or set using vma...
      Definition: vk_mem_alloc.h:2894
      vmaCreateBuffer
      VkResult vmaCreateBuffer(VmaAllocator allocator, const VkBufferCreateInfo *pBufferCreateInfo, const VmaAllocationCreateInfo *pAllocationCreateInfo, VkBuffer *pBuffer, VmaAllocation *pAllocation, VmaAllocationInfo *pAllocationInfo)
      -
      VmaAllocationInfo::memoryType
      uint32_t memoryType
      Memory type index that this allocation was allocated from.
      Definition: vk_mem_alloc.h:2785
      -
      VMA_ALLOCATION_CREATE_MAPPED_BIT
      Set this flag to use a memory that will be persistently mapped and retrieve pointer to it.
      Definition: vk_mem_alloc.h:2362
      -
      VmaAllocationCreateInfo::flags
      VmaAllocationCreateFlags flags
      Use VmaAllocationCreateFlagBits enum.
      Definition: vk_mem_alloc.h:2445
      -
      VmaAllocationCreateInfo
      Definition: vk_mem_alloc.h:2442
      -
      VmaAllocationCreateInfo::preferredFlags
      VkMemoryPropertyFlags preferredFlags
      Flags that preferably should be set in a memory type chosen for an allocation.
      Definition: vk_mem_alloc.h:2461
      -
      VmaAllocationInfo
      Parameters of VmaAllocation objects, that can be retrieved using function vmaGetAllocationInfo().
      Definition: vk_mem_alloc.h:2780
      +
      VmaAllocationInfo::memoryType
      uint32_t memoryType
      Memory type index that this allocation was allocated from.
      Definition: vk_mem_alloc.h:2861
      +
      VMA_ALLOCATION_CREATE_MAPPED_BIT
      Set this flag to use a memory that will be persistently mapped and retrieve pointer to it.
      Definition: vk_mem_alloc.h:2438
      +
      VmaAllocationCreateInfo::flags
      VmaAllocationCreateFlags flags
      Use VmaAllocationCreateFlagBits enum.
      Definition: vk_mem_alloc.h:2521
      +
      VmaAllocationCreateInfo
      Definition: vk_mem_alloc.h:2518
      +
      VmaAllocationCreateInfo::preferredFlags
      VkMemoryPropertyFlags preferredFlags
      Flags that preferably should be set in a memory type chosen for an allocation.
      Definition: vk_mem_alloc.h:2537
      +
      VmaAllocationInfo
      Parameters of VmaAllocation objects, that can be retrieved using function vmaGetAllocationInfo().
      Definition: vk_mem_alloc.h:2856
      Generated by   diff --git a/docs/html/pages.html b/docs/html/pages.html index 1fbad8f..7cf4657 100644 --- a/docs/html/pages.html +++ b/docs/html/pages.html @@ -81,8 +81,9 @@ $(function() {  Recommended usage patterns  Configuration  VK_KHR_dedicated_allocation - General considerations - Deprecated List + VK_AMD_device_coherent_memory + General considerations + Deprecated List diff --git a/docs/html/quick_start.html b/docs/html/quick_start.html index 05daaca..f0411f6 100644 --- a/docs/html/quick_start.html +++ b/docs/html/quick_start.html @@ -115,18 +115,18 @@ Resource allocation
      vmaDestroyAllocator(allocator);
      -
      VmaAllocatorCreateInfo::physicalDevice
      VkPhysicalDevice physicalDevice
      Vulkan physical device.
      Definition: vk_mem_alloc.h:2003
      +
      VmaAllocatorCreateInfo::physicalDevice
      VkPhysicalDevice physicalDevice
      Vulkan physical device.
      Definition: vk_mem_alloc.h:2079
      VmaAllocator
      Represents main object of this library initialized.
      -
      VmaAllocatorCreateInfo
      Description of a Allocator to be created.
      Definition: vk_mem_alloc.h:1997
      +
      VmaAllocatorCreateInfo
      Description of a Allocator to be created.
      Definition: vk_mem_alloc.h:2073
      VmaAllocation
      Represents single memory allocation.
      -
      VMA_MEMORY_USAGE_GPU_ONLY
      Definition: vk_mem_alloc.h:2285
      +
      VMA_MEMORY_USAGE_GPU_ONLY
      Definition: vk_mem_alloc.h:2361
      vmaDestroyAllocator
      void vmaDestroyAllocator(VmaAllocator allocator)
      Destroys allocator object.
      -
      VmaAllocatorCreateInfo::device
      VkDevice device
      Vulkan device.
      Definition: vk_mem_alloc.h:2006
      -
      VmaAllocationCreateInfo::usage
      VmaMemoryUsage usage
      Intended usage of memory.
      Definition: vk_mem_alloc.h:2451
      +
      VmaAllocatorCreateInfo::device
      VkDevice device
      Vulkan device.
      Definition: vk_mem_alloc.h:2082
      +
      VmaAllocationCreateInfo::usage
      VmaMemoryUsage usage
      Intended usage of memory.
      Definition: vk_mem_alloc.h:2527
      vmaCreateBuffer
      VkResult vmaCreateBuffer(VmaAllocator allocator, const VkBufferCreateInfo *pBufferCreateInfo, const VmaAllocationCreateInfo *pAllocationCreateInfo, VkBuffer *pBuffer, VmaAllocation *pAllocation, VmaAllocationInfo *pAllocationInfo)
      vmaCreateAllocator
      VkResult vmaCreateAllocator(const VmaAllocatorCreateInfo *pCreateInfo, VmaAllocator *pAllocator)
      Creates Allocator object.
      vmaDestroyBuffer
      void vmaDestroyBuffer(VmaAllocator allocator, VkBuffer buffer, VmaAllocation allocation)
      Destroys Vulkan buffer and frees allocated memory.
      -
      VmaAllocationCreateInfo
      Definition: vk_mem_alloc.h:2442
      +
      VmaAllocationCreateInfo
      Definition: vk_mem_alloc.h:2518
      Generated by   diff --git a/docs/html/search/all_0.js b/docs/html/search/all_0.js index f8addb4..f0f3fbc 100644 --- a/docs/html/search/all_0.js +++ b/docs/html/search/all_0.js @@ -1,10 +1,11 @@ var searchData= [ - ['allocation_20names_20and_20user_20data_0',['Allocation names and user data',['../allocation_annotation.html',1,'']]], - ['allocationbytes_1',['allocationBytes',['../struct_vma_budget.html#a7e2a6583ebd63e194951c542563804d8',1,'VmaBudget']]], - ['allocationcount_2',['allocationCount',['../struct_vma_stat_info.html#a537741e4d5cdddc1c0ab95ec650afaff',1,'VmaStatInfo::allocationCount()'],['../struct_vma_pool_stats.html#ad1924eb54fffa45e9e0e65670c8fe5eb',1,'VmaPoolStats::allocationCount()'],['../struct_vma_defragmentation_info2.html#a3cf86ab32c1da779b4923d301a3056ba',1,'VmaDefragmentationInfo2::allocationCount()']]], - ['allocationsizeavg_3',['allocationSizeAvg',['../struct_vma_stat_info.html#a1081a039964e566c672e7a2347f9e599',1,'VmaStatInfo']]], - ['allocationsizemax_4',['allocationSizeMax',['../struct_vma_stat_info.html#a17e9733a5ecd76287d4db6e66f71f50c',1,'VmaStatInfo']]], - ['allocationsizemin_5',['allocationSizeMin',['../struct_vma_stat_info.html#ade8b40bd3139c04aabd2fc538a356fea',1,'VmaStatInfo']]], - ['allocationsmoved_6',['allocationsMoved',['../struct_vma_defragmentation_stats.html#aefeabf130022008eadd75999478af3f9',1,'VmaDefragmentationStats']]] + ['allocation_0',['allocation',['../struct_vma_defragmentation_pass_move_info.html#ae885c861c2dd8d622e6c19e281d035cc',1,'VmaDefragmentationPassMoveInfo']]], + ['allocation_20names_20and_20user_20data_1',['Allocation names and user data',['../allocation_annotation.html',1,'']]], + ['allocationbytes_2',['allocationBytes',['../struct_vma_budget.html#a7e2a6583ebd63e194951c542563804d8',1,'VmaBudget']]], + ['allocationcount_3',['allocationCount',['../struct_vma_stat_info.html#a537741e4d5cdddc1c0ab95ec650afaff',1,'VmaStatInfo::allocationCount()'],['../struct_vma_pool_stats.html#ad1924eb54fffa45e9e0e65670c8fe5eb',1,'VmaPoolStats::allocationCount()'],['../struct_vma_defragmentation_info2.html#a3cf86ab32c1da779b4923d301a3056ba',1,'VmaDefragmentationInfo2::allocationCount()']]], + ['allocationsizeavg_4',['allocationSizeAvg',['../struct_vma_stat_info.html#a1081a039964e566c672e7a2347f9e599',1,'VmaStatInfo']]], + ['allocationsizemax_5',['allocationSizeMax',['../struct_vma_stat_info.html#a17e9733a5ecd76287d4db6e66f71f50c',1,'VmaStatInfo']]], + ['allocationsizemin_6',['allocationSizeMin',['../struct_vma_stat_info.html#ade8b40bd3139c04aabd2fc538a356fea',1,'VmaStatInfo']]], + ['allocationsmoved_7',['allocationsMoved',['../struct_vma_defragmentation_stats.html#aefeabf130022008eadd75999478af3f9',1,'VmaDefragmentationStats']]] ]; diff --git a/docs/html/search/all_1.js b/docs/html/search/all_1.js index 0ac2341..c90e7ad 100644 --- a/docs/html/search/all_1.js +++ b/docs/html/search/all_1.js @@ -1,9 +1,9 @@ var searchData= [ - ['blockbytes_7',['blockBytes',['../struct_vma_budget.html#a58b492901baab685f466199124e514a0',1,'VmaBudget']]], - ['blockcount_8',['blockCount',['../struct_vma_stat_info.html#abc4bb7cd611900778464c56e50c970a4',1,'VmaStatInfo::blockCount()'],['../struct_vma_pool_stats.html#aa0b5cb45cef6f18571cefb03b9a230e7',1,'VmaPoolStats::blockCount()']]], - ['blocksize_9',['blockSize',['../struct_vma_pool_create_info.html#aa4265160536cdb9be821b7686c16c676',1,'VmaPoolCreateInfo']]], - ['budget_10',['budget',['../struct_vma_budget.html#ab82e1d1754c2d210d0bdf90220bc6cdd',1,'VmaBudget']]], - ['bytesfreed_11',['bytesFreed',['../struct_vma_defragmentation_stats.html#ab0cb9ac0dbc106c77e384ea676422f28',1,'VmaDefragmentationStats']]], - ['bytesmoved_12',['bytesMoved',['../struct_vma_defragmentation_stats.html#a36f9d5df2a10ba2a36b16e126d60572d',1,'VmaDefragmentationStats']]] + ['blockbytes_8',['blockBytes',['../struct_vma_budget.html#a58b492901baab685f466199124e514a0',1,'VmaBudget']]], + ['blockcount_9',['blockCount',['../struct_vma_stat_info.html#abc4bb7cd611900778464c56e50c970a4',1,'VmaStatInfo::blockCount()'],['../struct_vma_pool_stats.html#aa0b5cb45cef6f18571cefb03b9a230e7',1,'VmaPoolStats::blockCount()']]], + ['blocksize_10',['blockSize',['../struct_vma_pool_create_info.html#aa4265160536cdb9be821b7686c16c676',1,'VmaPoolCreateInfo']]], + ['budget_11',['budget',['../struct_vma_budget.html#ab82e1d1754c2d210d0bdf90220bc6cdd',1,'VmaBudget']]], + ['bytesfreed_12',['bytesFreed',['../struct_vma_defragmentation_stats.html#ab0cb9ac0dbc106c77e384ea676422f28',1,'VmaDefragmentationStats']]], + ['bytesmoved_13',['bytesMoved',['../struct_vma_defragmentation_stats.html#a36f9d5df2a10ba2a36b16e126d60572d',1,'VmaDefragmentationStats']]] ]; diff --git a/docs/html/search/all_10.js b/docs/html/search/all_10.js index 3536756..f0183c5 100644 --- a/docs/html/search/all_10.js +++ b/docs/html/search/all_10.js @@ -1,11 +1,11 @@ var searchData= [ - ['unusedbytes_71',['unusedBytes',['../struct_vma_stat_info.html#a1859d290aca2cd582d8dc25922092669',1,'VmaStatInfo']]], - ['unusedrangecount_72',['unusedRangeCount',['../struct_vma_stat_info.html#ae06129c771bfebfd6468a7f4276502a9',1,'VmaStatInfo::unusedRangeCount()'],['../struct_vma_pool_stats.html#ae4f3546ffa4d1e598b64d8e6134854f4',1,'VmaPoolStats::unusedRangeCount()']]], - ['unusedrangesizeavg_73',['unusedRangeSizeAvg',['../struct_vma_stat_info.html#a2f9b3452af90c9768a30b7fb6ae194fc',1,'VmaStatInfo']]], - ['unusedrangesizemax_74',['unusedRangeSizeMax',['../struct_vma_stat_info.html#a5ba1a2476c4d39b10f7e2f7ebbb72ac4',1,'VmaStatInfo::unusedRangeSizeMax()'],['../struct_vma_pool_stats.html#ab4c8f52dd42ab01998f60f0b6acc722b',1,'VmaPoolStats::unusedRangeSizeMax()']]], - ['unusedrangesizemin_75',['unusedRangeSizeMin',['../struct_vma_stat_info.html#aedeba931324f16589cd2416c0d2dd0d4',1,'VmaStatInfo']]], - ['unusedsize_76',['unusedSize',['../struct_vma_pool_stats.html#ad7c54874724fce7b06aba526202d82a8',1,'VmaPoolStats']]], - ['usage_77',['usage',['../struct_vma_budget.html#a84dd1ecca8b0110259eb206dbadb11f6',1,'VmaBudget::usage()'],['../struct_vma_allocation_create_info.html#accb8b06b1f677d858cb9af20705fa910',1,'VmaAllocationCreateInfo::usage()']]], - ['usedbytes_78',['usedBytes',['../struct_vma_stat_info.html#ab0c6c73837e5a70c749fbd4f6064895a',1,'VmaStatInfo']]] + ['unusedbytes_75',['unusedBytes',['../struct_vma_stat_info.html#a1859d290aca2cd582d8dc25922092669',1,'VmaStatInfo']]], + ['unusedrangecount_76',['unusedRangeCount',['../struct_vma_stat_info.html#ae06129c771bfebfd6468a7f4276502a9',1,'VmaStatInfo::unusedRangeCount()'],['../struct_vma_pool_stats.html#ae4f3546ffa4d1e598b64d8e6134854f4',1,'VmaPoolStats::unusedRangeCount()']]], + ['unusedrangesizeavg_77',['unusedRangeSizeAvg',['../struct_vma_stat_info.html#a2f9b3452af90c9768a30b7fb6ae194fc',1,'VmaStatInfo']]], + ['unusedrangesizemax_78',['unusedRangeSizeMax',['../struct_vma_stat_info.html#a5ba1a2476c4d39b10f7e2f7ebbb72ac4',1,'VmaStatInfo::unusedRangeSizeMax()'],['../struct_vma_pool_stats.html#ab4c8f52dd42ab01998f60f0b6acc722b',1,'VmaPoolStats::unusedRangeSizeMax()']]], + ['unusedrangesizemin_79',['unusedRangeSizeMin',['../struct_vma_stat_info.html#aedeba931324f16589cd2416c0d2dd0d4',1,'VmaStatInfo']]], + ['unusedsize_80',['unusedSize',['../struct_vma_pool_stats.html#ad7c54874724fce7b06aba526202d82a8',1,'VmaPoolStats']]], + ['usage_81',['usage',['../struct_vma_budget.html#a84dd1ecca8b0110259eb206dbadb11f6',1,'VmaBudget::usage()'],['../struct_vma_allocation_create_info.html#accb8b06b1f677d858cb9af20705fa910',1,'VmaAllocationCreateInfo::usage()']]], + ['usedbytes_82',['usedBytes',['../struct_vma_stat_info.html#ab0c6c73837e5a70c749fbd4f6064895a',1,'VmaStatInfo']]] ]; diff --git a/docs/html/search/all_11.js b/docs/html/search/all_11.js index 4e93235..b0d9692 100644 --- a/docs/html/search/all_11.js +++ b/docs/html/search/all_11.js @@ -1,144 +1,151 @@ var searchData= [ - ['vulkan_20memory_20allocator_79',['Vulkan Memory Allocator',['../index.html',1,'']]], - ['vk_5fkhr_5fdedicated_5fallocation_80',['VK_KHR_dedicated_allocation',['../vk_khr_dedicated_allocation.html',1,'']]], - ['vk_5fmem_5falloc_2eh_81',['vk_mem_alloc.h',['../vk__mem__alloc_8h.html',1,'']]], - ['vkallocatememory_82',['vkAllocateMemory',['../struct_vma_vulkan_functions.html#a2943bf99dfd784a0e8f599d987e22e6c',1,'VmaVulkanFunctions']]], - ['vkbindbuffermemory_83',['vkBindBufferMemory',['../struct_vma_vulkan_functions.html#a94fc4f3a605d9880bb3c0ba2c2fc80b2',1,'VmaVulkanFunctions']]], - ['vkbindimagememory_84',['vkBindImageMemory',['../struct_vma_vulkan_functions.html#a1338d96a128a5ade648b8d934907c637',1,'VmaVulkanFunctions']]], - ['vkcmdcopybuffer_85',['vkCmdCopyBuffer',['../struct_vma_vulkan_functions.html#ae5c0db8c89a3b82593dc16aa6a49fa3a',1,'VmaVulkanFunctions']]], - ['vkcreatebuffer_86',['vkCreateBuffer',['../struct_vma_vulkan_functions.html#ae8084315a25006271a2edfc3a447519f',1,'VmaVulkanFunctions']]], - ['vkcreateimage_87',['vkCreateImage',['../struct_vma_vulkan_functions.html#a23ebe70be515b9b5010a1d691200e325',1,'VmaVulkanFunctions']]], - ['vkdestroybuffer_88',['vkDestroyBuffer',['../struct_vma_vulkan_functions.html#a7e054606faddb07f0e8556f3ed317d45',1,'VmaVulkanFunctions']]], - ['vkdestroyimage_89',['vkDestroyImage',['../struct_vma_vulkan_functions.html#a90b898227039b1dcb3520f6e91f09ffa',1,'VmaVulkanFunctions']]], - ['vkflushmappedmemoryranges_90',['vkFlushMappedMemoryRanges',['../struct_vma_vulkan_functions.html#a33c322f4c4ad2810f8a9c97a277572f9',1,'VmaVulkanFunctions']]], - ['vkfreememory_91',['vkFreeMemory',['../struct_vma_vulkan_functions.html#a4c658701778564d62034255b5dda91b4',1,'VmaVulkanFunctions']]], - ['vkgetbuffermemoryrequirements_92',['vkGetBufferMemoryRequirements',['../struct_vma_vulkan_functions.html#a5b92901df89a4194b0d12f6071d4d143',1,'VmaVulkanFunctions']]], - ['vkgetimagememoryrequirements_93',['vkGetImageMemoryRequirements',['../struct_vma_vulkan_functions.html#a475f6f49f8debe4d10800592606d53f4',1,'VmaVulkanFunctions']]], - ['vkgetphysicaldevicememoryproperties_94',['vkGetPhysicalDeviceMemoryProperties',['../struct_vma_vulkan_functions.html#a60d25c33bba06bb8592e6875cbaa9830',1,'VmaVulkanFunctions']]], - ['vkgetphysicaldeviceproperties_95',['vkGetPhysicalDeviceProperties',['../struct_vma_vulkan_functions.html#a77b7a74082823e865dd6546623468f96',1,'VmaVulkanFunctions']]], - ['vkinvalidatemappedmemoryranges_96',['vkInvalidateMappedMemoryRanges',['../struct_vma_vulkan_functions.html#a5c1093bc32386a8060c37c9f282078a1',1,'VmaVulkanFunctions']]], - ['vkmapmemory_97',['vkMapMemory',['../struct_vma_vulkan_functions.html#ab5c1f38dea3a2cf00dc9eb4f57218c49',1,'VmaVulkanFunctions']]], - ['vkunmapmemory_98',['vkUnmapMemory',['../struct_vma_vulkan_functions.html#acc798589736f0becb317fc2196c1d8b9',1,'VmaVulkanFunctions']]], - ['vma_5fallocation_5fcreate_5fcan_5fbecome_5flost_5fbit_99',['VMA_ALLOCATION_CREATE_CAN_BECOME_LOST_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a5f436af6c8fe8540573a6d22627a6fd2',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fcan_5fmake_5fother_5flost_5fbit_100',['VMA_ALLOCATION_CREATE_CAN_MAKE_OTHER_LOST_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a68686d0ce9beb0d4d1b9f2b8b1389a7e',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fdedicated_5fmemory_5fbit_101',['VMA_ALLOCATION_CREATE_DEDICATED_MEMORY_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a3fc311d855c2ff53f1090ef5c722b38f',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fdont_5fbind_5fbit_102',['VMA_ALLOCATION_CREATE_DONT_BIND_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a2310568c62208af432724305fe29ccea',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fflag_5fbits_5fmax_5fenum_103',['VMA_ALLOCATION_CREATE_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597ae5633ec569f4899cf8f29e7385b2f882',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fmapped_5fbit_104',['VMA_ALLOCATION_CREATE_MAPPED_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a11da372cc3a82931c5e5d6146cd9dd1f',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fnever_5fallocate_5fbit_105',['VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a89759603401014eb325eb22a3839f2ff',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fstrategy_5fbest_5ffit_5fbit_106',['VMA_ALLOCATION_CREATE_STRATEGY_BEST_FIT_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a839826775c62319466441f86496f036d',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fstrategy_5ffirst_5ffit_5fbit_107',['VMA_ALLOCATION_CREATE_STRATEGY_FIRST_FIT_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a33eb2052674f3ad92386c714a65fb777',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fstrategy_5fmask_108',['VMA_ALLOCATION_CREATE_STRATEGY_MASK',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a8e16845d81ae3d27c47106d4770d5c7e',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fstrategy_5fmin_5ffragmentation_5fbit_109',['VMA_ALLOCATION_CREATE_STRATEGY_MIN_FRAGMENTATION_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a621b704103eb3360230c860acf36e706',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fstrategy_5fmin_5fmemory_5fbit_110',['VMA_ALLOCATION_CREATE_STRATEGY_MIN_MEMORY_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a8af1210cf591784afa026d94998f735d',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fstrategy_5fmin_5ftime_5fbit_111',['VMA_ALLOCATION_CREATE_STRATEGY_MIN_TIME_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a0729e932b7ea170e3a128cad96c5cf6d',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fstrategy_5fworst_5ffit_5fbit_112',['VMA_ALLOCATION_CREATE_STRATEGY_WORST_FIT_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597ad242a04f802e25fef0b880afe8bb0a62',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fupper_5faddress_5fbit_113',['VMA_ALLOCATION_CREATE_UPPER_ADDRESS_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a42ba3a2d2c7117953210b7c3ef8da0df',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fuser_5fdata_5fcopy_5fstring_5fbit_114',['VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597aa6f24f821cd6a7c5e4a443f7bf59c520',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fwithin_5fbudget_5fbit_115',['VMA_ALLOCATION_CREATE_WITHIN_BUDGET_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597ab8b1764f3e9022368e440c057783b92d',1,'vk_mem_alloc.h']]], - ['vma_5fallocator_5fcreate_5fext_5fmemory_5fbudget_5fbit_116',['VMA_ALLOCATOR_CREATE_EXT_MEMORY_BUDGET_BIT',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7ca4d4687863f7bd4b418c6006dc04400b0',1,'vk_mem_alloc.h']]], - ['vma_5fallocator_5fcreate_5fexternally_5fsynchronized_5fbit_117',['VMA_ALLOCATOR_CREATE_EXTERNALLY_SYNCHRONIZED_BIT',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7ca4816ddaed324ba110172ca608a20f29d',1,'vk_mem_alloc.h']]], - ['vma_5fallocator_5fcreate_5fflag_5fbits_5fmax_5fenum_118',['VMA_ALLOCATOR_CREATE_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7cae4d5ad929caba5f23eb502b13bd5286c',1,'vk_mem_alloc.h']]], - ['vma_5fallocator_5fcreate_5fkhr_5fbind_5fmemory2_5fbit_119',['VMA_ALLOCATOR_CREATE_KHR_BIND_MEMORY2_BIT',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7ca8fb75bf07cd184ab903596295e863dee',1,'vk_mem_alloc.h']]], - ['vma_5fallocator_5fcreate_5fkhr_5fdedicated_5fallocation_5fbit_120',['VMA_ALLOCATOR_CREATE_KHR_DEDICATED_ALLOCATION_BIT',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7cace7da7cc6e71a625dfa763c55a597878',1,'vk_mem_alloc.h']]], - ['vma_5fbind_5fmemory2_121',['VMA_BIND_MEMORY2',['../vk__mem__alloc_8h.html#a88bef97f86d70a34a4c0746e09a2680d',1,'vk_mem_alloc.h']]], - ['vma_5fdedicated_5fallocation_122',['VMA_DEDICATED_ALLOCATION',['../vk__mem__alloc_8h.html#af7b860e63b96d11e44ae8587ba06bbf4',1,'vk_mem_alloc.h']]], - ['vma_5fdefragmentation_5fflag_5fbits_5fmax_5fenum_123',['VMA_DEFRAGMENTATION_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#a6552a65b71d16f378c6994b3ceaef50cab87ec33154803bfeb5ac2b379f1d6a97',1,'vk_mem_alloc.h']]], - ['vma_5fmemory_5fbudget_124',['VMA_MEMORY_BUDGET',['../vk__mem__alloc_8h.html#a05decf1cf4ebf767beba7acca6c1ec3a',1,'vk_mem_alloc.h']]], - ['vma_5fmemory_5fusage_5fcpu_5fcopy_125',['VMA_MEMORY_USAGE_CPU_COPY',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca416a444d4d0fc20067c3f76f32ff2500',1,'vk_mem_alloc.h']]], - ['vma_5fmemory_5fusage_5fcpu_5fonly_126',['VMA_MEMORY_USAGE_CPU_ONLY',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca40bdf4cddeffeb12f43d45ca1286e0a5',1,'vk_mem_alloc.h']]], - ['vma_5fmemory_5fusage_5fcpu_5fto_5fgpu_127',['VMA_MEMORY_USAGE_CPU_TO_GPU',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca9066b52c5a7079bb74a69aaf8b92ff67',1,'vk_mem_alloc.h']]], - ['vma_5fmemory_5fusage_5fgpu_5flazily_5fallocated_128',['VMA_MEMORY_USAGE_GPU_LAZILY_ALLOCATED',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca835333d9072db63a653818030e17614d',1,'vk_mem_alloc.h']]], - ['vma_5fmemory_5fusage_5fgpu_5fonly_129',['VMA_MEMORY_USAGE_GPU_ONLY',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305ccac6b5dc1432d88647aa4cd456246eadf7',1,'vk_mem_alloc.h']]], - ['vma_5fmemory_5fusage_5fgpu_5fto_5fcpu_130',['VMA_MEMORY_USAGE_GPU_TO_CPU',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca7b586d2fdaf82a463b58f581ed72be27',1,'vk_mem_alloc.h']]], - ['vma_5fmemory_5fusage_5fmax_5fenum_131',['VMA_MEMORY_USAGE_MAX_ENUM',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca091e69437ef693e8d0d287f1c719ba6e',1,'vk_mem_alloc.h']]], - ['vma_5fmemory_5fusage_5funknown_132',['VMA_MEMORY_USAGE_UNKNOWN',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305ccaf50d27e34e0925cf3a63db8c839121dd',1,'vk_mem_alloc.h']]], - ['vma_5fpool_5fcreate_5falgorithm_5fmask_133',['VMA_POOL_CREATE_ALGORITHM_MASK',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7af4d270f8f42517a0f70037ceb6ac1d9c',1,'vk_mem_alloc.h']]], - ['vma_5fpool_5fcreate_5fbuddy_5falgorithm_5fbit_134',['VMA_POOL_CREATE_BUDDY_ALGORITHM_BIT',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7a97a0dc38e5161b780594d998d313d35e',1,'vk_mem_alloc.h']]], - ['vma_5fpool_5fcreate_5fflag_5fbits_5fmax_5fenum_135',['VMA_POOL_CREATE_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7a1c7312bea9ea246846b9054fd6bd6aec',1,'vk_mem_alloc.h']]], - ['vma_5fpool_5fcreate_5fignore_5fbuffer_5fimage_5fgranularity_5fbit_136',['VMA_POOL_CREATE_IGNORE_BUFFER_IMAGE_GRANULARITY_BIT',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7a9f1a499508a8edb4e8ba40aa0290a3d2',1,'vk_mem_alloc.h']]], - ['vma_5fpool_5fcreate_5flinear_5falgorithm_5fbit_137',['VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7a13c8a444197c67866be9cb05599fc726',1,'vk_mem_alloc.h']]], - ['vma_5frecord_5fflag_5fbits_5fmax_5fenum_138',['VMA_RECORD_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#a4dd2c44642312a147a4e93373a6e64d2a20dd17d69966dbffa054739d6090b85e',1,'vk_mem_alloc.h']]], - ['vma_5frecord_5fflush_5fafter_5fcall_5fbit_139',['VMA_RECORD_FLUSH_AFTER_CALL_BIT',['../vk__mem__alloc_8h.html#a4dd2c44642312a147a4e93373a6e64d2a8e7ab322e8732654be627c4ea8f36cc7',1,'vk_mem_alloc.h']]], - ['vma_5frecording_5fenabled_140',['VMA_RECORDING_ENABLED',['../vk__mem__alloc_8h.html#a1f0c126759fc96ccb6e2d23c101d770c',1,'vk_mem_alloc.h']]], - ['vma_5fstats_5fstring_5fenabled_141',['VMA_STATS_STRING_ENABLED',['../vk__mem__alloc_8h.html#ae25f0d55fd91cb166f002b63244800e1',1,'vk_mem_alloc.h']]], - ['vma_5fvulkan_5fversion_142',['VMA_VULKAN_VERSION',['../vk__mem__alloc_8h.html#a1a2407c283893638cc039bb31fcd74b6',1,'vk_mem_alloc.h']]], - ['vmaallocatememory_143',['vmaAllocateMemory',['../vk__mem__alloc_8h.html#abf28077dbf82d0908b8acbe8ee8dd9b8',1,'vk_mem_alloc.h']]], - ['vmaallocatememoryforbuffer_144',['vmaAllocateMemoryForBuffer',['../vk__mem__alloc_8h.html#a7fdf64415b6c3d83c454f28d2c53df7b',1,'vk_mem_alloc.h']]], - ['vmaallocatememoryforimage_145',['vmaAllocateMemoryForImage',['../vk__mem__alloc_8h.html#a0faa3f9e5fb233d29d1e00390650febb',1,'vk_mem_alloc.h']]], - ['vmaallocatememorypages_146',['vmaAllocateMemoryPages',['../vk__mem__alloc_8h.html#ad37e82e492b3de38fc3f4cffd9ad0ae1',1,'vk_mem_alloc.h']]], - ['vmaallocation_147',['VmaAllocation',['../struct_vma_allocation.html',1,'']]], - ['vmaallocationcreateflagbits_148',['VmaAllocationCreateFlagBits',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597',1,'VmaAllocationCreateFlagBits(): vk_mem_alloc.h'],['../vk__mem__alloc_8h.html#abf6bf6748c7a9fe7ce5b7835c0f56af4',1,'VmaAllocationCreateFlagBits(): vk_mem_alloc.h']]], - ['vmaallocationcreateflags_149',['VmaAllocationCreateFlags',['../vk__mem__alloc_8h.html#a5225e5e11f8376f6a31a1791f3d6e817',1,'vk_mem_alloc.h']]], - ['vmaallocationcreateinfo_150',['VmaAllocationCreateInfo',['../struct_vma_allocation_create_info.html',1,'VmaAllocationCreateInfo'],['../vk__mem__alloc_8h.html#a86c44f9950b40d50088ed93a17870a7a',1,'VmaAllocationCreateInfo(): vk_mem_alloc.h']]], - ['vmaallocationinfo_151',['VmaAllocationInfo',['../struct_vma_allocation_info.html',1,'VmaAllocationInfo'],['../vk__mem__alloc_8h.html#a795e6ff02a21d5486c0565f403dd9255',1,'VmaAllocationInfo(): vk_mem_alloc.h']]], - ['vmaallocator_152',['VmaAllocator',['../struct_vma_allocator.html',1,'']]], - ['vmaallocatorcreateflagbits_153',['VmaAllocatorCreateFlagBits',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7c',1,'VmaAllocatorCreateFlagBits(): vk_mem_alloc.h'],['../vk__mem__alloc_8h.html#a4ddf381b6ce795bdfbc6c614640b9915',1,'VmaAllocatorCreateFlagBits(): vk_mem_alloc.h']]], - ['vmaallocatorcreateflags_154',['VmaAllocatorCreateFlags',['../vk__mem__alloc_8h.html#acfe6863e160722c2c1bbcf7573fddc4d',1,'vk_mem_alloc.h']]], - ['vmaallocatorcreateinfo_155',['VmaAllocatorCreateInfo',['../struct_vma_allocator_create_info.html',1,'VmaAllocatorCreateInfo'],['../vk__mem__alloc_8h.html#ae0f6d1d733dded220d28134da46b4283',1,'VmaAllocatorCreateInfo(): vk_mem_alloc.h']]], - ['vmabindbuffermemory_156',['vmaBindBufferMemory',['../vk__mem__alloc_8h.html#a6b0929b914b60cf2d45cac4bf3547470',1,'vk_mem_alloc.h']]], - ['vmabindbuffermemory2_157',['vmaBindBufferMemory2',['../vk__mem__alloc_8h.html#a927c944f45e0f2941182abb6f608e64a',1,'vk_mem_alloc.h']]], - ['vmabindimagememory_158',['vmaBindImageMemory',['../vk__mem__alloc_8h.html#a3d3ca45799923aa5d138e9e5f9eb2da5',1,'vk_mem_alloc.h']]], - ['vmabindimagememory2_159',['vmaBindImageMemory2',['../vk__mem__alloc_8h.html#aa8251ee81b0045a443e35b8e8aa021bc',1,'vk_mem_alloc.h']]], - ['vmabudget_160',['VmaBudget',['../struct_vma_budget.html',1,'VmaBudget'],['../vk__mem__alloc_8h.html#ab79b48b6d25aada0de91a913896e1c38',1,'VmaBudget(): vk_mem_alloc.h']]], - ['vmabuildstatsstring_161',['vmaBuildStatsString',['../vk__mem__alloc_8h.html#aa4fee7eb5253377599ef4fd38c93c2a0',1,'vk_mem_alloc.h']]], - ['vmacalculatestats_162',['vmaCalculateStats',['../vk__mem__alloc_8h.html#a333b61c1788cb23559177531e6a93ca3',1,'vk_mem_alloc.h']]], - ['vmacheckcorruption_163',['vmaCheckCorruption',['../vk__mem__alloc_8h.html#a49329a7f030dafcf82f7b73334c22e98',1,'vk_mem_alloc.h']]], - ['vmacheckpoolcorruption_164',['vmaCheckPoolCorruption',['../vk__mem__alloc_8h.html#ad535935619c7a549bf837e1bb0068f89',1,'vk_mem_alloc.h']]], - ['vmacreateallocator_165',['vmaCreateAllocator',['../vk__mem__alloc_8h.html#a200692051ddb34240248234f5f4c17bb',1,'vk_mem_alloc.h']]], - ['vmacreatebuffer_166',['vmaCreateBuffer',['../vk__mem__alloc_8h.html#ac72ee55598617e8eecca384e746bab51',1,'vk_mem_alloc.h']]], - ['vmacreateimage_167',['vmaCreateImage',['../vk__mem__alloc_8h.html#a02a94f25679275851a53e82eacbcfc73',1,'vk_mem_alloc.h']]], - ['vmacreatelostallocation_168',['vmaCreateLostAllocation',['../vk__mem__alloc_8h.html#ae5c9657d9e94756269145b01c05d16f1',1,'vk_mem_alloc.h']]], - ['vmacreatepool_169',['vmaCreatePool',['../vk__mem__alloc_8h.html#a5c8770ded7c59c8caac6de0c2cb00b50',1,'vk_mem_alloc.h']]], - ['vmadefragment_170',['vmaDefragment',['../vk__mem__alloc_8h.html#a6aced90fcc7b39882b6654a740a0b9bb',1,'vk_mem_alloc.h']]], - ['vmadefragmentationbegin_171',['vmaDefragmentationBegin',['../vk__mem__alloc_8h.html#a36ba776fd7fd5cb1e9359fdc0d8e6e8a',1,'vk_mem_alloc.h']]], - ['vmadefragmentationcontext_172',['VmaDefragmentationContext',['../struct_vma_defragmentation_context.html',1,'']]], - ['vmadefragmentationend_173',['vmaDefragmentationEnd',['../vk__mem__alloc_8h.html#a8774e20e91e245aae959ba63efa15dd2',1,'vk_mem_alloc.h']]], - ['vmadefragmentationflagbits_174',['VmaDefragmentationFlagBits',['../vk__mem__alloc_8h.html#a6552a65b71d16f378c6994b3ceaef50c',1,'VmaDefragmentationFlagBits(): vk_mem_alloc.h'],['../vk__mem__alloc_8h.html#a96df0eddab2e1735782fe4e7cd05ea7f',1,'VmaDefragmentationFlagBits(): vk_mem_alloc.h']]], - ['vmadefragmentationflags_175',['VmaDefragmentationFlags',['../vk__mem__alloc_8h.html#a88a77cef37e5d3c4fc9eb328885d048d',1,'vk_mem_alloc.h']]], - ['vmadefragmentationinfo_176',['VmaDefragmentationInfo',['../struct_vma_defragmentation_info.html',1,'VmaDefragmentationInfo'],['../vk__mem__alloc_8h.html#ae67f8573a0cf20f16f0a1eecbca566a0',1,'VmaDefragmentationInfo(): vk_mem_alloc.h']]], - ['vmadefragmentationinfo2_177',['VmaDefragmentationInfo2',['../struct_vma_defragmentation_info2.html',1,'VmaDefragmentationInfo2'],['../vk__mem__alloc_8h.html#abac0e85abaa6ea1ffd63bde29c5c3a29',1,'VmaDefragmentationInfo2(): vk_mem_alloc.h']]], - ['vmadefragmentationstats_178',['VmaDefragmentationStats',['../struct_vma_defragmentation_stats.html',1,'VmaDefragmentationStats'],['../vk__mem__alloc_8h.html#ab0f9b06441c840fee560de4a2967f8c9',1,'VmaDefragmentationStats(): vk_mem_alloc.h']]], - ['vmadestroyallocator_179',['vmaDestroyAllocator',['../vk__mem__alloc_8h.html#aa8d164061c88f22fb1fd3c8f3534bc1d',1,'vk_mem_alloc.h']]], - ['vmadestroybuffer_180',['vmaDestroyBuffer',['../vk__mem__alloc_8h.html#a0d9f4e4ba5bf9aab1f1c746387753d77',1,'vk_mem_alloc.h']]], - ['vmadestroyimage_181',['vmaDestroyImage',['../vk__mem__alloc_8h.html#ae50d2cb3b4a3bfd4dd40987234e50e7e',1,'vk_mem_alloc.h']]], - ['vmadestroypool_182',['vmaDestroyPool',['../vk__mem__alloc_8h.html#a5485779c8f1948238fc4e92232fa65e1',1,'vk_mem_alloc.h']]], - ['vmadevicememorycallbacks_183',['VmaDeviceMemoryCallbacks',['../struct_vma_device_memory_callbacks.html',1,'VmaDeviceMemoryCallbacks'],['../vk__mem__alloc_8h.html#a5e2eb68d727cfd4df25702b027b7aa31',1,'VmaDeviceMemoryCallbacks(): vk_mem_alloc.h']]], - ['vmafindmemorytypeindex_184',['vmaFindMemoryTypeIndex',['../vk__mem__alloc_8h.html#aef15a94b58fbcb0fe706d5720e84a74a',1,'vk_mem_alloc.h']]], - ['vmafindmemorytypeindexforbufferinfo_185',['vmaFindMemoryTypeIndexForBufferInfo',['../vk__mem__alloc_8h.html#ae790ab9ffaf7667fb8f62523e6897888',1,'vk_mem_alloc.h']]], - ['vmafindmemorytypeindexforimageinfo_186',['vmaFindMemoryTypeIndexForImageInfo',['../vk__mem__alloc_8h.html#a088da83d8eaf3ce9056d9ea0b981d472',1,'vk_mem_alloc.h']]], - ['vmaflushallocation_187',['vmaFlushAllocation',['../vk__mem__alloc_8h.html#abc34ee6f021f459aff885f3758c435de',1,'vk_mem_alloc.h']]], - ['vmafreememory_188',['vmaFreeMemory',['../vk__mem__alloc_8h.html#a11f0fbc034fa81a4efedd73d61ce7568',1,'vk_mem_alloc.h']]], - ['vmafreememorypages_189',['vmaFreeMemoryPages',['../vk__mem__alloc_8h.html#ab9e709de044c5d8476bea77a4e755840',1,'vk_mem_alloc.h']]], - ['vmafreestatsstring_190',['vmaFreeStatsString',['../vk__mem__alloc_8h.html#a3104eb30d8122c84dd8541063f145288',1,'vk_mem_alloc.h']]], - ['vmagetallocationinfo_191',['vmaGetAllocationInfo',['../vk__mem__alloc_8h.html#a86dd08aba8633bfa4ad0df2e76481d8b',1,'vk_mem_alloc.h']]], - ['vmagetbudget_192',['vmaGetBudget',['../vk__mem__alloc_8h.html#aec0ed24ebea2d0099eed5f801daaefba',1,'vk_mem_alloc.h']]], - ['vmagetmemoryproperties_193',['vmaGetMemoryProperties',['../vk__mem__alloc_8h.html#ab88db292a17974f911182543fda52d19',1,'vk_mem_alloc.h']]], - ['vmagetmemorytypeproperties_194',['vmaGetMemoryTypeProperties',['../vk__mem__alloc_8h.html#a8701444752eb5de4464adb5a2b514bca',1,'vk_mem_alloc.h']]], - ['vmagetphysicaldeviceproperties_195',['vmaGetPhysicalDeviceProperties',['../vk__mem__alloc_8h.html#aecabf7b6e91ea87d0316fa0a9e014fe0',1,'vk_mem_alloc.h']]], - ['vmagetpoolname_196',['vmaGetPoolName',['../vk__mem__alloc_8h.html#af09b4e4eafdbee812e8d73ddf960f030',1,'vk_mem_alloc.h']]], - ['vmagetpoolstats_197',['vmaGetPoolStats',['../vk__mem__alloc_8h.html#ae8bf76997b234ef68aad922616df4153',1,'vk_mem_alloc.h']]], - ['vmainvalidateallocation_198',['vmaInvalidateAllocation',['../vk__mem__alloc_8h.html#a0d0eb0c1102268fa9a476d12ecbe4006',1,'vk_mem_alloc.h']]], - ['vmamakepoolallocationslost_199',['vmaMakePoolAllocationsLost',['../vk__mem__alloc_8h.html#a736bd6cbda886f36c891727e73bd4024',1,'vk_mem_alloc.h']]], - ['vmamapmemory_200',['vmaMapMemory',['../vk__mem__alloc_8h.html#ad5bd1243512d099706de88168992f069',1,'vk_mem_alloc.h']]], - ['vmamemoryusage_201',['VmaMemoryUsage',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cc',1,'VmaMemoryUsage(): vk_mem_alloc.h'],['../vk__mem__alloc_8h.html#ad63b2113c0bfdbeade1cb498f5a8580d',1,'VmaMemoryUsage(): vk_mem_alloc.h']]], - ['vmapool_202',['VmaPool',['../struct_vma_pool.html',1,'']]], - ['vmapoolcreateflagbits_203',['VmaPoolCreateFlagBits',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7',1,'VmaPoolCreateFlagBits(): vk_mem_alloc.h'],['../vk__mem__alloc_8h.html#a8f93195158e0e2ac80ca352064e71c1f',1,'VmaPoolCreateFlagBits(): vk_mem_alloc.h']]], - ['vmapoolcreateflags_204',['VmaPoolCreateFlags',['../vk__mem__alloc_8h.html#a2770e325ea42e087c1b91fdf46d0292a',1,'vk_mem_alloc.h']]], - ['vmapoolcreateinfo_205',['VmaPoolCreateInfo',['../struct_vma_pool_create_info.html',1,'VmaPoolCreateInfo'],['../vk__mem__alloc_8h.html#a211706e9348dcee25a843ed4ea69bce7',1,'VmaPoolCreateInfo(): vk_mem_alloc.h']]], - ['vmapoolstats_206',['VmaPoolStats',['../struct_vma_pool_stats.html',1,'VmaPoolStats'],['../vk__mem__alloc_8h.html#a2e5612d871d64c5624087b837a338c34',1,'VmaPoolStats(): vk_mem_alloc.h']]], - ['vmarecordflagbits_207',['VmaRecordFlagBits',['../vk__mem__alloc_8h.html#a4dd2c44642312a147a4e93373a6e64d2',1,'VmaRecordFlagBits(): vk_mem_alloc.h'],['../vk__mem__alloc_8h.html#ade20b626a6635ce1bf30ea53dea774e4',1,'VmaRecordFlagBits(): vk_mem_alloc.h']]], - ['vmarecordflags_208',['VmaRecordFlags',['../vk__mem__alloc_8h.html#af3929a1a4547c592fc0b0e55ef452828',1,'vk_mem_alloc.h']]], - ['vmarecordsettings_209',['VmaRecordSettings',['../struct_vma_record_settings.html',1,'VmaRecordSettings'],['../vk__mem__alloc_8h.html#a0ab61e87ff6365f1d59915eadc37a9f0',1,'VmaRecordSettings(): vk_mem_alloc.h']]], - ['vmaresizeallocation_210',['vmaResizeAllocation',['../vk__mem__alloc_8h.html#a0ff488958ca72b28e545880463cb8696',1,'vk_mem_alloc.h']]], - ['vmasetallocationuserdata_211',['vmaSetAllocationUserData',['../vk__mem__alloc_8h.html#af9147d31ffc11d62fc187bde283ed14f',1,'vk_mem_alloc.h']]], - ['vmasetcurrentframeindex_212',['vmaSetCurrentFrameIndex',['../vk__mem__alloc_8h.html#ade56bf8dc9f5a5eaddf5f119ed525236',1,'vk_mem_alloc.h']]], - ['vmasetpoolname_213',['vmaSetPoolName',['../vk__mem__alloc_8h.html#adbae3a0b4ab078024462fc85c37f3b58',1,'vk_mem_alloc.h']]], - ['vmastatinfo_214',['VmaStatInfo',['../struct_vma_stat_info.html',1,'VmaStatInfo'],['../vk__mem__alloc_8h.html#a810b009a788ee8aac72a25b42ffbe31c',1,'VmaStatInfo(): vk_mem_alloc.h']]], - ['vmastats_215',['VmaStats',['../struct_vma_stats.html',1,'VmaStats'],['../vk__mem__alloc_8h.html#a732be855fb4a7c248e6853d928a729af',1,'VmaStats(): vk_mem_alloc.h']]], - ['vmatouchallocation_216',['vmaTouchAllocation',['../vk__mem__alloc_8h.html#a43d8ba9673c846f049089a5029d5c73a',1,'vk_mem_alloc.h']]], - ['vmaunmapmemory_217',['vmaUnmapMemory',['../vk__mem__alloc_8h.html#a9bc268595cb33f6ec4d519cfce81ff45',1,'vk_mem_alloc.h']]], - ['vmavulkanfunctions_218',['VmaVulkanFunctions',['../struct_vma_vulkan_functions.html',1,'VmaVulkanFunctions'],['../vk__mem__alloc_8h.html#a97064a1a271b0061ebfc3a079862d0c5',1,'VmaVulkanFunctions(): vk_mem_alloc.h']]], - ['vulkanapiversion_219',['vulkanApiVersion',['../struct_vma_allocator_create_info.html#ae0ffc55139b54520a6bb704b29ffc285',1,'VmaAllocatorCreateInfo']]] + ['vulkan_20memory_20allocator_83',['Vulkan Memory Allocator',['../index.html',1,'']]], + ['vk_5famd_5fdevice_5fcoherent_5fmemory_84',['VK_AMD_device_coherent_memory',['../vk_amd_device_coherent_memory.html',1,'']]], + ['vk_5fkhr_5fdedicated_5fallocation_85',['VK_KHR_dedicated_allocation',['../vk_khr_dedicated_allocation.html',1,'']]], + ['vk_5fmem_5falloc_2eh_86',['vk_mem_alloc.h',['../vk__mem__alloc_8h.html',1,'']]], + ['vkallocatememory_87',['vkAllocateMemory',['../struct_vma_vulkan_functions.html#a2943bf99dfd784a0e8f599d987e22e6c',1,'VmaVulkanFunctions']]], + ['vkbindbuffermemory_88',['vkBindBufferMemory',['../struct_vma_vulkan_functions.html#a94fc4f3a605d9880bb3c0ba2c2fc80b2',1,'VmaVulkanFunctions']]], + ['vkbindimagememory_89',['vkBindImageMemory',['../struct_vma_vulkan_functions.html#a1338d96a128a5ade648b8d934907c637',1,'VmaVulkanFunctions']]], + ['vkcmdcopybuffer_90',['vkCmdCopyBuffer',['../struct_vma_vulkan_functions.html#ae5c0db8c89a3b82593dc16aa6a49fa3a',1,'VmaVulkanFunctions']]], + ['vkcreatebuffer_91',['vkCreateBuffer',['../struct_vma_vulkan_functions.html#ae8084315a25006271a2edfc3a447519f',1,'VmaVulkanFunctions']]], + ['vkcreateimage_92',['vkCreateImage',['../struct_vma_vulkan_functions.html#a23ebe70be515b9b5010a1d691200e325',1,'VmaVulkanFunctions']]], + ['vkdestroybuffer_93',['vkDestroyBuffer',['../struct_vma_vulkan_functions.html#a7e054606faddb07f0e8556f3ed317d45',1,'VmaVulkanFunctions']]], + ['vkdestroyimage_94',['vkDestroyImage',['../struct_vma_vulkan_functions.html#a90b898227039b1dcb3520f6e91f09ffa',1,'VmaVulkanFunctions']]], + ['vkflushmappedmemoryranges_95',['vkFlushMappedMemoryRanges',['../struct_vma_vulkan_functions.html#a33c322f4c4ad2810f8a9c97a277572f9',1,'VmaVulkanFunctions']]], + ['vkfreememory_96',['vkFreeMemory',['../struct_vma_vulkan_functions.html#a4c658701778564d62034255b5dda91b4',1,'VmaVulkanFunctions']]], + ['vkgetbuffermemoryrequirements_97',['vkGetBufferMemoryRequirements',['../struct_vma_vulkan_functions.html#a5b92901df89a4194b0d12f6071d4d143',1,'VmaVulkanFunctions']]], + ['vkgetimagememoryrequirements_98',['vkGetImageMemoryRequirements',['../struct_vma_vulkan_functions.html#a475f6f49f8debe4d10800592606d53f4',1,'VmaVulkanFunctions']]], + ['vkgetphysicaldevicememoryproperties_99',['vkGetPhysicalDeviceMemoryProperties',['../struct_vma_vulkan_functions.html#a60d25c33bba06bb8592e6875cbaa9830',1,'VmaVulkanFunctions']]], + ['vkgetphysicaldeviceproperties_100',['vkGetPhysicalDeviceProperties',['../struct_vma_vulkan_functions.html#a77b7a74082823e865dd6546623468f96',1,'VmaVulkanFunctions']]], + ['vkinvalidatemappedmemoryranges_101',['vkInvalidateMappedMemoryRanges',['../struct_vma_vulkan_functions.html#a5c1093bc32386a8060c37c9f282078a1',1,'VmaVulkanFunctions']]], + ['vkmapmemory_102',['vkMapMemory',['../struct_vma_vulkan_functions.html#ab5c1f38dea3a2cf00dc9eb4f57218c49',1,'VmaVulkanFunctions']]], + ['vkunmapmemory_103',['vkUnmapMemory',['../struct_vma_vulkan_functions.html#acc798589736f0becb317fc2196c1d8b9',1,'VmaVulkanFunctions']]], + ['vma_5fallocation_5fcreate_5fcan_5fbecome_5flost_5fbit_104',['VMA_ALLOCATION_CREATE_CAN_BECOME_LOST_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a5f436af6c8fe8540573a6d22627a6fd2',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fcan_5fmake_5fother_5flost_5fbit_105',['VMA_ALLOCATION_CREATE_CAN_MAKE_OTHER_LOST_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a68686d0ce9beb0d4d1b9f2b8b1389a7e',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fdedicated_5fmemory_5fbit_106',['VMA_ALLOCATION_CREATE_DEDICATED_MEMORY_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a3fc311d855c2ff53f1090ef5c722b38f',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fdont_5fbind_5fbit_107',['VMA_ALLOCATION_CREATE_DONT_BIND_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a2310568c62208af432724305fe29ccea',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fflag_5fbits_5fmax_5fenum_108',['VMA_ALLOCATION_CREATE_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597ae5633ec569f4899cf8f29e7385b2f882',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fmapped_5fbit_109',['VMA_ALLOCATION_CREATE_MAPPED_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a11da372cc3a82931c5e5d6146cd9dd1f',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fnever_5fallocate_5fbit_110',['VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a89759603401014eb325eb22a3839f2ff',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fstrategy_5fbest_5ffit_5fbit_111',['VMA_ALLOCATION_CREATE_STRATEGY_BEST_FIT_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a839826775c62319466441f86496f036d',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fstrategy_5ffirst_5ffit_5fbit_112',['VMA_ALLOCATION_CREATE_STRATEGY_FIRST_FIT_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a33eb2052674f3ad92386c714a65fb777',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fstrategy_5fmask_113',['VMA_ALLOCATION_CREATE_STRATEGY_MASK',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a8e16845d81ae3d27c47106d4770d5c7e',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fstrategy_5fmin_5ffragmentation_5fbit_114',['VMA_ALLOCATION_CREATE_STRATEGY_MIN_FRAGMENTATION_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a621b704103eb3360230c860acf36e706',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fstrategy_5fmin_5fmemory_5fbit_115',['VMA_ALLOCATION_CREATE_STRATEGY_MIN_MEMORY_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a8af1210cf591784afa026d94998f735d',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fstrategy_5fmin_5ftime_5fbit_116',['VMA_ALLOCATION_CREATE_STRATEGY_MIN_TIME_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a0729e932b7ea170e3a128cad96c5cf6d',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fstrategy_5fworst_5ffit_5fbit_117',['VMA_ALLOCATION_CREATE_STRATEGY_WORST_FIT_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597ad242a04f802e25fef0b880afe8bb0a62',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fupper_5faddress_5fbit_118',['VMA_ALLOCATION_CREATE_UPPER_ADDRESS_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a42ba3a2d2c7117953210b7c3ef8da0df',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fuser_5fdata_5fcopy_5fstring_5fbit_119',['VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597aa6f24f821cd6a7c5e4a443f7bf59c520',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fwithin_5fbudget_5fbit_120',['VMA_ALLOCATION_CREATE_WITHIN_BUDGET_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597ab8b1764f3e9022368e440c057783b92d',1,'vk_mem_alloc.h']]], + ['vma_5fallocator_5fcreate_5famd_5fdevice_5fcoherent_5fmemory_5fbit_121',['VMA_ALLOCATOR_CREATE_AMD_DEVICE_COHERENT_MEMORY_BIT',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7ca2acce4886d8078552efa38878413970f',1,'vk_mem_alloc.h']]], + ['vma_5fallocator_5fcreate_5fext_5fmemory_5fbudget_5fbit_122',['VMA_ALLOCATOR_CREATE_EXT_MEMORY_BUDGET_BIT',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7ca4d4687863f7bd4b418c6006dc04400b0',1,'vk_mem_alloc.h']]], + ['vma_5fallocator_5fcreate_5fexternally_5fsynchronized_5fbit_123',['VMA_ALLOCATOR_CREATE_EXTERNALLY_SYNCHRONIZED_BIT',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7ca4816ddaed324ba110172ca608a20f29d',1,'vk_mem_alloc.h']]], + ['vma_5fallocator_5fcreate_5fflag_5fbits_5fmax_5fenum_124',['VMA_ALLOCATOR_CREATE_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7cae4d5ad929caba5f23eb502b13bd5286c',1,'vk_mem_alloc.h']]], + ['vma_5fallocator_5fcreate_5fkhr_5fbind_5fmemory2_5fbit_125',['VMA_ALLOCATOR_CREATE_KHR_BIND_MEMORY2_BIT',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7ca8fb75bf07cd184ab903596295e863dee',1,'vk_mem_alloc.h']]], + ['vma_5fallocator_5fcreate_5fkhr_5fdedicated_5fallocation_5fbit_126',['VMA_ALLOCATOR_CREATE_KHR_DEDICATED_ALLOCATION_BIT',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7cace7da7cc6e71a625dfa763c55a597878',1,'vk_mem_alloc.h']]], + ['vma_5fbind_5fmemory2_127',['VMA_BIND_MEMORY2',['../vk__mem__alloc_8h.html#a88bef97f86d70a34a4c0746e09a2680d',1,'vk_mem_alloc.h']]], + ['vma_5fdedicated_5fallocation_128',['VMA_DEDICATED_ALLOCATION',['../vk__mem__alloc_8h.html#af7b860e63b96d11e44ae8587ba06bbf4',1,'vk_mem_alloc.h']]], + ['vma_5fdefragmentation_5fflag_5fbits_5fmax_5fenum_129',['VMA_DEFRAGMENTATION_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#a6552a65b71d16f378c6994b3ceaef50cab87ec33154803bfeb5ac2b379f1d6a97',1,'vk_mem_alloc.h']]], + ['vma_5fdefragmentation_5fflag_5fincremental_130',['VMA_DEFRAGMENTATION_FLAG_INCREMENTAL',['../vk__mem__alloc_8h.html#a6552a65b71d16f378c6994b3ceaef50ca31af49446af2459284a568ce2f3fdd33',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fbudget_131',['VMA_MEMORY_BUDGET',['../vk__mem__alloc_8h.html#a05decf1cf4ebf767beba7acca6c1ec3a',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5fcpu_5fcopy_132',['VMA_MEMORY_USAGE_CPU_COPY',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca416a444d4d0fc20067c3f76f32ff2500',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5fcpu_5fonly_133',['VMA_MEMORY_USAGE_CPU_ONLY',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca40bdf4cddeffeb12f43d45ca1286e0a5',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5fcpu_5fto_5fgpu_134',['VMA_MEMORY_USAGE_CPU_TO_GPU',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca9066b52c5a7079bb74a69aaf8b92ff67',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5fgpu_5flazily_5fallocated_135',['VMA_MEMORY_USAGE_GPU_LAZILY_ALLOCATED',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca835333d9072db63a653818030e17614d',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5fgpu_5fonly_136',['VMA_MEMORY_USAGE_GPU_ONLY',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305ccac6b5dc1432d88647aa4cd456246eadf7',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5fgpu_5fto_5fcpu_137',['VMA_MEMORY_USAGE_GPU_TO_CPU',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca7b586d2fdaf82a463b58f581ed72be27',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5fmax_5fenum_138',['VMA_MEMORY_USAGE_MAX_ENUM',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca091e69437ef693e8d0d287f1c719ba6e',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5funknown_139',['VMA_MEMORY_USAGE_UNKNOWN',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305ccaf50d27e34e0925cf3a63db8c839121dd',1,'vk_mem_alloc.h']]], + ['vma_5fpool_5fcreate_5falgorithm_5fmask_140',['VMA_POOL_CREATE_ALGORITHM_MASK',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7af4d270f8f42517a0f70037ceb6ac1d9c',1,'vk_mem_alloc.h']]], + ['vma_5fpool_5fcreate_5fbuddy_5falgorithm_5fbit_141',['VMA_POOL_CREATE_BUDDY_ALGORITHM_BIT',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7a97a0dc38e5161b780594d998d313d35e',1,'vk_mem_alloc.h']]], + ['vma_5fpool_5fcreate_5fflag_5fbits_5fmax_5fenum_142',['VMA_POOL_CREATE_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7a1c7312bea9ea246846b9054fd6bd6aec',1,'vk_mem_alloc.h']]], + ['vma_5fpool_5fcreate_5fignore_5fbuffer_5fimage_5fgranularity_5fbit_143',['VMA_POOL_CREATE_IGNORE_BUFFER_IMAGE_GRANULARITY_BIT',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7a9f1a499508a8edb4e8ba40aa0290a3d2',1,'vk_mem_alloc.h']]], + ['vma_5fpool_5fcreate_5flinear_5falgorithm_5fbit_144',['VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7a13c8a444197c67866be9cb05599fc726',1,'vk_mem_alloc.h']]], + ['vma_5frecord_5fflag_5fbits_5fmax_5fenum_145',['VMA_RECORD_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#a4dd2c44642312a147a4e93373a6e64d2a20dd17d69966dbffa054739d6090b85e',1,'vk_mem_alloc.h']]], + ['vma_5frecord_5fflush_5fafter_5fcall_5fbit_146',['VMA_RECORD_FLUSH_AFTER_CALL_BIT',['../vk__mem__alloc_8h.html#a4dd2c44642312a147a4e93373a6e64d2a8e7ab322e8732654be627c4ea8f36cc7',1,'vk_mem_alloc.h']]], + ['vma_5frecording_5fenabled_147',['VMA_RECORDING_ENABLED',['../vk__mem__alloc_8h.html#a1f0c126759fc96ccb6e2d23c101d770c',1,'vk_mem_alloc.h']]], + ['vma_5fstats_5fstring_5fenabled_148',['VMA_STATS_STRING_ENABLED',['../vk__mem__alloc_8h.html#ae25f0d55fd91cb166f002b63244800e1',1,'vk_mem_alloc.h']]], + ['vma_5fvulkan_5fversion_149',['VMA_VULKAN_VERSION',['../vk__mem__alloc_8h.html#a1a2407c283893638cc039bb31fcd74b6',1,'vk_mem_alloc.h']]], + ['vmaallocatememory_150',['vmaAllocateMemory',['../vk__mem__alloc_8h.html#abf28077dbf82d0908b8acbe8ee8dd9b8',1,'vk_mem_alloc.h']]], + ['vmaallocatememoryforbuffer_151',['vmaAllocateMemoryForBuffer',['../vk__mem__alloc_8h.html#a7fdf64415b6c3d83c454f28d2c53df7b',1,'vk_mem_alloc.h']]], + ['vmaallocatememoryforimage_152',['vmaAllocateMemoryForImage',['../vk__mem__alloc_8h.html#a0faa3f9e5fb233d29d1e00390650febb',1,'vk_mem_alloc.h']]], + ['vmaallocatememorypages_153',['vmaAllocateMemoryPages',['../vk__mem__alloc_8h.html#ad37e82e492b3de38fc3f4cffd9ad0ae1',1,'vk_mem_alloc.h']]], + ['vmaallocation_154',['VmaAllocation',['../struct_vma_allocation.html',1,'']]], + ['vmaallocationcreateflagbits_155',['VmaAllocationCreateFlagBits',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597',1,'VmaAllocationCreateFlagBits(): vk_mem_alloc.h'],['../vk__mem__alloc_8h.html#abf6bf6748c7a9fe7ce5b7835c0f56af4',1,'VmaAllocationCreateFlagBits(): vk_mem_alloc.h']]], + ['vmaallocationcreateflags_156',['VmaAllocationCreateFlags',['../vk__mem__alloc_8h.html#a5225e5e11f8376f6a31a1791f3d6e817',1,'vk_mem_alloc.h']]], + ['vmaallocationcreateinfo_157',['VmaAllocationCreateInfo',['../struct_vma_allocation_create_info.html',1,'VmaAllocationCreateInfo'],['../vk__mem__alloc_8h.html#a86c44f9950b40d50088ed93a17870a7a',1,'VmaAllocationCreateInfo(): vk_mem_alloc.h']]], + ['vmaallocationinfo_158',['VmaAllocationInfo',['../struct_vma_allocation_info.html',1,'VmaAllocationInfo'],['../vk__mem__alloc_8h.html#a795e6ff02a21d5486c0565f403dd9255',1,'VmaAllocationInfo(): vk_mem_alloc.h']]], + ['vmaallocator_159',['VmaAllocator',['../struct_vma_allocator.html',1,'']]], + ['vmaallocatorcreateflagbits_160',['VmaAllocatorCreateFlagBits',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7c',1,'VmaAllocatorCreateFlagBits(): vk_mem_alloc.h'],['../vk__mem__alloc_8h.html#a4ddf381b6ce795bdfbc6c614640b9915',1,'VmaAllocatorCreateFlagBits(): vk_mem_alloc.h']]], + ['vmaallocatorcreateflags_161',['VmaAllocatorCreateFlags',['../vk__mem__alloc_8h.html#acfe6863e160722c2c1bbcf7573fddc4d',1,'vk_mem_alloc.h']]], + ['vmaallocatorcreateinfo_162',['VmaAllocatorCreateInfo',['../struct_vma_allocator_create_info.html',1,'VmaAllocatorCreateInfo'],['../vk__mem__alloc_8h.html#ae0f6d1d733dded220d28134da46b4283',1,'VmaAllocatorCreateInfo(): vk_mem_alloc.h']]], + ['vmabegindefragmentationpass_163',['vmaBeginDefragmentationPass',['../vk__mem__alloc_8h.html#ac0f01545b6262f7d4d128fc8f8e5c77b',1,'vk_mem_alloc.h']]], + ['vmabindbuffermemory_164',['vmaBindBufferMemory',['../vk__mem__alloc_8h.html#a6b0929b914b60cf2d45cac4bf3547470',1,'vk_mem_alloc.h']]], + ['vmabindbuffermemory2_165',['vmaBindBufferMemory2',['../vk__mem__alloc_8h.html#a927c944f45e0f2941182abb6f608e64a',1,'vk_mem_alloc.h']]], + ['vmabindimagememory_166',['vmaBindImageMemory',['../vk__mem__alloc_8h.html#a3d3ca45799923aa5d138e9e5f9eb2da5',1,'vk_mem_alloc.h']]], + ['vmabindimagememory2_167',['vmaBindImageMemory2',['../vk__mem__alloc_8h.html#aa8251ee81b0045a443e35b8e8aa021bc',1,'vk_mem_alloc.h']]], + ['vmabudget_168',['VmaBudget',['../struct_vma_budget.html',1,'VmaBudget'],['../vk__mem__alloc_8h.html#ab79b48b6d25aada0de91a913896e1c38',1,'VmaBudget(): vk_mem_alloc.h']]], + ['vmabuildstatsstring_169',['vmaBuildStatsString',['../vk__mem__alloc_8h.html#aa4fee7eb5253377599ef4fd38c93c2a0',1,'vk_mem_alloc.h']]], + ['vmacalculatestats_170',['vmaCalculateStats',['../vk__mem__alloc_8h.html#a333b61c1788cb23559177531e6a93ca3',1,'vk_mem_alloc.h']]], + ['vmacheckcorruption_171',['vmaCheckCorruption',['../vk__mem__alloc_8h.html#a49329a7f030dafcf82f7b73334c22e98',1,'vk_mem_alloc.h']]], + ['vmacheckpoolcorruption_172',['vmaCheckPoolCorruption',['../vk__mem__alloc_8h.html#ad535935619c7a549bf837e1bb0068f89',1,'vk_mem_alloc.h']]], + ['vmacreateallocator_173',['vmaCreateAllocator',['../vk__mem__alloc_8h.html#a200692051ddb34240248234f5f4c17bb',1,'vk_mem_alloc.h']]], + ['vmacreatebuffer_174',['vmaCreateBuffer',['../vk__mem__alloc_8h.html#ac72ee55598617e8eecca384e746bab51',1,'vk_mem_alloc.h']]], + ['vmacreateimage_175',['vmaCreateImage',['../vk__mem__alloc_8h.html#a02a94f25679275851a53e82eacbcfc73',1,'vk_mem_alloc.h']]], + ['vmacreatelostallocation_176',['vmaCreateLostAllocation',['../vk__mem__alloc_8h.html#ae5c9657d9e94756269145b01c05d16f1',1,'vk_mem_alloc.h']]], + ['vmacreatepool_177',['vmaCreatePool',['../vk__mem__alloc_8h.html#a5c8770ded7c59c8caac6de0c2cb00b50',1,'vk_mem_alloc.h']]], + ['vmadefragment_178',['vmaDefragment',['../vk__mem__alloc_8h.html#a6aced90fcc7b39882b6654a740a0b9bb',1,'vk_mem_alloc.h']]], + ['vmadefragmentationbegin_179',['vmaDefragmentationBegin',['../vk__mem__alloc_8h.html#a36ba776fd7fd5cb1e9359fdc0d8e6e8a',1,'vk_mem_alloc.h']]], + ['vmadefragmentationcontext_180',['VmaDefragmentationContext',['../struct_vma_defragmentation_context.html',1,'']]], + ['vmadefragmentationend_181',['vmaDefragmentationEnd',['../vk__mem__alloc_8h.html#a8774e20e91e245aae959ba63efa15dd2',1,'vk_mem_alloc.h']]], + ['vmadefragmentationflagbits_182',['VmaDefragmentationFlagBits',['../vk__mem__alloc_8h.html#a6552a65b71d16f378c6994b3ceaef50c',1,'VmaDefragmentationFlagBits(): vk_mem_alloc.h'],['../vk__mem__alloc_8h.html#a96df0eddab2e1735782fe4e7cd05ea7f',1,'VmaDefragmentationFlagBits(): vk_mem_alloc.h']]], + ['vmadefragmentationflags_183',['VmaDefragmentationFlags',['../vk__mem__alloc_8h.html#a88a77cef37e5d3c4fc9eb328885d048d',1,'vk_mem_alloc.h']]], + ['vmadefragmentationinfo_184',['VmaDefragmentationInfo',['../struct_vma_defragmentation_info.html',1,'VmaDefragmentationInfo'],['../vk__mem__alloc_8h.html#ae67f8573a0cf20f16f0a1eecbca566a0',1,'VmaDefragmentationInfo(): vk_mem_alloc.h']]], + ['vmadefragmentationinfo2_185',['VmaDefragmentationInfo2',['../struct_vma_defragmentation_info2.html',1,'VmaDefragmentationInfo2'],['../vk__mem__alloc_8h.html#abac0e85abaa6ea1ffd63bde29c5c3a29',1,'VmaDefragmentationInfo2(): vk_mem_alloc.h']]], + ['vmadefragmentationpassinfo_186',['VmaDefragmentationPassInfo',['../struct_vma_defragmentation_pass_info.html',1,'VmaDefragmentationPassInfo'],['../vk__mem__alloc_8h.html#a2d0b0d6a81ba60e9c2d3d83ca1f01971',1,'VmaDefragmentationPassInfo(): vk_mem_alloc.h']]], + ['vmadefragmentationpassmoveinfo_187',['VmaDefragmentationPassMoveInfo',['../struct_vma_defragmentation_pass_move_info.html',1,'VmaDefragmentationPassMoveInfo'],['../vk__mem__alloc_8h.html#a459f238c542cedaa8d3cfabc024c39b5',1,'VmaDefragmentationPassMoveInfo(): vk_mem_alloc.h']]], + ['vmadefragmentationstats_188',['VmaDefragmentationStats',['../struct_vma_defragmentation_stats.html',1,'VmaDefragmentationStats'],['../vk__mem__alloc_8h.html#ab0f9b06441c840fee560de4a2967f8c9',1,'VmaDefragmentationStats(): vk_mem_alloc.h']]], + ['vmadestroyallocator_189',['vmaDestroyAllocator',['../vk__mem__alloc_8h.html#aa8d164061c88f22fb1fd3c8f3534bc1d',1,'vk_mem_alloc.h']]], + ['vmadestroybuffer_190',['vmaDestroyBuffer',['../vk__mem__alloc_8h.html#a0d9f4e4ba5bf9aab1f1c746387753d77',1,'vk_mem_alloc.h']]], + ['vmadestroyimage_191',['vmaDestroyImage',['../vk__mem__alloc_8h.html#ae50d2cb3b4a3bfd4dd40987234e50e7e',1,'vk_mem_alloc.h']]], + ['vmadestroypool_192',['vmaDestroyPool',['../vk__mem__alloc_8h.html#a5485779c8f1948238fc4e92232fa65e1',1,'vk_mem_alloc.h']]], + ['vmadevicememorycallbacks_193',['VmaDeviceMemoryCallbacks',['../struct_vma_device_memory_callbacks.html',1,'VmaDeviceMemoryCallbacks'],['../vk__mem__alloc_8h.html#a5e2eb68d727cfd4df25702b027b7aa31',1,'VmaDeviceMemoryCallbacks(): vk_mem_alloc.h']]], + ['vmaenddefragmentationpass_194',['vmaEndDefragmentationPass',['../vk__mem__alloc_8h.html#a1b9ffa538bed905af55c747cc48963bd',1,'vk_mem_alloc.h']]], + ['vmafindmemorytypeindex_195',['vmaFindMemoryTypeIndex',['../vk__mem__alloc_8h.html#aef15a94b58fbcb0fe706d5720e84a74a',1,'vk_mem_alloc.h']]], + ['vmafindmemorytypeindexforbufferinfo_196',['vmaFindMemoryTypeIndexForBufferInfo',['../vk__mem__alloc_8h.html#ae790ab9ffaf7667fb8f62523e6897888',1,'vk_mem_alloc.h']]], + ['vmafindmemorytypeindexforimageinfo_197',['vmaFindMemoryTypeIndexForImageInfo',['../vk__mem__alloc_8h.html#a088da83d8eaf3ce9056d9ea0b981d472',1,'vk_mem_alloc.h']]], + ['vmaflushallocation_198',['vmaFlushAllocation',['../vk__mem__alloc_8h.html#abc34ee6f021f459aff885f3758c435de',1,'vk_mem_alloc.h']]], + ['vmafreememory_199',['vmaFreeMemory',['../vk__mem__alloc_8h.html#a11f0fbc034fa81a4efedd73d61ce7568',1,'vk_mem_alloc.h']]], + ['vmafreememorypages_200',['vmaFreeMemoryPages',['../vk__mem__alloc_8h.html#ab9e709de044c5d8476bea77a4e755840',1,'vk_mem_alloc.h']]], + ['vmafreestatsstring_201',['vmaFreeStatsString',['../vk__mem__alloc_8h.html#a3104eb30d8122c84dd8541063f145288',1,'vk_mem_alloc.h']]], + ['vmagetallocationinfo_202',['vmaGetAllocationInfo',['../vk__mem__alloc_8h.html#a86dd08aba8633bfa4ad0df2e76481d8b',1,'vk_mem_alloc.h']]], + ['vmagetbudget_203',['vmaGetBudget',['../vk__mem__alloc_8h.html#aec0ed24ebea2d0099eed5f801daaefba',1,'vk_mem_alloc.h']]], + ['vmagetmemoryproperties_204',['vmaGetMemoryProperties',['../vk__mem__alloc_8h.html#ab88db292a17974f911182543fda52d19',1,'vk_mem_alloc.h']]], + ['vmagetmemorytypeproperties_205',['vmaGetMemoryTypeProperties',['../vk__mem__alloc_8h.html#a8701444752eb5de4464adb5a2b514bca',1,'vk_mem_alloc.h']]], + ['vmagetphysicaldeviceproperties_206',['vmaGetPhysicalDeviceProperties',['../vk__mem__alloc_8h.html#aecabf7b6e91ea87d0316fa0a9e014fe0',1,'vk_mem_alloc.h']]], + ['vmagetpoolname_207',['vmaGetPoolName',['../vk__mem__alloc_8h.html#af09b4e4eafdbee812e8d73ddf960f030',1,'vk_mem_alloc.h']]], + ['vmagetpoolstats_208',['vmaGetPoolStats',['../vk__mem__alloc_8h.html#ae8bf76997b234ef68aad922616df4153',1,'vk_mem_alloc.h']]], + ['vmainvalidateallocation_209',['vmaInvalidateAllocation',['../vk__mem__alloc_8h.html#a0d0eb0c1102268fa9a476d12ecbe4006',1,'vk_mem_alloc.h']]], + ['vmamakepoolallocationslost_210',['vmaMakePoolAllocationsLost',['../vk__mem__alloc_8h.html#a736bd6cbda886f36c891727e73bd4024',1,'vk_mem_alloc.h']]], + ['vmamapmemory_211',['vmaMapMemory',['../vk__mem__alloc_8h.html#ad5bd1243512d099706de88168992f069',1,'vk_mem_alloc.h']]], + ['vmamemoryusage_212',['VmaMemoryUsage',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cc',1,'VmaMemoryUsage(): vk_mem_alloc.h'],['../vk__mem__alloc_8h.html#ad63b2113c0bfdbeade1cb498f5a8580d',1,'VmaMemoryUsage(): vk_mem_alloc.h']]], + ['vmapool_213',['VmaPool',['../struct_vma_pool.html',1,'']]], + ['vmapoolcreateflagbits_214',['VmaPoolCreateFlagBits',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7',1,'VmaPoolCreateFlagBits(): vk_mem_alloc.h'],['../vk__mem__alloc_8h.html#a8f93195158e0e2ac80ca352064e71c1f',1,'VmaPoolCreateFlagBits(): vk_mem_alloc.h']]], + ['vmapoolcreateflags_215',['VmaPoolCreateFlags',['../vk__mem__alloc_8h.html#a2770e325ea42e087c1b91fdf46d0292a',1,'vk_mem_alloc.h']]], + ['vmapoolcreateinfo_216',['VmaPoolCreateInfo',['../struct_vma_pool_create_info.html',1,'VmaPoolCreateInfo'],['../vk__mem__alloc_8h.html#a211706e9348dcee25a843ed4ea69bce7',1,'VmaPoolCreateInfo(): vk_mem_alloc.h']]], + ['vmapoolstats_217',['VmaPoolStats',['../struct_vma_pool_stats.html',1,'VmaPoolStats'],['../vk__mem__alloc_8h.html#a2e5612d871d64c5624087b837a338c34',1,'VmaPoolStats(): vk_mem_alloc.h']]], + ['vmarecordflagbits_218',['VmaRecordFlagBits',['../vk__mem__alloc_8h.html#a4dd2c44642312a147a4e93373a6e64d2',1,'VmaRecordFlagBits(): vk_mem_alloc.h'],['../vk__mem__alloc_8h.html#ade20b626a6635ce1bf30ea53dea774e4',1,'VmaRecordFlagBits(): vk_mem_alloc.h']]], + ['vmarecordflags_219',['VmaRecordFlags',['../vk__mem__alloc_8h.html#af3929a1a4547c592fc0b0e55ef452828',1,'vk_mem_alloc.h']]], + ['vmarecordsettings_220',['VmaRecordSettings',['../struct_vma_record_settings.html',1,'VmaRecordSettings'],['../vk__mem__alloc_8h.html#a0ab61e87ff6365f1d59915eadc37a9f0',1,'VmaRecordSettings(): vk_mem_alloc.h']]], + ['vmaresizeallocation_221',['vmaResizeAllocation',['../vk__mem__alloc_8h.html#a0ff488958ca72b28e545880463cb8696',1,'vk_mem_alloc.h']]], + ['vmasetallocationuserdata_222',['vmaSetAllocationUserData',['../vk__mem__alloc_8h.html#af9147d31ffc11d62fc187bde283ed14f',1,'vk_mem_alloc.h']]], + ['vmasetcurrentframeindex_223',['vmaSetCurrentFrameIndex',['../vk__mem__alloc_8h.html#ade56bf8dc9f5a5eaddf5f119ed525236',1,'vk_mem_alloc.h']]], + ['vmasetpoolname_224',['vmaSetPoolName',['../vk__mem__alloc_8h.html#adbae3a0b4ab078024462fc85c37f3b58',1,'vk_mem_alloc.h']]], + ['vmastatinfo_225',['VmaStatInfo',['../struct_vma_stat_info.html',1,'VmaStatInfo'],['../vk__mem__alloc_8h.html#a810b009a788ee8aac72a25b42ffbe31c',1,'VmaStatInfo(): vk_mem_alloc.h']]], + ['vmastats_226',['VmaStats',['../struct_vma_stats.html',1,'VmaStats'],['../vk__mem__alloc_8h.html#a732be855fb4a7c248e6853d928a729af',1,'VmaStats(): vk_mem_alloc.h']]], + ['vmatouchallocation_227',['vmaTouchAllocation',['../vk__mem__alloc_8h.html#a43d8ba9673c846f049089a5029d5c73a',1,'vk_mem_alloc.h']]], + ['vmaunmapmemory_228',['vmaUnmapMemory',['../vk__mem__alloc_8h.html#a9bc268595cb33f6ec4d519cfce81ff45',1,'vk_mem_alloc.h']]], + ['vmavulkanfunctions_229',['VmaVulkanFunctions',['../struct_vma_vulkan_functions.html',1,'VmaVulkanFunctions'],['../vk__mem__alloc_8h.html#a97064a1a271b0061ebfc3a079862d0c5',1,'VmaVulkanFunctions(): vk_mem_alloc.h']]], + ['vulkanapiversion_230',['vulkanApiVersion',['../struct_vma_allocator_create_info.html#ae0ffc55139b54520a6bb704b29ffc285',1,'VmaAllocatorCreateInfo']]] ]; diff --git a/docs/html/search/all_12.html b/docs/html/search/all_12.html new file mode 100644 index 0000000..6b0988c --- /dev/null +++ b/docs/html/search/all_12.html @@ -0,0 +1,30 @@ + + + + + + + + + +
      +
      Loading...
      +
      + +
      Searching...
      +
      No Matches
      + +
      + + diff --git a/docs/html/search/all_12.js b/docs/html/search/all_12.js new file mode 100644 index 0000000..e4e1789 --- /dev/null +++ b/docs/html/search/all_12.js @@ -0,0 +1,150 @@ +var searchData= +[ + ['vulkan_20memory_20allocator_84',['Vulkan Memory Allocator',['../index.html',1,'']]], + ['vk_5fkhr_5fdedicated_5fallocation_85',['VK_KHR_dedicated_allocation',['../vk_khr_dedicated_allocation.html',1,'']]], + ['vk_5fmem_5falloc_2eh_86',['vk_mem_alloc.h',['../vk__mem__alloc_8h.html',1,'']]], + ['vkallocatememory_87',['vkAllocateMemory',['../struct_vma_vulkan_functions.html#a2943bf99dfd784a0e8f599d987e22e6c',1,'VmaVulkanFunctions']]], + ['vkbindbuffermemory_88',['vkBindBufferMemory',['../struct_vma_vulkan_functions.html#a94fc4f3a605d9880bb3c0ba2c2fc80b2',1,'VmaVulkanFunctions']]], + ['vkbindimagememory_89',['vkBindImageMemory',['../struct_vma_vulkan_functions.html#a1338d96a128a5ade648b8d934907c637',1,'VmaVulkanFunctions']]], + ['vkcmdcopybuffer_90',['vkCmdCopyBuffer',['../struct_vma_vulkan_functions.html#ae5c0db8c89a3b82593dc16aa6a49fa3a',1,'VmaVulkanFunctions']]], + ['vkcreatebuffer_91',['vkCreateBuffer',['../struct_vma_vulkan_functions.html#ae8084315a25006271a2edfc3a447519f',1,'VmaVulkanFunctions']]], + ['vkcreateimage_92',['vkCreateImage',['../struct_vma_vulkan_functions.html#a23ebe70be515b9b5010a1d691200e325',1,'VmaVulkanFunctions']]], + ['vkdestroybuffer_93',['vkDestroyBuffer',['../struct_vma_vulkan_functions.html#a7e054606faddb07f0e8556f3ed317d45',1,'VmaVulkanFunctions']]], + ['vkdestroyimage_94',['vkDestroyImage',['../struct_vma_vulkan_functions.html#a90b898227039b1dcb3520f6e91f09ffa',1,'VmaVulkanFunctions']]], + ['vkflushmappedmemoryranges_95',['vkFlushMappedMemoryRanges',['../struct_vma_vulkan_functions.html#a33c322f4c4ad2810f8a9c97a277572f9',1,'VmaVulkanFunctions']]], + ['vkfreememory_96',['vkFreeMemory',['../struct_vma_vulkan_functions.html#a4c658701778564d62034255b5dda91b4',1,'VmaVulkanFunctions']]], + ['vkgetbuffermemoryrequirements_97',['vkGetBufferMemoryRequirements',['../struct_vma_vulkan_functions.html#a5b92901df89a4194b0d12f6071d4d143',1,'VmaVulkanFunctions']]], + ['vkgetimagememoryrequirements_98',['vkGetImageMemoryRequirements',['../struct_vma_vulkan_functions.html#a475f6f49f8debe4d10800592606d53f4',1,'VmaVulkanFunctions']]], + ['vkgetphysicaldevicememoryproperties_99',['vkGetPhysicalDeviceMemoryProperties',['../struct_vma_vulkan_functions.html#a60d25c33bba06bb8592e6875cbaa9830',1,'VmaVulkanFunctions']]], + ['vkgetphysicaldeviceproperties_100',['vkGetPhysicalDeviceProperties',['../struct_vma_vulkan_functions.html#a77b7a74082823e865dd6546623468f96',1,'VmaVulkanFunctions']]], + ['vkinvalidatemappedmemoryranges_101',['vkInvalidateMappedMemoryRanges',['../struct_vma_vulkan_functions.html#a5c1093bc32386a8060c37c9f282078a1',1,'VmaVulkanFunctions']]], + ['vkmapmemory_102',['vkMapMemory',['../struct_vma_vulkan_functions.html#ab5c1f38dea3a2cf00dc9eb4f57218c49',1,'VmaVulkanFunctions']]], + ['vkunmapmemory_103',['vkUnmapMemory',['../struct_vma_vulkan_functions.html#acc798589736f0becb317fc2196c1d8b9',1,'VmaVulkanFunctions']]], + ['vma_5fallocation_5fcreate_5fcan_5fbecome_5flost_5fbit_104',['VMA_ALLOCATION_CREATE_CAN_BECOME_LOST_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a5f436af6c8fe8540573a6d22627a6fd2',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fcan_5fmake_5fother_5flost_5fbit_105',['VMA_ALLOCATION_CREATE_CAN_MAKE_OTHER_LOST_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a68686d0ce9beb0d4d1b9f2b8b1389a7e',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fdedicated_5fmemory_5fbit_106',['VMA_ALLOCATION_CREATE_DEDICATED_MEMORY_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a3fc311d855c2ff53f1090ef5c722b38f',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fdont_5fbind_5fbit_107',['VMA_ALLOCATION_CREATE_DONT_BIND_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a2310568c62208af432724305fe29ccea',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fflag_5fbits_5fmax_5fenum_108',['VMA_ALLOCATION_CREATE_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597ae5633ec569f4899cf8f29e7385b2f882',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fmapped_5fbit_109',['VMA_ALLOCATION_CREATE_MAPPED_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a11da372cc3a82931c5e5d6146cd9dd1f',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fnever_5fallocate_5fbit_110',['VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a89759603401014eb325eb22a3839f2ff',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fstrategy_5fbest_5ffit_5fbit_111',['VMA_ALLOCATION_CREATE_STRATEGY_BEST_FIT_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a839826775c62319466441f86496f036d',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fstrategy_5ffirst_5ffit_5fbit_112',['VMA_ALLOCATION_CREATE_STRATEGY_FIRST_FIT_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a33eb2052674f3ad92386c714a65fb777',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fstrategy_5fmask_113',['VMA_ALLOCATION_CREATE_STRATEGY_MASK',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a8e16845d81ae3d27c47106d4770d5c7e',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fstrategy_5fmin_5ffragmentation_5fbit_114',['VMA_ALLOCATION_CREATE_STRATEGY_MIN_FRAGMENTATION_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a621b704103eb3360230c860acf36e706',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fstrategy_5fmin_5fmemory_5fbit_115',['VMA_ALLOCATION_CREATE_STRATEGY_MIN_MEMORY_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a8af1210cf591784afa026d94998f735d',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fstrategy_5fmin_5ftime_5fbit_116',['VMA_ALLOCATION_CREATE_STRATEGY_MIN_TIME_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a0729e932b7ea170e3a128cad96c5cf6d',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fstrategy_5fworst_5ffit_5fbit_117',['VMA_ALLOCATION_CREATE_STRATEGY_WORST_FIT_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597ad242a04f802e25fef0b880afe8bb0a62',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fupper_5faddress_5fbit_118',['VMA_ALLOCATION_CREATE_UPPER_ADDRESS_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a42ba3a2d2c7117953210b7c3ef8da0df',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fuser_5fdata_5fcopy_5fstring_5fbit_119',['VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597aa6f24f821cd6a7c5e4a443f7bf59c520',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fwithin_5fbudget_5fbit_120',['VMA_ALLOCATION_CREATE_WITHIN_BUDGET_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597ab8b1764f3e9022368e440c057783b92d',1,'vk_mem_alloc.h']]], + ['vma_5fallocator_5fcreate_5famd_5fdevice_5fcoherent_5fmemory_5fbit_121',['VMA_ALLOCATOR_CREATE_AMD_DEVICE_COHERENT_MEMORY_BIT',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7ca2acce4886d8078552efa38878413970f',1,'vk_mem_alloc.h']]], + ['vma_5fallocator_5fcreate_5fext_5fmemory_5fbudget_5fbit_122',['VMA_ALLOCATOR_CREATE_EXT_MEMORY_BUDGET_BIT',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7ca4d4687863f7bd4b418c6006dc04400b0',1,'vk_mem_alloc.h']]], + ['vma_5fallocator_5fcreate_5fexternally_5fsynchronized_5fbit_123',['VMA_ALLOCATOR_CREATE_EXTERNALLY_SYNCHRONIZED_BIT',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7ca4816ddaed324ba110172ca608a20f29d',1,'vk_mem_alloc.h']]], + ['vma_5fallocator_5fcreate_5fflag_5fbits_5fmax_5fenum_124',['VMA_ALLOCATOR_CREATE_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7cae4d5ad929caba5f23eb502b13bd5286c',1,'vk_mem_alloc.h']]], + ['vma_5fallocator_5fcreate_5fkhr_5fbind_5fmemory2_5fbit_125',['VMA_ALLOCATOR_CREATE_KHR_BIND_MEMORY2_BIT',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7ca8fb75bf07cd184ab903596295e863dee',1,'vk_mem_alloc.h']]], + ['vma_5fallocator_5fcreate_5fkhr_5fdedicated_5fallocation_5fbit_126',['VMA_ALLOCATOR_CREATE_KHR_DEDICATED_ALLOCATION_BIT',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7cace7da7cc6e71a625dfa763c55a597878',1,'vk_mem_alloc.h']]], + ['vma_5fbind_5fmemory2_127',['VMA_BIND_MEMORY2',['../vk__mem__alloc_8h.html#a88bef97f86d70a34a4c0746e09a2680d',1,'vk_mem_alloc.h']]], + ['vma_5fdedicated_5fallocation_128',['VMA_DEDICATED_ALLOCATION',['../vk__mem__alloc_8h.html#af7b860e63b96d11e44ae8587ba06bbf4',1,'vk_mem_alloc.h']]], + ['vma_5fdefragmentation_5fflag_5fbits_5fmax_5fenum_129',['VMA_DEFRAGMENTATION_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#a6552a65b71d16f378c6994b3ceaef50cab87ec33154803bfeb5ac2b379f1d6a97',1,'vk_mem_alloc.h']]], + ['vma_5fdefragmentation_5fflag_5fincremental_130',['VMA_DEFRAGMENTATION_FLAG_INCREMENTAL',['../vk__mem__alloc_8h.html#a6552a65b71d16f378c6994b3ceaef50ca31af49446af2459284a568ce2f3fdd33',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fbudget_131',['VMA_MEMORY_BUDGET',['../vk__mem__alloc_8h.html#a05decf1cf4ebf767beba7acca6c1ec3a',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5fcpu_5fcopy_132',['VMA_MEMORY_USAGE_CPU_COPY',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca416a444d4d0fc20067c3f76f32ff2500',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5fcpu_5fonly_133',['VMA_MEMORY_USAGE_CPU_ONLY',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca40bdf4cddeffeb12f43d45ca1286e0a5',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5fcpu_5fto_5fgpu_134',['VMA_MEMORY_USAGE_CPU_TO_GPU',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca9066b52c5a7079bb74a69aaf8b92ff67',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5fgpu_5flazily_5fallocated_135',['VMA_MEMORY_USAGE_GPU_LAZILY_ALLOCATED',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca835333d9072db63a653818030e17614d',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5fgpu_5fonly_136',['VMA_MEMORY_USAGE_GPU_ONLY',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305ccac6b5dc1432d88647aa4cd456246eadf7',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5fgpu_5fto_5fcpu_137',['VMA_MEMORY_USAGE_GPU_TO_CPU',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca7b586d2fdaf82a463b58f581ed72be27',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5fmax_5fenum_138',['VMA_MEMORY_USAGE_MAX_ENUM',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca091e69437ef693e8d0d287f1c719ba6e',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5funknown_139',['VMA_MEMORY_USAGE_UNKNOWN',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305ccaf50d27e34e0925cf3a63db8c839121dd',1,'vk_mem_alloc.h']]], + ['vma_5fpool_5fcreate_5falgorithm_5fmask_140',['VMA_POOL_CREATE_ALGORITHM_MASK',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7af4d270f8f42517a0f70037ceb6ac1d9c',1,'vk_mem_alloc.h']]], + ['vma_5fpool_5fcreate_5fbuddy_5falgorithm_5fbit_141',['VMA_POOL_CREATE_BUDDY_ALGORITHM_BIT',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7a97a0dc38e5161b780594d998d313d35e',1,'vk_mem_alloc.h']]], + ['vma_5fpool_5fcreate_5fflag_5fbits_5fmax_5fenum_142',['VMA_POOL_CREATE_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7a1c7312bea9ea246846b9054fd6bd6aec',1,'vk_mem_alloc.h']]], + ['vma_5fpool_5fcreate_5fignore_5fbuffer_5fimage_5fgranularity_5fbit_143',['VMA_POOL_CREATE_IGNORE_BUFFER_IMAGE_GRANULARITY_BIT',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7a9f1a499508a8edb4e8ba40aa0290a3d2',1,'vk_mem_alloc.h']]], + ['vma_5fpool_5fcreate_5flinear_5falgorithm_5fbit_144',['VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7a13c8a444197c67866be9cb05599fc726',1,'vk_mem_alloc.h']]], + ['vma_5frecord_5fflag_5fbits_5fmax_5fenum_145',['VMA_RECORD_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#a4dd2c44642312a147a4e93373a6e64d2a20dd17d69966dbffa054739d6090b85e',1,'vk_mem_alloc.h']]], + ['vma_5frecord_5fflush_5fafter_5fcall_5fbit_146',['VMA_RECORD_FLUSH_AFTER_CALL_BIT',['../vk__mem__alloc_8h.html#a4dd2c44642312a147a4e93373a6e64d2a8e7ab322e8732654be627c4ea8f36cc7',1,'vk_mem_alloc.h']]], + ['vma_5frecording_5fenabled_147',['VMA_RECORDING_ENABLED',['../vk__mem__alloc_8h.html#a1f0c126759fc96ccb6e2d23c101d770c',1,'vk_mem_alloc.h']]], + ['vma_5fstats_5fstring_5fenabled_148',['VMA_STATS_STRING_ENABLED',['../vk__mem__alloc_8h.html#ae25f0d55fd91cb166f002b63244800e1',1,'vk_mem_alloc.h']]], + ['vma_5fvulkan_5fversion_149',['VMA_VULKAN_VERSION',['../vk__mem__alloc_8h.html#a1a2407c283893638cc039bb31fcd74b6',1,'vk_mem_alloc.h']]], + ['vmaallocatememory_150',['vmaAllocateMemory',['../vk__mem__alloc_8h.html#abf28077dbf82d0908b8acbe8ee8dd9b8',1,'vk_mem_alloc.h']]], + ['vmaallocatememoryforbuffer_151',['vmaAllocateMemoryForBuffer',['../vk__mem__alloc_8h.html#a7fdf64415b6c3d83c454f28d2c53df7b',1,'vk_mem_alloc.h']]], + ['vmaallocatememoryforimage_152',['vmaAllocateMemoryForImage',['../vk__mem__alloc_8h.html#a0faa3f9e5fb233d29d1e00390650febb',1,'vk_mem_alloc.h']]], + ['vmaallocatememorypages_153',['vmaAllocateMemoryPages',['../vk__mem__alloc_8h.html#ad37e82e492b3de38fc3f4cffd9ad0ae1',1,'vk_mem_alloc.h']]], + ['vmaallocation_154',['VmaAllocation',['../struct_vma_allocation.html',1,'']]], + ['vmaallocationcreateflagbits_155',['VmaAllocationCreateFlagBits',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597',1,'VmaAllocationCreateFlagBits(): vk_mem_alloc.h'],['../vk__mem__alloc_8h.html#abf6bf6748c7a9fe7ce5b7835c0f56af4',1,'VmaAllocationCreateFlagBits(): vk_mem_alloc.h']]], + ['vmaallocationcreateflags_156',['VmaAllocationCreateFlags',['../vk__mem__alloc_8h.html#a5225e5e11f8376f6a31a1791f3d6e817',1,'vk_mem_alloc.h']]], + ['vmaallocationcreateinfo_157',['VmaAllocationCreateInfo',['../vk__mem__alloc_8h.html#aca4da9d3526fe9e2d7fd6497809180cd',1,'vk_mem_alloc.h']]], + ['vmaallocationinfo_158',['VmaAllocationInfo',['../struct_vma_allocation_info.html',1,'VmaAllocationInfo'],['../vk__mem__alloc_8h.html#a795e6ff02a21d5486c0565f403dd9255',1,'VmaAllocationInfo(): vk_mem_alloc.h']]], + ['vmaallocator_159',['VmaAllocator',['../struct_vma_allocator.html',1,'']]], + ['vmaallocatorcreateflagbits_160',['VmaAllocatorCreateFlagBits',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7c',1,'VmaAllocatorCreateFlagBits(): vk_mem_alloc.h'],['../vk__mem__alloc_8h.html#a4ddf381b6ce795bdfbc6c614640b9915',1,'VmaAllocatorCreateFlagBits(): vk_mem_alloc.h']]], + ['vmaallocatorcreateflags_161',['VmaAllocatorCreateFlags',['../vk__mem__alloc_8h.html#acfe6863e160722c2c1bbcf7573fddc4d',1,'vk_mem_alloc.h']]], + ['vmaallocatorcreateinfo_162',['VmaAllocatorCreateInfo',['../struct_vma_allocator_create_info.html',1,'VmaAllocatorCreateInfo'],['../vk__mem__alloc_8h.html#ae0f6d1d733dded220d28134da46b4283',1,'VmaAllocatorCreateInfo(): vk_mem_alloc.h']]], + ['vmabegindefragmentationpass_163',['vmaBeginDefragmentationPass',['../vk__mem__alloc_8h.html#ac0f01545b6262f7d4d128fc8f8e5c77b',1,'vk_mem_alloc.h']]], + ['vmabindbuffermemory_164',['vmaBindBufferMemory',['../vk__mem__alloc_8h.html#a6b0929b914b60cf2d45cac4bf3547470',1,'vk_mem_alloc.h']]], + ['vmabindbuffermemory2_165',['vmaBindBufferMemory2',['../vk__mem__alloc_8h.html#a927c944f45e0f2941182abb6f608e64a',1,'vk_mem_alloc.h']]], + ['vmabindimagememory_166',['vmaBindImageMemory',['../vk__mem__alloc_8h.html#a3d3ca45799923aa5d138e9e5f9eb2da5',1,'vk_mem_alloc.h']]], + ['vmabindimagememory2_167',['vmaBindImageMemory2',['../vk__mem__alloc_8h.html#aa8251ee81b0045a443e35b8e8aa021bc',1,'vk_mem_alloc.h']]], + ['vmabudget_168',['VmaBudget',['../struct_vma_budget.html',1,'VmaBudget'],['../vk__mem__alloc_8h.html#ab79b48b6d25aada0de91a913896e1c38',1,'VmaBudget(): vk_mem_alloc.h']]], + ['vmabuildstatsstring_169',['vmaBuildStatsString',['../vk__mem__alloc_8h.html#aa4fee7eb5253377599ef4fd38c93c2a0',1,'vk_mem_alloc.h']]], + ['vmacalculatestats_170',['vmaCalculateStats',['../vk__mem__alloc_8h.html#a333b61c1788cb23559177531e6a93ca3',1,'vk_mem_alloc.h']]], + ['vmacheckcorruption_171',['vmaCheckCorruption',['../vk__mem__alloc_8h.html#a49329a7f030dafcf82f7b73334c22e98',1,'vk_mem_alloc.h']]], + ['vmacheckpoolcorruption_172',['vmaCheckPoolCorruption',['../vk__mem__alloc_8h.html#ad535935619c7a549bf837e1bb0068f89',1,'vk_mem_alloc.h']]], + ['vmacreateallocator_173',['vmaCreateAllocator',['../vk__mem__alloc_8h.html#a200692051ddb34240248234f5f4c17bb',1,'vk_mem_alloc.h']]], + ['vmacreatebuffer_174',['vmaCreateBuffer',['../vk__mem__alloc_8h.html#ac72ee55598617e8eecca384e746bab51',1,'vk_mem_alloc.h']]], + ['vmacreateimage_175',['vmaCreateImage',['../vk__mem__alloc_8h.html#a02a94f25679275851a53e82eacbcfc73',1,'vk_mem_alloc.h']]], + ['vmacreatelostallocation_176',['vmaCreateLostAllocation',['../vk__mem__alloc_8h.html#ae5c9657d9e94756269145b01c05d16f1',1,'vk_mem_alloc.h']]], + ['vmacreatepool_177',['vmaCreatePool',['../vk__mem__alloc_8h.html#a5c8770ded7c59c8caac6de0c2cb00b50',1,'vk_mem_alloc.h']]], + ['vmadefragment_178',['vmaDefragment',['../vk__mem__alloc_8h.html#a6aced90fcc7b39882b6654a740a0b9bb',1,'vk_mem_alloc.h']]], + ['vmadefragmentationbegin_179',['vmaDefragmentationBegin',['../vk__mem__alloc_8h.html#a36ba776fd7fd5cb1e9359fdc0d8e6e8a',1,'vk_mem_alloc.h']]], + ['vmadefragmentationcontext_180',['VmaDefragmentationContext',['../struct_vma_defragmentation_context.html',1,'']]], + ['vmadefragmentationend_181',['vmaDefragmentationEnd',['../vk__mem__alloc_8h.html#a8774e20e91e245aae959ba63efa15dd2',1,'vk_mem_alloc.h']]], + ['vmadefragmentationflagbits_182',['VmaDefragmentationFlagBits',['../vk__mem__alloc_8h.html#a6552a65b71d16f378c6994b3ceaef50c',1,'VmaDefragmentationFlagBits(): vk_mem_alloc.h'],['../vk__mem__alloc_8h.html#a96df0eddab2e1735782fe4e7cd05ea7f',1,'VmaDefragmentationFlagBits(): vk_mem_alloc.h']]], + ['vmadefragmentationflags_183',['VmaDefragmentationFlags',['../vk__mem__alloc_8h.html#a88a77cef37e5d3c4fc9eb328885d048d',1,'vk_mem_alloc.h']]], + ['vmadefragmentationinfo_184',['VmaDefragmentationInfo',['../struct_vma_defragmentation_info.html',1,'VmaDefragmentationInfo'],['../vk__mem__alloc_8h.html#ae67f8573a0cf20f16f0a1eecbca566a0',1,'VmaDefragmentationInfo(): vk_mem_alloc.h']]], + ['vmadefragmentationinfo2_185',['VmaDefragmentationInfo2',['../struct_vma_defragmentation_info2.html',1,'VmaDefragmentationInfo2'],['../vk__mem__alloc_8h.html#abac0e85abaa6ea1ffd63bde29c5c3a29',1,'VmaDefragmentationInfo2(): vk_mem_alloc.h']]], + ['vmadefragmentationpassinfo_186',['VmaDefragmentationPassInfo',['../struct_vma_defragmentation_pass_info.html',1,'VmaDefragmentationPassInfo'],['../vk__mem__alloc_8h.html#a2d0b0d6a81ba60e9c2d3d83ca1f01971',1,'VmaDefragmentationPassInfo(): vk_mem_alloc.h']]], + ['vmadefragmentationpassmoveinfo_187',['VmaDefragmentationPassMoveInfo',['../struct_vma_defragmentation_pass_move_info.html',1,'VmaDefragmentationPassMoveInfo'],['../vk__mem__alloc_8h.html#a459f238c542cedaa8d3cfabc024c39b5',1,'VmaDefragmentationPassMoveInfo(): vk_mem_alloc.h']]], + ['vmadefragmentationstats_188',['VmaDefragmentationStats',['../struct_vma_defragmentation_stats.html',1,'VmaDefragmentationStats'],['../vk__mem__alloc_8h.html#ab0f9b06441c840fee560de4a2967f8c9',1,'VmaDefragmentationStats(): vk_mem_alloc.h']]], + ['vmadestroyallocator_189',['vmaDestroyAllocator',['../vk__mem__alloc_8h.html#aa8d164061c88f22fb1fd3c8f3534bc1d',1,'vk_mem_alloc.h']]], + ['vmadestroybuffer_190',['vmaDestroyBuffer',['../vk__mem__alloc_8h.html#a0d9f4e4ba5bf9aab1f1c746387753d77',1,'vk_mem_alloc.h']]], + ['vmadestroyimage_191',['vmaDestroyImage',['../vk__mem__alloc_8h.html#ae50d2cb3b4a3bfd4dd40987234e50e7e',1,'vk_mem_alloc.h']]], + ['vmadestroypool_192',['vmaDestroyPool',['../vk__mem__alloc_8h.html#a5485779c8f1948238fc4e92232fa65e1',1,'vk_mem_alloc.h']]], + ['vmadevicememorycallbacks_193',['VmaDeviceMemoryCallbacks',['../struct_vma_device_memory_callbacks.html',1,'VmaDeviceMemoryCallbacks'],['../vk__mem__alloc_8h.html#a5e2eb68d727cfd4df25702b027b7aa31',1,'VmaDeviceMemoryCallbacks(): vk_mem_alloc.h']]], + ['vmaenddefragmentationpass_194',['vmaEndDefragmentationPass',['../vk__mem__alloc_8h.html#a1b9ffa538bed905af55c747cc48963bd',1,'vk_mem_alloc.h']]], + ['vmafindmemorytypeindex_195',['vmaFindMemoryTypeIndex',['../vk__mem__alloc_8h.html#aef15a94b58fbcb0fe706d5720e84a74a',1,'vk_mem_alloc.h']]], + ['vmafindmemorytypeindexforbufferinfo_196',['vmaFindMemoryTypeIndexForBufferInfo',['../vk__mem__alloc_8h.html#ae790ab9ffaf7667fb8f62523e6897888',1,'vk_mem_alloc.h']]], + ['vmafindmemorytypeindexforimageinfo_197',['vmaFindMemoryTypeIndexForImageInfo',['../vk__mem__alloc_8h.html#a088da83d8eaf3ce9056d9ea0b981d472',1,'vk_mem_alloc.h']]], + ['vmaflushallocation_198',['vmaFlushAllocation',['../vk__mem__alloc_8h.html#abc34ee6f021f459aff885f3758c435de',1,'vk_mem_alloc.h']]], + ['vmafreememory_199',['vmaFreeMemory',['../vk__mem__alloc_8h.html#a11f0fbc034fa81a4efedd73d61ce7568',1,'vk_mem_alloc.h']]], + ['vmafreememorypages_200',['vmaFreeMemoryPages',['../vk__mem__alloc_8h.html#ab9e709de044c5d8476bea77a4e755840',1,'vk_mem_alloc.h']]], + ['vmafreestatsstring_201',['vmaFreeStatsString',['../vk__mem__alloc_8h.html#a3104eb30d8122c84dd8541063f145288',1,'vk_mem_alloc.h']]], + ['vmagetallocationinfo_202',['vmaGetAllocationInfo',['../vk__mem__alloc_8h.html#a86dd08aba8633bfa4ad0df2e76481d8b',1,'vk_mem_alloc.h']]], + ['vmagetbudget_203',['vmaGetBudget',['../vk__mem__alloc_8h.html#aec0ed24ebea2d0099eed5f801daaefba',1,'vk_mem_alloc.h']]], + ['vmagetmemoryproperties_204',['vmaGetMemoryProperties',['../vk__mem__alloc_8h.html#ab88db292a17974f911182543fda52d19',1,'vk_mem_alloc.h']]], + ['vmagetmemorytypeproperties_205',['vmaGetMemoryTypeProperties',['../vk__mem__alloc_8h.html#a8701444752eb5de4464adb5a2b514bca',1,'vk_mem_alloc.h']]], + ['vmagetphysicaldeviceproperties_206',['vmaGetPhysicalDeviceProperties',['../vk__mem__alloc_8h.html#aecabf7b6e91ea87d0316fa0a9e014fe0',1,'vk_mem_alloc.h']]], + ['vmagetpoolname_207',['vmaGetPoolName',['../vk__mem__alloc_8h.html#af09b4e4eafdbee812e8d73ddf960f030',1,'vk_mem_alloc.h']]], + ['vmagetpoolstats_208',['vmaGetPoolStats',['../vk__mem__alloc_8h.html#ae8bf76997b234ef68aad922616df4153',1,'vk_mem_alloc.h']]], + ['vmainvalidateallocation_209',['vmaInvalidateAllocation',['../vk__mem__alloc_8h.html#a0d0eb0c1102268fa9a476d12ecbe4006',1,'vk_mem_alloc.h']]], + ['vmamakepoolallocationslost_210',['vmaMakePoolAllocationsLost',['../vk__mem__alloc_8h.html#a736bd6cbda886f36c891727e73bd4024',1,'vk_mem_alloc.h']]], + ['vmamapmemory_211',['vmaMapMemory',['../vk__mem__alloc_8h.html#ad5bd1243512d099706de88168992f069',1,'vk_mem_alloc.h']]], + ['vmamemoryusage_212',['VmaMemoryUsage',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cc',1,'VmaMemoryUsage(): vk_mem_alloc.h'],['../vk__mem__alloc_8h.html#ad63b2113c0bfdbeade1cb498f5a8580d',1,'VmaMemoryUsage(): vk_mem_alloc.h']]], + ['vmapool_213',['VmaPool',['../struct_vma_pool.html',1,'']]], + ['vmapoolcreateflagbits_214',['VmaPoolCreateFlagBits',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7',1,'VmaPoolCreateFlagBits(): vk_mem_alloc.h'],['../vk__mem__alloc_8h.html#a8f93195158e0e2ac80ca352064e71c1f',1,'VmaPoolCreateFlagBits(): vk_mem_alloc.h']]], + ['vmapoolcreateflags_215',['VmaPoolCreateFlags',['../vk__mem__alloc_8h.html#a2770e325ea42e087c1b91fdf46d0292a',1,'vk_mem_alloc.h']]], + ['vmapoolcreateinfo_216',['VmaPoolCreateInfo',['../struct_vma_pool_create_info.html',1,'VmaPoolCreateInfo'],['../vk__mem__alloc_8h.html#a211706e9348dcee25a843ed4ea69bce7',1,'VmaPoolCreateInfo(): vk_mem_alloc.h']]], + ['vmapoolstats_217',['VmaPoolStats',['../struct_vma_pool_stats.html',1,'VmaPoolStats'],['../vk__mem__alloc_8h.html#a2e5612d871d64c5624087b837a338c34',1,'VmaPoolStats(): vk_mem_alloc.h']]], + ['vmarecordflagbits_218',['VmaRecordFlagBits',['../vk__mem__alloc_8h.html#a4dd2c44642312a147a4e93373a6e64d2',1,'VmaRecordFlagBits(): vk_mem_alloc.h'],['../vk__mem__alloc_8h.html#ade20b626a6635ce1bf30ea53dea774e4',1,'VmaRecordFlagBits(): vk_mem_alloc.h']]], + ['vmarecordflags_219',['VmaRecordFlags',['../vk__mem__alloc_8h.html#af3929a1a4547c592fc0b0e55ef452828',1,'vk_mem_alloc.h']]], + ['vmarecordsettings_220',['VmaRecordSettings',['../struct_vma_record_settings.html',1,'VmaRecordSettings'],['../vk__mem__alloc_8h.html#a0ab61e87ff6365f1d59915eadc37a9f0',1,'VmaRecordSettings(): vk_mem_alloc.h']]], + ['vmaresizeallocation_221',['vmaResizeAllocation',['../vk__mem__alloc_8h.html#a0ff488958ca72b28e545880463cb8696',1,'vk_mem_alloc.h']]], + ['vmasetallocationuserdata_222',['vmaSetAllocationUserData',['../vk__mem__alloc_8h.html#af9147d31ffc11d62fc187bde283ed14f',1,'vk_mem_alloc.h']]], + ['vmasetcurrentframeindex_223',['vmaSetCurrentFrameIndex',['../vk__mem__alloc_8h.html#ade56bf8dc9f5a5eaddf5f119ed525236',1,'vk_mem_alloc.h']]], + ['vmasetpoolname_224',['vmaSetPoolName',['../vk__mem__alloc_8h.html#adbae3a0b4ab078024462fc85c37f3b58',1,'vk_mem_alloc.h']]], + ['vmastatinfo_225',['VmaStatInfo',['../struct_vma_stat_info.html',1,'VmaStatInfo'],['../vk__mem__alloc_8h.html#a810b009a788ee8aac72a25b42ffbe31c',1,'VmaStatInfo(): vk_mem_alloc.h']]], + ['vmastats_226',['VmaStats',['../struct_vma_stats.html',1,'VmaStats'],['../vk__mem__alloc_8h.html#a732be855fb4a7c248e6853d928a729af',1,'VmaStats(): vk_mem_alloc.h']]], + ['vmatouchallocation_227',['vmaTouchAllocation',['../vk__mem__alloc_8h.html#a43d8ba9673c846f049089a5029d5c73a',1,'vk_mem_alloc.h']]], + ['vmaunmapmemory_228',['vmaUnmapMemory',['../vk__mem__alloc_8h.html#a9bc268595cb33f6ec4d519cfce81ff45',1,'vk_mem_alloc.h']]], + ['vmavulkanfunctions_229',['VmaVulkanFunctions',['../struct_vma_vulkan_functions.html',1,'VmaVulkanFunctions'],['../vk__mem__alloc_8h.html#a97064a1a271b0061ebfc3a079862d0c5',1,'VmaVulkanFunctions(): vk_mem_alloc.h']]], + ['vulkanapiversion_230',['vulkanApiVersion',['../struct_vma_allocator_create_info.html#ae0ffc55139b54520a6bb704b29ffc285',1,'VmaAllocatorCreateInfo']]] +]; diff --git a/docs/html/search/all_2.js b/docs/html/search/all_2.js index 13bbae0..6f1e5c4 100644 --- a/docs/html/search/all_2.js +++ b/docs/html/search/all_2.js @@ -1,7 +1,7 @@ var searchData= [ - ['choosing_20memory_20type_13',['Choosing memory type',['../choosing_memory_type.html',1,'']]], - ['commandbuffer_14',['commandBuffer',['../struct_vma_defragmentation_info2.html#a7f71f39590c5316771493d2333f9c1bd',1,'VmaDefragmentationInfo2']]], - ['configuration_15',['Configuration',['../configuration.html',1,'']]], - ['custom_20memory_20pools_16',['Custom memory pools',['../custom_memory_pools.html',1,'']]] + ['choosing_20memory_20type_14',['Choosing memory type',['../choosing_memory_type.html',1,'']]], + ['commandbuffer_15',['commandBuffer',['../struct_vma_defragmentation_info2.html#a7f71f39590c5316771493d2333f9c1bd',1,'VmaDefragmentationInfo2']]], + ['configuration_16',['Configuration',['../configuration.html',1,'']]], + ['custom_20memory_20pools_17',['Custom memory pools',['../custom_memory_pools.html',1,'']]] ]; diff --git a/docs/html/search/all_3.js b/docs/html/search/all_3.js index a65fae3..31b93d9 100644 --- a/docs/html/search/all_3.js +++ b/docs/html/search/all_3.js @@ -1,9 +1,9 @@ var searchData= [ - ['debugging_20incorrect_20memory_20usage_17',['Debugging incorrect memory usage',['../debugging_memory_usage.html',1,'']]], - ['defragmentation_18',['Defragmentation',['../defragmentation.html',1,'']]], - ['deprecated_20list_19',['Deprecated List',['../deprecated.html',1,'']]], - ['device_20',['device',['../struct_vma_allocator_create_info.html#ad924ddd77b04039c88d0c09b0ffcd500',1,'VmaAllocatorCreateInfo']]], - ['devicememory_21',['deviceMemory',['../struct_vma_allocation_info.html#ae0bfb7dfdf79a76ffefc9a94677a2f67',1,'VmaAllocationInfo']]], - ['devicememoryblocksfreed_22',['deviceMemoryBlocksFreed',['../struct_vma_defragmentation_stats.html#a0113f1877904a5d1ee8f409216ff276b',1,'VmaDefragmentationStats']]] + ['debugging_20incorrect_20memory_20usage_18',['Debugging incorrect memory usage',['../debugging_memory_usage.html',1,'']]], + ['defragmentation_19',['Defragmentation',['../defragmentation.html',1,'']]], + ['deprecated_20list_20',['Deprecated List',['../deprecated.html',1,'']]], + ['device_21',['device',['../struct_vma_allocator_create_info.html#ad924ddd77b04039c88d0c09b0ffcd500',1,'VmaAllocatorCreateInfo']]], + ['devicememory_22',['deviceMemory',['../struct_vma_allocation_info.html#ae0bfb7dfdf79a76ffefc9a94677a2f67',1,'VmaAllocationInfo']]], + ['devicememoryblocksfreed_23',['deviceMemoryBlocksFreed',['../struct_vma_defragmentation_stats.html#a0113f1877904a5d1ee8f409216ff276b',1,'VmaDefragmentationStats']]] ]; diff --git a/docs/html/search/all_4.js b/docs/html/search/all_4.js index b144fa4..05c34f4 100644 --- a/docs/html/search/all_4.js +++ b/docs/html/search/all_4.js @@ -1,5 +1,5 @@ var searchData= [ - ['flags_23',['flags',['../struct_vma_record_settings.html#ad8fdcc92119ae7a8c08c1a564c01d63a',1,'VmaRecordSettings::flags()'],['../struct_vma_allocator_create_info.html#a392ea2ecbaff93f91a7c49f735ad4346',1,'VmaAllocatorCreateInfo::flags()'],['../struct_vma_allocation_create_info.html#add09658ac14fe290ace25470ddd6d41b',1,'VmaAllocationCreateInfo::flags()'],['../struct_vma_pool_create_info.html#a8405139f63d078340ae74513a59f5446',1,'VmaPoolCreateInfo::flags()'],['../struct_vma_defragmentation_info2.html#a53e844ee5633e229cf6daf14b2d9fff9',1,'VmaDefragmentationInfo2::flags()']]], - ['frameinusecount_24',['frameInUseCount',['../struct_vma_allocator_create_info.html#a21ea188dd212b8171cb9ecbed4a2a3a7',1,'VmaAllocatorCreateInfo::frameInUseCount()'],['../struct_vma_pool_create_info.html#a9437e43ffbb644dbbf7fc4e50cfad6aa',1,'VmaPoolCreateInfo::frameInUseCount()']]] + ['flags_24',['flags',['../struct_vma_record_settings.html#ad8fdcc92119ae7a8c08c1a564c01d63a',1,'VmaRecordSettings::flags()'],['../struct_vma_allocator_create_info.html#a392ea2ecbaff93f91a7c49f735ad4346',1,'VmaAllocatorCreateInfo::flags()'],['../struct_vma_allocation_create_info.html#add09658ac14fe290ace25470ddd6d41b',1,'VmaAllocationCreateInfo::flags()'],['../struct_vma_pool_create_info.html#a8405139f63d078340ae74513a59f5446',1,'VmaPoolCreateInfo::flags()'],['../struct_vma_defragmentation_info2.html#a53e844ee5633e229cf6daf14b2d9fff9',1,'VmaDefragmentationInfo2::flags()']]], + ['frameinusecount_25',['frameInUseCount',['../struct_vma_allocator_create_info.html#a21ea188dd212b8171cb9ecbed4a2a3a7',1,'VmaAllocatorCreateInfo::frameInUseCount()'],['../struct_vma_pool_create_info.html#a9437e43ffbb644dbbf7fc4e50cfad6aa',1,'VmaPoolCreateInfo::frameInUseCount()']]] ]; diff --git a/docs/html/search/all_5.js b/docs/html/search/all_5.js index be805b0..dad99dc 100644 --- a/docs/html/search/all_5.js +++ b/docs/html/search/all_5.js @@ -1,4 +1,4 @@ var searchData= [ - ['general_20considerations_25',['General considerations',['../general_considerations.html',1,'']]] + ['general_20considerations_26',['General considerations',['../general_considerations.html',1,'']]] ]; diff --git a/docs/html/search/all_6.js b/docs/html/search/all_6.js index f2a22fd..dfb7f52 100644 --- a/docs/html/search/all_6.js +++ b/docs/html/search/all_6.js @@ -1,4 +1,4 @@ var searchData= [ - ['instance_26',['instance',['../struct_vma_allocator_create_info.html#a70dd42e29b1df1d1b9b61532ae0b370b',1,'VmaAllocatorCreateInfo']]] + ['instance_27',['instance',['../struct_vma_allocator_create_info.html#a70dd42e29b1df1d1b9b61532ae0b370b',1,'VmaAllocatorCreateInfo']]] ]; diff --git a/docs/html/search/all_7.js b/docs/html/search/all_7.js index 8ed581e..63f0624 100644 --- a/docs/html/search/all_7.js +++ b/docs/html/search/all_7.js @@ -1,4 +1,4 @@ var searchData= [ - ['lost_20allocations_27',['Lost allocations',['../lost_allocations.html',1,'']]] + ['lost_20allocations_28',['Lost allocations',['../lost_allocations.html',1,'']]] ]; diff --git a/docs/html/search/all_8.js b/docs/html/search/all_8.js index 6ff3fb4..bc34976 100644 --- a/docs/html/search/all_8.js +++ b/docs/html/search/all_8.js @@ -1,16 +1,18 @@ var searchData= [ - ['maxallocationstomove_28',['maxAllocationsToMove',['../struct_vma_defragmentation_info.html#aa7c7304e13c71f604c907196c4e28fbc',1,'VmaDefragmentationInfo']]], - ['maxblockcount_29',['maxBlockCount',['../struct_vma_pool_create_info.html#ae41142f2834fcdc82baa4883c187b75c',1,'VmaPoolCreateInfo']]], - ['maxbytestomove_30',['maxBytesToMove',['../struct_vma_defragmentation_info.html#acb311c940a777270e67e1b81c5ab6a1d',1,'VmaDefragmentationInfo']]], - ['maxcpuallocationstomove_31',['maxCpuAllocationsToMove',['../struct_vma_defragmentation_info2.html#a94c2c7223d52878445a8cccce396b671',1,'VmaDefragmentationInfo2']]], - ['maxcpubytestomove_32',['maxCpuBytesToMove',['../struct_vma_defragmentation_info2.html#af78e1ea40c22d85137b65f6b384a4d0a',1,'VmaDefragmentationInfo2']]], - ['maxgpuallocationstomove_33',['maxGpuAllocationsToMove',['../struct_vma_defragmentation_info2.html#a40d53d33e71ba0b66f844ed63c05a3f6',1,'VmaDefragmentationInfo2']]], - ['maxgpubytestomove_34',['maxGpuBytesToMove',['../struct_vma_defragmentation_info2.html#a4ddbc898d0afe1518f863a3763628f08',1,'VmaDefragmentationInfo2']]], - ['memory_20mapping_35',['Memory mapping',['../memory_mapping.html',1,'']]], - ['memoryheap_36',['memoryHeap',['../struct_vma_stats.html#a0e6611508c29a187f0fd14ff1a0329c0',1,'VmaStats']]], - ['memorytype_37',['memoryType',['../struct_vma_stats.html#a13e3caf754be79352c42408756309331',1,'VmaStats::memoryType()'],['../struct_vma_allocation_info.html#a7f6b0aa58c135e488e6b40a388dad9d5',1,'VmaAllocationInfo::memoryType()']]], - ['memorytypebits_38',['memoryTypeBits',['../struct_vma_allocation_create_info.html#a3bf940c0271d85d6ba32a4d820075055',1,'VmaAllocationCreateInfo']]], - ['memorytypeindex_39',['memoryTypeIndex',['../struct_vma_pool_create_info.html#a596fa76b685d3f1f688f84a709a5b319',1,'VmaPoolCreateInfo']]], - ['minblockcount_40',['minBlockCount',['../struct_vma_pool_create_info.html#ad8006fb803185c0a699d30f3e9a865ae',1,'VmaPoolCreateInfo']]] + ['maxallocationstomove_29',['maxAllocationsToMove',['../struct_vma_defragmentation_info.html#aa7c7304e13c71f604c907196c4e28fbc',1,'VmaDefragmentationInfo']]], + ['maxblockcount_30',['maxBlockCount',['../struct_vma_pool_create_info.html#ae41142f2834fcdc82baa4883c187b75c',1,'VmaPoolCreateInfo']]], + ['maxbytestomove_31',['maxBytesToMove',['../struct_vma_defragmentation_info.html#acb311c940a777270e67e1b81c5ab6a1d',1,'VmaDefragmentationInfo']]], + ['maxcpuallocationstomove_32',['maxCpuAllocationsToMove',['../struct_vma_defragmentation_info2.html#a94c2c7223d52878445a8cccce396b671',1,'VmaDefragmentationInfo2']]], + ['maxcpubytestomove_33',['maxCpuBytesToMove',['../struct_vma_defragmentation_info2.html#af78e1ea40c22d85137b65f6b384a4d0a',1,'VmaDefragmentationInfo2']]], + ['maxgpuallocationstomove_34',['maxGpuAllocationsToMove',['../struct_vma_defragmentation_info2.html#a40d53d33e71ba0b66f844ed63c05a3f6',1,'VmaDefragmentationInfo2']]], + ['maxgpubytestomove_35',['maxGpuBytesToMove',['../struct_vma_defragmentation_info2.html#a4ddbc898d0afe1518f863a3763628f08',1,'VmaDefragmentationInfo2']]], + ['memory_36',['memory',['../struct_vma_defragmentation_pass_move_info.html#a06eb0c8690aa0d3478a036753492e769',1,'VmaDefragmentationPassMoveInfo']]], + ['memory_20mapping_37',['Memory mapping',['../memory_mapping.html',1,'']]], + ['memoryheap_38',['memoryHeap',['../struct_vma_stats.html#a0e6611508c29a187f0fd14ff1a0329c0',1,'VmaStats']]], + ['memorytype_39',['memoryType',['../struct_vma_stats.html#a13e3caf754be79352c42408756309331',1,'VmaStats::memoryType()'],['../struct_vma_allocation_info.html#a7f6b0aa58c135e488e6b40a388dad9d5',1,'VmaAllocationInfo::memoryType()']]], + ['memorytypebits_40',['memoryTypeBits',['../struct_vma_allocation_create_info.html#a3bf940c0271d85d6ba32a4d820075055',1,'VmaAllocationCreateInfo']]], + ['memorytypeindex_41',['memoryTypeIndex',['../struct_vma_pool_create_info.html#a596fa76b685d3f1f688f84a709a5b319',1,'VmaPoolCreateInfo']]], + ['minblockcount_42',['minBlockCount',['../struct_vma_pool_create_info.html#ad8006fb803185c0a699d30f3e9a865ae',1,'VmaPoolCreateInfo']]], + ['movecount_43',['moveCount',['../struct_vma_defragmentation_pass_info.html#ac1086e657ba995f8d1f4e49b83dcfb6c',1,'VmaDefragmentationPassInfo']]] ]; diff --git a/docs/html/search/all_9.js b/docs/html/search/all_9.js index f6fd5a7..a5fb8d5 100644 --- a/docs/html/search/all_9.js +++ b/docs/html/search/all_9.js @@ -1,4 +1,4 @@ var searchData= [ - ['nominmax_41',['NOMINMAX',['../vk__mem__alloc_8h.html#a9f918755b601cf4bffca775992e6fb90',1,'vk_mem_alloc.h']]] + ['nominmax_44',['NOMINMAX',['../vk__mem__alloc_8h.html#a9f918755b601cf4bffca775992e6fb90',1,'vk_mem_alloc.h']]] ]; diff --git a/docs/html/search/all_a.js b/docs/html/search/all_a.js index ab34015..4612195 100644 --- a/docs/html/search/all_a.js +++ b/docs/html/search/all_a.js @@ -1,4 +1,4 @@ var searchData= [ - ['offset_42',['offset',['../struct_vma_allocation_info.html#a4a3c732388dbdc7a23f9365b00825268',1,'VmaAllocationInfo']]] + ['offset_45',['offset',['../struct_vma_allocation_info.html#a4a3c732388dbdc7a23f9365b00825268',1,'VmaAllocationInfo::offset()'],['../struct_vma_defragmentation_pass_move_info.html#a8ab4508bc03625b0653c880576be96c6',1,'VmaDefragmentationPassMoveInfo::offset()']]] ]; diff --git a/docs/html/search/all_b.js b/docs/html/search/all_b.js index d1a2afd..cac8e23 100644 --- a/docs/html/search/all_b.js +++ b/docs/html/search/all_b.js @@ -1,23 +1,24 @@ var searchData= [ - ['pallocationcallbacks_43',['pAllocationCallbacks',['../struct_vma_allocator_create_info.html#a6e409087e3be55400d0e4ccbe43c608d',1,'VmaAllocatorCreateInfo']]], - ['pallocations_44',['pAllocations',['../struct_vma_defragmentation_info2.html#a8943f8d65969ce8e2189a1cdf3205e96',1,'VmaDefragmentationInfo2']]], - ['pallocationschanged_45',['pAllocationsChanged',['../struct_vma_defragmentation_info2.html#a76d51a644dc7f5405d0cdd0025ecd0cc',1,'VmaDefragmentationInfo2']]], - ['pdevicememorycallbacks_46',['pDeviceMemoryCallbacks',['../struct_vma_allocator_create_info.html#af1380969b5e1ea4c3184a877892d260e',1,'VmaAllocatorCreateInfo']]], - ['pfilepath_47',['pFilePath',['../struct_vma_record_settings.html#a6cb1fdbf6bcb610b68f2010dd629e89d',1,'VmaRecordSettings']]], - ['pfn_5fvmaallocatedevicememoryfunction_48',['PFN_vmaAllocateDeviceMemoryFunction',['../vk__mem__alloc_8h.html#ab6a6477cda1ce775b30bde96d766203b',1,'vk_mem_alloc.h']]], - ['pfn_5fvmafreedevicememoryfunction_49',['PFN_vmaFreeDeviceMemoryFunction',['../vk__mem__alloc_8h.html#aef2545dc2e9dd4f29ab9ba6ac6fe2f49',1,'vk_mem_alloc.h']]], - ['pfnallocate_50',['pfnAllocate',['../struct_vma_device_memory_callbacks.html#a4f17f7b255101e733b44d5633aceabfb',1,'VmaDeviceMemoryCallbacks']]], - ['pfnfree_51',['pfnFree',['../struct_vma_device_memory_callbacks.html#abe8a3328bbc916f6f712fdb6b299444c',1,'VmaDeviceMemoryCallbacks']]], - ['pheapsizelimit_52',['pHeapSizeLimit',['../struct_vma_allocator_create_info.html#a31c192aa6cbffa33279f6d9f0c47c44b',1,'VmaAllocatorCreateInfo']]], - ['physicaldevice_53',['physicalDevice',['../struct_vma_allocator_create_info.html#a08230f04ae6ccf8a78150a9e829a7156',1,'VmaAllocatorCreateInfo']]], - ['pmappeddata_54',['pMappedData',['../struct_vma_allocation_info.html#a5eeffbe2d2f30f53370ff14aefbadbe2',1,'VmaAllocationInfo']]], - ['pool_55',['pool',['../struct_vma_allocation_create_info.html#a6272c0555cfd1fe28bff1afeb6190150',1,'VmaAllocationCreateInfo']]], - ['poolcount_56',['poolCount',['../struct_vma_defragmentation_info2.html#a7e70aa2a1081d849dcc7829b19d3ec9d',1,'VmaDefragmentationInfo2']]], - ['ppools_57',['pPools',['../struct_vma_defragmentation_info2.html#a0b3effd57f3fcdeb2ed62210b4ef20e1',1,'VmaDefragmentationInfo2']]], - ['precordsettings_58',['pRecordSettings',['../struct_vma_allocator_create_info.html#ace2aa4877b16a42b0b7673d4e26000ee',1,'VmaAllocatorCreateInfo']]], - ['preferredflags_59',['preferredFlags',['../struct_vma_allocation_create_info.html#a7fe8d81a1ad10b2a2faacacee5b15d6d',1,'VmaAllocationCreateInfo']]], - ['preferredlargeheapblocksize_60',['preferredLargeHeapBlockSize',['../struct_vma_allocator_create_info.html#a8e4714298e3121cdd8b214a1ae7a637a',1,'VmaAllocatorCreateInfo']]], - ['puserdata_61',['pUserData',['../struct_vma_allocation_create_info.html#a8259e85c272683434f4abb4ddddffe19',1,'VmaAllocationCreateInfo::pUserData()'],['../struct_vma_allocation_info.html#adc507656149c04de7ed95d0042ba2a13',1,'VmaAllocationInfo::pUserData()']]], - ['pvulkanfunctions_62',['pVulkanFunctions',['../struct_vma_allocator_create_info.html#a3dc197be3227da7338b1643f70db36bd',1,'VmaAllocatorCreateInfo']]] + ['pallocationcallbacks_46',['pAllocationCallbacks',['../struct_vma_allocator_create_info.html#a6e409087e3be55400d0e4ccbe43c608d',1,'VmaAllocatorCreateInfo']]], + ['pallocations_47',['pAllocations',['../struct_vma_defragmentation_info2.html#a8943f8d65969ce8e2189a1cdf3205e96',1,'VmaDefragmentationInfo2']]], + ['pallocationschanged_48',['pAllocationsChanged',['../struct_vma_defragmentation_info2.html#a76d51a644dc7f5405d0cdd0025ecd0cc',1,'VmaDefragmentationInfo2']]], + ['pdevicememorycallbacks_49',['pDeviceMemoryCallbacks',['../struct_vma_allocator_create_info.html#af1380969b5e1ea4c3184a877892d260e',1,'VmaAllocatorCreateInfo']]], + ['pfilepath_50',['pFilePath',['../struct_vma_record_settings.html#a6cb1fdbf6bcb610b68f2010dd629e89d',1,'VmaRecordSettings']]], + ['pfn_5fvmaallocatedevicememoryfunction_51',['PFN_vmaAllocateDeviceMemoryFunction',['../vk__mem__alloc_8h.html#ab6a6477cda1ce775b30bde96d766203b',1,'vk_mem_alloc.h']]], + ['pfn_5fvmafreedevicememoryfunction_52',['PFN_vmaFreeDeviceMemoryFunction',['../vk__mem__alloc_8h.html#aef2545dc2e9dd4f29ab9ba6ac6fe2f49',1,'vk_mem_alloc.h']]], + ['pfnallocate_53',['pfnAllocate',['../struct_vma_device_memory_callbacks.html#a4f17f7b255101e733b44d5633aceabfb',1,'VmaDeviceMemoryCallbacks']]], + ['pfnfree_54',['pfnFree',['../struct_vma_device_memory_callbacks.html#abe8a3328bbc916f6f712fdb6b299444c',1,'VmaDeviceMemoryCallbacks']]], + ['pheapsizelimit_55',['pHeapSizeLimit',['../struct_vma_allocator_create_info.html#a31c192aa6cbffa33279f6d9f0c47c44b',1,'VmaAllocatorCreateInfo']]], + ['physicaldevice_56',['physicalDevice',['../struct_vma_allocator_create_info.html#a08230f04ae6ccf8a78150a9e829a7156',1,'VmaAllocatorCreateInfo']]], + ['pmappeddata_57',['pMappedData',['../struct_vma_allocation_info.html#a5eeffbe2d2f30f53370ff14aefbadbe2',1,'VmaAllocationInfo']]], + ['pmoves_58',['pMoves',['../struct_vma_defragmentation_pass_info.html#acbd42d4a3357999da130a95cd99a3792',1,'VmaDefragmentationPassInfo']]], + ['pool_59',['pool',['../struct_vma_allocation_create_info.html#a6272c0555cfd1fe28bff1afeb6190150',1,'VmaAllocationCreateInfo']]], + ['poolcount_60',['poolCount',['../struct_vma_defragmentation_info2.html#a7e70aa2a1081d849dcc7829b19d3ec9d',1,'VmaDefragmentationInfo2']]], + ['ppools_61',['pPools',['../struct_vma_defragmentation_info2.html#a0b3effd57f3fcdeb2ed62210b4ef20e1',1,'VmaDefragmentationInfo2']]], + ['precordsettings_62',['pRecordSettings',['../struct_vma_allocator_create_info.html#ace2aa4877b16a42b0b7673d4e26000ee',1,'VmaAllocatorCreateInfo']]], + ['preferredflags_63',['preferredFlags',['../struct_vma_allocation_create_info.html#a7fe8d81a1ad10b2a2faacacee5b15d6d',1,'VmaAllocationCreateInfo']]], + ['preferredlargeheapblocksize_64',['preferredLargeHeapBlockSize',['../struct_vma_allocator_create_info.html#a8e4714298e3121cdd8b214a1ae7a637a',1,'VmaAllocatorCreateInfo']]], + ['puserdata_65',['pUserData',['../struct_vma_allocation_create_info.html#a8259e85c272683434f4abb4ddddffe19',1,'VmaAllocationCreateInfo::pUserData()'],['../struct_vma_allocation_info.html#adc507656149c04de7ed95d0042ba2a13',1,'VmaAllocationInfo::pUserData()']]], + ['pvulkanfunctions_66',['pVulkanFunctions',['../struct_vma_allocator_create_info.html#a3dc197be3227da7338b1643f70db36bd',1,'VmaAllocatorCreateInfo']]] ]; diff --git a/docs/html/search/all_c.js b/docs/html/search/all_c.js index 7b83b43..c414e8e 100644 --- a/docs/html/search/all_c.js +++ b/docs/html/search/all_c.js @@ -1,4 +1,4 @@ var searchData= [ - ['quick_20start_63',['Quick start',['../quick_start.html',1,'']]] + ['quick_20start_67',['Quick start',['../quick_start.html',1,'']]] ]; diff --git a/docs/html/search/all_d.js b/docs/html/search/all_d.js index bd0b44a..89f4bb3 100644 --- a/docs/html/search/all_d.js +++ b/docs/html/search/all_d.js @@ -1,6 +1,6 @@ var searchData= [ - ['record_20and_20replay_64',['Record and replay',['../record_and_replay.html',1,'']]], - ['requiredflags_65',['requiredFlags',['../struct_vma_allocation_create_info.html#a9166390303ff42d783305bc31c2b6b90',1,'VmaAllocationCreateInfo']]], - ['recommended_20usage_20patterns_66',['Recommended usage patterns',['../usage_patterns.html',1,'']]] + ['record_20and_20replay_68',['Record and replay',['../record_and_replay.html',1,'']]], + ['requiredflags_69',['requiredFlags',['../struct_vma_allocation_create_info.html#a9166390303ff42d783305bc31c2b6b90',1,'VmaAllocationCreateInfo']]], + ['recommended_20usage_20patterns_70',['Recommended usage patterns',['../usage_patterns.html',1,'']]] ]; diff --git a/docs/html/search/all_e.js b/docs/html/search/all_e.js index 692377f..be451de 100644 --- a/docs/html/search/all_e.js +++ b/docs/html/search/all_e.js @@ -1,6 +1,6 @@ var searchData= [ - ['size_67',['size',['../struct_vma_pool_stats.html#a326807b2de2b0931cee4ed9a5f2e420c',1,'VmaPoolStats::size()'],['../struct_vma_allocation_info.html#aac76d113a6a5ccbb09fea00fb25fd18f',1,'VmaAllocationInfo::size()']]], - ['statistics_68',['Statistics',['../statistics.html',1,'']]], - ['staying_20within_20budget_69',['Staying within budget',['../staying_within_budget.html',1,'']]] + ['size_71',['size',['../struct_vma_pool_stats.html#a326807b2de2b0931cee4ed9a5f2e420c',1,'VmaPoolStats::size()'],['../struct_vma_allocation_info.html#aac76d113a6a5ccbb09fea00fb25fd18f',1,'VmaAllocationInfo::size()']]], + ['statistics_72',['Statistics',['../statistics.html',1,'']]], + ['staying_20within_20budget_73',['Staying within budget',['../staying_within_budget.html',1,'']]] ]; diff --git a/docs/html/search/all_f.js b/docs/html/search/all_f.js index adc9a94..dda285a 100644 --- a/docs/html/search/all_f.js +++ b/docs/html/search/all_f.js @@ -1,4 +1,4 @@ var searchData= [ - ['total_70',['total',['../struct_vma_stats.html#a2e8f5b3353f2fefef3c27f29e245a1f9',1,'VmaStats']]] + ['total_74',['total',['../struct_vma_stats.html#a2e8f5b3353f2fefef3c27f29e245a1f9',1,'VmaStats']]] ]; diff --git a/docs/html/search/classes_0.js b/docs/html/search/classes_0.js index 2d8575f..c6e32be 100644 --- a/docs/html/search/classes_0.js +++ b/docs/html/search/classes_0.js @@ -1,21 +1,23 @@ var searchData= [ - ['vmaallocation_220',['VmaAllocation',['../struct_vma_allocation.html',1,'']]], - ['vmaallocationcreateinfo_221',['VmaAllocationCreateInfo',['../struct_vma_allocation_create_info.html',1,'']]], - ['vmaallocationinfo_222',['VmaAllocationInfo',['../struct_vma_allocation_info.html',1,'']]], - ['vmaallocator_223',['VmaAllocator',['../struct_vma_allocator.html',1,'']]], - ['vmaallocatorcreateinfo_224',['VmaAllocatorCreateInfo',['../struct_vma_allocator_create_info.html',1,'']]], - ['vmabudget_225',['VmaBudget',['../struct_vma_budget.html',1,'']]], - ['vmadefragmentationcontext_226',['VmaDefragmentationContext',['../struct_vma_defragmentation_context.html',1,'']]], - ['vmadefragmentationinfo_227',['VmaDefragmentationInfo',['../struct_vma_defragmentation_info.html',1,'']]], - ['vmadefragmentationinfo2_228',['VmaDefragmentationInfo2',['../struct_vma_defragmentation_info2.html',1,'']]], - ['vmadefragmentationstats_229',['VmaDefragmentationStats',['../struct_vma_defragmentation_stats.html',1,'']]], - ['vmadevicememorycallbacks_230',['VmaDeviceMemoryCallbacks',['../struct_vma_device_memory_callbacks.html',1,'']]], - ['vmapool_231',['VmaPool',['../struct_vma_pool.html',1,'']]], - ['vmapoolcreateinfo_232',['VmaPoolCreateInfo',['../struct_vma_pool_create_info.html',1,'']]], - ['vmapoolstats_233',['VmaPoolStats',['../struct_vma_pool_stats.html',1,'']]], - ['vmarecordsettings_234',['VmaRecordSettings',['../struct_vma_record_settings.html',1,'']]], - ['vmastatinfo_235',['VmaStatInfo',['../struct_vma_stat_info.html',1,'']]], - ['vmastats_236',['VmaStats',['../struct_vma_stats.html',1,'']]], - ['vmavulkanfunctions_237',['VmaVulkanFunctions',['../struct_vma_vulkan_functions.html',1,'']]] + ['vmaallocation_231',['VmaAllocation',['../struct_vma_allocation.html',1,'']]], + ['vmaallocationcreateinfo_232',['VmaAllocationCreateInfo',['../struct_vma_allocation_create_info.html',1,'']]], + ['vmaallocationinfo_233',['VmaAllocationInfo',['../struct_vma_allocation_info.html',1,'']]], + ['vmaallocator_234',['VmaAllocator',['../struct_vma_allocator.html',1,'']]], + ['vmaallocatorcreateinfo_235',['VmaAllocatorCreateInfo',['../struct_vma_allocator_create_info.html',1,'']]], + ['vmabudget_236',['VmaBudget',['../struct_vma_budget.html',1,'']]], + ['vmadefragmentationcontext_237',['VmaDefragmentationContext',['../struct_vma_defragmentation_context.html',1,'']]], + ['vmadefragmentationinfo_238',['VmaDefragmentationInfo',['../struct_vma_defragmentation_info.html',1,'']]], + ['vmadefragmentationinfo2_239',['VmaDefragmentationInfo2',['../struct_vma_defragmentation_info2.html',1,'']]], + ['vmadefragmentationpassinfo_240',['VmaDefragmentationPassInfo',['../struct_vma_defragmentation_pass_info.html',1,'']]], + ['vmadefragmentationpassmoveinfo_241',['VmaDefragmentationPassMoveInfo',['../struct_vma_defragmentation_pass_move_info.html',1,'']]], + ['vmadefragmentationstats_242',['VmaDefragmentationStats',['../struct_vma_defragmentation_stats.html',1,'']]], + ['vmadevicememorycallbacks_243',['VmaDeviceMemoryCallbacks',['../struct_vma_device_memory_callbacks.html',1,'']]], + ['vmapool_244',['VmaPool',['../struct_vma_pool.html',1,'']]], + ['vmapoolcreateinfo_245',['VmaPoolCreateInfo',['../struct_vma_pool_create_info.html',1,'']]], + ['vmapoolstats_246',['VmaPoolStats',['../struct_vma_pool_stats.html',1,'']]], + ['vmarecordsettings_247',['VmaRecordSettings',['../struct_vma_record_settings.html',1,'']]], + ['vmastatinfo_248',['VmaStatInfo',['../struct_vma_stat_info.html',1,'']]], + ['vmastats_249',['VmaStats',['../struct_vma_stats.html',1,'']]], + ['vmavulkanfunctions_250',['VmaVulkanFunctions',['../struct_vma_vulkan_functions.html',1,'']]] ]; diff --git a/docs/html/search/classes_1.html b/docs/html/search/classes_1.html new file mode 100644 index 0000000..baeb182 --- /dev/null +++ b/docs/html/search/classes_1.html @@ -0,0 +1,30 @@ + + + + + + + + + +
      +
      Loading...
      +
      + +
      Searching...
      +
      No Matches
      + +
      + + diff --git a/docs/html/search/classes_1.js b/docs/html/search/classes_1.js new file mode 100644 index 0000000..58b1ed2 --- /dev/null +++ b/docs/html/search/classes_1.js @@ -0,0 +1,22 @@ +var searchData= +[ + ['vmaallocation_232',['VmaAllocation',['../struct_vma_allocation.html',1,'']]], + ['vmaallocationinfo_233',['VmaAllocationInfo',['../struct_vma_allocation_info.html',1,'']]], + ['vmaallocator_234',['VmaAllocator',['../struct_vma_allocator.html',1,'']]], + ['vmaallocatorcreateinfo_235',['VmaAllocatorCreateInfo',['../struct_vma_allocator_create_info.html',1,'']]], + ['vmabudget_236',['VmaBudget',['../struct_vma_budget.html',1,'']]], + ['vmadefragmentationcontext_237',['VmaDefragmentationContext',['../struct_vma_defragmentation_context.html',1,'']]], + ['vmadefragmentationinfo_238',['VmaDefragmentationInfo',['../struct_vma_defragmentation_info.html',1,'']]], + ['vmadefragmentationinfo2_239',['VmaDefragmentationInfo2',['../struct_vma_defragmentation_info2.html',1,'']]], + ['vmadefragmentationpassinfo_240',['VmaDefragmentationPassInfo',['../struct_vma_defragmentation_pass_info.html',1,'']]], + ['vmadefragmentationpassmoveinfo_241',['VmaDefragmentationPassMoveInfo',['../struct_vma_defragmentation_pass_move_info.html',1,'']]], + ['vmadefragmentationstats_242',['VmaDefragmentationStats',['../struct_vma_defragmentation_stats.html',1,'']]], + ['vmadevicememorycallbacks_243',['VmaDeviceMemoryCallbacks',['../struct_vma_device_memory_callbacks.html',1,'']]], + ['vmapool_244',['VmaPool',['../struct_vma_pool.html',1,'']]], + ['vmapoolcreateinfo_245',['VmaPoolCreateInfo',['../struct_vma_pool_create_info.html',1,'']]], + ['vmapoolstats_246',['VmaPoolStats',['../struct_vma_pool_stats.html',1,'']]], + ['vmarecordsettings_247',['VmaRecordSettings',['../struct_vma_record_settings.html',1,'']]], + ['vmastatinfo_248',['VmaStatInfo',['../struct_vma_stat_info.html',1,'']]], + ['vmastats_249',['VmaStats',['../struct_vma_stats.html',1,'']]], + ['vmavulkanfunctions_250',['VmaVulkanFunctions',['../struct_vma_vulkan_functions.html',1,'']]] +]; diff --git a/docs/html/search/defines_0.js b/docs/html/search/defines_0.js index 1fdc224..eb0558a 100644 --- a/docs/html/search/defines_0.js +++ b/docs/html/search/defines_0.js @@ -1,4 +1,4 @@ var searchData= [ - ['nominmax_436',['NOMINMAX',['../vk__mem__alloc_8h.html#a9f918755b601cf4bffca775992e6fb90',1,'vk_mem_alloc.h']]] + ['nominmax_459',['NOMINMAX',['../vk__mem__alloc_8h.html#a9f918755b601cf4bffca775992e6fb90',1,'vk_mem_alloc.h']]] ]; diff --git a/docs/html/search/defines_1.js b/docs/html/search/defines_1.js index 5ca4775..2a2ae44 100644 --- a/docs/html/search/defines_1.js +++ b/docs/html/search/defines_1.js @@ -1,9 +1,9 @@ var searchData= [ - ['vma_5fbind_5fmemory2_437',['VMA_BIND_MEMORY2',['../vk__mem__alloc_8h.html#a88bef97f86d70a34a4c0746e09a2680d',1,'vk_mem_alloc.h']]], - ['vma_5fdedicated_5fallocation_438',['VMA_DEDICATED_ALLOCATION',['../vk__mem__alloc_8h.html#af7b860e63b96d11e44ae8587ba06bbf4',1,'vk_mem_alloc.h']]], - ['vma_5fmemory_5fbudget_439',['VMA_MEMORY_BUDGET',['../vk__mem__alloc_8h.html#a05decf1cf4ebf767beba7acca6c1ec3a',1,'vk_mem_alloc.h']]], - ['vma_5frecording_5fenabled_440',['VMA_RECORDING_ENABLED',['../vk__mem__alloc_8h.html#a1f0c126759fc96ccb6e2d23c101d770c',1,'vk_mem_alloc.h']]], - ['vma_5fstats_5fstring_5fenabled_441',['VMA_STATS_STRING_ENABLED',['../vk__mem__alloc_8h.html#ae25f0d55fd91cb166f002b63244800e1',1,'vk_mem_alloc.h']]], - ['vma_5fvulkan_5fversion_442',['VMA_VULKAN_VERSION',['../vk__mem__alloc_8h.html#a1a2407c283893638cc039bb31fcd74b6',1,'vk_mem_alloc.h']]] + ['vma_5fbind_5fmemory2_460',['VMA_BIND_MEMORY2',['../vk__mem__alloc_8h.html#a88bef97f86d70a34a4c0746e09a2680d',1,'vk_mem_alloc.h']]], + ['vma_5fdedicated_5fallocation_461',['VMA_DEDICATED_ALLOCATION',['../vk__mem__alloc_8h.html#af7b860e63b96d11e44ae8587ba06bbf4',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fbudget_462',['VMA_MEMORY_BUDGET',['../vk__mem__alloc_8h.html#a05decf1cf4ebf767beba7acca6c1ec3a',1,'vk_mem_alloc.h']]], + ['vma_5frecording_5fenabled_463',['VMA_RECORDING_ENABLED',['../vk__mem__alloc_8h.html#a1f0c126759fc96ccb6e2d23c101d770c',1,'vk_mem_alloc.h']]], + ['vma_5fstats_5fstring_5fenabled_464',['VMA_STATS_STRING_ENABLED',['../vk__mem__alloc_8h.html#ae25f0d55fd91cb166f002b63244800e1',1,'vk_mem_alloc.h']]], + ['vma_5fvulkan_5fversion_465',['VMA_VULKAN_VERSION',['../vk__mem__alloc_8h.html#a1a2407c283893638cc039bb31fcd74b6',1,'vk_mem_alloc.h']]] ]; diff --git a/docs/html/search/enums_0.js b/docs/html/search/enums_0.js index 9561daf..ed7898f 100644 --- a/docs/html/search/enums_0.js +++ b/docs/html/search/enums_0.js @@ -1,9 +1,9 @@ var searchData= [ - ['vmaallocationcreateflagbits_392',['VmaAllocationCreateFlagBits',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597',1,'vk_mem_alloc.h']]], - ['vmaallocatorcreateflagbits_393',['VmaAllocatorCreateFlagBits',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7c',1,'vk_mem_alloc.h']]], - ['vmadefragmentationflagbits_394',['VmaDefragmentationFlagBits',['../vk__mem__alloc_8h.html#a6552a65b71d16f378c6994b3ceaef50c',1,'vk_mem_alloc.h']]], - ['vmamemoryusage_395',['VmaMemoryUsage',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cc',1,'vk_mem_alloc.h']]], - ['vmapoolcreateflagbits_396',['VmaPoolCreateFlagBits',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7',1,'vk_mem_alloc.h']]], - ['vmarecordflagbits_397',['VmaRecordFlagBits',['../vk__mem__alloc_8h.html#a4dd2c44642312a147a4e93373a6e64d2',1,'vk_mem_alloc.h']]] + ['vmaallocationcreateflagbits_413',['VmaAllocationCreateFlagBits',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597',1,'vk_mem_alloc.h']]], + ['vmaallocatorcreateflagbits_414',['VmaAllocatorCreateFlagBits',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7c',1,'vk_mem_alloc.h']]], + ['vmadefragmentationflagbits_415',['VmaDefragmentationFlagBits',['../vk__mem__alloc_8h.html#a6552a65b71d16f378c6994b3ceaef50c',1,'vk_mem_alloc.h']]], + ['vmamemoryusage_416',['VmaMemoryUsage',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cc',1,'vk_mem_alloc.h']]], + ['vmapoolcreateflagbits_417',['VmaPoolCreateFlagBits',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7',1,'vk_mem_alloc.h']]], + ['vmarecordflagbits_418',['VmaRecordFlagBits',['../vk__mem__alloc_8h.html#a4dd2c44642312a147a4e93373a6e64d2',1,'vk_mem_alloc.h']]] ]; diff --git a/docs/html/search/enumvalues_0.js b/docs/html/search/enumvalues_0.js index 5a93deb..727e4ab 100644 --- a/docs/html/search/enumvalues_0.js +++ b/docs/html/search/enumvalues_0.js @@ -1,41 +1,43 @@ var searchData= [ - ['vma_5fallocation_5fcreate_5fcan_5fbecome_5flost_5fbit_398',['VMA_ALLOCATION_CREATE_CAN_BECOME_LOST_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a5f436af6c8fe8540573a6d22627a6fd2',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fcan_5fmake_5fother_5flost_5fbit_399',['VMA_ALLOCATION_CREATE_CAN_MAKE_OTHER_LOST_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a68686d0ce9beb0d4d1b9f2b8b1389a7e',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fdedicated_5fmemory_5fbit_400',['VMA_ALLOCATION_CREATE_DEDICATED_MEMORY_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a3fc311d855c2ff53f1090ef5c722b38f',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fdont_5fbind_5fbit_401',['VMA_ALLOCATION_CREATE_DONT_BIND_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a2310568c62208af432724305fe29ccea',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fflag_5fbits_5fmax_5fenum_402',['VMA_ALLOCATION_CREATE_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597ae5633ec569f4899cf8f29e7385b2f882',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fmapped_5fbit_403',['VMA_ALLOCATION_CREATE_MAPPED_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a11da372cc3a82931c5e5d6146cd9dd1f',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fnever_5fallocate_5fbit_404',['VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a89759603401014eb325eb22a3839f2ff',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fstrategy_5fbest_5ffit_5fbit_405',['VMA_ALLOCATION_CREATE_STRATEGY_BEST_FIT_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a839826775c62319466441f86496f036d',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fstrategy_5ffirst_5ffit_5fbit_406',['VMA_ALLOCATION_CREATE_STRATEGY_FIRST_FIT_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a33eb2052674f3ad92386c714a65fb777',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fstrategy_5fmask_407',['VMA_ALLOCATION_CREATE_STRATEGY_MASK',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a8e16845d81ae3d27c47106d4770d5c7e',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fstrategy_5fmin_5ffragmentation_5fbit_408',['VMA_ALLOCATION_CREATE_STRATEGY_MIN_FRAGMENTATION_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a621b704103eb3360230c860acf36e706',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fstrategy_5fmin_5fmemory_5fbit_409',['VMA_ALLOCATION_CREATE_STRATEGY_MIN_MEMORY_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a8af1210cf591784afa026d94998f735d',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fstrategy_5fmin_5ftime_5fbit_410',['VMA_ALLOCATION_CREATE_STRATEGY_MIN_TIME_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a0729e932b7ea170e3a128cad96c5cf6d',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fstrategy_5fworst_5ffit_5fbit_411',['VMA_ALLOCATION_CREATE_STRATEGY_WORST_FIT_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597ad242a04f802e25fef0b880afe8bb0a62',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fupper_5faddress_5fbit_412',['VMA_ALLOCATION_CREATE_UPPER_ADDRESS_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a42ba3a2d2c7117953210b7c3ef8da0df',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fuser_5fdata_5fcopy_5fstring_5fbit_413',['VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597aa6f24f821cd6a7c5e4a443f7bf59c520',1,'vk_mem_alloc.h']]], - ['vma_5fallocation_5fcreate_5fwithin_5fbudget_5fbit_414',['VMA_ALLOCATION_CREATE_WITHIN_BUDGET_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597ab8b1764f3e9022368e440c057783b92d',1,'vk_mem_alloc.h']]], - ['vma_5fallocator_5fcreate_5fext_5fmemory_5fbudget_5fbit_415',['VMA_ALLOCATOR_CREATE_EXT_MEMORY_BUDGET_BIT',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7ca4d4687863f7bd4b418c6006dc04400b0',1,'vk_mem_alloc.h']]], - ['vma_5fallocator_5fcreate_5fexternally_5fsynchronized_5fbit_416',['VMA_ALLOCATOR_CREATE_EXTERNALLY_SYNCHRONIZED_BIT',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7ca4816ddaed324ba110172ca608a20f29d',1,'vk_mem_alloc.h']]], - ['vma_5fallocator_5fcreate_5fflag_5fbits_5fmax_5fenum_417',['VMA_ALLOCATOR_CREATE_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7cae4d5ad929caba5f23eb502b13bd5286c',1,'vk_mem_alloc.h']]], - ['vma_5fallocator_5fcreate_5fkhr_5fbind_5fmemory2_5fbit_418',['VMA_ALLOCATOR_CREATE_KHR_BIND_MEMORY2_BIT',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7ca8fb75bf07cd184ab903596295e863dee',1,'vk_mem_alloc.h']]], - ['vma_5fallocator_5fcreate_5fkhr_5fdedicated_5fallocation_5fbit_419',['VMA_ALLOCATOR_CREATE_KHR_DEDICATED_ALLOCATION_BIT',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7cace7da7cc6e71a625dfa763c55a597878',1,'vk_mem_alloc.h']]], - ['vma_5fdefragmentation_5fflag_5fbits_5fmax_5fenum_420',['VMA_DEFRAGMENTATION_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#a6552a65b71d16f378c6994b3ceaef50cab87ec33154803bfeb5ac2b379f1d6a97',1,'vk_mem_alloc.h']]], - ['vma_5fmemory_5fusage_5fcpu_5fcopy_421',['VMA_MEMORY_USAGE_CPU_COPY',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca416a444d4d0fc20067c3f76f32ff2500',1,'vk_mem_alloc.h']]], - ['vma_5fmemory_5fusage_5fcpu_5fonly_422',['VMA_MEMORY_USAGE_CPU_ONLY',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca40bdf4cddeffeb12f43d45ca1286e0a5',1,'vk_mem_alloc.h']]], - ['vma_5fmemory_5fusage_5fcpu_5fto_5fgpu_423',['VMA_MEMORY_USAGE_CPU_TO_GPU',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca9066b52c5a7079bb74a69aaf8b92ff67',1,'vk_mem_alloc.h']]], - ['vma_5fmemory_5fusage_5fgpu_5flazily_5fallocated_424',['VMA_MEMORY_USAGE_GPU_LAZILY_ALLOCATED',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca835333d9072db63a653818030e17614d',1,'vk_mem_alloc.h']]], - ['vma_5fmemory_5fusage_5fgpu_5fonly_425',['VMA_MEMORY_USAGE_GPU_ONLY',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305ccac6b5dc1432d88647aa4cd456246eadf7',1,'vk_mem_alloc.h']]], - ['vma_5fmemory_5fusage_5fgpu_5fto_5fcpu_426',['VMA_MEMORY_USAGE_GPU_TO_CPU',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca7b586d2fdaf82a463b58f581ed72be27',1,'vk_mem_alloc.h']]], - ['vma_5fmemory_5fusage_5fmax_5fenum_427',['VMA_MEMORY_USAGE_MAX_ENUM',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca091e69437ef693e8d0d287f1c719ba6e',1,'vk_mem_alloc.h']]], - ['vma_5fmemory_5fusage_5funknown_428',['VMA_MEMORY_USAGE_UNKNOWN',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305ccaf50d27e34e0925cf3a63db8c839121dd',1,'vk_mem_alloc.h']]], - ['vma_5fpool_5fcreate_5falgorithm_5fmask_429',['VMA_POOL_CREATE_ALGORITHM_MASK',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7af4d270f8f42517a0f70037ceb6ac1d9c',1,'vk_mem_alloc.h']]], - ['vma_5fpool_5fcreate_5fbuddy_5falgorithm_5fbit_430',['VMA_POOL_CREATE_BUDDY_ALGORITHM_BIT',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7a97a0dc38e5161b780594d998d313d35e',1,'vk_mem_alloc.h']]], - ['vma_5fpool_5fcreate_5fflag_5fbits_5fmax_5fenum_431',['VMA_POOL_CREATE_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7a1c7312bea9ea246846b9054fd6bd6aec',1,'vk_mem_alloc.h']]], - ['vma_5fpool_5fcreate_5fignore_5fbuffer_5fimage_5fgranularity_5fbit_432',['VMA_POOL_CREATE_IGNORE_BUFFER_IMAGE_GRANULARITY_BIT',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7a9f1a499508a8edb4e8ba40aa0290a3d2',1,'vk_mem_alloc.h']]], - ['vma_5fpool_5fcreate_5flinear_5falgorithm_5fbit_433',['VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7a13c8a444197c67866be9cb05599fc726',1,'vk_mem_alloc.h']]], - ['vma_5frecord_5fflag_5fbits_5fmax_5fenum_434',['VMA_RECORD_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#a4dd2c44642312a147a4e93373a6e64d2a20dd17d69966dbffa054739d6090b85e',1,'vk_mem_alloc.h']]], - ['vma_5frecord_5fflush_5fafter_5fcall_5fbit_435',['VMA_RECORD_FLUSH_AFTER_CALL_BIT',['../vk__mem__alloc_8h.html#a4dd2c44642312a147a4e93373a6e64d2a8e7ab322e8732654be627c4ea8f36cc7',1,'vk_mem_alloc.h']]] + ['vma_5fallocation_5fcreate_5fcan_5fbecome_5flost_5fbit_419',['VMA_ALLOCATION_CREATE_CAN_BECOME_LOST_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a5f436af6c8fe8540573a6d22627a6fd2',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fcan_5fmake_5fother_5flost_5fbit_420',['VMA_ALLOCATION_CREATE_CAN_MAKE_OTHER_LOST_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a68686d0ce9beb0d4d1b9f2b8b1389a7e',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fdedicated_5fmemory_5fbit_421',['VMA_ALLOCATION_CREATE_DEDICATED_MEMORY_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a3fc311d855c2ff53f1090ef5c722b38f',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fdont_5fbind_5fbit_422',['VMA_ALLOCATION_CREATE_DONT_BIND_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a2310568c62208af432724305fe29ccea',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fflag_5fbits_5fmax_5fenum_423',['VMA_ALLOCATION_CREATE_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597ae5633ec569f4899cf8f29e7385b2f882',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fmapped_5fbit_424',['VMA_ALLOCATION_CREATE_MAPPED_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a11da372cc3a82931c5e5d6146cd9dd1f',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fnever_5fallocate_5fbit_425',['VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a89759603401014eb325eb22a3839f2ff',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fstrategy_5fbest_5ffit_5fbit_426',['VMA_ALLOCATION_CREATE_STRATEGY_BEST_FIT_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a839826775c62319466441f86496f036d',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fstrategy_5ffirst_5ffit_5fbit_427',['VMA_ALLOCATION_CREATE_STRATEGY_FIRST_FIT_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a33eb2052674f3ad92386c714a65fb777',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fstrategy_5fmask_428',['VMA_ALLOCATION_CREATE_STRATEGY_MASK',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a8e16845d81ae3d27c47106d4770d5c7e',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fstrategy_5fmin_5ffragmentation_5fbit_429',['VMA_ALLOCATION_CREATE_STRATEGY_MIN_FRAGMENTATION_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a621b704103eb3360230c860acf36e706',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fstrategy_5fmin_5fmemory_5fbit_430',['VMA_ALLOCATION_CREATE_STRATEGY_MIN_MEMORY_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a8af1210cf591784afa026d94998f735d',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fstrategy_5fmin_5ftime_5fbit_431',['VMA_ALLOCATION_CREATE_STRATEGY_MIN_TIME_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a0729e932b7ea170e3a128cad96c5cf6d',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fstrategy_5fworst_5ffit_5fbit_432',['VMA_ALLOCATION_CREATE_STRATEGY_WORST_FIT_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597ad242a04f802e25fef0b880afe8bb0a62',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fupper_5faddress_5fbit_433',['VMA_ALLOCATION_CREATE_UPPER_ADDRESS_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597a42ba3a2d2c7117953210b7c3ef8da0df',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fuser_5fdata_5fcopy_5fstring_5fbit_434',['VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597aa6f24f821cd6a7c5e4a443f7bf59c520',1,'vk_mem_alloc.h']]], + ['vma_5fallocation_5fcreate_5fwithin_5fbudget_5fbit_435',['VMA_ALLOCATION_CREATE_WITHIN_BUDGET_BIT',['../vk__mem__alloc_8h.html#ad9889c10c798b040d59c92f257cae597ab8b1764f3e9022368e440c057783b92d',1,'vk_mem_alloc.h']]], + ['vma_5fallocator_5fcreate_5famd_5fdevice_5fcoherent_5fmemory_5fbit_436',['VMA_ALLOCATOR_CREATE_AMD_DEVICE_COHERENT_MEMORY_BIT',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7ca2acce4886d8078552efa38878413970f',1,'vk_mem_alloc.h']]], + ['vma_5fallocator_5fcreate_5fext_5fmemory_5fbudget_5fbit_437',['VMA_ALLOCATOR_CREATE_EXT_MEMORY_BUDGET_BIT',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7ca4d4687863f7bd4b418c6006dc04400b0',1,'vk_mem_alloc.h']]], + ['vma_5fallocator_5fcreate_5fexternally_5fsynchronized_5fbit_438',['VMA_ALLOCATOR_CREATE_EXTERNALLY_SYNCHRONIZED_BIT',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7ca4816ddaed324ba110172ca608a20f29d',1,'vk_mem_alloc.h']]], + ['vma_5fallocator_5fcreate_5fflag_5fbits_5fmax_5fenum_439',['VMA_ALLOCATOR_CREATE_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7cae4d5ad929caba5f23eb502b13bd5286c',1,'vk_mem_alloc.h']]], + ['vma_5fallocator_5fcreate_5fkhr_5fbind_5fmemory2_5fbit_440',['VMA_ALLOCATOR_CREATE_KHR_BIND_MEMORY2_BIT',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7ca8fb75bf07cd184ab903596295e863dee',1,'vk_mem_alloc.h']]], + ['vma_5fallocator_5fcreate_5fkhr_5fdedicated_5fallocation_5fbit_441',['VMA_ALLOCATOR_CREATE_KHR_DEDICATED_ALLOCATION_BIT',['../vk__mem__alloc_8h.html#a4f87c9100d154a65a4ad495f7763cf7cace7da7cc6e71a625dfa763c55a597878',1,'vk_mem_alloc.h']]], + ['vma_5fdefragmentation_5fflag_5fbits_5fmax_5fenum_442',['VMA_DEFRAGMENTATION_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#a6552a65b71d16f378c6994b3ceaef50cab87ec33154803bfeb5ac2b379f1d6a97',1,'vk_mem_alloc.h']]], + ['vma_5fdefragmentation_5fflag_5fincremental_443',['VMA_DEFRAGMENTATION_FLAG_INCREMENTAL',['../vk__mem__alloc_8h.html#a6552a65b71d16f378c6994b3ceaef50ca31af49446af2459284a568ce2f3fdd33',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5fcpu_5fcopy_444',['VMA_MEMORY_USAGE_CPU_COPY',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca416a444d4d0fc20067c3f76f32ff2500',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5fcpu_5fonly_445',['VMA_MEMORY_USAGE_CPU_ONLY',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca40bdf4cddeffeb12f43d45ca1286e0a5',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5fcpu_5fto_5fgpu_446',['VMA_MEMORY_USAGE_CPU_TO_GPU',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca9066b52c5a7079bb74a69aaf8b92ff67',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5fgpu_5flazily_5fallocated_447',['VMA_MEMORY_USAGE_GPU_LAZILY_ALLOCATED',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca835333d9072db63a653818030e17614d',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5fgpu_5fonly_448',['VMA_MEMORY_USAGE_GPU_ONLY',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305ccac6b5dc1432d88647aa4cd456246eadf7',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5fgpu_5fto_5fcpu_449',['VMA_MEMORY_USAGE_GPU_TO_CPU',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca7b586d2fdaf82a463b58f581ed72be27',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5fmax_5fenum_450',['VMA_MEMORY_USAGE_MAX_ENUM',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305cca091e69437ef693e8d0d287f1c719ba6e',1,'vk_mem_alloc.h']]], + ['vma_5fmemory_5fusage_5funknown_451',['VMA_MEMORY_USAGE_UNKNOWN',['../vk__mem__alloc_8h.html#aa5846affa1e9da3800e3e78fae2305ccaf50d27e34e0925cf3a63db8c839121dd',1,'vk_mem_alloc.h']]], + ['vma_5fpool_5fcreate_5falgorithm_5fmask_452',['VMA_POOL_CREATE_ALGORITHM_MASK',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7af4d270f8f42517a0f70037ceb6ac1d9c',1,'vk_mem_alloc.h']]], + ['vma_5fpool_5fcreate_5fbuddy_5falgorithm_5fbit_453',['VMA_POOL_CREATE_BUDDY_ALGORITHM_BIT',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7a97a0dc38e5161b780594d998d313d35e',1,'vk_mem_alloc.h']]], + ['vma_5fpool_5fcreate_5fflag_5fbits_5fmax_5fenum_454',['VMA_POOL_CREATE_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7a1c7312bea9ea246846b9054fd6bd6aec',1,'vk_mem_alloc.h']]], + ['vma_5fpool_5fcreate_5fignore_5fbuffer_5fimage_5fgranularity_5fbit_455',['VMA_POOL_CREATE_IGNORE_BUFFER_IMAGE_GRANULARITY_BIT',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7a9f1a499508a8edb4e8ba40aa0290a3d2',1,'vk_mem_alloc.h']]], + ['vma_5fpool_5fcreate_5flinear_5falgorithm_5fbit_456',['VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT',['../vk__mem__alloc_8h.html#a9a7c45f9c863695d98c83fa5ac940fe7a13c8a444197c67866be9cb05599fc726',1,'vk_mem_alloc.h']]], + ['vma_5frecord_5fflag_5fbits_5fmax_5fenum_457',['VMA_RECORD_FLAG_BITS_MAX_ENUM',['../vk__mem__alloc_8h.html#a4dd2c44642312a147a4e93373a6e64d2a20dd17d69966dbffa054739d6090b85e',1,'vk_mem_alloc.h']]], + ['vma_5frecord_5fflush_5fafter_5fcall_5fbit_458',['VMA_RECORD_FLUSH_AFTER_CALL_BIT',['../vk__mem__alloc_8h.html#a4dd2c44642312a147a4e93373a6e64d2a8e7ab322e8732654be627c4ea8f36cc7',1,'vk_mem_alloc.h']]] ]; diff --git a/docs/html/search/files_0.js b/docs/html/search/files_0.js index 3d1d93e..213d5e5 100644 --- a/docs/html/search/files_0.js +++ b/docs/html/search/files_0.js @@ -1,4 +1,4 @@ var searchData= [ - ['vk_5fmem_5falloc_2eh_238',['vk_mem_alloc.h',['../vk__mem__alloc_8h.html',1,'']]] + ['vk_5fmem_5falloc_2eh_251',['vk_mem_alloc.h',['../vk__mem__alloc_8h.html',1,'']]] ]; diff --git a/docs/html/search/functions_0.js b/docs/html/search/functions_0.js index 9e43030..c7f66d3 100644 --- a/docs/html/search/functions_0.js +++ b/docs/html/search/functions_0.js @@ -1,50 +1,52 @@ var searchData= [ - ['vmaallocatememory_239',['vmaAllocateMemory',['../vk__mem__alloc_8h.html#abf28077dbf82d0908b8acbe8ee8dd9b8',1,'vk_mem_alloc.h']]], - ['vmaallocatememoryforbuffer_240',['vmaAllocateMemoryForBuffer',['../vk__mem__alloc_8h.html#a7fdf64415b6c3d83c454f28d2c53df7b',1,'vk_mem_alloc.h']]], - ['vmaallocatememoryforimage_241',['vmaAllocateMemoryForImage',['../vk__mem__alloc_8h.html#a0faa3f9e5fb233d29d1e00390650febb',1,'vk_mem_alloc.h']]], - ['vmaallocatememorypages_242',['vmaAllocateMemoryPages',['../vk__mem__alloc_8h.html#ad37e82e492b3de38fc3f4cffd9ad0ae1',1,'vk_mem_alloc.h']]], - ['vmabindbuffermemory_243',['vmaBindBufferMemory',['../vk__mem__alloc_8h.html#a6b0929b914b60cf2d45cac4bf3547470',1,'vk_mem_alloc.h']]], - ['vmabindbuffermemory2_244',['vmaBindBufferMemory2',['../vk__mem__alloc_8h.html#a927c944f45e0f2941182abb6f608e64a',1,'vk_mem_alloc.h']]], - ['vmabindimagememory_245',['vmaBindImageMemory',['../vk__mem__alloc_8h.html#a3d3ca45799923aa5d138e9e5f9eb2da5',1,'vk_mem_alloc.h']]], - ['vmabindimagememory2_246',['vmaBindImageMemory2',['../vk__mem__alloc_8h.html#aa8251ee81b0045a443e35b8e8aa021bc',1,'vk_mem_alloc.h']]], - ['vmabuildstatsstring_247',['vmaBuildStatsString',['../vk__mem__alloc_8h.html#aa4fee7eb5253377599ef4fd38c93c2a0',1,'vk_mem_alloc.h']]], - ['vmacalculatestats_248',['vmaCalculateStats',['../vk__mem__alloc_8h.html#a333b61c1788cb23559177531e6a93ca3',1,'vk_mem_alloc.h']]], - ['vmacheckcorruption_249',['vmaCheckCorruption',['../vk__mem__alloc_8h.html#a49329a7f030dafcf82f7b73334c22e98',1,'vk_mem_alloc.h']]], - ['vmacheckpoolcorruption_250',['vmaCheckPoolCorruption',['../vk__mem__alloc_8h.html#ad535935619c7a549bf837e1bb0068f89',1,'vk_mem_alloc.h']]], - ['vmacreateallocator_251',['vmaCreateAllocator',['../vk__mem__alloc_8h.html#a200692051ddb34240248234f5f4c17bb',1,'vk_mem_alloc.h']]], - ['vmacreatebuffer_252',['vmaCreateBuffer',['../vk__mem__alloc_8h.html#ac72ee55598617e8eecca384e746bab51',1,'vk_mem_alloc.h']]], - ['vmacreateimage_253',['vmaCreateImage',['../vk__mem__alloc_8h.html#a02a94f25679275851a53e82eacbcfc73',1,'vk_mem_alloc.h']]], - ['vmacreatelostallocation_254',['vmaCreateLostAllocation',['../vk__mem__alloc_8h.html#ae5c9657d9e94756269145b01c05d16f1',1,'vk_mem_alloc.h']]], - ['vmacreatepool_255',['vmaCreatePool',['../vk__mem__alloc_8h.html#a5c8770ded7c59c8caac6de0c2cb00b50',1,'vk_mem_alloc.h']]], - ['vmadefragment_256',['vmaDefragment',['../vk__mem__alloc_8h.html#a6aced90fcc7b39882b6654a740a0b9bb',1,'vk_mem_alloc.h']]], - ['vmadefragmentationbegin_257',['vmaDefragmentationBegin',['../vk__mem__alloc_8h.html#a36ba776fd7fd5cb1e9359fdc0d8e6e8a',1,'vk_mem_alloc.h']]], - ['vmadefragmentationend_258',['vmaDefragmentationEnd',['../vk__mem__alloc_8h.html#a8774e20e91e245aae959ba63efa15dd2',1,'vk_mem_alloc.h']]], - ['vmadestroyallocator_259',['vmaDestroyAllocator',['../vk__mem__alloc_8h.html#aa8d164061c88f22fb1fd3c8f3534bc1d',1,'vk_mem_alloc.h']]], - ['vmadestroybuffer_260',['vmaDestroyBuffer',['../vk__mem__alloc_8h.html#a0d9f4e4ba5bf9aab1f1c746387753d77',1,'vk_mem_alloc.h']]], - ['vmadestroyimage_261',['vmaDestroyImage',['../vk__mem__alloc_8h.html#ae50d2cb3b4a3bfd4dd40987234e50e7e',1,'vk_mem_alloc.h']]], - ['vmadestroypool_262',['vmaDestroyPool',['../vk__mem__alloc_8h.html#a5485779c8f1948238fc4e92232fa65e1',1,'vk_mem_alloc.h']]], - ['vmafindmemorytypeindex_263',['vmaFindMemoryTypeIndex',['../vk__mem__alloc_8h.html#aef15a94b58fbcb0fe706d5720e84a74a',1,'vk_mem_alloc.h']]], - ['vmafindmemorytypeindexforbufferinfo_264',['vmaFindMemoryTypeIndexForBufferInfo',['../vk__mem__alloc_8h.html#ae790ab9ffaf7667fb8f62523e6897888',1,'vk_mem_alloc.h']]], - ['vmafindmemorytypeindexforimageinfo_265',['vmaFindMemoryTypeIndexForImageInfo',['../vk__mem__alloc_8h.html#a088da83d8eaf3ce9056d9ea0b981d472',1,'vk_mem_alloc.h']]], - ['vmaflushallocation_266',['vmaFlushAllocation',['../vk__mem__alloc_8h.html#abc34ee6f021f459aff885f3758c435de',1,'vk_mem_alloc.h']]], - ['vmafreememory_267',['vmaFreeMemory',['../vk__mem__alloc_8h.html#a11f0fbc034fa81a4efedd73d61ce7568',1,'vk_mem_alloc.h']]], - ['vmafreememorypages_268',['vmaFreeMemoryPages',['../vk__mem__alloc_8h.html#ab9e709de044c5d8476bea77a4e755840',1,'vk_mem_alloc.h']]], - ['vmafreestatsstring_269',['vmaFreeStatsString',['../vk__mem__alloc_8h.html#a3104eb30d8122c84dd8541063f145288',1,'vk_mem_alloc.h']]], - ['vmagetallocationinfo_270',['vmaGetAllocationInfo',['../vk__mem__alloc_8h.html#a86dd08aba8633bfa4ad0df2e76481d8b',1,'vk_mem_alloc.h']]], - ['vmagetbudget_271',['vmaGetBudget',['../vk__mem__alloc_8h.html#aec0ed24ebea2d0099eed5f801daaefba',1,'vk_mem_alloc.h']]], - ['vmagetmemoryproperties_272',['vmaGetMemoryProperties',['../vk__mem__alloc_8h.html#ab88db292a17974f911182543fda52d19',1,'vk_mem_alloc.h']]], - ['vmagetmemorytypeproperties_273',['vmaGetMemoryTypeProperties',['../vk__mem__alloc_8h.html#a8701444752eb5de4464adb5a2b514bca',1,'vk_mem_alloc.h']]], - ['vmagetphysicaldeviceproperties_274',['vmaGetPhysicalDeviceProperties',['../vk__mem__alloc_8h.html#aecabf7b6e91ea87d0316fa0a9e014fe0',1,'vk_mem_alloc.h']]], - ['vmagetpoolname_275',['vmaGetPoolName',['../vk__mem__alloc_8h.html#af09b4e4eafdbee812e8d73ddf960f030',1,'vk_mem_alloc.h']]], - ['vmagetpoolstats_276',['vmaGetPoolStats',['../vk__mem__alloc_8h.html#ae8bf76997b234ef68aad922616df4153',1,'vk_mem_alloc.h']]], - ['vmainvalidateallocation_277',['vmaInvalidateAllocation',['../vk__mem__alloc_8h.html#a0d0eb0c1102268fa9a476d12ecbe4006',1,'vk_mem_alloc.h']]], - ['vmamakepoolallocationslost_278',['vmaMakePoolAllocationsLost',['../vk__mem__alloc_8h.html#a736bd6cbda886f36c891727e73bd4024',1,'vk_mem_alloc.h']]], - ['vmamapmemory_279',['vmaMapMemory',['../vk__mem__alloc_8h.html#ad5bd1243512d099706de88168992f069',1,'vk_mem_alloc.h']]], - ['vmaresizeallocation_280',['vmaResizeAllocation',['../vk__mem__alloc_8h.html#a0ff488958ca72b28e545880463cb8696',1,'vk_mem_alloc.h']]], - ['vmasetallocationuserdata_281',['vmaSetAllocationUserData',['../vk__mem__alloc_8h.html#af9147d31ffc11d62fc187bde283ed14f',1,'vk_mem_alloc.h']]], - ['vmasetcurrentframeindex_282',['vmaSetCurrentFrameIndex',['../vk__mem__alloc_8h.html#ade56bf8dc9f5a5eaddf5f119ed525236',1,'vk_mem_alloc.h']]], - ['vmasetpoolname_283',['vmaSetPoolName',['../vk__mem__alloc_8h.html#adbae3a0b4ab078024462fc85c37f3b58',1,'vk_mem_alloc.h']]], - ['vmatouchallocation_284',['vmaTouchAllocation',['../vk__mem__alloc_8h.html#a43d8ba9673c846f049089a5029d5c73a',1,'vk_mem_alloc.h']]], - ['vmaunmapmemory_285',['vmaUnmapMemory',['../vk__mem__alloc_8h.html#a9bc268595cb33f6ec4d519cfce81ff45',1,'vk_mem_alloc.h']]] + ['vmaallocatememory_252',['vmaAllocateMemory',['../vk__mem__alloc_8h.html#abf28077dbf82d0908b8acbe8ee8dd9b8',1,'vk_mem_alloc.h']]], + ['vmaallocatememoryforbuffer_253',['vmaAllocateMemoryForBuffer',['../vk__mem__alloc_8h.html#a7fdf64415b6c3d83c454f28d2c53df7b',1,'vk_mem_alloc.h']]], + ['vmaallocatememoryforimage_254',['vmaAllocateMemoryForImage',['../vk__mem__alloc_8h.html#a0faa3f9e5fb233d29d1e00390650febb',1,'vk_mem_alloc.h']]], + ['vmaallocatememorypages_255',['vmaAllocateMemoryPages',['../vk__mem__alloc_8h.html#ad37e82e492b3de38fc3f4cffd9ad0ae1',1,'vk_mem_alloc.h']]], + ['vmabegindefragmentationpass_256',['vmaBeginDefragmentationPass',['../vk__mem__alloc_8h.html#ac0f01545b6262f7d4d128fc8f8e5c77b',1,'vk_mem_alloc.h']]], + ['vmabindbuffermemory_257',['vmaBindBufferMemory',['../vk__mem__alloc_8h.html#a6b0929b914b60cf2d45cac4bf3547470',1,'vk_mem_alloc.h']]], + ['vmabindbuffermemory2_258',['vmaBindBufferMemory2',['../vk__mem__alloc_8h.html#a927c944f45e0f2941182abb6f608e64a',1,'vk_mem_alloc.h']]], + ['vmabindimagememory_259',['vmaBindImageMemory',['../vk__mem__alloc_8h.html#a3d3ca45799923aa5d138e9e5f9eb2da5',1,'vk_mem_alloc.h']]], + ['vmabindimagememory2_260',['vmaBindImageMemory2',['../vk__mem__alloc_8h.html#aa8251ee81b0045a443e35b8e8aa021bc',1,'vk_mem_alloc.h']]], + ['vmabuildstatsstring_261',['vmaBuildStatsString',['../vk__mem__alloc_8h.html#aa4fee7eb5253377599ef4fd38c93c2a0',1,'vk_mem_alloc.h']]], + ['vmacalculatestats_262',['vmaCalculateStats',['../vk__mem__alloc_8h.html#a333b61c1788cb23559177531e6a93ca3',1,'vk_mem_alloc.h']]], + ['vmacheckcorruption_263',['vmaCheckCorruption',['../vk__mem__alloc_8h.html#a49329a7f030dafcf82f7b73334c22e98',1,'vk_mem_alloc.h']]], + ['vmacheckpoolcorruption_264',['vmaCheckPoolCorruption',['../vk__mem__alloc_8h.html#ad535935619c7a549bf837e1bb0068f89',1,'vk_mem_alloc.h']]], + ['vmacreateallocator_265',['vmaCreateAllocator',['../vk__mem__alloc_8h.html#a200692051ddb34240248234f5f4c17bb',1,'vk_mem_alloc.h']]], + ['vmacreatebuffer_266',['vmaCreateBuffer',['../vk__mem__alloc_8h.html#ac72ee55598617e8eecca384e746bab51',1,'vk_mem_alloc.h']]], + ['vmacreateimage_267',['vmaCreateImage',['../vk__mem__alloc_8h.html#a02a94f25679275851a53e82eacbcfc73',1,'vk_mem_alloc.h']]], + ['vmacreatelostallocation_268',['vmaCreateLostAllocation',['../vk__mem__alloc_8h.html#ae5c9657d9e94756269145b01c05d16f1',1,'vk_mem_alloc.h']]], + ['vmacreatepool_269',['vmaCreatePool',['../vk__mem__alloc_8h.html#a5c8770ded7c59c8caac6de0c2cb00b50',1,'vk_mem_alloc.h']]], + ['vmadefragment_270',['vmaDefragment',['../vk__mem__alloc_8h.html#a6aced90fcc7b39882b6654a740a0b9bb',1,'vk_mem_alloc.h']]], + ['vmadefragmentationbegin_271',['vmaDefragmentationBegin',['../vk__mem__alloc_8h.html#a36ba776fd7fd5cb1e9359fdc0d8e6e8a',1,'vk_mem_alloc.h']]], + ['vmadefragmentationend_272',['vmaDefragmentationEnd',['../vk__mem__alloc_8h.html#a8774e20e91e245aae959ba63efa15dd2',1,'vk_mem_alloc.h']]], + ['vmadestroyallocator_273',['vmaDestroyAllocator',['../vk__mem__alloc_8h.html#aa8d164061c88f22fb1fd3c8f3534bc1d',1,'vk_mem_alloc.h']]], + ['vmadestroybuffer_274',['vmaDestroyBuffer',['../vk__mem__alloc_8h.html#a0d9f4e4ba5bf9aab1f1c746387753d77',1,'vk_mem_alloc.h']]], + ['vmadestroyimage_275',['vmaDestroyImage',['../vk__mem__alloc_8h.html#ae50d2cb3b4a3bfd4dd40987234e50e7e',1,'vk_mem_alloc.h']]], + ['vmadestroypool_276',['vmaDestroyPool',['../vk__mem__alloc_8h.html#a5485779c8f1948238fc4e92232fa65e1',1,'vk_mem_alloc.h']]], + ['vmaenddefragmentationpass_277',['vmaEndDefragmentationPass',['../vk__mem__alloc_8h.html#a1b9ffa538bed905af55c747cc48963bd',1,'vk_mem_alloc.h']]], + ['vmafindmemorytypeindex_278',['vmaFindMemoryTypeIndex',['../vk__mem__alloc_8h.html#aef15a94b58fbcb0fe706d5720e84a74a',1,'vk_mem_alloc.h']]], + ['vmafindmemorytypeindexforbufferinfo_279',['vmaFindMemoryTypeIndexForBufferInfo',['../vk__mem__alloc_8h.html#ae790ab9ffaf7667fb8f62523e6897888',1,'vk_mem_alloc.h']]], + ['vmafindmemorytypeindexforimageinfo_280',['vmaFindMemoryTypeIndexForImageInfo',['../vk__mem__alloc_8h.html#a088da83d8eaf3ce9056d9ea0b981d472',1,'vk_mem_alloc.h']]], + ['vmaflushallocation_281',['vmaFlushAllocation',['../vk__mem__alloc_8h.html#abc34ee6f021f459aff885f3758c435de',1,'vk_mem_alloc.h']]], + ['vmafreememory_282',['vmaFreeMemory',['../vk__mem__alloc_8h.html#a11f0fbc034fa81a4efedd73d61ce7568',1,'vk_mem_alloc.h']]], + ['vmafreememorypages_283',['vmaFreeMemoryPages',['../vk__mem__alloc_8h.html#ab9e709de044c5d8476bea77a4e755840',1,'vk_mem_alloc.h']]], + ['vmafreestatsstring_284',['vmaFreeStatsString',['../vk__mem__alloc_8h.html#a3104eb30d8122c84dd8541063f145288',1,'vk_mem_alloc.h']]], + ['vmagetallocationinfo_285',['vmaGetAllocationInfo',['../vk__mem__alloc_8h.html#a86dd08aba8633bfa4ad0df2e76481d8b',1,'vk_mem_alloc.h']]], + ['vmagetbudget_286',['vmaGetBudget',['../vk__mem__alloc_8h.html#aec0ed24ebea2d0099eed5f801daaefba',1,'vk_mem_alloc.h']]], + ['vmagetmemoryproperties_287',['vmaGetMemoryProperties',['../vk__mem__alloc_8h.html#ab88db292a17974f911182543fda52d19',1,'vk_mem_alloc.h']]], + ['vmagetmemorytypeproperties_288',['vmaGetMemoryTypeProperties',['../vk__mem__alloc_8h.html#a8701444752eb5de4464adb5a2b514bca',1,'vk_mem_alloc.h']]], + ['vmagetphysicaldeviceproperties_289',['vmaGetPhysicalDeviceProperties',['../vk__mem__alloc_8h.html#aecabf7b6e91ea87d0316fa0a9e014fe0',1,'vk_mem_alloc.h']]], + ['vmagetpoolname_290',['vmaGetPoolName',['../vk__mem__alloc_8h.html#af09b4e4eafdbee812e8d73ddf960f030',1,'vk_mem_alloc.h']]], + ['vmagetpoolstats_291',['vmaGetPoolStats',['../vk__mem__alloc_8h.html#ae8bf76997b234ef68aad922616df4153',1,'vk_mem_alloc.h']]], + ['vmainvalidateallocation_292',['vmaInvalidateAllocation',['../vk__mem__alloc_8h.html#a0d0eb0c1102268fa9a476d12ecbe4006',1,'vk_mem_alloc.h']]], + ['vmamakepoolallocationslost_293',['vmaMakePoolAllocationsLost',['../vk__mem__alloc_8h.html#a736bd6cbda886f36c891727e73bd4024',1,'vk_mem_alloc.h']]], + ['vmamapmemory_294',['vmaMapMemory',['../vk__mem__alloc_8h.html#ad5bd1243512d099706de88168992f069',1,'vk_mem_alloc.h']]], + ['vmaresizeallocation_295',['vmaResizeAllocation',['../vk__mem__alloc_8h.html#a0ff488958ca72b28e545880463cb8696',1,'vk_mem_alloc.h']]], + ['vmasetallocationuserdata_296',['vmaSetAllocationUserData',['../vk__mem__alloc_8h.html#af9147d31ffc11d62fc187bde283ed14f',1,'vk_mem_alloc.h']]], + ['vmasetcurrentframeindex_297',['vmaSetCurrentFrameIndex',['../vk__mem__alloc_8h.html#ade56bf8dc9f5a5eaddf5f119ed525236',1,'vk_mem_alloc.h']]], + ['vmasetpoolname_298',['vmaSetPoolName',['../vk__mem__alloc_8h.html#adbae3a0b4ab078024462fc85c37f3b58',1,'vk_mem_alloc.h']]], + ['vmatouchallocation_299',['vmaTouchAllocation',['../vk__mem__alloc_8h.html#a43d8ba9673c846f049089a5029d5c73a',1,'vk_mem_alloc.h']]], + ['vmaunmapmemory_300',['vmaUnmapMemory',['../vk__mem__alloc_8h.html#a9bc268595cb33f6ec4d519cfce81ff45',1,'vk_mem_alloc.h']]] ]; diff --git a/docs/html/search/pages_0.js b/docs/html/search/pages_0.js index 1d82fdb..d87f8ee 100644 --- a/docs/html/search/pages_0.js +++ b/docs/html/search/pages_0.js @@ -1,4 +1,4 @@ var searchData= [ - ['allocation_20names_20and_20user_20data_443',['Allocation names and user data',['../allocation_annotation.html',1,'']]] + ['allocation_20names_20and_20user_20data_466',['Allocation names and user data',['../allocation_annotation.html',1,'']]] ]; diff --git a/docs/html/search/pages_1.js b/docs/html/search/pages_1.js index 21a2119..ad7ef39 100644 --- a/docs/html/search/pages_1.js +++ b/docs/html/search/pages_1.js @@ -1,6 +1,6 @@ var searchData= [ - ['choosing_20memory_20type_444',['Choosing memory type',['../choosing_memory_type.html',1,'']]], - ['configuration_445',['Configuration',['../configuration.html',1,'']]], - ['custom_20memory_20pools_446',['Custom memory pools',['../custom_memory_pools.html',1,'']]] + ['choosing_20memory_20type_467',['Choosing memory type',['../choosing_memory_type.html',1,'']]], + ['configuration_468',['Configuration',['../configuration.html',1,'']]], + ['custom_20memory_20pools_469',['Custom memory pools',['../custom_memory_pools.html',1,'']]] ]; diff --git a/docs/html/search/pages_2.js b/docs/html/search/pages_2.js index c973588..4ab962e 100644 --- a/docs/html/search/pages_2.js +++ b/docs/html/search/pages_2.js @@ -1,6 +1,6 @@ var searchData= [ - ['debugging_20incorrect_20memory_20usage_447',['Debugging incorrect memory usage',['../debugging_memory_usage.html',1,'']]], - ['defragmentation_448',['Defragmentation',['../defragmentation.html',1,'']]], - ['deprecated_20list_449',['Deprecated List',['../deprecated.html',1,'']]] + ['debugging_20incorrect_20memory_20usage_470',['Debugging incorrect memory usage',['../debugging_memory_usage.html',1,'']]], + ['defragmentation_471',['Defragmentation',['../defragmentation.html',1,'']]], + ['deprecated_20list_472',['Deprecated List',['../deprecated.html',1,'']]] ]; diff --git a/docs/html/search/pages_3.js b/docs/html/search/pages_3.js index 174dd5e..8de57ec 100644 --- a/docs/html/search/pages_3.js +++ b/docs/html/search/pages_3.js @@ -1,4 +1,4 @@ var searchData= [ - ['general_20considerations_450',['General considerations',['../general_considerations.html',1,'']]] + ['general_20considerations_473',['General considerations',['../general_considerations.html',1,'']]] ]; diff --git a/docs/html/search/pages_4.js b/docs/html/search/pages_4.js index 88bc63f..f9e91d6 100644 --- a/docs/html/search/pages_4.js +++ b/docs/html/search/pages_4.js @@ -1,4 +1,4 @@ var searchData= [ - ['lost_20allocations_451',['Lost allocations',['../lost_allocations.html',1,'']]] + ['lost_20allocations_474',['Lost allocations',['../lost_allocations.html',1,'']]] ]; diff --git a/docs/html/search/pages_5.js b/docs/html/search/pages_5.js index 2721810..457f2a3 100644 --- a/docs/html/search/pages_5.js +++ b/docs/html/search/pages_5.js @@ -1,4 +1,4 @@ var searchData= [ - ['memory_20mapping_452',['Memory mapping',['../memory_mapping.html',1,'']]] + ['memory_20mapping_475',['Memory mapping',['../memory_mapping.html',1,'']]] ]; diff --git a/docs/html/search/pages_6.js b/docs/html/search/pages_6.js index a208f81..e27e95a 100644 --- a/docs/html/search/pages_6.js +++ b/docs/html/search/pages_6.js @@ -1,4 +1,4 @@ var searchData= [ - ['quick_20start_453',['Quick start',['../quick_start.html',1,'']]] + ['quick_20start_476',['Quick start',['../quick_start.html',1,'']]] ]; diff --git a/docs/html/search/pages_7.js b/docs/html/search/pages_7.js index fd516c0..7ec3dbf 100644 --- a/docs/html/search/pages_7.js +++ b/docs/html/search/pages_7.js @@ -1,5 +1,5 @@ var searchData= [ - ['record_20and_20replay_454',['Record and replay',['../record_and_replay.html',1,'']]], - ['recommended_20usage_20patterns_455',['Recommended usage patterns',['../usage_patterns.html',1,'']]] + ['record_20and_20replay_477',['Record and replay',['../record_and_replay.html',1,'']]], + ['recommended_20usage_20patterns_478',['Recommended usage patterns',['../usage_patterns.html',1,'']]] ]; diff --git a/docs/html/search/pages_8.js b/docs/html/search/pages_8.js index 93ad4e8..171de9a 100644 --- a/docs/html/search/pages_8.js +++ b/docs/html/search/pages_8.js @@ -1,5 +1,5 @@ var searchData= [ - ['statistics_456',['Statistics',['../statistics.html',1,'']]], - ['staying_20within_20budget_457',['Staying within budget',['../staying_within_budget.html',1,'']]] + ['statistics_479',['Statistics',['../statistics.html',1,'']]], + ['staying_20within_20budget_480',['Staying within budget',['../staying_within_budget.html',1,'']]] ]; diff --git a/docs/html/search/pages_9.js b/docs/html/search/pages_9.js index 9eeece3..4d07f95 100644 --- a/docs/html/search/pages_9.js +++ b/docs/html/search/pages_9.js @@ -1,5 +1,6 @@ var searchData= [ - ['vulkan_20memory_20allocator_458',['Vulkan Memory Allocator',['../index.html',1,'']]], - ['vk_5fkhr_5fdedicated_5fallocation_459',['VK_KHR_dedicated_allocation',['../vk_khr_dedicated_allocation.html',1,'']]] + ['vulkan_20memory_20allocator_481',['Vulkan Memory Allocator',['../index.html',1,'']]], + ['vk_5famd_5fdevice_5fcoherent_5fmemory_482',['VK_AMD_device_coherent_memory',['../vk_amd_device_coherent_memory.html',1,'']]], + ['vk_5fkhr_5fdedicated_5fallocation_483',['VK_KHR_dedicated_allocation',['../vk_khr_dedicated_allocation.html',1,'']]] ]; diff --git a/docs/html/search/typedefs_0.js b/docs/html/search/typedefs_0.js index 7b21d9a..07542ec 100644 --- a/docs/html/search/typedefs_0.js +++ b/docs/html/search/typedefs_0.js @@ -1,5 +1,5 @@ var searchData= [ - ['pfn_5fvmaallocatedevicememoryfunction_365',['PFN_vmaAllocateDeviceMemoryFunction',['../vk__mem__alloc_8h.html#ab6a6477cda1ce775b30bde96d766203b',1,'vk_mem_alloc.h']]], - ['pfn_5fvmafreedevicememoryfunction_366',['PFN_vmaFreeDeviceMemoryFunction',['../vk__mem__alloc_8h.html#aef2545dc2e9dd4f29ab9ba6ac6fe2f49',1,'vk_mem_alloc.h']]] + ['pfn_5fvmaallocatedevicememoryfunction_384',['PFN_vmaAllocateDeviceMemoryFunction',['../vk__mem__alloc_8h.html#ab6a6477cda1ce775b30bde96d766203b',1,'vk_mem_alloc.h']]], + ['pfn_5fvmafreedevicememoryfunction_385',['PFN_vmaFreeDeviceMemoryFunction',['../vk__mem__alloc_8h.html#aef2545dc2e9dd4f29ab9ba6ac6fe2f49',1,'vk_mem_alloc.h']]] ]; diff --git a/docs/html/search/typedefs_1.js b/docs/html/search/typedefs_1.js index 7aad6a9..8878670 100644 --- a/docs/html/search/typedefs_1.js +++ b/docs/html/search/typedefs_1.js @@ -1,28 +1,30 @@ var searchData= [ - ['vmaallocationcreateflagbits_367',['VmaAllocationCreateFlagBits',['../vk__mem__alloc_8h.html#abf6bf6748c7a9fe7ce5b7835c0f56af4',1,'vk_mem_alloc.h']]], - ['vmaallocationcreateflags_368',['VmaAllocationCreateFlags',['../vk__mem__alloc_8h.html#a5225e5e11f8376f6a31a1791f3d6e817',1,'vk_mem_alloc.h']]], - ['vmaallocationcreateinfo_369',['VmaAllocationCreateInfo',['../vk__mem__alloc_8h.html#a86c44f9950b40d50088ed93a17870a7a',1,'vk_mem_alloc.h']]], - ['vmaallocationinfo_370',['VmaAllocationInfo',['../vk__mem__alloc_8h.html#a795e6ff02a21d5486c0565f403dd9255',1,'vk_mem_alloc.h']]], - ['vmaallocatorcreateflagbits_371',['VmaAllocatorCreateFlagBits',['../vk__mem__alloc_8h.html#a4ddf381b6ce795bdfbc6c614640b9915',1,'vk_mem_alloc.h']]], - ['vmaallocatorcreateflags_372',['VmaAllocatorCreateFlags',['../vk__mem__alloc_8h.html#acfe6863e160722c2c1bbcf7573fddc4d',1,'vk_mem_alloc.h']]], - ['vmaallocatorcreateinfo_373',['VmaAllocatorCreateInfo',['../vk__mem__alloc_8h.html#ae0f6d1d733dded220d28134da46b4283',1,'vk_mem_alloc.h']]], - ['vmabudget_374',['VmaBudget',['../vk__mem__alloc_8h.html#ab79b48b6d25aada0de91a913896e1c38',1,'vk_mem_alloc.h']]], - ['vmadefragmentationflagbits_375',['VmaDefragmentationFlagBits',['../vk__mem__alloc_8h.html#a96df0eddab2e1735782fe4e7cd05ea7f',1,'vk_mem_alloc.h']]], - ['vmadefragmentationflags_376',['VmaDefragmentationFlags',['../vk__mem__alloc_8h.html#a88a77cef37e5d3c4fc9eb328885d048d',1,'vk_mem_alloc.h']]], - ['vmadefragmentationinfo_377',['VmaDefragmentationInfo',['../vk__mem__alloc_8h.html#ae67f8573a0cf20f16f0a1eecbca566a0',1,'vk_mem_alloc.h']]], - ['vmadefragmentationinfo2_378',['VmaDefragmentationInfo2',['../vk__mem__alloc_8h.html#abac0e85abaa6ea1ffd63bde29c5c3a29',1,'vk_mem_alloc.h']]], - ['vmadefragmentationstats_379',['VmaDefragmentationStats',['../vk__mem__alloc_8h.html#ab0f9b06441c840fee560de4a2967f8c9',1,'vk_mem_alloc.h']]], - ['vmadevicememorycallbacks_380',['VmaDeviceMemoryCallbacks',['../vk__mem__alloc_8h.html#a5e2eb68d727cfd4df25702b027b7aa31',1,'vk_mem_alloc.h']]], - ['vmamemoryusage_381',['VmaMemoryUsage',['../vk__mem__alloc_8h.html#ad63b2113c0bfdbeade1cb498f5a8580d',1,'vk_mem_alloc.h']]], - ['vmapoolcreateflagbits_382',['VmaPoolCreateFlagBits',['../vk__mem__alloc_8h.html#a8f93195158e0e2ac80ca352064e71c1f',1,'vk_mem_alloc.h']]], - ['vmapoolcreateflags_383',['VmaPoolCreateFlags',['../vk__mem__alloc_8h.html#a2770e325ea42e087c1b91fdf46d0292a',1,'vk_mem_alloc.h']]], - ['vmapoolcreateinfo_384',['VmaPoolCreateInfo',['../vk__mem__alloc_8h.html#a211706e9348dcee25a843ed4ea69bce7',1,'vk_mem_alloc.h']]], - ['vmapoolstats_385',['VmaPoolStats',['../vk__mem__alloc_8h.html#a2e5612d871d64c5624087b837a338c34',1,'vk_mem_alloc.h']]], - ['vmarecordflagbits_386',['VmaRecordFlagBits',['../vk__mem__alloc_8h.html#ade20b626a6635ce1bf30ea53dea774e4',1,'vk_mem_alloc.h']]], - ['vmarecordflags_387',['VmaRecordFlags',['../vk__mem__alloc_8h.html#af3929a1a4547c592fc0b0e55ef452828',1,'vk_mem_alloc.h']]], - ['vmarecordsettings_388',['VmaRecordSettings',['../vk__mem__alloc_8h.html#a0ab61e87ff6365f1d59915eadc37a9f0',1,'vk_mem_alloc.h']]], - ['vmastatinfo_389',['VmaStatInfo',['../vk__mem__alloc_8h.html#a810b009a788ee8aac72a25b42ffbe31c',1,'vk_mem_alloc.h']]], - ['vmastats_390',['VmaStats',['../vk__mem__alloc_8h.html#a732be855fb4a7c248e6853d928a729af',1,'vk_mem_alloc.h']]], - ['vmavulkanfunctions_391',['VmaVulkanFunctions',['../vk__mem__alloc_8h.html#a97064a1a271b0061ebfc3a079862d0c5',1,'vk_mem_alloc.h']]] + ['vmaallocationcreateflagbits_386',['VmaAllocationCreateFlagBits',['../vk__mem__alloc_8h.html#abf6bf6748c7a9fe7ce5b7835c0f56af4',1,'vk_mem_alloc.h']]], + ['vmaallocationcreateflags_387',['VmaAllocationCreateFlags',['../vk__mem__alloc_8h.html#a5225e5e11f8376f6a31a1791f3d6e817',1,'vk_mem_alloc.h']]], + ['vmaallocationcreateinfo_388',['VmaAllocationCreateInfo',['../vk__mem__alloc_8h.html#a86c44f9950b40d50088ed93a17870a7a',1,'vk_mem_alloc.h']]], + ['vmaallocationinfo_389',['VmaAllocationInfo',['../vk__mem__alloc_8h.html#a795e6ff02a21d5486c0565f403dd9255',1,'vk_mem_alloc.h']]], + ['vmaallocatorcreateflagbits_390',['VmaAllocatorCreateFlagBits',['../vk__mem__alloc_8h.html#a4ddf381b6ce795bdfbc6c614640b9915',1,'vk_mem_alloc.h']]], + ['vmaallocatorcreateflags_391',['VmaAllocatorCreateFlags',['../vk__mem__alloc_8h.html#acfe6863e160722c2c1bbcf7573fddc4d',1,'vk_mem_alloc.h']]], + ['vmaallocatorcreateinfo_392',['VmaAllocatorCreateInfo',['../vk__mem__alloc_8h.html#ae0f6d1d733dded220d28134da46b4283',1,'vk_mem_alloc.h']]], + ['vmabudget_393',['VmaBudget',['../vk__mem__alloc_8h.html#ab79b48b6d25aada0de91a913896e1c38',1,'vk_mem_alloc.h']]], + ['vmadefragmentationflagbits_394',['VmaDefragmentationFlagBits',['../vk__mem__alloc_8h.html#a96df0eddab2e1735782fe4e7cd05ea7f',1,'vk_mem_alloc.h']]], + ['vmadefragmentationflags_395',['VmaDefragmentationFlags',['../vk__mem__alloc_8h.html#a88a77cef37e5d3c4fc9eb328885d048d',1,'vk_mem_alloc.h']]], + ['vmadefragmentationinfo_396',['VmaDefragmentationInfo',['../vk__mem__alloc_8h.html#ae67f8573a0cf20f16f0a1eecbca566a0',1,'vk_mem_alloc.h']]], + ['vmadefragmentationinfo2_397',['VmaDefragmentationInfo2',['../vk__mem__alloc_8h.html#abac0e85abaa6ea1ffd63bde29c5c3a29',1,'vk_mem_alloc.h']]], + ['vmadefragmentationpassinfo_398',['VmaDefragmentationPassInfo',['../vk__mem__alloc_8h.html#a2d0b0d6a81ba60e9c2d3d83ca1f01971',1,'vk_mem_alloc.h']]], + ['vmadefragmentationpassmoveinfo_399',['VmaDefragmentationPassMoveInfo',['../vk__mem__alloc_8h.html#a459f238c542cedaa8d3cfabc024c39b5',1,'vk_mem_alloc.h']]], + ['vmadefragmentationstats_400',['VmaDefragmentationStats',['../vk__mem__alloc_8h.html#ab0f9b06441c840fee560de4a2967f8c9',1,'vk_mem_alloc.h']]], + ['vmadevicememorycallbacks_401',['VmaDeviceMemoryCallbacks',['../vk__mem__alloc_8h.html#a5e2eb68d727cfd4df25702b027b7aa31',1,'vk_mem_alloc.h']]], + ['vmamemoryusage_402',['VmaMemoryUsage',['../vk__mem__alloc_8h.html#ad63b2113c0bfdbeade1cb498f5a8580d',1,'vk_mem_alloc.h']]], + ['vmapoolcreateflagbits_403',['VmaPoolCreateFlagBits',['../vk__mem__alloc_8h.html#a8f93195158e0e2ac80ca352064e71c1f',1,'vk_mem_alloc.h']]], + ['vmapoolcreateflags_404',['VmaPoolCreateFlags',['../vk__mem__alloc_8h.html#a2770e325ea42e087c1b91fdf46d0292a',1,'vk_mem_alloc.h']]], + ['vmapoolcreateinfo_405',['VmaPoolCreateInfo',['../vk__mem__alloc_8h.html#a211706e9348dcee25a843ed4ea69bce7',1,'vk_mem_alloc.h']]], + ['vmapoolstats_406',['VmaPoolStats',['../vk__mem__alloc_8h.html#a2e5612d871d64c5624087b837a338c34',1,'vk_mem_alloc.h']]], + ['vmarecordflagbits_407',['VmaRecordFlagBits',['../vk__mem__alloc_8h.html#ade20b626a6635ce1bf30ea53dea774e4',1,'vk_mem_alloc.h']]], + ['vmarecordflags_408',['VmaRecordFlags',['../vk__mem__alloc_8h.html#af3929a1a4547c592fc0b0e55ef452828',1,'vk_mem_alloc.h']]], + ['vmarecordsettings_409',['VmaRecordSettings',['../vk__mem__alloc_8h.html#a0ab61e87ff6365f1d59915eadc37a9f0',1,'vk_mem_alloc.h']]], + ['vmastatinfo_410',['VmaStatInfo',['../vk__mem__alloc_8h.html#a810b009a788ee8aac72a25b42ffbe31c',1,'vk_mem_alloc.h']]], + ['vmastats_411',['VmaStats',['../vk__mem__alloc_8h.html#a732be855fb4a7c248e6853d928a729af',1,'vk_mem_alloc.h']]], + ['vmavulkanfunctions_412',['VmaVulkanFunctions',['../vk__mem__alloc_8h.html#a97064a1a271b0061ebfc3a079862d0c5',1,'vk_mem_alloc.h']]] ]; diff --git a/docs/html/search/variables_0.js b/docs/html/search/variables_0.js index e789983..8635a9c 100644 --- a/docs/html/search/variables_0.js +++ b/docs/html/search/variables_0.js @@ -1,9 +1,10 @@ var searchData= [ - ['allocationbytes_286',['allocationBytes',['../struct_vma_budget.html#a7e2a6583ebd63e194951c542563804d8',1,'VmaBudget']]], - ['allocationcount_287',['allocationCount',['../struct_vma_stat_info.html#a537741e4d5cdddc1c0ab95ec650afaff',1,'VmaStatInfo::allocationCount()'],['../struct_vma_pool_stats.html#ad1924eb54fffa45e9e0e65670c8fe5eb',1,'VmaPoolStats::allocationCount()'],['../struct_vma_defragmentation_info2.html#a3cf86ab32c1da779b4923d301a3056ba',1,'VmaDefragmentationInfo2::allocationCount()']]], - ['allocationsizeavg_288',['allocationSizeAvg',['../struct_vma_stat_info.html#a1081a039964e566c672e7a2347f9e599',1,'VmaStatInfo']]], - ['allocationsizemax_289',['allocationSizeMax',['../struct_vma_stat_info.html#a17e9733a5ecd76287d4db6e66f71f50c',1,'VmaStatInfo']]], - ['allocationsizemin_290',['allocationSizeMin',['../struct_vma_stat_info.html#ade8b40bd3139c04aabd2fc538a356fea',1,'VmaStatInfo']]], - ['allocationsmoved_291',['allocationsMoved',['../struct_vma_defragmentation_stats.html#aefeabf130022008eadd75999478af3f9',1,'VmaDefragmentationStats']]] + ['allocation_301',['allocation',['../struct_vma_defragmentation_pass_move_info.html#ae885c861c2dd8d622e6c19e281d035cc',1,'VmaDefragmentationPassMoveInfo']]], + ['allocationbytes_302',['allocationBytes',['../struct_vma_budget.html#a7e2a6583ebd63e194951c542563804d8',1,'VmaBudget']]], + ['allocationcount_303',['allocationCount',['../struct_vma_stat_info.html#a537741e4d5cdddc1c0ab95ec650afaff',1,'VmaStatInfo::allocationCount()'],['../struct_vma_pool_stats.html#ad1924eb54fffa45e9e0e65670c8fe5eb',1,'VmaPoolStats::allocationCount()'],['../struct_vma_defragmentation_info2.html#a3cf86ab32c1da779b4923d301a3056ba',1,'VmaDefragmentationInfo2::allocationCount()']]], + ['allocationsizeavg_304',['allocationSizeAvg',['../struct_vma_stat_info.html#a1081a039964e566c672e7a2347f9e599',1,'VmaStatInfo']]], + ['allocationsizemax_305',['allocationSizeMax',['../struct_vma_stat_info.html#a17e9733a5ecd76287d4db6e66f71f50c',1,'VmaStatInfo']]], + ['allocationsizemin_306',['allocationSizeMin',['../struct_vma_stat_info.html#ade8b40bd3139c04aabd2fc538a356fea',1,'VmaStatInfo']]], + ['allocationsmoved_307',['allocationsMoved',['../struct_vma_defragmentation_stats.html#aefeabf130022008eadd75999478af3f9',1,'VmaDefragmentationStats']]] ]; diff --git a/docs/html/search/variables_1.js b/docs/html/search/variables_1.js index 9b41635..e6c5234 100644 --- a/docs/html/search/variables_1.js +++ b/docs/html/search/variables_1.js @@ -1,9 +1,9 @@ var searchData= [ - ['blockbytes_292',['blockBytes',['../struct_vma_budget.html#a58b492901baab685f466199124e514a0',1,'VmaBudget']]], - ['blockcount_293',['blockCount',['../struct_vma_stat_info.html#abc4bb7cd611900778464c56e50c970a4',1,'VmaStatInfo::blockCount()'],['../struct_vma_pool_stats.html#aa0b5cb45cef6f18571cefb03b9a230e7',1,'VmaPoolStats::blockCount()']]], - ['blocksize_294',['blockSize',['../struct_vma_pool_create_info.html#aa4265160536cdb9be821b7686c16c676',1,'VmaPoolCreateInfo']]], - ['budget_295',['budget',['../struct_vma_budget.html#ab82e1d1754c2d210d0bdf90220bc6cdd',1,'VmaBudget']]], - ['bytesfreed_296',['bytesFreed',['../struct_vma_defragmentation_stats.html#ab0cb9ac0dbc106c77e384ea676422f28',1,'VmaDefragmentationStats']]], - ['bytesmoved_297',['bytesMoved',['../struct_vma_defragmentation_stats.html#a36f9d5df2a10ba2a36b16e126d60572d',1,'VmaDefragmentationStats']]] + ['blockbytes_308',['blockBytes',['../struct_vma_budget.html#a58b492901baab685f466199124e514a0',1,'VmaBudget']]], + ['blockcount_309',['blockCount',['../struct_vma_stat_info.html#abc4bb7cd611900778464c56e50c970a4',1,'VmaStatInfo::blockCount()'],['../struct_vma_pool_stats.html#aa0b5cb45cef6f18571cefb03b9a230e7',1,'VmaPoolStats::blockCount()']]], + ['blocksize_310',['blockSize',['../struct_vma_pool_create_info.html#aa4265160536cdb9be821b7686c16c676',1,'VmaPoolCreateInfo']]], + ['budget_311',['budget',['../struct_vma_budget.html#ab82e1d1754c2d210d0bdf90220bc6cdd',1,'VmaBudget']]], + ['bytesfreed_312',['bytesFreed',['../struct_vma_defragmentation_stats.html#ab0cb9ac0dbc106c77e384ea676422f28',1,'VmaDefragmentationStats']]], + ['bytesmoved_313',['bytesMoved',['../struct_vma_defragmentation_stats.html#a36f9d5df2a10ba2a36b16e126d60572d',1,'VmaDefragmentationStats']]] ]; diff --git a/docs/html/search/variables_2.js b/docs/html/search/variables_2.js index 08a5c66..838fa74 100644 --- a/docs/html/search/variables_2.js +++ b/docs/html/search/variables_2.js @@ -1,4 +1,4 @@ var searchData= [ - ['commandbuffer_298',['commandBuffer',['../struct_vma_defragmentation_info2.html#a7f71f39590c5316771493d2333f9c1bd',1,'VmaDefragmentationInfo2']]] + ['commandbuffer_314',['commandBuffer',['../struct_vma_defragmentation_info2.html#a7f71f39590c5316771493d2333f9c1bd',1,'VmaDefragmentationInfo2']]] ]; diff --git a/docs/html/search/variables_3.js b/docs/html/search/variables_3.js index 73f8cb8..58528d1 100644 --- a/docs/html/search/variables_3.js +++ b/docs/html/search/variables_3.js @@ -1,6 +1,6 @@ var searchData= [ - ['device_299',['device',['../struct_vma_allocator_create_info.html#ad924ddd77b04039c88d0c09b0ffcd500',1,'VmaAllocatorCreateInfo']]], - ['devicememory_300',['deviceMemory',['../struct_vma_allocation_info.html#ae0bfb7dfdf79a76ffefc9a94677a2f67',1,'VmaAllocationInfo']]], - ['devicememoryblocksfreed_301',['deviceMemoryBlocksFreed',['../struct_vma_defragmentation_stats.html#a0113f1877904a5d1ee8f409216ff276b',1,'VmaDefragmentationStats']]] + ['device_315',['device',['../struct_vma_allocator_create_info.html#ad924ddd77b04039c88d0c09b0ffcd500',1,'VmaAllocatorCreateInfo']]], + ['devicememory_316',['deviceMemory',['../struct_vma_allocation_info.html#ae0bfb7dfdf79a76ffefc9a94677a2f67',1,'VmaAllocationInfo']]], + ['devicememoryblocksfreed_317',['deviceMemoryBlocksFreed',['../struct_vma_defragmentation_stats.html#a0113f1877904a5d1ee8f409216ff276b',1,'VmaDefragmentationStats']]] ]; diff --git a/docs/html/search/variables_4.js b/docs/html/search/variables_4.js index befdc65..7c700e0 100644 --- a/docs/html/search/variables_4.js +++ b/docs/html/search/variables_4.js @@ -1,5 +1,5 @@ var searchData= [ - ['flags_302',['flags',['../struct_vma_record_settings.html#ad8fdcc92119ae7a8c08c1a564c01d63a',1,'VmaRecordSettings::flags()'],['../struct_vma_allocator_create_info.html#a392ea2ecbaff93f91a7c49f735ad4346',1,'VmaAllocatorCreateInfo::flags()'],['../struct_vma_allocation_create_info.html#add09658ac14fe290ace25470ddd6d41b',1,'VmaAllocationCreateInfo::flags()'],['../struct_vma_pool_create_info.html#a8405139f63d078340ae74513a59f5446',1,'VmaPoolCreateInfo::flags()'],['../struct_vma_defragmentation_info2.html#a53e844ee5633e229cf6daf14b2d9fff9',1,'VmaDefragmentationInfo2::flags()']]], - ['frameinusecount_303',['frameInUseCount',['../struct_vma_allocator_create_info.html#a21ea188dd212b8171cb9ecbed4a2a3a7',1,'VmaAllocatorCreateInfo::frameInUseCount()'],['../struct_vma_pool_create_info.html#a9437e43ffbb644dbbf7fc4e50cfad6aa',1,'VmaPoolCreateInfo::frameInUseCount()']]] + ['flags_318',['flags',['../struct_vma_record_settings.html#ad8fdcc92119ae7a8c08c1a564c01d63a',1,'VmaRecordSettings::flags()'],['../struct_vma_allocator_create_info.html#a392ea2ecbaff93f91a7c49f735ad4346',1,'VmaAllocatorCreateInfo::flags()'],['../struct_vma_allocation_create_info.html#add09658ac14fe290ace25470ddd6d41b',1,'VmaAllocationCreateInfo::flags()'],['../struct_vma_pool_create_info.html#a8405139f63d078340ae74513a59f5446',1,'VmaPoolCreateInfo::flags()'],['../struct_vma_defragmentation_info2.html#a53e844ee5633e229cf6daf14b2d9fff9',1,'VmaDefragmentationInfo2::flags()']]], + ['frameinusecount_319',['frameInUseCount',['../struct_vma_allocator_create_info.html#a21ea188dd212b8171cb9ecbed4a2a3a7',1,'VmaAllocatorCreateInfo::frameInUseCount()'],['../struct_vma_pool_create_info.html#a9437e43ffbb644dbbf7fc4e50cfad6aa',1,'VmaPoolCreateInfo::frameInUseCount()']]] ]; diff --git a/docs/html/search/variables_5.js b/docs/html/search/variables_5.js index d5e147d..3907444 100644 --- a/docs/html/search/variables_5.js +++ b/docs/html/search/variables_5.js @@ -1,4 +1,4 @@ var searchData= [ - ['instance_304',['instance',['../struct_vma_allocator_create_info.html#a70dd42e29b1df1d1b9b61532ae0b370b',1,'VmaAllocatorCreateInfo']]] + ['instance_320',['instance',['../struct_vma_allocator_create_info.html#a70dd42e29b1df1d1b9b61532ae0b370b',1,'VmaAllocatorCreateInfo']]] ]; diff --git a/docs/html/search/variables_6.js b/docs/html/search/variables_6.js index 6985d99..8846bfd 100644 --- a/docs/html/search/variables_6.js +++ b/docs/html/search/variables_6.js @@ -1,15 +1,17 @@ var searchData= [ - ['maxallocationstomove_305',['maxAllocationsToMove',['../struct_vma_defragmentation_info.html#aa7c7304e13c71f604c907196c4e28fbc',1,'VmaDefragmentationInfo']]], - ['maxblockcount_306',['maxBlockCount',['../struct_vma_pool_create_info.html#ae41142f2834fcdc82baa4883c187b75c',1,'VmaPoolCreateInfo']]], - ['maxbytestomove_307',['maxBytesToMove',['../struct_vma_defragmentation_info.html#acb311c940a777270e67e1b81c5ab6a1d',1,'VmaDefragmentationInfo']]], - ['maxcpuallocationstomove_308',['maxCpuAllocationsToMove',['../struct_vma_defragmentation_info2.html#a94c2c7223d52878445a8cccce396b671',1,'VmaDefragmentationInfo2']]], - ['maxcpubytestomove_309',['maxCpuBytesToMove',['../struct_vma_defragmentation_info2.html#af78e1ea40c22d85137b65f6b384a4d0a',1,'VmaDefragmentationInfo2']]], - ['maxgpuallocationstomove_310',['maxGpuAllocationsToMove',['../struct_vma_defragmentation_info2.html#a40d53d33e71ba0b66f844ed63c05a3f6',1,'VmaDefragmentationInfo2']]], - ['maxgpubytestomove_311',['maxGpuBytesToMove',['../struct_vma_defragmentation_info2.html#a4ddbc898d0afe1518f863a3763628f08',1,'VmaDefragmentationInfo2']]], - ['memoryheap_312',['memoryHeap',['../struct_vma_stats.html#a0e6611508c29a187f0fd14ff1a0329c0',1,'VmaStats']]], - ['memorytype_313',['memoryType',['../struct_vma_stats.html#a13e3caf754be79352c42408756309331',1,'VmaStats::memoryType()'],['../struct_vma_allocation_info.html#a7f6b0aa58c135e488e6b40a388dad9d5',1,'VmaAllocationInfo::memoryType()']]], - ['memorytypebits_314',['memoryTypeBits',['../struct_vma_allocation_create_info.html#a3bf940c0271d85d6ba32a4d820075055',1,'VmaAllocationCreateInfo']]], - ['memorytypeindex_315',['memoryTypeIndex',['../struct_vma_pool_create_info.html#a596fa76b685d3f1f688f84a709a5b319',1,'VmaPoolCreateInfo']]], - ['minblockcount_316',['minBlockCount',['../struct_vma_pool_create_info.html#ad8006fb803185c0a699d30f3e9a865ae',1,'VmaPoolCreateInfo']]] + ['maxallocationstomove_321',['maxAllocationsToMove',['../struct_vma_defragmentation_info.html#aa7c7304e13c71f604c907196c4e28fbc',1,'VmaDefragmentationInfo']]], + ['maxblockcount_322',['maxBlockCount',['../struct_vma_pool_create_info.html#ae41142f2834fcdc82baa4883c187b75c',1,'VmaPoolCreateInfo']]], + ['maxbytestomove_323',['maxBytesToMove',['../struct_vma_defragmentation_info.html#acb311c940a777270e67e1b81c5ab6a1d',1,'VmaDefragmentationInfo']]], + ['maxcpuallocationstomove_324',['maxCpuAllocationsToMove',['../struct_vma_defragmentation_info2.html#a94c2c7223d52878445a8cccce396b671',1,'VmaDefragmentationInfo2']]], + ['maxcpubytestomove_325',['maxCpuBytesToMove',['../struct_vma_defragmentation_info2.html#af78e1ea40c22d85137b65f6b384a4d0a',1,'VmaDefragmentationInfo2']]], + ['maxgpuallocationstomove_326',['maxGpuAllocationsToMove',['../struct_vma_defragmentation_info2.html#a40d53d33e71ba0b66f844ed63c05a3f6',1,'VmaDefragmentationInfo2']]], + ['maxgpubytestomove_327',['maxGpuBytesToMove',['../struct_vma_defragmentation_info2.html#a4ddbc898d0afe1518f863a3763628f08',1,'VmaDefragmentationInfo2']]], + ['memory_328',['memory',['../struct_vma_defragmentation_pass_move_info.html#a06eb0c8690aa0d3478a036753492e769',1,'VmaDefragmentationPassMoveInfo']]], + ['memoryheap_329',['memoryHeap',['../struct_vma_stats.html#a0e6611508c29a187f0fd14ff1a0329c0',1,'VmaStats']]], + ['memorytype_330',['memoryType',['../struct_vma_stats.html#a13e3caf754be79352c42408756309331',1,'VmaStats::memoryType()'],['../struct_vma_allocation_info.html#a7f6b0aa58c135e488e6b40a388dad9d5',1,'VmaAllocationInfo::memoryType()']]], + ['memorytypebits_331',['memoryTypeBits',['../struct_vma_allocation_create_info.html#a3bf940c0271d85d6ba32a4d820075055',1,'VmaAllocationCreateInfo']]], + ['memorytypeindex_332',['memoryTypeIndex',['../struct_vma_pool_create_info.html#a596fa76b685d3f1f688f84a709a5b319',1,'VmaPoolCreateInfo']]], + ['minblockcount_333',['minBlockCount',['../struct_vma_pool_create_info.html#ad8006fb803185c0a699d30f3e9a865ae',1,'VmaPoolCreateInfo']]], + ['movecount_334',['moveCount',['../struct_vma_defragmentation_pass_info.html#ac1086e657ba995f8d1f4e49b83dcfb6c',1,'VmaDefragmentationPassInfo']]] ]; diff --git a/docs/html/search/variables_7.js b/docs/html/search/variables_7.js index 13493b2..941bb46 100644 --- a/docs/html/search/variables_7.js +++ b/docs/html/search/variables_7.js @@ -1,4 +1,4 @@ var searchData= [ - ['offset_317',['offset',['../struct_vma_allocation_info.html#a4a3c732388dbdc7a23f9365b00825268',1,'VmaAllocationInfo']]] + ['offset_335',['offset',['../struct_vma_allocation_info.html#a4a3c732388dbdc7a23f9365b00825268',1,'VmaAllocationInfo::offset()'],['../struct_vma_defragmentation_pass_move_info.html#a8ab4508bc03625b0653c880576be96c6',1,'VmaDefragmentationPassMoveInfo::offset()']]] ]; diff --git a/docs/html/search/variables_8.js b/docs/html/search/variables_8.js index 5aa5010..1e3ec89 100644 --- a/docs/html/search/variables_8.js +++ b/docs/html/search/variables_8.js @@ -1,21 +1,22 @@ var searchData= [ - ['pallocationcallbacks_318',['pAllocationCallbacks',['../struct_vma_allocator_create_info.html#a6e409087e3be55400d0e4ccbe43c608d',1,'VmaAllocatorCreateInfo']]], - ['pallocations_319',['pAllocations',['../struct_vma_defragmentation_info2.html#a8943f8d65969ce8e2189a1cdf3205e96',1,'VmaDefragmentationInfo2']]], - ['pallocationschanged_320',['pAllocationsChanged',['../struct_vma_defragmentation_info2.html#a76d51a644dc7f5405d0cdd0025ecd0cc',1,'VmaDefragmentationInfo2']]], - ['pdevicememorycallbacks_321',['pDeviceMemoryCallbacks',['../struct_vma_allocator_create_info.html#af1380969b5e1ea4c3184a877892d260e',1,'VmaAllocatorCreateInfo']]], - ['pfilepath_322',['pFilePath',['../struct_vma_record_settings.html#a6cb1fdbf6bcb610b68f2010dd629e89d',1,'VmaRecordSettings']]], - ['pfnallocate_323',['pfnAllocate',['../struct_vma_device_memory_callbacks.html#a4f17f7b255101e733b44d5633aceabfb',1,'VmaDeviceMemoryCallbacks']]], - ['pfnfree_324',['pfnFree',['../struct_vma_device_memory_callbacks.html#abe8a3328bbc916f6f712fdb6b299444c',1,'VmaDeviceMemoryCallbacks']]], - ['pheapsizelimit_325',['pHeapSizeLimit',['../struct_vma_allocator_create_info.html#a31c192aa6cbffa33279f6d9f0c47c44b',1,'VmaAllocatorCreateInfo']]], - ['physicaldevice_326',['physicalDevice',['../struct_vma_allocator_create_info.html#a08230f04ae6ccf8a78150a9e829a7156',1,'VmaAllocatorCreateInfo']]], - ['pmappeddata_327',['pMappedData',['../struct_vma_allocation_info.html#a5eeffbe2d2f30f53370ff14aefbadbe2',1,'VmaAllocationInfo']]], - ['pool_328',['pool',['../struct_vma_allocation_create_info.html#a6272c0555cfd1fe28bff1afeb6190150',1,'VmaAllocationCreateInfo']]], - ['poolcount_329',['poolCount',['../struct_vma_defragmentation_info2.html#a7e70aa2a1081d849dcc7829b19d3ec9d',1,'VmaDefragmentationInfo2']]], - ['ppools_330',['pPools',['../struct_vma_defragmentation_info2.html#a0b3effd57f3fcdeb2ed62210b4ef20e1',1,'VmaDefragmentationInfo2']]], - ['precordsettings_331',['pRecordSettings',['../struct_vma_allocator_create_info.html#ace2aa4877b16a42b0b7673d4e26000ee',1,'VmaAllocatorCreateInfo']]], - ['preferredflags_332',['preferredFlags',['../struct_vma_allocation_create_info.html#a7fe8d81a1ad10b2a2faacacee5b15d6d',1,'VmaAllocationCreateInfo']]], - ['preferredlargeheapblocksize_333',['preferredLargeHeapBlockSize',['../struct_vma_allocator_create_info.html#a8e4714298e3121cdd8b214a1ae7a637a',1,'VmaAllocatorCreateInfo']]], - ['puserdata_334',['pUserData',['../struct_vma_allocation_create_info.html#a8259e85c272683434f4abb4ddddffe19',1,'VmaAllocationCreateInfo::pUserData()'],['../struct_vma_allocation_info.html#adc507656149c04de7ed95d0042ba2a13',1,'VmaAllocationInfo::pUserData()']]], - ['pvulkanfunctions_335',['pVulkanFunctions',['../struct_vma_allocator_create_info.html#a3dc197be3227da7338b1643f70db36bd',1,'VmaAllocatorCreateInfo']]] + ['pallocationcallbacks_336',['pAllocationCallbacks',['../struct_vma_allocator_create_info.html#a6e409087e3be55400d0e4ccbe43c608d',1,'VmaAllocatorCreateInfo']]], + ['pallocations_337',['pAllocations',['../struct_vma_defragmentation_info2.html#a8943f8d65969ce8e2189a1cdf3205e96',1,'VmaDefragmentationInfo2']]], + ['pallocationschanged_338',['pAllocationsChanged',['../struct_vma_defragmentation_info2.html#a76d51a644dc7f5405d0cdd0025ecd0cc',1,'VmaDefragmentationInfo2']]], + ['pdevicememorycallbacks_339',['pDeviceMemoryCallbacks',['../struct_vma_allocator_create_info.html#af1380969b5e1ea4c3184a877892d260e',1,'VmaAllocatorCreateInfo']]], + ['pfilepath_340',['pFilePath',['../struct_vma_record_settings.html#a6cb1fdbf6bcb610b68f2010dd629e89d',1,'VmaRecordSettings']]], + ['pfnallocate_341',['pfnAllocate',['../struct_vma_device_memory_callbacks.html#a4f17f7b255101e733b44d5633aceabfb',1,'VmaDeviceMemoryCallbacks']]], + ['pfnfree_342',['pfnFree',['../struct_vma_device_memory_callbacks.html#abe8a3328bbc916f6f712fdb6b299444c',1,'VmaDeviceMemoryCallbacks']]], + ['pheapsizelimit_343',['pHeapSizeLimit',['../struct_vma_allocator_create_info.html#a31c192aa6cbffa33279f6d9f0c47c44b',1,'VmaAllocatorCreateInfo']]], + ['physicaldevice_344',['physicalDevice',['../struct_vma_allocator_create_info.html#a08230f04ae6ccf8a78150a9e829a7156',1,'VmaAllocatorCreateInfo']]], + ['pmappeddata_345',['pMappedData',['../struct_vma_allocation_info.html#a5eeffbe2d2f30f53370ff14aefbadbe2',1,'VmaAllocationInfo']]], + ['pmoves_346',['pMoves',['../struct_vma_defragmentation_pass_info.html#acbd42d4a3357999da130a95cd99a3792',1,'VmaDefragmentationPassInfo']]], + ['pool_347',['pool',['../struct_vma_allocation_create_info.html#a6272c0555cfd1fe28bff1afeb6190150',1,'VmaAllocationCreateInfo']]], + ['poolcount_348',['poolCount',['../struct_vma_defragmentation_info2.html#a7e70aa2a1081d849dcc7829b19d3ec9d',1,'VmaDefragmentationInfo2']]], + ['ppools_349',['pPools',['../struct_vma_defragmentation_info2.html#a0b3effd57f3fcdeb2ed62210b4ef20e1',1,'VmaDefragmentationInfo2']]], + ['precordsettings_350',['pRecordSettings',['../struct_vma_allocator_create_info.html#ace2aa4877b16a42b0b7673d4e26000ee',1,'VmaAllocatorCreateInfo']]], + ['preferredflags_351',['preferredFlags',['../struct_vma_allocation_create_info.html#a7fe8d81a1ad10b2a2faacacee5b15d6d',1,'VmaAllocationCreateInfo']]], + ['preferredlargeheapblocksize_352',['preferredLargeHeapBlockSize',['../struct_vma_allocator_create_info.html#a8e4714298e3121cdd8b214a1ae7a637a',1,'VmaAllocatorCreateInfo']]], + ['puserdata_353',['pUserData',['../struct_vma_allocation_create_info.html#a8259e85c272683434f4abb4ddddffe19',1,'VmaAllocationCreateInfo::pUserData()'],['../struct_vma_allocation_info.html#adc507656149c04de7ed95d0042ba2a13',1,'VmaAllocationInfo::pUserData()']]], + ['pvulkanfunctions_354',['pVulkanFunctions',['../struct_vma_allocator_create_info.html#a3dc197be3227da7338b1643f70db36bd',1,'VmaAllocatorCreateInfo']]] ]; diff --git a/docs/html/search/variables_9.js b/docs/html/search/variables_9.js index cbb1d9d..088f8d1 100644 --- a/docs/html/search/variables_9.js +++ b/docs/html/search/variables_9.js @@ -1,4 +1,4 @@ var searchData= [ - ['requiredflags_336',['requiredFlags',['../struct_vma_allocation_create_info.html#a9166390303ff42d783305bc31c2b6b90',1,'VmaAllocationCreateInfo']]] + ['requiredflags_355',['requiredFlags',['../struct_vma_allocation_create_info.html#a9166390303ff42d783305bc31c2b6b90',1,'VmaAllocationCreateInfo']]] ]; diff --git a/docs/html/search/variables_a.js b/docs/html/search/variables_a.js index cb9c51a..6e1c52b 100644 --- a/docs/html/search/variables_a.js +++ b/docs/html/search/variables_a.js @@ -1,4 +1,4 @@ var searchData= [ - ['size_337',['size',['../struct_vma_pool_stats.html#a326807b2de2b0931cee4ed9a5f2e420c',1,'VmaPoolStats::size()'],['../struct_vma_allocation_info.html#aac76d113a6a5ccbb09fea00fb25fd18f',1,'VmaAllocationInfo::size()']]] + ['size_356',['size',['../struct_vma_pool_stats.html#a326807b2de2b0931cee4ed9a5f2e420c',1,'VmaPoolStats::size()'],['../struct_vma_allocation_info.html#aac76d113a6a5ccbb09fea00fb25fd18f',1,'VmaAllocationInfo::size()']]] ]; diff --git a/docs/html/search/variables_b.js b/docs/html/search/variables_b.js index 1a0b424..4b52523 100644 --- a/docs/html/search/variables_b.js +++ b/docs/html/search/variables_b.js @@ -1,4 +1,4 @@ var searchData= [ - ['total_338',['total',['../struct_vma_stats.html#a2e8f5b3353f2fefef3c27f29e245a1f9',1,'VmaStats']]] + ['total_357',['total',['../struct_vma_stats.html#a2e8f5b3353f2fefef3c27f29e245a1f9',1,'VmaStats']]] ]; diff --git a/docs/html/search/variables_c.js b/docs/html/search/variables_c.js index 1a98383..5dea08e 100644 --- a/docs/html/search/variables_c.js +++ b/docs/html/search/variables_c.js @@ -1,11 +1,11 @@ var searchData= [ - ['unusedbytes_339',['unusedBytes',['../struct_vma_stat_info.html#a1859d290aca2cd582d8dc25922092669',1,'VmaStatInfo']]], - ['unusedrangecount_340',['unusedRangeCount',['../struct_vma_stat_info.html#ae06129c771bfebfd6468a7f4276502a9',1,'VmaStatInfo::unusedRangeCount()'],['../struct_vma_pool_stats.html#ae4f3546ffa4d1e598b64d8e6134854f4',1,'VmaPoolStats::unusedRangeCount()']]], - ['unusedrangesizeavg_341',['unusedRangeSizeAvg',['../struct_vma_stat_info.html#a2f9b3452af90c9768a30b7fb6ae194fc',1,'VmaStatInfo']]], - ['unusedrangesizemax_342',['unusedRangeSizeMax',['../struct_vma_stat_info.html#a5ba1a2476c4d39b10f7e2f7ebbb72ac4',1,'VmaStatInfo::unusedRangeSizeMax()'],['../struct_vma_pool_stats.html#ab4c8f52dd42ab01998f60f0b6acc722b',1,'VmaPoolStats::unusedRangeSizeMax()']]], - ['unusedrangesizemin_343',['unusedRangeSizeMin',['../struct_vma_stat_info.html#aedeba931324f16589cd2416c0d2dd0d4',1,'VmaStatInfo']]], - ['unusedsize_344',['unusedSize',['../struct_vma_pool_stats.html#ad7c54874724fce7b06aba526202d82a8',1,'VmaPoolStats']]], - ['usage_345',['usage',['../struct_vma_budget.html#a84dd1ecca8b0110259eb206dbadb11f6',1,'VmaBudget::usage()'],['../struct_vma_allocation_create_info.html#accb8b06b1f677d858cb9af20705fa910',1,'VmaAllocationCreateInfo::usage()']]], - ['usedbytes_346',['usedBytes',['../struct_vma_stat_info.html#ab0c6c73837e5a70c749fbd4f6064895a',1,'VmaStatInfo']]] + ['unusedbytes_358',['unusedBytes',['../struct_vma_stat_info.html#a1859d290aca2cd582d8dc25922092669',1,'VmaStatInfo']]], + ['unusedrangecount_359',['unusedRangeCount',['../struct_vma_stat_info.html#ae06129c771bfebfd6468a7f4276502a9',1,'VmaStatInfo::unusedRangeCount()'],['../struct_vma_pool_stats.html#ae4f3546ffa4d1e598b64d8e6134854f4',1,'VmaPoolStats::unusedRangeCount()']]], + ['unusedrangesizeavg_360',['unusedRangeSizeAvg',['../struct_vma_stat_info.html#a2f9b3452af90c9768a30b7fb6ae194fc',1,'VmaStatInfo']]], + ['unusedrangesizemax_361',['unusedRangeSizeMax',['../struct_vma_stat_info.html#a5ba1a2476c4d39b10f7e2f7ebbb72ac4',1,'VmaStatInfo::unusedRangeSizeMax()'],['../struct_vma_pool_stats.html#ab4c8f52dd42ab01998f60f0b6acc722b',1,'VmaPoolStats::unusedRangeSizeMax()']]], + ['unusedrangesizemin_362',['unusedRangeSizeMin',['../struct_vma_stat_info.html#aedeba931324f16589cd2416c0d2dd0d4',1,'VmaStatInfo']]], + ['unusedsize_363',['unusedSize',['../struct_vma_pool_stats.html#ad7c54874724fce7b06aba526202d82a8',1,'VmaPoolStats']]], + ['usage_364',['usage',['../struct_vma_budget.html#a84dd1ecca8b0110259eb206dbadb11f6',1,'VmaBudget::usage()'],['../struct_vma_allocation_create_info.html#accb8b06b1f677d858cb9af20705fa910',1,'VmaAllocationCreateInfo::usage()']]], + ['usedbytes_365',['usedBytes',['../struct_vma_stat_info.html#ab0c6c73837e5a70c749fbd4f6064895a',1,'VmaStatInfo']]] ]; diff --git a/docs/html/search/variables_d.js b/docs/html/search/variables_d.js index ecaf14b..aa1f448 100644 --- a/docs/html/search/variables_d.js +++ b/docs/html/search/variables_d.js @@ -1,21 +1,21 @@ var searchData= [ - ['vkallocatememory_347',['vkAllocateMemory',['../struct_vma_vulkan_functions.html#a2943bf99dfd784a0e8f599d987e22e6c',1,'VmaVulkanFunctions']]], - ['vkbindbuffermemory_348',['vkBindBufferMemory',['../struct_vma_vulkan_functions.html#a94fc4f3a605d9880bb3c0ba2c2fc80b2',1,'VmaVulkanFunctions']]], - ['vkbindimagememory_349',['vkBindImageMemory',['../struct_vma_vulkan_functions.html#a1338d96a128a5ade648b8d934907c637',1,'VmaVulkanFunctions']]], - ['vkcmdcopybuffer_350',['vkCmdCopyBuffer',['../struct_vma_vulkan_functions.html#ae5c0db8c89a3b82593dc16aa6a49fa3a',1,'VmaVulkanFunctions']]], - ['vkcreatebuffer_351',['vkCreateBuffer',['../struct_vma_vulkan_functions.html#ae8084315a25006271a2edfc3a447519f',1,'VmaVulkanFunctions']]], - ['vkcreateimage_352',['vkCreateImage',['../struct_vma_vulkan_functions.html#a23ebe70be515b9b5010a1d691200e325',1,'VmaVulkanFunctions']]], - ['vkdestroybuffer_353',['vkDestroyBuffer',['../struct_vma_vulkan_functions.html#a7e054606faddb07f0e8556f3ed317d45',1,'VmaVulkanFunctions']]], - ['vkdestroyimage_354',['vkDestroyImage',['../struct_vma_vulkan_functions.html#a90b898227039b1dcb3520f6e91f09ffa',1,'VmaVulkanFunctions']]], - ['vkflushmappedmemoryranges_355',['vkFlushMappedMemoryRanges',['../struct_vma_vulkan_functions.html#a33c322f4c4ad2810f8a9c97a277572f9',1,'VmaVulkanFunctions']]], - ['vkfreememory_356',['vkFreeMemory',['../struct_vma_vulkan_functions.html#a4c658701778564d62034255b5dda91b4',1,'VmaVulkanFunctions']]], - ['vkgetbuffermemoryrequirements_357',['vkGetBufferMemoryRequirements',['../struct_vma_vulkan_functions.html#a5b92901df89a4194b0d12f6071d4d143',1,'VmaVulkanFunctions']]], - ['vkgetimagememoryrequirements_358',['vkGetImageMemoryRequirements',['../struct_vma_vulkan_functions.html#a475f6f49f8debe4d10800592606d53f4',1,'VmaVulkanFunctions']]], - ['vkgetphysicaldevicememoryproperties_359',['vkGetPhysicalDeviceMemoryProperties',['../struct_vma_vulkan_functions.html#a60d25c33bba06bb8592e6875cbaa9830',1,'VmaVulkanFunctions']]], - ['vkgetphysicaldeviceproperties_360',['vkGetPhysicalDeviceProperties',['../struct_vma_vulkan_functions.html#a77b7a74082823e865dd6546623468f96',1,'VmaVulkanFunctions']]], - ['vkinvalidatemappedmemoryranges_361',['vkInvalidateMappedMemoryRanges',['../struct_vma_vulkan_functions.html#a5c1093bc32386a8060c37c9f282078a1',1,'VmaVulkanFunctions']]], - ['vkmapmemory_362',['vkMapMemory',['../struct_vma_vulkan_functions.html#ab5c1f38dea3a2cf00dc9eb4f57218c49',1,'VmaVulkanFunctions']]], - ['vkunmapmemory_363',['vkUnmapMemory',['../struct_vma_vulkan_functions.html#acc798589736f0becb317fc2196c1d8b9',1,'VmaVulkanFunctions']]], - ['vulkanapiversion_364',['vulkanApiVersion',['../struct_vma_allocator_create_info.html#ae0ffc55139b54520a6bb704b29ffc285',1,'VmaAllocatorCreateInfo']]] + ['vkallocatememory_366',['vkAllocateMemory',['../struct_vma_vulkan_functions.html#a2943bf99dfd784a0e8f599d987e22e6c',1,'VmaVulkanFunctions']]], + ['vkbindbuffermemory_367',['vkBindBufferMemory',['../struct_vma_vulkan_functions.html#a94fc4f3a605d9880bb3c0ba2c2fc80b2',1,'VmaVulkanFunctions']]], + ['vkbindimagememory_368',['vkBindImageMemory',['../struct_vma_vulkan_functions.html#a1338d96a128a5ade648b8d934907c637',1,'VmaVulkanFunctions']]], + ['vkcmdcopybuffer_369',['vkCmdCopyBuffer',['../struct_vma_vulkan_functions.html#ae5c0db8c89a3b82593dc16aa6a49fa3a',1,'VmaVulkanFunctions']]], + ['vkcreatebuffer_370',['vkCreateBuffer',['../struct_vma_vulkan_functions.html#ae8084315a25006271a2edfc3a447519f',1,'VmaVulkanFunctions']]], + ['vkcreateimage_371',['vkCreateImage',['../struct_vma_vulkan_functions.html#a23ebe70be515b9b5010a1d691200e325',1,'VmaVulkanFunctions']]], + ['vkdestroybuffer_372',['vkDestroyBuffer',['../struct_vma_vulkan_functions.html#a7e054606faddb07f0e8556f3ed317d45',1,'VmaVulkanFunctions']]], + ['vkdestroyimage_373',['vkDestroyImage',['../struct_vma_vulkan_functions.html#a90b898227039b1dcb3520f6e91f09ffa',1,'VmaVulkanFunctions']]], + ['vkflushmappedmemoryranges_374',['vkFlushMappedMemoryRanges',['../struct_vma_vulkan_functions.html#a33c322f4c4ad2810f8a9c97a277572f9',1,'VmaVulkanFunctions']]], + ['vkfreememory_375',['vkFreeMemory',['../struct_vma_vulkan_functions.html#a4c658701778564d62034255b5dda91b4',1,'VmaVulkanFunctions']]], + ['vkgetbuffermemoryrequirements_376',['vkGetBufferMemoryRequirements',['../struct_vma_vulkan_functions.html#a5b92901df89a4194b0d12f6071d4d143',1,'VmaVulkanFunctions']]], + ['vkgetimagememoryrequirements_377',['vkGetImageMemoryRequirements',['../struct_vma_vulkan_functions.html#a475f6f49f8debe4d10800592606d53f4',1,'VmaVulkanFunctions']]], + ['vkgetphysicaldevicememoryproperties_378',['vkGetPhysicalDeviceMemoryProperties',['../struct_vma_vulkan_functions.html#a60d25c33bba06bb8592e6875cbaa9830',1,'VmaVulkanFunctions']]], + ['vkgetphysicaldeviceproperties_379',['vkGetPhysicalDeviceProperties',['../struct_vma_vulkan_functions.html#a77b7a74082823e865dd6546623468f96',1,'VmaVulkanFunctions']]], + ['vkinvalidatemappedmemoryranges_380',['vkInvalidateMappedMemoryRanges',['../struct_vma_vulkan_functions.html#a5c1093bc32386a8060c37c9f282078a1',1,'VmaVulkanFunctions']]], + ['vkmapmemory_381',['vkMapMemory',['../struct_vma_vulkan_functions.html#ab5c1f38dea3a2cf00dc9eb4f57218c49',1,'VmaVulkanFunctions']]], + ['vkunmapmemory_382',['vkUnmapMemory',['../struct_vma_vulkan_functions.html#acc798589736f0becb317fc2196c1d8b9',1,'VmaVulkanFunctions']]], + ['vulkanapiversion_383',['vulkanApiVersion',['../struct_vma_allocator_create_info.html#ae0ffc55139b54520a6bb704b29ffc285',1,'VmaAllocatorCreateInfo']]] ]; diff --git a/docs/html/struct__-members.html b/docs/html/struct__-members.html new file mode 100644 index 0000000..afd2f73 --- /dev/null +++ b/docs/html/struct__-members.html @@ -0,0 +1,86 @@ + + + + + + + +Vulkan Memory Allocator: Member List + + + + + + + + + +
      +
      + + + + + + +
      +
      Vulkan Memory Allocator +
      +
      +
      + + + + + + + + +
      +
      + + +
      + +
      + +
      +
      +
      +
      _ Member List
      +
      +
      + +

      This is the complete list of members for _, including all inherited members.

      + + + + + + + + +
      flags_
      memoryTypeBits_
      pool_
      preferredFlags_
      pUserData_
      requiredFlags_
      usage_
      + +
      +Generated by   +doxygen + 1.8.16 +
      + + diff --git a/docs/html/struct__.html b/docs/html/struct__.html new file mode 100644 index 0000000..0823c40 --- /dev/null +++ b/docs/html/struct__.html @@ -0,0 +1,232 @@ + + + + + + + +Vulkan Memory Allocator: _ Struct Reference + + + + + + + + + +
      +
      + + + + + + +
      +
      Vulkan Memory Allocator +
      +
      +
      + + + + + + + + +
      +
      + + +
      + +
      + +
      +
      +
      +Public Attributes | +List of all members
      +
      +
      _ Struct Reference
      +
      +
      + +

      #include <vk_mem_alloc.h>

      + + + + + + + + + + + + + + + + + + + + + + + +

      +Public Attributes

      VmaAllocationCreateFlags flags
       Use VmaAllocationCreateFlagBits enum. More...
       
      VmaMemoryUsage usage
       Intended usage of memory. More...
       
      VkMemoryPropertyFlags requiredFlags
       Flags that must be set in a Memory Type chosen for an allocation. More...
       
      VkMemoryPropertyFlags preferredFlags
       Flags that preferably should be set in a memory type chosen for an allocation. More...
       
      uint32_t memoryTypeBits
       Bitmask containing one bit set for every memory type acceptable for this allocation. More...
       
      VmaPool pool
       Pool that this allocation should be created in. More...
       
      void * pUserData
       Custom general-purpose pointer that will be stored in VmaAllocation, can be read as VmaAllocationInfo::pUserData and changed using vmaSetAllocationUserData(). More...
       
      +

      Member Data Documentation

      + +

      ◆ flags

      + +
      +
      + + + + +
      VmaAllocationCreateFlags _::flags
      +
      + +

      Use VmaAllocationCreateFlagBits enum.

      + +
      +
      + +

      ◆ memoryTypeBits

      + +
      +
      + + + + +
      uint32_t _::memoryTypeBits
      +
      + +

      Bitmask containing one bit set for every memory type acceptable for this allocation.

      +

      Value 0 is equivalent to UINT32_MAX - it means any memory type is accepted if it meets other requirements specified by this structure, with no further restrictions on memory type index.
      +If pool is not null, this member is ignored.

      + +
      +
      + +

      ◆ pool

      + +
      +
      + + + + +
      VmaPool _::pool
      +
      + +

      Pool that this allocation should be created in.

      +

      Leave VK_NULL_HANDLE to allocate from default pool. If not null, members: usage, requiredFlags, preferredFlags, memoryTypeBits are ignored.

      + +
      +
      + +

      ◆ preferredFlags

      + +
      +
      + + + + +
      VkMemoryPropertyFlags _::preferredFlags
      +
      + +

      Flags that preferably should be set in a memory type chosen for an allocation.

      +

      Set to 0 if no additional flags are prefered.
      +If pool is not null, this member is ignored.

      + +
      +
      + +

      ◆ pUserData

      + +
      +
      + + + + +
      void* _::pUserData
      +
      + +

      Custom general-purpose pointer that will be stored in VmaAllocation, can be read as VmaAllocationInfo::pUserData and changed using vmaSetAllocationUserData().

      +

      If VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT is used, it must be either null or pointer to a null-terminated string. The string will be then copied to internal buffer, so it doesn't need to be valid after allocation call.

      + +
      +
      + +

      ◆ requiredFlags

      + +
      +
      + + + + +
      VkMemoryPropertyFlags _::requiredFlags
      +
      + +

      Flags that must be set in a Memory Type chosen for an allocation.

      +

      Leave 0 if you specify memory requirements in other way.
      +If pool is not null, this member is ignored.

      + +
      +
      + +

      ◆ usage

      + +
      +
      + + + + +
      VmaMemoryUsage _::usage
      +
      + +

      Intended usage of memory.

      +

      You can leave VMA_MEMORY_USAGE_UNKNOWN if you specify memory requirements in other way.
      +If pool is not null, this member is ignored.

      + +
      +
      +
      The documentation for this struct was generated from the following file: +
      + +
      +Generated by   +doxygen + 1.8.16 +
      + + diff --git a/docs/html/struct_vma_defragmentation_info.html b/docs/html/struct_vma_defragmentation_info.html index b232cfc..3961e5c 100644 --- a/docs/html/struct_vma_defragmentation_info.html +++ b/docs/html/struct_vma_defragmentation_info.html @@ -85,7 +85,7 @@ Public Attributes

      Detailed Description

      Deprecated. Optional configuration parameters to be passed to function vmaDefragment().

      -
      Deprecated:
      This is a part of the old interface. It is recommended to use structure VmaDefragmentationInfo2 and function vmaDefragmentationBegin() instead.
      +
      Deprecated:
      This is a part of the old interface. It is recommended to use structure VmaDefragmentationInfo2 and function vmaDefragmentationBegin() instead.

      Member Data Documentation

      ◆ maxAllocationsToMove

      diff --git a/docs/html/struct_vma_defragmentation_pass_info-members.html b/docs/html/struct_vma_defragmentation_pass_info-members.html new file mode 100644 index 0000000..8a01b11 --- /dev/null +++ b/docs/html/struct_vma_defragmentation_pass_info-members.html @@ -0,0 +1,81 @@ + + + + + + + +Vulkan Memory Allocator: Member List + + + + + + + + + +
      +
      + + + + + + +
      +
      Vulkan Memory Allocator +
      +
      +
      + + + + + + + + +
      +
      + + +
      + +
      + +
      +
      +
      +
      VmaDefragmentationPassInfo Member List
      +
      +
      + +

      This is the complete list of members for VmaDefragmentationPassInfo, including all inherited members.

      + + + +
      moveCountVmaDefragmentationPassInfo
      pMovesVmaDefragmentationPassInfo
      + +
      +Generated by   +doxygen + 1.8.16 +
      + + diff --git a/docs/html/struct_vma_defragmentation_pass_info.html b/docs/html/struct_vma_defragmentation_pass_info.html new file mode 100644 index 0000000..a9501c2 --- /dev/null +++ b/docs/html/struct_vma_defragmentation_pass_info.html @@ -0,0 +1,127 @@ + + + + + + + +Vulkan Memory Allocator: VmaDefragmentationPassInfo Struct Reference + + + + + + + + + +
      +
      + + + + + + +
      +
      Vulkan Memory Allocator +
      +
      +
      + + + + + + + + +
      +
      + + +
      + +
      + +
      +
      +
      +Public Attributes | +List of all members
      +
      +
      VmaDefragmentationPassInfo Struct Reference
      +
      +
      + +

      Parameters for incremental defragmentation steps. + More...

      + +

      #include <vk_mem_alloc.h>

      + + + + + + +

      +Public Attributes

      uint32_t moveCount
       
      VmaDefragmentationPassMoveInfo * pMoves
       
      +

      Detailed Description

      +

      Parameters for incremental defragmentation steps.

      +

      To be used with function vmaBeginDefragmentationPass().

      +

      Member Data Documentation

      + +

      ◆ moveCount

      + +
      +
      + + + + +
      uint32_t VmaDefragmentationPassInfo::moveCount
      +
      + +
      +
      + +

      ◆ pMoves

      + +
      +
      + + + + +
      VmaDefragmentationPassMoveInfo* VmaDefragmentationPassInfo::pMoves
      +
      + +
      +
      +
      The documentation for this struct was generated from the following file: +
      + +
      +Generated by   +doxygen + 1.8.16 +
      + + diff --git a/docs/html/struct_vma_defragmentation_pass_move_info-members.html b/docs/html/struct_vma_defragmentation_pass_move_info-members.html new file mode 100644 index 0000000..2b17fc9 --- /dev/null +++ b/docs/html/struct_vma_defragmentation_pass_move_info-members.html @@ -0,0 +1,82 @@ + + + + + + + +Vulkan Memory Allocator: Member List + + + + + + + + + +
      +
      + + + + + + +
      +
      Vulkan Memory Allocator +
      +
      +
      + + + + + + + + +
      +
      + + +
      + +
      + +
      +
      +
      +
      VmaDefragmentationPassMoveInfo Member List
      +
      +
      + +

      This is the complete list of members for VmaDefragmentationPassMoveInfo, including all inherited members.

      + + + + +
      allocationVmaDefragmentationPassMoveInfo
      memoryVmaDefragmentationPassMoveInfo
      offsetVmaDefragmentationPassMoveInfo
      + +
      +Generated by   +doxygen + 1.8.16 +
      + + diff --git a/docs/html/struct_vma_defragmentation_pass_move_info.html b/docs/html/struct_vma_defragmentation_pass_move_info.html new file mode 100644 index 0000000..f4665a9 --- /dev/null +++ b/docs/html/struct_vma_defragmentation_pass_move_info.html @@ -0,0 +1,137 @@ + + + + + + + +Vulkan Memory Allocator: VmaDefragmentationPassMoveInfo Struct Reference + + + + + + + + + +
      +
      + + + + + + +
      +
      Vulkan Memory Allocator +
      +
      +
      + + + + + + + + +
      +
      + + +
      + +
      + +
      +
      +
      +Public Attributes | +List of all members
      +
      +
      VmaDefragmentationPassMoveInfo Struct Reference
      +
      +
      + +

      #include <vk_mem_alloc.h>

      + + + + + + + + +

      +Public Attributes

      VmaAllocation allocation
       
      VkDeviceMemory memory
       
      VkDeviceSize offset
       
      +

      Member Data Documentation

      + +

      ◆ allocation

      + +
      +
      + + + + +
      VmaAllocation VmaDefragmentationPassMoveInfo::allocation
      +
      + +
      +
      + +

      ◆ memory

      + +
      +
      + + + + +
      VkDeviceMemory VmaDefragmentationPassMoveInfo::memory
      +
      + +
      +
      + +

      ◆ offset

      + +
      +
      + + + + +
      VkDeviceSize VmaDefragmentationPassMoveInfo::offset
      +
      + +
      +
      +
      The documentation for this struct was generated from the following file: +
      + +
      +Generated by   +doxygen + 1.8.16 +
      + + diff --git a/docs/html/vk__mem__alloc_8h.html b/docs/html/vk__mem__alloc_8h.html index 832fd78..bc521f5 100644 --- a/docs/html/vk__mem__alloc_8h.html +++ b/docs/html/vk__mem__alloc_8h.html @@ -112,6 +112,11 @@ Classes struct  VmaDefragmentationInfo2  Parameters for defragmentation. More...
        +struct  VmaDefragmentationPassMoveInfo +  +struct  VmaDefragmentationPassInfo + Parameters for incremental defragmentation steps. More...
      +  struct  VmaDefragmentationInfo  Deprecated. Optional configuration parameters to be passed to function vmaDefragment(). More...
        @@ -206,6 +211,11 @@ Typedefs typedef struct VmaDefragmentationInfo2 VmaDefragmentationInfo2  Parameters for defragmentation. More...
        +typedef struct VmaDefragmentationPassMoveInfo VmaDefragmentationPassMoveInfo +  +typedef struct VmaDefragmentationPassInfo VmaDefragmentationPassInfo + Parameters for incremental defragmentation steps. More...
      +  typedef struct VmaDefragmentationInfo VmaDefragmentationInfo  Deprecated. Optional configuration parameters to be passed to function vmaDefragment(). More...
        @@ -221,7 +231,8 @@ Enumerations VMA_ALLOCATOR_CREATE_KHR_BIND_MEMORY2_BIT = 0x00000004, VMA_ALLOCATOR_CREATE_EXT_MEMORY_BUDGET_BIT = 0x00000008,
      -  VMA_ALLOCATOR_CREATE_FLAG_BITS_MAX_ENUM = 0x7FFFFFFF +  VMA_ALLOCATOR_CREATE_AMD_DEVICE_COHERENT_MEMORY_BIT = 0x00000010, +VMA_ALLOCATOR_CREATE_FLAG_BITS_MAX_ENUM = 0x7FFFFFFF
      }  Flags for created VmaAllocator. More...
      @@ -281,7 +292,8 @@ Enumerations }  Flags to be passed as VmaPoolCreateInfo::flags. More...
        -enum  VmaDefragmentationFlagBits { VMA_DEFRAGMENTATION_FLAG_BITS_MAX_ENUM = 0x7FFFFFFF +enum  VmaDefragmentationFlagBits { VMA_DEFRAGMENTATION_FLAG_INCREMENTAL = 0x1, +VMA_DEFRAGMENTATION_FLAG_BITS_MAX_ENUM = 0x7FFFFFFF }  Flags to be used in vmaDefragmentationBegin(). None at the moment. Reserved for future use. More...
        @@ -398,6 +410,10 @@ Functions VkResult vmaDefragmentationEnd (VmaAllocator allocator, VmaDefragmentationContext context)  Ends defragmentation process. More...
        +VkResult vmaBeginDefragmentationPass (VmaAllocator allocator, VmaDefragmentationContext context, VmaDefragmentationPassInfo *pInfo) +  +VkResult vmaEndDefragmentationPass (VmaAllocator allocator, VmaDefragmentationContext context) +  VkResult vmaDefragment (VmaAllocator allocator, VmaAllocation *pAllocations, size_t allocationCount, VkBool32 *pAllocationsChanged, const VmaDefragmentationInfo *pDefragmentationInfo, VmaDefragmentationStats *pDefragmentationStats)  Deprecated. Compacts memory by moving allocations. More...
        @@ -722,7 +738,7 @@ Functions

      Deprecated. Optional configuration parameters to be passed to function vmaDefragment().

      -
      Deprecated:
      This is a part of the old interface. It is recommended to use structure VmaDefragmentationInfo2 and function vmaDefragmentationBegin() instead.
      +
      Deprecated:
      This is a part of the old interface. It is recommended to use structure VmaDefragmentationInfo2 and function vmaDefragmentationBegin() instead.
      @@ -741,6 +757,37 @@ Functions

      Parameters for defragmentation.

      To be used with function vmaDefragmentationBegin().

      + + + +

      ◆ VmaDefragmentationPassInfo

      + +
      +
      + + + + +
      typedef struct VmaDefragmentationPassInfo VmaDefragmentationPassInfo
      +
      + +

      Parameters for incremental defragmentation steps.

      +

      To be used with function vmaBeginDefragmentationPass().

      + +
      +
      + +

      ◆ VmaDefragmentationPassMoveInfo

      + +
      +
      + + + + +
      typedef struct VmaDefragmentationPassMoveInfo VmaDefragmentationPassMoveInfo
      +
      +
      @@ -1053,6 +1100,16 @@ Functions

      You may set this flag only if you found out that this device extension is supported, you enabled it while creating Vulkan device passed as VmaAllocatorCreateInfo::device, and you want it to be used internally by this library, along with another instance extension VK_KHR_get_physical_device_properties2, which is required by it (or Vulkan 1.1, where this extension is promoted).

      The extension provides query for current memory usage and budget, which will probably be more accurate than an estimation used by the library otherwise.

      +VMA_ALLOCATOR_CREATE_AMD_DEVICE_COHERENT_MEMORY_BIT 

      Enabled usage of VK_AMD_device_coherent_memory extension.

      +

      You may set this flag only if you:

      +
        +
      • found out that this device extension is supported and enabled it while creating Vulkan device passed as VmaAllocatorCreateInfo::device,
        • +
      • checked that VkPhysicalDeviceCoherentMemoryFeaturesAMD::deviceCoherentMemory is true and set it while creating the Vulkan device,
        • +
      • want it to be used internally by this library.
        • +
      +

      The extension and accompanying device feature provide access to memory types with VK_MEMORY_PROPERTY_DEVICE_COHERENT_BIT_AMD and VK_MEMORY_PROPERTY_DEVICE_UNCACHED_BIT_AMD flags. They are useful mostly for writing breadcrumb markers - a common method for debugging GPU crash/hang/TDR.

      +

      When the extension is not enabled, such memory types are still enumerated, but their usage is illegal. To protect from this error, if you don't create the allocator with this flag, it will refuse to allocate any memory or create a custom pool in such memory type, returning VK_ERROR_FEATURE_NOT_PRESENT.

      + VMA_ALLOCATOR_CREATE_FLAG_BITS_MAX_ENUM  @@ -1072,7 +1129,8 @@ Functions

      Flags to be used in vmaDefragmentationBegin(). None at the moment. Reserved for future use.

      - + +
      Enumerator
      VMA_DEFRAGMENTATION_FLAG_BITS_MAX_ENUM 
      Enumerator
      VMA_DEFRAGMENTATION_FLAG_INCREMENTAL 
      VMA_DEFRAGMENTATION_FLAG_BITS_MAX_ENUM 
      @@ -1408,6 +1466,40 @@ Functions

      Word "pages" is just a suggestion to use this function to allocate pieces of memory needed for sparse binding. It is just a general purpose allocation function able to make multiple allocations at once. It may be internally optimized to be more efficient than calling vmaAllocateMemory() allocationCount times.

      All allocations are made using same parameters. All of them are created out of the same memory pool and type. If any allocation fails, all allocations already made within this function call are also freed, so that when returned result is not VK_SUCCESS, pAllocation array is always entirely filled with VK_NULL_HANDLE.

      + + + +

      ◆ vmaBeginDefragmentationPass()

      + +
      +
      + + + + + + + + + + + + + + + + + + + + + + + + +
      VkResult vmaBeginDefragmentationPass (VmaAllocator allocator,
      VmaDefragmentationContext context,
      VmaDefragmentationPassInfo * pInfo 
      )
      +
      +
      @@ -2048,7 +2140,7 @@ Functions
      Returns
      VK_SUCCESS if completed, negative error code in case of error.
      -
      Deprecated:
      This is a part of the old interface. It is recommended to use structure VmaDefragmentationInfo2 and function vmaDefragmentationBegin() instead.
      +
      Deprecated:
      This is a part of the old interface. It is recommended to use structure VmaDefragmentationInfo2 and function vmaDefragmentationBegin() instead.

      This function works by moving allocations to different places (different VkDeviceMemory objects and/or different offsets) in order to optimize memory usage. Only allocations that are in pAllocations array can be moved. All other allocations are considered nonmovable in this call. Basic rules:

      • Only allocations made in memory types that have VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT and VK_MEMORY_PROPERTY_HOST_COHERENT_BIT flags can be compacted. You may pass other allocations but it makes no sense - these will never be moved.
        • @@ -2283,6 +2375,34 @@ Functions

        Destroys VmaPool object and frees Vulkan device memory.

        + + + +

        ◆ vmaEndDefragmentationPass()

        + +
        +
        + + + + + + + + + + + + + + + + + + +
        VkResult vmaEndDefragmentationPass (VmaAllocator allocator,
        VmaDefragmentationContext context 
        )
        +
        +
        @@ -3010,7 +3130,7 @@ Functions

        Deprecated.

        -

        In version 2.2.0 it used to try to change allocation's size without moving or reallocating it. In current version it returns VK_SUCCESS only if newSize equals current allocation's size. Otherwise returns VK_ERROR_OUT_OF_POOL_MEMORY, indicating that allocation's size could not be changed.

        +
        Deprecated:
        In version 2.2.0 it used to try to change allocation's size without moving or reallocating it. In current version it returns VK_SUCCESS only if newSize equals current allocation's size. Otherwise returns VK_ERROR_OUT_OF_POOL_MEMORY, indicating that allocation's size could not be changed.
        diff --git a/docs/html/vk__mem__alloc_8h_source.html b/docs/html/vk__mem__alloc_8h_source.html index 4d2de8f..5222ceb 100644 --- a/docs/html/vk__mem__alloc_8h_source.html +++ b/docs/html/vk__mem__alloc_8h_source.html @@ -66,7 +66,7 @@ $(function() {
        Go to the documentation of this file.
        1 //
        -
        2 // Copyright (c) 2017-2019 Advanced Micro Devices, Inc. All rights reserved.
        +
        2 // Copyright (c) 2017-2020 Advanced Micro Devices, Inc. All rights reserved.
        3 //
        4 // Permission is hereby granted, free of charge, to any person obtaining a copy
        5 // of this software and associated documentation files (the "Software"), to deal
        @@ -94,15058 +94,15486 @@ $(function() {
        27 extern "C" {
        28 #endif
        29 
        -
        1764 /*
        -
        1765 Define this macro to 0/1 to disable/enable support for recording functionality,
        -
        1766 available through VmaAllocatorCreateInfo::pRecordSettings.
        -
        1767 */
        -
        1768 #ifndef VMA_RECORDING_ENABLED
        -
        1769  #define VMA_RECORDING_ENABLED 0
        -
        1770 #endif
        -
        1771 
        -
        1772 #ifndef NOMINMAX
        -
        1773  #define NOMINMAX // For windows.h
        -
        1774 #endif
        -
        1775 
        -
        1776 #ifndef VULKAN_H_
        -
        1777  #include <vulkan/vulkan.h>
        -
        1778 #endif
        -
        1779 
        -
        1780 #if VMA_RECORDING_ENABLED
        -
        1781  #include <windows.h>
        -
        1782 #endif
        -
        1783 
        -
        1784 // Define this macro to declare maximum supported Vulkan version in format AAABBBCCC,
        -
        1785 // where AAA = major, BBB = minor, CCC = patch.
        -
        1786 // If you want to use version > 1.0, it still needs to be enabled via VmaAllocatorCreateInfo::vulkanApiVersion.
        -
        1787 #if !defined(VMA_VULKAN_VERSION)
        -
        1788  #if defined(VK_VERSION_1_1)
        -
        1789  #define VMA_VULKAN_VERSION 1001000
        -
        1790  #else
        -
        1791  #define VMA_VULKAN_VERSION 1000000
        -
        1792  #endif
        -
        1793 #endif
        -
        1794 
        -
        1795 #if !defined(VMA_DEDICATED_ALLOCATION)
        -
        1796  #if VK_KHR_get_memory_requirements2 && VK_KHR_dedicated_allocation
        -
        1797  #define VMA_DEDICATED_ALLOCATION 1
        -
        1798  #else
        -
        1799  #define VMA_DEDICATED_ALLOCATION 0
        -
        1800  #endif
        -
        1801 #endif
        -
        1802 
        -
        1803 #if !defined(VMA_BIND_MEMORY2)
        -
        1804  #if VK_KHR_bind_memory2
        -
        1805  #define VMA_BIND_MEMORY2 1
        -
        1806  #else
        -
        1807  #define VMA_BIND_MEMORY2 0
        -
        1808  #endif
        -
        1809 #endif
        -
        1810 
        -
        1811 #if !defined(VMA_MEMORY_BUDGET)
        -
        1812  #if VK_EXT_memory_budget && (VK_KHR_get_physical_device_properties2 || VMA_VULKAN_VERSION >= 1001000)
        -
        1813  #define VMA_MEMORY_BUDGET 1
        -
        1814  #else
        -
        1815  #define VMA_MEMORY_BUDGET 0
        -
        1816  #endif
        -
        1817 #endif
        -
        1818 
        -
        1819 // Define these macros to decorate all public functions with additional code,
        -
        1820 // before and after returned type, appropriately. This may be useful for
        -
        1821 // exporing the functions when compiling VMA as a separate library. Example:
        -
        1822 // #define VMA_CALL_PRE __declspec(dllexport)
        -
        1823 // #define VMA_CALL_POST __cdecl
        -
        1824 #ifndef VMA_CALL_PRE
        -
        1825  #define VMA_CALL_PRE
        -
        1826 #endif
        -
        1827 #ifndef VMA_CALL_POST
        -
        1828  #define VMA_CALL_POST
        -
        1829 #endif
        -
        1830 
        -
        1840 VK_DEFINE_HANDLE(VmaAllocator)
        +
        1822 /*
        +
        1823 Define this macro to 0/1 to disable/enable support for recording functionality,
        +
        1824 available through VmaAllocatorCreateInfo::pRecordSettings.
        +
        1825 */
        +
        1826 #ifndef VMA_RECORDING_ENABLED
        +
        1827  #define VMA_RECORDING_ENABLED 0
        +
        1828 #endif
        +
        1829 
        +
        1830 #ifndef NOMINMAX
        +
        1831  #define NOMINMAX // For windows.h
        +
        1832 #endif
        +
        1833 
        +
        1834 #ifndef VULKAN_H_
        +
        1835  #include <vulkan/vulkan.h>
        +
        1836 #endif
        +
        1837 
        +
        1838 #if VMA_RECORDING_ENABLED
        +
        1839  #include <windows.h>
        +
        1840 #endif
        1841 
        -
        1842 typedef void (VKAPI_PTR *PFN_vmaAllocateDeviceMemoryFunction)(
        -
        1844  VmaAllocator allocator,
        -
        1845  uint32_t memoryType,
        -
        1846  VkDeviceMemory memory,
        -
        1847  VkDeviceSize size);
        -
        1849 typedef void (VKAPI_PTR *PFN_vmaFreeDeviceMemoryFunction)(
        -
        1850  VmaAllocator allocator,
        -
        1851  uint32_t memoryType,
        -
        1852  VkDeviceMemory memory,
        -
        1853  VkDeviceSize size);
        -
        1854 
        -
        1862 typedef struct VmaDeviceMemoryCallbacks {
        -
        1864  PFN_vmaAllocateDeviceMemoryFunction pfnAllocate;
        -
        1866  PFN_vmaFreeDeviceMemoryFunction pfnFree;
        -
        1867 } VmaDeviceMemoryCallbacks;
        +
        1842 // Define this macro to declare maximum supported Vulkan version in format AAABBBCCC,
        +
        1843 // where AAA = major, BBB = minor, CCC = patch.
        +
        1844 // If you want to use version > 1.0, it still needs to be enabled via VmaAllocatorCreateInfo::vulkanApiVersion.
        +
        1845 #if !defined(VMA_VULKAN_VERSION)
        +
        1846  #if defined(VK_VERSION_1_1)
        +
        1847  #define VMA_VULKAN_VERSION 1001000
        +
        1848  #else
        +
        1849  #define VMA_VULKAN_VERSION 1000000
        +
        1850  #endif
        +
        1851 #endif
        +
        1852 
        +
        1853 #if !defined(VMA_DEDICATED_ALLOCATION)
        +
        1854  #if VK_KHR_get_memory_requirements2 && VK_KHR_dedicated_allocation
        +
        1855  #define VMA_DEDICATED_ALLOCATION 1
        +
        1856  #else
        +
        1857  #define VMA_DEDICATED_ALLOCATION 0
        +
        1858  #endif
        +
        1859 #endif
        +
        1860 
        +
        1861 #if !defined(VMA_BIND_MEMORY2)
        +
        1862  #if VK_KHR_bind_memory2
        +
        1863  #define VMA_BIND_MEMORY2 1
        +
        1864  #else
        +
        1865  #define VMA_BIND_MEMORY2 0
        +
        1866  #endif
        +
        1867 #endif
        1868 
        -
        1870 typedef enum VmaAllocatorCreateFlagBits {
        -
        1875  VMA_ALLOCATOR_CREATE_EXTERNALLY_SYNCHRONIZED_BIT = 0x00000001,
        -
        1900  VMA_ALLOCATOR_CREATE_KHR_DEDICATED_ALLOCATION_BIT = 0x00000002,
        -
        1915  VMA_ALLOCATOR_CREATE_KHR_BIND_MEMORY2_BIT = 0x00000004,
        -
        1927  VMA_ALLOCATOR_CREATE_EXT_MEMORY_BUDGET_BIT = 0x00000008,
        -
        1928 
        -
        1929  VMA_ALLOCATOR_CREATE_FLAG_BITS_MAX_ENUM = 0x7FFFFFFF
        -
        1930 } VmaAllocatorCreateFlagBits;
        -
        1931 typedef VkFlags VmaAllocatorCreateFlags;
        -
        1932 
        -
        1937 typedef struct VmaVulkanFunctions {
        -
        1938  PFN_vkGetPhysicalDeviceProperties vkGetPhysicalDeviceProperties;
        -
        1939  PFN_vkGetPhysicalDeviceMemoryProperties vkGetPhysicalDeviceMemoryProperties;
        -
        1940  PFN_vkAllocateMemory vkAllocateMemory;
        -
        1941  PFN_vkFreeMemory vkFreeMemory;
        -
        1942  PFN_vkMapMemory vkMapMemory;
        -
        1943  PFN_vkUnmapMemory vkUnmapMemory;
        -
        1944  PFN_vkFlushMappedMemoryRanges vkFlushMappedMemoryRanges;
        -
        1945  PFN_vkInvalidateMappedMemoryRanges vkInvalidateMappedMemoryRanges;
        -
        1946  PFN_vkBindBufferMemory vkBindBufferMemory;
        -
        1947  PFN_vkBindImageMemory vkBindImageMemory;
        -
        1948  PFN_vkGetBufferMemoryRequirements vkGetBufferMemoryRequirements;
        -
        1949  PFN_vkGetImageMemoryRequirements vkGetImageMemoryRequirements;
        -
        1950  PFN_vkCreateBuffer vkCreateBuffer;
        -
        1951  PFN_vkDestroyBuffer vkDestroyBuffer;
        -
        1952  PFN_vkCreateImage vkCreateImage;
        -
        1953  PFN_vkDestroyImage vkDestroyImage;
        -
        1954  PFN_vkCmdCopyBuffer vkCmdCopyBuffer;
        -
        1955 #if VMA_DEDICATED_ALLOCATION || VMA_VULKAN_VERSION >= 1001000
        -
        1956  PFN_vkGetBufferMemoryRequirements2KHR vkGetBufferMemoryRequirements2KHR;
        -
        1957  PFN_vkGetImageMemoryRequirements2KHR vkGetImageMemoryRequirements2KHR;
        -
        1958 #endif
        -
        1959 #if VMA_BIND_MEMORY2 || VMA_VULKAN_VERSION >= 1001000
        -
        1960  PFN_vkBindBufferMemory2KHR vkBindBufferMemory2KHR;
        -
        1961  PFN_vkBindImageMemory2KHR vkBindImageMemory2KHR;
        -
        1962 #endif
        -
        1963 #if VMA_MEMORY_BUDGET || VMA_VULKAN_VERSION >= 1001000
        -
        1964  PFN_vkGetPhysicalDeviceMemoryProperties2KHR vkGetPhysicalDeviceMemoryProperties2KHR;
        -
        1965 #endif
        -
        1966 } VmaVulkanFunctions;
        -
        1967 
        -
        1969 typedef enum VmaRecordFlagBits {
        -
        1975  VMA_RECORD_FLUSH_AFTER_CALL_BIT = 0x00000001,
        -
        1976 
        -
        1977  VMA_RECORD_FLAG_BITS_MAX_ENUM = 0x7FFFFFFF
        -
        1978 } VmaRecordFlagBits;
        -
        1979 typedef VkFlags VmaRecordFlags;
        -
        1980 
        -
        1982 typedef struct VmaRecordSettings
        -
        1983 {
        -
        1985  VmaRecordFlags flags;
        -
        1993  const char* pFilePath;
        -
        1994 } VmaRecordSettings;
        -
        1995 
        -
        1997 typedef struct VmaAllocatorCreateInfo
        -
        1998 {
        -
        2000  VmaAllocatorCreateFlags flags;
        -
        2002 
        -
        2003  VkPhysicalDevice physicalDevice;
        -
        2005 
        -
        2006  VkDevice device;
        +
        1869 #if !defined(VMA_MEMORY_BUDGET)
        +
        1870  #if VK_EXT_memory_budget && (VK_KHR_get_physical_device_properties2 || VMA_VULKAN_VERSION >= 1001000)
        +
        1871  #define VMA_MEMORY_BUDGET 1
        +
        1872  #else
        +
        1873  #define VMA_MEMORY_BUDGET 0
        +
        1874  #endif
        +
        1875 #endif
        +
        1876 
        +
        1877 // Define these macros to decorate all public functions with additional code,
        +
        1878 // before and after returned type, appropriately. This may be useful for
        +
        1879 // exporing the functions when compiling VMA as a separate library. Example:
        +
        1880 // #define VMA_CALL_PRE __declspec(dllexport)
        +
        1881 // #define VMA_CALL_POST __cdecl
        +
        1882 #ifndef VMA_CALL_PRE
        +
        1883  #define VMA_CALL_PRE
        +
        1884 #endif
        +
        1885 #ifndef VMA_CALL_POST
        +
        1886  #define VMA_CALL_POST
        +
        1887 #endif
        +
        1888 
        +
        1898 VK_DEFINE_HANDLE(VmaAllocator)
        +
        1899 
        +
        1900 typedef void (VKAPI_PTR *PFN_vmaAllocateDeviceMemoryFunction)(
        +
        1902  VmaAllocator allocator,
        +
        1903  uint32_t memoryType,
        +
        1904  VkDeviceMemory memory,
        +
        1905  VkDeviceSize size);
        +
        1907 typedef void (VKAPI_PTR *PFN_vmaFreeDeviceMemoryFunction)(
        +
        1908  VmaAllocator allocator,
        +
        1909  uint32_t memoryType,
        +
        1910  VkDeviceMemory memory,
        +
        1911  VkDeviceSize size);
        +
        1912 
        +
        1920 typedef struct VmaDeviceMemoryCallbacks {
        +
        1922  PFN_vmaAllocateDeviceMemoryFunction pfnAllocate;
        +
        1924  PFN_vmaFreeDeviceMemoryFunction pfnFree;
        +
        1925 } VmaDeviceMemoryCallbacks;
        +
        1926 
        +
        1928 typedef enum VmaAllocatorCreateFlagBits {
        +
        1933  VMA_ALLOCATOR_CREATE_EXTERNALLY_SYNCHRONIZED_BIT = 0x00000001,
        +
        1958  VMA_ALLOCATOR_CREATE_KHR_DEDICATED_ALLOCATION_BIT = 0x00000002,
        +
        1973  VMA_ALLOCATOR_CREATE_KHR_BIND_MEMORY2_BIT = 0x00000004,
        +
        1985  VMA_ALLOCATOR_CREATE_EXT_MEMORY_BUDGET_BIT = 0x00000008,
        +
        2003  VMA_ALLOCATOR_CREATE_AMD_DEVICE_COHERENT_MEMORY_BIT = 0x00000010,
        +
        2004 
        +
        2005  VMA_ALLOCATOR_CREATE_FLAG_BITS_MAX_ENUM = 0x7FFFFFFF
        +
        2006 } VmaAllocatorCreateFlagBits;
        +
        2007 typedef VkFlags VmaAllocatorCreateFlags;
        2008 
        -
        2009  VkDeviceSize preferredLargeHeapBlockSize;
        -
        2011 
        -
        2012  const VkAllocationCallbacks* pAllocationCallbacks;
        -
        2014 
        -
        2015  const VmaDeviceMemoryCallbacks* pDeviceMemoryCallbacks;
        -
        2029  uint32_t frameInUseCount;
        -
        2054  const VkDeviceSize* pHeapSizeLimit;
        -
        2066  const VmaVulkanFunctions* pVulkanFunctions;
        -
        2073  const VmaRecordSettings* pRecordSettings;
        -
        2079  VkInstance instance;
        -
        2088  uint32_t vulkanApiVersion;
        -
        2089 } VmaAllocatorCreateInfo;
        +
        2013 typedef struct VmaVulkanFunctions {
        +
        2014  PFN_vkGetPhysicalDeviceProperties vkGetPhysicalDeviceProperties;
        +
        2015  PFN_vkGetPhysicalDeviceMemoryProperties vkGetPhysicalDeviceMemoryProperties;
        +
        2016  PFN_vkAllocateMemory vkAllocateMemory;
        +
        2017  PFN_vkFreeMemory vkFreeMemory;
        +
        2018  PFN_vkMapMemory vkMapMemory;
        +
        2019  PFN_vkUnmapMemory vkUnmapMemory;
        +
        2020  PFN_vkFlushMappedMemoryRanges vkFlushMappedMemoryRanges;
        +
        2021  PFN_vkInvalidateMappedMemoryRanges vkInvalidateMappedMemoryRanges;
        +
        2022  PFN_vkBindBufferMemory vkBindBufferMemory;
        +
        2023  PFN_vkBindImageMemory vkBindImageMemory;
        +
        2024  PFN_vkGetBufferMemoryRequirements vkGetBufferMemoryRequirements;
        +
        2025  PFN_vkGetImageMemoryRequirements vkGetImageMemoryRequirements;
        +
        2026  PFN_vkCreateBuffer vkCreateBuffer;
        +
        2027  PFN_vkDestroyBuffer vkDestroyBuffer;
        +
        2028  PFN_vkCreateImage vkCreateImage;
        +
        2029  PFN_vkDestroyImage vkDestroyImage;
        +
        2030  PFN_vkCmdCopyBuffer vkCmdCopyBuffer;
        +
        2031 #if VMA_DEDICATED_ALLOCATION || VMA_VULKAN_VERSION >= 1001000
        +
        2032  PFN_vkGetBufferMemoryRequirements2KHR vkGetBufferMemoryRequirements2KHR;
        +
        2033  PFN_vkGetImageMemoryRequirements2KHR vkGetImageMemoryRequirements2KHR;
        +
        2034 #endif
        +
        2035 #if VMA_BIND_MEMORY2 || VMA_VULKAN_VERSION >= 1001000
        +
        2036  PFN_vkBindBufferMemory2KHR vkBindBufferMemory2KHR;
        +
        2037  PFN_vkBindImageMemory2KHR vkBindImageMemory2KHR;
        +
        2038 #endif
        +
        2039 #if VMA_MEMORY_BUDGET || VMA_VULKAN_VERSION >= 1001000
        +
        2040  PFN_vkGetPhysicalDeviceMemoryProperties2KHR vkGetPhysicalDeviceMemoryProperties2KHR;
        +
        2041 #endif
        +
        2042 } VmaVulkanFunctions;
        +
        2043 
        +
        2045 typedef enum VmaRecordFlagBits {
        +
        2051  VMA_RECORD_FLUSH_AFTER_CALL_BIT = 0x00000001,
        +
        2052 
        +
        2053  VMA_RECORD_FLAG_BITS_MAX_ENUM = 0x7FFFFFFF
        +
        2054 } VmaRecordFlagBits;
        +
        2055 typedef VkFlags VmaRecordFlags;
        +
        2056 
        +
        2058 typedef struct VmaRecordSettings
        +
        2059 {
        +
        2061  VmaRecordFlags flags;
        +
        2069  const char* pFilePath;
        +
        2070 } VmaRecordSettings;
        +
        2071 
        +
        2073 typedef struct VmaAllocatorCreateInfo
        +
        2074 {
        +
        2076  VmaAllocatorCreateFlags flags;
        +
        2078 
        +
        2079  VkPhysicalDevice physicalDevice;
        +
        2081 
        +
        2082  VkDevice device;
        +
        2084 
        +
        2085  VkDeviceSize preferredLargeHeapBlockSize;
        +
        2087 
        +
        2088  const VkAllocationCallbacks* pAllocationCallbacks;
        2090 
        -
        2092 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCreateAllocator(
        -
        2093  const VmaAllocatorCreateInfo* pCreateInfo,
        -
        2094  VmaAllocator* pAllocator);
        -
        2095 
        -
        2097 VMA_CALL_PRE void VMA_CALL_POST vmaDestroyAllocator(
        -
        2098  VmaAllocator allocator);
        -
        2099 
        -
        2104 VMA_CALL_PRE void VMA_CALL_POST vmaGetPhysicalDeviceProperties(
        -
        2105  VmaAllocator allocator,
        -
        2106  const VkPhysicalDeviceProperties** ppPhysicalDeviceProperties);
        -
        2107 
        -
        2112 VMA_CALL_PRE void VMA_CALL_POST vmaGetMemoryProperties(
        -
        2113  VmaAllocator allocator,
        -
        2114  const VkPhysicalDeviceMemoryProperties** ppPhysicalDeviceMemoryProperties);
        -
        2115 
        -
        2122 VMA_CALL_PRE void VMA_CALL_POST vmaGetMemoryTypeProperties(
        -
        2123  VmaAllocator allocator,
        -
        2124  uint32_t memoryTypeIndex,
        -
        2125  VkMemoryPropertyFlags* pFlags);
        -
        2126 
        -
        2135 VMA_CALL_PRE void VMA_CALL_POST vmaSetCurrentFrameIndex(
        -
        2136  VmaAllocator allocator,
        -
        2137  uint32_t frameIndex);
        -
        2138 
        -
        2141 typedef struct VmaStatInfo
        -
        2142 {
        -
        2144  uint32_t blockCount;
        -
        2146  uint32_t allocationCount;
        -
        2148  uint32_t unusedRangeCount;
        -
        2150  VkDeviceSize usedBytes;
        -
        2152  VkDeviceSize unusedBytes;
        -
        2153  VkDeviceSize allocationSizeMin, allocationSizeAvg, allocationSizeMax;
        -
        2154  VkDeviceSize unusedRangeSizeMin, unusedRangeSizeAvg, unusedRangeSizeMax;
        -
        2155 } VmaStatInfo;
        -
        2156 
        -
        2158 typedef struct VmaStats
        -
        2159 {
        -
        2160  VmaStatInfo memoryType[VK_MAX_MEMORY_TYPES];
        -
        2161  VmaStatInfo memoryHeap[VK_MAX_MEMORY_HEAPS];
        -
        2162  VmaStatInfo total;
        -
        2163 } VmaStats;
        -
        2164 
        -
        2174 VMA_CALL_PRE void VMA_CALL_POST vmaCalculateStats(
        -
        2175  VmaAllocator allocator,
        -
        2176  VmaStats* pStats);
        -
        2177 
        -
        2180 typedef struct VmaBudget
        -
        2181 {
        -
        2184  VkDeviceSize blockBytes;
        -
        2185 
        -
        2195  VkDeviceSize allocationBytes;
        -
        2196 
        -
        2205  VkDeviceSize usage;
        -
        2206 
        -
        2216  VkDeviceSize budget;
        -
        2217 } VmaBudget;
        -
        2218 
        -
        2229 VMA_CALL_PRE void VMA_CALL_POST vmaGetBudget(
        -
        2230  VmaAllocator allocator,
        -
        2231  VmaBudget* pBudget);
        +
        2091  const VmaDeviceMemoryCallbacks* pDeviceMemoryCallbacks;
        +
        2105  uint32_t frameInUseCount;
        +
        2130  const VkDeviceSize* pHeapSizeLimit;
        +
        2142  const VmaVulkanFunctions* pVulkanFunctions;
        +
        2149  const VmaRecordSettings* pRecordSettings;
        +
        2155  VkInstance instance;
        +
        2164  uint32_t vulkanApiVersion;
        +
        2165 } VmaAllocatorCreateInfo;
        +
        2166 
        +
        2168 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCreateAllocator(
        +
        2169  const VmaAllocatorCreateInfo* pCreateInfo,
        +
        2170  VmaAllocator* pAllocator);
        +
        2171 
        +
        2173 VMA_CALL_PRE void VMA_CALL_POST vmaDestroyAllocator(
        +
        2174  VmaAllocator allocator);
        +
        2175 
        +
        2180 VMA_CALL_PRE void VMA_CALL_POST vmaGetPhysicalDeviceProperties(
        +
        2181  VmaAllocator allocator,
        +
        2182  const VkPhysicalDeviceProperties** ppPhysicalDeviceProperties);
        +
        2183 
        +
        2188 VMA_CALL_PRE void VMA_CALL_POST vmaGetMemoryProperties(
        +
        2189  VmaAllocator allocator,
        +
        2190  const VkPhysicalDeviceMemoryProperties** ppPhysicalDeviceMemoryProperties);
        +
        2191 
        +
        2198 VMA_CALL_PRE void VMA_CALL_POST vmaGetMemoryTypeProperties(
        +
        2199  VmaAllocator allocator,
        +
        2200  uint32_t memoryTypeIndex,
        +
        2201  VkMemoryPropertyFlags* pFlags);
        +
        2202 
        +
        2211 VMA_CALL_PRE void VMA_CALL_POST vmaSetCurrentFrameIndex(
        +
        2212  VmaAllocator allocator,
        +
        2213  uint32_t frameIndex);
        +
        2214 
        +
        2217 typedef struct VmaStatInfo
        +
        2218 {
        +
        2220  uint32_t blockCount;
        +
        2222  uint32_t allocationCount;
        +
        2224  uint32_t unusedRangeCount;
        +
        2226  VkDeviceSize usedBytes;
        +
        2228  VkDeviceSize unusedBytes;
        +
        2229  VkDeviceSize allocationSizeMin, allocationSizeAvg, allocationSizeMax;
        +
        2230  VkDeviceSize unusedRangeSizeMin, unusedRangeSizeAvg, unusedRangeSizeMax;
        +
        2231 } VmaStatInfo;
        2232 
        -
        2233 #ifndef VMA_STATS_STRING_ENABLED
        -
        2234 #define VMA_STATS_STRING_ENABLED 1
        -
        2235 #endif
        -
        2236 
        -
        2237 #if VMA_STATS_STRING_ENABLED
        -
        2238 
        +
        2234 typedef struct VmaStats
        +
        2235 {
        +
        2236  VmaStatInfo memoryType[VK_MAX_MEMORY_TYPES];
        +
        2237  VmaStatInfo memoryHeap[VK_MAX_MEMORY_HEAPS];
        +
        2238  VmaStatInfo total;
        +
        2239 } VmaStats;
        2240 
        -
        2242 VMA_CALL_PRE void VMA_CALL_POST vmaBuildStatsString(
        -
        2243  VmaAllocator allocator,
        -
        2244  char** ppStatsString,
        -
        2245  VkBool32 detailedMap);
        -
        2246 
        -
        2247 VMA_CALL_PRE void VMA_CALL_POST vmaFreeStatsString(
        -
        2248  VmaAllocator allocator,
        -
        2249  char* pStatsString);
        -
        2250 
        -
        2251 #endif // #if VMA_STATS_STRING_ENABLED
        -
        2252 
        -
        2261 VK_DEFINE_HANDLE(VmaPool)
        -
        2262 
        -
        2263 typedef enum VmaMemoryUsage
        -
        2264 {
        -
        2268  VMA_MEMORY_USAGE_UNKNOWN = 0,
        -
        2285  VMA_MEMORY_USAGE_GPU_ONLY = 1,
        -
        2295  VMA_MEMORY_USAGE_CPU_ONLY = 2,
        -
        2302  VMA_MEMORY_USAGE_CPU_TO_GPU = 3,
        -
        2311  VMA_MEMORY_USAGE_GPU_TO_CPU = 4,
        -
        2317  VMA_MEMORY_USAGE_CPU_COPY = 5,
        -
        2325  VMA_MEMORY_USAGE_GPU_LAZILY_ALLOCATED = 6,
        +
        2250 VMA_CALL_PRE void VMA_CALL_POST vmaCalculateStats(
        +
        2251  VmaAllocator allocator,
        +
        2252  VmaStats* pStats);
        +
        2253 
        +
        2256 typedef struct VmaBudget
        +
        2257 {
        +
        2260  VkDeviceSize blockBytes;
        +
        2261 
        +
        2271  VkDeviceSize allocationBytes;
        +
        2272 
        +
        2281  VkDeviceSize usage;
        +
        2282 
        +
        2292  VkDeviceSize budget;
        +
        2293 } VmaBudget;
        +
        2294 
        +
        2305 VMA_CALL_PRE void VMA_CALL_POST vmaGetBudget(
        +
        2306  VmaAllocator allocator,
        +
        2307  VmaBudget* pBudget);
        +
        2308 
        +
        2309 #ifndef VMA_STATS_STRING_ENABLED
        +
        2310 #define VMA_STATS_STRING_ENABLED 1
        +
        2311 #endif
        +
        2312 
        +
        2313 #if VMA_STATS_STRING_ENABLED
        +
        2314 
        +
        2316 
        +
        2318 VMA_CALL_PRE void VMA_CALL_POST vmaBuildStatsString(
        +
        2319  VmaAllocator allocator,
        +
        2320  char** ppStatsString,
        +
        2321  VkBool32 detailedMap);
        +
        2322 
        +
        2323 VMA_CALL_PRE void VMA_CALL_POST vmaFreeStatsString(
        +
        2324  VmaAllocator allocator,
        +
        2325  char* pStatsString);
        2326 
        -
        2327  VMA_MEMORY_USAGE_MAX_ENUM = 0x7FFFFFFF
        -
        2328 } VmaMemoryUsage;
        -
        2329 
        -
        2331 typedef enum VmaAllocationCreateFlagBits {
        -
        2338  VMA_ALLOCATION_CREATE_DEDICATED_MEMORY_BIT = 0x00000001,
        -
        2339 
        -
        2349  VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT = 0x00000002,
        -
        2362  VMA_ALLOCATION_CREATE_MAPPED_BIT = 0x00000004,
        -
        2375  VMA_ALLOCATION_CREATE_CAN_BECOME_LOST_BIT = 0x00000008,
        -
        2382  VMA_ALLOCATION_CREATE_CAN_MAKE_OTHER_LOST_BIT = 0x00000010,
        -
        2388  VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT = 0x00000020,
        -
        2393  VMA_ALLOCATION_CREATE_UPPER_ADDRESS_BIT = 0x00000040,
        -
        2399  VMA_ALLOCATION_CREATE_DONT_BIND_BIT = 0x00000080,
        -
        2403  VMA_ALLOCATION_CREATE_WITHIN_BUDGET_BIT = 0x00000100,
        -
        2404 
        -
        2408  VMA_ALLOCATION_CREATE_STRATEGY_BEST_FIT_BIT = 0x00010000,
        -
        2412  VMA_ALLOCATION_CREATE_STRATEGY_WORST_FIT_BIT = 0x00020000,
        -
        2419  VMA_ALLOCATION_CREATE_STRATEGY_FIRST_FIT_BIT = 0x00040000,
        -
        2420 
        -
        2423  VMA_ALLOCATION_CREATE_STRATEGY_MIN_MEMORY_BIT = VMA_ALLOCATION_CREATE_STRATEGY_BEST_FIT_BIT,
        -
        2426  VMA_ALLOCATION_CREATE_STRATEGY_MIN_TIME_BIT = VMA_ALLOCATION_CREATE_STRATEGY_FIRST_FIT_BIT,
        -
        2429  VMA_ALLOCATION_CREATE_STRATEGY_MIN_FRAGMENTATION_BIT = VMA_ALLOCATION_CREATE_STRATEGY_WORST_FIT_BIT,
        -
        2430 
        -
        2433  VMA_ALLOCATION_CREATE_STRATEGY_MASK =
        -
        2434  VMA_ALLOCATION_CREATE_STRATEGY_BEST_FIT_BIT |
        -
        2435  VMA_ALLOCATION_CREATE_STRATEGY_WORST_FIT_BIT |
        -
        2436  VMA_ALLOCATION_CREATE_STRATEGY_FIRST_FIT_BIT,
        -
        2437 
        -
        2438  VMA_ALLOCATION_CREATE_FLAG_BITS_MAX_ENUM = 0x7FFFFFFF
        -
        2439 } VmaAllocationCreateFlagBits;
        -
        2440 typedef VkFlags VmaAllocationCreateFlags;
        -
        2441 
        -
        2442 typedef struct VmaAllocationCreateInfo
        -
        2443 {
        -
        2445  VmaAllocationCreateFlags flags;
        -
        2451  VmaMemoryUsage usage;
        -
        2456  VkMemoryPropertyFlags requiredFlags;
        -
        2461  VkMemoryPropertyFlags preferredFlags;
        -
        2469  uint32_t memoryTypeBits;
        -
        2475  VmaPool pool;
        -
        2482  void* pUserData;
        -
        2483 } VmaAllocationCreateInfo;
        -
        2484 
        -
        2501 VMA_CALL_PRE VkResult VMA_CALL_POST vmaFindMemoryTypeIndex(
        -
        2502  VmaAllocator allocator,
        -
        2503  uint32_t memoryTypeBits,
        -
        2504  const VmaAllocationCreateInfo* pAllocationCreateInfo,
        -
        2505  uint32_t* pMemoryTypeIndex);
        +
        2327 #endif // #if VMA_STATS_STRING_ENABLED
        +
        2328 
        +
        2337 VK_DEFINE_HANDLE(VmaPool)
        +
        2338 
        +
        2339 typedef enum VmaMemoryUsage
        +
        2340 {
        +
        2344  VMA_MEMORY_USAGE_UNKNOWN = 0,
        +
        2361  VMA_MEMORY_USAGE_GPU_ONLY = 1,
        +
        2371  VMA_MEMORY_USAGE_CPU_ONLY = 2,
        +
        2378  VMA_MEMORY_USAGE_CPU_TO_GPU = 3,
        +
        2387  VMA_MEMORY_USAGE_GPU_TO_CPU = 4,
        +
        2393  VMA_MEMORY_USAGE_CPU_COPY = 5,
        +
        2401  VMA_MEMORY_USAGE_GPU_LAZILY_ALLOCATED = 6,
        +
        2402 
        +
        2403  VMA_MEMORY_USAGE_MAX_ENUM = 0x7FFFFFFF
        +
        2404 } VmaMemoryUsage;
        +
        2405 
        +
        2407 typedef enum VmaAllocationCreateFlagBits {
        +
        2414  VMA_ALLOCATION_CREATE_DEDICATED_MEMORY_BIT = 0x00000001,
        +
        2415 
        +
        2425  VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT = 0x00000002,
        +
        2438  VMA_ALLOCATION_CREATE_MAPPED_BIT = 0x00000004,
        +
        2451  VMA_ALLOCATION_CREATE_CAN_BECOME_LOST_BIT = 0x00000008,
        +
        2458  VMA_ALLOCATION_CREATE_CAN_MAKE_OTHER_LOST_BIT = 0x00000010,
        +
        2464  VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT = 0x00000020,
        +
        2469  VMA_ALLOCATION_CREATE_UPPER_ADDRESS_BIT = 0x00000040,
        +
        2475  VMA_ALLOCATION_CREATE_DONT_BIND_BIT = 0x00000080,
        +
        2479  VMA_ALLOCATION_CREATE_WITHIN_BUDGET_BIT = 0x00000100,
        +
        2480 
        +
        2484  VMA_ALLOCATION_CREATE_STRATEGY_BEST_FIT_BIT = 0x00010000,
        +
        2488  VMA_ALLOCATION_CREATE_STRATEGY_WORST_FIT_BIT = 0x00020000,
        +
        2495  VMA_ALLOCATION_CREATE_STRATEGY_FIRST_FIT_BIT = 0x00040000,
        +
        2496 
        +
        2499  VMA_ALLOCATION_CREATE_STRATEGY_MIN_MEMORY_BIT = VMA_ALLOCATION_CREATE_STRATEGY_BEST_FIT_BIT,
        +
        2502  VMA_ALLOCATION_CREATE_STRATEGY_MIN_TIME_BIT = VMA_ALLOCATION_CREATE_STRATEGY_FIRST_FIT_BIT,
        +
        2505  VMA_ALLOCATION_CREATE_STRATEGY_MIN_FRAGMENTATION_BIT = VMA_ALLOCATION_CREATE_STRATEGY_WORST_FIT_BIT,
        2506 
        -
        2519 VMA_CALL_PRE VkResult VMA_CALL_POST vmaFindMemoryTypeIndexForBufferInfo(
        -
        2520  VmaAllocator allocator,
        -
        2521  const VkBufferCreateInfo* pBufferCreateInfo,
        -
        2522  const VmaAllocationCreateInfo* pAllocationCreateInfo,
        -
        2523  uint32_t* pMemoryTypeIndex);
        -
        2524 
        -
        2537 VMA_CALL_PRE VkResult VMA_CALL_POST vmaFindMemoryTypeIndexForImageInfo(
        -
        2538  VmaAllocator allocator,
        -
        2539  const VkImageCreateInfo* pImageCreateInfo,
        -
        2540  const VmaAllocationCreateInfo* pAllocationCreateInfo,
        -
        2541  uint32_t* pMemoryTypeIndex);
        -
        2542 
        -
        2544 typedef enum VmaPoolCreateFlagBits {
        -
        2562  VMA_POOL_CREATE_IGNORE_BUFFER_IMAGE_GRANULARITY_BIT = 0x00000002,
        -
        2563 
        -
        2579  VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT = 0x00000004,
        -
        2580 
        -
        2590  VMA_POOL_CREATE_BUDDY_ALGORITHM_BIT = 0x00000008,
        -
        2591 
        -
        2594  VMA_POOL_CREATE_ALGORITHM_MASK =
        -
        2595  VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT |
        -
        2596  VMA_POOL_CREATE_BUDDY_ALGORITHM_BIT,
        -
        2597 
        -
        2598  VMA_POOL_CREATE_FLAG_BITS_MAX_ENUM = 0x7FFFFFFF
        -
        2599 } VmaPoolCreateFlagBits;
        -
        2600 typedef VkFlags VmaPoolCreateFlags;
        -
        2601 
        -
        2604 typedef struct VmaPoolCreateInfo {
        -
        2607  uint32_t memoryTypeIndex;
        -
        2610  VmaPoolCreateFlags flags;
        -
        2619  VkDeviceSize blockSize;
        -
        2624  size_t minBlockCount;
        -
        2632  size_t maxBlockCount;
        -
        2646  uint32_t frameInUseCount;
        -
        2647 } VmaPoolCreateInfo;
        -
        2648 
        -
        2651 typedef struct VmaPoolStats {
        -
        2654  VkDeviceSize size;
        -
        2657  VkDeviceSize unusedSize;
        -
        2660  size_t allocationCount;
        -
        2663  size_t unusedRangeCount;
        -
        2670  VkDeviceSize unusedRangeSizeMax;
        -
        2673  size_t blockCount;
        -
        2674 } VmaPoolStats;
        -
        2675 
        -
        2682 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCreatePool(
        -
        2683  VmaAllocator allocator,
        -
        2684  const VmaPoolCreateInfo* pCreateInfo,
        -
        2685  VmaPool* pPool);
        -
        2686 
        -
        2689 VMA_CALL_PRE void VMA_CALL_POST vmaDestroyPool(
        -
        2690  VmaAllocator allocator,
        -
        2691  VmaPool pool);
        -
        2692 
        -
        2699 VMA_CALL_PRE void VMA_CALL_POST vmaGetPoolStats(
        -
        2700  VmaAllocator allocator,
        -
        2701  VmaPool pool,
        -
        2702  VmaPoolStats* pPoolStats);
        -
        2703 
        -
        2710 VMA_CALL_PRE void VMA_CALL_POST vmaMakePoolAllocationsLost(
        -
        2711  VmaAllocator allocator,
        -
        2712  VmaPool pool,
        -
        2713  size_t* pLostAllocationCount);
        -
        2714 
        -
        2729 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCheckPoolCorruption(VmaAllocator allocator, VmaPool pool);
        -
        2730 
        -
        2737 VMA_CALL_PRE void VMA_CALL_POST vmaGetPoolName(
        -
        2738  VmaAllocator allocator,
        -
        2739  VmaPool pool,
        -
        2740  const char** ppName);
        -
        2741 
        -
        2747 VMA_CALL_PRE void VMA_CALL_POST vmaSetPoolName(
        -
        2748  VmaAllocator allocator,
        -
        2749  VmaPool pool,
        -
        2750  const char* pName);
        +
        2509  VMA_ALLOCATION_CREATE_STRATEGY_MASK =
        +
        2510  VMA_ALLOCATION_CREATE_STRATEGY_BEST_FIT_BIT |
        +
        2511  VMA_ALLOCATION_CREATE_STRATEGY_WORST_FIT_BIT |
        +
        2512  VMA_ALLOCATION_CREATE_STRATEGY_FIRST_FIT_BIT,
        +
        2513 
        +
        2514  VMA_ALLOCATION_CREATE_FLAG_BITS_MAX_ENUM = 0x7FFFFFFF
        +
        2515 } VmaAllocationCreateFlagBits;
        +
        2516 typedef VkFlags VmaAllocationCreateFlags;
        +
        2517 
        +
        2518 typedef struct VmaAllocationCreateInfo
        +
        2519 {
        +
        2521  VmaAllocationCreateFlags flags;
        +
        2527  VmaMemoryUsage usage;
        +
        2532  VkMemoryPropertyFlags requiredFlags;
        +
        2537  VkMemoryPropertyFlags preferredFlags;
        +
        2545  uint32_t memoryTypeBits;
        +
        2551  VmaPool pool;
        +
        2558  void* pUserData;
        +
        2559 } VmaAllocationCreateInfo;
        +
        2560 
        +
        2577 VMA_CALL_PRE VkResult VMA_CALL_POST vmaFindMemoryTypeIndex(
        +
        2578  VmaAllocator allocator,
        +
        2579  uint32_t memoryTypeBits,
        +
        2580  const VmaAllocationCreateInfo* pAllocationCreateInfo,
        +
        2581  uint32_t* pMemoryTypeIndex);
        +
        2582 
        +
        2595 VMA_CALL_PRE VkResult VMA_CALL_POST vmaFindMemoryTypeIndexForBufferInfo(
        +
        2596  VmaAllocator allocator,
        +
        2597  const VkBufferCreateInfo* pBufferCreateInfo,
        +
        2598  const VmaAllocationCreateInfo* pAllocationCreateInfo,
        +
        2599  uint32_t* pMemoryTypeIndex);
        +
        2600 
        +
        2613 VMA_CALL_PRE VkResult VMA_CALL_POST vmaFindMemoryTypeIndexForImageInfo(
        +
        2614  VmaAllocator allocator,
        +
        2615  const VkImageCreateInfo* pImageCreateInfo,
        +
        2616  const VmaAllocationCreateInfo* pAllocationCreateInfo,
        +
        2617  uint32_t* pMemoryTypeIndex);
        +
        2618 
        +
        2620 typedef enum VmaPoolCreateFlagBits {
        +
        2638  VMA_POOL_CREATE_IGNORE_BUFFER_IMAGE_GRANULARITY_BIT = 0x00000002,
        +
        2639 
        +
        2655  VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT = 0x00000004,
        +
        2656 
        +
        2666  VMA_POOL_CREATE_BUDDY_ALGORITHM_BIT = 0x00000008,
        +
        2667 
        +
        2670  VMA_POOL_CREATE_ALGORITHM_MASK =
        +
        2671  VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT |
        +
        2672  VMA_POOL_CREATE_BUDDY_ALGORITHM_BIT,
        +
        2673 
        +
        2674  VMA_POOL_CREATE_FLAG_BITS_MAX_ENUM = 0x7FFFFFFF
        +
        2675 } VmaPoolCreateFlagBits;
        +
        2676 typedef VkFlags VmaPoolCreateFlags;
        +
        2677 
        +
        2680 typedef struct VmaPoolCreateInfo {
        +
        2683  uint32_t memoryTypeIndex;
        +
        2686  VmaPoolCreateFlags flags;
        +
        2695  VkDeviceSize blockSize;
        +
        2700  size_t minBlockCount;
        +
        2708  size_t maxBlockCount;
        +
        2722  uint32_t frameInUseCount;
        +
        2723 } VmaPoolCreateInfo;
        +
        2724 
        +
        2727 typedef struct VmaPoolStats {
        +
        2730  VkDeviceSize size;
        +
        2733  VkDeviceSize unusedSize;
        +
        2736  size_t allocationCount;
        +
        2739  size_t unusedRangeCount;
        +
        2746  VkDeviceSize unusedRangeSizeMax;
        +
        2749  size_t blockCount;
        +
        2750 } VmaPoolStats;
        2751 
        -
        2776 VK_DEFINE_HANDLE(VmaAllocation)
        -
        2777 
        -
        2778 
        -
        2780 typedef struct VmaAllocationInfo {
        -
        2785  uint32_t memoryType;
        -
        2794  VkDeviceMemory deviceMemory;
        -
        2799  VkDeviceSize offset;
        -
        2804  VkDeviceSize size;
        -
        2813  void* pMappedData;
        -
        2818  void* pUserData;
        -
        2819 } VmaAllocationInfo;
        -
        2820 
        -
        2831 VMA_CALL_PRE VkResult VMA_CALL_POST vmaAllocateMemory(
        -
        2832  VmaAllocator allocator,
        -
        2833  const VkMemoryRequirements* pVkMemoryRequirements,
        -
        2834  const VmaAllocationCreateInfo* pCreateInfo,
        -
        2835  VmaAllocation* pAllocation,
        -
        2836  VmaAllocationInfo* pAllocationInfo);
        -
        2837 
        -
        2857 VMA_CALL_PRE VkResult VMA_CALL_POST vmaAllocateMemoryPages(
        -
        2858  VmaAllocator allocator,
        -
        2859  const VkMemoryRequirements* pVkMemoryRequirements,
        -
        2860  const VmaAllocationCreateInfo* pCreateInfo,
        -
        2861  size_t allocationCount,
        -
        2862  VmaAllocation* pAllocations,
        -
        2863  VmaAllocationInfo* pAllocationInfo);
        -
        2864 
        -
        2871 VMA_CALL_PRE VkResult VMA_CALL_POST vmaAllocateMemoryForBuffer(
        -
        2872  VmaAllocator allocator,
        -
        2873  VkBuffer buffer,
        -
        2874  const VmaAllocationCreateInfo* pCreateInfo,
        -
        2875  VmaAllocation* pAllocation,
        -
        2876  VmaAllocationInfo* pAllocationInfo);
        -
        2877 
        -
        2879 VMA_CALL_PRE VkResult VMA_CALL_POST vmaAllocateMemoryForImage(
        -
        2880  VmaAllocator allocator,
        -
        2881  VkImage image,
        -
        2882  const VmaAllocationCreateInfo* pCreateInfo,
        -
        2883  VmaAllocation* pAllocation,
        -
        2884  VmaAllocationInfo* pAllocationInfo);
        -
        2885 
        -
        2890 VMA_CALL_PRE void VMA_CALL_POST vmaFreeMemory(
        -
        2891  VmaAllocator allocator,
        -
        2892  VmaAllocation allocation);
        -
        2893 
        -
        2904 VMA_CALL_PRE void VMA_CALL_POST vmaFreeMemoryPages(
        -
        2905  VmaAllocator allocator,
        -
        2906  size_t allocationCount,
        -
        2907  VmaAllocation* pAllocations);
        -
        2908 
        -
        2915 VMA_CALL_PRE VkResult VMA_CALL_POST vmaResizeAllocation(
        -
        2916  VmaAllocator allocator,
        -
        2917  VmaAllocation allocation,
        -
        2918  VkDeviceSize newSize);
        -
        2919 
        -
        2936 VMA_CALL_PRE void VMA_CALL_POST vmaGetAllocationInfo(
        -
        2937  VmaAllocator allocator,
        -
        2938  VmaAllocation allocation,
        +
        2758 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCreatePool(
        +
        2759  VmaAllocator allocator,
        +
        2760  const VmaPoolCreateInfo* pCreateInfo,
        +
        2761  VmaPool* pPool);
        +
        2762 
        +
        2765 VMA_CALL_PRE void VMA_CALL_POST vmaDestroyPool(
        +
        2766  VmaAllocator allocator,
        +
        2767  VmaPool pool);
        +
        2768 
        +
        2775 VMA_CALL_PRE void VMA_CALL_POST vmaGetPoolStats(
        +
        2776  VmaAllocator allocator,
        +
        2777  VmaPool pool,
        +
        2778  VmaPoolStats* pPoolStats);
        +
        2779 
        +
        2786 VMA_CALL_PRE void VMA_CALL_POST vmaMakePoolAllocationsLost(
        +
        2787  VmaAllocator allocator,
        +
        2788  VmaPool pool,
        +
        2789  size_t* pLostAllocationCount);
        +
        2790 
        +
        2805 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCheckPoolCorruption(VmaAllocator allocator, VmaPool pool);
        +
        2806 
        +
        2813 VMA_CALL_PRE void VMA_CALL_POST vmaGetPoolName(
        +
        2814  VmaAllocator allocator,
        +
        2815  VmaPool pool,
        +
        2816  const char** ppName);
        +
        2817 
        +
        2823 VMA_CALL_PRE void VMA_CALL_POST vmaSetPoolName(
        +
        2824  VmaAllocator allocator,
        +
        2825  VmaPool pool,
        +
        2826  const char* pName);
        +
        2827 
        +
        2852 VK_DEFINE_HANDLE(VmaAllocation)
        +
        2853 
        +
        2854 
        +
        2856 typedef struct VmaAllocationInfo {
        +
        2861  uint32_t memoryType;
        +
        2870  VkDeviceMemory deviceMemory;
        +
        2875  VkDeviceSize offset;
        +
        2880  VkDeviceSize size;
        +
        2889  void* pMappedData;
        +
        2894  void* pUserData;
        +
        2895 } VmaAllocationInfo;
        +
        2896 
        +
        2907 VMA_CALL_PRE VkResult VMA_CALL_POST vmaAllocateMemory(
        +
        2908  VmaAllocator allocator,
        +
        2909  const VkMemoryRequirements* pVkMemoryRequirements,
        +
        2910  const VmaAllocationCreateInfo* pCreateInfo,
        +
        2911  VmaAllocation* pAllocation,
        +
        2912  VmaAllocationInfo* pAllocationInfo);
        +
        2913 
        +
        2933 VMA_CALL_PRE VkResult VMA_CALL_POST vmaAllocateMemoryPages(
        +
        2934  VmaAllocator allocator,
        +
        2935  const VkMemoryRequirements* pVkMemoryRequirements,
        +
        2936  const VmaAllocationCreateInfo* pCreateInfo,
        +
        2937  size_t allocationCount,
        +
        2938  VmaAllocation* pAllocations,
        2939  VmaAllocationInfo* pAllocationInfo);
        2940 
        -
        2955 VMA_CALL_PRE VkBool32 VMA_CALL_POST vmaTouchAllocation(
        +
        2947 VMA_CALL_PRE VkResult VMA_CALL_POST vmaAllocateMemoryForBuffer(
        +
        2948  VmaAllocator allocator,
        +
        2949  VkBuffer buffer,
        +
        2950  const VmaAllocationCreateInfo* pCreateInfo,
        +
        2951  VmaAllocation* pAllocation,
        +
        2952  VmaAllocationInfo* pAllocationInfo);
        +
        2953 
        +
        2955 VMA_CALL_PRE VkResult VMA_CALL_POST vmaAllocateMemoryForImage(
        2956  VmaAllocator allocator,
        -
        2957  VmaAllocation allocation);
        -
        2958 
        -
        2972 VMA_CALL_PRE void VMA_CALL_POST vmaSetAllocationUserData(
        -
        2973  VmaAllocator allocator,
        -
        2974  VmaAllocation allocation,
        -
        2975  void* pUserData);
        -
        2976 
        -
        2987 VMA_CALL_PRE void VMA_CALL_POST vmaCreateLostAllocation(
        -
        2988  VmaAllocator allocator,
        -
        2989  VmaAllocation* pAllocation);
        -
        2990 
        -
        3029 VMA_CALL_PRE VkResult VMA_CALL_POST vmaMapMemory(
        -
        3030  VmaAllocator allocator,
        -
        3031  VmaAllocation allocation,
        -
        3032  void** ppData);
        -
        3033 
        -
        3042 VMA_CALL_PRE void VMA_CALL_POST vmaUnmapMemory(
        -
        3043  VmaAllocator allocator,
        -
        3044  VmaAllocation allocation);
        -
        3045 
        -
        3064 VMA_CALL_PRE void VMA_CALL_POST vmaFlushAllocation(VmaAllocator allocator, VmaAllocation allocation, VkDeviceSize offset, VkDeviceSize size);
        -
        3065 
        -
        3084 VMA_CALL_PRE void VMA_CALL_POST vmaInvalidateAllocation(VmaAllocator allocator, VmaAllocation allocation, VkDeviceSize offset, VkDeviceSize size);
        -
        3085 
        -
        3102 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCheckCorruption(VmaAllocator allocator, uint32_t memoryTypeBits);
        -
        3103 
        -
        3110 VK_DEFINE_HANDLE(VmaDefragmentationContext)
        -
        3111 
        -
        3112 typedef enum VmaDefragmentationFlagBits {
        -
        3114  VMA_DEFRAGMENTATION_FLAG_BITS_MAX_ENUM = 0x7FFFFFFF
        -
        3115 } VmaDefragmentationFlagBits;
        -
        3116 typedef VkFlags VmaDefragmentationFlags;
        -
        3117 
        -
        3122 typedef struct VmaDefragmentationInfo2 {
        -
        3125  VmaDefragmentationFlags flags;
        -
        3128  uint32_t allocationCount;
        -
        3137  VmaAllocation* pAllocations;
        -
        3143  VkBool32* pAllocationsChanged;
        -
        3146  uint32_t poolCount;
        -
        3162  VmaPool* pPools;
        -
        3167  VkDeviceSize maxCpuBytesToMove;
        -
        3172  uint32_t maxCpuAllocationsToMove;
        -
        3177  VkDeviceSize maxGpuBytesToMove;
        -
        3182  uint32_t maxGpuAllocationsToMove;
        -
        3191  VkCommandBuffer commandBuffer;
        -
        3192 } VmaDefragmentationInfo2;
        -
        3193 
        -
        3198 typedef struct VmaDefragmentationInfo {
        -
        3203  VkDeviceSize maxBytesToMove;
        -
        3208  uint32_t maxAllocationsToMove;
        -
        3209 } VmaDefragmentationInfo;
        -
        3210 
        -
        3212 typedef struct VmaDefragmentationStats {
        -
        3214  VkDeviceSize bytesMoved;
        -
        3216  VkDeviceSize bytesFreed;
        -
        3218  uint32_t allocationsMoved;
        -
        3220  uint32_t deviceMemoryBlocksFreed;
        -
        3221 } VmaDefragmentationStats;
        -
        3222 
        -
        3252 VMA_CALL_PRE VkResult VMA_CALL_POST vmaDefragmentationBegin(
        -
        3253  VmaAllocator allocator,
        -
        3254  const VmaDefragmentationInfo2* pInfo,
        -
        3255  VmaDefragmentationStats* pStats,
        -
        3256  VmaDefragmentationContext *pContext);
        -
        3257 
        -
        3263 VMA_CALL_PRE VkResult VMA_CALL_POST vmaDefragmentationEnd(
        -
        3264  VmaAllocator allocator,
        -
        3265  VmaDefragmentationContext context);
        -
        3266 
        -
        3307 VMA_CALL_PRE VkResult VMA_CALL_POST vmaDefragment(
        -
        3308  VmaAllocator allocator,
        -
        3309  VmaAllocation* pAllocations,
        -
        3310  size_t allocationCount,
        -
        3311  VkBool32* pAllocationsChanged,
        -
        3312  const VmaDefragmentationInfo *pDefragmentationInfo,
        -
        3313  VmaDefragmentationStats* pDefragmentationStats);
        -
        3314 
        -
        3327 VMA_CALL_PRE VkResult VMA_CALL_POST vmaBindBufferMemory(
        -
        3328  VmaAllocator allocator,
        -
        3329  VmaAllocation allocation,
        -
        3330  VkBuffer buffer);
        -
        3331 
        -
        3342 VMA_CALL_PRE VkResult VMA_CALL_POST vmaBindBufferMemory2(
        -
        3343  VmaAllocator allocator,
        -
        3344  VmaAllocation allocation,
        -
        3345  VkDeviceSize allocationLocalOffset,
        -
        3346  VkBuffer buffer,
        -
        3347  const void* pNext);
        -
        3348 
        -
        3361 VMA_CALL_PRE VkResult VMA_CALL_POST vmaBindImageMemory(
        -
        3362  VmaAllocator allocator,
        -
        3363  VmaAllocation allocation,
        -
        3364  VkImage image);
        -
        3365 
        -
        3376 VMA_CALL_PRE VkResult VMA_CALL_POST vmaBindImageMemory2(
        -
        3377  VmaAllocator allocator,
        -
        3378  VmaAllocation allocation,
        -
        3379  VkDeviceSize allocationLocalOffset,
        -
        3380  VkImage image,
        -
        3381  const void* pNext);
        -
        3382 
        -
        3409 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCreateBuffer(
        -
        3410  VmaAllocator allocator,
        -
        3411  const VkBufferCreateInfo* pBufferCreateInfo,
        -
        3412  const VmaAllocationCreateInfo* pAllocationCreateInfo,
        -
        3413  VkBuffer* pBuffer,
        -
        3414  VmaAllocation* pAllocation,
        -
        3415  VmaAllocationInfo* pAllocationInfo);
        -
        3416 
        -
        3428 VMA_CALL_PRE void VMA_CALL_POST vmaDestroyBuffer(
        -
        3429  VmaAllocator allocator,
        -
        3430  VkBuffer buffer,
        -
        3431  VmaAllocation allocation);
        -
        3432 
        -
        3434 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCreateImage(
        -
        3435  VmaAllocator allocator,
        -
        3436  const VkImageCreateInfo* pImageCreateInfo,
        -
        3437  const VmaAllocationCreateInfo* pAllocationCreateInfo,
        -
        3438  VkImage* pImage,
        -
        3439  VmaAllocation* pAllocation,
        -
        3440  VmaAllocationInfo* pAllocationInfo);
        -
        3441 
        -
        3453 VMA_CALL_PRE void VMA_CALL_POST vmaDestroyImage(
        -
        3454  VmaAllocator allocator,
        -
        3455  VkImage image,
        -
        3456  VmaAllocation allocation);
        -
        3457 
        -
        3458 #ifdef __cplusplus
        -
        3459 }
        -
        3460 #endif
        -
        3461 
        -
        3462 #endif // AMD_VULKAN_MEMORY_ALLOCATOR_H
        -
        3463 
        -
        3464 // For Visual Studio IntelliSense.
        -
        3465 #if defined(__cplusplus) && defined(__INTELLISENSE__)
        -
        3466 #define VMA_IMPLEMENTATION
        -
        3467 #endif
        +
        2957  VkImage image,
        +
        2958  const VmaAllocationCreateInfo* pCreateInfo,
        +
        2959  VmaAllocation* pAllocation,
        +
        2960  VmaAllocationInfo* pAllocationInfo);
        +
        2961 
        +
        2966 VMA_CALL_PRE void VMA_CALL_POST vmaFreeMemory(
        +
        2967  VmaAllocator allocator,
        +
        2968  VmaAllocation allocation);
        +
        2969 
        +
        2980 VMA_CALL_PRE void VMA_CALL_POST vmaFreeMemoryPages(
        +
        2981  VmaAllocator allocator,
        +
        2982  size_t allocationCount,
        +
        2983  VmaAllocation* pAllocations);
        +
        2984 
        +
        2992 VMA_CALL_PRE VkResult VMA_CALL_POST vmaResizeAllocation(
        +
        2993  VmaAllocator allocator,
        +
        2994  VmaAllocation allocation,
        +
        2995  VkDeviceSize newSize);
        +
        2996 
        +
        3013 VMA_CALL_PRE void VMA_CALL_POST vmaGetAllocationInfo(
        +
        3014  VmaAllocator allocator,
        +
        3015  VmaAllocation allocation,
        +
        3016  VmaAllocationInfo* pAllocationInfo);
        +
        3017 
        +
        3032 VMA_CALL_PRE VkBool32 VMA_CALL_POST vmaTouchAllocation(
        +
        3033  VmaAllocator allocator,
        +
        3034  VmaAllocation allocation);
        +
        3035 
        +
        3049 VMA_CALL_PRE void VMA_CALL_POST vmaSetAllocationUserData(
        +
        3050  VmaAllocator allocator,
        +
        3051  VmaAllocation allocation,
        +
        3052  void* pUserData);
        +
        3053 
        +
        3064 VMA_CALL_PRE void VMA_CALL_POST vmaCreateLostAllocation(
        +
        3065  VmaAllocator allocator,
        +
        3066  VmaAllocation* pAllocation);
        +
        3067 
        +
        3106 VMA_CALL_PRE VkResult VMA_CALL_POST vmaMapMemory(
        +
        3107  VmaAllocator allocator,
        +
        3108  VmaAllocation allocation,
        +
        3109  void** ppData);
        +
        3110 
        +
        3119 VMA_CALL_PRE void VMA_CALL_POST vmaUnmapMemory(
        +
        3120  VmaAllocator allocator,
        +
        3121  VmaAllocation allocation);
        +
        3122 
        +
        3141 VMA_CALL_PRE void VMA_CALL_POST vmaFlushAllocation(VmaAllocator allocator, VmaAllocation allocation, VkDeviceSize offset, VkDeviceSize size);
        +
        3142 
        +
        3161 VMA_CALL_PRE void VMA_CALL_POST vmaInvalidateAllocation(VmaAllocator allocator, VmaAllocation allocation, VkDeviceSize offset, VkDeviceSize size);
        +
        3162 
        +
        3179 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCheckCorruption(VmaAllocator allocator, uint32_t memoryTypeBits);
        +
        3180 
        +
        3187 VK_DEFINE_HANDLE(VmaDefragmentationContext)
        +
        3188 
        +
        3189 typedef enum VmaDefragmentationFlagBits {
        +
        3191  VMA_DEFRAGMENTATION_FLAG_INCREMENTAL = 0x1,
        +
        3192  VMA_DEFRAGMENTATION_FLAG_BITS_MAX_ENUM = 0x7FFFFFFF
        +
        3193 } VmaDefragmentationFlagBits;
        +
        3194 typedef VkFlags VmaDefragmentationFlags;
        +
        3195 
        +
        3200 typedef struct VmaDefragmentationInfo2 {
        +
        3203  VmaDefragmentationFlags flags;
        +
        3206  uint32_t allocationCount;
        +
        3215  VmaAllocation* pAllocations;
        +
        3221  VkBool32* pAllocationsChanged;
        +
        3224  uint32_t poolCount;
        +
        3240  VmaPool* pPools;
        +
        3245  VkDeviceSize maxCpuBytesToMove;
        +
        3250  uint32_t maxCpuAllocationsToMove;
        +
        3255  VkDeviceSize maxGpuBytesToMove;
        +
        3260  uint32_t maxGpuAllocationsToMove;
        +
        3269  VkCommandBuffer commandBuffer;
        +
        3270 } VmaDefragmentationInfo2;
        +
        3271 
        +
        3272 typedef struct VmaDefragmentationPassMoveInfo {
        +
        3273  VmaAllocation allocation;
        +
        3274  VkDeviceMemory memory;
        +
        3275  VkDeviceSize offset;
        +
        3276 } VmaDefragmentationPassMoveInfo;
        +
        3277 
        +
        3282 typedef struct VmaDefragmentationPassInfo {
        +
        3283  uint32_t moveCount;
        +
        3284  VmaDefragmentationPassMoveInfo* pMoves;
        +
        3285 } VmaDefragmentationPassInfo;
        +
        3286 
        +
        3291 typedef struct VmaDefragmentationInfo {
        +
        3296  VkDeviceSize maxBytesToMove;
        +
        3301  uint32_t maxAllocationsToMove;
        +
        3302 } VmaDefragmentationInfo;
        +
        3303 
        +
        3305 typedef struct VmaDefragmentationStats {
        +
        3307  VkDeviceSize bytesMoved;
        +
        3309  VkDeviceSize bytesFreed;
        +
        3311  uint32_t allocationsMoved;
        +
        3313  uint32_t deviceMemoryBlocksFreed;
        +
        3314 } VmaDefragmentationStats;
        +
        3315 
        +
        3345 VMA_CALL_PRE VkResult VMA_CALL_POST vmaDefragmentationBegin(
        +
        3346  VmaAllocator allocator,
        +
        3347  const VmaDefragmentationInfo2* pInfo,
        +
        3348  VmaDefragmentationStats* pStats,
        +
        3349  VmaDefragmentationContext *pContext);
        +
        3350 
        +
        3356 VMA_CALL_PRE VkResult VMA_CALL_POST vmaDefragmentationEnd(
        +
        3357  VmaAllocator allocator,
        +
        3358  VmaDefragmentationContext context);
        +
        3359 
        +
        3360 VMA_CALL_PRE VkResult VMA_CALL_POST vmaBeginDefragmentationPass(
        +
        3361  VmaAllocator allocator,
        +
        3362  VmaDefragmentationContext context,
        +
        3363  VmaDefragmentationPassInfo* pInfo
        +
        3364 );
        +
        3365 VMA_CALL_PRE VkResult VMA_CALL_POST vmaEndDefragmentationPass(
        +
        3366  VmaAllocator allocator,
        +
        3367  VmaDefragmentationContext context
        +
        3368 );
        +
        3369 
        +
        3410 VMA_CALL_PRE VkResult VMA_CALL_POST vmaDefragment(
        +
        3411  VmaAllocator allocator,
        +
        3412  VmaAllocation* pAllocations,
        +
        3413  size_t allocationCount,
        +
        3414  VkBool32* pAllocationsChanged,
        +
        3415  const VmaDefragmentationInfo *pDefragmentationInfo,
        +
        3416  VmaDefragmentationStats* pDefragmentationStats);
        +
        3417 
        +
        3430 VMA_CALL_PRE VkResult VMA_CALL_POST vmaBindBufferMemory(
        +
        3431  VmaAllocator allocator,
        +
        3432  VmaAllocation allocation,
        +
        3433  VkBuffer buffer);
        +
        3434 
        +
        3445 VMA_CALL_PRE VkResult VMA_CALL_POST vmaBindBufferMemory2(
        +
        3446  VmaAllocator allocator,
        +
        3447  VmaAllocation allocation,
        +
        3448  VkDeviceSize allocationLocalOffset,
        +
        3449  VkBuffer buffer,
        +
        3450  const void* pNext);
        +
        3451 
        +
        3464 VMA_CALL_PRE VkResult VMA_CALL_POST vmaBindImageMemory(
        +
        3465  VmaAllocator allocator,
        +
        3466  VmaAllocation allocation,
        +
        3467  VkImage image);
        3468 
        -
        3469 #ifdef VMA_IMPLEMENTATION
        -
        3470 #undef VMA_IMPLEMENTATION
        -
        3471 
        -
        3472 #include <cstdint>
        -
        3473 #include <cstdlib>
        -
        3474 #include <cstring>
        -
        3475 
        -
        3476 /*******************************************************************************
        -
        3477 CONFIGURATION SECTION
        -
        3478 
        -
        3479 Define some of these macros before each #include of this header or change them
        -
        3480 here if you need other then default behavior depending on your environment.
        -
        3481 */
        -
        3482 
        -
        3483 /*
        -
        3484 Define this macro to 1 to make the library fetch pointers to Vulkan functions
        -
        3485 internally, like:
        -
        3486 
        -
        3487  vulkanFunctions.vkAllocateMemory = &vkAllocateMemory;
        -
        3488 
        -
        3489 Define to 0 if you are going to provide you own pointers to Vulkan functions via
        -
        3490 VmaAllocatorCreateInfo::pVulkanFunctions.
        -
        3491 */
        -
        3492 #if !defined(VMA_STATIC_VULKAN_FUNCTIONS) && !defined(VK_NO_PROTOTYPES)
        -
        3493 #define VMA_STATIC_VULKAN_FUNCTIONS 1
        -
        3494 #endif
        -
        3495 
        -
        3496 // Define this macro to 1 to make the library use STL containers instead of its own implementation.
        -
        3497 //#define VMA_USE_STL_CONTAINERS 1
        -
        3498 
        -
        3499 /* Set this macro to 1 to make the library including and using STL containers:
        -
        3500 std::pair, std::vector, std::list, std::unordered_map.
        -
        3501 
        -
        3502 Set it to 0 or undefined to make the library using its own implementation of
        -
        3503 the containers.
        -
        3504 */
        -
        3505 #if VMA_USE_STL_CONTAINERS
        -
        3506  #define VMA_USE_STL_VECTOR 1
        -
        3507  #define VMA_USE_STL_UNORDERED_MAP 1
        -
        3508  #define VMA_USE_STL_LIST 1
        -
        3509 #endif
        -
        3510 
        -
        3511 #ifndef VMA_USE_STL_SHARED_MUTEX
        -
        3512  // Compiler conforms to C++17.
        -
        3513  #if __cplusplus >= 201703L
        -
        3514  #define VMA_USE_STL_SHARED_MUTEX 1
        -
        3515  // Visual studio defines __cplusplus properly only when passed additional parameter: /Zc:__cplusplus
        -
        3516  // Otherwise it's always 199711L, despite shared_mutex works since Visual Studio 2015 Update 2.
        -
        3517  // See: https://blogs.msdn.microsoft.com/vcblog/2018/04/09/msvc-now-correctly-reports-__cplusplus/
        -
        3518  #elif defined(_MSC_FULL_VER) && _MSC_FULL_VER >= 190023918 && __cplusplus == 199711L && _MSVC_LANG >= 201703L
        -
        3519  #define VMA_USE_STL_SHARED_MUTEX 1
        -
        3520  #else
        -
        3521  #define VMA_USE_STL_SHARED_MUTEX 0
        -
        3522  #endif
        -
        3523 #endif
        -
        3524 
        -
        3525 /*
        -
        3526 THESE INCLUDES ARE NOT ENABLED BY DEFAULT.
        -
        3527 Library has its own container implementation.
        -
        3528 */
        -
        3529 #if VMA_USE_STL_VECTOR
        -
        3530  #include <vector>
        -
        3531 #endif
        -
        3532 
        -
        3533 #if VMA_USE_STL_UNORDERED_MAP
        -
        3534  #include <unordered_map>
        -
        3535 #endif
        -
        3536 
        -
        3537 #if VMA_USE_STL_LIST
        -
        3538  #include <list>
        -
        3539 #endif
        -
        3540 
        -
        3541 /*
        -
        3542 Following headers are used in this CONFIGURATION section only, so feel free to
        -
        3543 remove them if not needed.
        -
        3544 */
        -
        3545 #include <cassert> // for assert
        -
        3546 #include <algorithm> // for min, max
        -
        3547 #include <mutex>
        -
        3548 
        -
        3549 #ifndef VMA_NULL
        -
        3550  // Value used as null pointer. Define it to e.g.: nullptr, NULL, 0, (void*)0.
        -
        3551  #define VMA_NULL nullptr
        -
        3552 #endif
        -
        3553 
        -
        3554 #if defined(__ANDROID_API__) && (__ANDROID_API__ < 16)
        -
        3555 #include <cstdlib>
        -
        3556 void *aligned_alloc(size_t alignment, size_t size)
        -
        3557 {
        -
        3558  // alignment must be >= sizeof(void*)
        -
        3559  if(alignment < sizeof(void*))
        -
        3560  {
        -
        3561  alignment = sizeof(void*);
        -
        3562  }
        -
        3563 
        -
        3564  return memalign(alignment, size);
        -
        3565 }
        -
        3566 #elif defined(__APPLE__) || defined(__ANDROID__) || (defined(__linux__) && defined(__GLIBCXX__) && !defined(_GLIBCXX_HAVE_ALIGNED_ALLOC))
        -
        3567 #include <cstdlib>
        -
        3568 void *aligned_alloc(size_t alignment, size_t size)
        -
        3569 {
        -
        3570  // alignment must be >= sizeof(void*)
        -
        3571  if(alignment < sizeof(void*))
        -
        3572  {
        -
        3573  alignment = sizeof(void*);
        -
        3574  }
        -
        3575 
        -
        3576  void *pointer;
        -
        3577  if(posix_memalign(&pointer, alignment, size) == 0)
        -
        3578  return pointer;
        -
        3579  return VMA_NULL;
        -
        3580 }
        -
        3581 #endif
        -
        3582 
        -
        3583 // If your compiler is not compatible with C++11 and definition of
        -
        3584 // aligned_alloc() function is missing, uncommeting following line may help:
        -
        3585 
        -
        3586 //#include <malloc.h>
        -
        3587 
        -
        3588 // Normal assert to check for programmer's errors, especially in Debug configuration.
        -
        3589 #ifndef VMA_ASSERT
        -
        3590  #ifdef NDEBUG
        -
        3591  #define VMA_ASSERT(expr)
        -
        3592  #else
        -
        3593  #define VMA_ASSERT(expr) assert(expr)
        -
        3594  #endif
        -
        3595 #endif
        -
        3596 
        -
        3597 // Assert that will be called very often, like inside data structures e.g. operator[].
        -
        3598 // Making it non-empty can make program slow.
        -
        3599 #ifndef VMA_HEAVY_ASSERT
        -
        3600  #ifdef NDEBUG
        -
        3601  #define VMA_HEAVY_ASSERT(expr)
        -
        3602  #else
        -
        3603  #define VMA_HEAVY_ASSERT(expr) //VMA_ASSERT(expr)
        -
        3604  #endif
        -
        3605 #endif
        -
        3606 
        -
        3607 #ifndef VMA_ALIGN_OF
        -
        3608  #define VMA_ALIGN_OF(type) (__alignof(type))
        -
        3609 #endif
        -
        3610 
        -
        3611 #ifndef VMA_SYSTEM_ALIGNED_MALLOC
        -
        3612  #if defined(_WIN32)
        -
        3613  #define VMA_SYSTEM_ALIGNED_MALLOC(size, alignment) (_aligned_malloc((size), (alignment)))
        -
        3614  #else
        -
        3615  #define VMA_SYSTEM_ALIGNED_MALLOC(size, alignment) (aligned_alloc((alignment), (size) ))
        -
        3616  #endif
        -
        3617 #endif
        -
        3618 
        -
        3619 #ifndef VMA_SYSTEM_FREE
        -
        3620  #if defined(_WIN32)
        -
        3621  #define VMA_SYSTEM_FREE(ptr) _aligned_free(ptr)
        -
        3622  #else
        -
        3623  #define VMA_SYSTEM_FREE(ptr) free(ptr)
        -
        3624  #endif
        -
        3625 #endif
        -
        3626 
        -
        3627 #ifndef VMA_MIN
        -
        3628  #define VMA_MIN(v1, v2) (std::min((v1), (v2)))
        -
        3629 #endif
        -
        3630 
        -
        3631 #ifndef VMA_MAX
        -
        3632  #define VMA_MAX(v1, v2) (std::max((v1), (v2)))
        -
        3633 #endif
        -
        3634 
        -
        3635 #ifndef VMA_SWAP
        -
        3636  #define VMA_SWAP(v1, v2) std::swap((v1), (v2))
        -
        3637 #endif
        -
        3638 
        -
        3639 #ifndef VMA_SORT
        -
        3640  #define VMA_SORT(beg, end, cmp) std::sort(beg, end, cmp)
        -
        3641 #endif
        -
        3642 
        -
        3643 #ifndef VMA_DEBUG_LOG
        -
        3644  #define VMA_DEBUG_LOG(format, ...)
        -
        3645  /*
        -
        3646  #define VMA_DEBUG_LOG(format, ...) do { \
        -
        3647  printf(format, __VA_ARGS__); \
        -
        3648  printf("\n"); \
        -
        3649  } while(false)
        -
        3650  */
        -
        3651 #endif
        +
        3479 VMA_CALL_PRE VkResult VMA_CALL_POST vmaBindImageMemory2(
        +
        3480  VmaAllocator allocator,
        +
        3481  VmaAllocation allocation,
        +
        3482  VkDeviceSize allocationLocalOffset,
        +
        3483  VkImage image,
        +
        3484  const void* pNext);
        +
        3485 
        +
        3512 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCreateBuffer(
        +
        3513  VmaAllocator allocator,
        +
        3514  const VkBufferCreateInfo* pBufferCreateInfo,
        +
        3515  const VmaAllocationCreateInfo* pAllocationCreateInfo,
        +
        3516  VkBuffer* pBuffer,
        +
        3517  VmaAllocation* pAllocation,
        +
        3518  VmaAllocationInfo* pAllocationInfo);
        +
        3519 
        +
        3531 VMA_CALL_PRE void VMA_CALL_POST vmaDestroyBuffer(
        +
        3532  VmaAllocator allocator,
        +
        3533  VkBuffer buffer,
        +
        3534  VmaAllocation allocation);
        +
        3535 
        +
        3537 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCreateImage(
        +
        3538  VmaAllocator allocator,
        +
        3539  const VkImageCreateInfo* pImageCreateInfo,
        +
        3540  const VmaAllocationCreateInfo* pAllocationCreateInfo,
        +
        3541  VkImage* pImage,
        +
        3542  VmaAllocation* pAllocation,
        +
        3543  VmaAllocationInfo* pAllocationInfo);
        +
        3544 
        +
        3556 VMA_CALL_PRE void VMA_CALL_POST vmaDestroyImage(
        +
        3557  VmaAllocator allocator,
        +
        3558  VkImage image,
        +
        3559  VmaAllocation allocation);
        +
        3560 
        +
        3561 #ifdef __cplusplus
        +
        3562 }
        +
        3563 #endif
        +
        3564 
        +
        3565 #endif // AMD_VULKAN_MEMORY_ALLOCATOR_H
        +
        3566 
        +
        3567 // For Visual Studio IntelliSense.
        +
        3568 #if defined(__cplusplus) && defined(__INTELLISENSE__)
        +
        3569 #define VMA_IMPLEMENTATION
        +
        3570 #endif
        +
        3571 
        +
        3572 #ifdef VMA_IMPLEMENTATION
        +
        3573 #undef VMA_IMPLEMENTATION
        +
        3574 
        +
        3575 #include <cstdint>
        +
        3576 #include <cstdlib>
        +
        3577 #include <cstring>
        +
        3578 #include <utility>
        +
        3579 
        +
        3580 /*******************************************************************************
        +
        3581 CONFIGURATION SECTION
        +
        3582 
        +
        3583 Define some of these macros before each #include of this header or change them
        +
        3584 here if you need other then default behavior depending on your environment.
        +
        3585 */
        +
        3586 
        +
        3587 /*
        +
        3588 Define this macro to 1 to make the library fetch pointers to Vulkan functions
        +
        3589 internally, like:
        +
        3590 
        +
        3591  vulkanFunctions.vkAllocateMemory = &vkAllocateMemory;
        +
        3592 
        +
        3593 Define to 0 if you are going to provide you own pointers to Vulkan functions via
        +
        3594 VmaAllocatorCreateInfo::pVulkanFunctions.
        +
        3595 */
        +
        3596 #if !defined(VMA_STATIC_VULKAN_FUNCTIONS) && !defined(VK_NO_PROTOTYPES)
        +
        3597 #define VMA_STATIC_VULKAN_FUNCTIONS 1
        +
        3598 #endif
        +
        3599 
        +
        3600 // Define this macro to 1 to make the library use STL containers instead of its own implementation.
        +
        3601 //#define VMA_USE_STL_CONTAINERS 1
        +
        3602 
        +
        3603 /* Set this macro to 1 to make the library including and using STL containers:
        +
        3604 std::pair, std::vector, std::list, std::unordered_map.
        +
        3605 
        +
        3606 Set it to 0 or undefined to make the library using its own implementation of
        +
        3607 the containers.
        +
        3608 */
        +
        3609 #if VMA_USE_STL_CONTAINERS
        +
        3610  #define VMA_USE_STL_VECTOR 1
        +
        3611  #define VMA_USE_STL_UNORDERED_MAP 1
        +
        3612  #define VMA_USE_STL_LIST 1
        +
        3613 #endif
        +
        3614 
        +
        3615 #ifndef VMA_USE_STL_SHARED_MUTEX
        +
        3616  // Compiler conforms to C++17.
        +
        3617  #if __cplusplus >= 201703L
        +
        3618  #define VMA_USE_STL_SHARED_MUTEX 1
        +
        3619  // Visual studio defines __cplusplus properly only when passed additional parameter: /Zc:__cplusplus
        +
        3620  // Otherwise it's always 199711L, despite shared_mutex works since Visual Studio 2015 Update 2.
        +
        3621  // See: https://blogs.msdn.microsoft.com/vcblog/2018/04/09/msvc-now-correctly-reports-__cplusplus/
        +
        3622  #elif defined(_MSC_FULL_VER) && _MSC_FULL_VER >= 190023918 && __cplusplus == 199711L && _MSVC_LANG >= 201703L
        +
        3623  #define VMA_USE_STL_SHARED_MUTEX 1
        +
        3624  #else
        +
        3625  #define VMA_USE_STL_SHARED_MUTEX 0
        +
        3626  #endif
        +
        3627 #endif
        +
        3628 
        +
        3629 /*
        +
        3630 THESE INCLUDES ARE NOT ENABLED BY DEFAULT.
        +
        3631 Library has its own container implementation.
        +
        3632 */
        +
        3633 #if VMA_USE_STL_VECTOR
        +
        3634  #include <vector>
        +
        3635 #endif
        +
        3636 
        +
        3637 #if VMA_USE_STL_UNORDERED_MAP
        +
        3638  #include <unordered_map>
        +
        3639 #endif
        +
        3640 
        +
        3641 #if VMA_USE_STL_LIST
        +
        3642  #include <list>
        +
        3643 #endif
        +
        3644 
        +
        3645 /*
        +
        3646 Following headers are used in this CONFIGURATION section only, so feel free to
        +
        3647 remove them if not needed.
        +
        3648 */
        +
        3649 #include <cassert> // for assert
        +
        3650 #include <algorithm> // for min, max
        +
        3651 #include <mutex>
        3652 
        -
        3653 // Define this macro to 1 to enable functions: vmaBuildStatsString, vmaFreeStatsString.
        -
        3654 #if VMA_STATS_STRING_ENABLED
        -
        3655  static inline void VmaUint32ToStr(char* outStr, size_t strLen, uint32_t num)
        -
        3656  {
        -
        3657  snprintf(outStr, strLen, "%u", static_cast<unsigned int>(num));
        -
        3658  }
        -
        3659  static inline void VmaUint64ToStr(char* outStr, size_t strLen, uint64_t num)
        -
        3660  {
        -
        3661  snprintf(outStr, strLen, "%llu", static_cast<unsigned long long>(num));
        -
        3662  }
        -
        3663  static inline void VmaPtrToStr(char* outStr, size_t strLen, const void* ptr)
        +
        3653 #ifndef VMA_NULL
        +
        3654  // Value used as null pointer. Define it to e.g.: nullptr, NULL, 0, (void*)0.
        +
        3655  #define VMA_NULL nullptr
        +
        3656 #endif
        +
        3657 
        +
        3658 #if defined(__ANDROID_API__) && (__ANDROID_API__ < 16)
        +
        3659 #include <cstdlib>
        +
        3660 void *aligned_alloc(size_t alignment, size_t size)
        +
        3661 {
        +
        3662  // alignment must be >= sizeof(void*)
        +
        3663  if(alignment < sizeof(void*))
        3664  {
        -
        3665  snprintf(outStr, strLen, "%p", ptr);
        +
        3665  alignment = sizeof(void*);
        3666  }
        -
        3667 #endif
        -
        3668 
        -
        3669 #ifndef VMA_MUTEX
        -
        3670  class VmaMutex
        -
        3671  {
        -
        3672  public:
        -
        3673  void Lock() { m_Mutex.lock(); }
        -
        3674  void Unlock() { m_Mutex.unlock(); }
        -
        3675  private:
        -
        3676  std::mutex m_Mutex;
        -
        3677  };
        -
        3678  #define VMA_MUTEX VmaMutex
        -
        3679 #endif
        -
        3680 
        -
        3681 // Read-write mutex, where "read" is shared access, "write" is exclusive access.
        -
        3682 #ifndef VMA_RW_MUTEX
        -
        3683  #if VMA_USE_STL_SHARED_MUTEX
        -
        3684  // Use std::shared_mutex from C++17.
        -
        3685  #include <shared_mutex>
        -
        3686  class VmaRWMutex
        -
        3687  {
        -
        3688  public:
        -
        3689  void LockRead() { m_Mutex.lock_shared(); }
        -
        3690  void UnlockRead() { m_Mutex.unlock_shared(); }
        -
        3691  void LockWrite() { m_Mutex.lock(); }
        -
        3692  void UnlockWrite() { m_Mutex.unlock(); }
        -
        3693  private:
        -
        3694  std::shared_mutex m_Mutex;
        -
        3695  };
        -
        3696  #define VMA_RW_MUTEX VmaRWMutex
        -
        3697  #elif defined(_WIN32) && defined(WINVER) && WINVER >= 0x0600
        -
        3698  // Use SRWLOCK from WinAPI.
        -
        3699  // Minimum supported client = Windows Vista, server = Windows Server 2008.
        -
        3700  class VmaRWMutex
        -
        3701  {
        -
        3702  public:
        -
        3703  VmaRWMutex() { InitializeSRWLock(&m_Lock); }
        -
        3704  void LockRead() { AcquireSRWLockShared(&m_Lock); }
        -
        3705  void UnlockRead() { ReleaseSRWLockShared(&m_Lock); }
        -
        3706  void LockWrite() { AcquireSRWLockExclusive(&m_Lock); }
        -
        3707  void UnlockWrite() { ReleaseSRWLockExclusive(&m_Lock); }
        -
        3708  private:
        -
        3709  SRWLOCK m_Lock;
        -
        3710  };
        -
        3711  #define VMA_RW_MUTEX VmaRWMutex
        -
        3712  #else
        -
        3713  // Less efficient fallback: Use normal mutex.
        -
        3714  class VmaRWMutex
        -
        3715  {
        -
        3716  public:
        -
        3717  void LockRead() { m_Mutex.Lock(); }
        -
        3718  void UnlockRead() { m_Mutex.Unlock(); }
        -
        3719  void LockWrite() { m_Mutex.Lock(); }
        -
        3720  void UnlockWrite() { m_Mutex.Unlock(); }
        -
        3721  private:
        -
        3722  VMA_MUTEX m_Mutex;
        -
        3723  };
        -
        3724  #define VMA_RW_MUTEX VmaRWMutex
        -
        3725  #endif // #if VMA_USE_STL_SHARED_MUTEX
        -
        3726 #endif // #ifndef VMA_RW_MUTEX
        -
        3727 
        -
        3728 /*
        -
        3729 If providing your own implementation, you need to implement a subset of std::atomic.
        -
        3730 */
        -
        3731 #ifndef VMA_ATOMIC_UINT32
        -
        3732  #include <atomic>
        -
        3733  #define VMA_ATOMIC_UINT32 std::atomic<uint32_t>
        -
        3734 #endif
        -
        3735 
        -
        3736 #ifndef VMA_ATOMIC_UINT64
        -
        3737  #include <atomic>
        -
        3738  #define VMA_ATOMIC_UINT64 std::atomic<uint64_t>
        -
        3739 #endif
        -
        3740 
        -
        3741 #ifndef VMA_DEBUG_ALWAYS_DEDICATED_MEMORY
        +
        3667 
        +
        3668  return memalign(alignment, size);
        +
        3669 }
        +
        3670 #elif defined(__APPLE__) || defined(__ANDROID__) || (defined(__linux__) && defined(__GLIBCXX__) && !defined(_GLIBCXX_HAVE_ALIGNED_ALLOC))
        +
        3671 #include <cstdlib>
        +
        3672 void *aligned_alloc(size_t alignment, size_t size)
        +
        3673 {
        +
        3674  // alignment must be >= sizeof(void*)
        +
        3675  if(alignment < sizeof(void*))
        +
        3676  {
        +
        3677  alignment = sizeof(void*);
        +
        3678  }
        +
        3679 
        +
        3680  void *pointer;
        +
        3681  if(posix_memalign(&pointer, alignment, size) == 0)
        +
        3682  return pointer;
        +
        3683  return VMA_NULL;
        +
        3684 }
        +
        3685 #endif
        +
        3686 
        +
        3687 // If your compiler is not compatible with C++11 and definition of
        +
        3688 // aligned_alloc() function is missing, uncommeting following line may help:
        +
        3689 
        +
        3690 //#include <malloc.h>
        +
        3691 
        +
        3692 // Normal assert to check for programmer's errors, especially in Debug configuration.
        +
        3693 #ifndef VMA_ASSERT
        +
        3694  #ifdef NDEBUG
        +
        3695  #define VMA_ASSERT(expr)
        +
        3696  #else
        +
        3697  #define VMA_ASSERT(expr) assert(expr)
        +
        3698  #endif
        +
        3699 #endif
        +
        3700 
        +
        3701 // Assert that will be called very often, like inside data structures e.g. operator[].
        +
        3702 // Making it non-empty can make program slow.
        +
        3703 #ifndef VMA_HEAVY_ASSERT
        +
        3704  #ifdef NDEBUG
        +
        3705  #define VMA_HEAVY_ASSERT(expr)
        +
        3706  #else
        +
        3707  #define VMA_HEAVY_ASSERT(expr) //VMA_ASSERT(expr)
        +
        3708  #endif
        +
        3709 #endif
        +
        3710 
        +
        3711 #ifndef VMA_ALIGN_OF
        +
        3712  #define VMA_ALIGN_OF(type) (__alignof(type))
        +
        3713 #endif
        +
        3714 
        +
        3715 #ifndef VMA_SYSTEM_ALIGNED_MALLOC
        +
        3716  #if defined(_WIN32)
        +
        3717  #define VMA_SYSTEM_ALIGNED_MALLOC(size, alignment) (_aligned_malloc((size), (alignment)))
        +
        3718  #else
        +
        3719  #define VMA_SYSTEM_ALIGNED_MALLOC(size, alignment) (aligned_alloc((alignment), (size) ))
        +
        3720  #endif
        +
        3721 #endif
        +
        3722 
        +
        3723 #ifndef VMA_SYSTEM_FREE
        +
        3724  #if defined(_WIN32)
        +
        3725  #define VMA_SYSTEM_FREE(ptr) _aligned_free(ptr)
        +
        3726  #else
        +
        3727  #define VMA_SYSTEM_FREE(ptr) free(ptr)
        +
        3728  #endif
        +
        3729 #endif
        +
        3730 
        +
        3731 #ifndef VMA_MIN
        +
        3732  #define VMA_MIN(v1, v2) (std::min((v1), (v2)))
        +
        3733 #endif
        +
        3734 
        +
        3735 #ifndef VMA_MAX
        +
        3736  #define VMA_MAX(v1, v2) (std::max((v1), (v2)))
        +
        3737 #endif
        +
        3738 
        +
        3739 #ifndef VMA_SWAP
        +
        3740  #define VMA_SWAP(v1, v2) std::swap((v1), (v2))
        +
        3741 #endif
        3742 
        -
        3746  #define VMA_DEBUG_ALWAYS_DEDICATED_MEMORY (0)
        -
        3747 #endif
        -
        3748 
        -
        3749 #ifndef VMA_DEBUG_ALIGNMENT
        -
        3750 
        -
        3754  #define VMA_DEBUG_ALIGNMENT (1)
        +
        3743 #ifndef VMA_SORT
        +
        3744  #define VMA_SORT(beg, end, cmp) std::sort(beg, end, cmp)
        +
        3745 #endif
        +
        3746 
        +
        3747 #ifndef VMA_DEBUG_LOG
        +
        3748  #define VMA_DEBUG_LOG(format, ...)
        +
        3749  /*
        +
        3750  #define VMA_DEBUG_LOG(format, ...) do { \
        +
        3751  printf(format, __VA_ARGS__); \
        +
        3752  printf("\n"); \
        +
        3753  } while(false)
        +
        3754  */
        3755 #endif
        3756 
        -
        3757 #ifndef VMA_DEBUG_MARGIN
        -
        3758 
        -
        3762  #define VMA_DEBUG_MARGIN (0)
        -
        3763 #endif
        -
        3764 
        -
        3765 #ifndef VMA_DEBUG_INITIALIZE_ALLOCATIONS
        -
        3766 
        -
        3770  #define VMA_DEBUG_INITIALIZE_ALLOCATIONS (0)
        +
        3757 // Define this macro to 1 to enable functions: vmaBuildStatsString, vmaFreeStatsString.
        +
        3758 #if VMA_STATS_STRING_ENABLED
        +
        3759  static inline void VmaUint32ToStr(char* outStr, size_t strLen, uint32_t num)
        +
        3760  {
        +
        3761  snprintf(outStr, strLen, "%u", static_cast<unsigned int>(num));
        +
        3762  }
        +
        3763  static inline void VmaUint64ToStr(char* outStr, size_t strLen, uint64_t num)
        +
        3764  {
        +
        3765  snprintf(outStr, strLen, "%llu", static_cast<unsigned long long>(num));
        +
        3766  }
        +
        3767  static inline void VmaPtrToStr(char* outStr, size_t strLen, const void* ptr)
        +
        3768  {
        +
        3769  snprintf(outStr, strLen, "%p", ptr);
        +
        3770  }
        3771 #endif
        3772 
        -
        3773 #ifndef VMA_DEBUG_DETECT_CORRUPTION
        -
        3774 
        -
        3779  #define VMA_DEBUG_DETECT_CORRUPTION (0)
        -
        3780 #endif
        -
        3781 
        -
        3782 #ifndef VMA_DEBUG_GLOBAL_MUTEX
        -
        3783 
        -
        3787  #define VMA_DEBUG_GLOBAL_MUTEX (0)
        -
        3788 #endif
        -
        3789 
        -
        3790 #ifndef VMA_DEBUG_MIN_BUFFER_IMAGE_GRANULARITY
        -
        3791 
        -
        3795  #define VMA_DEBUG_MIN_BUFFER_IMAGE_GRANULARITY (1)
        -
        3796 #endif
        -
        3797 
        -
        3798 #ifndef VMA_SMALL_HEAP_MAX_SIZE
        -
        3799  #define VMA_SMALL_HEAP_MAX_SIZE (1024ull * 1024 * 1024)
        -
        3801 #endif
        -
        3802 
        -
        3803 #ifndef VMA_DEFAULT_LARGE_HEAP_BLOCK_SIZE
        -
        3804  #define VMA_DEFAULT_LARGE_HEAP_BLOCK_SIZE (256ull * 1024 * 1024)
        -
        3806 #endif
        -
        3807 
        -
        3808 #ifndef VMA_CLASS_NO_COPY
        -
        3809  #define VMA_CLASS_NO_COPY(className) \
        -
        3810  private: \
        -
        3811  className(const className&) = delete; \
        -
        3812  className& operator=(const className&) = delete;
        -
        3813 #endif
        -
        3814 
        -
        3815 static const uint32_t VMA_FRAME_INDEX_LOST = UINT32_MAX;
        -
        3816 
        -
        3817 // Decimal 2139416166, float NaN, little-endian binary 66 E6 84 7F.
        -
        3818 static const uint32_t VMA_CORRUPTION_DETECTION_MAGIC_VALUE = 0x7F84E666;
        -
        3819 
        -
        3820 static const uint8_t VMA_ALLOCATION_FILL_PATTERN_CREATED = 0xDC;
        -
        3821 static const uint8_t VMA_ALLOCATION_FILL_PATTERN_DESTROYED = 0xEF;
        -
        3822 
        -
        3823 /*******************************************************************************
        -
        3824 END OF CONFIGURATION
        -
        3825 */
        -
        3826 
        -
        3827 static const uint32_t VMA_ALLOCATION_INTERNAL_STRATEGY_MIN_OFFSET = 0x10000000u;
        -
        3828 
        -
        3829 static VkAllocationCallbacks VmaEmptyAllocationCallbacks = {
        -
        3830  VMA_NULL, VMA_NULL, VMA_NULL, VMA_NULL, VMA_NULL, VMA_NULL };
        -
        3831 
        -
        3832 // Returns number of bits set to 1 in (v).
        -
        3833 static inline uint32_t VmaCountBitsSet(uint32_t v)
        -
        3834 {
        -
        3835  uint32_t c = v - ((v >> 1) & 0x55555555);
        -
        3836  c = ((c >> 2) & 0x33333333) + (c & 0x33333333);
        -
        3837  c = ((c >> 4) + c) & 0x0F0F0F0F;
        -
        3838  c = ((c >> 8) + c) & 0x00FF00FF;
        -
        3839  c = ((c >> 16) + c) & 0x0000FFFF;
        -
        3840  return c;
        -
        3841 }
        -
        3842 
        -
        3843 // Aligns given value up to nearest multiply of align value. For example: VmaAlignUp(11, 8) = 16.
        -
        3844 // Use types like uint32_t, uint64_t as T.
        -
        3845 template <typename T>
        -
        3846 static inline T VmaAlignUp(T val, T align)
        -
        3847 {
        -
        3848  return (val + align - 1) / align * align;
        -
        3849 }
        -
        3850 // Aligns given value down to nearest multiply of align value. For example: VmaAlignUp(11, 8) = 8.
        -
        3851 // Use types like uint32_t, uint64_t as T.
        -
        3852 template <typename T>
        -
        3853 static inline T VmaAlignDown(T val, T align)
        -
        3854 {
        -
        3855  return val / align * align;
        -
        3856 }
        -
        3857 
        -
        3858 // Division with mathematical rounding to nearest number.
        -
        3859 template <typename T>
        -
        3860 static inline T VmaRoundDiv(T x, T y)
        -
        3861 {
        -
        3862  return (x + (y / (T)2)) / y;
        -
        3863 }
        -
        3864 
        -
        3865 /*
        -
        3866 Returns true if given number is a power of two.
        -
        3867 T must be unsigned integer number or signed integer but always nonnegative.
        -
        3868 For 0 returns true.
        -
        3869 */
        -
        3870 template <typename T>
        -
        3871 inline bool VmaIsPow2(T x)
        -
        3872 {
        -
        3873  return (x & (x-1)) == 0;
        -
        3874 }
        +
        3773 #ifndef VMA_MUTEX
        +
        3774  class VmaMutex
        +
        3775  {
        +
        3776  public:
        +
        3777  void Lock() { m_Mutex.lock(); }
        +
        3778  void Unlock() { m_Mutex.unlock(); }
        +
        3779  bool TryLock() { return m_Mutex.try_lock(); }
        +
        3780  private:
        +
        3781  std::mutex m_Mutex;
        +
        3782  };
        +
        3783  #define VMA_MUTEX VmaMutex
        +
        3784 #endif
        +
        3785 
        +
        3786 // Read-write mutex, where "read" is shared access, "write" is exclusive access.
        +
        3787 #ifndef VMA_RW_MUTEX
        +
        3788  #if VMA_USE_STL_SHARED_MUTEX
        +
        3789  // Use std::shared_mutex from C++17.
        +
        3790  #include <shared_mutex>
        +
        3791  class VmaRWMutex
        +
        3792  {
        +
        3793  public:
        +
        3794  void LockRead() { m_Mutex.lock_shared(); }
        +
        3795  void UnlockRead() { m_Mutex.unlock_shared(); }
        +
        3796  bool TryLockRead() { return m_Mutex.try_lock_shared(); }
        +
        3797  void LockWrite() { m_Mutex.lock(); }
        +
        3798  void UnlockWrite() { m_Mutex.unlock(); }
        +
        3799  bool TryLockWrite() { return m_Mutex.try_lock(); }
        +
        3800  private:
        +
        3801  std::shared_mutex m_Mutex;
        +
        3802  };
        +
        3803  #define VMA_RW_MUTEX VmaRWMutex
        +
        3804  #elif defined(_WIN32) && defined(WINVER) && WINVER >= 0x0600
        +
        3805  // Use SRWLOCK from WinAPI.
        +
        3806  // Minimum supported client = Windows Vista, server = Windows Server 2008.
        +
        3807  class VmaRWMutex
        +
        3808  {
        +
        3809  public:
        +
        3810  VmaRWMutex() { InitializeSRWLock(&m_Lock); }
        +
        3811  void LockRead() { AcquireSRWLockShared(&m_Lock); }
        +
        3812  void UnlockRead() { ReleaseSRWLockShared(&m_Lock); }
        +
        3813  bool TryLockRead() { return TryAcquireSRWLockShared(&m_Lock) != FALSE; }
        +
        3814  void LockWrite() { AcquireSRWLockExclusive(&m_Lock); }
        +
        3815  void UnlockWrite() { ReleaseSRWLockExclusive(&m_Lock); }
        +
        3816  bool TryLockWrite() { return TryAcquireSRWLockExclusive(&m_Lock) != FALSE; }
        +
        3817  private:
        +
        3818  SRWLOCK m_Lock;
        +
        3819  };
        +
        3820  #define VMA_RW_MUTEX VmaRWMutex
        +
        3821  #else
        +
        3822  // Less efficient fallback: Use normal mutex.
        +
        3823  class VmaRWMutex
        +
        3824  {
        +
        3825  public:
        +
        3826  void LockRead() { m_Mutex.Lock(); }
        +
        3827  void UnlockRead() { m_Mutex.Unlock(); }
        +
        3828  bool TryLockRead() { return m_Mutex.TryLock(); }
        +
        3829  void LockWrite() { m_Mutex.Lock(); }
        +
        3830  void UnlockWrite() { m_Mutex.Unlock(); }
        +
        3831  bool TryLockWrite() { return m_Mutex.TryLock(); }
        +
        3832  private:
        +
        3833  VMA_MUTEX m_Mutex;
        +
        3834  };
        +
        3835  #define VMA_RW_MUTEX VmaRWMutex
        +
        3836  #endif // #if VMA_USE_STL_SHARED_MUTEX
        +
        3837 #endif // #ifndef VMA_RW_MUTEX
        +
        3838 
        +
        3839 /*
        +
        3840 If providing your own implementation, you need to implement a subset of std::atomic.
        +
        3841 */
        +
        3842 #ifndef VMA_ATOMIC_UINT32
        +
        3843  #include <atomic>
        +
        3844  #define VMA_ATOMIC_UINT32 std::atomic<uint32_t>
        +
        3845 #endif
        +
        3846 
        +
        3847 #ifndef VMA_ATOMIC_UINT64
        +
        3848  #include <atomic>
        +
        3849  #define VMA_ATOMIC_UINT64 std::atomic<uint64_t>
        +
        3850 #endif
        +
        3851 
        +
        3852 #ifndef VMA_DEBUG_ALWAYS_DEDICATED_MEMORY
        +
        3853 
        +
        3857  #define VMA_DEBUG_ALWAYS_DEDICATED_MEMORY (0)
        +
        3858 #endif
        +
        3859 
        +
        3860 #ifndef VMA_DEBUG_ALIGNMENT
        +
        3861 
        +
        3865  #define VMA_DEBUG_ALIGNMENT (1)
        +
        3866 #endif
        +
        3867 
        +
        3868 #ifndef VMA_DEBUG_MARGIN
        +
        3869 
        +
        3873  #define VMA_DEBUG_MARGIN (0)
        +
        3874 #endif
        3875 
        -
        3876 // Returns smallest power of 2 greater or equal to v.
        -
        3877 static inline uint32_t VmaNextPow2(uint32_t v)
        -
        3878 {
        -
        3879  v--;
        -
        3880  v |= v >> 1;
        -
        3881  v |= v >> 2;
        -
        3882  v |= v >> 4;
        -
        3883  v |= v >> 8;
        -
        3884  v |= v >> 16;
        -
        3885  v++;
        -
        3886  return v;
        -
        3887 }
        -
        3888 static inline uint64_t VmaNextPow2(uint64_t v)
        -
        3889 {
        -
        3890  v--;
        -
        3891  v |= v >> 1;
        -
        3892  v |= v >> 2;
        -
        3893  v |= v >> 4;
        -
        3894  v |= v >> 8;
        -
        3895  v |= v >> 16;
        -
        3896  v |= v >> 32;
        -
        3897  v++;
        -
        3898  return v;
        -
        3899 }
        +
        3876 #ifndef VMA_DEBUG_INITIALIZE_ALLOCATIONS
        +
        3877 
        +
        3881  #define VMA_DEBUG_INITIALIZE_ALLOCATIONS (0)
        +
        3882 #endif
        +
        3883 
        +
        3884 #ifndef VMA_DEBUG_DETECT_CORRUPTION
        +
        3885 
        +
        3890  #define VMA_DEBUG_DETECT_CORRUPTION (0)
        +
        3891 #endif
        +
        3892 
        +
        3893 #ifndef VMA_DEBUG_GLOBAL_MUTEX
        +
        3894 
        +
        3898  #define VMA_DEBUG_GLOBAL_MUTEX (0)
        +
        3899 #endif
        3900 
        -
        3901 // Returns largest power of 2 less or equal to v.
        -
        3902 static inline uint32_t VmaPrevPow2(uint32_t v)
        -
        3903 {
        -
        3904  v |= v >> 1;
        -
        3905  v |= v >> 2;
        -
        3906  v |= v >> 4;
        -
        3907  v |= v >> 8;
        -
        3908  v |= v >> 16;
        -
        3909  v = v ^ (v >> 1);
        -
        3910  return v;
        -
        3911 }
        -
        3912 static inline uint64_t VmaPrevPow2(uint64_t v)
        -
        3913 {
        -
        3914  v |= v >> 1;
        -
        3915  v |= v >> 2;
        -
        3916  v |= v >> 4;
        -
        3917  v |= v >> 8;
        -
        3918  v |= v >> 16;
        -
        3919  v |= v >> 32;
        -
        3920  v = v ^ (v >> 1);
        -
        3921  return v;
        -
        3922 }
        -
        3923 
        -
        3924 static inline bool VmaStrIsEmpty(const char* pStr)
        -
        3925 {
        -
        3926  return pStr == VMA_NULL || *pStr == '\0';
        -
        3927 }
        -
        3928 
        -
        3929 #if VMA_STATS_STRING_ENABLED
        +
        3901 #ifndef VMA_DEBUG_MIN_BUFFER_IMAGE_GRANULARITY
        +
        3902 
        +
        3906  #define VMA_DEBUG_MIN_BUFFER_IMAGE_GRANULARITY (1)
        +
        3907 #endif
        +
        3908 
        +
        3909 #ifndef VMA_SMALL_HEAP_MAX_SIZE
        +
        3910  #define VMA_SMALL_HEAP_MAX_SIZE (1024ull * 1024 * 1024)
        +
        3912 #endif
        +
        3913 
        +
        3914 #ifndef VMA_DEFAULT_LARGE_HEAP_BLOCK_SIZE
        +
        3915  #define VMA_DEFAULT_LARGE_HEAP_BLOCK_SIZE (256ull * 1024 * 1024)
        +
        3917 #endif
        +
        3918 
        +
        3919 #ifndef VMA_CLASS_NO_COPY
        +
        3920  #define VMA_CLASS_NO_COPY(className) \
        +
        3921  private: \
        +
        3922  className(const className&) = delete; \
        +
        3923  className& operator=(const className&) = delete;
        +
        3924 #endif
        +
        3925 
        +
        3926 static const uint32_t VMA_FRAME_INDEX_LOST = UINT32_MAX;
        +
        3927 
        +
        3928 // Decimal 2139416166, float NaN, little-endian binary 66 E6 84 7F.
        +
        3929 static const uint32_t VMA_CORRUPTION_DETECTION_MAGIC_VALUE = 0x7F84E666;
        3930 
        -
        3931 static const char* VmaAlgorithmToStr(uint32_t algorithm)
        -
        3932 {
        -
        3933  switch(algorithm)
        -
        3934  {
        -
        3935  case VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT:
        -
        3936  return "Linear";
        -
        3937  case VMA_POOL_CREATE_BUDDY_ALGORITHM_BIT:
        -
        3938  return "Buddy";
        -
        3939  case 0:
        -
        3940  return "Default";
        -
        3941  default:
        -
        3942  VMA_ASSERT(0);
        -
        3943  return "";
        -
        3944  }
        -
        3945 }
        -
        3946 
        -
        3947 #endif // #if VMA_STATS_STRING_ENABLED
        +
        3931 static const uint8_t VMA_ALLOCATION_FILL_PATTERN_CREATED = 0xDC;
        +
        3932 static const uint8_t VMA_ALLOCATION_FILL_PATTERN_DESTROYED = 0xEF;
        +
        3933 
        +
        3934 /*******************************************************************************
        +
        3935 END OF CONFIGURATION
        +
        3936 */
        +
        3937 
        +
        3938 // # Copy of some Vulkan definitions so we don't need to check their existence just to handle few constants.
        +
        3939 
        +
        3940 static const uint32_t VK_MEMORY_PROPERTY_DEVICE_COHERENT_BIT_AMD_COPY = 0x00000040;
        +
        3941 static const uint32_t VK_MEMORY_PROPERTY_DEVICE_UNCACHED_BIT_AMD_COPY = 0x00000080;
        +
        3942 
        +
        3943 
        +
        3944 static const uint32_t VMA_ALLOCATION_INTERNAL_STRATEGY_MIN_OFFSET = 0x10000000u;
        +
        3945 
        +
        3946 static VkAllocationCallbacks VmaEmptyAllocationCallbacks = {
        +
        3947  VMA_NULL, VMA_NULL, VMA_NULL, VMA_NULL, VMA_NULL, VMA_NULL };
        3948 
        -
        3949 #ifndef VMA_SORT
        -
        3950 
        -
        3951 template<typename Iterator, typename Compare>
        -
        3952 Iterator VmaQuickSortPartition(Iterator beg, Iterator end, Compare cmp)
        -
        3953 {
        -
        3954  Iterator centerValue = end; --centerValue;
        -
        3955  Iterator insertIndex = beg;
        -
        3956  for(Iterator memTypeIndex = beg; memTypeIndex < centerValue; ++memTypeIndex)
        -
        3957  {
        -
        3958  if(cmp(*memTypeIndex, *centerValue))
        -
        3959  {
        -
        3960  if(insertIndex != memTypeIndex)
        -
        3961  {
        -
        3962  VMA_SWAP(*memTypeIndex, *insertIndex);
        -
        3963  }
        -
        3964  ++insertIndex;
        -
        3965  }
        -
        3966  }
        -
        3967  if(insertIndex != centerValue)
        -
        3968  {
        -
        3969  VMA_SWAP(*insertIndex, *centerValue);
        -
        3970  }
        -
        3971  return insertIndex;
        -
        3972 }
        -
        3973 
        -
        3974 template<typename Iterator, typename Compare>
        -
        3975 void VmaQuickSort(Iterator beg, Iterator end, Compare cmp)
        -
        3976 {
        -
        3977  if(beg < end)
        -
        3978  {
        -
        3979  Iterator it = VmaQuickSortPartition<Iterator, Compare>(beg, end, cmp);
        -
        3980  VmaQuickSort<Iterator, Compare>(beg, it, cmp);
        -
        3981  VmaQuickSort<Iterator, Compare>(it + 1, end, cmp);
        -
        3982  }
        -
        3983 }
        -
        3984 
        -
        3985 #define VMA_SORT(beg, end, cmp) VmaQuickSort(beg, end, cmp)
        -
        3986 
        -
        3987 #endif // #ifndef VMA_SORT
        -
        3988 
        -
        3989 /*
        -
        3990 Returns true if two memory blocks occupy overlapping pages.
        -
        3991 ResourceA must be in less memory offset than ResourceB.
        -
        3992 
        -
        3993 Algorithm is based on "Vulkan 1.0.39 - A Specification (with all registered Vulkan extensions)"
        -
        3994 chapter 11.6 "Resource Memory Association", paragraph "Buffer-Image Granularity".
        -
        3995 */
        -
        3996 static inline bool VmaBlocksOnSamePage(
        -
        3997  VkDeviceSize resourceAOffset,
        -
        3998  VkDeviceSize resourceASize,
        -
        3999  VkDeviceSize resourceBOffset,
        -
        4000  VkDeviceSize pageSize)
        -
        4001 {
        -
        4002  VMA_ASSERT(resourceAOffset + resourceASize <= resourceBOffset && resourceASize > 0 && pageSize > 0);
        -
        4003  VkDeviceSize resourceAEnd = resourceAOffset + resourceASize - 1;
        -
        4004  VkDeviceSize resourceAEndPage = resourceAEnd & ~(pageSize - 1);
        -
        4005  VkDeviceSize resourceBStart = resourceBOffset;
        -
        4006  VkDeviceSize resourceBStartPage = resourceBStart & ~(pageSize - 1);
        -
        4007  return resourceAEndPage == resourceBStartPage;
        -
        4008 }
        -
        4009 
        -
        4010 enum VmaSuballocationType
        -
        4011 {
        -
        4012  VMA_SUBALLOCATION_TYPE_FREE = 0,
        -
        4013  VMA_SUBALLOCATION_TYPE_UNKNOWN = 1,
        -
        4014  VMA_SUBALLOCATION_TYPE_BUFFER = 2,
        -
        4015  VMA_SUBALLOCATION_TYPE_IMAGE_UNKNOWN = 3,
        -
        4016  VMA_SUBALLOCATION_TYPE_IMAGE_LINEAR = 4,
        -
        4017  VMA_SUBALLOCATION_TYPE_IMAGE_OPTIMAL = 5,
        -
        4018  VMA_SUBALLOCATION_TYPE_MAX_ENUM = 0x7FFFFFFF
        -
        4019 };
        -
        4020 
        -
        4021 /*
        -
        4022 Returns true if given suballocation types could conflict and must respect
        -
        4023 VkPhysicalDeviceLimits::bufferImageGranularity. They conflict if one is buffer
        -
        4024 or linear image and another one is optimal image. If type is unknown, behave
        -
        4025 conservatively.
        -
        4026 */
        -
        4027 static inline bool VmaIsBufferImageGranularityConflict(
        -
        4028  VmaSuballocationType suballocType1,
        -
        4029  VmaSuballocationType suballocType2)
        +
        3949 // Returns number of bits set to 1 in (v).
        +
        3950 static inline uint32_t VmaCountBitsSet(uint32_t v)
        +
        3951 {
        +
        3952  uint32_t c = v - ((v >> 1) & 0x55555555);
        +
        3953  c = ((c >> 2) & 0x33333333) + (c & 0x33333333);
        +
        3954  c = ((c >> 4) + c) & 0x0F0F0F0F;
        +
        3955  c = ((c >> 8) + c) & 0x00FF00FF;
        +
        3956  c = ((c >> 16) + c) & 0x0000FFFF;
        +
        3957  return c;
        +
        3958 }
        +
        3959 
        +
        3960 // Aligns given value up to nearest multiply of align value. For example: VmaAlignUp(11, 8) = 16.
        +
        3961 // Use types like uint32_t, uint64_t as T.
        +
        3962 template <typename T>
        +
        3963 static inline T VmaAlignUp(T val, T align)
        +
        3964 {
        +
        3965  return (val + align - 1) / align * align;
        +
        3966 }
        +
        3967 // Aligns given value down to nearest multiply of align value. For example: VmaAlignUp(11, 8) = 8.
        +
        3968 // Use types like uint32_t, uint64_t as T.
        +
        3969 template <typename T>
        +
        3970 static inline T VmaAlignDown(T val, T align)
        +
        3971 {
        +
        3972  return val / align * align;
        +
        3973 }
        +
        3974 
        +
        3975 // Division with mathematical rounding to nearest number.
        +
        3976 template <typename T>
        +
        3977 static inline T VmaRoundDiv(T x, T y)
        +
        3978 {
        +
        3979  return (x + (y / (T)2)) / y;
        +
        3980 }
        +
        3981 
        +
        3982 /*
        +
        3983 Returns true if given number is a power of two.
        +
        3984 T must be unsigned integer number or signed integer but always nonnegative.
        +
        3985 For 0 returns true.
        +
        3986 */
        +
        3987 template <typename T>
        +
        3988 inline bool VmaIsPow2(T x)
        +
        3989 {
        +
        3990  return (x & (x-1)) == 0;
        +
        3991 }
        +
        3992 
        +
        3993 // Returns smallest power of 2 greater or equal to v.
        +
        3994 static inline uint32_t VmaNextPow2(uint32_t v)
        +
        3995 {
        +
        3996  v--;
        +
        3997  v |= v >> 1;
        +
        3998  v |= v >> 2;
        +
        3999  v |= v >> 4;
        +
        4000  v |= v >> 8;
        +
        4001  v |= v >> 16;
        +
        4002  v++;
        +
        4003  return v;
        +
        4004 }
        +
        4005 static inline uint64_t VmaNextPow2(uint64_t v)
        +
        4006 {
        +
        4007  v--;
        +
        4008  v |= v >> 1;
        +
        4009  v |= v >> 2;
        +
        4010  v |= v >> 4;
        +
        4011  v |= v >> 8;
        +
        4012  v |= v >> 16;
        +
        4013  v |= v >> 32;
        +
        4014  v++;
        +
        4015  return v;
        +
        4016 }
        +
        4017 
        +
        4018 // Returns largest power of 2 less or equal to v.
        +
        4019 static inline uint32_t VmaPrevPow2(uint32_t v)
        +
        4020 {
        +
        4021  v |= v >> 1;
        +
        4022  v |= v >> 2;
        +
        4023  v |= v >> 4;
        +
        4024  v |= v >> 8;
        +
        4025  v |= v >> 16;
        +
        4026  v = v ^ (v >> 1);
        +
        4027  return v;
        +
        4028 }
        +
        4029 static inline uint64_t VmaPrevPow2(uint64_t v)
        4030 {
        -
        4031  if(suballocType1 > suballocType2)
        -
        4032  {
        -
        4033  VMA_SWAP(suballocType1, suballocType2);
        -
        4034  }
        -
        4035 
        -
        4036  switch(suballocType1)
        -
        4037  {
        -
        4038  case VMA_SUBALLOCATION_TYPE_FREE:
        -
        4039  return false;
        -
        4040  case VMA_SUBALLOCATION_TYPE_UNKNOWN:
        -
        4041  return true;
        -
        4042  case VMA_SUBALLOCATION_TYPE_BUFFER:
        -
        4043  return
        -
        4044  suballocType2 == VMA_SUBALLOCATION_TYPE_IMAGE_UNKNOWN ||
        -
        4045  suballocType2 == VMA_SUBALLOCATION_TYPE_IMAGE_OPTIMAL;
        -
        4046  case VMA_SUBALLOCATION_TYPE_IMAGE_UNKNOWN:
        -
        4047  return
        -
        4048  suballocType2 == VMA_SUBALLOCATION_TYPE_IMAGE_UNKNOWN ||
        -
        4049  suballocType2 == VMA_SUBALLOCATION_TYPE_IMAGE_LINEAR ||
        -
        4050  suballocType2 == VMA_SUBALLOCATION_TYPE_IMAGE_OPTIMAL;
        -
        4051  case VMA_SUBALLOCATION_TYPE_IMAGE_LINEAR:
        -
        4052  return
        -
        4053  suballocType2 == VMA_SUBALLOCATION_TYPE_IMAGE_OPTIMAL;
        -
        4054  case VMA_SUBALLOCATION_TYPE_IMAGE_OPTIMAL:
        -
        4055  return false;
        -
        4056  default:
        -
        4057  VMA_ASSERT(0);
        -
        4058  return true;
        -
        4059  }
        -
        4060 }
        -
        4061 
        -
        4062 static void VmaWriteMagicValue(void* pData, VkDeviceSize offset)
        -
        4063 {
        -
        4064 #if VMA_DEBUG_MARGIN > 0 && VMA_DEBUG_DETECT_CORRUPTION
        -
        4065  uint32_t* pDst = (uint32_t*)((char*)pData + offset);
        -
        4066  const size_t numberCount = VMA_DEBUG_MARGIN / sizeof(uint32_t);
        -
        4067  for(size_t i = 0; i < numberCount; ++i, ++pDst)
        -
        4068  {
        -
        4069  *pDst = VMA_CORRUPTION_DETECTION_MAGIC_VALUE;
        -
        4070  }
        -
        4071 #else
        -
        4072  // no-op
        -
        4073 #endif
        -
        4074 }
        -
        4075 
        -
        4076 static bool VmaValidateMagicValue(const void* pData, VkDeviceSize offset)
        -
        4077 {
        -
        4078 #if VMA_DEBUG_MARGIN > 0 && VMA_DEBUG_DETECT_CORRUPTION
        -
        4079  const uint32_t* pSrc = (const uint32_t*)((const char*)pData + offset);
        -
        4080  const size_t numberCount = VMA_DEBUG_MARGIN / sizeof(uint32_t);
        -
        4081  for(size_t i = 0; i < numberCount; ++i, ++pSrc)
        -
        4082  {
        -
        4083  if(*pSrc != VMA_CORRUPTION_DETECTION_MAGIC_VALUE)
        -
        4084  {
        -
        4085  return false;
        -
        4086  }
        +
        4031  v |= v >> 1;
        +
        4032  v |= v >> 2;
        +
        4033  v |= v >> 4;
        +
        4034  v |= v >> 8;
        +
        4035  v |= v >> 16;
        +
        4036  v |= v >> 32;
        +
        4037  v = v ^ (v >> 1);
        +
        4038  return v;
        +
        4039 }
        +
        4040 
        +
        4041 static inline bool VmaStrIsEmpty(const char* pStr)
        +
        4042 {
        +
        4043  return pStr == VMA_NULL || *pStr == '\0';
        +
        4044 }
        +
        4045 
        +
        4046 #if VMA_STATS_STRING_ENABLED
        +
        4047 
        +
        4048 static const char* VmaAlgorithmToStr(uint32_t algorithm)
        +
        4049 {
        +
        4050  switch(algorithm)
        +
        4051  {
        +
        4052  case VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT:
        +
        4053  return "Linear";
        +
        4054  case VMA_POOL_CREATE_BUDDY_ALGORITHM_BIT:
        +
        4055  return "Buddy";
        +
        4056  case 0:
        +
        4057  return "Default";
        +
        4058  default:
        +
        4059  VMA_ASSERT(0);
        +
        4060  return "";
        +
        4061  }
        +
        4062 }
        +
        4063 
        +
        4064 #endif // #if VMA_STATS_STRING_ENABLED
        +
        4065 
        +
        4066 #ifndef VMA_SORT
        +
        4067 
        +
        4068 template<typename Iterator, typename Compare>
        +
        4069 Iterator VmaQuickSortPartition(Iterator beg, Iterator end, Compare cmp)
        +
        4070 {
        +
        4071  Iterator centerValue = end; --centerValue;
        +
        4072  Iterator insertIndex = beg;
        +
        4073  for(Iterator memTypeIndex = beg; memTypeIndex < centerValue; ++memTypeIndex)
        +
        4074  {
        +
        4075  if(cmp(*memTypeIndex, *centerValue))
        +
        4076  {
        +
        4077  if(insertIndex != memTypeIndex)
        +
        4078  {
        +
        4079  VMA_SWAP(*memTypeIndex, *insertIndex);
        +
        4080  }
        +
        4081  ++insertIndex;
        +
        4082  }
        +
        4083  }
        +
        4084  if(insertIndex != centerValue)
        +
        4085  {
        +
        4086  VMA_SWAP(*insertIndex, *centerValue);
        4087  }
        -
        4088 #endif
        -
        4089  return true;
        -
        4090 }
        -
        4091 
        -
        4092 /*
        -
        4093 Fills structure with parameters of an example buffer to be used for transfers
        -
        4094 during GPU memory defragmentation.
        -
        4095 */
        -
        4096 static void VmaFillGpuDefragmentationBufferCreateInfo(VkBufferCreateInfo& outBufCreateInfo)
        -
        4097 {
        -
        4098  memset(&outBufCreateInfo, 0, sizeof(outBufCreateInfo));
        -
        4099  outBufCreateInfo.sType = VK_STRUCTURE_TYPE_BUFFER_CREATE_INFO;
        -
        4100  outBufCreateInfo.usage = VK_BUFFER_USAGE_TRANSFER_SRC_BIT | VK_BUFFER_USAGE_TRANSFER_DST_BIT;
        -
        4101  outBufCreateInfo.size = (VkDeviceSize)VMA_DEFAULT_LARGE_HEAP_BLOCK_SIZE; // Example size.
        -
        4102 }
        +
        4088  return insertIndex;
        +
        4089 }
        +
        4090 
        +
        4091 template<typename Iterator, typename Compare>
        +
        4092 void VmaQuickSort(Iterator beg, Iterator end, Compare cmp)
        +
        4093 {
        +
        4094  if(beg < end)
        +
        4095  {
        +
        4096  Iterator it = VmaQuickSortPartition<Iterator, Compare>(beg, end, cmp);
        +
        4097  VmaQuickSort<Iterator, Compare>(beg, it, cmp);
        +
        4098  VmaQuickSort<Iterator, Compare>(it + 1, end, cmp);
        +
        4099  }
        +
        4100 }
        +
        4101 
        +
        4102 #define VMA_SORT(beg, end, cmp) VmaQuickSort(beg, end, cmp)
        4103 
        -
        4104 // Helper RAII class to lock a mutex in constructor and unlock it in destructor (at the end of scope).
        -
        4105 struct VmaMutexLock
        -
        4106 {
        -
        4107  VMA_CLASS_NO_COPY(VmaMutexLock)
        -
        4108 public:
        -
        4109  VmaMutexLock(VMA_MUTEX& mutex, bool useMutex = true) :
        -
        4110  m_pMutex(useMutex ? &mutex : VMA_NULL)
        -
        4111  { if(m_pMutex) { m_pMutex->Lock(); } }
        -
        4112  ~VmaMutexLock()
        -
        4113  { if(m_pMutex) { m_pMutex->Unlock(); } }
        -
        4114 private:
        -
        4115  VMA_MUTEX* m_pMutex;
        -
        4116 };
        -
        4117 
        -
        4118 // Helper RAII class to lock a RW mutex in constructor and unlock it in destructor (at the end of scope), for reading.
        -
        4119 struct VmaMutexLockRead
        -
        4120 {
        -
        4121  VMA_CLASS_NO_COPY(VmaMutexLockRead)
        -
        4122 public:
        -
        4123  VmaMutexLockRead(VMA_RW_MUTEX& mutex, bool useMutex) :
        -
        4124  m_pMutex(useMutex ? &mutex : VMA_NULL)
        -
        4125  { if(m_pMutex) { m_pMutex->LockRead(); } }
        -
        4126  ~VmaMutexLockRead() { if(m_pMutex) { m_pMutex->UnlockRead(); } }
        -
        4127 private:
        -
        4128  VMA_RW_MUTEX* m_pMutex;
        -
        4129 };
        -
        4130 
        -
        4131 // Helper RAII class to lock a RW mutex in constructor and unlock it in destructor (at the end of scope), for writing.
        -
        4132 struct VmaMutexLockWrite
        -
        4133 {
        -
        4134  VMA_CLASS_NO_COPY(VmaMutexLockWrite)
        -
        4135 public:
        -
        4136  VmaMutexLockWrite(VMA_RW_MUTEX& mutex, bool useMutex) :
        -
        4137  m_pMutex(useMutex ? &mutex : VMA_NULL)
        -
        4138  { if(m_pMutex) { m_pMutex->LockWrite(); } }
        -
        4139  ~VmaMutexLockWrite() { if(m_pMutex) { m_pMutex->UnlockWrite(); } }
        -
        4140 private:
        -
        4141  VMA_RW_MUTEX* m_pMutex;
        -
        4142 };
        -
        4143 
        -
        4144 #if VMA_DEBUG_GLOBAL_MUTEX
        -
        4145  static VMA_MUTEX gDebugGlobalMutex;
        -
        4146  #define VMA_DEBUG_GLOBAL_MUTEX_LOCK VmaMutexLock debugGlobalMutexLock(gDebugGlobalMutex, true);
        -
        4147 #else
        -
        4148  #define VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        4149 #endif
        -
        4150 
        -
        4151 // Minimum size of a free suballocation to register it in the free suballocation collection.
        -
        4152 static const VkDeviceSize VMA_MIN_FREE_SUBALLOCATION_SIZE_TO_REGISTER = 16;
        -
        4153 
        -
        4154 /*
        -
        4155 Performs binary search and returns iterator to first element that is greater or
        -
        4156 equal to (key), according to comparison (cmp).
        -
        4157 
        -
        4158 Cmp should return true if first argument is less than second argument.
        -
        4159 
        -
        4160 Returned value is the found element, if present in the collection or place where
        -
        4161 new element with value (key) should be inserted.
        -
        4162 */
        -
        4163 template <typename CmpLess, typename IterT, typename KeyT>
        -
        4164 static IterT VmaBinaryFindFirstNotLess(IterT beg, IterT end, const KeyT &key, const CmpLess& cmp)
        -
        4165 {
        -
        4166  size_t down = 0, up = (end - beg);
        -
        4167  while(down < up)
        -
        4168  {
        -
        4169  const size_t mid = (down + up) / 2;
        -
        4170  if(cmp(*(beg+mid), key))
        -
        4171  {
        -
        4172  down = mid + 1;
        -
        4173  }
        -
        4174  else
        -
        4175  {
        -
        4176  up = mid;
        -
        4177  }
        -
        4178  }
        -
        4179  return beg + down;
        -
        4180 }
        -
        4181 
        -
        4182 template<typename CmpLess, typename IterT, typename KeyT>
        -
        4183 IterT VmaBinaryFindSorted(const IterT& beg, const IterT& end, const KeyT& value, const CmpLess& cmp)
        -
        4184 {
        -
        4185  IterT it = VmaBinaryFindFirstNotLess<CmpLess, IterT, KeyT>(
        -
        4186  beg, end, value, cmp);
        -
        4187  if(it == end ||
        -
        4188  (!cmp(*it, value) && !cmp(value, *it)))
        -
        4189  {
        -
        4190  return it;
        -
        4191  }
        -
        4192  return end;
        -
        4193 }
        -
        4194 
        -
        4195 /*
        -
        4196 Returns true if all pointers in the array are not-null and unique.
        -
        4197 Warning! O(n^2) complexity. Use only inside VMA_HEAVY_ASSERT.
        -
        4198 T must be pointer type, e.g. VmaAllocation, VmaPool.
        -
        4199 */
        -
        4200 template<typename T>
        -
        4201 static bool VmaValidatePointerArray(uint32_t count, const T* arr)
        -
        4202 {
        -
        4203  for(uint32_t i = 0; i < count; ++i)
        -
        4204  {
        -
        4205  const T iPtr = arr[i];
        -
        4206  if(iPtr == VMA_NULL)
        -
        4207  {
        -
        4208  return false;
        -
        4209  }
        -
        4210  for(uint32_t j = i + 1; j < count; ++j)
        -
        4211  {
        -
        4212  if(iPtr == arr[j])
        -
        4213  {
        -
        4214  return false;
        -
        4215  }
        -
        4216  }
        -
        4217  }
        -
        4218  return true;
        +
        4104 #endif // #ifndef VMA_SORT
        +
        4105 
        +
        4106 /*
        +
        4107 Returns true if two memory blocks occupy overlapping pages.
        +
        4108 ResourceA must be in less memory offset than ResourceB.
        +
        4109 
        +
        4110 Algorithm is based on "Vulkan 1.0.39 - A Specification (with all registered Vulkan extensions)"
        +
        4111 chapter 11.6 "Resource Memory Association", paragraph "Buffer-Image Granularity".
        +
        4112 */
        +
        4113 static inline bool VmaBlocksOnSamePage(
        +
        4114  VkDeviceSize resourceAOffset,
        +
        4115  VkDeviceSize resourceASize,
        +
        4116  VkDeviceSize resourceBOffset,
        +
        4117  VkDeviceSize pageSize)
        +
        4118 {
        +
        4119  VMA_ASSERT(resourceAOffset + resourceASize <= resourceBOffset && resourceASize > 0 && pageSize > 0);
        +
        4120  VkDeviceSize resourceAEnd = resourceAOffset + resourceASize - 1;
        +
        4121  VkDeviceSize resourceAEndPage = resourceAEnd & ~(pageSize - 1);
        +
        4122  VkDeviceSize resourceBStart = resourceBOffset;
        +
        4123  VkDeviceSize resourceBStartPage = resourceBStart & ~(pageSize - 1);
        +
        4124  return resourceAEndPage == resourceBStartPage;
        +
        4125 }
        +
        4126 
        +
        4127 enum VmaSuballocationType
        +
        4128 {
        +
        4129  VMA_SUBALLOCATION_TYPE_FREE = 0,
        +
        4130  VMA_SUBALLOCATION_TYPE_UNKNOWN = 1,
        +
        4131  VMA_SUBALLOCATION_TYPE_BUFFER = 2,
        +
        4132  VMA_SUBALLOCATION_TYPE_IMAGE_UNKNOWN = 3,
        +
        4133  VMA_SUBALLOCATION_TYPE_IMAGE_LINEAR = 4,
        +
        4134  VMA_SUBALLOCATION_TYPE_IMAGE_OPTIMAL = 5,
        +
        4135  VMA_SUBALLOCATION_TYPE_MAX_ENUM = 0x7FFFFFFF
        +
        4136 };
        +
        4137 
        +
        4138 /*
        +
        4139 Returns true if given suballocation types could conflict and must respect
        +
        4140 VkPhysicalDeviceLimits::bufferImageGranularity. They conflict if one is buffer
        +
        4141 or linear image and another one is optimal image. If type is unknown, behave
        +
        4142 conservatively.
        +
        4143 */
        +
        4144 static inline bool VmaIsBufferImageGranularityConflict(
        +
        4145  VmaSuballocationType suballocType1,
        +
        4146  VmaSuballocationType suballocType2)
        +
        4147 {
        +
        4148  if(suballocType1 > suballocType2)
        +
        4149  {
        +
        4150  VMA_SWAP(suballocType1, suballocType2);
        +
        4151  }
        +
        4152 
        +
        4153  switch(suballocType1)
        +
        4154  {
        +
        4155  case VMA_SUBALLOCATION_TYPE_FREE:
        +
        4156  return false;
        +
        4157  case VMA_SUBALLOCATION_TYPE_UNKNOWN:
        +
        4158  return true;
        +
        4159  case VMA_SUBALLOCATION_TYPE_BUFFER:
        +
        4160  return
        +
        4161  suballocType2 == VMA_SUBALLOCATION_TYPE_IMAGE_UNKNOWN ||
        +
        4162  suballocType2 == VMA_SUBALLOCATION_TYPE_IMAGE_OPTIMAL;
        +
        4163  case VMA_SUBALLOCATION_TYPE_IMAGE_UNKNOWN:
        +
        4164  return
        +
        4165  suballocType2 == VMA_SUBALLOCATION_TYPE_IMAGE_UNKNOWN ||
        +
        4166  suballocType2 == VMA_SUBALLOCATION_TYPE_IMAGE_LINEAR ||
        +
        4167  suballocType2 == VMA_SUBALLOCATION_TYPE_IMAGE_OPTIMAL;
        +
        4168  case VMA_SUBALLOCATION_TYPE_IMAGE_LINEAR:
        +
        4169  return
        +
        4170  suballocType2 == VMA_SUBALLOCATION_TYPE_IMAGE_OPTIMAL;
        +
        4171  case VMA_SUBALLOCATION_TYPE_IMAGE_OPTIMAL:
        +
        4172  return false;
        +
        4173  default:
        +
        4174  VMA_ASSERT(0);
        +
        4175  return true;
        +
        4176  }
        +
        4177 }
        +
        4178 
        +
        4179 static void VmaWriteMagicValue(void* pData, VkDeviceSize offset)
        +
        4180 {
        +
        4181 #if VMA_DEBUG_MARGIN > 0 && VMA_DEBUG_DETECT_CORRUPTION
        +
        4182  uint32_t* pDst = (uint32_t*)((char*)pData + offset);
        +
        4183  const size_t numberCount = VMA_DEBUG_MARGIN / sizeof(uint32_t);
        +
        4184  for(size_t i = 0; i < numberCount; ++i, ++pDst)
        +
        4185  {
        +
        4186  *pDst = VMA_CORRUPTION_DETECTION_MAGIC_VALUE;
        +
        4187  }
        +
        4188 #else
        +
        4189  // no-op
        +
        4190 #endif
        +
        4191 }
        +
        4192 
        +
        4193 static bool VmaValidateMagicValue(const void* pData, VkDeviceSize offset)
        +
        4194 {
        +
        4195 #if VMA_DEBUG_MARGIN > 0 && VMA_DEBUG_DETECT_CORRUPTION
        +
        4196  const uint32_t* pSrc = (const uint32_t*)((const char*)pData + offset);
        +
        4197  const size_t numberCount = VMA_DEBUG_MARGIN / sizeof(uint32_t);
        +
        4198  for(size_t i = 0; i < numberCount; ++i, ++pSrc)
        +
        4199  {
        +
        4200  if(*pSrc != VMA_CORRUPTION_DETECTION_MAGIC_VALUE)
        +
        4201  {
        +
        4202  return false;
        +
        4203  }
        +
        4204  }
        +
        4205 #endif
        +
        4206  return true;
        +
        4207 }
        +
        4208 
        +
        4209 /*
        +
        4210 Fills structure with parameters of an example buffer to be used for transfers
        +
        4211 during GPU memory defragmentation.
        +
        4212 */
        +
        4213 static void VmaFillGpuDefragmentationBufferCreateInfo(VkBufferCreateInfo& outBufCreateInfo)
        +
        4214 {
        +
        4215  memset(&outBufCreateInfo, 0, sizeof(outBufCreateInfo));
        +
        4216  outBufCreateInfo.sType = VK_STRUCTURE_TYPE_BUFFER_CREATE_INFO;
        +
        4217  outBufCreateInfo.usage = VK_BUFFER_USAGE_TRANSFER_SRC_BIT | VK_BUFFER_USAGE_TRANSFER_DST_BIT;
        +
        4218  outBufCreateInfo.size = (VkDeviceSize)VMA_DEFAULT_LARGE_HEAP_BLOCK_SIZE; // Example size.
        4219 }
        4220 
        -
        4222 // Memory allocation
        -
        4223 
        -
        4224 static void* VmaMalloc(const VkAllocationCallbacks* pAllocationCallbacks, size_t size, size_t alignment)
        -
        4225 {
        -
        4226  if((pAllocationCallbacks != VMA_NULL) &&
        -
        4227  (pAllocationCallbacks->pfnAllocation != VMA_NULL))
        -
        4228  {
        -
        4229  return (*pAllocationCallbacks->pfnAllocation)(
        -
        4230  pAllocationCallbacks->pUserData,
        -
        4231  size,
        -
        4232  alignment,
        -
        4233  VK_SYSTEM_ALLOCATION_SCOPE_OBJECT);
        -
        4234  }
        -
        4235  else
        -
        4236  {
        -
        4237  return VMA_SYSTEM_ALIGNED_MALLOC(size, alignment);
        -
        4238  }
        -
        4239 }
        -
        4240 
        -
        4241 static void VmaFree(const VkAllocationCallbacks* pAllocationCallbacks, void* ptr)
        -
        4242 {
        -
        4243  if((pAllocationCallbacks != VMA_NULL) &&
        -
        4244  (pAllocationCallbacks->pfnFree != VMA_NULL))
        -
        4245  {
        -
        4246  (*pAllocationCallbacks->pfnFree)(pAllocationCallbacks->pUserData, ptr);
        -
        4247  }
        -
        4248  else
        -
        4249  {
        -
        4250  VMA_SYSTEM_FREE(ptr);
        -
        4251  }
        -
        4252 }
        -
        4253 
        -
        4254 template<typename T>
        -
        4255 static T* VmaAllocate(const VkAllocationCallbacks* pAllocationCallbacks)
        -
        4256 {
        -
        4257  return (T*)VmaMalloc(pAllocationCallbacks, sizeof(T), VMA_ALIGN_OF(T));
        -
        4258 }
        -
        4259 
        -
        4260 template<typename T>
        -
        4261 static T* VmaAllocateArray(const VkAllocationCallbacks* pAllocationCallbacks, size_t count)
        -
        4262 {
        -
        4263  return (T*)VmaMalloc(pAllocationCallbacks, sizeof(T) * count, VMA_ALIGN_OF(T));
        -
        4264 }
        -
        4265 
        -
        4266 #define vma_new(allocator, type) new(VmaAllocate<type>(allocator))(type)
        +
        4221 // Helper RAII class to lock a mutex in constructor and unlock it in destructor (at the end of scope).
        +
        4222 struct VmaMutexLock
        +
        4223 {
        +
        4224  VMA_CLASS_NO_COPY(VmaMutexLock)
        +
        4225 public:
        +
        4226  VmaMutexLock(VMA_MUTEX& mutex, bool useMutex = true) :
        +
        4227  m_pMutex(useMutex ? &mutex : VMA_NULL)
        +
        4228  { if(m_pMutex) { m_pMutex->Lock(); } }
        +
        4229  ~VmaMutexLock()
        +
        4230  { if(m_pMutex) { m_pMutex->Unlock(); } }
        +
        4231 private:
        +
        4232  VMA_MUTEX* m_pMutex;
        +
        4233 };
        +
        4234 
        +
        4235 // Helper RAII class to lock a RW mutex in constructor and unlock it in destructor (at the end of scope), for reading.
        +
        4236 struct VmaMutexLockRead
        +
        4237 {
        +
        4238  VMA_CLASS_NO_COPY(VmaMutexLockRead)
        +
        4239 public:
        +
        4240  VmaMutexLockRead(VMA_RW_MUTEX& mutex, bool useMutex) :
        +
        4241  m_pMutex(useMutex ? &mutex : VMA_NULL)
        +
        4242  { if(m_pMutex) { m_pMutex->LockRead(); } }
        +
        4243  ~VmaMutexLockRead() { if(m_pMutex) { m_pMutex->UnlockRead(); } }
        +
        4244 private:
        +
        4245  VMA_RW_MUTEX* m_pMutex;
        +
        4246 };
        +
        4247 
        +
        4248 // Helper RAII class to lock a RW mutex in constructor and unlock it in destructor (at the end of scope), for writing.
        +
        4249 struct VmaMutexLockWrite
        +
        4250 {
        +
        4251  VMA_CLASS_NO_COPY(VmaMutexLockWrite)
        +
        4252 public:
        +
        4253  VmaMutexLockWrite(VMA_RW_MUTEX& mutex, bool useMutex) :
        +
        4254  m_pMutex(useMutex ? &mutex : VMA_NULL)
        +
        4255  { if(m_pMutex) { m_pMutex->LockWrite(); } }
        +
        4256  ~VmaMutexLockWrite() { if(m_pMutex) { m_pMutex->UnlockWrite(); } }
        +
        4257 private:
        +
        4258  VMA_RW_MUTEX* m_pMutex;
        +
        4259 };
        +
        4260 
        +
        4261 #if VMA_DEBUG_GLOBAL_MUTEX
        +
        4262  static VMA_MUTEX gDebugGlobalMutex;
        +
        4263  #define VMA_DEBUG_GLOBAL_MUTEX_LOCK VmaMutexLock debugGlobalMutexLock(gDebugGlobalMutex, true);
        +
        4264 #else
        +
        4265  #define VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        4266 #endif
        4267 
        -
        4268 #define vma_new_array(allocator, type, count) new(VmaAllocateArray<type>((allocator), (count)))(type)
        -
        4269 
        -
        4270 template<typename T>
        -
        4271 static void vma_delete(const VkAllocationCallbacks* pAllocationCallbacks, T* ptr)
        -
        4272 {
        -
        4273  ptr->~T();
        -
        4274  VmaFree(pAllocationCallbacks, ptr);
        -
        4275 }
        -
        4276 
        -
        4277 template<typename T>
        -
        4278 static void vma_delete_array(const VkAllocationCallbacks* pAllocationCallbacks, T* ptr, size_t count)
        -
        4279 {
        -
        4280  if(ptr != VMA_NULL)
        -
        4281  {
        -
        4282  for(size_t i = count; i--; )
        -
        4283  {
        -
        4284  ptr[i].~T();
        -
        4285  }
        -
        4286  VmaFree(pAllocationCallbacks, ptr);
        -
        4287  }
        -
        4288 }
        -
        4289 
        -
        4290 static char* VmaCreateStringCopy(const VkAllocationCallbacks* allocs, const char* srcStr)
        -
        4291 {
        -
        4292  if(srcStr != VMA_NULL)
        -
        4293  {
        -
        4294  const size_t len = strlen(srcStr);
        -
        4295  char* const result = vma_new_array(allocs, char, len + 1);
        -
        4296  memcpy(result, srcStr, len + 1);
        -
        4297  return result;
        -
        4298  }
        -
        4299  else
        -
        4300  {
        -
        4301  return VMA_NULL;
        -
        4302  }
        -
        4303 }
        -
        4304 
        -
        4305 static void VmaFreeString(const VkAllocationCallbacks* allocs, char* str)
        -
        4306 {
        -
        4307  if(str != VMA_NULL)
        -
        4308  {
        -
        4309  const size_t len = strlen(str);
        -
        4310  vma_delete_array(allocs, str, len + 1);
        -
        4311  }
        -
        4312 }
        -
        4313 
        -
        4314 // STL-compatible allocator.
        -
        4315 template<typename T>
        -
        4316 class VmaStlAllocator
        -
        4317 {
        -
        4318 public:
        -
        4319  const VkAllocationCallbacks* const m_pCallbacks;
        -
        4320  typedef T value_type;
        -
        4321 
        -
        4322  VmaStlAllocator(const VkAllocationCallbacks* pCallbacks) : m_pCallbacks(pCallbacks) { }
        -
        4323  template<typename U> VmaStlAllocator(const VmaStlAllocator<U>& src) : m_pCallbacks(src.m_pCallbacks) { }
        -
        4324 
        -
        4325  T* allocate(size_t n) { return VmaAllocateArray<T>(m_pCallbacks, n); }
        -
        4326  void deallocate(T* p, size_t n) { VmaFree(m_pCallbacks, p); }
        -
        4327 
        -
        4328  template<typename U>
        -
        4329  bool operator==(const VmaStlAllocator<U>& rhs) const
        -
        4330  {
        -
        4331  return m_pCallbacks == rhs.m_pCallbacks;
        -
        4332  }
        -
        4333  template<typename U>
        -
        4334  bool operator!=(const VmaStlAllocator<U>& rhs) const
        -
        4335  {
        -
        4336  return m_pCallbacks != rhs.m_pCallbacks;
        -
        4337  }
        -
        4338 
        -
        4339  VmaStlAllocator& operator=(const VmaStlAllocator& x) = delete;
        -
        4340 };
        -
        4341 
        -
        4342 #if VMA_USE_STL_VECTOR
        -
        4343 
        -
        4344 #define VmaVector std::vector
        -
        4345 
        -
        4346 template<typename T, typename allocatorT>
        -
        4347 static void VmaVectorInsert(std::vector<T, allocatorT>& vec, size_t index, const T& item)
        -
        4348 {
        -
        4349  vec.insert(vec.begin() + index, item);
        -
        4350 }
        -
        4351 
        -
        4352 template<typename T, typename allocatorT>
        -
        4353 static void VmaVectorRemove(std::vector<T, allocatorT>& vec, size_t index)
        -
        4354 {
        -
        4355  vec.erase(vec.begin() + index);
        +
        4268 // Minimum size of a free suballocation to register it in the free suballocation collection.
        +
        4269 static const VkDeviceSize VMA_MIN_FREE_SUBALLOCATION_SIZE_TO_REGISTER = 16;
        +
        4270 
        +
        4271 /*
        +
        4272 Performs binary search and returns iterator to first element that is greater or
        +
        4273 equal to (key), according to comparison (cmp).
        +
        4274 
        +
        4275 Cmp should return true if first argument is less than second argument.
        +
        4276 
        +
        4277 Returned value is the found element, if present in the collection or place where
        +
        4278 new element with value (key) should be inserted.
        +
        4279 */
        +
        4280 template <typename CmpLess, typename IterT, typename KeyT>
        +
        4281 static IterT VmaBinaryFindFirstNotLess(IterT beg, IterT end, const KeyT &key, const CmpLess& cmp)
        +
        4282 {
        +
        4283  size_t down = 0, up = (end - beg);
        +
        4284  while(down < up)
        +
        4285  {
        +
        4286  const size_t mid = (down + up) / 2;
        +
        4287  if(cmp(*(beg+mid), key))
        +
        4288  {
        +
        4289  down = mid + 1;
        +
        4290  }
        +
        4291  else
        +
        4292  {
        +
        4293  up = mid;
        +
        4294  }
        +
        4295  }
        +
        4296  return beg + down;
        +
        4297 }
        +
        4298 
        +
        4299 template<typename CmpLess, typename IterT, typename KeyT>
        +
        4300 IterT VmaBinaryFindSorted(const IterT& beg, const IterT& end, const KeyT& value, const CmpLess& cmp)
        +
        4301 {
        +
        4302  IterT it = VmaBinaryFindFirstNotLess<CmpLess, IterT, KeyT>(
        +
        4303  beg, end, value, cmp);
        +
        4304  if(it == end ||
        +
        4305  (!cmp(*it, value) && !cmp(value, *it)))
        +
        4306  {
        +
        4307  return it;
        +
        4308  }
        +
        4309  return end;
        +
        4310 }
        +
        4311 
        +
        4312 /*
        +
        4313 Returns true if all pointers in the array are not-null and unique.
        +
        4314 Warning! O(n^2) complexity. Use only inside VMA_HEAVY_ASSERT.
        +
        4315 T must be pointer type, e.g. VmaAllocation, VmaPool.
        +
        4316 */
        +
        4317 template<typename T>
        +
        4318 static bool VmaValidatePointerArray(uint32_t count, const T* arr)
        +
        4319 {
        +
        4320  for(uint32_t i = 0; i < count; ++i)
        +
        4321  {
        +
        4322  const T iPtr = arr[i];
        +
        4323  if(iPtr == VMA_NULL)
        +
        4324  {
        +
        4325  return false;
        +
        4326  }
        +
        4327  for(uint32_t j = i + 1; j < count; ++j)
        +
        4328  {
        +
        4329  if(iPtr == arr[j])
        +
        4330  {
        +
        4331  return false;
        +
        4332  }
        +
        4333  }
        +
        4334  }
        +
        4335  return true;
        +
        4336 }
        +
        4337 
        +
        4339 // Memory allocation
        +
        4340 
        +
        4341 static void* VmaMalloc(const VkAllocationCallbacks* pAllocationCallbacks, size_t size, size_t alignment)
        +
        4342 {
        +
        4343  if((pAllocationCallbacks != VMA_NULL) &&
        +
        4344  (pAllocationCallbacks->pfnAllocation != VMA_NULL))
        +
        4345  {
        +
        4346  return (*pAllocationCallbacks->pfnAllocation)(
        +
        4347  pAllocationCallbacks->pUserData,
        +
        4348  size,
        +
        4349  alignment,
        +
        4350  VK_SYSTEM_ALLOCATION_SCOPE_OBJECT);
        +
        4351  }
        +
        4352  else
        +
        4353  {
        +
        4354  return VMA_SYSTEM_ALIGNED_MALLOC(size, alignment);
        +
        4355  }
        4356 }
        4357 
        -
        4358 #else // #if VMA_USE_STL_VECTOR
        -
        4359 
        -
        4360 /* Class with interface compatible with subset of std::vector.
        -
        4361 T must be POD because constructors and destructors are not called and memcpy is
        -
        4362 used for these objects. */
        -
        4363 template<typename T, typename AllocatorT>
        -
        4364 class VmaVector
        -
        4365 {
        -
        4366 public:
        -
        4367  typedef T value_type;
        -
        4368 
        -
        4369  VmaVector(const AllocatorT& allocator) :
        -
        4370  m_Allocator(allocator),
        -
        4371  m_pArray(VMA_NULL),
        -
        4372  m_Count(0),
        -
        4373  m_Capacity(0)
        -
        4374  {
        -
        4375  }
        +
        4358 static void VmaFree(const VkAllocationCallbacks* pAllocationCallbacks, void* ptr)
        +
        4359 {
        +
        4360  if((pAllocationCallbacks != VMA_NULL) &&
        +
        4361  (pAllocationCallbacks->pfnFree != VMA_NULL))
        +
        4362  {
        +
        4363  (*pAllocationCallbacks->pfnFree)(pAllocationCallbacks->pUserData, ptr);
        +
        4364  }
        +
        4365  else
        +
        4366  {
        +
        4367  VMA_SYSTEM_FREE(ptr);
        +
        4368  }
        +
        4369 }
        +
        4370 
        +
        4371 template<typename T>
        +
        4372 static T* VmaAllocate(const VkAllocationCallbacks* pAllocationCallbacks)
        +
        4373 {
        +
        4374  return (T*)VmaMalloc(pAllocationCallbacks, sizeof(T), VMA_ALIGN_OF(T));
        +
        4375 }
        4376 
        -
        4377  VmaVector(size_t count, const AllocatorT& allocator) :
        -
        4378  m_Allocator(allocator),
        -
        4379  m_pArray(count ? (T*)VmaAllocateArray<T>(allocator.m_pCallbacks, count) : VMA_NULL),
        -
        4380  m_Count(count),
        -
        4381  m_Capacity(count)
        -
        4382  {
        -
        4383  }
        -
        4384 
        -
        4385  // This version of the constructor is here for compatibility with pre-C++14 std::vector.
        -
        4386  // value is unused.
        -
        4387  VmaVector(size_t count, const T& value, const AllocatorT& allocator)
        -
        4388  : VmaVector(count, allocator) {}
        -
        4389 
        -
        4390  VmaVector(const VmaVector<T, AllocatorT>& src) :
        -
        4391  m_Allocator(src.m_Allocator),
        -
        4392  m_pArray(src.m_Count ? (T*)VmaAllocateArray<T>(src.m_Allocator.m_pCallbacks, src.m_Count) : VMA_NULL),
        -
        4393  m_Count(src.m_Count),
        -
        4394  m_Capacity(src.m_Count)
        -
        4395  {
        -
        4396  if(m_Count != 0)
        -
        4397  {
        -
        4398  memcpy(m_pArray, src.m_pArray, m_Count * sizeof(T));
        -
        4399  }
        -
        4400  }
        -
        4401 
        -
        4402  ~VmaVector()
        -
        4403  {
        -
        4404  VmaFree(m_Allocator.m_pCallbacks, m_pArray);
        -
        4405  }
        +
        4377 template<typename T>
        +
        4378 static T* VmaAllocateArray(const VkAllocationCallbacks* pAllocationCallbacks, size_t count)
        +
        4379 {
        +
        4380  return (T*)VmaMalloc(pAllocationCallbacks, sizeof(T) * count, VMA_ALIGN_OF(T));
        +
        4381 }
        +
        4382 
        +
        4383 #define vma_new(allocator, type) new(VmaAllocate<type>(allocator))(type)
        +
        4384 
        +
        4385 #define vma_new_array(allocator, type, count) new(VmaAllocateArray<type>((allocator), (count)))(type)
        +
        4386 
        +
        4387 template<typename T>
        +
        4388 static void vma_delete(const VkAllocationCallbacks* pAllocationCallbacks, T* ptr)
        +
        4389 {
        +
        4390  ptr->~T();
        +
        4391  VmaFree(pAllocationCallbacks, ptr);
        +
        4392 }
        +
        4393 
        +
        4394 template<typename T>
        +
        4395 static void vma_delete_array(const VkAllocationCallbacks* pAllocationCallbacks, T* ptr, size_t count)
        +
        4396 {
        +
        4397  if(ptr != VMA_NULL)
        +
        4398  {
        +
        4399  for(size_t i = count; i--; )
        +
        4400  {
        +
        4401  ptr[i].~T();
        +
        4402  }
        +
        4403  VmaFree(pAllocationCallbacks, ptr);
        +
        4404  }
        +
        4405 }
        4406 
        -
        4407  VmaVector& operator=(const VmaVector<T, AllocatorT>& rhs)
        -
        4408  {
        -
        4409  if(&rhs != this)
        -
        4410  {
        -
        4411  resize(rhs.m_Count);
        -
        4412  if(m_Count != 0)
        -
        4413  {
        -
        4414  memcpy(m_pArray, rhs.m_pArray, m_Count * sizeof(T));
        -
        4415  }
        -
        4416  }
        -
        4417  return *this;
        -
        4418  }
        -
        4419 
        -
        4420  bool empty() const { return m_Count == 0; }
        -
        4421  size_t size() const { return m_Count; }
        -
        4422  T* data() { return m_pArray; }
        -
        4423  const T* data() const { return m_pArray; }
        -
        4424 
        -
        4425  T& operator[](size_t index)
        -
        4426  {
        -
        4427  VMA_HEAVY_ASSERT(index < m_Count);
        -
        4428  return m_pArray[index];
        -
        4429  }
        -
        4430  const T& operator[](size_t index) const
        -
        4431  {
        -
        4432  VMA_HEAVY_ASSERT(index < m_Count);
        -
        4433  return m_pArray[index];
        -
        4434  }
        -
        4435 
        -
        4436  T& front()
        -
        4437  {
        -
        4438  VMA_HEAVY_ASSERT(m_Count > 0);
        -
        4439  return m_pArray[0];
        -
        4440  }
        -
        4441  const T& front() const
        -
        4442  {
        -
        4443  VMA_HEAVY_ASSERT(m_Count > 0);
        -
        4444  return m_pArray[0];
        -
        4445  }
        -
        4446  T& back()
        -
        4447  {
        -
        4448  VMA_HEAVY_ASSERT(m_Count > 0);
        -
        4449  return m_pArray[m_Count - 1];
        -
        4450  }
        -
        4451  const T& back() const
        +
        4407 static char* VmaCreateStringCopy(const VkAllocationCallbacks* allocs, const char* srcStr)
        +
        4408 {
        +
        4409  if(srcStr != VMA_NULL)
        +
        4410  {
        +
        4411  const size_t len = strlen(srcStr);
        +
        4412  char* const result = vma_new_array(allocs, char, len + 1);
        +
        4413  memcpy(result, srcStr, len + 1);
        +
        4414  return result;
        +
        4415  }
        +
        4416  else
        +
        4417  {
        +
        4418  return VMA_NULL;
        +
        4419  }
        +
        4420 }
        +
        4421 
        +
        4422 static void VmaFreeString(const VkAllocationCallbacks* allocs, char* str)
        +
        4423 {
        +
        4424  if(str != VMA_NULL)
        +
        4425  {
        +
        4426  const size_t len = strlen(str);
        +
        4427  vma_delete_array(allocs, str, len + 1);
        +
        4428  }
        +
        4429 }
        +
        4430 
        +
        4431 // STL-compatible allocator.
        +
        4432 template<typename T>
        +
        4433 class VmaStlAllocator
        +
        4434 {
        +
        4435 public:
        +
        4436  const VkAllocationCallbacks* const m_pCallbacks;
        +
        4437  typedef T value_type;
        +
        4438 
        +
        4439  VmaStlAllocator(const VkAllocationCallbacks* pCallbacks) : m_pCallbacks(pCallbacks) { }
        +
        4440  template<typename U> VmaStlAllocator(const VmaStlAllocator<U>& src) : m_pCallbacks(src.m_pCallbacks) { }
        +
        4441 
        +
        4442  T* allocate(size_t n) { return VmaAllocateArray<T>(m_pCallbacks, n); }
        +
        4443  void deallocate(T* p, size_t n) { VmaFree(m_pCallbacks, p); }
        +
        4444 
        +
        4445  template<typename U>
        +
        4446  bool operator==(const VmaStlAllocator<U>& rhs) const
        +
        4447  {
        +
        4448  return m_pCallbacks == rhs.m_pCallbacks;
        +
        4449  }
        +
        4450  template<typename U>
        +
        4451  bool operator!=(const VmaStlAllocator<U>& rhs) const
        4452  {
        -
        4453  VMA_HEAVY_ASSERT(m_Count > 0);
        -
        4454  return m_pArray[m_Count - 1];
        -
        4455  }
        -
        4456 
        -
        4457  void reserve(size_t newCapacity, bool freeMemory = false)
        -
        4458  {
        -
        4459  newCapacity = VMA_MAX(newCapacity, m_Count);
        -
        4460 
        -
        4461  if((newCapacity < m_Capacity) && !freeMemory)
        -
        4462  {
        -
        4463  newCapacity = m_Capacity;
        -
        4464  }
        -
        4465 
        -
        4466  if(newCapacity != m_Capacity)
        -
        4467  {
        -
        4468  T* const newArray = newCapacity ? VmaAllocateArray<T>(m_Allocator, newCapacity) : VMA_NULL;
        -
        4469  if(m_Count != 0)
        -
        4470  {
        -
        4471  memcpy(newArray, m_pArray, m_Count * sizeof(T));
        -
        4472  }
        -
        4473  VmaFree(m_Allocator.m_pCallbacks, m_pArray);
        -
        4474  m_Capacity = newCapacity;
        -
        4475  m_pArray = newArray;
        -
        4476  }
        -
        4477  }
        -
        4478 
        -
        4479  void resize(size_t newCount, bool freeMemory = false)
        -
        4480  {
        -
        4481  size_t newCapacity = m_Capacity;
        -
        4482  if(newCount > m_Capacity)
        -
        4483  {
        -
        4484  newCapacity = VMA_MAX(newCount, VMA_MAX(m_Capacity * 3 / 2, (size_t)8));
        -
        4485  }
        -
        4486  else if(freeMemory)
        -
        4487  {
        -
        4488  newCapacity = newCount;
        -
        4489  }
        -
        4490 
        -
        4491  if(newCapacity != m_Capacity)
        -
        4492  {
        -
        4493  T* const newArray = newCapacity ? VmaAllocateArray<T>(m_Allocator.m_pCallbacks, newCapacity) : VMA_NULL;
        -
        4494  const size_t elementsToCopy = VMA_MIN(m_Count, newCount);
        -
        4495  if(elementsToCopy != 0)
        -
        4496  {
        -
        4497  memcpy(newArray, m_pArray, elementsToCopy * sizeof(T));
        -
        4498  }
        -
        4499  VmaFree(m_Allocator.m_pCallbacks, m_pArray);
        -
        4500  m_Capacity = newCapacity;
        -
        4501  m_pArray = newArray;
        -
        4502  }
        -
        4503 
        -
        4504  m_Count = newCount;
        -
        4505  }
        -
        4506 
        -
        4507  void clear(bool freeMemory = false)
        -
        4508  {
        -
        4509  resize(0, freeMemory);
        -
        4510  }
        -
        4511 
        -
        4512  void insert(size_t index, const T& src)
        -
        4513  {
        -
        4514  VMA_HEAVY_ASSERT(index <= m_Count);
        -
        4515  const size_t oldCount = size();
        -
        4516  resize(oldCount + 1);
        -
        4517  if(index < oldCount)
        -
        4518  {
        -
        4519  memmove(m_pArray + (index + 1), m_pArray + index, (oldCount - index) * sizeof(T));
        -
        4520  }
        -
        4521  m_pArray[index] = src;
        +
        4453  return m_pCallbacks != rhs.m_pCallbacks;
        +
        4454  }
        +
        4455 
        +
        4456  VmaStlAllocator& operator=(const VmaStlAllocator& x) = delete;
        +
        4457 };
        +
        4458 
        +
        4459 #if VMA_USE_STL_VECTOR
        +
        4460 
        +
        4461 #define VmaVector std::vector
        +
        4462 
        +
        4463 template<typename T, typename allocatorT>
        +
        4464 static void VmaVectorInsert(std::vector<T, allocatorT>& vec, size_t index, const T& item)
        +
        4465 {
        +
        4466  vec.insert(vec.begin() + index, item);
        +
        4467 }
        +
        4468 
        +
        4469 template<typename T, typename allocatorT>
        +
        4470 static void VmaVectorRemove(std::vector<T, allocatorT>& vec, size_t index)
        +
        4471 {
        +
        4472  vec.erase(vec.begin() + index);
        +
        4473 }
        +
        4474 
        +
        4475 #else // #if VMA_USE_STL_VECTOR
        +
        4476 
        +
        4477 /* Class with interface compatible with subset of std::vector.
        +
        4478 T must be POD because constructors and destructors are not called and memcpy is
        +
        4479 used for these objects. */
        +
        4480 template<typename T, typename AllocatorT>
        +
        4481 class VmaVector
        +
        4482 {
        +
        4483 public:
        +
        4484  typedef T value_type;
        +
        4485 
        +
        4486  VmaVector(const AllocatorT& allocator) :
        +
        4487  m_Allocator(allocator),
        +
        4488  m_pArray(VMA_NULL),
        +
        4489  m_Count(0),
        +
        4490  m_Capacity(0)
        +
        4491  {
        +
        4492  }
        +
        4493 
        +
        4494  VmaVector(size_t count, const AllocatorT& allocator) :
        +
        4495  m_Allocator(allocator),
        +
        4496  m_pArray(count ? (T*)VmaAllocateArray<T>(allocator.m_pCallbacks, count) : VMA_NULL),
        +
        4497  m_Count(count),
        +
        4498  m_Capacity(count)
        +
        4499  {
        +
        4500  }
        +
        4501 
        +
        4502  // This version of the constructor is here for compatibility with pre-C++14 std::vector.
        +
        4503  // value is unused.
        +
        4504  VmaVector(size_t count, const T& value, const AllocatorT& allocator)
        +
        4505  : VmaVector(count, allocator) {}
        +
        4506 
        +
        4507  VmaVector(const VmaVector<T, AllocatorT>& src) :
        +
        4508  m_Allocator(src.m_Allocator),
        +
        4509  m_pArray(src.m_Count ? (T*)VmaAllocateArray<T>(src.m_Allocator.m_pCallbacks, src.m_Count) : VMA_NULL),
        +
        4510  m_Count(src.m_Count),
        +
        4511  m_Capacity(src.m_Count)
        +
        4512  {
        +
        4513  if(m_Count != 0)
        +
        4514  {
        +
        4515  memcpy(m_pArray, src.m_pArray, m_Count * sizeof(T));
        +
        4516  }
        +
        4517  }
        +
        4518 
        +
        4519  ~VmaVector()
        +
        4520  {
        +
        4521  VmaFree(m_Allocator.m_pCallbacks, m_pArray);
        4522  }
        4523 
        -
        4524  void remove(size_t index)
        +
        4524  VmaVector& operator=(const VmaVector<T, AllocatorT>& rhs)
        4525  {
        -
        4526  VMA_HEAVY_ASSERT(index < m_Count);
        -
        4527  const size_t oldCount = size();
        -
        4528  if(index < oldCount - 1)
        -
        4529  {
        -
        4530  memmove(m_pArray + index, m_pArray + (index + 1), (oldCount - index - 1) * sizeof(T));
        -
        4531  }
        -
        4532  resize(oldCount - 1);
        -
        4533  }
        -
        4534 
        -
        4535  void push_back(const T& src)
        -
        4536  {
        -
        4537  const size_t newIndex = size();
        -
        4538  resize(newIndex + 1);
        -
        4539  m_pArray[newIndex] = src;
        -
        4540  }
        -
        4541 
        -
        4542  void pop_back()
        +
        4526  if(&rhs != this)
        +
        4527  {
        +
        4528  resize(rhs.m_Count);
        +
        4529  if(m_Count != 0)
        +
        4530  {
        +
        4531  memcpy(m_pArray, rhs.m_pArray, m_Count * sizeof(T));
        +
        4532  }
        +
        4533  }
        +
        4534  return *this;
        +
        4535  }
        +
        4536 
        +
        4537  bool empty() const { return m_Count == 0; }
        +
        4538  size_t size() const { return m_Count; }
        +
        4539  T* data() { return m_pArray; }
        +
        4540  const T* data() const { return m_pArray; }
        +
        4541 
        +
        4542  T& operator[](size_t index)
        4543  {
        -
        4544  VMA_HEAVY_ASSERT(m_Count > 0);
        -
        4545  resize(size() - 1);
        +
        4544  VMA_HEAVY_ASSERT(index < m_Count);
        +
        4545  return m_pArray[index];
        4546  }
        -
        4547 
        -
        4548  void push_front(const T& src)
        -
        4549  {
        -
        4550  insert(0, src);
        +
        4547  const T& operator[](size_t index) const
        +
        4548  {
        +
        4549  VMA_HEAVY_ASSERT(index < m_Count);
        +
        4550  return m_pArray[index];
        4551  }
        4552 
        -
        4553  void pop_front()
        +
        4553  T& front()
        4554  {
        4555  VMA_HEAVY_ASSERT(m_Count > 0);
        -
        4556  remove(0);
        +
        4556  return m_pArray[0];
        4557  }
        -
        4558 
        -
        4559  typedef T* iterator;
        -
        4560 
        -
        4561  iterator begin() { return m_pArray; }
        -
        4562  iterator end() { return m_pArray + m_Count; }
        -
        4563 
        -
        4564 private:
        -
        4565  AllocatorT m_Allocator;
        -
        4566  T* m_pArray;
        -
        4567  size_t m_Count;
        -
        4568  size_t m_Capacity;
        -
        4569 };
        -
        4570 
        -
        4571 template<typename T, typename allocatorT>
        -
        4572 static void VmaVectorInsert(VmaVector<T, allocatorT>& vec, size_t index, const T& item)
        -
        4573 {
        -
        4574  vec.insert(index, item);
        -
        4575 }
        -
        4576 
        -
        4577 template<typename T, typename allocatorT>
        -
        4578 static void VmaVectorRemove(VmaVector<T, allocatorT>& vec, size_t index)
        -
        4579 {
        -
        4580  vec.remove(index);
        -
        4581 }
        -
        4582 
        -
        4583 #endif // #if VMA_USE_STL_VECTOR
        -
        4584 
        -
        4585 template<typename CmpLess, typename VectorT>
        -
        4586 size_t VmaVectorInsertSorted(VectorT& vector, const typename VectorT::value_type& value)
        -
        4587 {
        -
        4588  const size_t indexToInsert = VmaBinaryFindFirstNotLess(
        -
        4589  vector.data(),
        -
        4590  vector.data() + vector.size(),
        -
        4591  value,
        -
        4592  CmpLess()) - vector.data();
        -
        4593  VmaVectorInsert(vector, indexToInsert, value);
        -
        4594  return indexToInsert;
        -
        4595 }
        -
        4596 
        -
        4597 template<typename CmpLess, typename VectorT>
        -
        4598 bool VmaVectorRemoveSorted(VectorT& vector, const typename VectorT::value_type& value)
        -
        4599 {
        -
        4600  CmpLess comparator;
        -
        4601  typename VectorT::iterator it = VmaBinaryFindFirstNotLess(
        -
        4602  vector.begin(),
        -
        4603  vector.end(),
        -
        4604  value,
        -
        4605  comparator);
        -
        4606  if((it != vector.end()) && !comparator(*it, value) && !comparator(value, *it))
        -
        4607  {
        -
        4608  size_t indexToRemove = it - vector.begin();
        -
        4609  VmaVectorRemove(vector, indexToRemove);
        -
        4610  return true;
        -
        4611  }
        -
        4612  return false;
        -
        4613 }
        -
        4614 
        -
        4616 // class VmaPoolAllocator
        -
        4617 
        -
        4618 /*
        -
        4619 Allocator for objects of type T using a list of arrays (pools) to speed up
        -
        4620 allocation. Number of elements that can be allocated is not bounded because
        -
        4621 allocator can create multiple blocks.
        -
        4622 */
        -
        4623 template<typename T>
        -
        4624 class VmaPoolAllocator
        -
        4625 {
        -
        4626  VMA_CLASS_NO_COPY(VmaPoolAllocator)
        -
        4627 public:
        -
        4628  VmaPoolAllocator(const VkAllocationCallbacks* pAllocationCallbacks, uint32_t firstBlockCapacity);
        -
        4629  ~VmaPoolAllocator();
        -
        4630  T* Alloc();
        -
        4631  void Free(T* ptr);
        -
        4632 
        -
        4633 private:
        -
        4634  union Item
        -
        4635  {
        -
        4636  uint32_t NextFreeIndex;
        -
        4637  alignas(T) char Value[sizeof(T)];
        -
        4638  };
        -
        4639 
        -
        4640  struct ItemBlock
        -
        4641  {
        -
        4642  Item* pItems;
        -
        4643  uint32_t Capacity;
        -
        4644  uint32_t FirstFreeIndex;
        -
        4645  };
        -
        4646 
        -
        4647  const VkAllocationCallbacks* m_pAllocationCallbacks;
        -
        4648  const uint32_t m_FirstBlockCapacity;
        -
        4649  VmaVector< ItemBlock, VmaStlAllocator<ItemBlock> > m_ItemBlocks;
        -
        4650 
        -
        4651  ItemBlock& CreateNewBlock();
        -
        4652 };
        -
        4653 
        -
        4654 template<typename T>
        -
        4655 VmaPoolAllocator<T>::VmaPoolAllocator(const VkAllocationCallbacks* pAllocationCallbacks, uint32_t firstBlockCapacity) :
        -
        4656  m_pAllocationCallbacks(pAllocationCallbacks),
        -
        4657  m_FirstBlockCapacity(firstBlockCapacity),
        -
        4658  m_ItemBlocks(VmaStlAllocator<ItemBlock>(pAllocationCallbacks))
        -
        4659 {
        -
        4660  VMA_ASSERT(m_FirstBlockCapacity > 1);
        -
        4661 }
        -
        4662 
        -
        4663 template<typename T>
        -
        4664 VmaPoolAllocator<T>::~VmaPoolAllocator()
        -
        4665 {
        -
        4666  for(size_t i = m_ItemBlocks.size(); i--; )
        -
        4667  vma_delete_array(m_pAllocationCallbacks, m_ItemBlocks[i].pItems, m_ItemBlocks[i].Capacity);
        -
        4668  m_ItemBlocks.clear();
        -
        4669 }
        -
        4670 
        -
        4671 template<typename T>
        -
        4672 T* VmaPoolAllocator<T>::Alloc()
        -
        4673 {
        -
        4674  for(size_t i = m_ItemBlocks.size(); i--; )
        -
        4675  {
        -
        4676  ItemBlock& block = m_ItemBlocks[i];
        -
        4677  // This block has some free items: Use first one.
        -
        4678  if(block.FirstFreeIndex != UINT32_MAX)
        -
        4679  {
        -
        4680  Item* const pItem = &block.pItems[block.FirstFreeIndex];
        -
        4681  block.FirstFreeIndex = pItem->NextFreeIndex;
        -
        4682  T* result = (T*)&pItem->Value;
        -
        4683  new(result)T(); // Explicit constructor call.
        -
        4684  return result;
        -
        4685  }
        -
        4686  }
        +
        4558  const T& front() const
        +
        4559  {
        +
        4560  VMA_HEAVY_ASSERT(m_Count > 0);
        +
        4561  return m_pArray[0];
        +
        4562  }
        +
        4563  T& back()
        +
        4564  {
        +
        4565  VMA_HEAVY_ASSERT(m_Count > 0);
        +
        4566  return m_pArray[m_Count - 1];
        +
        4567  }
        +
        4568  const T& back() const
        +
        4569  {
        +
        4570  VMA_HEAVY_ASSERT(m_Count > 0);
        +
        4571  return m_pArray[m_Count - 1];
        +
        4572  }
        +
        4573 
        +
        4574  void reserve(size_t newCapacity, bool freeMemory = false)
        +
        4575  {
        +
        4576  newCapacity = VMA_MAX(newCapacity, m_Count);
        +
        4577 
        +
        4578  if((newCapacity < m_Capacity) && !freeMemory)
        +
        4579  {
        +
        4580  newCapacity = m_Capacity;
        +
        4581  }
        +
        4582 
        +
        4583  if(newCapacity != m_Capacity)
        +
        4584  {
        +
        4585  T* const newArray = newCapacity ? VmaAllocateArray<T>(m_Allocator, newCapacity) : VMA_NULL;
        +
        4586  if(m_Count != 0)
        +
        4587  {
        +
        4588  memcpy(newArray, m_pArray, m_Count * sizeof(T));
        +
        4589  }
        +
        4590  VmaFree(m_Allocator.m_pCallbacks, m_pArray);
        +
        4591  m_Capacity = newCapacity;
        +
        4592  m_pArray = newArray;
        +
        4593  }
        +
        4594  }
        +
        4595 
        +
        4596  void resize(size_t newCount, bool freeMemory = false)
        +
        4597  {
        +
        4598  size_t newCapacity = m_Capacity;
        +
        4599  if(newCount > m_Capacity)
        +
        4600  {
        +
        4601  newCapacity = VMA_MAX(newCount, VMA_MAX(m_Capacity * 3 / 2, (size_t)8));
        +
        4602  }
        +
        4603  else if(freeMemory)
        +
        4604  {
        +
        4605  newCapacity = newCount;
        +
        4606  }
        +
        4607 
        +
        4608  if(newCapacity != m_Capacity)
        +
        4609  {
        +
        4610  T* const newArray = newCapacity ? VmaAllocateArray<T>(m_Allocator.m_pCallbacks, newCapacity) : VMA_NULL;
        +
        4611  const size_t elementsToCopy = VMA_MIN(m_Count, newCount);
        +
        4612  if(elementsToCopy != 0)
        +
        4613  {
        +
        4614  memcpy(newArray, m_pArray, elementsToCopy * sizeof(T));
        +
        4615  }
        +
        4616  VmaFree(m_Allocator.m_pCallbacks, m_pArray);
        +
        4617  m_Capacity = newCapacity;
        +
        4618  m_pArray = newArray;
        +
        4619  }
        +
        4620 
        +
        4621  m_Count = newCount;
        +
        4622  }
        +
        4623 
        +
        4624  void clear(bool freeMemory = false)
        +
        4625  {
        +
        4626  resize(0, freeMemory);
        +
        4627  }
        +
        4628 
        +
        4629  void insert(size_t index, const T& src)
        +
        4630  {
        +
        4631  VMA_HEAVY_ASSERT(index <= m_Count);
        +
        4632  const size_t oldCount = size();
        +
        4633  resize(oldCount + 1);
        +
        4634  if(index < oldCount)
        +
        4635  {
        +
        4636  memmove(m_pArray + (index + 1), m_pArray + index, (oldCount - index) * sizeof(T));
        +
        4637  }
        +
        4638  m_pArray[index] = src;
        +
        4639  }
        +
        4640 
        +
        4641  void remove(size_t index)
        +
        4642  {
        +
        4643  VMA_HEAVY_ASSERT(index < m_Count);
        +
        4644  const size_t oldCount = size();
        +
        4645  if(index < oldCount - 1)
        +
        4646  {
        +
        4647  memmove(m_pArray + index, m_pArray + (index + 1), (oldCount - index - 1) * sizeof(T));
        +
        4648  }
        +
        4649  resize(oldCount - 1);
        +
        4650  }
        +
        4651 
        +
        4652  void push_back(const T& src)
        +
        4653  {
        +
        4654  const size_t newIndex = size();
        +
        4655  resize(newIndex + 1);
        +
        4656  m_pArray[newIndex] = src;
        +
        4657  }
        +
        4658 
        +
        4659  void pop_back()
        +
        4660  {
        +
        4661  VMA_HEAVY_ASSERT(m_Count > 0);
        +
        4662  resize(size() - 1);
        +
        4663  }
        +
        4664 
        +
        4665  void push_front(const T& src)
        +
        4666  {
        +
        4667  insert(0, src);
        +
        4668  }
        +
        4669 
        +
        4670  void pop_front()
        +
        4671  {
        +
        4672  VMA_HEAVY_ASSERT(m_Count > 0);
        +
        4673  remove(0);
        +
        4674  }
        +
        4675 
        +
        4676  typedef T* iterator;
        +
        4677 
        +
        4678  iterator begin() { return m_pArray; }
        +
        4679  iterator end() { return m_pArray + m_Count; }
        +
        4680 
        +
        4681 private:
        +
        4682  AllocatorT m_Allocator;
        +
        4683  T* m_pArray;
        +
        4684  size_t m_Count;
        +
        4685  size_t m_Capacity;
        +
        4686 };
        4687 
        -
        4688  // No block has free item: Create new one and use it.
        -
        4689  ItemBlock& newBlock = CreateNewBlock();
        -
        4690  Item* const pItem = &newBlock.pItems[0];
        -
        4691  newBlock.FirstFreeIndex = pItem->NextFreeIndex;
        -
        4692  T* result = (T*)&pItem->Value;
        -
        4693  new(result)T(); // Explicit constructor call.
        -
        4694  return result;
        -
        4695 }
        -
        4696 
        -
        4697 template<typename T>
        -
        4698 void VmaPoolAllocator<T>::Free(T* ptr)
        -
        4699 {
        -
        4700  // Search all memory blocks to find ptr.
        -
        4701  for(size_t i = m_ItemBlocks.size(); i--; )
        -
        4702  {
        -
        4703  ItemBlock& block = m_ItemBlocks[i];
        -
        4704 
        -
        4705  // Casting to union.
        -
        4706  Item* pItemPtr;
        -
        4707  memcpy(&pItemPtr, &ptr, sizeof(pItemPtr));
        -
        4708 
        -
        4709  // Check if pItemPtr is in address range of this block.
        -
        4710  if((pItemPtr >= block.pItems) && (pItemPtr < block.pItems + block.Capacity))
        -
        4711  {
        -
        4712  ptr->~T(); // Explicit destructor call.
        -
        4713  const uint32_t index = static_cast<uint32_t>(pItemPtr - block.pItems);
        -
        4714  pItemPtr->NextFreeIndex = block.FirstFreeIndex;
        -
        4715  block.FirstFreeIndex = index;
        -
        4716  return;
        -
        4717  }
        -
        4718  }
        -
        4719  VMA_ASSERT(0 && "Pointer doesn't belong to this memory pool.");
        -
        4720 }
        -
        4721 
        -
        4722 template<typename T>
        -
        4723 typename VmaPoolAllocator<T>::ItemBlock& VmaPoolAllocator<T>::CreateNewBlock()
        -
        4724 {
        -
        4725  const uint32_t newBlockCapacity = m_ItemBlocks.empty() ?
        -
        4726  m_FirstBlockCapacity : m_ItemBlocks.back().Capacity * 3 / 2;
        -
        4727 
        -
        4728  const ItemBlock newBlock = {
        -
        4729  vma_new_array(m_pAllocationCallbacks, Item, newBlockCapacity),
        -
        4730  newBlockCapacity,
        -
        4731  0 };
        -
        4732 
        -
        4733  m_ItemBlocks.push_back(newBlock);
        +
        4688 template<typename T, typename allocatorT>
        +
        4689 static void VmaVectorInsert(VmaVector<T, allocatorT>& vec, size_t index, const T& item)
        +
        4690 {
        +
        4691  vec.insert(index, item);
        +
        4692 }
        +
        4693 
        +
        4694 template<typename T, typename allocatorT>
        +
        4695 static void VmaVectorRemove(VmaVector<T, allocatorT>& vec, size_t index)
        +
        4696 {
        +
        4697  vec.remove(index);
        +
        4698 }
        +
        4699 
        +
        4700 #endif // #if VMA_USE_STL_VECTOR
        +
        4701 
        +
        4702 template<typename CmpLess, typename VectorT>
        +
        4703 size_t VmaVectorInsertSorted(VectorT& vector, const typename VectorT::value_type& value)
        +
        4704 {
        +
        4705  const size_t indexToInsert = VmaBinaryFindFirstNotLess(
        +
        4706  vector.data(),
        +
        4707  vector.data() + vector.size(),
        +
        4708  value,
        +
        4709  CmpLess()) - vector.data();
        +
        4710  VmaVectorInsert(vector, indexToInsert, value);
        +
        4711  return indexToInsert;
        +
        4712 }
        +
        4713 
        +
        4714 template<typename CmpLess, typename VectorT>
        +
        4715 bool VmaVectorRemoveSorted(VectorT& vector, const typename VectorT::value_type& value)
        +
        4716 {
        +
        4717  CmpLess comparator;
        +
        4718  typename VectorT::iterator it = VmaBinaryFindFirstNotLess(
        +
        4719  vector.begin(),
        +
        4720  vector.end(),
        +
        4721  value,
        +
        4722  comparator);
        +
        4723  if((it != vector.end()) && !comparator(*it, value) && !comparator(value, *it))
        +
        4724  {
        +
        4725  size_t indexToRemove = it - vector.begin();
        +
        4726  VmaVectorRemove(vector, indexToRemove);
        +
        4727  return true;
        +
        4728  }
        +
        4729  return false;
        +
        4730 }
        +
        4731 
        +
        4733 // class VmaPoolAllocator
        4734 
        -
        4735  // Setup singly-linked list of all free items in this block.
        -
        4736  for(uint32_t i = 0; i < newBlockCapacity - 1; ++i)
        -
        4737  newBlock.pItems[i].NextFreeIndex = i + 1;
        -
        4738  newBlock.pItems[newBlockCapacity - 1].NextFreeIndex = UINT32_MAX;
        -
        4739  return m_ItemBlocks.back();
        -
        4740 }
        -
        4741 
        -
        4743 // class VmaRawList, VmaList
        -
        4744 
        -
        4745 #if VMA_USE_STL_LIST
        -
        4746 
        -
        4747 #define VmaList std::list
        -
        4748 
        -
        4749 #else // #if VMA_USE_STL_LIST
        -
        4750 
        -
        4751 template<typename T>
        -
        4752 struct VmaListItem
        -
        4753 {
        -
        4754  VmaListItem* pPrev;
        -
        4755  VmaListItem* pNext;
        -
        4756  T Value;
        -
        4757 };
        -
        4758 
        -
        4759 // Doubly linked list.
        -
        4760 template<typename T>
        -
        4761 class VmaRawList
        -
        4762 {
        -
        4763  VMA_CLASS_NO_COPY(VmaRawList)
        -
        4764 public:
        -
        4765  typedef VmaListItem<T> ItemType;
        -
        4766 
        -
        4767  VmaRawList(const VkAllocationCallbacks* pAllocationCallbacks);
        -
        4768  ~VmaRawList();
        -
        4769  void Clear();
        +
        4735 /*
        +
        4736 Allocator for objects of type T using a list of arrays (pools) to speed up
        +
        4737 allocation. Number of elements that can be allocated is not bounded because
        +
        4738 allocator can create multiple blocks.
        +
        4739 */
        +
        4740 template<typename T>
        +
        4741 class VmaPoolAllocator
        +
        4742 {
        +
        4743  VMA_CLASS_NO_COPY(VmaPoolAllocator)
        +
        4744 public:
        +
        4745  VmaPoolAllocator(const VkAllocationCallbacks* pAllocationCallbacks, uint32_t firstBlockCapacity);
        +
        4746  ~VmaPoolAllocator();
        +
        4747  template<typename... Types> T* Alloc(Types... args);
        +
        4748  void Free(T* ptr);
        +
        4749 
        +
        4750 private:
        +
        4751  union Item
        +
        4752  {
        +
        4753  uint32_t NextFreeIndex;
        +
        4754  alignas(T) char Value[sizeof(T)];
        +
        4755  };
        +
        4756 
        +
        4757  struct ItemBlock
        +
        4758  {
        +
        4759  Item* pItems;
        +
        4760  uint32_t Capacity;
        +
        4761  uint32_t FirstFreeIndex;
        +
        4762  };
        +
        4763 
        +
        4764  const VkAllocationCallbacks* m_pAllocationCallbacks;
        +
        4765  const uint32_t m_FirstBlockCapacity;
        +
        4766  VmaVector< ItemBlock, VmaStlAllocator<ItemBlock> > m_ItemBlocks;
        +
        4767 
        +
        4768  ItemBlock& CreateNewBlock();
        +
        4769 };
        4770 
        -
        4771  size_t GetCount() const { return m_Count; }
        -
        4772  bool IsEmpty() const { return m_Count == 0; }
        -
        4773 
        -
        4774  ItemType* Front() { return m_pFront; }
        -
        4775  const ItemType* Front() const { return m_pFront; }
        -
        4776  ItemType* Back() { return m_pBack; }
        -
        4777  const ItemType* Back() const { return m_pBack; }
        -
        4778 
        -
        4779  ItemType* PushBack();
        -
        4780  ItemType* PushFront();
        -
        4781  ItemType* PushBack(const T& value);
        -
        4782  ItemType* PushFront(const T& value);
        -
        4783  void PopBack();
        -
        4784  void PopFront();
        -
        4785 
        -
        4786  // Item can be null - it means PushBack.
        -
        4787  ItemType* InsertBefore(ItemType* pItem);
        -
        4788  // Item can be null - it means PushFront.
        -
        4789  ItemType* InsertAfter(ItemType* pItem);
        -
        4790 
        -
        4791  ItemType* InsertBefore(ItemType* pItem, const T& value);
        -
        4792  ItemType* InsertAfter(ItemType* pItem, const T& value);
        -
        4793 
        -
        4794  void Remove(ItemType* pItem);
        -
        4795 
        -
        4796 private:
        -
        4797  const VkAllocationCallbacks* const m_pAllocationCallbacks;
        -
        4798  VmaPoolAllocator<ItemType> m_ItemAllocator;
        -
        4799  ItemType* m_pFront;
        -
        4800  ItemType* m_pBack;
        -
        4801  size_t m_Count;
        -
        4802 };
        -
        4803 
        -
        4804 template<typename T>
        -
        4805 VmaRawList<T>::VmaRawList(const VkAllocationCallbacks* pAllocationCallbacks) :
        -
        4806  m_pAllocationCallbacks(pAllocationCallbacks),
        -
        4807  m_ItemAllocator(pAllocationCallbacks, 128),
        -
        4808  m_pFront(VMA_NULL),
        -
        4809  m_pBack(VMA_NULL),
        -
        4810  m_Count(0)
        -
        4811 {
        +
        4771 template<typename T>
        +
        4772 VmaPoolAllocator<T>::VmaPoolAllocator(const VkAllocationCallbacks* pAllocationCallbacks, uint32_t firstBlockCapacity) :
        +
        4773  m_pAllocationCallbacks(pAllocationCallbacks),
        +
        4774  m_FirstBlockCapacity(firstBlockCapacity),
        +
        4775  m_ItemBlocks(VmaStlAllocator<ItemBlock>(pAllocationCallbacks))
        +
        4776 {
        +
        4777  VMA_ASSERT(m_FirstBlockCapacity > 1);
        +
        4778 }
        +
        4779 
        +
        4780 template<typename T>
        +
        4781 VmaPoolAllocator<T>::~VmaPoolAllocator()
        +
        4782 {
        +
        4783  for(size_t i = m_ItemBlocks.size(); i--; )
        +
        4784  vma_delete_array(m_pAllocationCallbacks, m_ItemBlocks[i].pItems, m_ItemBlocks[i].Capacity);
        +
        4785  m_ItemBlocks.clear();
        +
        4786 }
        +
        4787 
        +
        4788 template<typename T>
        +
        4789 template<typename... Types> T* VmaPoolAllocator<T>::Alloc(Types... args)
        +
        4790 {
        +
        4791  for(size_t i = m_ItemBlocks.size(); i--; )
        +
        4792  {
        +
        4793  ItemBlock& block = m_ItemBlocks[i];
        +
        4794  // This block has some free items: Use first one.
        +
        4795  if(block.FirstFreeIndex != UINT32_MAX)
        +
        4796  {
        +
        4797  Item* const pItem = &block.pItems[block.FirstFreeIndex];
        +
        4798  block.FirstFreeIndex = pItem->NextFreeIndex;
        +
        4799  T* result = (T*)&pItem->Value;
        +
        4800  new(result)T(std::forward<Types>(args)...); // Explicit constructor call.
        +
        4801  return result;
        +
        4802  }
        +
        4803  }
        +
        4804 
        +
        4805  // No block has free item: Create new one and use it.
        +
        4806  ItemBlock& newBlock = CreateNewBlock();
        +
        4807  Item* const pItem = &newBlock.pItems[0];
        +
        4808  newBlock.FirstFreeIndex = pItem->NextFreeIndex;
        +
        4809  T* result = (T*)&pItem->Value;
        +
        4810  new(result)T(std::forward<Types>(args)...); // Explicit constructor call.
        +
        4811  return result;
        4812 }
        4813 
        4814 template<typename T>
        -
        4815 VmaRawList<T>::~VmaRawList()
        +
        4815 void VmaPoolAllocator<T>::Free(T* ptr)
        4816 {
        -
        4817  // Intentionally not calling Clear, because that would be unnecessary
        -
        4818  // computations to return all items to m_ItemAllocator as free.
        -
        4819 }
        -
        4820 
        -
        4821 template<typename T>
        -
        4822 void VmaRawList<T>::Clear()
        -
        4823 {
        -
        4824  if(IsEmpty() == false)
        -
        4825  {
        -
        4826  ItemType* pItem = m_pBack;
        -
        4827  while(pItem != VMA_NULL)
        +
        4817  // Search all memory blocks to find ptr.
        +
        4818  for(size_t i = m_ItemBlocks.size(); i--; )
        +
        4819  {
        +
        4820  ItemBlock& block = m_ItemBlocks[i];
        +
        4821 
        +
        4822  // Casting to union.
        +
        4823  Item* pItemPtr;
        +
        4824  memcpy(&pItemPtr, &ptr, sizeof(pItemPtr));
        +
        4825 
        +
        4826  // Check if pItemPtr is in address range of this block.
        +
        4827  if((pItemPtr >= block.pItems) && (pItemPtr < block.pItems + block.Capacity))
        4828  {
        -
        4829  ItemType* const pPrevItem = pItem->pPrev;
        -
        4830  m_ItemAllocator.Free(pItem);
        -
        4831  pItem = pPrevItem;
        -
        4832  }
        -
        4833  m_pFront = VMA_NULL;
        -
        4834  m_pBack = VMA_NULL;
        -
        4835  m_Count = 0;
        -
        4836  }
        +
        4829  ptr->~T(); // Explicit destructor call.
        +
        4830  const uint32_t index = static_cast<uint32_t>(pItemPtr - block.pItems);
        +
        4831  pItemPtr->NextFreeIndex = block.FirstFreeIndex;
        +
        4832  block.FirstFreeIndex = index;
        +
        4833  return;
        +
        4834  }
        +
        4835  }
        +
        4836  VMA_ASSERT(0 && "Pointer doesn't belong to this memory pool.");
        4837 }
        4838 
        4839 template<typename T>
        -
        4840 VmaListItem<T>* VmaRawList<T>::PushBack()
        +
        4840 typename VmaPoolAllocator<T>::ItemBlock& VmaPoolAllocator<T>::CreateNewBlock()
        4841 {
        -
        4842  ItemType* const pNewItem = m_ItemAllocator.Alloc();
        -
        4843  pNewItem->pNext = VMA_NULL;
        -
        4844  if(IsEmpty())
        -
        4845  {
        -
        4846  pNewItem->pPrev = VMA_NULL;
        -
        4847  m_pFront = pNewItem;
        -
        4848  m_pBack = pNewItem;
        -
        4849  m_Count = 1;
        -
        4850  }
        -
        4851  else
        -
        4852  {
        -
        4853  pNewItem->pPrev = m_pBack;
        -
        4854  m_pBack->pNext = pNewItem;
        -
        4855  m_pBack = pNewItem;
        -
        4856  ++m_Count;
        -
        4857  }
        -
        4858  return pNewItem;
        -
        4859 }
        -
        4860 
        -
        4861 template<typename T>
        -
        4862 VmaListItem<T>* VmaRawList<T>::PushFront()
        -
        4863 {
        -
        4864  ItemType* const pNewItem = m_ItemAllocator.Alloc();
        -
        4865  pNewItem->pPrev = VMA_NULL;
        -
        4866  if(IsEmpty())
        -
        4867  {
        -
        4868  pNewItem->pNext = VMA_NULL;
        -
        4869  m_pFront = pNewItem;
        -
        4870  m_pBack = pNewItem;
        -
        4871  m_Count = 1;
        -
        4872  }
        -
        4873  else
        -
        4874  {
        -
        4875  pNewItem->pNext = m_pFront;
        -
        4876  m_pFront->pPrev = pNewItem;
        -
        4877  m_pFront = pNewItem;
        -
        4878  ++m_Count;
        -
        4879  }
        -
        4880  return pNewItem;
        -
        4881 }
        -
        4882 
        -
        4883 template<typename T>
        -
        4884 VmaListItem<T>* VmaRawList<T>::PushBack(const T& value)
        -
        4885 {
        -
        4886  ItemType* const pNewItem = PushBack();
        -
        4887  pNewItem->Value = value;
        -
        4888  return pNewItem;
        -
        4889 }
        +
        4842  const uint32_t newBlockCapacity = m_ItemBlocks.empty() ?
        +
        4843  m_FirstBlockCapacity : m_ItemBlocks.back().Capacity * 3 / 2;
        +
        4844 
        +
        4845  const ItemBlock newBlock = {
        +
        4846  vma_new_array(m_pAllocationCallbacks, Item, newBlockCapacity),
        +
        4847  newBlockCapacity,
        +
        4848  0 };
        +
        4849 
        +
        4850  m_ItemBlocks.push_back(newBlock);
        +
        4851 
        +
        4852  // Setup singly-linked list of all free items in this block.
        +
        4853  for(uint32_t i = 0; i < newBlockCapacity - 1; ++i)
        +
        4854  newBlock.pItems[i].NextFreeIndex = i + 1;
        +
        4855  newBlock.pItems[newBlockCapacity - 1].NextFreeIndex = UINT32_MAX;
        +
        4856  return m_ItemBlocks.back();
        +
        4857 }
        +
        4858 
        +
        4860 // class VmaRawList, VmaList
        +
        4861 
        +
        4862 #if VMA_USE_STL_LIST
        +
        4863 
        +
        4864 #define VmaList std::list
        +
        4865 
        +
        4866 #else // #if VMA_USE_STL_LIST
        +
        4867 
        +
        4868 template<typename T>
        +
        4869 struct VmaListItem
        +
        4870 {
        +
        4871  VmaListItem* pPrev;
        +
        4872  VmaListItem* pNext;
        +
        4873  T Value;
        +
        4874 };
        +
        4875 
        +
        4876 // Doubly linked list.
        +
        4877 template<typename T>
        +
        4878 class VmaRawList
        +
        4879 {
        +
        4880  VMA_CLASS_NO_COPY(VmaRawList)
        +
        4881 public:
        +
        4882  typedef VmaListItem<T> ItemType;
        +
        4883 
        +
        4884  VmaRawList(const VkAllocationCallbacks* pAllocationCallbacks);
        +
        4885  ~VmaRawList();
        +
        4886  void Clear();
        +
        4887 
        +
        4888  size_t GetCount() const { return m_Count; }
        +
        4889  bool IsEmpty() const { return m_Count == 0; }
        4890 
        -
        4891 template<typename T>
        -
        4892 VmaListItem<T>* VmaRawList<T>::PushFront(const T& value)
        -
        4893 {
        -
        4894  ItemType* const pNewItem = PushFront();
        -
        4895  pNewItem->Value = value;
        -
        4896  return pNewItem;
        -
        4897 }
        -
        4898 
        -
        4899 template<typename T>
        -
        4900 void VmaRawList<T>::PopBack()
        -
        4901 {
        -
        4902  VMA_HEAVY_ASSERT(m_Count > 0);
        -
        4903  ItemType* const pBackItem = m_pBack;
        -
        4904  ItemType* const pPrevItem = pBackItem->pPrev;
        -
        4905  if(pPrevItem != VMA_NULL)
        -
        4906  {
        -
        4907  pPrevItem->pNext = VMA_NULL;
        -
        4908  }
        -
        4909  m_pBack = pPrevItem;
        -
        4910  m_ItemAllocator.Free(pBackItem);
        -
        4911  --m_Count;
        -
        4912 }
        -
        4913 
        -
        4914 template<typename T>
        -
        4915 void VmaRawList<T>::PopFront()
        -
        4916 {
        -
        4917  VMA_HEAVY_ASSERT(m_Count > 0);
        -
        4918  ItemType* const pFrontItem = m_pFront;
        -
        4919  ItemType* const pNextItem = pFrontItem->pNext;
        -
        4920  if(pNextItem != VMA_NULL)
        -
        4921  {
        -
        4922  pNextItem->pPrev = VMA_NULL;
        -
        4923  }
        -
        4924  m_pFront = pNextItem;
        -
        4925  m_ItemAllocator.Free(pFrontItem);
        -
        4926  --m_Count;
        -
        4927 }
        -
        4928 
        -
        4929 template<typename T>
        -
        4930 void VmaRawList<T>::Remove(ItemType* pItem)
        -
        4931 {
        -
        4932  VMA_HEAVY_ASSERT(pItem != VMA_NULL);
        -
        4933  VMA_HEAVY_ASSERT(m_Count > 0);
        -
        4934 
        -
        4935  if(pItem->pPrev != VMA_NULL)
        -
        4936  {
        -
        4937  pItem->pPrev->pNext = pItem->pNext;
        -
        4938  }
        -
        4939  else
        -
        4940  {
        -
        4941  VMA_HEAVY_ASSERT(m_pFront == pItem);
        -
        4942  m_pFront = pItem->pNext;
        -
        4943  }
        -
        4944 
        -
        4945  if(pItem->pNext != VMA_NULL)
        -
        4946  {
        -
        4947  pItem->pNext->pPrev = pItem->pPrev;
        -
        4948  }
        -
        4949  else
        -
        4950  {
        -
        4951  VMA_HEAVY_ASSERT(m_pBack == pItem);
        -
        4952  m_pBack = pItem->pPrev;
        +
        4891  ItemType* Front() { return m_pFront; }
        +
        4892  const ItemType* Front() const { return m_pFront; }
        +
        4893  ItemType* Back() { return m_pBack; }
        +
        4894  const ItemType* Back() const { return m_pBack; }
        +
        4895 
        +
        4896  ItemType* PushBack();
        +
        4897  ItemType* PushFront();
        +
        4898  ItemType* PushBack(const T& value);
        +
        4899  ItemType* PushFront(const T& value);
        +
        4900  void PopBack();
        +
        4901  void PopFront();
        +
        4902 
        +
        4903  // Item can be null - it means PushBack.
        +
        4904  ItemType* InsertBefore(ItemType* pItem);
        +
        4905  // Item can be null - it means PushFront.
        +
        4906  ItemType* InsertAfter(ItemType* pItem);
        +
        4907 
        +
        4908  ItemType* InsertBefore(ItemType* pItem, const T& value);
        +
        4909  ItemType* InsertAfter(ItemType* pItem, const T& value);
        +
        4910 
        +
        4911  void Remove(ItemType* pItem);
        +
        4912 
        +
        4913 private:
        +
        4914  const VkAllocationCallbacks* const m_pAllocationCallbacks;
        +
        4915  VmaPoolAllocator<ItemType> m_ItemAllocator;
        +
        4916  ItemType* m_pFront;
        +
        4917  ItemType* m_pBack;
        +
        4918  size_t m_Count;
        +
        4919 };
        +
        4920 
        +
        4921 template<typename T>
        +
        4922 VmaRawList<T>::VmaRawList(const VkAllocationCallbacks* pAllocationCallbacks) :
        +
        4923  m_pAllocationCallbacks(pAllocationCallbacks),
        +
        4924  m_ItemAllocator(pAllocationCallbacks, 128),
        +
        4925  m_pFront(VMA_NULL),
        +
        4926  m_pBack(VMA_NULL),
        +
        4927  m_Count(0)
        +
        4928 {
        +
        4929 }
        +
        4930 
        +
        4931 template<typename T>
        +
        4932 VmaRawList<T>::~VmaRawList()
        +
        4933 {
        +
        4934  // Intentionally not calling Clear, because that would be unnecessary
        +
        4935  // computations to return all items to m_ItemAllocator as free.
        +
        4936 }
        +
        4937 
        +
        4938 template<typename T>
        +
        4939 void VmaRawList<T>::Clear()
        +
        4940 {
        +
        4941  if(IsEmpty() == false)
        +
        4942  {
        +
        4943  ItemType* pItem = m_pBack;
        +
        4944  while(pItem != VMA_NULL)
        +
        4945  {
        +
        4946  ItemType* const pPrevItem = pItem->pPrev;
        +
        4947  m_ItemAllocator.Free(pItem);
        +
        4948  pItem = pPrevItem;
        +
        4949  }
        +
        4950  m_pFront = VMA_NULL;
        +
        4951  m_pBack = VMA_NULL;
        +
        4952  m_Count = 0;
        4953  }
        -
        4954 
        -
        4955  m_ItemAllocator.Free(pItem);
        -
        4956  --m_Count;
        -
        4957 }
        -
        4958 
        -
        4959 template<typename T>
        -
        4960 VmaListItem<T>* VmaRawList<T>::InsertBefore(ItemType* pItem)
        -
        4961 {
        -
        4962  if(pItem != VMA_NULL)
        -
        4963  {
        -
        4964  ItemType* const prevItem = pItem->pPrev;
        -
        4965  ItemType* const newItem = m_ItemAllocator.Alloc();
        -
        4966  newItem->pPrev = prevItem;
        -
        4967  newItem->pNext = pItem;
        -
        4968  pItem->pPrev = newItem;
        -
        4969  if(prevItem != VMA_NULL)
        -
        4970  {
        -
        4971  prevItem->pNext = newItem;
        -
        4972  }
        -
        4973  else
        -
        4974  {
        -
        4975  VMA_HEAVY_ASSERT(m_pFront == pItem);
        -
        4976  m_pFront = newItem;
        -
        4977  }
        -
        4978  ++m_Count;
        -
        4979  return newItem;
        -
        4980  }
        -
        4981  else
        -
        4982  return PushBack();
        -
        4983 }
        -
        4984 
        -
        4985 template<typename T>
        -
        4986 VmaListItem<T>* VmaRawList<T>::InsertAfter(ItemType* pItem)
        -
        4987 {
        -
        4988  if(pItem != VMA_NULL)
        -
        4989  {
        -
        4990  ItemType* const nextItem = pItem->pNext;
        -
        4991  ItemType* const newItem = m_ItemAllocator.Alloc();
        -
        4992  newItem->pNext = nextItem;
        -
        4993  newItem->pPrev = pItem;
        -
        4994  pItem->pNext = newItem;
        -
        4995  if(nextItem != VMA_NULL)
        -
        4996  {
        -
        4997  nextItem->pPrev = newItem;
        -
        4998  }
        -
        4999  else
        -
        5000  {
        -
        5001  VMA_HEAVY_ASSERT(m_pBack == pItem);
        -
        5002  m_pBack = newItem;
        -
        5003  }
        -
        5004  ++m_Count;
        -
        5005  return newItem;
        -
        5006  }
        -
        5007  else
        -
        5008  return PushFront();
        -
        5009 }
        -
        5010 
        -
        5011 template<typename T>
        -
        5012 VmaListItem<T>* VmaRawList<T>::InsertBefore(ItemType* pItem, const T& value)
        -
        5013 {
        -
        5014  ItemType* const newItem = InsertBefore(pItem);
        -
        5015  newItem->Value = value;
        -
        5016  return newItem;
        -
        5017 }
        -
        5018 
        -
        5019 template<typename T>
        -
        5020 VmaListItem<T>* VmaRawList<T>::InsertAfter(ItemType* pItem, const T& value)
        -
        5021 {
        -
        5022  ItemType* const newItem = InsertAfter(pItem);
        -
        5023  newItem->Value = value;
        -
        5024  return newItem;
        -
        5025 }
        -
        5026 
        -
        5027 template<typename T, typename AllocatorT>
        -
        5028 class VmaList
        -
        5029 {
        -
        5030  VMA_CLASS_NO_COPY(VmaList)
        -
        5031 public:
        -
        5032  class iterator
        -
        5033  {
        -
        5034  public:
        -
        5035  iterator() :
        -
        5036  m_pList(VMA_NULL),
        -
        5037  m_pItem(VMA_NULL)
        -
        5038  {
        -
        5039  }
        -
        5040 
        -
        5041  T& operator*() const
        -
        5042  {
        -
        5043  VMA_HEAVY_ASSERT(m_pItem != VMA_NULL);
        -
        5044  return m_pItem->Value;
        -
        5045  }
        -
        5046  T* operator->() const
        -
        5047  {
        -
        5048  VMA_HEAVY_ASSERT(m_pItem != VMA_NULL);
        -
        5049  return &m_pItem->Value;
        -
        5050  }
        +
        4954 }
        +
        4955 
        +
        4956 template<typename T>
        +
        4957 VmaListItem<T>* VmaRawList<T>::PushBack()
        +
        4958 {
        +
        4959  ItemType* const pNewItem = m_ItemAllocator.Alloc();
        +
        4960  pNewItem->pNext = VMA_NULL;
        +
        4961  if(IsEmpty())
        +
        4962  {
        +
        4963  pNewItem->pPrev = VMA_NULL;
        +
        4964  m_pFront = pNewItem;
        +
        4965  m_pBack = pNewItem;
        +
        4966  m_Count = 1;
        +
        4967  }
        +
        4968  else
        +
        4969  {
        +
        4970  pNewItem->pPrev = m_pBack;
        +
        4971  m_pBack->pNext = pNewItem;
        +
        4972  m_pBack = pNewItem;
        +
        4973  ++m_Count;
        +
        4974  }
        +
        4975  return pNewItem;
        +
        4976 }
        +
        4977 
        +
        4978 template<typename T>
        +
        4979 VmaListItem<T>* VmaRawList<T>::PushFront()
        +
        4980 {
        +
        4981  ItemType* const pNewItem = m_ItemAllocator.Alloc();
        +
        4982  pNewItem->pPrev = VMA_NULL;
        +
        4983  if(IsEmpty())
        +
        4984  {
        +
        4985  pNewItem->pNext = VMA_NULL;
        +
        4986  m_pFront = pNewItem;
        +
        4987  m_pBack = pNewItem;
        +
        4988  m_Count = 1;
        +
        4989  }
        +
        4990  else
        +
        4991  {
        +
        4992  pNewItem->pNext = m_pFront;
        +
        4993  m_pFront->pPrev = pNewItem;
        +
        4994  m_pFront = pNewItem;
        +
        4995  ++m_Count;
        +
        4996  }
        +
        4997  return pNewItem;
        +
        4998 }
        +
        4999 
        +
        5000 template<typename T>
        +
        5001 VmaListItem<T>* VmaRawList<T>::PushBack(const T& value)
        +
        5002 {
        +
        5003  ItemType* const pNewItem = PushBack();
        +
        5004  pNewItem->Value = value;
        +
        5005  return pNewItem;
        +
        5006 }
        +
        5007 
        +
        5008 template<typename T>
        +
        5009 VmaListItem<T>* VmaRawList<T>::PushFront(const T& value)
        +
        5010 {
        +
        5011  ItemType* const pNewItem = PushFront();
        +
        5012  pNewItem->Value = value;
        +
        5013  return pNewItem;
        +
        5014 }
        +
        5015 
        +
        5016 template<typename T>
        +
        5017 void VmaRawList<T>::PopBack()
        +
        5018 {
        +
        5019  VMA_HEAVY_ASSERT(m_Count > 0);
        +
        5020  ItemType* const pBackItem = m_pBack;
        +
        5021  ItemType* const pPrevItem = pBackItem->pPrev;
        +
        5022  if(pPrevItem != VMA_NULL)
        +
        5023  {
        +
        5024  pPrevItem->pNext = VMA_NULL;
        +
        5025  }
        +
        5026  m_pBack = pPrevItem;
        +
        5027  m_ItemAllocator.Free(pBackItem);
        +
        5028  --m_Count;
        +
        5029 }
        +
        5030 
        +
        5031 template<typename T>
        +
        5032 void VmaRawList<T>::PopFront()
        +
        5033 {
        +
        5034  VMA_HEAVY_ASSERT(m_Count > 0);
        +
        5035  ItemType* const pFrontItem = m_pFront;
        +
        5036  ItemType* const pNextItem = pFrontItem->pNext;
        +
        5037  if(pNextItem != VMA_NULL)
        +
        5038  {
        +
        5039  pNextItem->pPrev = VMA_NULL;
        +
        5040  }
        +
        5041  m_pFront = pNextItem;
        +
        5042  m_ItemAllocator.Free(pFrontItem);
        +
        5043  --m_Count;
        +
        5044 }
        +
        5045 
        +
        5046 template<typename T>
        +
        5047 void VmaRawList<T>::Remove(ItemType* pItem)
        +
        5048 {
        +
        5049  VMA_HEAVY_ASSERT(pItem != VMA_NULL);
        +
        5050  VMA_HEAVY_ASSERT(m_Count > 0);
        5051 
        -
        5052  iterator& operator++()
        -
        5053  {
        -
        5054  VMA_HEAVY_ASSERT(m_pItem != VMA_NULL);
        -
        5055  m_pItem = m_pItem->pNext;
        -
        5056  return *this;
        -
        5057  }
        -
        5058  iterator& operator--()
        -
        5059  {
        -
        5060  if(m_pItem != VMA_NULL)
        -
        5061  {
        -
        5062  m_pItem = m_pItem->pPrev;
        -
        5063  }
        -
        5064  else
        -
        5065  {
        -
        5066  VMA_HEAVY_ASSERT(!m_pList->IsEmpty());
        -
        5067  m_pItem = m_pList->Back();
        -
        5068  }
        -
        5069  return *this;
        -
        5070  }
        +
        5052  if(pItem->pPrev != VMA_NULL)
        +
        5053  {
        +
        5054  pItem->pPrev->pNext = pItem->pNext;
        +
        5055  }
        +
        5056  else
        +
        5057  {
        +
        5058  VMA_HEAVY_ASSERT(m_pFront == pItem);
        +
        5059  m_pFront = pItem->pNext;
        +
        5060  }
        +
        5061 
        +
        5062  if(pItem->pNext != VMA_NULL)
        +
        5063  {
        +
        5064  pItem->pNext->pPrev = pItem->pPrev;
        +
        5065  }
        +
        5066  else
        +
        5067  {
        +
        5068  VMA_HEAVY_ASSERT(m_pBack == pItem);
        +
        5069  m_pBack = pItem->pPrev;
        +
        5070  }
        5071 
        -
        5072  iterator operator++(int)
        -
        5073  {
        -
        5074  iterator result = *this;
        -
        5075  ++*this;
        -
        5076  return result;
        -
        5077  }
        -
        5078  iterator operator--(int)
        -
        5079  {
        -
        5080  iterator result = *this;
        -
        5081  --*this;
        -
        5082  return result;
        -
        5083  }
        -
        5084 
        -
        5085  bool operator==(const iterator& rhs) const
        -
        5086  {
        -
        5087  VMA_HEAVY_ASSERT(m_pList == rhs.m_pList);
        -
        5088  return m_pItem == rhs.m_pItem;
        +
        5072  m_ItemAllocator.Free(pItem);
        +
        5073  --m_Count;
        +
        5074 }
        +
        5075 
        +
        5076 template<typename T>
        +
        5077 VmaListItem<T>* VmaRawList<T>::InsertBefore(ItemType* pItem)
        +
        5078 {
        +
        5079  if(pItem != VMA_NULL)
        +
        5080  {
        +
        5081  ItemType* const prevItem = pItem->pPrev;
        +
        5082  ItemType* const newItem = m_ItemAllocator.Alloc();
        +
        5083  newItem->pPrev = prevItem;
        +
        5084  newItem->pNext = pItem;
        +
        5085  pItem->pPrev = newItem;
        +
        5086  if(prevItem != VMA_NULL)
        +
        5087  {
        +
        5088  prevItem->pNext = newItem;
        5089  }
        -
        5090  bool operator!=(const iterator& rhs) const
        -
        5091  {
        -
        5092  VMA_HEAVY_ASSERT(m_pList == rhs.m_pList);
        -
        5093  return m_pItem != rhs.m_pItem;
        +
        5090  else
        +
        5091  {
        +
        5092  VMA_HEAVY_ASSERT(m_pFront == pItem);
        +
        5093  m_pFront = newItem;
        5094  }
        -
        5095 
        -
        5096  private:
        -
        5097  VmaRawList<T>* m_pList;
        -
        5098  VmaListItem<T>* m_pItem;
        -
        5099 
        -
        5100  iterator(VmaRawList<T>* pList, VmaListItem<T>* pItem) :
        -
        5101  m_pList(pList),
        -
        5102  m_pItem(pItem)
        -
        5103  {
        -
        5104  }
        -
        5105 
        -
        5106  friend class VmaList<T, AllocatorT>;
        -
        5107  };
        -
        5108 
        -
        5109  class const_iterator
        -
        5110  {
        -
        5111  public:
        -
        5112  const_iterator() :
        -
        5113  m_pList(VMA_NULL),
        -
        5114  m_pItem(VMA_NULL)
        -
        5115  {
        -
        5116  }
        -
        5117 
        -
        5118  const_iterator(const iterator& src) :
        -
        5119  m_pList(src.m_pList),
        -
        5120  m_pItem(src.m_pItem)
        -
        5121  {
        -
        5122  }
        -
        5123 
        -
        5124  const T& operator*() const
        -
        5125  {
        -
        5126  VMA_HEAVY_ASSERT(m_pItem != VMA_NULL);
        -
        5127  return m_pItem->Value;
        -
        5128  }
        -
        5129  const T* operator->() const
        -
        5130  {
        -
        5131  VMA_HEAVY_ASSERT(m_pItem != VMA_NULL);
        -
        5132  return &m_pItem->Value;
        -
        5133  }
        -
        5134 
        -
        5135  const_iterator& operator++()
        -
        5136  {
        -
        5137  VMA_HEAVY_ASSERT(m_pItem != VMA_NULL);
        -
        5138  m_pItem = m_pItem->pNext;
        -
        5139  return *this;
        -
        5140  }
        -
        5141  const_iterator& operator--()
        -
        5142  {
        -
        5143  if(m_pItem != VMA_NULL)
        -
        5144  {
        -
        5145  m_pItem = m_pItem->pPrev;
        -
        5146  }
        -
        5147  else
        -
        5148  {
        -
        5149  VMA_HEAVY_ASSERT(!m_pList->IsEmpty());
        -
        5150  m_pItem = m_pList->Back();
        -
        5151  }
        -
        5152  return *this;
        -
        5153  }
        -
        5154 
        -
        5155  const_iterator operator++(int)
        -
        5156  {
        -
        5157  const_iterator result = *this;
        -
        5158  ++*this;
        -
        5159  return result;
        -
        5160  }
        -
        5161  const_iterator operator--(int)
        -
        5162  {
        -
        5163  const_iterator result = *this;
        -
        5164  --*this;
        -
        5165  return result;
        -
        5166  }
        -
        5167 
        -
        5168  bool operator==(const const_iterator& rhs) const
        -
        5169  {
        -
        5170  VMA_HEAVY_ASSERT(m_pList == rhs.m_pList);
        -
        5171  return m_pItem == rhs.m_pItem;
        -
        5172  }
        -
        5173  bool operator!=(const const_iterator& rhs) const
        -
        5174  {
        -
        5175  VMA_HEAVY_ASSERT(m_pList == rhs.m_pList);
        -
        5176  return m_pItem != rhs.m_pItem;
        -
        5177  }
        -
        5178 
        -
        5179  private:
        -
        5180  const_iterator(const VmaRawList<T>* pList, const VmaListItem<T>* pItem) :
        -
        5181  m_pList(pList),
        -
        5182  m_pItem(pItem)
        -
        5183  {
        -
        5184  }
        -
        5185 
        -
        5186  const VmaRawList<T>* m_pList;
        -
        5187  const VmaListItem<T>* m_pItem;
        +
        5095  ++m_Count;
        +
        5096  return newItem;
        +
        5097  }
        +
        5098  else
        +
        5099  return PushBack();
        +
        5100 }
        +
        5101 
        +
        5102 template<typename T>
        +
        5103 VmaListItem<T>* VmaRawList<T>::InsertAfter(ItemType* pItem)
        +
        5104 {
        +
        5105  if(pItem != VMA_NULL)
        +
        5106  {
        +
        5107  ItemType* const nextItem = pItem->pNext;
        +
        5108  ItemType* const newItem = m_ItemAllocator.Alloc();
        +
        5109  newItem->pNext = nextItem;
        +
        5110  newItem->pPrev = pItem;
        +
        5111  pItem->pNext = newItem;
        +
        5112  if(nextItem != VMA_NULL)
        +
        5113  {
        +
        5114  nextItem->pPrev = newItem;
        +
        5115  }
        +
        5116  else
        +
        5117  {
        +
        5118  VMA_HEAVY_ASSERT(m_pBack == pItem);
        +
        5119  m_pBack = newItem;
        +
        5120  }
        +
        5121  ++m_Count;
        +
        5122  return newItem;
        +
        5123  }
        +
        5124  else
        +
        5125  return PushFront();
        +
        5126 }
        +
        5127 
        +
        5128 template<typename T>
        +
        5129 VmaListItem<T>* VmaRawList<T>::InsertBefore(ItemType* pItem, const T& value)
        +
        5130 {
        +
        5131  ItemType* const newItem = InsertBefore(pItem);
        +
        5132  newItem->Value = value;
        +
        5133  return newItem;
        +
        5134 }
        +
        5135 
        +
        5136 template<typename T>
        +
        5137 VmaListItem<T>* VmaRawList<T>::InsertAfter(ItemType* pItem, const T& value)
        +
        5138 {
        +
        5139  ItemType* const newItem = InsertAfter(pItem);
        +
        5140  newItem->Value = value;
        +
        5141  return newItem;
        +
        5142 }
        +
        5143 
        +
        5144 template<typename T, typename AllocatorT>
        +
        5145 class VmaList
        +
        5146 {
        +
        5147  VMA_CLASS_NO_COPY(VmaList)
        +
        5148 public:
        +
        5149  class iterator
        +
        5150  {
        +
        5151  public:
        +
        5152  iterator() :
        +
        5153  m_pList(VMA_NULL),
        +
        5154  m_pItem(VMA_NULL)
        +
        5155  {
        +
        5156  }
        +
        5157 
        +
        5158  T& operator*() const
        +
        5159  {
        +
        5160  VMA_HEAVY_ASSERT(m_pItem != VMA_NULL);
        +
        5161  return m_pItem->Value;
        +
        5162  }
        +
        5163  T* operator->() const
        +
        5164  {
        +
        5165  VMA_HEAVY_ASSERT(m_pItem != VMA_NULL);
        +
        5166  return &m_pItem->Value;
        +
        5167  }
        +
        5168 
        +
        5169  iterator& operator++()
        +
        5170  {
        +
        5171  VMA_HEAVY_ASSERT(m_pItem != VMA_NULL);
        +
        5172  m_pItem = m_pItem->pNext;
        +
        5173  return *this;
        +
        5174  }
        +
        5175  iterator& operator--()
        +
        5176  {
        +
        5177  if(m_pItem != VMA_NULL)
        +
        5178  {
        +
        5179  m_pItem = m_pItem->pPrev;
        +
        5180  }
        +
        5181  else
        +
        5182  {
        +
        5183  VMA_HEAVY_ASSERT(!m_pList->IsEmpty());
        +
        5184  m_pItem = m_pList->Back();
        +
        5185  }
        +
        5186  return *this;
        +
        5187  }
        5188 
        -
        5189  friend class VmaList<T, AllocatorT>;
        -
        5190  };
        -
        5191 
        -
        5192  VmaList(const AllocatorT& allocator) : m_RawList(allocator.m_pCallbacks) { }
        -
        5193 
        -
        5194  bool empty() const { return m_RawList.IsEmpty(); }
        -
        5195  size_t size() const { return m_RawList.GetCount(); }
        -
        5196 
        -
        5197  iterator begin() { return iterator(&m_RawList, m_RawList.Front()); }
        -
        5198  iterator end() { return iterator(&m_RawList, VMA_NULL); }
        -
        5199 
        -
        5200  const_iterator cbegin() const { return const_iterator(&m_RawList, m_RawList.Front()); }
        -
        5201  const_iterator cend() const { return const_iterator(&m_RawList, VMA_NULL); }
        -
        5202 
        -
        5203  void clear() { m_RawList.Clear(); }
        -
        5204  void push_back(const T& value) { m_RawList.PushBack(value); }
        -
        5205  void erase(iterator it) { m_RawList.Remove(it.m_pItem); }
        -
        5206  iterator insert(iterator it, const T& value) { return iterator(&m_RawList, m_RawList.InsertBefore(it.m_pItem, value)); }
        -
        5207 
        -
        5208 private:
        -
        5209  VmaRawList<T> m_RawList;
        -
        5210 };
        -
        5211 
        -
        5212 #endif // #if VMA_USE_STL_LIST
        -
        5213 
        -
        5215 // class VmaMap
        +
        5189  iterator operator++(int)
        +
        5190  {
        +
        5191  iterator result = *this;
        +
        5192  ++*this;
        +
        5193  return result;
        +
        5194  }
        +
        5195  iterator operator--(int)
        +
        5196  {
        +
        5197  iterator result = *this;
        +
        5198  --*this;
        +
        5199  return result;
        +
        5200  }
        +
        5201 
        +
        5202  bool operator==(const iterator& rhs) const
        +
        5203  {
        +
        5204  VMA_HEAVY_ASSERT(m_pList == rhs.m_pList);
        +
        5205  return m_pItem == rhs.m_pItem;
        +
        5206  }
        +
        5207  bool operator!=(const iterator& rhs) const
        +
        5208  {
        +
        5209  VMA_HEAVY_ASSERT(m_pList == rhs.m_pList);
        +
        5210  return m_pItem != rhs.m_pItem;
        +
        5211  }
        +
        5212 
        +
        5213  private:
        +
        5214  VmaRawList<T>* m_pList;
        +
        5215  VmaListItem<T>* m_pItem;
        5216 
        -
        5217 // Unused in this version.
        -
        5218 #if 0
        -
        5219 
        -
        5220 #if VMA_USE_STL_UNORDERED_MAP
        -
        5221 
        -
        5222 #define VmaPair std::pair
        -
        5223 
        -
        5224 #define VMA_MAP_TYPE(KeyT, ValueT) \
        -
        5225  std::unordered_map< KeyT, ValueT, std::hash<KeyT>, std::equal_to<KeyT>, VmaStlAllocator< std::pair<KeyT, ValueT> > >
        -
        5226 
        -
        5227 #else // #if VMA_USE_STL_UNORDERED_MAP
        -
        5228 
        -
        5229 template<typename T1, typename T2>
        -
        5230 struct VmaPair
        -
        5231 {
        -
        5232  T1 first;
        -
        5233  T2 second;
        +
        5217  iterator(VmaRawList<T>* pList, VmaListItem<T>* pItem) :
        +
        5218  m_pList(pList),
        +
        5219  m_pItem(pItem)
        +
        5220  {
        +
        5221  }
        +
        5222 
        +
        5223  friend class VmaList<T, AllocatorT>;
        +
        5224  };
        +
        5225 
        +
        5226  class const_iterator
        +
        5227  {
        +
        5228  public:
        +
        5229  const_iterator() :
        +
        5230  m_pList(VMA_NULL),
        +
        5231  m_pItem(VMA_NULL)
        +
        5232  {
        +
        5233  }
        5234 
        -
        5235  VmaPair() : first(), second() { }
        -
        5236  VmaPair(const T1& firstSrc, const T2& secondSrc) : first(firstSrc), second(secondSrc) { }
        -
        5237 };
        -
        5238 
        -
        5239 /* Class compatible with subset of interface of std::unordered_map.
        -
        5240 KeyT, ValueT must be POD because they will be stored in VmaVector.
        -
        5241 */
        -
        5242 template<typename KeyT, typename ValueT>
        -
        5243 class VmaMap
        -
        5244 {
        -
        5245 public:
        -
        5246  typedef VmaPair<KeyT, ValueT> PairType;
        -
        5247  typedef PairType* iterator;
        -
        5248 
        -
        5249  VmaMap(const VmaStlAllocator<PairType>& allocator) : m_Vector(allocator) { }
        -
        5250 
        -
        5251  iterator begin() { return m_Vector.begin(); }
        -
        5252  iterator end() { return m_Vector.end(); }
        -
        5253 
        -
        5254  void insert(const PairType& pair);
        -
        5255  iterator find(const KeyT& key);
        -
        5256  void erase(iterator it);
        -
        5257 
        -
        5258 private:
        -
        5259  VmaVector< PairType, VmaStlAllocator<PairType> > m_Vector;
        -
        5260 };
        -
        5261 
        -
        5262 #define VMA_MAP_TYPE(KeyT, ValueT) VmaMap<KeyT, ValueT>
        -
        5263 
        -
        5264 template<typename FirstT, typename SecondT>
        -
        5265 struct VmaPairFirstLess
        -
        5266 {
        -
        5267  bool operator()(const VmaPair<FirstT, SecondT>& lhs, const VmaPair<FirstT, SecondT>& rhs) const
        -
        5268  {
        -
        5269  return lhs.first < rhs.first;
        -
        5270  }
        -
        5271  bool operator()(const VmaPair<FirstT, SecondT>& lhs, const FirstT& rhsFirst) const
        -
        5272  {
        -
        5273  return lhs.first < rhsFirst;
        -
        5274  }
        -
        5275 };
        -
        5276 
        -
        5277 template<typename KeyT, typename ValueT>
        -
        5278 void VmaMap<KeyT, ValueT>::insert(const PairType& pair)
        -
        5279 {
        -
        5280  const size_t indexToInsert = VmaBinaryFindFirstNotLess(
        -
        5281  m_Vector.data(),
        -
        5282  m_Vector.data() + m_Vector.size(),
        -
        5283  pair,
        -
        5284  VmaPairFirstLess<KeyT, ValueT>()) - m_Vector.data();
        -
        5285  VmaVectorInsert(m_Vector, indexToInsert, pair);
        -
        5286 }
        -
        5287 
        -
        5288 template<typename KeyT, typename ValueT>
        -
        5289 VmaPair<KeyT, ValueT>* VmaMap<KeyT, ValueT>::find(const KeyT& key)
        -
        5290 {
        -
        5291  PairType* it = VmaBinaryFindFirstNotLess(
        -
        5292  m_Vector.data(),
        -
        5293  m_Vector.data() + m_Vector.size(),
        -
        5294  key,
        -
        5295  VmaPairFirstLess<KeyT, ValueT>());
        -
        5296  if((it != m_Vector.end()) && (it->first == key))
        -
        5297  {
        -
        5298  return it;
        -
        5299  }
        -
        5300  else
        -
        5301  {
        -
        5302  return m_Vector.end();
        -
        5303  }
        -
        5304 }
        +
        5235  const_iterator(const iterator& src) :
        +
        5236  m_pList(src.m_pList),
        +
        5237  m_pItem(src.m_pItem)
        +
        5238  {
        +
        5239  }
        +
        5240 
        +
        5241  const T& operator*() const
        +
        5242  {
        +
        5243  VMA_HEAVY_ASSERT(m_pItem != VMA_NULL);
        +
        5244  return m_pItem->Value;
        +
        5245  }
        +
        5246  const T* operator->() const
        +
        5247  {
        +
        5248  VMA_HEAVY_ASSERT(m_pItem != VMA_NULL);
        +
        5249  return &m_pItem->Value;
        +
        5250  }
        +
        5251 
        +
        5252  const_iterator& operator++()
        +
        5253  {
        +
        5254  VMA_HEAVY_ASSERT(m_pItem != VMA_NULL);
        +
        5255  m_pItem = m_pItem->pNext;
        +
        5256  return *this;
        +
        5257  }
        +
        5258  const_iterator& operator--()
        +
        5259  {
        +
        5260  if(m_pItem != VMA_NULL)
        +
        5261  {
        +
        5262  m_pItem = m_pItem->pPrev;
        +
        5263  }
        +
        5264  else
        +
        5265  {
        +
        5266  VMA_HEAVY_ASSERT(!m_pList->IsEmpty());
        +
        5267  m_pItem = m_pList->Back();
        +
        5268  }
        +
        5269  return *this;
        +
        5270  }
        +
        5271 
        +
        5272  const_iterator operator++(int)
        +
        5273  {
        +
        5274  const_iterator result = *this;
        +
        5275  ++*this;
        +
        5276  return result;
        +
        5277  }
        +
        5278  const_iterator operator--(int)
        +
        5279  {
        +
        5280  const_iterator result = *this;
        +
        5281  --*this;
        +
        5282  return result;
        +
        5283  }
        +
        5284 
        +
        5285  bool operator==(const const_iterator& rhs) const
        +
        5286  {
        +
        5287  VMA_HEAVY_ASSERT(m_pList == rhs.m_pList);
        +
        5288  return m_pItem == rhs.m_pItem;
        +
        5289  }
        +
        5290  bool operator!=(const const_iterator& rhs) const
        +
        5291  {
        +
        5292  VMA_HEAVY_ASSERT(m_pList == rhs.m_pList);
        +
        5293  return m_pItem != rhs.m_pItem;
        +
        5294  }
        +
        5295 
        +
        5296  private:
        +
        5297  const_iterator(const VmaRawList<T>* pList, const VmaListItem<T>* pItem) :
        +
        5298  m_pList(pList),
        +
        5299  m_pItem(pItem)
        +
        5300  {
        +
        5301  }
        +
        5302 
        +
        5303  const VmaRawList<T>* m_pList;
        +
        5304  const VmaListItem<T>* m_pItem;
        5305 
        -
        5306 template<typename KeyT, typename ValueT>
        -
        5307 void VmaMap<KeyT, ValueT>::erase(iterator it)
        -
        5308 {
        -
        5309  VmaVectorRemove(m_Vector, it - m_Vector.begin());
        -
        5310 }
        -
        5311 
        -
        5312 #endif // #if VMA_USE_STL_UNORDERED_MAP
        +
        5306  friend class VmaList<T, AllocatorT>;
        +
        5307  };
        +
        5308 
        +
        5309  VmaList(const AllocatorT& allocator) : m_RawList(allocator.m_pCallbacks) { }
        +
        5310 
        +
        5311  bool empty() const { return m_RawList.IsEmpty(); }
        +
        5312  size_t size() const { return m_RawList.GetCount(); }
        5313 
        -
        5314 #endif // #if 0
        -
        5315 
        -
        5317 
        -
        5318 class VmaDeviceMemoryBlock;
        +
        5314  iterator begin() { return iterator(&m_RawList, m_RawList.Front()); }
        +
        5315  iterator end() { return iterator(&m_RawList, VMA_NULL); }
        +
        5316 
        +
        5317  const_iterator cbegin() const { return const_iterator(&m_RawList, m_RawList.Front()); }
        +
        5318  const_iterator cend() const { return const_iterator(&m_RawList, VMA_NULL); }
        5319 
        -
        5320 enum VMA_CACHE_OPERATION { VMA_CACHE_FLUSH, VMA_CACHE_INVALIDATE };
        -
        5321 
        -
        5322 struct VmaAllocation_T
        -
        5323 {
        -
        5324 private:
        -
        5325  static const uint8_t MAP_COUNT_FLAG_PERSISTENT_MAP = 0x80;
        -
        5326 
        -
        5327  enum FLAGS
        -
        5328  {
        -
        5329  FLAG_USER_DATA_STRING = 0x01,
        -
        5330  };
        -
        5331 
        -
        5332 public:
        -
        5333  enum ALLOCATION_TYPE
        -
        5334  {
        -
        5335  ALLOCATION_TYPE_NONE,
        -
        5336  ALLOCATION_TYPE_BLOCK,
        -
        5337  ALLOCATION_TYPE_DEDICATED,
        -
        5338  };
        -
        5339 
        -
        5340  /*
        -
        5341  This struct is allocated using VmaPoolAllocator.
        -
        5342  */
        +
        5320  void clear() { m_RawList.Clear(); }
        +
        5321  void push_back(const T& value) { m_RawList.PushBack(value); }
        +
        5322  void erase(iterator it) { m_RawList.Remove(it.m_pItem); }
        +
        5323  iterator insert(iterator it, const T& value) { return iterator(&m_RawList, m_RawList.InsertBefore(it.m_pItem, value)); }
        +
        5324 
        +
        5325 private:
        +
        5326  VmaRawList<T> m_RawList;
        +
        5327 };
        +
        5328 
        +
        5329 #endif // #if VMA_USE_STL_LIST
        +
        5330 
        +
        5332 // class VmaMap
        +
        5333 
        +
        5334 // Unused in this version.
        +
        5335 #if 0
        +
        5336 
        +
        5337 #if VMA_USE_STL_UNORDERED_MAP
        +
        5338 
        +
        5339 #define VmaPair std::pair
        +
        5340 
        +
        5341 #define VMA_MAP_TYPE(KeyT, ValueT) \
        +
        5342  std::unordered_map< KeyT, ValueT, std::hash<KeyT>, std::equal_to<KeyT>, VmaStlAllocator< std::pair<KeyT, ValueT> > >
        5343 
        -
        5344  void Ctor(uint32_t currentFrameIndex, bool userDataString)
        -
        5345  {
        -
        5346  m_Alignment = 1;
        -
        5347  m_Size = 0;
        -
        5348  m_MemoryTypeIndex = 0;
        -
        5349  m_pUserData = VMA_NULL;
        -
        5350  m_LastUseFrameIndex = currentFrameIndex;
        -
        5351  m_Type = (uint8_t)ALLOCATION_TYPE_NONE;
        -
        5352  m_SuballocationType = (uint8_t)VMA_SUBALLOCATION_TYPE_UNKNOWN;
        -
        5353  m_MapCount = 0;
        -
        5354  m_Flags = userDataString ? (uint8_t)FLAG_USER_DATA_STRING : 0;
        +
        5344 #else // #if VMA_USE_STL_UNORDERED_MAP
        +
        5345 
        +
        5346 template<typename T1, typename T2>
        +
        5347 struct VmaPair
        +
        5348 {
        +
        5349  T1 first;
        +
        5350  T2 second;
        +
        5351 
        +
        5352  VmaPair() : first(), second() { }
        +
        5353  VmaPair(const T1& firstSrc, const T2& secondSrc) : first(firstSrc), second(secondSrc) { }
        +
        5354 };
        5355 
        -
        5356 #if VMA_STATS_STRING_ENABLED
        -
        5357  m_CreationFrameIndex = currentFrameIndex;
        -
        5358  m_BufferImageUsage = 0;
        -
        5359 #endif
        -
        5360  }
        -
        5361 
        -
        5362  void Dtor()
        -
        5363  {
        -
        5364  VMA_ASSERT((m_MapCount & ~MAP_COUNT_FLAG_PERSISTENT_MAP) == 0 && "Allocation was not unmapped before destruction.");
        +
        5356 /* Class compatible with subset of interface of std::unordered_map.
        +
        5357 KeyT, ValueT must be POD because they will be stored in VmaVector.
        +
        5358 */
        +
        5359 template<typename KeyT, typename ValueT>
        +
        5360 class VmaMap
        +
        5361 {
        +
        5362 public:
        +
        5363  typedef VmaPair<KeyT, ValueT> PairType;
        +
        5364  typedef PairType* iterator;
        5365 
        -
        5366  // Check if owned string was freed.
        -
        5367  VMA_ASSERT(m_pUserData == VMA_NULL);
        -
        5368  }
        -
        5369 
        -
        5370  void InitBlockAllocation(
        -
        5371  VmaDeviceMemoryBlock* block,
        -
        5372  VkDeviceSize offset,
        -
        5373  VkDeviceSize alignment,
        -
        5374  VkDeviceSize size,
        -
        5375  uint32_t memoryTypeIndex,
        -
        5376  VmaSuballocationType suballocationType,
        -
        5377  bool mapped,
        -
        5378  bool canBecomeLost)
        -
        5379  {
        -
        5380  VMA_ASSERT(m_Type == ALLOCATION_TYPE_NONE);
        -
        5381  VMA_ASSERT(block != VMA_NULL);
        -
        5382  m_Type = (uint8_t)ALLOCATION_TYPE_BLOCK;
        -
        5383  m_Alignment = alignment;
        -
        5384  m_Size = size;
        -
        5385  m_MemoryTypeIndex = memoryTypeIndex;
        -
        5386  m_MapCount = mapped ? MAP_COUNT_FLAG_PERSISTENT_MAP : 0;
        -
        5387  m_SuballocationType = (uint8_t)suballocationType;
        -
        5388  m_BlockAllocation.m_Block = block;
        -
        5389  m_BlockAllocation.m_Offset = offset;
        -
        5390  m_BlockAllocation.m_CanBecomeLost = canBecomeLost;
        +
        5366  VmaMap(const VmaStlAllocator<PairType>& allocator) : m_Vector(allocator) { }
        +
        5367 
        +
        5368  iterator begin() { return m_Vector.begin(); }
        +
        5369  iterator end() { return m_Vector.end(); }
        +
        5370 
        +
        5371  void insert(const PairType& pair);
        +
        5372  iterator find(const KeyT& key);
        +
        5373  void erase(iterator it);
        +
        5374 
        +
        5375 private:
        +
        5376  VmaVector< PairType, VmaStlAllocator<PairType> > m_Vector;
        +
        5377 };
        +
        5378 
        +
        5379 #define VMA_MAP_TYPE(KeyT, ValueT) VmaMap<KeyT, ValueT>
        +
        5380 
        +
        5381 template<typename FirstT, typename SecondT>
        +
        5382 struct VmaPairFirstLess
        +
        5383 {
        +
        5384  bool operator()(const VmaPair<FirstT, SecondT>& lhs, const VmaPair<FirstT, SecondT>& rhs) const
        +
        5385  {
        +
        5386  return lhs.first < rhs.first;
        +
        5387  }
        +
        5388  bool operator()(const VmaPair<FirstT, SecondT>& lhs, const FirstT& rhsFirst) const
        +
        5389  {
        +
        5390  return lhs.first < rhsFirst;
        5391  }
        -
        5392 
        -
        5393  void InitLost()
        -
        5394  {
        -
        5395  VMA_ASSERT(m_Type == ALLOCATION_TYPE_NONE);
        -
        5396  VMA_ASSERT(m_LastUseFrameIndex.load() == VMA_FRAME_INDEX_LOST);
        -
        5397  m_Type = (uint8_t)ALLOCATION_TYPE_BLOCK;
        -
        5398  m_MemoryTypeIndex = 0;
        -
        5399  m_BlockAllocation.m_Block = VMA_NULL;
        -
        5400  m_BlockAllocation.m_Offset = 0;
        -
        5401  m_BlockAllocation.m_CanBecomeLost = true;
        -
        5402  }
        -
        5403 
        -
        5404  void ChangeBlockAllocation(
        -
        5405  VmaAllocator hAllocator,
        -
        5406  VmaDeviceMemoryBlock* block,
        -
        5407  VkDeviceSize offset);
        -
        5408 
        -
        5409  void ChangeOffset(VkDeviceSize newOffset);
        -
        5410 
        -
        5411  // pMappedData not null means allocation is created with MAPPED flag.
        -
        5412  void InitDedicatedAllocation(
        -
        5413  uint32_t memoryTypeIndex,
        -
        5414  VkDeviceMemory hMemory,
        -
        5415  VmaSuballocationType suballocationType,
        -
        5416  void* pMappedData,
        -
        5417  VkDeviceSize size)
        +
        5392 };
        +
        5393 
        +
        5394 template<typename KeyT, typename ValueT>
        +
        5395 void VmaMap<KeyT, ValueT>::insert(const PairType& pair)
        +
        5396 {
        +
        5397  const size_t indexToInsert = VmaBinaryFindFirstNotLess(
        +
        5398  m_Vector.data(),
        +
        5399  m_Vector.data() + m_Vector.size(),
        +
        5400  pair,
        +
        5401  VmaPairFirstLess<KeyT, ValueT>()) - m_Vector.data();
        +
        5402  VmaVectorInsert(m_Vector, indexToInsert, pair);
        +
        5403 }
        +
        5404 
        +
        5405 template<typename KeyT, typename ValueT>
        +
        5406 VmaPair<KeyT, ValueT>* VmaMap<KeyT, ValueT>::find(const KeyT& key)
        +
        5407 {
        +
        5408  PairType* it = VmaBinaryFindFirstNotLess(
        +
        5409  m_Vector.data(),
        +
        5410  m_Vector.data() + m_Vector.size(),
        +
        5411  key,
        +
        5412  VmaPairFirstLess<KeyT, ValueT>());
        +
        5413  if((it != m_Vector.end()) && (it->first == key))
        +
        5414  {
        +
        5415  return it;
        +
        5416  }
        +
        5417  else
        5418  {
        -
        5419  VMA_ASSERT(m_Type == ALLOCATION_TYPE_NONE);
        -
        5420  VMA_ASSERT(hMemory != VK_NULL_HANDLE);
        -
        5421  m_Type = (uint8_t)ALLOCATION_TYPE_DEDICATED;
        -
        5422  m_Alignment = 0;
        -
        5423  m_Size = size;
        -
        5424  m_MemoryTypeIndex = memoryTypeIndex;
        -
        5425  m_SuballocationType = (uint8_t)suballocationType;
        -
        5426  m_MapCount = (pMappedData != VMA_NULL) ? MAP_COUNT_FLAG_PERSISTENT_MAP : 0;
        -
        5427  m_DedicatedAllocation.m_hMemory = hMemory;
        -
        5428  m_DedicatedAllocation.m_pMappedData = pMappedData;
        -
        5429  }
        +
        5419  return m_Vector.end();
        +
        5420  }
        +
        5421 }
        +
        5422 
        +
        5423 template<typename KeyT, typename ValueT>
        +
        5424 void VmaMap<KeyT, ValueT>::erase(iterator it)
        +
        5425 {
        +
        5426  VmaVectorRemove(m_Vector, it - m_Vector.begin());
        +
        5427 }
        +
        5428 
        +
        5429 #endif // #if VMA_USE_STL_UNORDERED_MAP
        5430 
        -
        5431  ALLOCATION_TYPE GetType() const { return (ALLOCATION_TYPE)m_Type; }
        -
        5432  VkDeviceSize GetAlignment() const { return m_Alignment; }
        -
        5433  VkDeviceSize GetSize() const { return m_Size; }
        -
        5434  bool IsUserDataString() const { return (m_Flags & FLAG_USER_DATA_STRING) != 0; }
        -
        5435  void* GetUserData() const { return m_pUserData; }
        -
        5436  void SetUserData(VmaAllocator hAllocator, void* pUserData);
        -
        5437  VmaSuballocationType GetSuballocationType() const { return (VmaSuballocationType)m_SuballocationType; }
        +
        5431 #endif // #if 0
        +
        5432 
        +
        5434 
        +
        5435 class VmaDeviceMemoryBlock;
        +
        5436 
        +
        5437 enum VMA_CACHE_OPERATION { VMA_CACHE_FLUSH, VMA_CACHE_INVALIDATE };
        5438 
        -
        5439  VmaDeviceMemoryBlock* GetBlock() const
        -
        5440  {
        -
        5441  VMA_ASSERT(m_Type == ALLOCATION_TYPE_BLOCK);
        -
        5442  return m_BlockAllocation.m_Block;
        -
        5443  }
        -
        5444  VkDeviceSize GetOffset() const;
        -
        5445  VkDeviceMemory GetMemory() const;
        -
        5446  uint32_t GetMemoryTypeIndex() const { return m_MemoryTypeIndex; }
        -
        5447  bool IsPersistentMap() const { return (m_MapCount & MAP_COUNT_FLAG_PERSISTENT_MAP) != 0; }
        -
        5448  void* GetMappedData() const;
        -
        5449  bool CanBecomeLost() const;
        -
        5450 
        -
        5451  uint32_t GetLastUseFrameIndex() const
        -
        5452  {
        -
        5453  return m_LastUseFrameIndex.load();
        -
        5454  }
        -
        5455  bool CompareExchangeLastUseFrameIndex(uint32_t& expected, uint32_t desired)
        -
        5456  {
        -
        5457  return m_LastUseFrameIndex.compare_exchange_weak(expected, desired);
        -
        5458  }
        -
        5459  /*
        -
        5460  - If hAllocation.LastUseFrameIndex + frameInUseCount < allocator.CurrentFrameIndex,
        -
        5461  makes it lost by setting LastUseFrameIndex = VMA_FRAME_INDEX_LOST and returns true.
        -
        5462  - Else, returns false.
        -
        5463 
        -
        5464  If hAllocation is already lost, assert - you should not call it then.
        -
        5465  If hAllocation was not created with CAN_BECOME_LOST_BIT, assert.
        -
        5466  */
        -
        5467  bool MakeLost(uint32_t currentFrameIndex, uint32_t frameInUseCount);
        -
        5468 
        -
        5469  void DedicatedAllocCalcStatsInfo(VmaStatInfo& outInfo)
        -
        5470  {
        -
        5471  VMA_ASSERT(m_Type == ALLOCATION_TYPE_DEDICATED);
        -
        5472  outInfo.blockCount = 1;
        -
        5473  outInfo.allocationCount = 1;
        -
        5474  outInfo.unusedRangeCount = 0;
        -
        5475  outInfo.usedBytes = m_Size;
        -
        5476  outInfo.unusedBytes = 0;
        -
        5477  outInfo.allocationSizeMin = outInfo.allocationSizeMax = m_Size;
        -
        5478  outInfo.unusedRangeSizeMin = UINT64_MAX;
        -
        5479  outInfo.unusedRangeSizeMax = 0;
        -
        5480  }
        +
        5439 struct VmaAllocation_T
        +
        5440 {
        +
        5441 private:
        +
        5442  static const uint8_t MAP_COUNT_FLAG_PERSISTENT_MAP = 0x80;
        +
        5443 
        +
        5444  enum FLAGS
        +
        5445  {
        +
        5446  FLAG_USER_DATA_STRING = 0x01,
        +
        5447  };
        +
        5448 
        +
        5449 public:
        +
        5450  enum ALLOCATION_TYPE
        +
        5451  {
        +
        5452  ALLOCATION_TYPE_NONE,
        +
        5453  ALLOCATION_TYPE_BLOCK,
        +
        5454  ALLOCATION_TYPE_DEDICATED,
        +
        5455  };
        +
        5456 
        +
        5457  /*
        +
        5458  This struct is allocated using VmaPoolAllocator.
        +
        5459  */
        +
        5460 
        +
        5461  VmaAllocation_T(uint32_t currentFrameIndex, bool userDataString) :
        +
        5462  m_Alignment{1},
        +
        5463  m_Size{0},
        +
        5464  m_pUserData{VMA_NULL},
        +
        5465  m_LastUseFrameIndex{currentFrameIndex},
        +
        5466  m_MemoryTypeIndex{0},
        +
        5467  m_Type{(uint8_t)ALLOCATION_TYPE_NONE},
        +
        5468  m_SuballocationType{(uint8_t)VMA_SUBALLOCATION_TYPE_UNKNOWN},
        +
        5469  m_MapCount{0},
        +
        5470  m_Flags{userDataString ? (uint8_t)FLAG_USER_DATA_STRING : (uint8_t)0}
        +
        5471  {
        +
        5472 #if VMA_STATS_STRING_ENABLED
        +
        5473  m_CreationFrameIndex = currentFrameIndex;
        +
        5474  m_BufferImageUsage = 0;
        +
        5475 #endif
        +
        5476  }
        +
        5477 
        +
        5478  ~VmaAllocation_T()
        +
        5479  {
        +
        5480  VMA_ASSERT((m_MapCount & ~MAP_COUNT_FLAG_PERSISTENT_MAP) == 0 && "Allocation was not unmapped before destruction.");
        5481 
        -
        5482  void BlockAllocMap();
        -
        5483  void BlockAllocUnmap();
        -
        5484  VkResult DedicatedAllocMap(VmaAllocator hAllocator, void** ppData);
        -
        5485  void DedicatedAllocUnmap(VmaAllocator hAllocator);
        -
        5486 
        -
        5487 #if VMA_STATS_STRING_ENABLED
        -
        5488  uint32_t GetCreationFrameIndex() const { return m_CreationFrameIndex; }
        -
        5489  uint32_t GetBufferImageUsage() const { return m_BufferImageUsage; }
        -
        5490 
        -
        5491  void InitBufferImageUsage(uint32_t bufferImageUsage)
        -
        5492  {
        -
        5493  VMA_ASSERT(m_BufferImageUsage == 0);
        -
        5494  m_BufferImageUsage = bufferImageUsage;
        -
        5495  }
        -
        5496 
        -
        5497  void PrintParameters(class VmaJsonWriter& json) const;
        -
        5498 #endif
        -
        5499 
        -
        5500 private:
        -
        5501  VkDeviceSize m_Alignment;
        -
        5502  VkDeviceSize m_Size;
        -
        5503  void* m_pUserData;
        -
        5504  VMA_ATOMIC_UINT32 m_LastUseFrameIndex;
        -
        5505  uint32_t m_MemoryTypeIndex;
        -
        5506  uint8_t m_Type; // ALLOCATION_TYPE
        -
        5507  uint8_t m_SuballocationType; // VmaSuballocationType
        -
        5508  // Bit 0x80 is set when allocation was created with VMA_ALLOCATION_CREATE_MAPPED_BIT.
        -
        5509  // Bits with mask 0x7F are reference counter for vmaMapMemory()/vmaUnmapMemory().
        -
        5510  uint8_t m_MapCount;
        -
        5511  uint8_t m_Flags; // enum FLAGS
        -
        5512 
        -
        5513  // Allocation out of VmaDeviceMemoryBlock.
        -
        5514  struct BlockAllocation
        -
        5515  {
        -
        5516  VmaDeviceMemoryBlock* m_Block;
        -
        5517  VkDeviceSize m_Offset;
        -
        5518  bool m_CanBecomeLost;
        -
        5519  };
        -
        5520 
        -
        5521  // Allocation for an object that has its own private VkDeviceMemory.
        -
        5522  struct DedicatedAllocation
        -
        5523  {
        -
        5524  VkDeviceMemory m_hMemory;
        -
        5525  void* m_pMappedData; // Not null means memory is mapped.
        -
        5526  };
        -
        5527 
        -
        5528  union
        -
        5529  {
        -
        5530  // Allocation out of VmaDeviceMemoryBlock.
        -
        5531  BlockAllocation m_BlockAllocation;
        -
        5532  // Allocation for an object that has its own private VkDeviceMemory.
        -
        5533  DedicatedAllocation m_DedicatedAllocation;
        -
        5534  };
        -
        5535 
        -
        5536 #if VMA_STATS_STRING_ENABLED
        -
        5537  uint32_t m_CreationFrameIndex;
        -
        5538  uint32_t m_BufferImageUsage; // 0 if unknown.
        -
        5539 #endif
        -
        5540 
        -
        5541  void FreeUserDataString(VmaAllocator hAllocator);
        -
        5542 };
        -
        5543 
        -
        5544 /*
        -
        5545 Represents a region of VmaDeviceMemoryBlock that is either assigned and returned as
        -
        5546 allocated memory block or free.
        -
        5547 */
        -
        5548 struct VmaSuballocation
        -
        5549 {
        -
        5550  VkDeviceSize offset;
        -
        5551  VkDeviceSize size;
        -
        5552  VmaAllocation hAllocation;
        -
        5553  VmaSuballocationType type;
        -
        5554 };
        -
        5555 
        -
        5556 // Comparator for offsets.
        -
        5557 struct VmaSuballocationOffsetLess
        -
        5558 {
        -
        5559  bool operator()(const VmaSuballocation& lhs, const VmaSuballocation& rhs) const
        -
        5560  {
        -
        5561  return lhs.offset < rhs.offset;
        -
        5562  }
        -
        5563 };
        -
        5564 struct VmaSuballocationOffsetGreater
        -
        5565 {
        -
        5566  bool operator()(const VmaSuballocation& lhs, const VmaSuballocation& rhs) const
        -
        5567  {
        -
        5568  return lhs.offset > rhs.offset;
        -
        5569  }
        -
        5570 };
        -
        5571 
        -
        5572 typedef VmaList< VmaSuballocation, VmaStlAllocator<VmaSuballocation> > VmaSuballocationList;
        -
        5573 
        -
        5574 // Cost of one additional allocation lost, as equivalent in bytes.
        -
        5575 static const VkDeviceSize VMA_LOST_ALLOCATION_COST = 1048576;
        -
        5576 
        -
        5577 enum class VmaAllocationRequestType
        -
        5578 {
        -
        5579  Normal,
        -
        5580  // Used by "Linear" algorithm.
        -
        5581  UpperAddress,
        -
        5582  EndOf1st,
        -
        5583  EndOf2nd,
        -
        5584 };
        -
        5585 
        -
        5586 /*
        -
        5587 Parameters of planned allocation inside a VmaDeviceMemoryBlock.
        -
        5588 
        -
        5589 If canMakeOtherLost was false:
        -
        5590 - item points to a FREE suballocation.
        -
        5591 - itemsToMakeLostCount is 0.
        -
        5592 
        -
        5593 If canMakeOtherLost was true:
        -
        5594 - item points to first of sequence of suballocations, which are either FREE,
        -
        5595  or point to VmaAllocations that can become lost.
        -
        5596 - itemsToMakeLostCount is the number of VmaAllocations that need to be made lost for
        -
        5597  the requested allocation to succeed.
        -
        5598 */
        -
        5599 struct VmaAllocationRequest
        -
        5600 {
        -
        5601  VkDeviceSize offset;
        -
        5602  VkDeviceSize sumFreeSize; // Sum size of free items that overlap with proposed allocation.
        -
        5603  VkDeviceSize sumItemSize; // Sum size of items to make lost that overlap with proposed allocation.
        -
        5604  VmaSuballocationList::iterator item;
        -
        5605  size_t itemsToMakeLostCount;
        -
        5606  void* customData;
        -
        5607  VmaAllocationRequestType type;
        -
        5608 
        -
        5609  VkDeviceSize CalcCost() const
        -
        5610  {
        -
        5611  return sumItemSize + itemsToMakeLostCount * VMA_LOST_ALLOCATION_COST;
        -
        5612  }
        -
        5613 };
        -
        5614 
        -
        5615 /*
        -
        5616 Data structure used for bookkeeping of allocations and unused ranges of memory
        -
        5617 in a single VkDeviceMemory block.
        -
        5618 */
        -
        5619 class VmaBlockMetadata
        -
        5620 {
        -
        5621 public:
        -
        5622  VmaBlockMetadata(VmaAllocator hAllocator);
        -
        5623  virtual ~VmaBlockMetadata() { }
        -
        5624  virtual void Init(VkDeviceSize size) { m_Size = size; }
        -
        5625 
        -
        5626  // Validates all data structures inside this object. If not valid, returns false.
        -
        5627  virtual bool Validate() const = 0;
        -
        5628  VkDeviceSize GetSize() const { return m_Size; }
        -
        5629  virtual size_t GetAllocationCount() const = 0;
        -
        5630  virtual VkDeviceSize GetSumFreeSize() const = 0;
        -
        5631  virtual VkDeviceSize GetUnusedRangeSizeMax() const = 0;
        -
        5632  // Returns true if this block is empty - contains only single free suballocation.
        -
        5633  virtual bool IsEmpty() const = 0;
        -
        5634 
        -
        5635  virtual void CalcAllocationStatInfo(VmaStatInfo& outInfo) const = 0;
        -
        5636  // Shouldn't modify blockCount.
        -
        5637  virtual void AddPoolStats(VmaPoolStats& inoutStats) const = 0;
        -
        5638 
        -
        5639 #if VMA_STATS_STRING_ENABLED
        -
        5640  virtual void PrintDetailedMap(class VmaJsonWriter& json) const = 0;
        -
        5641 #endif
        -
        5642 
        -
        5643  // Tries to find a place for suballocation with given parameters inside this block.
        -
        5644  // If succeeded, fills pAllocationRequest and returns true.
        -
        5645  // If failed, returns false.
        -
        5646  virtual bool CreateAllocationRequest(
        -
        5647  uint32_t currentFrameIndex,
        -
        5648  uint32_t frameInUseCount,
        -
        5649  VkDeviceSize bufferImageGranularity,
        -
        5650  VkDeviceSize allocSize,
        -
        5651  VkDeviceSize allocAlignment,
        -
        5652  bool upperAddress,
        -
        5653  VmaSuballocationType allocType,
        -
        5654  bool canMakeOtherLost,
        -
        5655  // Always one of VMA_ALLOCATION_CREATE_STRATEGY_* or VMA_ALLOCATION_INTERNAL_STRATEGY_* flags.
        -
        5656  uint32_t strategy,
        -
        5657  VmaAllocationRequest* pAllocationRequest) = 0;
        -
        5658 
        -
        5659  virtual bool MakeRequestedAllocationsLost(
        -
        5660  uint32_t currentFrameIndex,
        -
        5661  uint32_t frameInUseCount,
        -
        5662  VmaAllocationRequest* pAllocationRequest) = 0;
        -
        5663 
        -
        5664  virtual uint32_t MakeAllocationsLost(uint32_t currentFrameIndex, uint32_t frameInUseCount) = 0;
        -
        5665 
        -
        5666  virtual VkResult CheckCorruption(const void* pBlockData) = 0;
        -
        5667 
        -
        5668  // Makes actual allocation based on request. Request must already be checked and valid.
        -
        5669  virtual void Alloc(
        -
        5670  const VmaAllocationRequest& request,
        -
        5671  VmaSuballocationType type,
        -
        5672  VkDeviceSize allocSize,
        -
        5673  VmaAllocation hAllocation) = 0;
        -
        5674 
        -
        5675  // Frees suballocation assigned to given memory region.
        -
        5676  virtual void Free(const VmaAllocation allocation) = 0;
        -
        5677  virtual void FreeAtOffset(VkDeviceSize offset) = 0;
        -
        5678 
        -
        5679 protected:
        -
        5680  const VkAllocationCallbacks* GetAllocationCallbacks() const { return m_pAllocationCallbacks; }
        -
        5681 
        -
        5682 #if VMA_STATS_STRING_ENABLED
        -
        5683  void PrintDetailedMap_Begin(class VmaJsonWriter& json,
        -
        5684  VkDeviceSize unusedBytes,
        -
        5685  size_t allocationCount,
        -
        5686  size_t unusedRangeCount) const;
        -
        5687  void PrintDetailedMap_Allocation(class VmaJsonWriter& json,
        -
        5688  VkDeviceSize offset,
        -
        5689  VmaAllocation hAllocation) const;
        -
        5690  void PrintDetailedMap_UnusedRange(class VmaJsonWriter& json,
        -
        5691  VkDeviceSize offset,
        -
        5692  VkDeviceSize size) const;
        -
        5693  void PrintDetailedMap_End(class VmaJsonWriter& json) const;
        -
        5694 #endif
        -
        5695 
        -
        5696 private:
        -
        5697  VkDeviceSize m_Size;
        -
        5698  const VkAllocationCallbacks* m_pAllocationCallbacks;
        -
        5699 };
        -
        5700 
        -
        5701 #define VMA_VALIDATE(cond) do { if(!(cond)) { \
        -
        5702  VMA_ASSERT(0 && "Validation failed: " #cond); \
        -
        5703  return false; \
        -
        5704  } } while(false)
        -
        5705 
        -
        5706 class VmaBlockMetadata_Generic : public VmaBlockMetadata
        -
        5707 {
        -
        5708  VMA_CLASS_NO_COPY(VmaBlockMetadata_Generic)
        -
        5709 public:
        -
        5710  VmaBlockMetadata_Generic(VmaAllocator hAllocator);
        -
        5711  virtual ~VmaBlockMetadata_Generic();
        -
        5712  virtual void Init(VkDeviceSize size);
        -
        5713 
        -
        5714  virtual bool Validate() const;
        -
        5715  virtual size_t GetAllocationCount() const { return m_Suballocations.size() - m_FreeCount; }
        -
        5716  virtual VkDeviceSize GetSumFreeSize() const { return m_SumFreeSize; }
        -
        5717  virtual VkDeviceSize GetUnusedRangeSizeMax() const;
        -
        5718  virtual bool IsEmpty() const;
        -
        5719 
        -
        5720  virtual void CalcAllocationStatInfo(VmaStatInfo& outInfo) const;
        -
        5721  virtual void AddPoolStats(VmaPoolStats& inoutStats) const;
        -
        5722 
        -
        5723 #if VMA_STATS_STRING_ENABLED
        -
        5724  virtual void PrintDetailedMap(class VmaJsonWriter& json) const;
        -
        5725 #endif
        -
        5726 
        -
        5727  virtual bool CreateAllocationRequest(
        -
        5728  uint32_t currentFrameIndex,
        -
        5729  uint32_t frameInUseCount,
        -
        5730  VkDeviceSize bufferImageGranularity,
        -
        5731  VkDeviceSize allocSize,
        -
        5732  VkDeviceSize allocAlignment,
        -
        5733  bool upperAddress,
        -
        5734  VmaSuballocationType allocType,
        -
        5735  bool canMakeOtherLost,
        -
        5736  uint32_t strategy,
        -
        5737  VmaAllocationRequest* pAllocationRequest);
        -
        5738 
        -
        5739  virtual bool MakeRequestedAllocationsLost(
        -
        5740  uint32_t currentFrameIndex,
        -
        5741  uint32_t frameInUseCount,
        -
        5742  VmaAllocationRequest* pAllocationRequest);
        -
        5743 
        -
        5744  virtual uint32_t MakeAllocationsLost(uint32_t currentFrameIndex, uint32_t frameInUseCount);
        -
        5745 
        -
        5746  virtual VkResult CheckCorruption(const void* pBlockData);
        -
        5747 
        -
        5748  virtual void Alloc(
        -
        5749  const VmaAllocationRequest& request,
        -
        5750  VmaSuballocationType type,
        -
        5751  VkDeviceSize allocSize,
        -
        5752  VmaAllocation hAllocation);
        -
        5753 
        -
        5754  virtual void Free(const VmaAllocation allocation);
        -
        5755  virtual void FreeAtOffset(VkDeviceSize offset);
        -
        5756 
        -
        5758  // For defragmentation
        -
        5759 
        -
        5760  bool IsBufferImageGranularityConflictPossible(
        -
        5761  VkDeviceSize bufferImageGranularity,
        -
        5762  VmaSuballocationType& inOutPrevSuballocType) const;
        -
        5763 
        -
        5764 private:
        -
        5765  friend class VmaDefragmentationAlgorithm_Generic;
        -
        5766  friend class VmaDefragmentationAlgorithm_Fast;
        -
        5767 
        -
        5768  uint32_t m_FreeCount;
        -
        5769  VkDeviceSize m_SumFreeSize;
        -
        5770  VmaSuballocationList m_Suballocations;
        -
        5771  // Suballocations that are free and have size greater than certain threshold.
        -
        5772  // Sorted by size, ascending.
        -
        5773  VmaVector< VmaSuballocationList::iterator, VmaStlAllocator< VmaSuballocationList::iterator > > m_FreeSuballocationsBySize;
        +
        5482  // Check if owned string was freed.
        +
        5483  VMA_ASSERT(m_pUserData == VMA_NULL);
        +
        5484  }
        +
        5485 
        +
        5486  void InitBlockAllocation(
        +
        5487  VmaDeviceMemoryBlock* block,
        +
        5488  VkDeviceSize offset,
        +
        5489  VkDeviceSize alignment,
        +
        5490  VkDeviceSize size,
        +
        5491  uint32_t memoryTypeIndex,
        +
        5492  VmaSuballocationType suballocationType,
        +
        5493  bool mapped,
        +
        5494  bool canBecomeLost)
        +
        5495  {
        +
        5496  VMA_ASSERT(m_Type == ALLOCATION_TYPE_NONE);
        +
        5497  VMA_ASSERT(block != VMA_NULL);
        +
        5498  m_Type = (uint8_t)ALLOCATION_TYPE_BLOCK;
        +
        5499  m_Alignment = alignment;
        +
        5500  m_Size = size;
        +
        5501  m_MemoryTypeIndex = memoryTypeIndex;
        +
        5502  m_MapCount = mapped ? MAP_COUNT_FLAG_PERSISTENT_MAP : 0;
        +
        5503  m_SuballocationType = (uint8_t)suballocationType;
        +
        5504  m_BlockAllocation.m_Block = block;
        +
        5505  m_BlockAllocation.m_Offset = offset;
        +
        5506  m_BlockAllocation.m_CanBecomeLost = canBecomeLost;
        +
        5507  }
        +
        5508 
        +
        5509  void InitLost()
        +
        5510  {
        +
        5511  VMA_ASSERT(m_Type == ALLOCATION_TYPE_NONE);
        +
        5512  VMA_ASSERT(m_LastUseFrameIndex.load() == VMA_FRAME_INDEX_LOST);
        +
        5513  m_Type = (uint8_t)ALLOCATION_TYPE_BLOCK;
        +
        5514  m_MemoryTypeIndex = 0;
        +
        5515  m_BlockAllocation.m_Block = VMA_NULL;
        +
        5516  m_BlockAllocation.m_Offset = 0;
        +
        5517  m_BlockAllocation.m_CanBecomeLost = true;
        +
        5518  }
        +
        5519 
        +
        5520  void ChangeBlockAllocation(
        +
        5521  VmaAllocator hAllocator,
        +
        5522  VmaDeviceMemoryBlock* block,
        +
        5523  VkDeviceSize offset);
        +
        5524 
        +
        5525  void ChangeOffset(VkDeviceSize newOffset);
        +
        5526 
        +
        5527  // pMappedData not null means allocation is created with MAPPED flag.
        +
        5528  void InitDedicatedAllocation(
        +
        5529  uint32_t memoryTypeIndex,
        +
        5530  VkDeviceMemory hMemory,
        +
        5531  VmaSuballocationType suballocationType,
        +
        5532  void* pMappedData,
        +
        5533  VkDeviceSize size)
        +
        5534  {
        +
        5535  VMA_ASSERT(m_Type == ALLOCATION_TYPE_NONE);
        +
        5536  VMA_ASSERT(hMemory != VK_NULL_HANDLE);
        +
        5537  m_Type = (uint8_t)ALLOCATION_TYPE_DEDICATED;
        +
        5538  m_Alignment = 0;
        +
        5539  m_Size = size;
        +
        5540  m_MemoryTypeIndex = memoryTypeIndex;
        +
        5541  m_SuballocationType = (uint8_t)suballocationType;
        +
        5542  m_MapCount = (pMappedData != VMA_NULL) ? MAP_COUNT_FLAG_PERSISTENT_MAP : 0;
        +
        5543  m_DedicatedAllocation.m_hMemory = hMemory;
        +
        5544  m_DedicatedAllocation.m_pMappedData = pMappedData;
        +
        5545  }
        +
        5546 
        +
        5547  ALLOCATION_TYPE GetType() const { return (ALLOCATION_TYPE)m_Type; }
        +
        5548  VkDeviceSize GetAlignment() const { return m_Alignment; }
        +
        5549  VkDeviceSize GetSize() const { return m_Size; }
        +
        5550  bool IsUserDataString() const { return (m_Flags & FLAG_USER_DATA_STRING) != 0; }
        +
        5551  void* GetUserData() const { return m_pUserData; }
        +
        5552  void SetUserData(VmaAllocator hAllocator, void* pUserData);
        +
        5553  VmaSuballocationType GetSuballocationType() const { return (VmaSuballocationType)m_SuballocationType; }
        +
        5554 
        +
        5555  VmaDeviceMemoryBlock* GetBlock() const
        +
        5556  {
        +
        5557  VMA_ASSERT(m_Type == ALLOCATION_TYPE_BLOCK);
        +
        5558  return m_BlockAllocation.m_Block;
        +
        5559  }
        +
        5560  VkDeviceSize GetOffset() const;
        +
        5561  VkDeviceMemory GetMemory() const;
        +
        5562  uint32_t GetMemoryTypeIndex() const { return m_MemoryTypeIndex; }
        +
        5563  bool IsPersistentMap() const { return (m_MapCount & MAP_COUNT_FLAG_PERSISTENT_MAP) != 0; }
        +
        5564  void* GetMappedData() const;
        +
        5565  bool CanBecomeLost() const;
        +
        5566 
        +
        5567  uint32_t GetLastUseFrameIndex() const
        +
        5568  {
        +
        5569  return m_LastUseFrameIndex.load();
        +
        5570  }
        +
        5571  bool CompareExchangeLastUseFrameIndex(uint32_t& expected, uint32_t desired)
        +
        5572  {
        +
        5573  return m_LastUseFrameIndex.compare_exchange_weak(expected, desired);
        +
        5574  }
        +
        5575  /*
        +
        5576  - If hAllocation.LastUseFrameIndex + frameInUseCount < allocator.CurrentFrameIndex,
        +
        5577  makes it lost by setting LastUseFrameIndex = VMA_FRAME_INDEX_LOST and returns true.
        +
        5578  - Else, returns false.
        +
        5579 
        +
        5580  If hAllocation is already lost, assert - you should not call it then.
        +
        5581  If hAllocation was not created with CAN_BECOME_LOST_BIT, assert.
        +
        5582  */
        +
        5583  bool MakeLost(uint32_t currentFrameIndex, uint32_t frameInUseCount);
        +
        5584 
        +
        5585  void DedicatedAllocCalcStatsInfo(VmaStatInfo& outInfo)
        +
        5586  {
        +
        5587  VMA_ASSERT(m_Type == ALLOCATION_TYPE_DEDICATED);
        +
        5588  outInfo.blockCount = 1;
        +
        5589  outInfo.allocationCount = 1;
        +
        5590  outInfo.unusedRangeCount = 0;
        +
        5591  outInfo.usedBytes = m_Size;
        +
        5592  outInfo.unusedBytes = 0;
        +
        5593  outInfo.allocationSizeMin = outInfo.allocationSizeMax = m_Size;
        +
        5594  outInfo.unusedRangeSizeMin = UINT64_MAX;
        +
        5595  outInfo.unusedRangeSizeMax = 0;
        +
        5596  }
        +
        5597 
        +
        5598  void BlockAllocMap();
        +
        5599  void BlockAllocUnmap();
        +
        5600  VkResult DedicatedAllocMap(VmaAllocator hAllocator, void** ppData);
        +
        5601  void DedicatedAllocUnmap(VmaAllocator hAllocator);
        +
        5602 
        +
        5603 #if VMA_STATS_STRING_ENABLED
        +
        5604  uint32_t GetCreationFrameIndex() const { return m_CreationFrameIndex; }
        +
        5605  uint32_t GetBufferImageUsage() const { return m_BufferImageUsage; }
        +
        5606 
        +
        5607  void InitBufferImageUsage(uint32_t bufferImageUsage)
        +
        5608  {
        +
        5609  VMA_ASSERT(m_BufferImageUsage == 0);
        +
        5610  m_BufferImageUsage = bufferImageUsage;
        +
        5611  }
        +
        5612 
        +
        5613  void PrintParameters(class VmaJsonWriter& json) const;
        +
        5614 #endif
        +
        5615 
        +
        5616 private:
        +
        5617  VkDeviceSize m_Alignment;
        +
        5618  VkDeviceSize m_Size;
        +
        5619  void* m_pUserData;
        +
        5620  VMA_ATOMIC_UINT32 m_LastUseFrameIndex;
        +
        5621  uint32_t m_MemoryTypeIndex;
        +
        5622  uint8_t m_Type; // ALLOCATION_TYPE
        +
        5623  uint8_t m_SuballocationType; // VmaSuballocationType
        +
        5624  // Bit 0x80 is set when allocation was created with VMA_ALLOCATION_CREATE_MAPPED_BIT.
        +
        5625  // Bits with mask 0x7F are reference counter for vmaMapMemory()/vmaUnmapMemory().
        +
        5626  uint8_t m_MapCount;
        +
        5627  uint8_t m_Flags; // enum FLAGS
        +
        5628 
        +
        5629  // Allocation out of VmaDeviceMemoryBlock.
        +
        5630  struct BlockAllocation
        +
        5631  {
        +
        5632  VmaDeviceMemoryBlock* m_Block;
        +
        5633  VkDeviceSize m_Offset;
        +
        5634  bool m_CanBecomeLost;
        +
        5635  };
        +
        5636 
        +
        5637  // Allocation for an object that has its own private VkDeviceMemory.
        +
        5638  struct DedicatedAllocation
        +
        5639  {
        +
        5640  VkDeviceMemory m_hMemory;
        +
        5641  void* m_pMappedData; // Not null means memory is mapped.
        +
        5642  };
        +
        5643 
        +
        5644  union
        +
        5645  {
        +
        5646  // Allocation out of VmaDeviceMemoryBlock.
        +
        5647  BlockAllocation m_BlockAllocation;
        +
        5648  // Allocation for an object that has its own private VkDeviceMemory.
        +
        5649  DedicatedAllocation m_DedicatedAllocation;
        +
        5650  };
        +
        5651 
        +
        5652 #if VMA_STATS_STRING_ENABLED
        +
        5653  uint32_t m_CreationFrameIndex;
        +
        5654  uint32_t m_BufferImageUsage; // 0 if unknown.
        +
        5655 #endif
        +
        5656 
        +
        5657  void FreeUserDataString(VmaAllocator hAllocator);
        +
        5658 };
        +
        5659 
        +
        5660 /*
        +
        5661 Represents a region of VmaDeviceMemoryBlock that is either assigned and returned as
        +
        5662 allocated memory block or free.
        +
        5663 */
        +
        5664 struct VmaSuballocation
        +
        5665 {
        +
        5666  VkDeviceSize offset;
        +
        5667  VkDeviceSize size;
        +
        5668  VmaAllocation hAllocation;
        +
        5669  VmaSuballocationType type;
        +
        5670 };
        +
        5671 
        +
        5672 // Comparator for offsets.
        +
        5673 struct VmaSuballocationOffsetLess
        +
        5674 {
        +
        5675  bool operator()(const VmaSuballocation& lhs, const VmaSuballocation& rhs) const
        +
        5676  {
        +
        5677  return lhs.offset < rhs.offset;
        +
        5678  }
        +
        5679 };
        +
        5680 struct VmaSuballocationOffsetGreater
        +
        5681 {
        +
        5682  bool operator()(const VmaSuballocation& lhs, const VmaSuballocation& rhs) const
        +
        5683  {
        +
        5684  return lhs.offset > rhs.offset;
        +
        5685  }
        +
        5686 };
        +
        5687 
        +
        5688 typedef VmaList< VmaSuballocation, VmaStlAllocator<VmaSuballocation> > VmaSuballocationList;
        +
        5689 
        +
        5690 // Cost of one additional allocation lost, as equivalent in bytes.
        +
        5691 static const VkDeviceSize VMA_LOST_ALLOCATION_COST = 1048576;
        +
        5692 
        +
        5693 enum class VmaAllocationRequestType
        +
        5694 {
        +
        5695  Normal,
        +
        5696  // Used by "Linear" algorithm.
        +
        5697  UpperAddress,
        +
        5698  EndOf1st,
        +
        5699  EndOf2nd,
        +
        5700 };
        +
        5701 
        +
        5702 /*
        +
        5703 Parameters of planned allocation inside a VmaDeviceMemoryBlock.
        +
        5704 
        +
        5705 If canMakeOtherLost was false:
        +
        5706 - item points to a FREE suballocation.
        +
        5707 - itemsToMakeLostCount is 0.
        +
        5708 
        +
        5709 If canMakeOtherLost was true:
        +
        5710 - item points to first of sequence of suballocations, which are either FREE,
        +
        5711  or point to VmaAllocations that can become lost.
        +
        5712 - itemsToMakeLostCount is the number of VmaAllocations that need to be made lost for
        +
        5713  the requested allocation to succeed.
        +
        5714 */
        +
        5715 struct VmaAllocationRequest
        +
        5716 {
        +
        5717  VkDeviceSize offset;
        +
        5718  VkDeviceSize sumFreeSize; // Sum size of free items that overlap with proposed allocation.
        +
        5719  VkDeviceSize sumItemSize; // Sum size of items to make lost that overlap with proposed allocation.
        +
        5720  VmaSuballocationList::iterator item;
        +
        5721  size_t itemsToMakeLostCount;
        +
        5722  void* customData;
        +
        5723  VmaAllocationRequestType type;
        +
        5724 
        +
        5725  VkDeviceSize CalcCost() const
        +
        5726  {
        +
        5727  return sumItemSize + itemsToMakeLostCount * VMA_LOST_ALLOCATION_COST;
        +
        5728  }
        +
        5729 };
        +
        5730 
        +
        5731 /*
        +
        5732 Data structure used for bookkeeping of allocations and unused ranges of memory
        +
        5733 in a single VkDeviceMemory block.
        +
        5734 */
        +
        5735 class VmaBlockMetadata
        +
        5736 {
        +
        5737 public:
        +
        5738  VmaBlockMetadata(VmaAllocator hAllocator);
        +
        5739  virtual ~VmaBlockMetadata() { }
        +
        5740  virtual void Init(VkDeviceSize size) { m_Size = size; }
        +
        5741 
        +
        5742  // Validates all data structures inside this object. If not valid, returns false.
        +
        5743  virtual bool Validate() const = 0;
        +
        5744  VkDeviceSize GetSize() const { return m_Size; }
        +
        5745  virtual size_t GetAllocationCount() const = 0;
        +
        5746  virtual VkDeviceSize GetSumFreeSize() const = 0;
        +
        5747  virtual VkDeviceSize GetUnusedRangeSizeMax() const = 0;
        +
        5748  // Returns true if this block is empty - contains only single free suballocation.
        +
        5749  virtual bool IsEmpty() const = 0;
        +
        5750 
        +
        5751  virtual void CalcAllocationStatInfo(VmaStatInfo& outInfo) const = 0;
        +
        5752  // Shouldn't modify blockCount.
        +
        5753  virtual void AddPoolStats(VmaPoolStats& inoutStats) const = 0;
        +
        5754 
        +
        5755 #if VMA_STATS_STRING_ENABLED
        +
        5756  virtual void PrintDetailedMap(class VmaJsonWriter& json) const = 0;
        +
        5757 #endif
        +
        5758 
        +
        5759  // Tries to find a place for suballocation with given parameters inside this block.
        +
        5760  // If succeeded, fills pAllocationRequest and returns true.
        +
        5761  // If failed, returns false.
        +
        5762  virtual bool CreateAllocationRequest(
        +
        5763  uint32_t currentFrameIndex,
        +
        5764  uint32_t frameInUseCount,
        +
        5765  VkDeviceSize bufferImageGranularity,
        +
        5766  VkDeviceSize allocSize,
        +
        5767  VkDeviceSize allocAlignment,
        +
        5768  bool upperAddress,
        +
        5769  VmaSuballocationType allocType,
        +
        5770  bool canMakeOtherLost,
        +
        5771  // Always one of VMA_ALLOCATION_CREATE_STRATEGY_* or VMA_ALLOCATION_INTERNAL_STRATEGY_* flags.
        +
        5772  uint32_t strategy,
        +
        5773  VmaAllocationRequest* pAllocationRequest) = 0;
        5774 
        -
        5775  bool ValidateFreeSuballocationList() const;
        -
        5776 
        -
        5777  // Checks if requested suballocation with given parameters can be placed in given pFreeSuballocItem.
        -
        5778  // If yes, fills pOffset and returns true. If no, returns false.
        -
        5779  bool CheckAllocation(
        -
        5780  uint32_t currentFrameIndex,
        -
        5781  uint32_t frameInUseCount,
        -
        5782  VkDeviceSize bufferImageGranularity,
        -
        5783  VkDeviceSize allocSize,
        -
        5784  VkDeviceSize allocAlignment,
        -
        5785  VmaSuballocationType allocType,
        -
        5786  VmaSuballocationList::const_iterator suballocItem,
        -
        5787  bool canMakeOtherLost,
        -
        5788  VkDeviceSize* pOffset,
        -
        5789  size_t* itemsToMakeLostCount,
        -
        5790  VkDeviceSize* pSumFreeSize,
        -
        5791  VkDeviceSize* pSumItemSize) const;
        -
        5792  // Given free suballocation, it merges it with following one, which must also be free.
        -
        5793  void MergeFreeWithNext(VmaSuballocationList::iterator item);
        -
        5794  // Releases given suballocation, making it free.
        -
        5795  // Merges it with adjacent free suballocations if applicable.
        -
        5796  // Returns iterator to new free suballocation at this place.
        -
        5797  VmaSuballocationList::iterator FreeSuballocation(VmaSuballocationList::iterator suballocItem);
        -
        5798  // Given free suballocation, it inserts it into sorted list of
        -
        5799  // m_FreeSuballocationsBySize if it's suitable.
        -
        5800  void RegisterFreeSuballocation(VmaSuballocationList::iterator item);
        -
        5801  // Given free suballocation, it removes it from sorted list of
        -
        5802  // m_FreeSuballocationsBySize if it's suitable.
        -
        5803  void UnregisterFreeSuballocation(VmaSuballocationList::iterator item);
        -
        5804 };
        -
        5805 
        -
        5806 /*
        -
        5807 Allocations and their references in internal data structure look like this:
        -
        5808 
        -
        5809 if(m_2ndVectorMode == SECOND_VECTOR_EMPTY):
        -
        5810 
        -
        5811  0 +-------+
        -
        5812  | |
        -
        5813  | |
        -
        5814  | |
        -
        5815  +-------+
        -
        5816  | Alloc | 1st[m_1stNullItemsBeginCount]
        -
        5817  +-------+
        -
        5818  | Alloc | 1st[m_1stNullItemsBeginCount + 1]
        -
        5819  +-------+
        -
        5820  | ... |
        -
        5821  +-------+
        -
        5822  | Alloc | 1st[1st.size() - 1]
        -
        5823  +-------+
        -
        5824  | |
        -
        5825  | |
        -
        5826  | |
        -
        5827 GetSize() +-------+
        -
        5828 
        -
        5829 if(m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER):
        -
        5830 
        -
        5831  0 +-------+
        -
        5832  | Alloc | 2nd[0]
        -
        5833  +-------+
        -
        5834  | Alloc | 2nd[1]
        -
        5835  +-------+
        -
        5836  | ... |
        -
        5837  +-------+
        -
        5838  | Alloc | 2nd[2nd.size() - 1]
        -
        5839  +-------+
        -
        5840  | |
        -
        5841  | |
        -
        5842  | |
        -
        5843  +-------+
        -
        5844  | Alloc | 1st[m_1stNullItemsBeginCount]
        -
        5845  +-------+
        -
        5846  | Alloc | 1st[m_1stNullItemsBeginCount + 1]
        -
        5847  +-------+
        -
        5848  | ... |
        -
        5849  +-------+
        -
        5850  | Alloc | 1st[1st.size() - 1]
        -
        5851  +-------+
        -
        5852  | |
        -
        5853 GetSize() +-------+
        -
        5854 
        -
        5855 if(m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK):
        -
        5856 
        -
        5857  0 +-------+
        -
        5858  | |
        -
        5859  | |
        -
        5860  | |
        -
        5861  +-------+
        -
        5862  | Alloc | 1st[m_1stNullItemsBeginCount]
        -
        5863  +-------+
        -
        5864  | Alloc | 1st[m_1stNullItemsBeginCount + 1]
        -
        5865  +-------+
        -
        5866  | ... |
        -
        5867  +-------+
        -
        5868  | Alloc | 1st[1st.size() - 1]
        -
        5869  +-------+
        -
        5870  | |
        -
        5871  | |
        -
        5872  | |
        -
        5873  +-------+
        -
        5874  | Alloc | 2nd[2nd.size() - 1]
        -
        5875  +-------+
        -
        5876  | ... |
        -
        5877  +-------+
        -
        5878  | Alloc | 2nd[1]
        -
        5879  +-------+
        -
        5880  | Alloc | 2nd[0]
        -
        5881 GetSize() +-------+
        -
        5882 
        -
        5883 */
        -
        5884 class VmaBlockMetadata_Linear : public VmaBlockMetadata
        -
        5885 {
        -
        5886  VMA_CLASS_NO_COPY(VmaBlockMetadata_Linear)
        -
        5887 public:
        -
        5888  VmaBlockMetadata_Linear(VmaAllocator hAllocator);
        -
        5889  virtual ~VmaBlockMetadata_Linear();
        -
        5890  virtual void Init(VkDeviceSize size);
        -
        5891 
        -
        5892  virtual bool Validate() const;
        -
        5893  virtual size_t GetAllocationCount() const;
        -
        5894  virtual VkDeviceSize GetSumFreeSize() const { return m_SumFreeSize; }
        -
        5895  virtual VkDeviceSize GetUnusedRangeSizeMax() const;
        -
        5896  virtual bool IsEmpty() const { return GetAllocationCount() == 0; }
        -
        5897 
        -
        5898  virtual void CalcAllocationStatInfo(VmaStatInfo& outInfo) const;
        -
        5899  virtual void AddPoolStats(VmaPoolStats& inoutStats) const;
        -
        5900 
        -
        5901 #if VMA_STATS_STRING_ENABLED
        -
        5902  virtual void PrintDetailedMap(class VmaJsonWriter& json) const;
        -
        5903 #endif
        -
        5904 
        -
        5905  virtual bool CreateAllocationRequest(
        -
        5906  uint32_t currentFrameIndex,
        -
        5907  uint32_t frameInUseCount,
        -
        5908  VkDeviceSize bufferImageGranularity,
        -
        5909  VkDeviceSize allocSize,
        -
        5910  VkDeviceSize allocAlignment,
        -
        5911  bool upperAddress,
        -
        5912  VmaSuballocationType allocType,
        -
        5913  bool canMakeOtherLost,
        -
        5914  uint32_t strategy,
        -
        5915  VmaAllocationRequest* pAllocationRequest);
        -
        5916 
        -
        5917  virtual bool MakeRequestedAllocationsLost(
        -
        5918  uint32_t currentFrameIndex,
        -
        5919  uint32_t frameInUseCount,
        -
        5920  VmaAllocationRequest* pAllocationRequest);
        +
        5775  virtual bool MakeRequestedAllocationsLost(
        +
        5776  uint32_t currentFrameIndex,
        +
        5777  uint32_t frameInUseCount,
        +
        5778  VmaAllocationRequest* pAllocationRequest) = 0;
        +
        5779 
        +
        5780  virtual uint32_t MakeAllocationsLost(uint32_t currentFrameIndex, uint32_t frameInUseCount) = 0;
        +
        5781 
        +
        5782  virtual VkResult CheckCorruption(const void* pBlockData) = 0;
        +
        5783 
        +
        5784  // Makes actual allocation based on request. Request must already be checked and valid.
        +
        5785  virtual void Alloc(
        +
        5786  const VmaAllocationRequest& request,
        +
        5787  VmaSuballocationType type,
        +
        5788  VkDeviceSize allocSize,
        +
        5789  VmaAllocation hAllocation) = 0;
        +
        5790 
        +
        5791  // Frees suballocation assigned to given memory region.
        +
        5792  virtual void Free(const VmaAllocation allocation) = 0;
        +
        5793  virtual void FreeAtOffset(VkDeviceSize offset) = 0;
        +
        5794 
        +
        5795 protected:
        +
        5796  const VkAllocationCallbacks* GetAllocationCallbacks() const { return m_pAllocationCallbacks; }
        +
        5797 
        +
        5798 #if VMA_STATS_STRING_ENABLED
        +
        5799  void PrintDetailedMap_Begin(class VmaJsonWriter& json,
        +
        5800  VkDeviceSize unusedBytes,
        +
        5801  size_t allocationCount,
        +
        5802  size_t unusedRangeCount) const;
        +
        5803  void PrintDetailedMap_Allocation(class VmaJsonWriter& json,
        +
        5804  VkDeviceSize offset,
        +
        5805  VmaAllocation hAllocation) const;
        +
        5806  void PrintDetailedMap_UnusedRange(class VmaJsonWriter& json,
        +
        5807  VkDeviceSize offset,
        +
        5808  VkDeviceSize size) const;
        +
        5809  void PrintDetailedMap_End(class VmaJsonWriter& json) const;
        +
        5810 #endif
        +
        5811 
        +
        5812 private:
        +
        5813  VkDeviceSize m_Size;
        +
        5814  const VkAllocationCallbacks* m_pAllocationCallbacks;
        +
        5815 };
        +
        5816 
        +
        5817 #define VMA_VALIDATE(cond) do { if(!(cond)) { \
        +
        5818  VMA_ASSERT(0 && "Validation failed: " #cond); \
        +
        5819  return false; \
        +
        5820  } } while(false)
        +
        5821 
        +
        5822 class VmaBlockMetadata_Generic : public VmaBlockMetadata
        +
        5823 {
        +
        5824  VMA_CLASS_NO_COPY(VmaBlockMetadata_Generic)
        +
        5825 public:
        +
        5826  VmaBlockMetadata_Generic(VmaAllocator hAllocator);
        +
        5827  virtual ~VmaBlockMetadata_Generic();
        +
        5828  virtual void Init(VkDeviceSize size);
        +
        5829 
        +
        5830  virtual bool Validate() const;
        +
        5831  virtual size_t GetAllocationCount() const { return m_Suballocations.size() - m_FreeCount; }
        +
        5832  virtual VkDeviceSize GetSumFreeSize() const { return m_SumFreeSize; }
        +
        5833  virtual VkDeviceSize GetUnusedRangeSizeMax() const;
        +
        5834  virtual bool IsEmpty() const;
        +
        5835 
        +
        5836  virtual void CalcAllocationStatInfo(VmaStatInfo& outInfo) const;
        +
        5837  virtual void AddPoolStats(VmaPoolStats& inoutStats) const;
        +
        5838 
        +
        5839 #if VMA_STATS_STRING_ENABLED
        +
        5840  virtual void PrintDetailedMap(class VmaJsonWriter& json) const;
        +
        5841 #endif
        +
        5842 
        +
        5843  virtual bool CreateAllocationRequest(
        +
        5844  uint32_t currentFrameIndex,
        +
        5845  uint32_t frameInUseCount,
        +
        5846  VkDeviceSize bufferImageGranularity,
        +
        5847  VkDeviceSize allocSize,
        +
        5848  VkDeviceSize allocAlignment,
        +
        5849  bool upperAddress,
        +
        5850  VmaSuballocationType allocType,
        +
        5851  bool canMakeOtherLost,
        +
        5852  uint32_t strategy,
        +
        5853  VmaAllocationRequest* pAllocationRequest);
        +
        5854 
        +
        5855  virtual bool MakeRequestedAllocationsLost(
        +
        5856  uint32_t currentFrameIndex,
        +
        5857  uint32_t frameInUseCount,
        +
        5858  VmaAllocationRequest* pAllocationRequest);
        +
        5859 
        +
        5860  virtual uint32_t MakeAllocationsLost(uint32_t currentFrameIndex, uint32_t frameInUseCount);
        +
        5861 
        +
        5862  virtual VkResult CheckCorruption(const void* pBlockData);
        +
        5863 
        +
        5864  virtual void Alloc(
        +
        5865  const VmaAllocationRequest& request,
        +
        5866  VmaSuballocationType type,
        +
        5867  VkDeviceSize allocSize,
        +
        5868  VmaAllocation hAllocation);
        +
        5869 
        +
        5870  virtual void Free(const VmaAllocation allocation);
        +
        5871  virtual void FreeAtOffset(VkDeviceSize offset);
        +
        5872 
        +
        5874  // For defragmentation
        +
        5875 
        +
        5876  bool IsBufferImageGranularityConflictPossible(
        +
        5877  VkDeviceSize bufferImageGranularity,
        +
        5878  VmaSuballocationType& inOutPrevSuballocType) const;
        +
        5879 
        +
        5880 private:
        +
        5881  friend class VmaDefragmentationAlgorithm_Generic;
        +
        5882  friend class VmaDefragmentationAlgorithm_Fast;
        +
        5883 
        +
        5884  uint32_t m_FreeCount;
        +
        5885  VkDeviceSize m_SumFreeSize;
        +
        5886  VmaSuballocationList m_Suballocations;
        +
        5887  // Suballocations that are free and have size greater than certain threshold.
        +
        5888  // Sorted by size, ascending.
        +
        5889  VmaVector< VmaSuballocationList::iterator, VmaStlAllocator< VmaSuballocationList::iterator > > m_FreeSuballocationsBySize;
        +
        5890 
        +
        5891  bool ValidateFreeSuballocationList() const;
        +
        5892 
        +
        5893  // Checks if requested suballocation with given parameters can be placed in given pFreeSuballocItem.
        +
        5894  // If yes, fills pOffset and returns true. If no, returns false.
        +
        5895  bool CheckAllocation(
        +
        5896  uint32_t currentFrameIndex,
        +
        5897  uint32_t frameInUseCount,
        +
        5898  VkDeviceSize bufferImageGranularity,
        +
        5899  VkDeviceSize allocSize,
        +
        5900  VkDeviceSize allocAlignment,
        +
        5901  VmaSuballocationType allocType,
        +
        5902  VmaSuballocationList::const_iterator suballocItem,
        +
        5903  bool canMakeOtherLost,
        +
        5904  VkDeviceSize* pOffset,
        +
        5905  size_t* itemsToMakeLostCount,
        +
        5906  VkDeviceSize* pSumFreeSize,
        +
        5907  VkDeviceSize* pSumItemSize) const;
        +
        5908  // Given free suballocation, it merges it with following one, which must also be free.
        +
        5909  void MergeFreeWithNext(VmaSuballocationList::iterator item);
        +
        5910  // Releases given suballocation, making it free.
        +
        5911  // Merges it with adjacent free suballocations if applicable.
        +
        5912  // Returns iterator to new free suballocation at this place.
        +
        5913  VmaSuballocationList::iterator FreeSuballocation(VmaSuballocationList::iterator suballocItem);
        +
        5914  // Given free suballocation, it inserts it into sorted list of
        +
        5915  // m_FreeSuballocationsBySize if it's suitable.
        +
        5916  void RegisterFreeSuballocation(VmaSuballocationList::iterator item);
        +
        5917  // Given free suballocation, it removes it from sorted list of
        +
        5918  // m_FreeSuballocationsBySize if it's suitable.
        +
        5919  void UnregisterFreeSuballocation(VmaSuballocationList::iterator item);
        +
        5920 };
        5921 
        -
        5922  virtual uint32_t MakeAllocationsLost(uint32_t currentFrameIndex, uint32_t frameInUseCount);
        -
        5923 
        -
        5924  virtual VkResult CheckCorruption(const void* pBlockData);
        -
        5925 
        -
        5926  virtual void Alloc(
        -
        5927  const VmaAllocationRequest& request,
        -
        5928  VmaSuballocationType type,
        -
        5929  VkDeviceSize allocSize,
        -
        5930  VmaAllocation hAllocation);
        -
        5931 
        -
        5932  virtual void Free(const VmaAllocation allocation);
        -
        5933  virtual void FreeAtOffset(VkDeviceSize offset);
        -
        5934 
        -
        5935 private:
        -
        5936  /*
        -
        5937  There are two suballocation vectors, used in ping-pong way.
        -
        5938  The one with index m_1stVectorIndex is called 1st.
        -
        5939  The one with index (m_1stVectorIndex ^ 1) is called 2nd.
        -
        5940  2nd can be non-empty only when 1st is not empty.
        -
        5941  When 2nd is not empty, m_2ndVectorMode indicates its mode of operation.
        -
        5942  */
        -
        5943  typedef VmaVector< VmaSuballocation, VmaStlAllocator<VmaSuballocation> > SuballocationVectorType;
        -
        5944 
        -
        5945  enum SECOND_VECTOR_MODE
        -
        5946  {
        -
        5947  SECOND_VECTOR_EMPTY,
        -
        5948  /*
        -
        5949  Suballocations in 2nd vector are created later than the ones in 1st, but they
        -
        5950  all have smaller offset.
        -
        5951  */
        -
        5952  SECOND_VECTOR_RING_BUFFER,
        -
        5953  /*
        -
        5954  Suballocations in 2nd vector are upper side of double stack.
        -
        5955  They all have offsets higher than those in 1st vector.
        -
        5956  Top of this stack means smaller offsets, but higher indices in this vector.
        -
        5957  */
        -
        5958  SECOND_VECTOR_DOUBLE_STACK,
        -
        5959  };
        -
        5960 
        -
        5961  VkDeviceSize m_SumFreeSize;
        -
        5962  SuballocationVectorType m_Suballocations0, m_Suballocations1;
        -
        5963  uint32_t m_1stVectorIndex;
        -
        5964  SECOND_VECTOR_MODE m_2ndVectorMode;
        -
        5965 
        -
        5966  SuballocationVectorType& AccessSuballocations1st() { return m_1stVectorIndex ? m_Suballocations1 : m_Suballocations0; }
        -
        5967  SuballocationVectorType& AccessSuballocations2nd() { return m_1stVectorIndex ? m_Suballocations0 : m_Suballocations1; }
        -
        5968  const SuballocationVectorType& AccessSuballocations1st() const { return m_1stVectorIndex ? m_Suballocations1 : m_Suballocations0; }
        -
        5969  const SuballocationVectorType& AccessSuballocations2nd() const { return m_1stVectorIndex ? m_Suballocations0 : m_Suballocations1; }
        -
        5970 
        -
        5971  // Number of items in 1st vector with hAllocation = null at the beginning.
        -
        5972  size_t m_1stNullItemsBeginCount;
        -
        5973  // Number of other items in 1st vector with hAllocation = null somewhere in the middle.
        -
        5974  size_t m_1stNullItemsMiddleCount;
        -
        5975  // Number of items in 2nd vector with hAllocation = null.
        -
        5976  size_t m_2ndNullItemsCount;
        -
        5977 
        -
        5978  bool ShouldCompact1st() const;
        -
        5979  void CleanupAfterFree();
        -
        5980 
        -
        5981  bool CreateAllocationRequest_LowerAddress(
        -
        5982  uint32_t currentFrameIndex,
        -
        5983  uint32_t frameInUseCount,
        -
        5984  VkDeviceSize bufferImageGranularity,
        -
        5985  VkDeviceSize allocSize,
        -
        5986  VkDeviceSize allocAlignment,
        -
        5987  VmaSuballocationType allocType,
        -
        5988  bool canMakeOtherLost,
        -
        5989  uint32_t strategy,
        -
        5990  VmaAllocationRequest* pAllocationRequest);
        -
        5991  bool CreateAllocationRequest_UpperAddress(
        -
        5992  uint32_t currentFrameIndex,
        -
        5993  uint32_t frameInUseCount,
        -
        5994  VkDeviceSize bufferImageGranularity,
        -
        5995  VkDeviceSize allocSize,
        -
        5996  VkDeviceSize allocAlignment,
        -
        5997  VmaSuballocationType allocType,
        -
        5998  bool canMakeOtherLost,
        -
        5999  uint32_t strategy,
        -
        6000  VmaAllocationRequest* pAllocationRequest);
        -
        6001 };
        -
        6002 
        -
        6003 /*
        -
        6004 - GetSize() is the original size of allocated memory block.
        -
        6005 - m_UsableSize is this size aligned down to a power of two.
        -
        6006  All allocations and calculations happen relative to m_UsableSize.
        -
        6007 - GetUnusableSize() is the difference between them.
        -
        6008  It is repoted as separate, unused range, not available for allocations.
        -
        6009 
        -
        6010 Node at level 0 has size = m_UsableSize.
        -
        6011 Each next level contains nodes with size 2 times smaller than current level.
        -
        6012 m_LevelCount is the maximum number of levels to use in the current object.
        -
        6013 */
        -
        6014 class VmaBlockMetadata_Buddy : public VmaBlockMetadata
        -
        6015 {
        -
        6016  VMA_CLASS_NO_COPY(VmaBlockMetadata_Buddy)
        -
        6017 public:
        -
        6018  VmaBlockMetadata_Buddy(VmaAllocator hAllocator);
        -
        6019  virtual ~VmaBlockMetadata_Buddy();
        -
        6020  virtual void Init(VkDeviceSize size);
        -
        6021 
        -
        6022  virtual bool Validate() const;
        -
        6023  virtual size_t GetAllocationCount() const { return m_AllocationCount; }
        -
        6024  virtual VkDeviceSize GetSumFreeSize() const { return m_SumFreeSize + GetUnusableSize(); }
        -
        6025  virtual VkDeviceSize GetUnusedRangeSizeMax() const;
        -
        6026  virtual bool IsEmpty() const { return m_Root->type == Node::TYPE_FREE; }
        -
        6027 
        -
        6028  virtual void CalcAllocationStatInfo(VmaStatInfo& outInfo) const;
        -
        6029  virtual void AddPoolStats(VmaPoolStats& inoutStats) const;
        -
        6030 
        -
        6031 #if VMA_STATS_STRING_ENABLED
        -
        6032  virtual void PrintDetailedMap(class VmaJsonWriter& json) const;
        -
        6033 #endif
        -
        6034 
        -
        6035  virtual bool CreateAllocationRequest(
        -
        6036  uint32_t currentFrameIndex,
        -
        6037  uint32_t frameInUseCount,
        -
        6038  VkDeviceSize bufferImageGranularity,
        -
        6039  VkDeviceSize allocSize,
        -
        6040  VkDeviceSize allocAlignment,
        -
        6041  bool upperAddress,
        -
        6042  VmaSuballocationType allocType,
        -
        6043  bool canMakeOtherLost,
        -
        6044  uint32_t strategy,
        -
        6045  VmaAllocationRequest* pAllocationRequest);
        -
        6046 
        -
        6047  virtual bool MakeRequestedAllocationsLost(
        -
        6048  uint32_t currentFrameIndex,
        -
        6049  uint32_t frameInUseCount,
        -
        6050  VmaAllocationRequest* pAllocationRequest);
        -
        6051 
        -
        6052  virtual uint32_t MakeAllocationsLost(uint32_t currentFrameIndex, uint32_t frameInUseCount);
        -
        6053 
        -
        6054  virtual VkResult CheckCorruption(const void* pBlockData) { return VK_ERROR_FEATURE_NOT_PRESENT; }
        -
        6055 
        -
        6056  virtual void Alloc(
        -
        6057  const VmaAllocationRequest& request,
        -
        6058  VmaSuballocationType type,
        -
        6059  VkDeviceSize allocSize,
        -
        6060  VmaAllocation hAllocation);
        -
        6061 
        -
        6062  virtual void Free(const VmaAllocation allocation) { FreeAtOffset(allocation, allocation->GetOffset()); }
        -
        6063  virtual void FreeAtOffset(VkDeviceSize offset) { FreeAtOffset(VMA_NULL, offset); }
        -
        6064 
        -
        6065 private:
        -
        6066  static const VkDeviceSize MIN_NODE_SIZE = 32;
        -
        6067  static const size_t MAX_LEVELS = 30;
        -
        6068 
        -
        6069  struct ValidationContext
        -
        6070  {
        -
        6071  size_t calculatedAllocationCount;
        -
        6072  size_t calculatedFreeCount;
        -
        6073  VkDeviceSize calculatedSumFreeSize;
        -
        6074 
        -
        6075  ValidationContext() :
        -
        6076  calculatedAllocationCount(0),
        -
        6077  calculatedFreeCount(0),
        -
        6078  calculatedSumFreeSize(0) { }
        -
        6079  };
        -
        6080 
        -
        6081  struct Node
        -
        6082  {
        -
        6083  VkDeviceSize offset;
        -
        6084  enum TYPE
        -
        6085  {
        -
        6086  TYPE_FREE,
        -
        6087  TYPE_ALLOCATION,
        -
        6088  TYPE_SPLIT,
        -
        6089  TYPE_COUNT
        -
        6090  } type;
        -
        6091  Node* parent;
        -
        6092  Node* buddy;
        +
        5922 /*
        +
        5923 Allocations and their references in internal data structure look like this:
        +
        5924 
        +
        5925 if(m_2ndVectorMode == SECOND_VECTOR_EMPTY):
        +
        5926 
        +
        5927  0 +-------+
        +
        5928  | |
        +
        5929  | |
        +
        5930  | |
        +
        5931  +-------+
        +
        5932  | Alloc | 1st[m_1stNullItemsBeginCount]
        +
        5933  +-------+
        +
        5934  | Alloc | 1st[m_1stNullItemsBeginCount + 1]
        +
        5935  +-------+
        +
        5936  | ... |
        +
        5937  +-------+
        +
        5938  | Alloc | 1st[1st.size() - 1]
        +
        5939  +-------+
        +
        5940  | |
        +
        5941  | |
        +
        5942  | |
        +
        5943 GetSize() +-------+
        +
        5944 
        +
        5945 if(m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER):
        +
        5946 
        +
        5947  0 +-------+
        +
        5948  | Alloc | 2nd[0]
        +
        5949  +-------+
        +
        5950  | Alloc | 2nd[1]
        +
        5951  +-------+
        +
        5952  | ... |
        +
        5953  +-------+
        +
        5954  | Alloc | 2nd[2nd.size() - 1]
        +
        5955  +-------+
        +
        5956  | |
        +
        5957  | |
        +
        5958  | |
        +
        5959  +-------+
        +
        5960  | Alloc | 1st[m_1stNullItemsBeginCount]
        +
        5961  +-------+
        +
        5962  | Alloc | 1st[m_1stNullItemsBeginCount + 1]
        +
        5963  +-------+
        +
        5964  | ... |
        +
        5965  +-------+
        +
        5966  | Alloc | 1st[1st.size() - 1]
        +
        5967  +-------+
        +
        5968  | |
        +
        5969 GetSize() +-------+
        +
        5970 
        +
        5971 if(m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK):
        +
        5972 
        +
        5973  0 +-------+
        +
        5974  | |
        +
        5975  | |
        +
        5976  | |
        +
        5977  +-------+
        +
        5978  | Alloc | 1st[m_1stNullItemsBeginCount]
        +
        5979  +-------+
        +
        5980  | Alloc | 1st[m_1stNullItemsBeginCount + 1]
        +
        5981  +-------+
        +
        5982  | ... |
        +
        5983  +-------+
        +
        5984  | Alloc | 1st[1st.size() - 1]
        +
        5985  +-------+
        +
        5986  | |
        +
        5987  | |
        +
        5988  | |
        +
        5989  +-------+
        +
        5990  | Alloc | 2nd[2nd.size() - 1]
        +
        5991  +-------+
        +
        5992  | ... |
        +
        5993  +-------+
        +
        5994  | Alloc | 2nd[1]
        +
        5995  +-------+
        +
        5996  | Alloc | 2nd[0]
        +
        5997 GetSize() +-------+
        +
        5998 
        +
        5999 */
        +
        6000 class VmaBlockMetadata_Linear : public VmaBlockMetadata
        +
        6001 {
        +
        6002  VMA_CLASS_NO_COPY(VmaBlockMetadata_Linear)
        +
        6003 public:
        +
        6004  VmaBlockMetadata_Linear(VmaAllocator hAllocator);
        +
        6005  virtual ~VmaBlockMetadata_Linear();
        +
        6006  virtual void Init(VkDeviceSize size);
        +
        6007 
        +
        6008  virtual bool Validate() const;
        +
        6009  virtual size_t GetAllocationCount() const;
        +
        6010  virtual VkDeviceSize GetSumFreeSize() const { return m_SumFreeSize; }
        +
        6011  virtual VkDeviceSize GetUnusedRangeSizeMax() const;
        +
        6012  virtual bool IsEmpty() const { return GetAllocationCount() == 0; }
        +
        6013 
        +
        6014  virtual void CalcAllocationStatInfo(VmaStatInfo& outInfo) const;
        +
        6015  virtual void AddPoolStats(VmaPoolStats& inoutStats) const;
        +
        6016 
        +
        6017 #if VMA_STATS_STRING_ENABLED
        +
        6018  virtual void PrintDetailedMap(class VmaJsonWriter& json) const;
        +
        6019 #endif
        +
        6020 
        +
        6021  virtual bool CreateAllocationRequest(
        +
        6022  uint32_t currentFrameIndex,
        +
        6023  uint32_t frameInUseCount,
        +
        6024  VkDeviceSize bufferImageGranularity,
        +
        6025  VkDeviceSize allocSize,
        +
        6026  VkDeviceSize allocAlignment,
        +
        6027  bool upperAddress,
        +
        6028  VmaSuballocationType allocType,
        +
        6029  bool canMakeOtherLost,
        +
        6030  uint32_t strategy,
        +
        6031  VmaAllocationRequest* pAllocationRequest);
        +
        6032 
        +
        6033  virtual bool MakeRequestedAllocationsLost(
        +
        6034  uint32_t currentFrameIndex,
        +
        6035  uint32_t frameInUseCount,
        +
        6036  VmaAllocationRequest* pAllocationRequest);
        +
        6037 
        +
        6038  virtual uint32_t MakeAllocationsLost(uint32_t currentFrameIndex, uint32_t frameInUseCount);
        +
        6039 
        +
        6040  virtual VkResult CheckCorruption(const void* pBlockData);
        +
        6041 
        +
        6042  virtual void Alloc(
        +
        6043  const VmaAllocationRequest& request,
        +
        6044  VmaSuballocationType type,
        +
        6045  VkDeviceSize allocSize,
        +
        6046  VmaAllocation hAllocation);
        +
        6047 
        +
        6048  virtual void Free(const VmaAllocation allocation);
        +
        6049  virtual void FreeAtOffset(VkDeviceSize offset);
        +
        6050 
        +
        6051 private:
        +
        6052  /*
        +
        6053  There are two suballocation vectors, used in ping-pong way.
        +
        6054  The one with index m_1stVectorIndex is called 1st.
        +
        6055  The one with index (m_1stVectorIndex ^ 1) is called 2nd.
        +
        6056  2nd can be non-empty only when 1st is not empty.
        +
        6057  When 2nd is not empty, m_2ndVectorMode indicates its mode of operation.
        +
        6058  */
        +
        6059  typedef VmaVector< VmaSuballocation, VmaStlAllocator<VmaSuballocation> > SuballocationVectorType;
        +
        6060 
        +
        6061  enum SECOND_VECTOR_MODE
        +
        6062  {
        +
        6063  SECOND_VECTOR_EMPTY,
        +
        6064  /*
        +
        6065  Suballocations in 2nd vector are created later than the ones in 1st, but they
        +
        6066  all have smaller offset.
        +
        6067  */
        +
        6068  SECOND_VECTOR_RING_BUFFER,
        +
        6069  /*
        +
        6070  Suballocations in 2nd vector are upper side of double stack.
        +
        6071  They all have offsets higher than those in 1st vector.
        +
        6072  Top of this stack means smaller offsets, but higher indices in this vector.
        +
        6073  */
        +
        6074  SECOND_VECTOR_DOUBLE_STACK,
        +
        6075  };
        +
        6076 
        +
        6077  VkDeviceSize m_SumFreeSize;
        +
        6078  SuballocationVectorType m_Suballocations0, m_Suballocations1;
        +
        6079  uint32_t m_1stVectorIndex;
        +
        6080  SECOND_VECTOR_MODE m_2ndVectorMode;
        +
        6081 
        +
        6082  SuballocationVectorType& AccessSuballocations1st() { return m_1stVectorIndex ? m_Suballocations1 : m_Suballocations0; }
        +
        6083  SuballocationVectorType& AccessSuballocations2nd() { return m_1stVectorIndex ? m_Suballocations0 : m_Suballocations1; }
        +
        6084  const SuballocationVectorType& AccessSuballocations1st() const { return m_1stVectorIndex ? m_Suballocations1 : m_Suballocations0; }
        +
        6085  const SuballocationVectorType& AccessSuballocations2nd() const { return m_1stVectorIndex ? m_Suballocations0 : m_Suballocations1; }
        +
        6086 
        +
        6087  // Number of items in 1st vector with hAllocation = null at the beginning.
        +
        6088  size_t m_1stNullItemsBeginCount;
        +
        6089  // Number of other items in 1st vector with hAllocation = null somewhere in the middle.
        +
        6090  size_t m_1stNullItemsMiddleCount;
        +
        6091  // Number of items in 2nd vector with hAllocation = null.
        +
        6092  size_t m_2ndNullItemsCount;
        6093 
        -
        6094  union
        -
        6095  {
        -
        6096  struct
        -
        6097  {
        -
        6098  Node* prev;
        -
        6099  Node* next;
        -
        6100  } free;
        -
        6101  struct
        -
        6102  {
        -
        6103  VmaAllocation alloc;
        -
        6104  } allocation;
        -
        6105  struct
        -
        6106  {
        -
        6107  Node* leftChild;
        -
        6108  } split;
        -
        6109  };
        -
        6110  };
        -
        6111 
        -
        6112  // Size of the memory block aligned down to a power of two.
        -
        6113  VkDeviceSize m_UsableSize;
        -
        6114  uint32_t m_LevelCount;
        -
        6115 
        -
        6116  Node* m_Root;
        -
        6117  struct {
        -
        6118  Node* front;
        -
        6119  Node* back;
        -
        6120  } m_FreeList[MAX_LEVELS];
        -
        6121  // Number of nodes in the tree with type == TYPE_ALLOCATION.
        -
        6122  size_t m_AllocationCount;
        -
        6123  // Number of nodes in the tree with type == TYPE_FREE.
        -
        6124  size_t m_FreeCount;
        -
        6125  // This includes space wasted due to internal fragmentation. Doesn't include unusable size.
        -
        6126  VkDeviceSize m_SumFreeSize;
        -
        6127 
        -
        6128  VkDeviceSize GetUnusableSize() const { return GetSize() - m_UsableSize; }
        -
        6129  void DeleteNode(Node* node);
        -
        6130  bool ValidateNode(ValidationContext& ctx, const Node* parent, const Node* curr, uint32_t level, VkDeviceSize levelNodeSize) const;
        -
        6131  uint32_t AllocSizeToLevel(VkDeviceSize allocSize) const;
        -
        6132  inline VkDeviceSize LevelToNodeSize(uint32_t level) const { return m_UsableSize >> level; }
        -
        6133  // Alloc passed just for validation. Can be null.
        -
        6134  void FreeAtOffset(VmaAllocation alloc, VkDeviceSize offset);
        -
        6135  void CalcAllocationStatInfoNode(VmaStatInfo& outInfo, const Node* node, VkDeviceSize levelNodeSize) const;
        -
        6136  // Adds node to the front of FreeList at given level.
        -
        6137  // node->type must be FREE.
        -
        6138  // node->free.prev, next can be undefined.
        -
        6139  void AddToFreeListFront(uint32_t level, Node* node);
        -
        6140  // Removes node from FreeList at given level.
        -
        6141  // node->type must be FREE.
        -
        6142  // node->free.prev, next stay untouched.
        -
        6143  void RemoveFromFreeList(uint32_t level, Node* node);
        -
        6144 
        -
        6145 #if VMA_STATS_STRING_ENABLED
        -
        6146  void PrintDetailedMapNode(class VmaJsonWriter& json, const Node* node, VkDeviceSize levelNodeSize) const;
        -
        6147 #endif
        -
        6148 };
        -
        6149 
        -
        6150 /*
        -
        6151 Represents a single block of device memory (`VkDeviceMemory`) with all the
        -
        6152 data about its regions (aka suballocations, #VmaAllocation), assigned and free.
        -
        6153 
        -
        6154 Thread-safety: This class must be externally synchronized.
        -
        6155 */
        -
        6156 class VmaDeviceMemoryBlock
        -
        6157 {
        -
        6158  VMA_CLASS_NO_COPY(VmaDeviceMemoryBlock)
        -
        6159 public:
        -
        6160  VmaBlockMetadata* m_pMetadata;
        -
        6161 
        -
        6162  VmaDeviceMemoryBlock(VmaAllocator hAllocator);
        -
        6163 
        -
        6164  ~VmaDeviceMemoryBlock()
        -
        6165  {
        -
        6166  VMA_ASSERT(m_MapCount == 0 && "VkDeviceMemory block is being destroyed while it is still mapped.");
        -
        6167  VMA_ASSERT(m_hMemory == VK_NULL_HANDLE);
        -
        6168  }
        +
        6094  bool ShouldCompact1st() const;
        +
        6095  void CleanupAfterFree();
        +
        6096 
        +
        6097  bool CreateAllocationRequest_LowerAddress(
        +
        6098  uint32_t currentFrameIndex,
        +
        6099  uint32_t frameInUseCount,
        +
        6100  VkDeviceSize bufferImageGranularity,
        +
        6101  VkDeviceSize allocSize,
        +
        6102  VkDeviceSize allocAlignment,
        +
        6103  VmaSuballocationType allocType,
        +
        6104  bool canMakeOtherLost,
        +
        6105  uint32_t strategy,
        +
        6106  VmaAllocationRequest* pAllocationRequest);
        +
        6107  bool CreateAllocationRequest_UpperAddress(
        +
        6108  uint32_t currentFrameIndex,
        +
        6109  uint32_t frameInUseCount,
        +
        6110  VkDeviceSize bufferImageGranularity,
        +
        6111  VkDeviceSize allocSize,
        +
        6112  VkDeviceSize allocAlignment,
        +
        6113  VmaSuballocationType allocType,
        +
        6114  bool canMakeOtherLost,
        +
        6115  uint32_t strategy,
        +
        6116  VmaAllocationRequest* pAllocationRequest);
        +
        6117 };
        +
        6118 
        +
        6119 /*
        +
        6120 - GetSize() is the original size of allocated memory block.
        +
        6121 - m_UsableSize is this size aligned down to a power of two.
        +
        6122  All allocations and calculations happen relative to m_UsableSize.
        +
        6123 - GetUnusableSize() is the difference between them.
        +
        6124  It is repoted as separate, unused range, not available for allocations.
        +
        6125 
        +
        6126 Node at level 0 has size = m_UsableSize.
        +
        6127 Each next level contains nodes with size 2 times smaller than current level.
        +
        6128 m_LevelCount is the maximum number of levels to use in the current object.
        +
        6129 */
        +
        6130 class VmaBlockMetadata_Buddy : public VmaBlockMetadata
        +
        6131 {
        +
        6132  VMA_CLASS_NO_COPY(VmaBlockMetadata_Buddy)
        +
        6133 public:
        +
        6134  VmaBlockMetadata_Buddy(VmaAllocator hAllocator);
        +
        6135  virtual ~VmaBlockMetadata_Buddy();
        +
        6136  virtual void Init(VkDeviceSize size);
        +
        6137 
        +
        6138  virtual bool Validate() const;
        +
        6139  virtual size_t GetAllocationCount() const { return m_AllocationCount; }
        +
        6140  virtual VkDeviceSize GetSumFreeSize() const { return m_SumFreeSize + GetUnusableSize(); }
        +
        6141  virtual VkDeviceSize GetUnusedRangeSizeMax() const;
        +
        6142  virtual bool IsEmpty() const { return m_Root->type == Node::TYPE_FREE; }
        +
        6143 
        +
        6144  virtual void CalcAllocationStatInfo(VmaStatInfo& outInfo) const;
        +
        6145  virtual void AddPoolStats(VmaPoolStats& inoutStats) const;
        +
        6146 
        +
        6147 #if VMA_STATS_STRING_ENABLED
        +
        6148  virtual void PrintDetailedMap(class VmaJsonWriter& json) const;
        +
        6149 #endif
        +
        6150 
        +
        6151  virtual bool CreateAllocationRequest(
        +
        6152  uint32_t currentFrameIndex,
        +
        6153  uint32_t frameInUseCount,
        +
        6154  VkDeviceSize bufferImageGranularity,
        +
        6155  VkDeviceSize allocSize,
        +
        6156  VkDeviceSize allocAlignment,
        +
        6157  bool upperAddress,
        +
        6158  VmaSuballocationType allocType,
        +
        6159  bool canMakeOtherLost,
        +
        6160  uint32_t strategy,
        +
        6161  VmaAllocationRequest* pAllocationRequest);
        +
        6162 
        +
        6163  virtual bool MakeRequestedAllocationsLost(
        +
        6164  uint32_t currentFrameIndex,
        +
        6165  uint32_t frameInUseCount,
        +
        6166  VmaAllocationRequest* pAllocationRequest);
        +
        6167 
        +
        6168  virtual uint32_t MakeAllocationsLost(uint32_t currentFrameIndex, uint32_t frameInUseCount);
        6169 
        -
        6170  // Always call after construction.
        -
        6171  void Init(
        -
        6172  VmaAllocator hAllocator,
        -
        6173  VmaPool hParentPool,
        -
        6174  uint32_t newMemoryTypeIndex,
        -
        6175  VkDeviceMemory newMemory,
        -
        6176  VkDeviceSize newSize,
        -
        6177  uint32_t id,
        -
        6178  uint32_t algorithm);
        -
        6179  // Always call before destruction.
        -
        6180  void Destroy(VmaAllocator allocator);
        -
        6181 
        -
        6182  VmaPool GetParentPool() const { return m_hParentPool; }
        -
        6183  VkDeviceMemory GetDeviceMemory() const { return m_hMemory; }
        -
        6184  uint32_t GetMemoryTypeIndex() const { return m_MemoryTypeIndex; }
        -
        6185  uint32_t GetId() const { return m_Id; }
        -
        6186  void* GetMappedData() const { return m_pMappedData; }
        -
        6187 
        -
        6188  // Validates all data structures inside this object. If not valid, returns false.
        -
        6189  bool Validate() const;
        +
        6170  virtual VkResult CheckCorruption(const void* pBlockData) { return VK_ERROR_FEATURE_NOT_PRESENT; }
        +
        6171 
        +
        6172  virtual void Alloc(
        +
        6173  const VmaAllocationRequest& request,
        +
        6174  VmaSuballocationType type,
        +
        6175  VkDeviceSize allocSize,
        +
        6176  VmaAllocation hAllocation);
        +
        6177 
        +
        6178  virtual void Free(const VmaAllocation allocation) { FreeAtOffset(allocation, allocation->GetOffset()); }
        +
        6179  virtual void FreeAtOffset(VkDeviceSize offset) { FreeAtOffset(VMA_NULL, offset); }
        +
        6180 
        +
        6181 private:
        +
        6182  static const VkDeviceSize MIN_NODE_SIZE = 32;
        +
        6183  static const size_t MAX_LEVELS = 30;
        +
        6184 
        +
        6185  struct ValidationContext
        +
        6186  {
        +
        6187  size_t calculatedAllocationCount;
        +
        6188  size_t calculatedFreeCount;
        +
        6189  VkDeviceSize calculatedSumFreeSize;
        6190 
        -
        6191  VkResult CheckCorruption(VmaAllocator hAllocator);
        -
        6192 
        -
        6193  // ppData can be null.
        -
        6194  VkResult Map(VmaAllocator hAllocator, uint32_t count, void** ppData);
        -
        6195  void Unmap(VmaAllocator hAllocator, uint32_t count);
        +
        6191  ValidationContext() :
        +
        6192  calculatedAllocationCount(0),
        +
        6193  calculatedFreeCount(0),
        +
        6194  calculatedSumFreeSize(0) { }
        +
        6195  };
        6196 
        -
        6197  VkResult WriteMagicValueAroundAllocation(VmaAllocator hAllocator, VkDeviceSize allocOffset, VkDeviceSize allocSize);
        -
        6198  VkResult ValidateMagicValueAroundAllocation(VmaAllocator hAllocator, VkDeviceSize allocOffset, VkDeviceSize allocSize);
        -
        6199 
        -
        6200  VkResult BindBufferMemory(
        -
        6201  const VmaAllocator hAllocator,
        -
        6202  const VmaAllocation hAllocation,
        -
        6203  VkDeviceSize allocationLocalOffset,
        -
        6204  VkBuffer hBuffer,
        -
        6205  const void* pNext);
        -
        6206  VkResult BindImageMemory(
        -
        6207  const VmaAllocator hAllocator,
        -
        6208  const VmaAllocation hAllocation,
        -
        6209  VkDeviceSize allocationLocalOffset,
        -
        6210  VkImage hImage,
        -
        6211  const void* pNext);
        -
        6212 
        -
        6213 private:
        -
        6214  VmaPool m_hParentPool; // VK_NULL_HANDLE if not belongs to custom pool.
        -
        6215  uint32_t m_MemoryTypeIndex;
        -
        6216  uint32_t m_Id;
        -
        6217  VkDeviceMemory m_hMemory;
        -
        6218 
        -
        6219  /*
        -
        6220  Protects access to m_hMemory so it's not used by multiple threads simultaneously, e.g. vkMapMemory, vkBindBufferMemory.
        -
        6221  Also protects m_MapCount, m_pMappedData.
        -
        6222  Allocations, deallocations, any change in m_pMetadata is protected by parent's VmaBlockVector::m_Mutex.
        -
        6223  */
        -
        6224  VMA_MUTEX m_Mutex;
        -
        6225  uint32_t m_MapCount;
        -
        6226  void* m_pMappedData;
        -
        6227 };
        -
        6228 
        -
        6229 struct VmaPointerLess
        -
        6230 {
        -
        6231  bool operator()(const void* lhs, const void* rhs) const
        -
        6232  {
        -
        6233  return lhs < rhs;
        -
        6234  }
        -
        6235 };
        -
        6236 
        -
        6237 struct VmaDefragmentationMove
        -
        6238 {
        -
        6239  size_t srcBlockIndex;
        -
        6240  size_t dstBlockIndex;
        -
        6241  VkDeviceSize srcOffset;
        -
        6242  VkDeviceSize dstOffset;
        -
        6243  VkDeviceSize size;
        -
        6244 };
        -
        6245 
        -
        6246 class VmaDefragmentationAlgorithm;
        -
        6247 
        -
        6248 /*
        -
        6249 Sequence of VmaDeviceMemoryBlock. Represents memory blocks allocated for a specific
        -
        6250 Vulkan memory type.
        -
        6251 
        -
        6252 Synchronized internally with a mutex.
        -
        6253 */
        -
        6254 struct VmaBlockVector
        -
        6255 {
        -
        6256  VMA_CLASS_NO_COPY(VmaBlockVector)
        -
        6257 public:
        -
        6258  VmaBlockVector(
        -
        6259  VmaAllocator hAllocator,
        -
        6260  VmaPool hParentPool,
        -
        6261  uint32_t memoryTypeIndex,
        -
        6262  VkDeviceSize preferredBlockSize,
        -
        6263  size_t minBlockCount,
        -
        6264  size_t maxBlockCount,
        -
        6265  VkDeviceSize bufferImageGranularity,
        -
        6266  uint32_t frameInUseCount,
        -
        6267  bool explicitBlockSize,
        -
        6268  uint32_t algorithm);
        -
        6269  ~VmaBlockVector();
        -
        6270 
        -
        6271  VkResult CreateMinBlocks();
        -
        6272 
        -
        6273  VmaAllocator GetAllocator() const { return m_hAllocator; }
        -
        6274  VmaPool GetParentPool() const { return m_hParentPool; }
        -
        6275  bool IsCustomPool() const { return m_hParentPool != VMA_NULL; }
        -
        6276  uint32_t GetMemoryTypeIndex() const { return m_MemoryTypeIndex; }
        -
        6277  VkDeviceSize GetPreferredBlockSize() const { return m_PreferredBlockSize; }
        -
        6278  VkDeviceSize GetBufferImageGranularity() const { return m_BufferImageGranularity; }
        -
        6279  uint32_t GetFrameInUseCount() const { return m_FrameInUseCount; }
        -
        6280  uint32_t GetAlgorithm() const { return m_Algorithm; }
        -
        6281 
        -
        6282  void GetPoolStats(VmaPoolStats* pStats);
        -
        6283 
        -
        6284  bool IsEmpty();
        -
        6285  bool IsCorruptionDetectionEnabled() const;
        -
        6286 
        -
        6287  VkResult Allocate(
        -
        6288  uint32_t currentFrameIndex,
        -
        6289  VkDeviceSize size,
        -
        6290  VkDeviceSize alignment,
        -
        6291  const VmaAllocationCreateInfo& createInfo,
        -
        6292  VmaSuballocationType suballocType,
        -
        6293  size_t allocationCount,
        -
        6294  VmaAllocation* pAllocations);
        -
        6295 
        -
        6296  void Free(const VmaAllocation hAllocation);
        -
        6297 
        -
        6298  // Adds statistics of this BlockVector to pStats.
        -
        6299  void AddStats(VmaStats* pStats);
        -
        6300 
        -
        6301 #if VMA_STATS_STRING_ENABLED
        -
        6302  void PrintDetailedMap(class VmaJsonWriter& json);
        -
        6303 #endif
        -
        6304 
        -
        6305  void MakePoolAllocationsLost(
        -
        6306  uint32_t currentFrameIndex,
        -
        6307  size_t* pLostAllocationCount);
        -
        6308  VkResult CheckCorruption();
        -
        6309 
        -
        6310  // Saves results in pCtx->res.
        -
        6311  void Defragment(
        -
        6312  class VmaBlockVectorDefragmentationContext* pCtx,
        -
        6313  VmaDefragmentationStats* pStats,
        -
        6314  VkDeviceSize& maxCpuBytesToMove, uint32_t& maxCpuAllocationsToMove,
        -
        6315  VkDeviceSize& maxGpuBytesToMove, uint32_t& maxGpuAllocationsToMove,
        -
        6316  VkCommandBuffer commandBuffer);
        -
        6317  void DefragmentationEnd(
        -
        6318  class VmaBlockVectorDefragmentationContext* pCtx,
        -
        6319  VmaDefragmentationStats* pStats);
        -
        6320 
        -
        6322  // To be used only while the m_Mutex is locked. Used during defragmentation.
        -
        6323 
        -
        6324  size_t GetBlockCount() const { return m_Blocks.size(); }
        -
        6325  VmaDeviceMemoryBlock* GetBlock(size_t index) const { return m_Blocks[index]; }
        -
        6326  size_t CalcAllocationCount() const;
        -
        6327  bool IsBufferImageGranularityConflictPossible() const;
        +
        6197  struct Node
        +
        6198  {
        +
        6199  VkDeviceSize offset;
        +
        6200  enum TYPE
        +
        6201  {
        +
        6202  TYPE_FREE,
        +
        6203  TYPE_ALLOCATION,
        +
        6204  TYPE_SPLIT,
        +
        6205  TYPE_COUNT
        +
        6206  } type;
        +
        6207  Node* parent;
        +
        6208  Node* buddy;
        +
        6209 
        +
        6210  union
        +
        6211  {
        +
        6212  struct
        +
        6213  {
        +
        6214  Node* prev;
        +
        6215  Node* next;
        +
        6216  } free;
        +
        6217  struct
        +
        6218  {
        +
        6219  VmaAllocation alloc;
        +
        6220  } allocation;
        +
        6221  struct
        +
        6222  {
        +
        6223  Node* leftChild;
        +
        6224  } split;
        +
        6225  };
        +
        6226  };
        +
        6227 
        +
        6228  // Size of the memory block aligned down to a power of two.
        +
        6229  VkDeviceSize m_UsableSize;
        +
        6230  uint32_t m_LevelCount;
        +
        6231 
        +
        6232  Node* m_Root;
        +
        6233  struct {
        +
        6234  Node* front;
        +
        6235  Node* back;
        +
        6236  } m_FreeList[MAX_LEVELS];
        +
        6237  // Number of nodes in the tree with type == TYPE_ALLOCATION.
        +
        6238  size_t m_AllocationCount;
        +
        6239  // Number of nodes in the tree with type == TYPE_FREE.
        +
        6240  size_t m_FreeCount;
        +
        6241  // This includes space wasted due to internal fragmentation. Doesn't include unusable size.
        +
        6242  VkDeviceSize m_SumFreeSize;
        +
        6243 
        +
        6244  VkDeviceSize GetUnusableSize() const { return GetSize() - m_UsableSize; }
        +
        6245  void DeleteNode(Node* node);
        +
        6246  bool ValidateNode(ValidationContext& ctx, const Node* parent, const Node* curr, uint32_t level, VkDeviceSize levelNodeSize) const;
        +
        6247  uint32_t AllocSizeToLevel(VkDeviceSize allocSize) const;
        +
        6248  inline VkDeviceSize LevelToNodeSize(uint32_t level) const { return m_UsableSize >> level; }
        +
        6249  // Alloc passed just for validation. Can be null.
        +
        6250  void FreeAtOffset(VmaAllocation alloc, VkDeviceSize offset);
        +
        6251  void CalcAllocationStatInfoNode(VmaStatInfo& outInfo, const Node* node, VkDeviceSize levelNodeSize) const;
        +
        6252  // Adds node to the front of FreeList at given level.
        +
        6253  // node->type must be FREE.
        +
        6254  // node->free.prev, next can be undefined.
        +
        6255  void AddToFreeListFront(uint32_t level, Node* node);
        +
        6256  // Removes node from FreeList at given level.
        +
        6257  // node->type must be FREE.
        +
        6258  // node->free.prev, next stay untouched.
        +
        6259  void RemoveFromFreeList(uint32_t level, Node* node);
        +
        6260 
        +
        6261 #if VMA_STATS_STRING_ENABLED
        +
        6262  void PrintDetailedMapNode(class VmaJsonWriter& json, const Node* node, VkDeviceSize levelNodeSize) const;
        +
        6263 #endif
        +
        6264 };
        +
        6265 
        +
        6266 /*
        +
        6267 Represents a single block of device memory (`VkDeviceMemory`) with all the
        +
        6268 data about its regions (aka suballocations, #VmaAllocation), assigned and free.
        +
        6269 
        +
        6270 Thread-safety: This class must be externally synchronized.
        +
        6271 */
        +
        6272 class VmaDeviceMemoryBlock
        +
        6273 {
        +
        6274  VMA_CLASS_NO_COPY(VmaDeviceMemoryBlock)
        +
        6275 public:
        +
        6276  VmaBlockMetadata* m_pMetadata;
        +
        6277 
        +
        6278  VmaDeviceMemoryBlock(VmaAllocator hAllocator);
        +
        6279 
        +
        6280  ~VmaDeviceMemoryBlock()
        +
        6281  {
        +
        6282  VMA_ASSERT(m_MapCount == 0 && "VkDeviceMemory block is being destroyed while it is still mapped.");
        +
        6283  VMA_ASSERT(m_hMemory == VK_NULL_HANDLE);
        +
        6284  }
        +
        6285 
        +
        6286  // Always call after construction.
        +
        6287  void Init(
        +
        6288  VmaAllocator hAllocator,
        +
        6289  VmaPool hParentPool,
        +
        6290  uint32_t newMemoryTypeIndex,
        +
        6291  VkDeviceMemory newMemory,
        +
        6292  VkDeviceSize newSize,
        +
        6293  uint32_t id,
        +
        6294  uint32_t algorithm);
        +
        6295  // Always call before destruction.
        +
        6296  void Destroy(VmaAllocator allocator);
        +
        6297 
        +
        6298  VmaPool GetParentPool() const { return m_hParentPool; }
        +
        6299  VkDeviceMemory GetDeviceMemory() const { return m_hMemory; }
        +
        6300  uint32_t GetMemoryTypeIndex() const { return m_MemoryTypeIndex; }
        +
        6301  uint32_t GetId() const { return m_Id; }
        +
        6302  void* GetMappedData() const { return m_pMappedData; }
        +
        6303 
        +
        6304  // Validates all data structures inside this object. If not valid, returns false.
        +
        6305  bool Validate() const;
        +
        6306 
        +
        6307  VkResult CheckCorruption(VmaAllocator hAllocator);
        +
        6308 
        +
        6309  // ppData can be null.
        +
        6310  VkResult Map(VmaAllocator hAllocator, uint32_t count, void** ppData);
        +
        6311  void Unmap(VmaAllocator hAllocator, uint32_t count);
        +
        6312 
        +
        6313  VkResult WriteMagicValueAroundAllocation(VmaAllocator hAllocator, VkDeviceSize allocOffset, VkDeviceSize allocSize);
        +
        6314  VkResult ValidateMagicValueAroundAllocation(VmaAllocator hAllocator, VkDeviceSize allocOffset, VkDeviceSize allocSize);
        +
        6315 
        +
        6316  VkResult BindBufferMemory(
        +
        6317  const VmaAllocator hAllocator,
        +
        6318  const VmaAllocation hAllocation,
        +
        6319  VkDeviceSize allocationLocalOffset,
        +
        6320  VkBuffer hBuffer,
        +
        6321  const void* pNext);
        +
        6322  VkResult BindImageMemory(
        +
        6323  const VmaAllocator hAllocator,
        +
        6324  const VmaAllocation hAllocation,
        +
        6325  VkDeviceSize allocationLocalOffset,
        +
        6326  VkImage hImage,
        +
        6327  const void* pNext);
        6328 
        6329 private:
        -
        6330  friend class VmaDefragmentationAlgorithm_Generic;
        -
        6331 
        -
        6332  const VmaAllocator m_hAllocator;
        -
        6333  const VmaPool m_hParentPool;
        -
        6334  const uint32_t m_MemoryTypeIndex;
        -
        6335  const VkDeviceSize m_PreferredBlockSize;
        -
        6336  const size_t m_MinBlockCount;
        -
        6337  const size_t m_MaxBlockCount;
        -
        6338  const VkDeviceSize m_BufferImageGranularity;
        -
        6339  const uint32_t m_FrameInUseCount;
        -
        6340  const bool m_ExplicitBlockSize;
        -
        6341  const uint32_t m_Algorithm;
        -
        6342  VMA_RW_MUTEX m_Mutex;
        -
        6343 
        -
        6344  /* There can be at most one allocation that is completely empty (except when minBlockCount > 0) -
        -
        6345  a hysteresis to avoid pessimistic case of alternating creation and destruction of a VkDeviceMemory. */
        -
        6346  bool m_HasEmptyBlock;
        -
        6347  // Incrementally sorted by sumFreeSize, ascending.
        -
        6348  VmaVector< VmaDeviceMemoryBlock*, VmaStlAllocator<VmaDeviceMemoryBlock*> > m_Blocks;
        -
        6349  uint32_t m_NextBlockId;
        -
        6350 
        -
        6351  VkDeviceSize CalcMaxBlockSize() const;
        +
        6330  VmaPool m_hParentPool; // VK_NULL_HANDLE if not belongs to custom pool.
        +
        6331  uint32_t m_MemoryTypeIndex;
        +
        6332  uint32_t m_Id;
        +
        6333  VkDeviceMemory m_hMemory;
        +
        6334 
        +
        6335  /*
        +
        6336  Protects access to m_hMemory so it's not used by multiple threads simultaneously, e.g. vkMapMemory, vkBindBufferMemory.
        +
        6337  Also protects m_MapCount, m_pMappedData.
        +
        6338  Allocations, deallocations, any change in m_pMetadata is protected by parent's VmaBlockVector::m_Mutex.
        +
        6339  */
        +
        6340  VMA_MUTEX m_Mutex;
        +
        6341  uint32_t m_MapCount;
        +
        6342  void* m_pMappedData;
        +
        6343 };
        +
        6344 
        +
        6345 struct VmaPointerLess
        +
        6346 {
        +
        6347  bool operator()(const void* lhs, const void* rhs) const
        +
        6348  {
        +
        6349  return lhs < rhs;
        +
        6350  }
        +
        6351 };
        6352 
        -
        6353  // Finds and removes given block from vector.
        -
        6354  void Remove(VmaDeviceMemoryBlock* pBlock);
        -
        6355 
        -
        6356  // Performs single step in sorting m_Blocks. They may not be fully sorted
        -
        6357  // after this call.
        -
        6358  void IncrementallySortBlocks();
        -
        6359 
        -
        6360  VkResult AllocatePage(
        -
        6361  uint32_t currentFrameIndex,
        -
        6362  VkDeviceSize size,
        -
        6363  VkDeviceSize alignment,
        -
        6364  const VmaAllocationCreateInfo& createInfo,
        -
        6365  VmaSuballocationType suballocType,
        -
        6366  VmaAllocation* pAllocation);
        -
        6367 
        -
        6368  // To be used only without CAN_MAKE_OTHER_LOST flag.
        -
        6369  VkResult AllocateFromBlock(
        -
        6370  VmaDeviceMemoryBlock* pBlock,
        -
        6371  uint32_t currentFrameIndex,
        -
        6372  VkDeviceSize size,
        -
        6373  VkDeviceSize alignment,
        -
        6374  VmaAllocationCreateFlags allocFlags,
        -
        6375  void* pUserData,
        -
        6376  VmaSuballocationType suballocType,
        -
        6377  uint32_t strategy,
        -
        6378  VmaAllocation* pAllocation);
        -
        6379 
        -
        6380  VkResult CreateBlock(VkDeviceSize blockSize, size_t* pNewBlockIndex);
        -
        6381 
        -
        6382  // Saves result to pCtx->res.
        -
        6383  void ApplyDefragmentationMovesCpu(
        -
        6384  class VmaBlockVectorDefragmentationContext* pDefragCtx,
        -
        6385  const VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> >& moves);
        -
        6386  // Saves result to pCtx->res.
        -
        6387  void ApplyDefragmentationMovesGpu(
        -
        6388  class VmaBlockVectorDefragmentationContext* pDefragCtx,
        -
        6389  const VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> >& moves,
        -
        6390  VkCommandBuffer commandBuffer);
        +
        6353 struct VmaDefragmentationMove
        +
        6354 {
        +
        6355  size_t srcBlockIndex;
        +
        6356  size_t dstBlockIndex;
        +
        6357  VkDeviceSize srcOffset;
        +
        6358  VkDeviceSize dstOffset;
        +
        6359  VkDeviceSize size;
        +
        6360  VmaAllocation hAllocation;
        +
        6361  VmaDeviceMemoryBlock* pSrcBlock;
        +
        6362  VmaDeviceMemoryBlock* pDstBlock;
        +
        6363 };
        +
        6364 
        +
        6365 class VmaDefragmentationAlgorithm;
        +
        6366 
        +
        6367 /*
        +
        6368 Sequence of VmaDeviceMemoryBlock. Represents memory blocks allocated for a specific
        +
        6369 Vulkan memory type.
        +
        6370 
        +
        6371 Synchronized internally with a mutex.
        +
        6372 */
        +
        6373 struct VmaBlockVector
        +
        6374 {
        +
        6375  VMA_CLASS_NO_COPY(VmaBlockVector)
        +
        6376 public:
        +
        6377  VmaBlockVector(
        +
        6378  VmaAllocator hAllocator,
        +
        6379  VmaPool hParentPool,
        +
        6380  uint32_t memoryTypeIndex,
        +
        6381  VkDeviceSize preferredBlockSize,
        +
        6382  size_t minBlockCount,
        +
        6383  size_t maxBlockCount,
        +
        6384  VkDeviceSize bufferImageGranularity,
        +
        6385  uint32_t frameInUseCount,
        +
        6386  bool explicitBlockSize,
        +
        6387  uint32_t algorithm);
        +
        6388  ~VmaBlockVector();
        +
        6389 
        +
        6390  VkResult CreateMinBlocks();
        6391 
        -
        6392  /*
        -
        6393  Used during defragmentation. pDefragmentationStats is optional. It's in/out
        -
        6394  - updated with new data.
        -
        6395  */
        -
        6396  void FreeEmptyBlocks(VmaDefragmentationStats* pDefragmentationStats);
        -
        6397 
        -
        6398  void UpdateHasEmptyBlock();
        -
        6399 };
        +
        6392  VmaAllocator GetAllocator() const { return m_hAllocator; }
        +
        6393  VmaPool GetParentPool() const { return m_hParentPool; }
        +
        6394  bool IsCustomPool() const { return m_hParentPool != VMA_NULL; }
        +
        6395  uint32_t GetMemoryTypeIndex() const { return m_MemoryTypeIndex; }
        +
        6396  VkDeviceSize GetPreferredBlockSize() const { return m_PreferredBlockSize; }
        +
        6397  VkDeviceSize GetBufferImageGranularity() const { return m_BufferImageGranularity; }
        +
        6398  uint32_t GetFrameInUseCount() const { return m_FrameInUseCount; }
        +
        6399  uint32_t GetAlgorithm() const { return m_Algorithm; }
        6400 
        -
        6401 struct VmaPool_T
        -
        6402 {
        -
        6403  VMA_CLASS_NO_COPY(VmaPool_T)
        -
        6404 public:
        -
        6405  VmaBlockVector m_BlockVector;
        -
        6406 
        -
        6407  VmaPool_T(
        -
        6408  VmaAllocator hAllocator,
        -
        6409  const VmaPoolCreateInfo& createInfo,
        -
        6410  VkDeviceSize preferredBlockSize);
        -
        6411  ~VmaPool_T();
        -
        6412 
        -
        6413  uint32_t GetId() const { return m_Id; }
        -
        6414  void SetId(uint32_t id) { VMA_ASSERT(m_Id == 0); m_Id = id; }
        -
        6415 
        -
        6416  const char* GetName() const { return m_Name; }
        -
        6417  void SetName(const char* pName);
        -
        6418 
        -
        6419 #if VMA_STATS_STRING_ENABLED
        -
        6420  //void PrintDetailedMap(class VmaStringBuilder& sb);
        -
        6421 #endif
        -
        6422 
        -
        6423 private:
        -
        6424  uint32_t m_Id;
        -
        6425  char* m_Name;
        -
        6426 };
        -
        6427 
        -
        6428 /*
        -
        6429 Performs defragmentation:
        -
        6430 
        -
        6431 - Updates `pBlockVector->m_pMetadata`.
        -
        6432 - Updates allocations by calling ChangeBlockAllocation() or ChangeOffset().
        -
        6433 - Does not move actual data, only returns requested moves as `moves`.
        -
        6434 */
        -
        6435 class VmaDefragmentationAlgorithm
        -
        6436 {
        -
        6437  VMA_CLASS_NO_COPY(VmaDefragmentationAlgorithm)
        -
        6438 public:
        -
        6439  VmaDefragmentationAlgorithm(
        -
        6440  VmaAllocator hAllocator,
        -
        6441  VmaBlockVector* pBlockVector,
        -
        6442  uint32_t currentFrameIndex) :
        -
        6443  m_hAllocator(hAllocator),
        -
        6444  m_pBlockVector(pBlockVector),
        -
        6445  m_CurrentFrameIndex(currentFrameIndex)
        -
        6446  {
        -
        6447  }
        -
        6448  virtual ~VmaDefragmentationAlgorithm()
        -
        6449  {
        -
        6450  }
        -
        6451 
        -
        6452  virtual void AddAllocation(VmaAllocation hAlloc, VkBool32* pChanged) = 0;
        -
        6453  virtual void AddAll() = 0;
        -
        6454 
        -
        6455  virtual VkResult Defragment(
        -
        6456  VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> >& moves,
        -
        6457  VkDeviceSize maxBytesToMove,
        -
        6458  uint32_t maxAllocationsToMove) = 0;
        -
        6459 
        -
        6460  virtual VkDeviceSize GetBytesMoved() const = 0;
        -
        6461  virtual uint32_t GetAllocationsMoved() const = 0;
        -
        6462 
        -
        6463 protected:
        -
        6464  VmaAllocator const m_hAllocator;
        -
        6465  VmaBlockVector* const m_pBlockVector;
        -
        6466  const uint32_t m_CurrentFrameIndex;
        -
        6467 
        -
        6468  struct AllocationInfo
        -
        6469  {
        -
        6470  VmaAllocation m_hAllocation;
        -
        6471  VkBool32* m_pChanged;
        -
        6472 
        -
        6473  AllocationInfo() :
        -
        6474  m_hAllocation(VK_NULL_HANDLE),
        -
        6475  m_pChanged(VMA_NULL)
        -
        6476  {
        -
        6477  }
        -
        6478  AllocationInfo(VmaAllocation hAlloc, VkBool32* pChanged) :
        -
        6479  m_hAllocation(hAlloc),
        -
        6480  m_pChanged(pChanged)
        -
        6481  {
        -
        6482  }
        -
        6483  };
        -
        6484 };
        -
        6485 
        -
        6486 class VmaDefragmentationAlgorithm_Generic : public VmaDefragmentationAlgorithm
        -
        6487 {
        -
        6488  VMA_CLASS_NO_COPY(VmaDefragmentationAlgorithm_Generic)
        -
        6489 public:
        -
        6490  VmaDefragmentationAlgorithm_Generic(
        -
        6491  VmaAllocator hAllocator,
        -
        6492  VmaBlockVector* pBlockVector,
        -
        6493  uint32_t currentFrameIndex,
        -
        6494  bool overlappingMoveSupported);
        -
        6495  virtual ~VmaDefragmentationAlgorithm_Generic();
        -
        6496 
        -
        6497  virtual void AddAllocation(VmaAllocation hAlloc, VkBool32* pChanged);
        -
        6498  virtual void AddAll() { m_AllAllocations = true; }
        -
        6499 
        -
        6500  virtual VkResult Defragment(
        -
        6501  VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> >& moves,
        -
        6502  VkDeviceSize maxBytesToMove,
        -
        6503  uint32_t maxAllocationsToMove);
        -
        6504 
        -
        6505  virtual VkDeviceSize GetBytesMoved() const { return m_BytesMoved; }
        -
        6506  virtual uint32_t GetAllocationsMoved() const { return m_AllocationsMoved; }
        -
        6507 
        -
        6508 private:
        -
        6509  uint32_t m_AllocationCount;
        -
        6510  bool m_AllAllocations;
        -
        6511 
        -
        6512  VkDeviceSize m_BytesMoved;
        -
        6513  uint32_t m_AllocationsMoved;
        -
        6514 
        -
        6515  struct AllocationInfoSizeGreater
        -
        6516  {
        -
        6517  bool operator()(const AllocationInfo& lhs, const AllocationInfo& rhs) const
        -
        6518  {
        -
        6519  return lhs.m_hAllocation->GetSize() > rhs.m_hAllocation->GetSize();
        -
        6520  }
        -
        6521  };
        -
        6522 
        -
        6523  struct AllocationInfoOffsetGreater
        -
        6524  {
        -
        6525  bool operator()(const AllocationInfo& lhs, const AllocationInfo& rhs) const
        -
        6526  {
        -
        6527  return lhs.m_hAllocation->GetOffset() > rhs.m_hAllocation->GetOffset();
        -
        6528  }
        -
        6529  };
        -
        6530 
        -
        6531  struct BlockInfo
        -
        6532  {
        -
        6533  size_t m_OriginalBlockIndex;
        -
        6534  VmaDeviceMemoryBlock* m_pBlock;
        -
        6535  bool m_HasNonMovableAllocations;
        -
        6536  VmaVector< AllocationInfo, VmaStlAllocator<AllocationInfo> > m_Allocations;
        -
        6537 
        -
        6538  BlockInfo(const VkAllocationCallbacks* pAllocationCallbacks) :
        -
        6539  m_OriginalBlockIndex(SIZE_MAX),
        -
        6540  m_pBlock(VMA_NULL),
        -
        6541  m_HasNonMovableAllocations(true),
        -
        6542  m_Allocations(pAllocationCallbacks)
        -
        6543  {
        -
        6544  }
        +
        6401  void GetPoolStats(VmaPoolStats* pStats);
        +
        6402 
        +
        6403  bool IsEmpty();
        +
        6404  bool IsCorruptionDetectionEnabled() const;
        +
        6405 
        +
        6406  VkResult Allocate(
        +
        6407  uint32_t currentFrameIndex,
        +
        6408  VkDeviceSize size,
        +
        6409  VkDeviceSize alignment,
        +
        6410  const VmaAllocationCreateInfo& createInfo,
        +
        6411  VmaSuballocationType suballocType,
        +
        6412  size_t allocationCount,
        +
        6413  VmaAllocation* pAllocations);
        +
        6414 
        +
        6415  void Free(const VmaAllocation hAllocation);
        +
        6416 
        +
        6417  // Adds statistics of this BlockVector to pStats.
        +
        6418  void AddStats(VmaStats* pStats);
        +
        6419 
        +
        6420 #if VMA_STATS_STRING_ENABLED
        +
        6421  void PrintDetailedMap(class VmaJsonWriter& json);
        +
        6422 #endif
        +
        6423 
        +
        6424  void MakePoolAllocationsLost(
        +
        6425  uint32_t currentFrameIndex,
        +
        6426  size_t* pLostAllocationCount);
        +
        6427  VkResult CheckCorruption();
        +
        6428 
        +
        6429  // Saves results in pCtx->res.
        +
        6430  void Defragment(
        +
        6431  class VmaBlockVectorDefragmentationContext* pCtx,
        +
        6432  VmaDefragmentationStats* pStats, VmaDefragmentationFlags flags,
        +
        6433  VkDeviceSize& maxCpuBytesToMove, uint32_t& maxCpuAllocationsToMove,
        +
        6434  VkDeviceSize& maxGpuBytesToMove, uint32_t& maxGpuAllocationsToMove,
        +
        6435  VkCommandBuffer commandBuffer);
        +
        6436  void DefragmentationEnd(
        +
        6437  class VmaBlockVectorDefragmentationContext* pCtx,
        +
        6438  VmaDefragmentationStats* pStats);
        +
        6439 
        +
        6440  uint32_t ProcessDefragmentations(
        +
        6441  class VmaBlockVectorDefragmentationContext *pCtx,
        +
        6442  VmaDefragmentationPassMoveInfo* pMove, uint32_t maxMoves);
        +
        6443 
        +
        6444  void CommitDefragmentations(
        +
        6445  class VmaBlockVectorDefragmentationContext *pCtx,
        +
        6446  VmaDefragmentationStats* pStats);
        +
        6447 
        +
        6449  // To be used only while the m_Mutex is locked. Used during defragmentation.
        +
        6450 
        +
        6451  size_t GetBlockCount() const { return m_Blocks.size(); }
        +
        6452  VmaDeviceMemoryBlock* GetBlock(size_t index) const { return m_Blocks[index]; }
        +
        6453  size_t CalcAllocationCount() const;
        +
        6454  bool IsBufferImageGranularityConflictPossible() const;
        +
        6455 
        +
        6456 private:
        +
        6457  friend class VmaDefragmentationAlgorithm_Generic;
        +
        6458 
        +
        6459  const VmaAllocator m_hAllocator;
        +
        6460  const VmaPool m_hParentPool;
        +
        6461  const uint32_t m_MemoryTypeIndex;
        +
        6462  const VkDeviceSize m_PreferredBlockSize;
        +
        6463  const size_t m_MinBlockCount;
        +
        6464  const size_t m_MaxBlockCount;
        +
        6465  const VkDeviceSize m_BufferImageGranularity;
        +
        6466  const uint32_t m_FrameInUseCount;
        +
        6467  const bool m_ExplicitBlockSize;
        +
        6468  const uint32_t m_Algorithm;
        +
        6469  VMA_RW_MUTEX m_Mutex;
        +
        6470 
        +
        6471  /* There can be at most one allocation that is completely empty (except when minBlockCount > 0) -
        +
        6472  a hysteresis to avoid pessimistic case of alternating creation and destruction of a VkDeviceMemory. */
        +
        6473  bool m_HasEmptyBlock;
        +
        6474  // Incrementally sorted by sumFreeSize, ascending.
        +
        6475  VmaVector< VmaDeviceMemoryBlock*, VmaStlAllocator<VmaDeviceMemoryBlock*> > m_Blocks;
        +
        6476  uint32_t m_NextBlockId;
        +
        6477 
        +
        6478  VkDeviceSize CalcMaxBlockSize() const;
        +
        6479 
        +
        6480  // Finds and removes given block from vector.
        +
        6481  void Remove(VmaDeviceMemoryBlock* pBlock);
        +
        6482 
        +
        6483  // Performs single step in sorting m_Blocks. They may not be fully sorted
        +
        6484  // after this call.
        +
        6485  void IncrementallySortBlocks();
        +
        6486 
        +
        6487  VkResult AllocatePage(
        +
        6488  uint32_t currentFrameIndex,
        +
        6489  VkDeviceSize size,
        +
        6490  VkDeviceSize alignment,
        +
        6491  const VmaAllocationCreateInfo& createInfo,
        +
        6492  VmaSuballocationType suballocType,
        +
        6493  VmaAllocation* pAllocation);
        +
        6494 
        +
        6495  // To be used only without CAN_MAKE_OTHER_LOST flag.
        +
        6496  VkResult AllocateFromBlock(
        +
        6497  VmaDeviceMemoryBlock* pBlock,
        +
        6498  uint32_t currentFrameIndex,
        +
        6499  VkDeviceSize size,
        +
        6500  VkDeviceSize alignment,
        +
        6501  VmaAllocationCreateFlags allocFlags,
        +
        6502  void* pUserData,
        +
        6503  VmaSuballocationType suballocType,
        +
        6504  uint32_t strategy,
        +
        6505  VmaAllocation* pAllocation);
        +
        6506 
        +
        6507  VkResult CreateBlock(VkDeviceSize blockSize, size_t* pNewBlockIndex);
        +
        6508 
        +
        6509  // Saves result to pCtx->res.
        +
        6510  void ApplyDefragmentationMovesCpu(
        +
        6511  class VmaBlockVectorDefragmentationContext* pDefragCtx,
        +
        6512  const VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> >& moves);
        +
        6513  // Saves result to pCtx->res.
        +
        6514  void ApplyDefragmentationMovesGpu(
        +
        6515  class VmaBlockVectorDefragmentationContext* pDefragCtx,
        +
        6516  VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> >& moves,
        +
        6517  VkCommandBuffer commandBuffer);
        +
        6518 
        +
        6519  /*
        +
        6520  Used during defragmentation. pDefragmentationStats is optional. It's in/out
        +
        6521  - updated with new data.
        +
        6522  */
        +
        6523  void FreeEmptyBlocks(VmaDefragmentationStats* pDefragmentationStats);
        +
        6524 
        +
        6525  void UpdateHasEmptyBlock();
        +
        6526 };
        +
        6527 
        +
        6528 struct VmaPool_T
        +
        6529 {
        +
        6530  VMA_CLASS_NO_COPY(VmaPool_T)
        +
        6531 public:
        +
        6532  VmaBlockVector m_BlockVector;
        +
        6533 
        +
        6534  VmaPool_T(
        +
        6535  VmaAllocator hAllocator,
        +
        6536  const VmaPoolCreateInfo& createInfo,
        +
        6537  VkDeviceSize preferredBlockSize);
        +
        6538  ~VmaPool_T();
        +
        6539 
        +
        6540  uint32_t GetId() const { return m_Id; }
        +
        6541  void SetId(uint32_t id) { VMA_ASSERT(m_Id == 0); m_Id = id; }
        +
        6542 
        +
        6543  const char* GetName() const { return m_Name; }
        +
        6544  void SetName(const char* pName);
        6545 
        -
        6546  void CalcHasNonMovableAllocations()
        -
        6547  {
        -
        6548  const size_t blockAllocCount = m_pBlock->m_pMetadata->GetAllocationCount();
        -
        6549  const size_t defragmentAllocCount = m_Allocations.size();
        -
        6550  m_HasNonMovableAllocations = blockAllocCount != defragmentAllocCount;
        -
        6551  }
        -
        6552 
        -
        6553  void SortAllocationsBySizeDescending()
        -
        6554  {
        -
        6555  VMA_SORT(m_Allocations.begin(), m_Allocations.end(), AllocationInfoSizeGreater());
        -
        6556  }
        -
        6557 
        -
        6558  void SortAllocationsByOffsetDescending()
        -
        6559  {
        -
        6560  VMA_SORT(m_Allocations.begin(), m_Allocations.end(), AllocationInfoOffsetGreater());
        -
        6561  }
        -
        6562  };
        -
        6563 
        -
        6564  struct BlockPointerLess
        -
        6565  {
        -
        6566  bool operator()(const BlockInfo* pLhsBlockInfo, const VmaDeviceMemoryBlock* pRhsBlock) const
        -
        6567  {
        -
        6568  return pLhsBlockInfo->m_pBlock < pRhsBlock;
        -
        6569  }
        -
        6570  bool operator()(const BlockInfo* pLhsBlockInfo, const BlockInfo* pRhsBlockInfo) const
        -
        6571  {
        -
        6572  return pLhsBlockInfo->m_pBlock < pRhsBlockInfo->m_pBlock;
        -
        6573  }
        -
        6574  };
        -
        6575 
        -
        6576  // 1. Blocks with some non-movable allocations go first.
        -
        6577  // 2. Blocks with smaller sumFreeSize go first.
        -
        6578  struct BlockInfoCompareMoveDestination
        -
        6579  {
        -
        6580  bool operator()(const BlockInfo* pLhsBlockInfo, const BlockInfo* pRhsBlockInfo) const
        -
        6581  {
        -
        6582  if(pLhsBlockInfo->m_HasNonMovableAllocations && !pRhsBlockInfo->m_HasNonMovableAllocations)
        -
        6583  {
        -
        6584  return true;
        -
        6585  }
        -
        6586  if(!pLhsBlockInfo->m_HasNonMovableAllocations && pRhsBlockInfo->m_HasNonMovableAllocations)
        -
        6587  {
        -
        6588  return false;
        -
        6589  }
        -
        6590  if(pLhsBlockInfo->m_pBlock->m_pMetadata->GetSumFreeSize() < pRhsBlockInfo->m_pBlock->m_pMetadata->GetSumFreeSize())
        -
        6591  {
        -
        6592  return true;
        -
        6593  }
        -
        6594  return false;
        -
        6595  }
        -
        6596  };
        -
        6597 
        -
        6598  typedef VmaVector< BlockInfo*, VmaStlAllocator<BlockInfo*> > BlockInfoVector;
        -
        6599  BlockInfoVector m_Blocks;
        +
        6546 #if VMA_STATS_STRING_ENABLED
        +
        6547  //void PrintDetailedMap(class VmaStringBuilder& sb);
        +
        6548 #endif
        +
        6549 
        +
        6550 private:
        +
        6551  uint32_t m_Id;
        +
        6552  char* m_Name;
        +
        6553 };
        +
        6554 
        +
        6555 /*
        +
        6556 Performs defragmentation:
        +
        6557 
        +
        6558 - Updates `pBlockVector->m_pMetadata`.
        +
        6559 - Updates allocations by calling ChangeBlockAllocation() or ChangeOffset().
        +
        6560 - Does not move actual data, only returns requested moves as `moves`.
        +
        6561 */
        +
        6562 class VmaDefragmentationAlgorithm
        +
        6563 {
        +
        6564  VMA_CLASS_NO_COPY(VmaDefragmentationAlgorithm)
        +
        6565 public:
        +
        6566  VmaDefragmentationAlgorithm(
        +
        6567  VmaAllocator hAllocator,
        +
        6568  VmaBlockVector* pBlockVector,
        +
        6569  uint32_t currentFrameIndex) :
        +
        6570  m_hAllocator(hAllocator),
        +
        6571  m_pBlockVector(pBlockVector),
        +
        6572  m_CurrentFrameIndex(currentFrameIndex)
        +
        6573  {
        +
        6574  }
        +
        6575  virtual ~VmaDefragmentationAlgorithm()
        +
        6576  {
        +
        6577  }
        +
        6578 
        +
        6579  virtual void AddAllocation(VmaAllocation hAlloc, VkBool32* pChanged) = 0;
        +
        6580  virtual void AddAll() = 0;
        +
        6581 
        +
        6582  virtual VkResult Defragment(
        +
        6583  VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> >& moves,
        +
        6584  VkDeviceSize maxBytesToMove,
        +
        6585  uint32_t maxAllocationsToMove,
        +
        6586  VmaDefragmentationFlags flags) = 0;
        +
        6587 
        +
        6588  virtual VkDeviceSize GetBytesMoved() const = 0;
        +
        6589  virtual uint32_t GetAllocationsMoved() const = 0;
        +
        6590 
        +
        6591 protected:
        +
        6592  VmaAllocator const m_hAllocator;
        +
        6593  VmaBlockVector* const m_pBlockVector;
        +
        6594  const uint32_t m_CurrentFrameIndex;
        +
        6595 
        +
        6596  struct AllocationInfo
        +
        6597  {
        +
        6598  VmaAllocation m_hAllocation;
        +
        6599  VkBool32* m_pChanged;
        6600 
        -
        6601  VkResult DefragmentRound(
        -
        6602  VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> >& moves,
        -
        6603  VkDeviceSize maxBytesToMove,
        -
        6604  uint32_t maxAllocationsToMove);
        -
        6605 
        -
        6606  size_t CalcBlocksWithNonMovableCount() const;
        -
        6607 
        -
        6608  static bool MoveMakesSense(
        -
        6609  size_t dstBlockIndex, VkDeviceSize dstOffset,
        -
        6610  size_t srcBlockIndex, VkDeviceSize srcOffset);
        -
        6611 };
        -
        6612 
        -
        6613 class VmaDefragmentationAlgorithm_Fast : public VmaDefragmentationAlgorithm
        -
        6614 {
        -
        6615  VMA_CLASS_NO_COPY(VmaDefragmentationAlgorithm_Fast)
        -
        6616 public:
        -
        6617  VmaDefragmentationAlgorithm_Fast(
        -
        6618  VmaAllocator hAllocator,
        -
        6619  VmaBlockVector* pBlockVector,
        -
        6620  uint32_t currentFrameIndex,
        -
        6621  bool overlappingMoveSupported);
        -
        6622  virtual ~VmaDefragmentationAlgorithm_Fast();
        -
        6623 
        -
        6624  virtual void AddAllocation(VmaAllocation hAlloc, VkBool32* pChanged) { ++m_AllocationCount; }
        -
        6625  virtual void AddAll() { m_AllAllocations = true; }
        -
        6626 
        -
        6627  virtual VkResult Defragment(
        -
        6628  VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> >& moves,
        -
        6629  VkDeviceSize maxBytesToMove,
        -
        6630  uint32_t maxAllocationsToMove);
        -
        6631 
        -
        6632  virtual VkDeviceSize GetBytesMoved() const { return m_BytesMoved; }
        -
        6633  virtual uint32_t GetAllocationsMoved() const { return m_AllocationsMoved; }
        -
        6634 
        -
        6635 private:
        -
        6636  struct BlockInfo
        -
        6637  {
        -
        6638  size_t origBlockIndex;
        -
        6639  };
        +
        6601  AllocationInfo() :
        +
        6602  m_hAllocation(VK_NULL_HANDLE),
        +
        6603  m_pChanged(VMA_NULL)
        +
        6604  {
        +
        6605  }
        +
        6606  AllocationInfo(VmaAllocation hAlloc, VkBool32* pChanged) :
        +
        6607  m_hAllocation(hAlloc),
        +
        6608  m_pChanged(pChanged)
        +
        6609  {
        +
        6610  }
        +
        6611  };
        +
        6612 };
        +
        6613 
        +
        6614 class VmaDefragmentationAlgorithm_Generic : public VmaDefragmentationAlgorithm
        +
        6615 {
        +
        6616  VMA_CLASS_NO_COPY(VmaDefragmentationAlgorithm_Generic)
        +
        6617 public:
        +
        6618  VmaDefragmentationAlgorithm_Generic(
        +
        6619  VmaAllocator hAllocator,
        +
        6620  VmaBlockVector* pBlockVector,
        +
        6621  uint32_t currentFrameIndex,
        +
        6622  bool overlappingMoveSupported);
        +
        6623  virtual ~VmaDefragmentationAlgorithm_Generic();
        +
        6624 
        +
        6625  virtual void AddAllocation(VmaAllocation hAlloc, VkBool32* pChanged);
        +
        6626  virtual void AddAll() { m_AllAllocations = true; }
        +
        6627 
        +
        6628  virtual VkResult Defragment(
        +
        6629  VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> >& moves,
        +
        6630  VkDeviceSize maxBytesToMove,
        +
        6631  uint32_t maxAllocationsToMove,
        +
        6632  VmaDefragmentationFlags flags);
        +
        6633 
        +
        6634  virtual VkDeviceSize GetBytesMoved() const { return m_BytesMoved; }
        +
        6635  virtual uint32_t GetAllocationsMoved() const { return m_AllocationsMoved; }
        +
        6636 
        +
        6637 private:
        +
        6638  uint32_t m_AllocationCount;
        +
        6639  bool m_AllAllocations;
        6640 
        -
        6641  class FreeSpaceDatabase
        -
        6642  {
        -
        6643  public:
        -
        6644  FreeSpaceDatabase()
        -
        6645  {
        -
        6646  FreeSpace s = {};
        -
        6647  s.blockInfoIndex = SIZE_MAX;
        -
        6648  for(size_t i = 0; i < MAX_COUNT; ++i)
        -
        6649  {
        -
        6650  m_FreeSpaces[i] = s;
        -
        6651  }
        -
        6652  }
        -
        6653 
        -
        6654  void Register(size_t blockInfoIndex, VkDeviceSize offset, VkDeviceSize size)
        -
        6655  {
        -
        6656  if(size < VMA_MIN_FREE_SUBALLOCATION_SIZE_TO_REGISTER)
        -
        6657  {
        -
        6658  return;
        -
        6659  }
        -
        6660 
        -
        6661  // Find first invalid or the smallest structure.
        -
        6662  size_t bestIndex = SIZE_MAX;
        -
        6663  for(size_t i = 0; i < MAX_COUNT; ++i)
        -
        6664  {
        -
        6665  // Empty structure.
        -
        6666  if(m_FreeSpaces[i].blockInfoIndex == SIZE_MAX)
        -
        6667  {
        -
        6668  bestIndex = i;
        -
        6669  break;
        -
        6670  }
        -
        6671  if(m_FreeSpaces[i].size < size &&
        -
        6672  (bestIndex == SIZE_MAX || m_FreeSpaces[bestIndex].size > m_FreeSpaces[i].size))
        -
        6673  {
        -
        6674  bestIndex = i;
        -
        6675  }
        -
        6676  }
        -
        6677 
        -
        6678  if(bestIndex != SIZE_MAX)
        -
        6679  {
        -
        6680  m_FreeSpaces[bestIndex].blockInfoIndex = blockInfoIndex;
        -
        6681  m_FreeSpaces[bestIndex].offset = offset;
        -
        6682  m_FreeSpaces[bestIndex].size = size;
        -
        6683  }
        -
        6684  }
        -
        6685 
        -
        6686  bool Fetch(VkDeviceSize alignment, VkDeviceSize size,
        -
        6687  size_t& outBlockInfoIndex, VkDeviceSize& outDstOffset)
        +
        6641  VkDeviceSize m_BytesMoved;
        +
        6642  uint32_t m_AllocationsMoved;
        +
        6643 
        +
        6644  struct AllocationInfoSizeGreater
        +
        6645  {
        +
        6646  bool operator()(const AllocationInfo& lhs, const AllocationInfo& rhs) const
        +
        6647  {
        +
        6648  return lhs.m_hAllocation->GetSize() > rhs.m_hAllocation->GetSize();
        +
        6649  }
        +
        6650  };
        +
        6651 
        +
        6652  struct AllocationInfoOffsetGreater
        +
        6653  {
        +
        6654  bool operator()(const AllocationInfo& lhs, const AllocationInfo& rhs) const
        +
        6655  {
        +
        6656  return lhs.m_hAllocation->GetOffset() > rhs.m_hAllocation->GetOffset();
        +
        6657  }
        +
        6658  };
        +
        6659 
        +
        6660  struct BlockInfo
        +
        6661  {
        +
        6662  size_t m_OriginalBlockIndex;
        +
        6663  VmaDeviceMemoryBlock* m_pBlock;
        +
        6664  bool m_HasNonMovableAllocations;
        +
        6665  VmaVector< AllocationInfo, VmaStlAllocator<AllocationInfo> > m_Allocations;
        +
        6666 
        +
        6667  BlockInfo(const VkAllocationCallbacks* pAllocationCallbacks) :
        +
        6668  m_OriginalBlockIndex(SIZE_MAX),
        +
        6669  m_pBlock(VMA_NULL),
        +
        6670  m_HasNonMovableAllocations(true),
        +
        6671  m_Allocations(pAllocationCallbacks)
        +
        6672  {
        +
        6673  }
        +
        6674 
        +
        6675  void CalcHasNonMovableAllocations()
        +
        6676  {
        +
        6677  const size_t blockAllocCount = m_pBlock->m_pMetadata->GetAllocationCount();
        +
        6678  const size_t defragmentAllocCount = m_Allocations.size();
        +
        6679  m_HasNonMovableAllocations = blockAllocCount != defragmentAllocCount;
        +
        6680  }
        +
        6681 
        +
        6682  void SortAllocationsBySizeDescending()
        +
        6683  {
        +
        6684  VMA_SORT(m_Allocations.begin(), m_Allocations.end(), AllocationInfoSizeGreater());
        +
        6685  }
        +
        6686 
        +
        6687  void SortAllocationsByOffsetDescending()
        6688  {
        -
        6689  size_t bestIndex = SIZE_MAX;
        -
        6690  VkDeviceSize bestFreeSpaceAfter = 0;
        -
        6691  for(size_t i = 0; i < MAX_COUNT; ++i)
        -
        6692  {
        -
        6693  // Structure is valid.
        -
        6694  if(m_FreeSpaces[i].blockInfoIndex != SIZE_MAX)
        -
        6695  {
        -
        6696  const VkDeviceSize dstOffset = VmaAlignUp(m_FreeSpaces[i].offset, alignment);
        -
        6697  // Allocation fits into this structure.
        -
        6698  if(dstOffset + size <= m_FreeSpaces[i].offset + m_FreeSpaces[i].size)
        -
        6699  {
        -
        6700  const VkDeviceSize freeSpaceAfter = (m_FreeSpaces[i].offset + m_FreeSpaces[i].size) -
        -
        6701  (dstOffset + size);
        -
        6702  if(bestIndex == SIZE_MAX || freeSpaceAfter > bestFreeSpaceAfter)
        -
        6703  {
        -
        6704  bestIndex = i;
        -
        6705  bestFreeSpaceAfter = freeSpaceAfter;
        -
        6706  }
        -
        6707  }
        -
        6708  }
        -
        6709  }
        -
        6710 
        -
        6711  if(bestIndex != SIZE_MAX)
        +
        6689  VMA_SORT(m_Allocations.begin(), m_Allocations.end(), AllocationInfoOffsetGreater());
        +
        6690  }
        +
        6691  };
        +
        6692 
        +
        6693  struct BlockPointerLess
        +
        6694  {
        +
        6695  bool operator()(const BlockInfo* pLhsBlockInfo, const VmaDeviceMemoryBlock* pRhsBlock) const
        +
        6696  {
        +
        6697  return pLhsBlockInfo->m_pBlock < pRhsBlock;
        +
        6698  }
        +
        6699  bool operator()(const BlockInfo* pLhsBlockInfo, const BlockInfo* pRhsBlockInfo) const
        +
        6700  {
        +
        6701  return pLhsBlockInfo->m_pBlock < pRhsBlockInfo->m_pBlock;
        +
        6702  }
        +
        6703  };
        +
        6704 
        +
        6705  // 1. Blocks with some non-movable allocations go first.
        +
        6706  // 2. Blocks with smaller sumFreeSize go first.
        +
        6707  struct BlockInfoCompareMoveDestination
        +
        6708  {
        +
        6709  bool operator()(const BlockInfo* pLhsBlockInfo, const BlockInfo* pRhsBlockInfo) const
        +
        6710  {
        +
        6711  if(pLhsBlockInfo->m_HasNonMovableAllocations && !pRhsBlockInfo->m_HasNonMovableAllocations)
        6712  {
        -
        6713  outBlockInfoIndex = m_FreeSpaces[bestIndex].blockInfoIndex;
        -
        6714  outDstOffset = VmaAlignUp(m_FreeSpaces[bestIndex].offset, alignment);
        -
        6715 
        -
        6716  if(bestFreeSpaceAfter >= VMA_MIN_FREE_SUBALLOCATION_SIZE_TO_REGISTER)
        -
        6717  {
        -
        6718  // Leave this structure for remaining empty space.
        -
        6719  const VkDeviceSize alignmentPlusSize = (outDstOffset - m_FreeSpaces[bestIndex].offset) + size;
        -
        6720  m_FreeSpaces[bestIndex].offset += alignmentPlusSize;
        -
        6721  m_FreeSpaces[bestIndex].size -= alignmentPlusSize;
        -
        6722  }
        -
        6723  else
        -
        6724  {
        -
        6725  // This structure becomes invalid.
        -
        6726  m_FreeSpaces[bestIndex].blockInfoIndex = SIZE_MAX;
        -
        6727  }
        -
        6728 
        -
        6729  return true;
        -
        6730  }
        -
        6731 
        -
        6732  return false;
        -
        6733  }
        -
        6734 
        -
        6735  private:
        -
        6736  static const size_t MAX_COUNT = 4;
        +
        6713  return true;
        +
        6714  }
        +
        6715  if(!pLhsBlockInfo->m_HasNonMovableAllocations && pRhsBlockInfo->m_HasNonMovableAllocations)
        +
        6716  {
        +
        6717  return false;
        +
        6718  }
        +
        6719  if(pLhsBlockInfo->m_pBlock->m_pMetadata->GetSumFreeSize() < pRhsBlockInfo->m_pBlock->m_pMetadata->GetSumFreeSize())
        +
        6720  {
        +
        6721  return true;
        +
        6722  }
        +
        6723  return false;
        +
        6724  }
        +
        6725  };
        +
        6726 
        +
        6727  typedef VmaVector< BlockInfo*, VmaStlAllocator<BlockInfo*> > BlockInfoVector;
        +
        6728  BlockInfoVector m_Blocks;
        +
        6729 
        +
        6730  VkResult DefragmentRound(
        +
        6731  VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> >& moves,
        +
        6732  VkDeviceSize maxBytesToMove,
        +
        6733  uint32_t maxAllocationsToMove,
        +
        6734  bool freeOldAllocations);
        +
        6735 
        +
        6736  size_t CalcBlocksWithNonMovableCount() const;
        6737 
        -
        6738  struct FreeSpace
        -
        6739  {
        -
        6740  size_t blockInfoIndex; // SIZE_MAX means this structure is invalid.
        -
        6741  VkDeviceSize offset;
        -
        6742  VkDeviceSize size;
        -
        6743  } m_FreeSpaces[MAX_COUNT];
        -
        6744  };
        -
        6745 
        -
        6746  const bool m_OverlappingMoveSupported;
        -
        6747 
        -
        6748  uint32_t m_AllocationCount;
        -
        6749  bool m_AllAllocations;
        -
        6750 
        -
        6751  VkDeviceSize m_BytesMoved;
        -
        6752  uint32_t m_AllocationsMoved;
        +
        6738  static bool MoveMakesSense(
        +
        6739  size_t dstBlockIndex, VkDeviceSize dstOffset,
        +
        6740  size_t srcBlockIndex, VkDeviceSize srcOffset);
        +
        6741 };
        +
        6742 
        +
        6743 class VmaDefragmentationAlgorithm_Fast : public VmaDefragmentationAlgorithm
        +
        6744 {
        +
        6745  VMA_CLASS_NO_COPY(VmaDefragmentationAlgorithm_Fast)
        +
        6746 public:
        +
        6747  VmaDefragmentationAlgorithm_Fast(
        +
        6748  VmaAllocator hAllocator,
        +
        6749  VmaBlockVector* pBlockVector,
        +
        6750  uint32_t currentFrameIndex,
        +
        6751  bool overlappingMoveSupported);
        +
        6752  virtual ~VmaDefragmentationAlgorithm_Fast();
        6753 
        -
        6754  VmaVector< BlockInfo, VmaStlAllocator<BlockInfo> > m_BlockInfos;
        -
        6755 
        -
        6756  void PreprocessMetadata();
        -
        6757  void PostprocessMetadata();
        -
        6758  void InsertSuballoc(VmaBlockMetadata_Generic* pMetadata, const VmaSuballocation& suballoc);
        -
        6759 };
        -
        6760 
        -
        6761 struct VmaBlockDefragmentationContext
        -
        6762 {
        -
        6763  enum BLOCK_FLAG
        -
        6764  {
        -
        6765  BLOCK_FLAG_USED = 0x00000001,
        -
        6766  };
        -
        6767  uint32_t flags;
        -
        6768  VkBuffer hBuffer;
        -
        6769 };
        -
        6770 
        -
        6771 class VmaBlockVectorDefragmentationContext
        -
        6772 {
        -
        6773  VMA_CLASS_NO_COPY(VmaBlockVectorDefragmentationContext)
        -
        6774 public:
        -
        6775  VkResult res;
        -
        6776  bool mutexLocked;
        -
        6777  VmaVector< VmaBlockDefragmentationContext, VmaStlAllocator<VmaBlockDefragmentationContext> > blockContexts;
        -
        6778 
        -
        6779  VmaBlockVectorDefragmentationContext(
        -
        6780  VmaAllocator hAllocator,
        -
        6781  VmaPool hCustomPool, // Optional.
        -
        6782  VmaBlockVector* pBlockVector,
        -
        6783  uint32_t currFrameIndex);
        -
        6784  ~VmaBlockVectorDefragmentationContext();
        -
        6785 
        -
        6786  VmaPool GetCustomPool() const { return m_hCustomPool; }
        -
        6787  VmaBlockVector* GetBlockVector() const { return m_pBlockVector; }
        -
        6788  VmaDefragmentationAlgorithm* GetAlgorithm() const { return m_pAlgorithm; }
        -
        6789 
        -
        6790  void AddAllocation(VmaAllocation hAlloc, VkBool32* pChanged);
        -
        6791  void AddAll() { m_AllAllocations = true; }
        -
        6792 
        -
        6793  void Begin(bool overlappingMoveSupported);
        -
        6794 
        -
        6795 private:
        -
        6796  const VmaAllocator m_hAllocator;
        -
        6797  // Null if not from custom pool.
        -
        6798  const VmaPool m_hCustomPool;
        -
        6799  // Redundant, for convenience not to fetch from m_hCustomPool->m_BlockVector or m_hAllocator->m_pBlockVectors.
        -
        6800  VmaBlockVector* const m_pBlockVector;
        -
        6801  const uint32_t m_CurrFrameIndex;
        -
        6802  // Owner of this object.
        -
        6803  VmaDefragmentationAlgorithm* m_pAlgorithm;
        -
        6804 
        -
        6805  struct AllocInfo
        -
        6806  {
        -
        6807  VmaAllocation hAlloc;
        -
        6808  VkBool32* pChanged;
        -
        6809  };
        -
        6810  // Used between constructor and Begin.
        -
        6811  VmaVector< AllocInfo, VmaStlAllocator<AllocInfo> > m_Allocations;
        -
        6812  bool m_AllAllocations;
        -
        6813 };
        -
        6814 
        -
        6815 struct VmaDefragmentationContext_T
        -
        6816 {
        -
        6817 private:
        -
        6818  VMA_CLASS_NO_COPY(VmaDefragmentationContext_T)
        -
        6819 public:
        -
        6820  VmaDefragmentationContext_T(
        -
        6821  VmaAllocator hAllocator,
        -
        6822  uint32_t currFrameIndex,
        -
        6823  uint32_t flags,
        -
        6824  VmaDefragmentationStats* pStats);
        -
        6825  ~VmaDefragmentationContext_T();
        -
        6826 
        -
        6827  void AddPools(uint32_t poolCount, VmaPool* pPools);
        -
        6828  void AddAllocations(
        -
        6829  uint32_t allocationCount,
        -
        6830  VmaAllocation* pAllocations,
        -
        6831  VkBool32* pAllocationsChanged);
        -
        6832 
        -
        6833  /*
        -
        6834  Returns:
        -
        6835  - `VK_SUCCESS` if succeeded and object can be destroyed immediately.
        -
        6836  - `VK_NOT_READY` if succeeded but the object must remain alive until vmaDefragmentationEnd().
        -
        6837  - Negative value if error occured and object can be destroyed immediately.
        -
        6838  */
        -
        6839  VkResult Defragment(
        -
        6840  VkDeviceSize maxCpuBytesToMove, uint32_t maxCpuAllocationsToMove,
        -
        6841  VkDeviceSize maxGpuBytesToMove, uint32_t maxGpuAllocationsToMove,
        -
        6842  VkCommandBuffer commandBuffer, VmaDefragmentationStats* pStats);
        -
        6843 
        -
        6844 private:
        -
        6845  const VmaAllocator m_hAllocator;
        -
        6846  const uint32_t m_CurrFrameIndex;
        -
        6847  const uint32_t m_Flags;
        -
        6848  VmaDefragmentationStats* const m_pStats;
        -
        6849  // Owner of these objects.
        -
        6850  VmaBlockVectorDefragmentationContext* m_DefaultPoolContexts[VK_MAX_MEMORY_TYPES];
        -
        6851  // Owner of these objects.
        -
        6852  VmaVector< VmaBlockVectorDefragmentationContext*, VmaStlAllocator<VmaBlockVectorDefragmentationContext*> > m_CustomPoolContexts;
        -
        6853 };
        -
        6854 
        -
        6855 #if VMA_RECORDING_ENABLED
        -
        6856 
        -
        6857 class VmaRecorder
        -
        6858 {
        -
        6859 public:
        -
        6860  VmaRecorder();
        -
        6861  VkResult Init(const VmaRecordSettings& settings, bool useMutex);
        -
        6862  void WriteConfiguration(
        -
        6863  const VkPhysicalDeviceProperties& devProps,
        -
        6864  const VkPhysicalDeviceMemoryProperties& memProps,
        -
        6865  uint32_t vulkanApiVersion,
        -
        6866  bool dedicatedAllocationExtensionEnabled,
        -
        6867  bool bindMemory2ExtensionEnabled,
        -
        6868  bool memoryBudgetExtensionEnabled);
        -
        6869  ~VmaRecorder();
        -
        6870 
        -
        6871  void RecordCreateAllocator(uint32_t frameIndex);
        -
        6872  void RecordDestroyAllocator(uint32_t frameIndex);
        -
        6873  void RecordCreatePool(uint32_t frameIndex,
        -
        6874  const VmaPoolCreateInfo& createInfo,
        -
        6875  VmaPool pool);
        -
        6876  void RecordDestroyPool(uint32_t frameIndex, VmaPool pool);
        -
        6877  void RecordAllocateMemory(uint32_t frameIndex,
        -
        6878  const VkMemoryRequirements& vkMemReq,
        -
        6879  const VmaAllocationCreateInfo& createInfo,
        -
        6880  VmaAllocation allocation);
        -
        6881  void RecordAllocateMemoryPages(uint32_t frameIndex,
        -
        6882  const VkMemoryRequirements& vkMemReq,
        -
        6883  const VmaAllocationCreateInfo& createInfo,
        -
        6884  uint64_t allocationCount,
        -
        6885  const VmaAllocation* pAllocations);
        -
        6886  void RecordAllocateMemoryForBuffer(uint32_t frameIndex,
        -
        6887  const VkMemoryRequirements& vkMemReq,
        -
        6888  bool requiresDedicatedAllocation,
        -
        6889  bool prefersDedicatedAllocation,
        -
        6890  const VmaAllocationCreateInfo& createInfo,
        -
        6891  VmaAllocation allocation);
        -
        6892  void RecordAllocateMemoryForImage(uint32_t frameIndex,
        -
        6893  const VkMemoryRequirements& vkMemReq,
        -
        6894  bool requiresDedicatedAllocation,
        -
        6895  bool prefersDedicatedAllocation,
        -
        6896  const VmaAllocationCreateInfo& createInfo,
        -
        6897  VmaAllocation allocation);
        -
        6898  void RecordFreeMemory(uint32_t frameIndex,
        -
        6899  VmaAllocation allocation);
        -
        6900  void RecordFreeMemoryPages(uint32_t frameIndex,
        -
        6901  uint64_t allocationCount,
        -
        6902  const VmaAllocation* pAllocations);
        -
        6903  void RecordSetAllocationUserData(uint32_t frameIndex,
        -
        6904  VmaAllocation allocation,
        -
        6905  const void* pUserData);
        -
        6906  void RecordCreateLostAllocation(uint32_t frameIndex,
        -
        6907  VmaAllocation allocation);
        -
        6908  void RecordMapMemory(uint32_t frameIndex,
        -
        6909  VmaAllocation allocation);
        -
        6910  void RecordUnmapMemory(uint32_t frameIndex,
        -
        6911  VmaAllocation allocation);
        -
        6912  void RecordFlushAllocation(uint32_t frameIndex,
        -
        6913  VmaAllocation allocation, VkDeviceSize offset, VkDeviceSize size);
        -
        6914  void RecordInvalidateAllocation(uint32_t frameIndex,
        -
        6915  VmaAllocation allocation, VkDeviceSize offset, VkDeviceSize size);
        -
        6916  void RecordCreateBuffer(uint32_t frameIndex,
        -
        6917  const VkBufferCreateInfo& bufCreateInfo,
        -
        6918  const VmaAllocationCreateInfo& allocCreateInfo,
        -
        6919  VmaAllocation allocation);
        -
        6920  void RecordCreateImage(uint32_t frameIndex,
        -
        6921  const VkImageCreateInfo& imageCreateInfo,
        -
        6922  const VmaAllocationCreateInfo& allocCreateInfo,
        -
        6923  VmaAllocation allocation);
        -
        6924  void RecordDestroyBuffer(uint32_t frameIndex,
        -
        6925  VmaAllocation allocation);
        -
        6926  void RecordDestroyImage(uint32_t frameIndex,
        -
        6927  VmaAllocation allocation);
        -
        6928  void RecordTouchAllocation(uint32_t frameIndex,
        -
        6929  VmaAllocation allocation);
        -
        6930  void RecordGetAllocationInfo(uint32_t frameIndex,
        -
        6931  VmaAllocation allocation);
        -
        6932  void RecordMakePoolAllocationsLost(uint32_t frameIndex,
        -
        6933  VmaPool pool);
        -
        6934  void RecordDefragmentationBegin(uint32_t frameIndex,
        -
        6935  const VmaDefragmentationInfo2& info,
        -
        6936  VmaDefragmentationContext ctx);
        -
        6937  void RecordDefragmentationEnd(uint32_t frameIndex,
        -
        6938  VmaDefragmentationContext ctx);
        -
        6939  void RecordSetPoolName(uint32_t frameIndex,
        -
        6940  VmaPool pool,
        -
        6941  const char* name);
        -
        6942 
        -
        6943 private:
        -
        6944  struct CallParams
        -
        6945  {
        -
        6946  uint32_t threadId;
        -
        6947  double time;
        -
        6948  };
        +
        6754  virtual void AddAllocation(VmaAllocation hAlloc, VkBool32* pChanged) { ++m_AllocationCount; }
        +
        6755  virtual void AddAll() { m_AllAllocations = true; }
        +
        6756 
        +
        6757  virtual VkResult Defragment(
        +
        6758  VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> >& moves,
        +
        6759  VkDeviceSize maxBytesToMove,
        +
        6760  uint32_t maxAllocationsToMove,
        +
        6761  VmaDefragmentationFlags flags);
        +
        6762 
        +
        6763  virtual VkDeviceSize GetBytesMoved() const { return m_BytesMoved; }
        +
        6764  virtual uint32_t GetAllocationsMoved() const { return m_AllocationsMoved; }
        +
        6765 
        +
        6766 private:
        +
        6767  struct BlockInfo
        +
        6768  {
        +
        6769  size_t origBlockIndex;
        +
        6770  };
        +
        6771 
        +
        6772  class FreeSpaceDatabase
        +
        6773  {
        +
        6774  public:
        +
        6775  FreeSpaceDatabase()
        +
        6776  {
        +
        6777  FreeSpace s = {};
        +
        6778  s.blockInfoIndex = SIZE_MAX;
        +
        6779  for(size_t i = 0; i < MAX_COUNT; ++i)
        +
        6780  {
        +
        6781  m_FreeSpaces[i] = s;
        +
        6782  }
        +
        6783  }
        +
        6784 
        +
        6785  void Register(size_t blockInfoIndex, VkDeviceSize offset, VkDeviceSize size)
        +
        6786  {
        +
        6787  if(size < VMA_MIN_FREE_SUBALLOCATION_SIZE_TO_REGISTER)
        +
        6788  {
        +
        6789  return;
        +
        6790  }
        +
        6791 
        +
        6792  // Find first invalid or the smallest structure.
        +
        6793  size_t bestIndex = SIZE_MAX;
        +
        6794  for(size_t i = 0; i < MAX_COUNT; ++i)
        +
        6795  {
        +
        6796  // Empty structure.
        +
        6797  if(m_FreeSpaces[i].blockInfoIndex == SIZE_MAX)
        +
        6798  {
        +
        6799  bestIndex = i;
        +
        6800  break;
        +
        6801  }
        +
        6802  if(m_FreeSpaces[i].size < size &&
        +
        6803  (bestIndex == SIZE_MAX || m_FreeSpaces[bestIndex].size > m_FreeSpaces[i].size))
        +
        6804  {
        +
        6805  bestIndex = i;
        +
        6806  }
        +
        6807  }
        +
        6808 
        +
        6809  if(bestIndex != SIZE_MAX)
        +
        6810  {
        +
        6811  m_FreeSpaces[bestIndex].blockInfoIndex = blockInfoIndex;
        +
        6812  m_FreeSpaces[bestIndex].offset = offset;
        +
        6813  m_FreeSpaces[bestIndex].size = size;
        +
        6814  }
        +
        6815  }
        +
        6816 
        +
        6817  bool Fetch(VkDeviceSize alignment, VkDeviceSize size,
        +
        6818  size_t& outBlockInfoIndex, VkDeviceSize& outDstOffset)
        +
        6819  {
        +
        6820  size_t bestIndex = SIZE_MAX;
        +
        6821  VkDeviceSize bestFreeSpaceAfter = 0;
        +
        6822  for(size_t i = 0; i < MAX_COUNT; ++i)
        +
        6823  {
        +
        6824  // Structure is valid.
        +
        6825  if(m_FreeSpaces[i].blockInfoIndex != SIZE_MAX)
        +
        6826  {
        +
        6827  const VkDeviceSize dstOffset = VmaAlignUp(m_FreeSpaces[i].offset, alignment);
        +
        6828  // Allocation fits into this structure.
        +
        6829  if(dstOffset + size <= m_FreeSpaces[i].offset + m_FreeSpaces[i].size)
        +
        6830  {
        +
        6831  const VkDeviceSize freeSpaceAfter = (m_FreeSpaces[i].offset + m_FreeSpaces[i].size) -
        +
        6832  (dstOffset + size);
        +
        6833  if(bestIndex == SIZE_MAX || freeSpaceAfter > bestFreeSpaceAfter)
        +
        6834  {
        +
        6835  bestIndex = i;
        +
        6836  bestFreeSpaceAfter = freeSpaceAfter;
        +
        6837  }
        +
        6838  }
        +
        6839  }
        +
        6840  }
        +
        6841 
        +
        6842  if(bestIndex != SIZE_MAX)
        +
        6843  {
        +
        6844  outBlockInfoIndex = m_FreeSpaces[bestIndex].blockInfoIndex;
        +
        6845  outDstOffset = VmaAlignUp(m_FreeSpaces[bestIndex].offset, alignment);
        +
        6846 
        +
        6847  if(bestFreeSpaceAfter >= VMA_MIN_FREE_SUBALLOCATION_SIZE_TO_REGISTER)
        +
        6848  {
        +
        6849  // Leave this structure for remaining empty space.
        +
        6850  const VkDeviceSize alignmentPlusSize = (outDstOffset - m_FreeSpaces[bestIndex].offset) + size;
        +
        6851  m_FreeSpaces[bestIndex].offset += alignmentPlusSize;
        +
        6852  m_FreeSpaces[bestIndex].size -= alignmentPlusSize;
        +
        6853  }
        +
        6854  else
        +
        6855  {
        +
        6856  // This structure becomes invalid.
        +
        6857  m_FreeSpaces[bestIndex].blockInfoIndex = SIZE_MAX;
        +
        6858  }
        +
        6859 
        +
        6860  return true;
        +
        6861  }
        +
        6862 
        +
        6863  return false;
        +
        6864  }
        +
        6865 
        +
        6866  private:
        +
        6867  static const size_t MAX_COUNT = 4;
        +
        6868 
        +
        6869  struct FreeSpace
        +
        6870  {
        +
        6871  size_t blockInfoIndex; // SIZE_MAX means this structure is invalid.
        +
        6872  VkDeviceSize offset;
        +
        6873  VkDeviceSize size;
        +
        6874  } m_FreeSpaces[MAX_COUNT];
        +
        6875  };
        +
        6876 
        +
        6877  const bool m_OverlappingMoveSupported;
        +
        6878 
        +
        6879  uint32_t m_AllocationCount;
        +
        6880  bool m_AllAllocations;
        +
        6881 
        +
        6882  VkDeviceSize m_BytesMoved;
        +
        6883  uint32_t m_AllocationsMoved;
        +
        6884 
        +
        6885  VmaVector< BlockInfo, VmaStlAllocator<BlockInfo> > m_BlockInfos;
        +
        6886 
        +
        6887  void PreprocessMetadata();
        +
        6888  void PostprocessMetadata();
        +
        6889  void InsertSuballoc(VmaBlockMetadata_Generic* pMetadata, const VmaSuballocation& suballoc);
        +
        6890 };
        +
        6891 
        +
        6892 struct VmaBlockDefragmentationContext
        +
        6893 {
        +
        6894  enum BLOCK_FLAG
        +
        6895  {
        +
        6896  BLOCK_FLAG_USED = 0x00000001,
        +
        6897  };
        +
        6898  uint32_t flags;
        +
        6899  VkBuffer hBuffer;
        +
        6900 };
        +
        6901 
        +
        6902 class VmaBlockVectorDefragmentationContext
        +
        6903 {
        +
        6904  VMA_CLASS_NO_COPY(VmaBlockVectorDefragmentationContext)
        +
        6905 public:
        +
        6906  VkResult res;
        +
        6907  bool mutexLocked;
        +
        6908  VmaVector< VmaBlockDefragmentationContext, VmaStlAllocator<VmaBlockDefragmentationContext> > blockContexts;
        +
        6909  VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> > defragmentationMoves;
        +
        6910  uint32_t defragmentationMovesProcessed;
        +
        6911  uint32_t defragmentationMovesCommitted;
        +
        6912  bool hasDefragmentationPlan;
        +
        6913 
        +
        6914  VmaBlockVectorDefragmentationContext(
        +
        6915  VmaAllocator hAllocator,
        +
        6916  VmaPool hCustomPool, // Optional.
        +
        6917  VmaBlockVector* pBlockVector,
        +
        6918  uint32_t currFrameIndex);
        +
        6919  ~VmaBlockVectorDefragmentationContext();
        +
        6920 
        +
        6921  VmaPool GetCustomPool() const { return m_hCustomPool; }
        +
        6922  VmaBlockVector* GetBlockVector() const { return m_pBlockVector; }
        +
        6923  VmaDefragmentationAlgorithm* GetAlgorithm() const { return m_pAlgorithm; }
        +
        6924 
        +
        6925  void AddAllocation(VmaAllocation hAlloc, VkBool32* pChanged);
        +
        6926  void AddAll() { m_AllAllocations = true; }
        +
        6927 
        +
        6928  void Begin(bool overlappingMoveSupported, VmaDefragmentationFlags flags);
        +
        6929 
        +
        6930 private:
        +
        6931  const VmaAllocator m_hAllocator;
        +
        6932  // Null if not from custom pool.
        +
        6933  const VmaPool m_hCustomPool;
        +
        6934  // Redundant, for convenience not to fetch from m_hCustomPool->m_BlockVector or m_hAllocator->m_pBlockVectors.
        +
        6935  VmaBlockVector* const m_pBlockVector;
        +
        6936  const uint32_t m_CurrFrameIndex;
        +
        6937  // Owner of this object.
        +
        6938  VmaDefragmentationAlgorithm* m_pAlgorithm;
        +
        6939 
        +
        6940  struct AllocInfo
        +
        6941  {
        +
        6942  VmaAllocation hAlloc;
        +
        6943  VkBool32* pChanged;
        +
        6944  };
        +
        6945  // Used between constructor and Begin.
        +
        6946  VmaVector< AllocInfo, VmaStlAllocator<AllocInfo> > m_Allocations;
        +
        6947  bool m_AllAllocations;
        +
        6948 };
        6949 
        -
        6950  class UserDataString
        -
        6951  {
        -
        6952  public:
        -
        6953  UserDataString(VmaAllocationCreateFlags allocFlags, const void* pUserData);
        -
        6954  const char* GetString() const { return m_Str; }
        -
        6955 
        -
        6956  private:
        -
        6957  char m_PtrStr[17];
        -
        6958  const char* m_Str;
        -
        6959  };
        -
        6960 
        -
        6961  bool m_UseMutex;
        -
        6962  VmaRecordFlags m_Flags;
        -
        6963  FILE* m_File;
        -
        6964  VMA_MUTEX m_FileMutex;
        -
        6965  int64_t m_Freq;
        -
        6966  int64_t m_StartCounter;
        +
        6950 struct VmaDefragmentationContext_T
        +
        6951 {
        +
        6952 private:
        +
        6953  VMA_CLASS_NO_COPY(VmaDefragmentationContext_T)
        +
        6954 public:
        +
        6955  VmaDefragmentationContext_T(
        +
        6956  VmaAllocator hAllocator,
        +
        6957  uint32_t currFrameIndex,
        +
        6958  uint32_t flags,
        +
        6959  VmaDefragmentationStats* pStats);
        +
        6960  ~VmaDefragmentationContext_T();
        +
        6961 
        +
        6962  void AddPools(uint32_t poolCount, VmaPool* pPools);
        +
        6963  void AddAllocations(
        +
        6964  uint32_t allocationCount,
        +
        6965  VmaAllocation* pAllocations,
        +
        6966  VkBool32* pAllocationsChanged);
        6967 
        -
        6968  void GetBasicParams(CallParams& outParams);
        -
        6969 
        -
        6970  // T must be a pointer type, e.g. VmaAllocation, VmaPool.
        -
        6971  template<typename T>
        -
        6972  void PrintPointerList(uint64_t count, const T* pItems)
        -
        6973  {
        -
        6974  if(count)
        -
        6975  {
        -
        6976  fprintf(m_File, "%p", pItems[0]);
        -
        6977  for(uint64_t i = 1; i < count; ++i)
        -
        6978  {
        -
        6979  fprintf(m_File, " %p", pItems[i]);
        -
        6980  }
        -
        6981  }
        -
        6982  }
        -
        6983 
        -
        6984  void PrintPointerList(uint64_t count, const VmaAllocation* pItems);
        -
        6985  void Flush();
        -
        6986 };
        +
        6968  /*
        +
        6969  Returns:
        +
        6970  - `VK_SUCCESS` if succeeded and object can be destroyed immediately.
        +
        6971  - `VK_NOT_READY` if succeeded but the object must remain alive until vmaDefragmentationEnd().
        +
        6972  - Negative value if error occured and object can be destroyed immediately.
        +
        6973  */
        +
        6974  VkResult Defragment(
        +
        6975  VkDeviceSize maxCpuBytesToMove, uint32_t maxCpuAllocationsToMove,
        +
        6976  VkDeviceSize maxGpuBytesToMove, uint32_t maxGpuAllocationsToMove,
        +
        6977  VkCommandBuffer commandBuffer, VmaDefragmentationStats* pStats, VmaDefragmentationFlags flags);
        +
        6978 
        +
        6979  VkResult DefragmentPassBegin(VmaDefragmentationPassInfo* pInfo);
        +
        6980  VkResult DefragmentPassEnd();
        +
        6981 
        +
        6982 private:
        +
        6983  const VmaAllocator m_hAllocator;
        +
        6984  const uint32_t m_CurrFrameIndex;
        +
        6985  const uint32_t m_Flags;
        +
        6986  VmaDefragmentationStats* const m_pStats;
        6987 
        -
        6988 #endif // #if VMA_RECORDING_ENABLED
        -
        6989 
        -
        6990 /*
        -
        6991 Thread-safe wrapper over VmaPoolAllocator free list, for allocation of VmaAllocation_T objects.
        -
        6992 */
        -
        6993 class VmaAllocationObjectAllocator
        -
        6994 {
        -
        6995  VMA_CLASS_NO_COPY(VmaAllocationObjectAllocator)
        -
        6996 public:
        -
        6997  VmaAllocationObjectAllocator(const VkAllocationCallbacks* pAllocationCallbacks);
        +
        6988  VkDeviceSize m_MaxCpuBytesToMove;
        +
        6989  uint32_t m_MaxCpuAllocationsToMove;
        +
        6990  VkDeviceSize m_MaxGpuBytesToMove;
        +
        6991  uint32_t m_MaxGpuAllocationsToMove;
        +
        6992 
        +
        6993  // Owner of these objects.
        +
        6994  VmaBlockVectorDefragmentationContext* m_DefaultPoolContexts[VK_MAX_MEMORY_TYPES];
        +
        6995  // Owner of these objects.
        +
        6996  VmaVector< VmaBlockVectorDefragmentationContext*, VmaStlAllocator<VmaBlockVectorDefragmentationContext*> > m_CustomPoolContexts;
        +
        6997 };
        6998 
        -
        6999  VmaAllocation Allocate();
        -
        7000  void Free(VmaAllocation hAlloc);
        -
        7001 
        -
        7002 private:
        -
        7003  VMA_MUTEX m_Mutex;
        -
        7004  VmaPoolAllocator<VmaAllocation_T> m_Allocator;
        -
        7005 };
        -
        7006 
        -
        7007 struct VmaCurrentBudgetData
        -
        7008 {
        -
        7009  VMA_ATOMIC_UINT64 m_BlockBytes[VK_MAX_MEMORY_HEAPS];
        -
        7010  VMA_ATOMIC_UINT64 m_AllocationBytes[VK_MAX_MEMORY_HEAPS];
        -
        7011 
        -
        7012 #if VMA_MEMORY_BUDGET
        -
        7013  VMA_ATOMIC_UINT32 m_OperationsSinceBudgetFetch;
        -
        7014  VMA_RW_MUTEX m_BudgetMutex;
        -
        7015  uint64_t m_VulkanUsage[VK_MAX_MEMORY_HEAPS];
        -
        7016  uint64_t m_VulkanBudget[VK_MAX_MEMORY_HEAPS];
        -
        7017  uint64_t m_BlockBytesAtBudgetFetch[VK_MAX_MEMORY_HEAPS];
        -
        7018 #endif // #if VMA_MEMORY_BUDGET
        -
        7019 
        -
        7020  VmaCurrentBudgetData()
        -
        7021  {
        -
        7022  for(uint32_t heapIndex = 0; heapIndex < VK_MAX_MEMORY_HEAPS; ++heapIndex)
        -
        7023  {
        -
        7024  m_BlockBytes[heapIndex] = 0;
        -
        7025  m_AllocationBytes[heapIndex] = 0;
        -
        7026 #if VMA_MEMORY_BUDGET
        -
        7027  m_VulkanUsage[heapIndex] = 0;
        -
        7028  m_VulkanBudget[heapIndex] = 0;
        -
        7029  m_BlockBytesAtBudgetFetch[heapIndex] = 0;
        -
        7030 #endif
        -
        7031  }
        -
        7032 
        -
        7033 #if VMA_MEMORY_BUDGET
        -
        7034  m_OperationsSinceBudgetFetch = 0;
        -
        7035 #endif
        -
        7036  }
        -
        7037 
        -
        7038  void AddAllocation(uint32_t heapIndex, VkDeviceSize allocationSize)
        -
        7039  {
        -
        7040  m_AllocationBytes[heapIndex] += allocationSize;
        -
        7041 #if VMA_MEMORY_BUDGET
        -
        7042  ++m_OperationsSinceBudgetFetch;
        -
        7043 #endif
        -
        7044  }
        -
        7045 
        -
        7046  void RemoveAllocation(uint32_t heapIndex, VkDeviceSize allocationSize)
        -
        7047  {
        -
        7048  VMA_ASSERT(m_AllocationBytes[heapIndex] >= allocationSize); // DELME
        -
        7049  m_AllocationBytes[heapIndex] -= allocationSize;
        -
        7050 #if VMA_MEMORY_BUDGET
        -
        7051  ++m_OperationsSinceBudgetFetch;
        -
        7052 #endif
        -
        7053  }
        -
        7054 };
        -
        7055 
        -
        7056 // Main allocator object.
        -
        7057 struct VmaAllocator_T
        -
        7058 {
        -
        7059  VMA_CLASS_NO_COPY(VmaAllocator_T)
        -
        7060 public:
        -
        7061  bool m_UseMutex;
        -
        7062  uint32_t m_VulkanApiVersion;
        -
        7063  bool m_UseKhrDedicatedAllocation; // Can be set only if m_VulkanApiVersion < VK_MAKE_VERSION(1, 1, 0).
        -
        7064  bool m_UseKhrBindMemory2; // Can be set only if m_VulkanApiVersion < VK_MAKE_VERSION(1, 1, 0).
        -
        7065  bool m_UseExtMemoryBudget;
        -
        7066  VkDevice m_hDevice;
        -
        7067  VkInstance m_hInstance;
        -
        7068  bool m_AllocationCallbacksSpecified;
        -
        7069  VkAllocationCallbacks m_AllocationCallbacks;
        -
        7070  VmaDeviceMemoryCallbacks m_DeviceMemoryCallbacks;
        -
        7071  VmaAllocationObjectAllocator m_AllocationObjectAllocator;
        -
        7072 
        -
        7073  // Each bit (1 << i) is set if HeapSizeLimit is enabled for that heap, so cannot allocate more than the heap size.
        -
        7074  uint32_t m_HeapSizeLimitMask;
        -
        7075 
        -
        7076  VkPhysicalDeviceProperties m_PhysicalDeviceProperties;
        -
        7077  VkPhysicalDeviceMemoryProperties m_MemProps;
        -
        7078 
        -
        7079  // Default pools.
        -
        7080  VmaBlockVector* m_pBlockVectors[VK_MAX_MEMORY_TYPES];
        -
        7081 
        -
        7082  // Each vector is sorted by memory (handle value).
        -
        7083  typedef VmaVector< VmaAllocation, VmaStlAllocator<VmaAllocation> > AllocationVectorType;
        -
        7084  AllocationVectorType* m_pDedicatedAllocations[VK_MAX_MEMORY_TYPES];
        -
        7085  VMA_RW_MUTEX m_DedicatedAllocationsMutex[VK_MAX_MEMORY_TYPES];
        -
        7086 
        -
        7087  VmaCurrentBudgetData m_Budget;
        -
        7088 
        -
        7089  VmaAllocator_T(const VmaAllocatorCreateInfo* pCreateInfo);
        -
        7090  VkResult Init(const VmaAllocatorCreateInfo* pCreateInfo);
        -
        7091  ~VmaAllocator_T();
        -
        7092 
        -
        7093  const VkAllocationCallbacks* GetAllocationCallbacks() const
        -
        7094  {
        -
        7095  return m_AllocationCallbacksSpecified ? &m_AllocationCallbacks : 0;
        -
        7096  }
        -
        7097  const VmaVulkanFunctions& GetVulkanFunctions() const
        -
        7098  {
        -
        7099  return m_VulkanFunctions;
        -
        7100  }
        -
        7101 
        -
        7102  VkDeviceSize GetBufferImageGranularity() const
        -
        7103  {
        -
        7104  return VMA_MAX(
        -
        7105  static_cast<VkDeviceSize>(VMA_DEBUG_MIN_BUFFER_IMAGE_GRANULARITY),
        -
        7106  m_PhysicalDeviceProperties.limits.bufferImageGranularity);
        -
        7107  }
        -
        7108 
        -
        7109  uint32_t GetMemoryHeapCount() const { return m_MemProps.memoryHeapCount; }
        -
        7110  uint32_t GetMemoryTypeCount() const { return m_MemProps.memoryTypeCount; }
        -
        7111 
        -
        7112  uint32_t MemoryTypeIndexToHeapIndex(uint32_t memTypeIndex) const
        -
        7113  {
        -
        7114  VMA_ASSERT(memTypeIndex < m_MemProps.memoryTypeCount);
        -
        7115  return m_MemProps.memoryTypes[memTypeIndex].heapIndex;
        -
        7116  }
        -
        7117  // True when specific memory type is HOST_VISIBLE but not HOST_COHERENT.
        -
        7118  bool IsMemoryTypeNonCoherent(uint32_t memTypeIndex) const
        -
        7119  {
        -
        7120  return (m_MemProps.memoryTypes[memTypeIndex].propertyFlags & (VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT | VK_MEMORY_PROPERTY_HOST_COHERENT_BIT)) ==
        -
        7121  VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT;
        -
        7122  }
        -
        7123  // Minimum alignment for all allocations in specific memory type.
        -
        7124  VkDeviceSize GetMemoryTypeMinAlignment(uint32_t memTypeIndex) const
        -
        7125  {
        -
        7126  return IsMemoryTypeNonCoherent(memTypeIndex) ?
        -
        7127  VMA_MAX((VkDeviceSize)VMA_DEBUG_ALIGNMENT, m_PhysicalDeviceProperties.limits.nonCoherentAtomSize) :
        -
        7128  (VkDeviceSize)VMA_DEBUG_ALIGNMENT;
        -
        7129  }
        -
        7130 
        -
        7131  bool IsIntegratedGpu() const
        -
        7132  {
        -
        7133  return m_PhysicalDeviceProperties.deviceType == VK_PHYSICAL_DEVICE_TYPE_INTEGRATED_GPU;
        -
        7134  }
        -
        7135 
        -
        7136 #if VMA_RECORDING_ENABLED
        -
        7137  VmaRecorder* GetRecorder() const { return m_pRecorder; }
        -
        7138 #endif
        -
        7139 
        -
        7140  void GetBufferMemoryRequirements(
        -
        7141  VkBuffer hBuffer,
        -
        7142  VkMemoryRequirements& memReq,
        -
        7143  bool& requiresDedicatedAllocation,
        -
        7144  bool& prefersDedicatedAllocation) const;
        -
        7145  void GetImageMemoryRequirements(
        -
        7146  VkImage hImage,
        -
        7147  VkMemoryRequirements& memReq,
        -
        7148  bool& requiresDedicatedAllocation,
        -
        7149  bool& prefersDedicatedAllocation) const;
        -
        7150 
        -
        7151  // Main allocation function.
        -
        7152  VkResult AllocateMemory(
        -
        7153  const VkMemoryRequirements& vkMemReq,
        -
        7154  bool requiresDedicatedAllocation,
        -
        7155  bool prefersDedicatedAllocation,
        -
        7156  VkBuffer dedicatedBuffer,
        -
        7157  VkImage dedicatedImage,
        -
        7158  const VmaAllocationCreateInfo& createInfo,
        -
        7159  VmaSuballocationType suballocType,
        -
        7160  size_t allocationCount,
        -
        7161  VmaAllocation* pAllocations);
        -
        7162 
        -
        7163  // Main deallocation function.
        -
        7164  void FreeMemory(
        -
        7165  size_t allocationCount,
        -
        7166  const VmaAllocation* pAllocations);
        -
        7167 
        -
        7168  VkResult ResizeAllocation(
        -
        7169  const VmaAllocation alloc,
        -
        7170  VkDeviceSize newSize);
        -
        7171 
        -
        7172  void CalculateStats(VmaStats* pStats);
        -
        7173 
        -
        7174  void GetBudget(
        -
        7175  VmaBudget* outBudget, uint32_t firstHeap, uint32_t heapCount);
        -
        7176 
        -
        7177 #if VMA_STATS_STRING_ENABLED
        -
        7178  void PrintDetailedMap(class VmaJsonWriter& json);
        -
        7179 #endif
        -
        7180 
        -
        7181  VkResult DefragmentationBegin(
        -
        7182  const VmaDefragmentationInfo2& info,
        -
        7183  VmaDefragmentationStats* pStats,
        -
        7184  VmaDefragmentationContext* pContext);
        -
        7185  VkResult DefragmentationEnd(
        -
        7186  VmaDefragmentationContext context);
        -
        7187 
        -
        7188  void GetAllocationInfo(VmaAllocation hAllocation, VmaAllocationInfo* pAllocationInfo);
        -
        7189  bool TouchAllocation(VmaAllocation hAllocation);
        +
        6999 #if VMA_RECORDING_ENABLED
        +
        7000 
        +
        7001 class VmaRecorder
        +
        7002 {
        +
        7003 public:
        +
        7004  VmaRecorder();
        +
        7005  VkResult Init(const VmaRecordSettings& settings, bool useMutex);
        +
        7006  void WriteConfiguration(
        +
        7007  const VkPhysicalDeviceProperties& devProps,
        +
        7008  const VkPhysicalDeviceMemoryProperties& memProps,
        +
        7009  uint32_t vulkanApiVersion,
        +
        7010  bool dedicatedAllocationExtensionEnabled,
        +
        7011  bool bindMemory2ExtensionEnabled,
        +
        7012  bool memoryBudgetExtensionEnabled,
        +
        7013  bool deviceCoherentMemoryExtensionEnabled);
        +
        7014  ~VmaRecorder();
        +
        7015 
        +
        7016  void RecordCreateAllocator(uint32_t frameIndex);
        +
        7017  void RecordDestroyAllocator(uint32_t frameIndex);
        +
        7018  void RecordCreatePool(uint32_t frameIndex,
        +
        7019  const VmaPoolCreateInfo& createInfo,
        +
        7020  VmaPool pool);
        +
        7021  void RecordDestroyPool(uint32_t frameIndex, VmaPool pool);
        +
        7022  void RecordAllocateMemory(uint32_t frameIndex,
        +
        7023  const VkMemoryRequirements& vkMemReq,
        +
        7024  const VmaAllocationCreateInfo& createInfo,
        +
        7025  VmaAllocation allocation);
        +
        7026  void RecordAllocateMemoryPages(uint32_t frameIndex,
        +
        7027  const VkMemoryRequirements& vkMemReq,
        +
        7028  const VmaAllocationCreateInfo& createInfo,
        +
        7029  uint64_t allocationCount,
        +
        7030  const VmaAllocation* pAllocations);
        +
        7031  void RecordAllocateMemoryForBuffer(uint32_t frameIndex,
        +
        7032  const VkMemoryRequirements& vkMemReq,
        +
        7033  bool requiresDedicatedAllocation,
        +
        7034  bool prefersDedicatedAllocation,
        +
        7035  const VmaAllocationCreateInfo& createInfo,
        +
        7036  VmaAllocation allocation);
        +
        7037  void RecordAllocateMemoryForImage(uint32_t frameIndex,
        +
        7038  const VkMemoryRequirements& vkMemReq,
        +
        7039  bool requiresDedicatedAllocation,
        +
        7040  bool prefersDedicatedAllocation,
        +
        7041  const VmaAllocationCreateInfo& createInfo,
        +
        7042  VmaAllocation allocation);
        +
        7043  void RecordFreeMemory(uint32_t frameIndex,
        +
        7044  VmaAllocation allocation);
        +
        7045  void RecordFreeMemoryPages(uint32_t frameIndex,
        +
        7046  uint64_t allocationCount,
        +
        7047  const VmaAllocation* pAllocations);
        +
        7048  void RecordSetAllocationUserData(uint32_t frameIndex,
        +
        7049  VmaAllocation allocation,
        +
        7050  const void* pUserData);
        +
        7051  void RecordCreateLostAllocation(uint32_t frameIndex,
        +
        7052  VmaAllocation allocation);
        +
        7053  void RecordMapMemory(uint32_t frameIndex,
        +
        7054  VmaAllocation allocation);
        +
        7055  void RecordUnmapMemory(uint32_t frameIndex,
        +
        7056  VmaAllocation allocation);
        +
        7057  void RecordFlushAllocation(uint32_t frameIndex,
        +
        7058  VmaAllocation allocation, VkDeviceSize offset, VkDeviceSize size);
        +
        7059  void RecordInvalidateAllocation(uint32_t frameIndex,
        +
        7060  VmaAllocation allocation, VkDeviceSize offset, VkDeviceSize size);
        +
        7061  void RecordCreateBuffer(uint32_t frameIndex,
        +
        7062  const VkBufferCreateInfo& bufCreateInfo,
        +
        7063  const VmaAllocationCreateInfo& allocCreateInfo,
        +
        7064  VmaAllocation allocation);
        +
        7065  void RecordCreateImage(uint32_t frameIndex,
        +
        7066  const VkImageCreateInfo& imageCreateInfo,
        +
        7067  const VmaAllocationCreateInfo& allocCreateInfo,
        +
        7068  VmaAllocation allocation);
        +
        7069  void RecordDestroyBuffer(uint32_t frameIndex,
        +
        7070  VmaAllocation allocation);
        +
        7071  void RecordDestroyImage(uint32_t frameIndex,
        +
        7072  VmaAllocation allocation);
        +
        7073  void RecordTouchAllocation(uint32_t frameIndex,
        +
        7074  VmaAllocation allocation);
        +
        7075  void RecordGetAllocationInfo(uint32_t frameIndex,
        +
        7076  VmaAllocation allocation);
        +
        7077  void RecordMakePoolAllocationsLost(uint32_t frameIndex,
        +
        7078  VmaPool pool);
        +
        7079  void RecordDefragmentationBegin(uint32_t frameIndex,
        +
        7080  const VmaDefragmentationInfo2& info,
        +
        7081  VmaDefragmentationContext ctx);
        +
        7082  void RecordDefragmentationEnd(uint32_t frameIndex,
        +
        7083  VmaDefragmentationContext ctx);
        +
        7084  void RecordSetPoolName(uint32_t frameIndex,
        +
        7085  VmaPool pool,
        +
        7086  const char* name);
        +
        7087 
        +
        7088 private:
        +
        7089  struct CallParams
        +
        7090  {
        +
        7091  uint32_t threadId;
        +
        7092  double time;
        +
        7093  };
        +
        7094 
        +
        7095  class UserDataString
        +
        7096  {
        +
        7097  public:
        +
        7098  UserDataString(VmaAllocationCreateFlags allocFlags, const void* pUserData);
        +
        7099  const char* GetString() const { return m_Str; }
        +
        7100 
        +
        7101  private:
        +
        7102  char m_PtrStr[17];
        +
        7103  const char* m_Str;
        +
        7104  };
        +
        7105 
        +
        7106  bool m_UseMutex;
        +
        7107  VmaRecordFlags m_Flags;
        +
        7108  FILE* m_File;
        +
        7109  VMA_MUTEX m_FileMutex;
        +
        7110  int64_t m_Freq;
        +
        7111  int64_t m_StartCounter;
        +
        7112 
        +
        7113  void GetBasicParams(CallParams& outParams);
        +
        7114 
        +
        7115  // T must be a pointer type, e.g. VmaAllocation, VmaPool.
        +
        7116  template<typename T>
        +
        7117  void PrintPointerList(uint64_t count, const T* pItems)
        +
        7118  {
        +
        7119  if(count)
        +
        7120  {
        +
        7121  fprintf(m_File, "%p", pItems[0]);
        +
        7122  for(uint64_t i = 1; i < count; ++i)
        +
        7123  {
        +
        7124  fprintf(m_File, " %p", pItems[i]);
        +
        7125  }
        +
        7126  }
        +
        7127  }
        +
        7128 
        +
        7129  void PrintPointerList(uint64_t count, const VmaAllocation* pItems);
        +
        7130  void Flush();
        +
        7131 };
        +
        7132 
        +
        7133 #endif // #if VMA_RECORDING_ENABLED
        +
        7134 
        +
        7135 /*
        +
        7136 Thread-safe wrapper over VmaPoolAllocator free list, for allocation of VmaAllocation_T objects.
        +
        7137 */
        +
        7138 class VmaAllocationObjectAllocator
        +
        7139 {
        +
        7140  VMA_CLASS_NO_COPY(VmaAllocationObjectAllocator)
        +
        7141 public:
        +
        7142  VmaAllocationObjectAllocator(const VkAllocationCallbacks* pAllocationCallbacks);
        +
        7143 
        +
        7144  template<typename... Types> VmaAllocation Allocate(Types... args);
        +
        7145  void Free(VmaAllocation hAlloc);
        +
        7146 
        +
        7147 private:
        +
        7148  VMA_MUTEX m_Mutex;
        +
        7149  VmaPoolAllocator<VmaAllocation_T> m_Allocator;
        +
        7150 };
        +
        7151 
        +
        7152 struct VmaCurrentBudgetData
        +
        7153 {
        +
        7154  VMA_ATOMIC_UINT64 m_BlockBytes[VK_MAX_MEMORY_HEAPS];
        +
        7155  VMA_ATOMIC_UINT64 m_AllocationBytes[VK_MAX_MEMORY_HEAPS];
        +
        7156 
        +
        7157 #if VMA_MEMORY_BUDGET
        +
        7158  VMA_ATOMIC_UINT32 m_OperationsSinceBudgetFetch;
        +
        7159  VMA_RW_MUTEX m_BudgetMutex;
        +
        7160  uint64_t m_VulkanUsage[VK_MAX_MEMORY_HEAPS];
        +
        7161  uint64_t m_VulkanBudget[VK_MAX_MEMORY_HEAPS];
        +
        7162  uint64_t m_BlockBytesAtBudgetFetch[VK_MAX_MEMORY_HEAPS];
        +
        7163 #endif // #if VMA_MEMORY_BUDGET
        +
        7164 
        +
        7165  VmaCurrentBudgetData()
        +
        7166  {
        +
        7167  for(uint32_t heapIndex = 0; heapIndex < VK_MAX_MEMORY_HEAPS; ++heapIndex)
        +
        7168  {
        +
        7169  m_BlockBytes[heapIndex] = 0;
        +
        7170  m_AllocationBytes[heapIndex] = 0;
        +
        7171 #if VMA_MEMORY_BUDGET
        +
        7172  m_VulkanUsage[heapIndex] = 0;
        +
        7173  m_VulkanBudget[heapIndex] = 0;
        +
        7174  m_BlockBytesAtBudgetFetch[heapIndex] = 0;
        +
        7175 #endif
        +
        7176  }
        +
        7177 
        +
        7178 #if VMA_MEMORY_BUDGET
        +
        7179  m_OperationsSinceBudgetFetch = 0;
        +
        7180 #endif
        +
        7181  }
        +
        7182 
        +
        7183  void AddAllocation(uint32_t heapIndex, VkDeviceSize allocationSize)
        +
        7184  {
        +
        7185  m_AllocationBytes[heapIndex] += allocationSize;
        +
        7186 #if VMA_MEMORY_BUDGET
        +
        7187  ++m_OperationsSinceBudgetFetch;
        +
        7188 #endif
        +
        7189  }
        7190 
        -
        7191  VkResult CreatePool(const VmaPoolCreateInfo* pCreateInfo, VmaPool* pPool);
        -
        7192  void DestroyPool(VmaPool pool);
        -
        7193  void GetPoolStats(VmaPool pool, VmaPoolStats* pPoolStats);
        -
        7194 
        -
        7195  void SetCurrentFrameIndex(uint32_t frameIndex);
        -
        7196  uint32_t GetCurrentFrameIndex() const { return m_CurrentFrameIndex.load(); }
        -
        7197 
        -
        7198  void MakePoolAllocationsLost(
        -
        7199  VmaPool hPool,
        -
        7200  size_t* pLostAllocationCount);
        -
        7201  VkResult CheckPoolCorruption(VmaPool hPool);
        -
        7202  VkResult CheckCorruption(uint32_t memoryTypeBits);
        -
        7203 
        -
        7204  void CreateLostAllocation(VmaAllocation* pAllocation);
        -
        7205 
        -
        7206  // Call to Vulkan function vkAllocateMemory with accompanying bookkeeping.
        -
        7207  VkResult AllocateVulkanMemory(const VkMemoryAllocateInfo* pAllocateInfo, VkDeviceMemory* pMemory);
        -
        7208  // Call to Vulkan function vkFreeMemory with accompanying bookkeeping.
        -
        7209  void FreeVulkanMemory(uint32_t memoryType, VkDeviceSize size, VkDeviceMemory hMemory);
        -
        7210  // Call to Vulkan function vkBindBufferMemory or vkBindBufferMemory2KHR.
        -
        7211  VkResult BindVulkanBuffer(
        -
        7212  VkDeviceMemory memory,
        -
        7213  VkDeviceSize memoryOffset,
        -
        7214  VkBuffer buffer,
        -
        7215  const void* pNext);
        -
        7216  // Call to Vulkan function vkBindImageMemory or vkBindImageMemory2KHR.
        -
        7217  VkResult BindVulkanImage(
        -
        7218  VkDeviceMemory memory,
        -
        7219  VkDeviceSize memoryOffset,
        -
        7220  VkImage image,
        -
        7221  const void* pNext);
        -
        7222 
        -
        7223  VkResult Map(VmaAllocation hAllocation, void** ppData);
        -
        7224  void Unmap(VmaAllocation hAllocation);
        -
        7225 
        -
        7226  VkResult BindBufferMemory(
        -
        7227  VmaAllocation hAllocation,
        -
        7228  VkDeviceSize allocationLocalOffset,
        -
        7229  VkBuffer hBuffer,
        -
        7230  const void* pNext);
        -
        7231  VkResult BindImageMemory(
        -
        7232  VmaAllocation hAllocation,
        -
        7233  VkDeviceSize allocationLocalOffset,
        -
        7234  VkImage hImage,
        -
        7235  const void* pNext);
        -
        7236 
        -
        7237  void FlushOrInvalidateAllocation(
        -
        7238  VmaAllocation hAllocation,
        -
        7239  VkDeviceSize offset, VkDeviceSize size,
        -
        7240  VMA_CACHE_OPERATION op);
        -
        7241 
        -
        7242  void FillAllocation(const VmaAllocation hAllocation, uint8_t pattern);
        -
        7243 
        -
        7244  /*
        -
        7245  Returns bit mask of memory types that can support defragmentation on GPU as
        -
        7246  they support creation of required buffer for copy operations.
        -
        7247  */
        -
        7248  uint32_t GetGpuDefragmentationMemoryTypeBits();
        -
        7249 
        -
        7250 private:
        -
        7251  VkDeviceSize m_PreferredLargeHeapBlockSize;
        -
        7252 
        -
        7253  VkPhysicalDevice m_PhysicalDevice;
        -
        7254  VMA_ATOMIC_UINT32 m_CurrentFrameIndex;
        -
        7255  VMA_ATOMIC_UINT32 m_GpuDefragmentationMemoryTypeBits; // UINT32_MAX means uninitialized.
        -
        7256 
        -
        7257  VMA_RW_MUTEX m_PoolsMutex;
        -
        7258  // Protected by m_PoolsMutex. Sorted by pointer value.
        -
        7259  VmaVector<VmaPool, VmaStlAllocator<VmaPool> > m_Pools;
        -
        7260  uint32_t m_NextPoolId;
        -
        7261 
        -
        7262  VmaVulkanFunctions m_VulkanFunctions;
        -
        7263 
        -
        7264 #if VMA_RECORDING_ENABLED
        -
        7265  VmaRecorder* m_pRecorder;
        -
        7266 #endif
        -
        7267 
        -
        7268  void ImportVulkanFunctions(const VmaVulkanFunctions* pVulkanFunctions);
        -
        7269 
        -
        7270  VkDeviceSize CalcPreferredBlockSize(uint32_t memTypeIndex);
        -
        7271 
        -
        7272  VkResult AllocateMemoryOfType(
        -
        7273  VkDeviceSize size,
        -
        7274  VkDeviceSize alignment,
        -
        7275  bool dedicatedAllocation,
        -
        7276  VkBuffer dedicatedBuffer,
        -
        7277  VkImage dedicatedImage,
        -
        7278  const VmaAllocationCreateInfo& createInfo,
        -
        7279  uint32_t memTypeIndex,
        -
        7280  VmaSuballocationType suballocType,
        -
        7281  size_t allocationCount,
        -
        7282  VmaAllocation* pAllocations);
        +
        7191  void RemoveAllocation(uint32_t heapIndex, VkDeviceSize allocationSize)
        +
        7192  {
        +
        7193  VMA_ASSERT(m_AllocationBytes[heapIndex] >= allocationSize); // DELME
        +
        7194  m_AllocationBytes[heapIndex] -= allocationSize;
        +
        7195 #if VMA_MEMORY_BUDGET
        +
        7196  ++m_OperationsSinceBudgetFetch;
        +
        7197 #endif
        +
        7198  }
        +
        7199 };
        +
        7200 
        +
        7201 // Main allocator object.
        +
        7202 struct VmaAllocator_T
        +
        7203 {
        +
        7204  VMA_CLASS_NO_COPY(VmaAllocator_T)
        +
        7205 public:
        +
        7206  bool m_UseMutex;
        +
        7207  uint32_t m_VulkanApiVersion;
        +
        7208  bool m_UseKhrDedicatedAllocation; // Can be set only if m_VulkanApiVersion < VK_MAKE_VERSION(1, 1, 0).
        +
        7209  bool m_UseKhrBindMemory2; // Can be set only if m_VulkanApiVersion < VK_MAKE_VERSION(1, 1, 0).
        +
        7210  bool m_UseExtMemoryBudget;
        +
        7211  bool m_UseAmdDeviceCoherentMemory;
        +
        7212  VkDevice m_hDevice;
        +
        7213  VkInstance m_hInstance;
        +
        7214  bool m_AllocationCallbacksSpecified;
        +
        7215  VkAllocationCallbacks m_AllocationCallbacks;
        +
        7216  VmaDeviceMemoryCallbacks m_DeviceMemoryCallbacks;
        +
        7217  VmaAllocationObjectAllocator m_AllocationObjectAllocator;
        +
        7218 
        +
        7219  // Each bit (1 << i) is set if HeapSizeLimit is enabled for that heap, so cannot allocate more than the heap size.
        +
        7220  uint32_t m_HeapSizeLimitMask;
        +
        7221 
        +
        7222  VkPhysicalDeviceProperties m_PhysicalDeviceProperties;
        +
        7223  VkPhysicalDeviceMemoryProperties m_MemProps;
        +
        7224 
        +
        7225  // Default pools.
        +
        7226  VmaBlockVector* m_pBlockVectors[VK_MAX_MEMORY_TYPES];
        +
        7227 
        +
        7228  // Each vector is sorted by memory (handle value).
        +
        7229  typedef VmaVector< VmaAllocation, VmaStlAllocator<VmaAllocation> > AllocationVectorType;
        +
        7230  AllocationVectorType* m_pDedicatedAllocations[VK_MAX_MEMORY_TYPES];
        +
        7231  VMA_RW_MUTEX m_DedicatedAllocationsMutex[VK_MAX_MEMORY_TYPES];
        +
        7232 
        +
        7233  VmaCurrentBudgetData m_Budget;
        +
        7234 
        +
        7235  VmaAllocator_T(const VmaAllocatorCreateInfo* pCreateInfo);
        +
        7236  VkResult Init(const VmaAllocatorCreateInfo* pCreateInfo);
        +
        7237  ~VmaAllocator_T();
        +
        7238 
        +
        7239  const VkAllocationCallbacks* GetAllocationCallbacks() const
        +
        7240  {
        +
        7241  return m_AllocationCallbacksSpecified ? &m_AllocationCallbacks : 0;
        +
        7242  }
        +
        7243  const VmaVulkanFunctions& GetVulkanFunctions() const
        +
        7244  {
        +
        7245  return m_VulkanFunctions;
        +
        7246  }
        +
        7247 
        +
        7248  VkDeviceSize GetBufferImageGranularity() const
        +
        7249  {
        +
        7250  return VMA_MAX(
        +
        7251  static_cast<VkDeviceSize>(VMA_DEBUG_MIN_BUFFER_IMAGE_GRANULARITY),
        +
        7252  m_PhysicalDeviceProperties.limits.bufferImageGranularity);
        +
        7253  }
        +
        7254 
        +
        7255  uint32_t GetMemoryHeapCount() const { return m_MemProps.memoryHeapCount; }
        +
        7256  uint32_t GetMemoryTypeCount() const { return m_MemProps.memoryTypeCount; }
        +
        7257 
        +
        7258  uint32_t MemoryTypeIndexToHeapIndex(uint32_t memTypeIndex) const
        +
        7259  {
        +
        7260  VMA_ASSERT(memTypeIndex < m_MemProps.memoryTypeCount);
        +
        7261  return m_MemProps.memoryTypes[memTypeIndex].heapIndex;
        +
        7262  }
        +
        7263  // True when specific memory type is HOST_VISIBLE but not HOST_COHERENT.
        +
        7264  bool IsMemoryTypeNonCoherent(uint32_t memTypeIndex) const
        +
        7265  {
        +
        7266  return (m_MemProps.memoryTypes[memTypeIndex].propertyFlags & (VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT | VK_MEMORY_PROPERTY_HOST_COHERENT_BIT)) ==
        +
        7267  VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT;
        +
        7268  }
        +
        7269  // Minimum alignment for all allocations in specific memory type.
        +
        7270  VkDeviceSize GetMemoryTypeMinAlignment(uint32_t memTypeIndex) const
        +
        7271  {
        +
        7272  return IsMemoryTypeNonCoherent(memTypeIndex) ?
        +
        7273  VMA_MAX((VkDeviceSize)VMA_DEBUG_ALIGNMENT, m_PhysicalDeviceProperties.limits.nonCoherentAtomSize) :
        +
        7274  (VkDeviceSize)VMA_DEBUG_ALIGNMENT;
        +
        7275  }
        +
        7276 
        +
        7277  bool IsIntegratedGpu() const
        +
        7278  {
        +
        7279  return m_PhysicalDeviceProperties.deviceType == VK_PHYSICAL_DEVICE_TYPE_INTEGRATED_GPU;
        +
        7280  }
        +
        7281 
        +
        7282  uint32_t GetGlobalMemoryTypeBits() const { return m_GlobalMemoryTypeBits; }
        7283 
        -
        7284  // Helper function only to be used inside AllocateDedicatedMemory.
        -
        7285  VkResult AllocateDedicatedMemoryPage(
        -
        7286  VkDeviceSize size,
        -
        7287  VmaSuballocationType suballocType,
        -
        7288  uint32_t memTypeIndex,
        -
        7289  const VkMemoryAllocateInfo& allocInfo,
        -
        7290  bool map,
        -
        7291  bool isUserDataString,
        -
        7292  void* pUserData,
        -
        7293  VmaAllocation* pAllocation);
        -
        7294 
        -
        7295  // Allocates and registers new VkDeviceMemory specifically for dedicated allocations.
        -
        7296  VkResult AllocateDedicatedMemory(
        -
        7297  VkDeviceSize size,
        -
        7298  VmaSuballocationType suballocType,
        -
        7299  uint32_t memTypeIndex,
        -
        7300  bool withinBudget,
        -
        7301  bool map,
        -
        7302  bool isUserDataString,
        -
        7303  void* pUserData,
        +
        7284 #if VMA_RECORDING_ENABLED
        +
        7285  VmaRecorder* GetRecorder() const { return m_pRecorder; }
        +
        7286 #endif
        +
        7287 
        +
        7288  void GetBufferMemoryRequirements(
        +
        7289  VkBuffer hBuffer,
        +
        7290  VkMemoryRequirements& memReq,
        +
        7291  bool& requiresDedicatedAllocation,
        +
        7292  bool& prefersDedicatedAllocation) const;
        +
        7293  void GetImageMemoryRequirements(
        +
        7294  VkImage hImage,
        +
        7295  VkMemoryRequirements& memReq,
        +
        7296  bool& requiresDedicatedAllocation,
        +
        7297  bool& prefersDedicatedAllocation) const;
        +
        7298 
        +
        7299  // Main allocation function.
        +
        7300  VkResult AllocateMemory(
        +
        7301  const VkMemoryRequirements& vkMemReq,
        +
        7302  bool requiresDedicatedAllocation,
        +
        7303  bool prefersDedicatedAllocation,
        7304  VkBuffer dedicatedBuffer,
        7305  VkImage dedicatedImage,
        -
        7306  size_t allocationCount,
        -
        7307  VmaAllocation* pAllocations);
        -
        7308 
        -
        7309  void FreeDedicatedMemory(const VmaAllocation allocation);
        +
        7306  const VmaAllocationCreateInfo& createInfo,
        +
        7307  VmaSuballocationType suballocType,
        +
        7308  size_t allocationCount,
        +
        7309  VmaAllocation* pAllocations);
        7310 
        -
        7311  /*
        -
        7312  Calculates and returns bit mask of memory types that can support defragmentation
        -
        7313  on GPU as they support creation of required buffer for copy operations.
        -
        7314  */
        -
        7315  uint32_t CalculateGpuDefragmentationMemoryTypeBits() const;
        -
        7316 
        -
        7317 #if VMA_MEMORY_BUDGET
        -
        7318  void UpdateVulkanBudget();
        -
        7319 #endif // #if VMA_MEMORY_BUDGET
        -
        7320 };
        +
        7311  // Main deallocation function.
        +
        7312  void FreeMemory(
        +
        7313  size_t allocationCount,
        +
        7314  const VmaAllocation* pAllocations);
        +
        7315 
        +
        7316  VkResult ResizeAllocation(
        +
        7317  const VmaAllocation alloc,
        +
        7318  VkDeviceSize newSize);
        +
        7319 
        +
        7320  void CalculateStats(VmaStats* pStats);
        7321 
        -
        7323 // Memory allocation #2 after VmaAllocator_T definition
        +
        7322  void GetBudget(
        +
        7323  VmaBudget* outBudget, uint32_t firstHeap, uint32_t heapCount);
        7324 
        -
        7325 static void* VmaMalloc(VmaAllocator hAllocator, size_t size, size_t alignment)
        -
        7326 {
        -
        7327  return VmaMalloc(&hAllocator->m_AllocationCallbacks, size, alignment);
        -
        7328 }
        -
        7329 
        -
        7330 static void VmaFree(VmaAllocator hAllocator, void* ptr)
        -
        7331 {
        -
        7332  VmaFree(&hAllocator->m_AllocationCallbacks, ptr);
        -
        7333 }
        -
        7334 
        -
        7335 template<typename T>
        -
        7336 static T* VmaAllocate(VmaAllocator hAllocator)
        -
        7337 {
        -
        7338  return (T*)VmaMalloc(hAllocator, sizeof(T), VMA_ALIGN_OF(T));
        -
        7339 }
        -
        7340 
        -
        7341 template<typename T>
        -
        7342 static T* VmaAllocateArray(VmaAllocator hAllocator, size_t count)
        -
        7343 {
        -
        7344  return (T*)VmaMalloc(hAllocator, sizeof(T) * count, VMA_ALIGN_OF(T));
        -
        7345 }
        -
        7346 
        -
        7347 template<typename T>
        -
        7348 static void vma_delete(VmaAllocator hAllocator, T* ptr)
        -
        7349 {
        -
        7350  if(ptr != VMA_NULL)
        -
        7351  {
        -
        7352  ptr->~T();
        -
        7353  VmaFree(hAllocator, ptr);
        -
        7354  }
        -
        7355 }
        -
        7356 
        -
        7357 template<typename T>
        -
        7358 static void vma_delete_array(VmaAllocator hAllocator, T* ptr, size_t count)
        -
        7359 {
        -
        7360  if(ptr != VMA_NULL)
        -
        7361  {
        -
        7362  for(size_t i = count; i--; )
        -
        7363  ptr[i].~T();
        -
        7364  VmaFree(hAllocator, ptr);
        -
        7365  }
        -
        7366 }
        -
        7367 
        -
        7369 // VmaStringBuilder
        -
        7370 
        -
        7371 #if VMA_STATS_STRING_ENABLED
        -
        7372 
        -
        7373 class VmaStringBuilder
        -
        7374 {
        -
        7375 public:
        -
        7376  VmaStringBuilder(VmaAllocator alloc) : m_Data(VmaStlAllocator<char>(alloc->GetAllocationCallbacks())) { }
        -
        7377  size_t GetLength() const { return m_Data.size(); }
        -
        7378  const char* GetData() const { return m_Data.data(); }
        +
        7325 #if VMA_STATS_STRING_ENABLED
        +
        7326  void PrintDetailedMap(class VmaJsonWriter& json);
        +
        7327 #endif
        +
        7328 
        +
        7329  VkResult DefragmentationBegin(
        +
        7330  const VmaDefragmentationInfo2& info,
        +
        7331  VmaDefragmentationStats* pStats,
        +
        7332  VmaDefragmentationContext* pContext);
        +
        7333  VkResult DefragmentationEnd(
        +
        7334  VmaDefragmentationContext context);
        +
        7335 
        +
        7336  VkResult DefragmentationPassBegin(
        +
        7337  VmaDefragmentationPassInfo* pInfo,
        +
        7338  VmaDefragmentationContext context);
        +
        7339  VkResult DefragmentationPassEnd(
        +
        7340  VmaDefragmentationContext context);
        +
        7341 
        +
        7342  void GetAllocationInfo(VmaAllocation hAllocation, VmaAllocationInfo* pAllocationInfo);
        +
        7343  bool TouchAllocation(VmaAllocation hAllocation);
        +
        7344 
        +
        7345  VkResult CreatePool(const VmaPoolCreateInfo* pCreateInfo, VmaPool* pPool);
        +
        7346  void DestroyPool(VmaPool pool);
        +
        7347  void GetPoolStats(VmaPool pool, VmaPoolStats* pPoolStats);
        +
        7348 
        +
        7349  void SetCurrentFrameIndex(uint32_t frameIndex);
        +
        7350  uint32_t GetCurrentFrameIndex() const { return m_CurrentFrameIndex.load(); }
        +
        7351 
        +
        7352  void MakePoolAllocationsLost(
        +
        7353  VmaPool hPool,
        +
        7354  size_t* pLostAllocationCount);
        +
        7355  VkResult CheckPoolCorruption(VmaPool hPool);
        +
        7356  VkResult CheckCorruption(uint32_t memoryTypeBits);
        +
        7357 
        +
        7358  void CreateLostAllocation(VmaAllocation* pAllocation);
        +
        7359 
        +
        7360  // Call to Vulkan function vkAllocateMemory with accompanying bookkeeping.
        +
        7361  VkResult AllocateVulkanMemory(const VkMemoryAllocateInfo* pAllocateInfo, VkDeviceMemory* pMemory);
        +
        7362  // Call to Vulkan function vkFreeMemory with accompanying bookkeeping.
        +
        7363  void FreeVulkanMemory(uint32_t memoryType, VkDeviceSize size, VkDeviceMemory hMemory);
        +
        7364  // Call to Vulkan function vkBindBufferMemory or vkBindBufferMemory2KHR.
        +
        7365  VkResult BindVulkanBuffer(
        +
        7366  VkDeviceMemory memory,
        +
        7367  VkDeviceSize memoryOffset,
        +
        7368  VkBuffer buffer,
        +
        7369  const void* pNext);
        +
        7370  // Call to Vulkan function vkBindImageMemory or vkBindImageMemory2KHR.
        +
        7371  VkResult BindVulkanImage(
        +
        7372  VkDeviceMemory memory,
        +
        7373  VkDeviceSize memoryOffset,
        +
        7374  VkImage image,
        +
        7375  const void* pNext);
        +
        7376 
        +
        7377  VkResult Map(VmaAllocation hAllocation, void** ppData);
        +
        7378  void Unmap(VmaAllocation hAllocation);
        7379 
        -
        7380  void Add(char ch) { m_Data.push_back(ch); }
        -
        7381  void Add(const char* pStr);
        -
        7382  void AddNewLine() { Add('\n'); }
        -
        7383  void AddNumber(uint32_t num);
        -
        7384  void AddNumber(uint64_t num);
        -
        7385  void AddPointer(const void* ptr);
        -
        7386 
        -
        7387 private:
        -
        7388  VmaVector< char, VmaStlAllocator<char> > m_Data;
        -
        7389 };
        +
        7380  VkResult BindBufferMemory(
        +
        7381  VmaAllocation hAllocation,
        +
        7382  VkDeviceSize allocationLocalOffset,
        +
        7383  VkBuffer hBuffer,
        +
        7384  const void* pNext);
        +
        7385  VkResult BindImageMemory(
        +
        7386  VmaAllocation hAllocation,
        +
        7387  VkDeviceSize allocationLocalOffset,
        +
        7388  VkImage hImage,
        +
        7389  const void* pNext);
        7390 
        -
        7391 void VmaStringBuilder::Add(const char* pStr)
        -
        7392 {
        -
        7393  const size_t strLen = strlen(pStr);
        -
        7394  if(strLen > 0)
        -
        7395  {
        -
        7396  const size_t oldCount = m_Data.size();
        -
        7397  m_Data.resize(oldCount + strLen);
        -
        7398  memcpy(m_Data.data() + oldCount, pStr, strLen);
        -
        7399  }
        -
        7400 }
        -
        7401 
        -
        7402 void VmaStringBuilder::AddNumber(uint32_t num)
        -
        7403 {
        -
        7404  char buf[11];
        -
        7405  buf[10] = '\0';
        -
        7406  char *p = &buf[10];
        -
        7407  do
        -
        7408  {
        -
        7409  *--p = '0' + (num % 10);
        -
        7410  num /= 10;
        -
        7411  }
        -
        7412  while(num);
        -
        7413  Add(p);
        -
        7414 }
        +
        7391  void FlushOrInvalidateAllocation(
        +
        7392  VmaAllocation hAllocation,
        +
        7393  VkDeviceSize offset, VkDeviceSize size,
        +
        7394  VMA_CACHE_OPERATION op);
        +
        7395 
        +
        7396  void FillAllocation(const VmaAllocation hAllocation, uint8_t pattern);
        +
        7397 
        +
        7398  /*
        +
        7399  Returns bit mask of memory types that can support defragmentation on GPU as
        +
        7400  they support creation of required buffer for copy operations.
        +
        7401  */
        +
        7402  uint32_t GetGpuDefragmentationMemoryTypeBits();
        +
        7403 
        +
        7404 private:
        +
        7405  VkDeviceSize m_PreferredLargeHeapBlockSize;
        +
        7406 
        +
        7407  VkPhysicalDevice m_PhysicalDevice;
        +
        7408  VMA_ATOMIC_UINT32 m_CurrentFrameIndex;
        +
        7409  VMA_ATOMIC_UINT32 m_GpuDefragmentationMemoryTypeBits; // UINT32_MAX means uninitialized.
        +
        7410 
        +
        7411  VMA_RW_MUTEX m_PoolsMutex;
        +
        7412  // Protected by m_PoolsMutex. Sorted by pointer value.
        +
        7413  VmaVector<VmaPool, VmaStlAllocator<VmaPool> > m_Pools;
        +
        7414  uint32_t m_NextPoolId;
        7415 
        -
        7416 void VmaStringBuilder::AddNumber(uint64_t num)
        -
        7417 {
        -
        7418  char buf[21];
        -
        7419  buf[20] = '\0';
        -
        7420  char *p = &buf[20];
        -
        7421  do
        -
        7422  {
        -
        7423  *--p = '0' + (num % 10);
        -
        7424  num /= 10;
        -
        7425  }
        -
        7426  while(num);
        -
        7427  Add(p);
        -
        7428 }
        -
        7429 
        -
        7430 void VmaStringBuilder::AddPointer(const void* ptr)
        -
        7431 {
        -
        7432  char buf[21];
        -
        7433  VmaPtrToStr(buf, sizeof(buf), ptr);
        -
        7434  Add(buf);
        -
        7435 }
        -
        7436 
        -
        7437 #endif // #if VMA_STATS_STRING_ENABLED
        -
        7438 
        -
        7440 // VmaJsonWriter
        -
        7441 
        -
        7442 #if VMA_STATS_STRING_ENABLED
        -
        7443 
        -
        7444 class VmaJsonWriter
        -
        7445 {
        -
        7446  VMA_CLASS_NO_COPY(VmaJsonWriter)
        -
        7447 public:
        -
        7448  VmaJsonWriter(const VkAllocationCallbacks* pAllocationCallbacks, VmaStringBuilder& sb);
        -
        7449  ~VmaJsonWriter();
        -
        7450 
        -
        7451  void BeginObject(bool singleLine = false);
        -
        7452  void EndObject();
        -
        7453 
        -
        7454  void BeginArray(bool singleLine = false);
        -
        7455  void EndArray();
        -
        7456 
        -
        7457  void WriteString(const char* pStr);
        -
        7458  void BeginString(const char* pStr = VMA_NULL);
        -
        7459  void ContinueString(const char* pStr);
        -
        7460  void ContinueString(uint32_t n);
        -
        7461  void ContinueString(uint64_t n);
        -
        7462  void ContinueString_Pointer(const void* ptr);
        -
        7463  void EndString(const char* pStr = VMA_NULL);
        -
        7464 
        -
        7465  void WriteNumber(uint32_t n);
        -
        7466  void WriteNumber(uint64_t n);
        -
        7467  void WriteBool(bool b);
        -
        7468  void WriteNull();
        -
        7469 
        -
        7470 private:
        -
        7471  static const char* const INDENT;
        -
        7472 
        -
        7473  enum COLLECTION_TYPE
        -
        7474  {
        -
        7475  COLLECTION_TYPE_OBJECT,
        -
        7476  COLLECTION_TYPE_ARRAY,
        -
        7477  };
        -
        7478  struct StackItem
        -
        7479  {
        -
        7480  COLLECTION_TYPE type;
        -
        7481  uint32_t valueCount;
        -
        7482  bool singleLineMode;
        -
        7483  };
        -
        7484 
        -
        7485  VmaStringBuilder& m_SB;
        -
        7486  VmaVector< StackItem, VmaStlAllocator<StackItem> > m_Stack;
        -
        7487  bool m_InsideString;
        +
        7416  VmaVulkanFunctions m_VulkanFunctions;
        +
        7417 
        +
        7418  // Global bit mask AND-ed with any memoryTypeBits to disallow certain memory types.
        +
        7419  uint32_t m_GlobalMemoryTypeBits;
        +
        7420 
        +
        7421 #if VMA_RECORDING_ENABLED
        +
        7422  VmaRecorder* m_pRecorder;
        +
        7423 #endif
        +
        7424 
        +
        7425  void ImportVulkanFunctions(const VmaVulkanFunctions* pVulkanFunctions);
        +
        7426 
        +
        7427  VkDeviceSize CalcPreferredBlockSize(uint32_t memTypeIndex);
        +
        7428 
        +
        7429  VkResult AllocateMemoryOfType(
        +
        7430  VkDeviceSize size,
        +
        7431  VkDeviceSize alignment,
        +
        7432  bool dedicatedAllocation,
        +
        7433  VkBuffer dedicatedBuffer,
        +
        7434  VkImage dedicatedImage,
        +
        7435  const VmaAllocationCreateInfo& createInfo,
        +
        7436  uint32_t memTypeIndex,
        +
        7437  VmaSuballocationType suballocType,
        +
        7438  size_t allocationCount,
        +
        7439  VmaAllocation* pAllocations);
        +
        7440 
        +
        7441  // Helper function only to be used inside AllocateDedicatedMemory.
        +
        7442  VkResult AllocateDedicatedMemoryPage(
        +
        7443  VkDeviceSize size,
        +
        7444  VmaSuballocationType suballocType,
        +
        7445  uint32_t memTypeIndex,
        +
        7446  const VkMemoryAllocateInfo& allocInfo,
        +
        7447  bool map,
        +
        7448  bool isUserDataString,
        +
        7449  void* pUserData,
        +
        7450  VmaAllocation* pAllocation);
        +
        7451 
        +
        7452  // Allocates and registers new VkDeviceMemory specifically for dedicated allocations.
        +
        7453  VkResult AllocateDedicatedMemory(
        +
        7454  VkDeviceSize size,
        +
        7455  VmaSuballocationType suballocType,
        +
        7456  uint32_t memTypeIndex,
        +
        7457  bool withinBudget,
        +
        7458  bool map,
        +
        7459  bool isUserDataString,
        +
        7460  void* pUserData,
        +
        7461  VkBuffer dedicatedBuffer,
        +
        7462  VkImage dedicatedImage,
        +
        7463  size_t allocationCount,
        +
        7464  VmaAllocation* pAllocations);
        +
        7465 
        +
        7466  void FreeDedicatedMemory(const VmaAllocation allocation);
        +
        7467 
        +
        7468  /*
        +
        7469  Calculates and returns bit mask of memory types that can support defragmentation
        +
        7470  on GPU as they support creation of required buffer for copy operations.
        +
        7471  */
        +
        7472  uint32_t CalculateGpuDefragmentationMemoryTypeBits() const;
        +
        7473 
        +
        7474  uint32_t CalculateGlobalMemoryTypeBits() const;
        +
        7475 
        +
        7476 #if VMA_MEMORY_BUDGET
        +
        7477  void UpdateVulkanBudget();
        +
        7478 #endif // #if VMA_MEMORY_BUDGET
        +
        7479 };
        +
        7480 
        +
        7482 // Memory allocation #2 after VmaAllocator_T definition
        +
        7483 
        +
        7484 static void* VmaMalloc(VmaAllocator hAllocator, size_t size, size_t alignment)
        +
        7485 {
        +
        7486  return VmaMalloc(&hAllocator->m_AllocationCallbacks, size, alignment);
        +
        7487 }
        7488 
        -
        7489  void BeginValue(bool isString);
        -
        7490  void WriteIndent(bool oneLess = false);
        -
        7491 };
        -
        7492 
        -
        7493 const char* const VmaJsonWriter::INDENT = " ";
        -
        7494 
        -
        7495 VmaJsonWriter::VmaJsonWriter(const VkAllocationCallbacks* pAllocationCallbacks, VmaStringBuilder& sb) :
        -
        7496  m_SB(sb),
        -
        7497  m_Stack(VmaStlAllocator<StackItem>(pAllocationCallbacks)),
        -
        7498  m_InsideString(false)
        -
        7499 {
        -
        7500 }
        -
        7501 
        -
        7502 VmaJsonWriter::~VmaJsonWriter()
        -
        7503 {
        -
        7504  VMA_ASSERT(!m_InsideString);
        -
        7505  VMA_ASSERT(m_Stack.empty());
        -
        7506 }
        -
        7507 
        -
        7508 void VmaJsonWriter::BeginObject(bool singleLine)
        -
        7509 {
        -
        7510  VMA_ASSERT(!m_InsideString);
        -
        7511 
        -
        7512  BeginValue(false);
        -
        7513  m_SB.Add('{');
        -
        7514 
        -
        7515  StackItem item;
        -
        7516  item.type = COLLECTION_TYPE_OBJECT;
        -
        7517  item.valueCount = 0;
        -
        7518  item.singleLineMode = singleLine;
        -
        7519  m_Stack.push_back(item);
        -
        7520 }
        -
        7521 
        -
        7522 void VmaJsonWriter::EndObject()
        -
        7523 {
        -
        7524  VMA_ASSERT(!m_InsideString);
        -
        7525 
        -
        7526  WriteIndent(true);
        -
        7527  m_SB.Add('}');
        -
        7528 
        -
        7529  VMA_ASSERT(!m_Stack.empty() && m_Stack.back().type == COLLECTION_TYPE_OBJECT);
        -
        7530  m_Stack.pop_back();
        -
        7531 }
        -
        7532 
        -
        7533 void VmaJsonWriter::BeginArray(bool singleLine)
        -
        7534 {
        -
        7535  VMA_ASSERT(!m_InsideString);
        -
        7536 
        -
        7537  BeginValue(false);
        -
        7538  m_SB.Add('[');
        -
        7539 
        -
        7540  StackItem item;
        -
        7541  item.type = COLLECTION_TYPE_ARRAY;
        -
        7542  item.valueCount = 0;
        -
        7543  item.singleLineMode = singleLine;
        -
        7544  m_Stack.push_back(item);
        -
        7545 }
        -
        7546 
        -
        7547 void VmaJsonWriter::EndArray()
        -
        7548 {
        -
        7549  VMA_ASSERT(!m_InsideString);
        -
        7550 
        -
        7551  WriteIndent(true);
        -
        7552  m_SB.Add(']');
        -
        7553 
        -
        7554  VMA_ASSERT(!m_Stack.empty() && m_Stack.back().type == COLLECTION_TYPE_ARRAY);
        -
        7555  m_Stack.pop_back();
        -
        7556 }
        -
        7557 
        -
        7558 void VmaJsonWriter::WriteString(const char* pStr)
        -
        7559 {
        -
        7560  BeginString(pStr);
        -
        7561  EndString();
        -
        7562 }
        -
        7563 
        -
        7564 void VmaJsonWriter::BeginString(const char* pStr)
        -
        7565 {
        -
        7566  VMA_ASSERT(!m_InsideString);
        -
        7567 
        -
        7568  BeginValue(true);
        -
        7569  m_SB.Add('"');
        -
        7570  m_InsideString = true;
        -
        7571  if(pStr != VMA_NULL && pStr[0] != '\0')
        -
        7572  {
        -
        7573  ContinueString(pStr);
        -
        7574  }
        -
        7575 }
        -
        7576 
        -
        7577 void VmaJsonWriter::ContinueString(const char* pStr)
        -
        7578 {
        -
        7579  VMA_ASSERT(m_InsideString);
        -
        7580 
        -
        7581  const size_t strLen = strlen(pStr);
        -
        7582  for(size_t i = 0; i < strLen; ++i)
        -
        7583  {
        -
        7584  char ch = pStr[i];
        -
        7585  if(ch == '\\')
        -
        7586  {
        -
        7587  m_SB.Add("\\\\");
        -
        7588  }
        -
        7589  else if(ch == '"')
        -
        7590  {
        -
        7591  m_SB.Add("\\\"");
        -
        7592  }
        -
        7593  else if(ch >= 32)
        -
        7594  {
        -
        7595  m_SB.Add(ch);
        -
        7596  }
        -
        7597  else switch(ch)
        -
        7598  {
        -
        7599  case '\b':
        -
        7600  m_SB.Add("\\b");
        -
        7601  break;
        -
        7602  case '\f':
        -
        7603  m_SB.Add("\\f");
        -
        7604  break;
        -
        7605  case '\n':
        -
        7606  m_SB.Add("\\n");
        -
        7607  break;
        -
        7608  case '\r':
        -
        7609  m_SB.Add("\\r");
        -
        7610  break;
        -
        7611  case '\t':
        -
        7612  m_SB.Add("\\t");
        -
        7613  break;
        -
        7614  default:
        -
        7615  VMA_ASSERT(0 && "Character not currently supported.");
        -
        7616  break;
        -
        7617  }
        -
        7618  }
        -
        7619 }
        -
        7620 
        -
        7621 void VmaJsonWriter::ContinueString(uint32_t n)
        -
        7622 {
        -
        7623  VMA_ASSERT(m_InsideString);
        -
        7624  m_SB.AddNumber(n);
        -
        7625 }
        -
        7626 
        -
        7627 void VmaJsonWriter::ContinueString(uint64_t n)
        -
        7628 {
        -
        7629  VMA_ASSERT(m_InsideString);
        -
        7630  m_SB.AddNumber(n);
        -
        7631 }
        -
        7632 
        -
        7633 void VmaJsonWriter::ContinueString_Pointer(const void* ptr)
        -
        7634 {
        -
        7635  VMA_ASSERT(m_InsideString);
        -
        7636  m_SB.AddPointer(ptr);
        -
        7637 }
        -
        7638 
        -
        7639 void VmaJsonWriter::EndString(const char* pStr)
        -
        7640 {
        -
        7641  VMA_ASSERT(m_InsideString);
        -
        7642  if(pStr != VMA_NULL && pStr[0] != '\0')
        -
        7643  {
        -
        7644  ContinueString(pStr);
        -
        7645  }
        -
        7646  m_SB.Add('"');
        -
        7647  m_InsideString = false;
        -
        7648 }
        -
        7649 
        -
        7650 void VmaJsonWriter::WriteNumber(uint32_t n)
        -
        7651 {
        -
        7652  VMA_ASSERT(!m_InsideString);
        -
        7653  BeginValue(false);
        -
        7654  m_SB.AddNumber(n);
        -
        7655 }
        -
        7656 
        -
        7657 void VmaJsonWriter::WriteNumber(uint64_t n)
        +
        7489 static void VmaFree(VmaAllocator hAllocator, void* ptr)
        +
        7490 {
        +
        7491  VmaFree(&hAllocator->m_AllocationCallbacks, ptr);
        +
        7492 }
        +
        7493 
        +
        7494 template<typename T>
        +
        7495 static T* VmaAllocate(VmaAllocator hAllocator)
        +
        7496 {
        +
        7497  return (T*)VmaMalloc(hAllocator, sizeof(T), VMA_ALIGN_OF(T));
        +
        7498 }
        +
        7499 
        +
        7500 template<typename T>
        +
        7501 static T* VmaAllocateArray(VmaAllocator hAllocator, size_t count)
        +
        7502 {
        +
        7503  return (T*)VmaMalloc(hAllocator, sizeof(T) * count, VMA_ALIGN_OF(T));
        +
        7504 }
        +
        7505 
        +
        7506 template<typename T>
        +
        7507 static void vma_delete(VmaAllocator hAllocator, T* ptr)
        +
        7508 {
        +
        7509  if(ptr != VMA_NULL)
        +
        7510  {
        +
        7511  ptr->~T();
        +
        7512  VmaFree(hAllocator, ptr);
        +
        7513  }
        +
        7514 }
        +
        7515 
        +
        7516 template<typename T>
        +
        7517 static void vma_delete_array(VmaAllocator hAllocator, T* ptr, size_t count)
        +
        7518 {
        +
        7519  if(ptr != VMA_NULL)
        +
        7520  {
        +
        7521  for(size_t i = count; i--; )
        +
        7522  ptr[i].~T();
        +
        7523  VmaFree(hAllocator, ptr);
        +
        7524  }
        +
        7525 }
        +
        7526 
        +
        7528 // VmaStringBuilder
        +
        7529 
        +
        7530 #if VMA_STATS_STRING_ENABLED
        +
        7531 
        +
        7532 class VmaStringBuilder
        +
        7533 {
        +
        7534 public:
        +
        7535  VmaStringBuilder(VmaAllocator alloc) : m_Data(VmaStlAllocator<char>(alloc->GetAllocationCallbacks())) { }
        +
        7536  size_t GetLength() const { return m_Data.size(); }
        +
        7537  const char* GetData() const { return m_Data.data(); }
        +
        7538 
        +
        7539  void Add(char ch) { m_Data.push_back(ch); }
        +
        7540  void Add(const char* pStr);
        +
        7541  void AddNewLine() { Add('\n'); }
        +
        7542  void AddNumber(uint32_t num);
        +
        7543  void AddNumber(uint64_t num);
        +
        7544  void AddPointer(const void* ptr);
        +
        7545 
        +
        7546 private:
        +
        7547  VmaVector< char, VmaStlAllocator<char> > m_Data;
        +
        7548 };
        +
        7549 
        +
        7550 void VmaStringBuilder::Add(const char* pStr)
        +
        7551 {
        +
        7552  const size_t strLen = strlen(pStr);
        +
        7553  if(strLen > 0)
        +
        7554  {
        +
        7555  const size_t oldCount = m_Data.size();
        +
        7556  m_Data.resize(oldCount + strLen);
        +
        7557  memcpy(m_Data.data() + oldCount, pStr, strLen);
        +
        7558  }
        +
        7559 }
        +
        7560 
        +
        7561 void VmaStringBuilder::AddNumber(uint32_t num)
        +
        7562 {
        +
        7563  char buf[11];
        +
        7564  buf[10] = '\0';
        +
        7565  char *p = &buf[10];
        +
        7566  do
        +
        7567  {
        +
        7568  *--p = '0' + (num % 10);
        +
        7569  num /= 10;
        +
        7570  }
        +
        7571  while(num);
        +
        7572  Add(p);
        +
        7573 }
        +
        7574 
        +
        7575 void VmaStringBuilder::AddNumber(uint64_t num)
        +
        7576 {
        +
        7577  char buf[21];
        +
        7578  buf[20] = '\0';
        +
        7579  char *p = &buf[20];
        +
        7580  do
        +
        7581  {
        +
        7582  *--p = '0' + (num % 10);
        +
        7583  num /= 10;
        +
        7584  }
        +
        7585  while(num);
        +
        7586  Add(p);
        +
        7587 }
        +
        7588 
        +
        7589 void VmaStringBuilder::AddPointer(const void* ptr)
        +
        7590 {
        +
        7591  char buf[21];
        +
        7592  VmaPtrToStr(buf, sizeof(buf), ptr);
        +
        7593  Add(buf);
        +
        7594 }
        +
        7595 
        +
        7596 #endif // #if VMA_STATS_STRING_ENABLED
        +
        7597 
        +
        7599 // VmaJsonWriter
        +
        7600 
        +
        7601 #if VMA_STATS_STRING_ENABLED
        +
        7602 
        +
        7603 class VmaJsonWriter
        +
        7604 {
        +
        7605  VMA_CLASS_NO_COPY(VmaJsonWriter)
        +
        7606 public:
        +
        7607  VmaJsonWriter(const VkAllocationCallbacks* pAllocationCallbacks, VmaStringBuilder& sb);
        +
        7608  ~VmaJsonWriter();
        +
        7609 
        +
        7610  void BeginObject(bool singleLine = false);
        +
        7611  void EndObject();
        +
        7612 
        +
        7613  void BeginArray(bool singleLine = false);
        +
        7614  void EndArray();
        +
        7615 
        +
        7616  void WriteString(const char* pStr);
        +
        7617  void BeginString(const char* pStr = VMA_NULL);
        +
        7618  void ContinueString(const char* pStr);
        +
        7619  void ContinueString(uint32_t n);
        +
        7620  void ContinueString(uint64_t n);
        +
        7621  void ContinueString_Pointer(const void* ptr);
        +
        7622  void EndString(const char* pStr = VMA_NULL);
        +
        7623 
        +
        7624  void WriteNumber(uint32_t n);
        +
        7625  void WriteNumber(uint64_t n);
        +
        7626  void WriteBool(bool b);
        +
        7627  void WriteNull();
        +
        7628 
        +
        7629 private:
        +
        7630  static const char* const INDENT;
        +
        7631 
        +
        7632  enum COLLECTION_TYPE
        +
        7633  {
        +
        7634  COLLECTION_TYPE_OBJECT,
        +
        7635  COLLECTION_TYPE_ARRAY,
        +
        7636  };
        +
        7637  struct StackItem
        +
        7638  {
        +
        7639  COLLECTION_TYPE type;
        +
        7640  uint32_t valueCount;
        +
        7641  bool singleLineMode;
        +
        7642  };
        +
        7643 
        +
        7644  VmaStringBuilder& m_SB;
        +
        7645  VmaVector< StackItem, VmaStlAllocator<StackItem> > m_Stack;
        +
        7646  bool m_InsideString;
        +
        7647 
        +
        7648  void BeginValue(bool isString);
        +
        7649  void WriteIndent(bool oneLess = false);
        +
        7650 };
        +
        7651 
        +
        7652 const char* const VmaJsonWriter::INDENT = " ";
        +
        7653 
        +
        7654 VmaJsonWriter::VmaJsonWriter(const VkAllocationCallbacks* pAllocationCallbacks, VmaStringBuilder& sb) :
        +
        7655  m_SB(sb),
        +
        7656  m_Stack(VmaStlAllocator<StackItem>(pAllocationCallbacks)),
        +
        7657  m_InsideString(false)
        7658 {
        -
        7659  VMA_ASSERT(!m_InsideString);
        -
        7660  BeginValue(false);
        -
        7661  m_SB.AddNumber(n);
        -
        7662 }
        -
        7663 
        -
        7664 void VmaJsonWriter::WriteBool(bool b)
        -
        7665 {
        -
        7666  VMA_ASSERT(!m_InsideString);
        -
        7667  BeginValue(false);
        -
        7668  m_SB.Add(b ? "true" : "false");
        -
        7669 }
        +
        7659 }
        +
        7660 
        +
        7661 VmaJsonWriter::~VmaJsonWriter()
        +
        7662 {
        +
        7663  VMA_ASSERT(!m_InsideString);
        +
        7664  VMA_ASSERT(m_Stack.empty());
        +
        7665 }
        +
        7666 
        +
        7667 void VmaJsonWriter::BeginObject(bool singleLine)
        +
        7668 {
        +
        7669  VMA_ASSERT(!m_InsideString);
        7670 
        -
        7671 void VmaJsonWriter::WriteNull()
        -
        7672 {
        -
        7673  VMA_ASSERT(!m_InsideString);
        -
        7674  BeginValue(false);
        -
        7675  m_SB.Add("null");
        -
        7676 }
        -
        7677 
        -
        7678 void VmaJsonWriter::BeginValue(bool isString)
        -
        7679 {
        -
        7680  if(!m_Stack.empty())
        -
        7681  {
        -
        7682  StackItem& currItem = m_Stack.back();
        -
        7683  if(currItem.type == COLLECTION_TYPE_OBJECT &&
        -
        7684  currItem.valueCount % 2 == 0)
        -
        7685  {
        -
        7686  VMA_ASSERT(isString);
        -
        7687  }
        -
        7688 
        -
        7689  if(currItem.type == COLLECTION_TYPE_OBJECT &&
        -
        7690  currItem.valueCount % 2 != 0)
        -
        7691  {
        -
        7692  m_SB.Add(": ");
        -
        7693  }
        -
        7694  else if(currItem.valueCount > 0)
        -
        7695  {
        -
        7696  m_SB.Add(", ");
        -
        7697  WriteIndent();
        -
        7698  }
        -
        7699  else
        -
        7700  {
        -
        7701  WriteIndent();
        -
        7702  }
        -
        7703  ++currItem.valueCount;
        -
        7704  }
        -
        7705 }
        -
        7706 
        -
        7707 void VmaJsonWriter::WriteIndent(bool oneLess)
        -
        7708 {
        -
        7709  if(!m_Stack.empty() && !m_Stack.back().singleLineMode)
        -
        7710  {
        -
        7711  m_SB.AddNewLine();
        -
        7712 
        -
        7713  size_t count = m_Stack.size();
        -
        7714  if(count > 0 && oneLess)
        -
        7715  {
        -
        7716  --count;
        -
        7717  }
        -
        7718  for(size_t i = 0; i < count; ++i)
        -
        7719  {
        -
        7720  m_SB.Add(INDENT);
        -
        7721  }
        -
        7722  }
        -
        7723 }
        -
        7724 
        -
        7725 #endif // #if VMA_STATS_STRING_ENABLED
        +
        7671  BeginValue(false);
        +
        7672  m_SB.Add('{');
        +
        7673 
        +
        7674  StackItem item;
        +
        7675  item.type = COLLECTION_TYPE_OBJECT;
        +
        7676  item.valueCount = 0;
        +
        7677  item.singleLineMode = singleLine;
        +
        7678  m_Stack.push_back(item);
        +
        7679 }
        +
        7680 
        +
        7681 void VmaJsonWriter::EndObject()
        +
        7682 {
        +
        7683  VMA_ASSERT(!m_InsideString);
        +
        7684 
        +
        7685  WriteIndent(true);
        +
        7686  m_SB.Add('}');
        +
        7687 
        +
        7688  VMA_ASSERT(!m_Stack.empty() && m_Stack.back().type == COLLECTION_TYPE_OBJECT);
        +
        7689  m_Stack.pop_back();
        +
        7690 }
        +
        7691 
        +
        7692 void VmaJsonWriter::BeginArray(bool singleLine)
        +
        7693 {
        +
        7694  VMA_ASSERT(!m_InsideString);
        +
        7695 
        +
        7696  BeginValue(false);
        +
        7697  m_SB.Add('[');
        +
        7698 
        +
        7699  StackItem item;
        +
        7700  item.type = COLLECTION_TYPE_ARRAY;
        +
        7701  item.valueCount = 0;
        +
        7702  item.singleLineMode = singleLine;
        +
        7703  m_Stack.push_back(item);
        +
        7704 }
        +
        7705 
        +
        7706 void VmaJsonWriter::EndArray()
        +
        7707 {
        +
        7708  VMA_ASSERT(!m_InsideString);
        +
        7709 
        +
        7710  WriteIndent(true);
        +
        7711  m_SB.Add(']');
        +
        7712 
        +
        7713  VMA_ASSERT(!m_Stack.empty() && m_Stack.back().type == COLLECTION_TYPE_ARRAY);
        +
        7714  m_Stack.pop_back();
        +
        7715 }
        +
        7716 
        +
        7717 void VmaJsonWriter::WriteString(const char* pStr)
        +
        7718 {
        +
        7719  BeginString(pStr);
        +
        7720  EndString();
        +
        7721 }
        +
        7722 
        +
        7723 void VmaJsonWriter::BeginString(const char* pStr)
        +
        7724 {
        +
        7725  VMA_ASSERT(!m_InsideString);
        7726 
        -
        7728 
        -
        7729 void VmaAllocation_T::SetUserData(VmaAllocator hAllocator, void* pUserData)
        -
        7730 {
        -
        7731  if(IsUserDataString())
        -
        7732  {
        -
        7733  VMA_ASSERT(pUserData == VMA_NULL || pUserData != m_pUserData);
        -
        7734 
        -
        7735  FreeUserDataString(hAllocator);
        -
        7736 
        -
        7737  if(pUserData != VMA_NULL)
        -
        7738  {
        -
        7739  m_pUserData = VmaCreateStringCopy(hAllocator->GetAllocationCallbacks(), (const char*)pUserData);
        -
        7740  }
        -
        7741  }
        -
        7742  else
        -
        7743  {
        -
        7744  m_pUserData = pUserData;
        -
        7745  }
        -
        7746 }
        -
        7747 
        -
        7748 void VmaAllocation_T::ChangeBlockAllocation(
        -
        7749  VmaAllocator hAllocator,
        -
        7750  VmaDeviceMemoryBlock* block,
        -
        7751  VkDeviceSize offset)
        -
        7752 {
        -
        7753  VMA_ASSERT(block != VMA_NULL);
        -
        7754  VMA_ASSERT(m_Type == ALLOCATION_TYPE_BLOCK);
        -
        7755 
        -
        7756  // Move mapping reference counter from old block to new block.
        -
        7757  if(block != m_BlockAllocation.m_Block)
        -
        7758  {
        -
        7759  uint32_t mapRefCount = m_MapCount & ~MAP_COUNT_FLAG_PERSISTENT_MAP;
        -
        7760  if(IsPersistentMap())
        -
        7761  ++mapRefCount;
        -
        7762  m_BlockAllocation.m_Block->Unmap(hAllocator, mapRefCount);
        -
        7763  block->Map(hAllocator, mapRefCount, VMA_NULL);
        -
        7764  }
        -
        7765 
        -
        7766  m_BlockAllocation.m_Block = block;
        -
        7767  m_BlockAllocation.m_Offset = offset;
        -
        7768 }
        -
        7769 
        -
        7770 void VmaAllocation_T::ChangeOffset(VkDeviceSize newOffset)
        -
        7771 {
        -
        7772  VMA_ASSERT(m_Type == ALLOCATION_TYPE_BLOCK);
        -
        7773  m_BlockAllocation.m_Offset = newOffset;
        -
        7774 }
        -
        7775 
        -
        7776 VkDeviceSize VmaAllocation_T::GetOffset() const
        -
        7777 {
        -
        7778  switch(m_Type)
        -
        7779  {
        -
        7780  case ALLOCATION_TYPE_BLOCK:
        -
        7781  return m_BlockAllocation.m_Offset;
        -
        7782  case ALLOCATION_TYPE_DEDICATED:
        -
        7783  return 0;
        -
        7784  default:
        -
        7785  VMA_ASSERT(0);
        -
        7786  return 0;
        -
        7787  }
        -
        7788 }
        -
        7789 
        -
        7790 VkDeviceMemory VmaAllocation_T::GetMemory() const
        -
        7791 {
        -
        7792  switch(m_Type)
        -
        7793  {
        -
        7794  case ALLOCATION_TYPE_BLOCK:
        -
        7795  return m_BlockAllocation.m_Block->GetDeviceMemory();
        -
        7796  case ALLOCATION_TYPE_DEDICATED:
        -
        7797  return m_DedicatedAllocation.m_hMemory;
        -
        7798  default:
        -
        7799  VMA_ASSERT(0);
        -
        7800  return VK_NULL_HANDLE;
        -
        7801  }
        -
        7802 }
        -
        7803 
        -
        7804 void* VmaAllocation_T::GetMappedData() const
        -
        7805 {
        -
        7806  switch(m_Type)
        -
        7807  {
        -
        7808  case ALLOCATION_TYPE_BLOCK:
        -
        7809  if(m_MapCount != 0)
        -
        7810  {
        -
        7811  void* pBlockData = m_BlockAllocation.m_Block->GetMappedData();
        -
        7812  VMA_ASSERT(pBlockData != VMA_NULL);
        -
        7813  return (char*)pBlockData + m_BlockAllocation.m_Offset;
        -
        7814  }
        -
        7815  else
        -
        7816  {
        -
        7817  return VMA_NULL;
        -
        7818  }
        -
        7819  break;
        -
        7820  case ALLOCATION_TYPE_DEDICATED:
        -
        7821  VMA_ASSERT((m_DedicatedAllocation.m_pMappedData != VMA_NULL) == (m_MapCount != 0));
        -
        7822  return m_DedicatedAllocation.m_pMappedData;
        -
        7823  default:
        -
        7824  VMA_ASSERT(0);
        -
        7825  return VMA_NULL;
        -
        7826  }
        -
        7827 }
        -
        7828 
        -
        7829 bool VmaAllocation_T::CanBecomeLost() const
        -
        7830 {
        -
        7831  switch(m_Type)
        -
        7832  {
        -
        7833  case ALLOCATION_TYPE_BLOCK:
        -
        7834  return m_BlockAllocation.m_CanBecomeLost;
        -
        7835  case ALLOCATION_TYPE_DEDICATED:
        -
        7836  return false;
        -
        7837  default:
        -
        7838  VMA_ASSERT(0);
        -
        7839  return false;
        -
        7840  }
        -
        7841 }
        -
        7842 
        -
        7843 bool VmaAllocation_T::MakeLost(uint32_t currentFrameIndex, uint32_t frameInUseCount)
        -
        7844 {
        -
        7845  VMA_ASSERT(CanBecomeLost());
        -
        7846 
        -
        7847  /*
        -
        7848  Warning: This is a carefully designed algorithm.
        -
        7849  Do not modify unless you really know what you're doing :)
        -
        7850  */
        -
        7851  uint32_t localLastUseFrameIndex = GetLastUseFrameIndex();
        -
        7852  for(;;)
        -
        7853  {
        -
        7854  if(localLastUseFrameIndex == VMA_FRAME_INDEX_LOST)
        -
        7855  {
        -
        7856  VMA_ASSERT(0);
        -
        7857  return false;
        -
        7858  }
        -
        7859  else if(localLastUseFrameIndex + frameInUseCount >= currentFrameIndex)
        -
        7860  {
        -
        7861  return false;
        -
        7862  }
        -
        7863  else // Last use time earlier than current time.
        -
        7864  {
        -
        7865  if(CompareExchangeLastUseFrameIndex(localLastUseFrameIndex, VMA_FRAME_INDEX_LOST))
        -
        7866  {
        -
        7867  // Setting hAllocation.LastUseFrameIndex atomic to VMA_FRAME_INDEX_LOST is enough to mark it as LOST.
        -
        7868  // Calling code just needs to unregister this allocation in owning VmaDeviceMemoryBlock.
        -
        7869  return true;
        -
        7870  }
        -
        7871  }
        -
        7872  }
        -
        7873 }
        -
        7874 
        -
        7875 #if VMA_STATS_STRING_ENABLED
        -
        7876 
        -
        7877 // Correspond to values of enum VmaSuballocationType.
        -
        7878 static const char* VMA_SUBALLOCATION_TYPE_NAMES[] = {
        -
        7879  "FREE",
        -
        7880  "UNKNOWN",
        -
        7881  "BUFFER",
        -
        7882  "IMAGE_UNKNOWN",
        -
        7883  "IMAGE_LINEAR",
        -
        7884  "IMAGE_OPTIMAL",
        -
        7885 };
        -
        7886 
        -
        7887 void VmaAllocation_T::PrintParameters(class VmaJsonWriter& json) const
        -
        7888 {
        -
        7889  json.WriteString("Type");
        -
        7890  json.WriteString(VMA_SUBALLOCATION_TYPE_NAMES[m_SuballocationType]);
        -
        7891 
        -
        7892  json.WriteString("Size");
        -
        7893  json.WriteNumber(m_Size);
        -
        7894 
        -
        7895  if(m_pUserData != VMA_NULL)
        -
        7896  {
        -
        7897  json.WriteString("UserData");
        -
        7898  if(IsUserDataString())
        -
        7899  {
        -
        7900  json.WriteString((const char*)m_pUserData);
        -
        7901  }
        -
        7902  else
        -
        7903  {
        -
        7904  json.BeginString();
        -
        7905  json.ContinueString_Pointer(m_pUserData);
        -
        7906  json.EndString();
        -
        7907  }
        -
        7908  }
        -
        7909 
        -
        7910  json.WriteString("CreationFrameIndex");
        -
        7911  json.WriteNumber(m_CreationFrameIndex);
        -
        7912 
        -
        7913  json.WriteString("LastUseFrameIndex");
        -
        7914  json.WriteNumber(GetLastUseFrameIndex());
        -
        7915 
        -
        7916  if(m_BufferImageUsage != 0)
        +
        7727  BeginValue(true);
        +
        7728  m_SB.Add('"');
        +
        7729  m_InsideString = true;
        +
        7730  if(pStr != VMA_NULL && pStr[0] != '\0')
        +
        7731  {
        +
        7732  ContinueString(pStr);
        +
        7733  }
        +
        7734 }
        +
        7735 
        +
        7736 void VmaJsonWriter::ContinueString(const char* pStr)
        +
        7737 {
        +
        7738  VMA_ASSERT(m_InsideString);
        +
        7739 
        +
        7740  const size_t strLen = strlen(pStr);
        +
        7741  for(size_t i = 0; i < strLen; ++i)
        +
        7742  {
        +
        7743  char ch = pStr[i];
        +
        7744  if(ch == '\\')
        +
        7745  {
        +
        7746  m_SB.Add("\\\\");
        +
        7747  }
        +
        7748  else if(ch == '"')
        +
        7749  {
        +
        7750  m_SB.Add("\\\"");
        +
        7751  }
        +
        7752  else if(ch >= 32)
        +
        7753  {
        +
        7754  m_SB.Add(ch);
        +
        7755  }
        +
        7756  else switch(ch)
        +
        7757  {
        +
        7758  case '\b':
        +
        7759  m_SB.Add("\\b");
        +
        7760  break;
        +
        7761  case '\f':
        +
        7762  m_SB.Add("\\f");
        +
        7763  break;
        +
        7764  case '\n':
        +
        7765  m_SB.Add("\\n");
        +
        7766  break;
        +
        7767  case '\r':
        +
        7768  m_SB.Add("\\r");
        +
        7769  break;
        +
        7770  case '\t':
        +
        7771  m_SB.Add("\\t");
        +
        7772  break;
        +
        7773  default:
        +
        7774  VMA_ASSERT(0 && "Character not currently supported.");
        +
        7775  break;
        +
        7776  }
        +
        7777  }
        +
        7778 }
        +
        7779 
        +
        7780 void VmaJsonWriter::ContinueString(uint32_t n)
        +
        7781 {
        +
        7782  VMA_ASSERT(m_InsideString);
        +
        7783  m_SB.AddNumber(n);
        +
        7784 }
        +
        7785 
        +
        7786 void VmaJsonWriter::ContinueString(uint64_t n)
        +
        7787 {
        +
        7788  VMA_ASSERT(m_InsideString);
        +
        7789  m_SB.AddNumber(n);
        +
        7790 }
        +
        7791 
        +
        7792 void VmaJsonWriter::ContinueString_Pointer(const void* ptr)
        +
        7793 {
        +
        7794  VMA_ASSERT(m_InsideString);
        +
        7795  m_SB.AddPointer(ptr);
        +
        7796 }
        +
        7797 
        +
        7798 void VmaJsonWriter::EndString(const char* pStr)
        +
        7799 {
        +
        7800  VMA_ASSERT(m_InsideString);
        +
        7801  if(pStr != VMA_NULL && pStr[0] != '\0')
        +
        7802  {
        +
        7803  ContinueString(pStr);
        +
        7804  }
        +
        7805  m_SB.Add('"');
        +
        7806  m_InsideString = false;
        +
        7807 }
        +
        7808 
        +
        7809 void VmaJsonWriter::WriteNumber(uint32_t n)
        +
        7810 {
        +
        7811  VMA_ASSERT(!m_InsideString);
        +
        7812  BeginValue(false);
        +
        7813  m_SB.AddNumber(n);
        +
        7814 }
        +
        7815 
        +
        7816 void VmaJsonWriter::WriteNumber(uint64_t n)
        +
        7817 {
        +
        7818  VMA_ASSERT(!m_InsideString);
        +
        7819  BeginValue(false);
        +
        7820  m_SB.AddNumber(n);
        +
        7821 }
        +
        7822 
        +
        7823 void VmaJsonWriter::WriteBool(bool b)
        +
        7824 {
        +
        7825  VMA_ASSERT(!m_InsideString);
        +
        7826  BeginValue(false);
        +
        7827  m_SB.Add(b ? "true" : "false");
        +
        7828 }
        +
        7829 
        +
        7830 void VmaJsonWriter::WriteNull()
        +
        7831 {
        +
        7832  VMA_ASSERT(!m_InsideString);
        +
        7833  BeginValue(false);
        +
        7834  m_SB.Add("null");
        +
        7835 }
        +
        7836 
        +
        7837 void VmaJsonWriter::BeginValue(bool isString)
        +
        7838 {
        +
        7839  if(!m_Stack.empty())
        +
        7840  {
        +
        7841  StackItem& currItem = m_Stack.back();
        +
        7842  if(currItem.type == COLLECTION_TYPE_OBJECT &&
        +
        7843  currItem.valueCount % 2 == 0)
        +
        7844  {
        +
        7845  VMA_ASSERT(isString);
        +
        7846  }
        +
        7847 
        +
        7848  if(currItem.type == COLLECTION_TYPE_OBJECT &&
        +
        7849  currItem.valueCount % 2 != 0)
        +
        7850  {
        +
        7851  m_SB.Add(": ");
        +
        7852  }
        +
        7853  else if(currItem.valueCount > 0)
        +
        7854  {
        +
        7855  m_SB.Add(", ");
        +
        7856  WriteIndent();
        +
        7857  }
        +
        7858  else
        +
        7859  {
        +
        7860  WriteIndent();
        +
        7861  }
        +
        7862  ++currItem.valueCount;
        +
        7863  }
        +
        7864 }
        +
        7865 
        +
        7866 void VmaJsonWriter::WriteIndent(bool oneLess)
        +
        7867 {
        +
        7868  if(!m_Stack.empty() && !m_Stack.back().singleLineMode)
        +
        7869  {
        +
        7870  m_SB.AddNewLine();
        +
        7871 
        +
        7872  size_t count = m_Stack.size();
        +
        7873  if(count > 0 && oneLess)
        +
        7874  {
        +
        7875  --count;
        +
        7876  }
        +
        7877  for(size_t i = 0; i < count; ++i)
        +
        7878  {
        +
        7879  m_SB.Add(INDENT);
        +
        7880  }
        +
        7881  }
        +
        7882 }
        +
        7883 
        +
        7884 #endif // #if VMA_STATS_STRING_ENABLED
        +
        7885 
        +
        7887 
        +
        7888 void VmaAllocation_T::SetUserData(VmaAllocator hAllocator, void* pUserData)
        +
        7889 {
        +
        7890  if(IsUserDataString())
        +
        7891  {
        +
        7892  VMA_ASSERT(pUserData == VMA_NULL || pUserData != m_pUserData);
        +
        7893 
        +
        7894  FreeUserDataString(hAllocator);
        +
        7895 
        +
        7896  if(pUserData != VMA_NULL)
        +
        7897  {
        +
        7898  m_pUserData = VmaCreateStringCopy(hAllocator->GetAllocationCallbacks(), (const char*)pUserData);
        +
        7899  }
        +
        7900  }
        +
        7901  else
        +
        7902  {
        +
        7903  m_pUserData = pUserData;
        +
        7904  }
        +
        7905 }
        +
        7906 
        +
        7907 void VmaAllocation_T::ChangeBlockAllocation(
        +
        7908  VmaAllocator hAllocator,
        +
        7909  VmaDeviceMemoryBlock* block,
        +
        7910  VkDeviceSize offset)
        +
        7911 {
        +
        7912  VMA_ASSERT(block != VMA_NULL);
        +
        7913  VMA_ASSERT(m_Type == ALLOCATION_TYPE_BLOCK);
        +
        7914 
        +
        7915  // Move mapping reference counter from old block to new block.
        +
        7916  if(block != m_BlockAllocation.m_Block)
        7917  {
        -
        7918  json.WriteString("Usage");
        -
        7919  json.WriteNumber(m_BufferImageUsage);
        -
        7920  }
        -
        7921 }
        -
        7922 
        -
        7923 #endif
        +
        7918  uint32_t mapRefCount = m_MapCount & ~MAP_COUNT_FLAG_PERSISTENT_MAP;
        +
        7919  if(IsPersistentMap())
        +
        7920  ++mapRefCount;
        +
        7921  m_BlockAllocation.m_Block->Unmap(hAllocator, mapRefCount);
        +
        7922  block->Map(hAllocator, mapRefCount, VMA_NULL);
        +
        7923  }
        7924 
        -
        7925 void VmaAllocation_T::FreeUserDataString(VmaAllocator hAllocator)
        -
        7926 {
        -
        7927  VMA_ASSERT(IsUserDataString());
        -
        7928  VmaFreeString(hAllocator->GetAllocationCallbacks(), (char*)m_pUserData);
        -
        7929  m_pUserData = VMA_NULL;
        -
        7930 }
        -
        7931 
        -
        7932 void VmaAllocation_T::BlockAllocMap()
        -
        7933 {
        -
        7934  VMA_ASSERT(GetType() == ALLOCATION_TYPE_BLOCK);
        -
        7935 
        -
        7936  if((m_MapCount & ~MAP_COUNT_FLAG_PERSISTENT_MAP) < 0x7F)
        -
        7937  {
        -
        7938  ++m_MapCount;
        -
        7939  }
        -
        7940  else
        -
        7941  {
        -
        7942  VMA_ASSERT(0 && "Allocation mapped too many times simultaneously.");
        -
        7943  }
        -
        7944 }
        -
        7945 
        -
        7946 void VmaAllocation_T::BlockAllocUnmap()
        -
        7947 {
        -
        7948  VMA_ASSERT(GetType() == ALLOCATION_TYPE_BLOCK);
        -
        7949 
        -
        7950  if((m_MapCount & ~MAP_COUNT_FLAG_PERSISTENT_MAP) != 0)
        -
        7951  {
        -
        7952  --m_MapCount;
        -
        7953  }
        -
        7954  else
        -
        7955  {
        -
        7956  VMA_ASSERT(0 && "Unmapping allocation not previously mapped.");
        -
        7957  }
        -
        7958 }
        -
        7959 
        -
        7960 VkResult VmaAllocation_T::DedicatedAllocMap(VmaAllocator hAllocator, void** ppData)
        -
        7961 {
        -
        7962  VMA_ASSERT(GetType() == ALLOCATION_TYPE_DEDICATED);
        -
        7963 
        -
        7964  if(m_MapCount != 0)
        -
        7965  {
        -
        7966  if((m_MapCount & ~MAP_COUNT_FLAG_PERSISTENT_MAP) < 0x7F)
        -
        7967  {
        -
        7968  VMA_ASSERT(m_DedicatedAllocation.m_pMappedData != VMA_NULL);
        -
        7969  *ppData = m_DedicatedAllocation.m_pMappedData;
        -
        7970  ++m_MapCount;
        -
        7971  return VK_SUCCESS;
        -
        7972  }
        -
        7973  else
        -
        7974  {
        -
        7975  VMA_ASSERT(0 && "Dedicated allocation mapped too many times simultaneously.");
        -
        7976  return VK_ERROR_MEMORY_MAP_FAILED;
        +
        7925  m_BlockAllocation.m_Block = block;
        +
        7926  m_BlockAllocation.m_Offset = offset;
        +
        7927 }
        +
        7928 
        +
        7929 void VmaAllocation_T::ChangeOffset(VkDeviceSize newOffset)
        +
        7930 {
        +
        7931  VMA_ASSERT(m_Type == ALLOCATION_TYPE_BLOCK);
        +
        7932  m_BlockAllocation.m_Offset = newOffset;
        +
        7933 }
        +
        7934 
        +
        7935 VkDeviceSize VmaAllocation_T::GetOffset() const
        +
        7936 {
        +
        7937  switch(m_Type)
        +
        7938  {
        +
        7939  case ALLOCATION_TYPE_BLOCK:
        +
        7940  return m_BlockAllocation.m_Offset;
        +
        7941  case ALLOCATION_TYPE_DEDICATED:
        +
        7942  return 0;
        +
        7943  default:
        +
        7944  VMA_ASSERT(0);
        +
        7945  return 0;
        +
        7946  }
        +
        7947 }
        +
        7948 
        +
        7949 VkDeviceMemory VmaAllocation_T::GetMemory() const
        +
        7950 {
        +
        7951  switch(m_Type)
        +
        7952  {
        +
        7953  case ALLOCATION_TYPE_BLOCK:
        +
        7954  return m_BlockAllocation.m_Block->GetDeviceMemory();
        +
        7955  case ALLOCATION_TYPE_DEDICATED:
        +
        7956  return m_DedicatedAllocation.m_hMemory;
        +
        7957  default:
        +
        7958  VMA_ASSERT(0);
        +
        7959  return VK_NULL_HANDLE;
        +
        7960  }
        +
        7961 }
        +
        7962 
        +
        7963 void* VmaAllocation_T::GetMappedData() const
        +
        7964 {
        +
        7965  switch(m_Type)
        +
        7966  {
        +
        7967  case ALLOCATION_TYPE_BLOCK:
        +
        7968  if(m_MapCount != 0)
        +
        7969  {
        +
        7970  void* pBlockData = m_BlockAllocation.m_Block->GetMappedData();
        +
        7971  VMA_ASSERT(pBlockData != VMA_NULL);
        +
        7972  return (char*)pBlockData + m_BlockAllocation.m_Offset;
        +
        7973  }
        +
        7974  else
        +
        7975  {
        +
        7976  return VMA_NULL;
        7977  }
        -
        7978  }
        -
        7979  else
        -
        7980  {
        -
        7981  VkResult result = (*hAllocator->GetVulkanFunctions().vkMapMemory)(
        -
        7982  hAllocator->m_hDevice,
        -
        7983  m_DedicatedAllocation.m_hMemory,
        -
        7984  0, // offset
        -
        7985  VK_WHOLE_SIZE,
        -
        7986  0, // flags
        -
        7987  ppData);
        -
        7988  if(result == VK_SUCCESS)
        -
        7989  {
        -
        7990  m_DedicatedAllocation.m_pMappedData = *ppData;
        -
        7991  m_MapCount = 1;
        -
        7992  }
        -
        7993  return result;
        -
        7994  }
        -
        7995 }
        -
        7996 
        -
        7997 void VmaAllocation_T::DedicatedAllocUnmap(VmaAllocator hAllocator)
        -
        7998 {
        -
        7999  VMA_ASSERT(GetType() == ALLOCATION_TYPE_DEDICATED);
        -
        8000 
        -
        8001  if((m_MapCount & ~MAP_COUNT_FLAG_PERSISTENT_MAP) != 0)
        -
        8002  {
        -
        8003  --m_MapCount;
        -
        8004  if(m_MapCount == 0)
        -
        8005  {
        -
        8006  m_DedicatedAllocation.m_pMappedData = VMA_NULL;
        -
        8007  (*hAllocator->GetVulkanFunctions().vkUnmapMemory)(
        -
        8008  hAllocator->m_hDevice,
        -
        8009  m_DedicatedAllocation.m_hMemory);
        -
        8010  }
        -
        8011  }
        -
        8012  else
        -
        8013  {
        -
        8014  VMA_ASSERT(0 && "Unmapping dedicated allocation not previously mapped.");
        -
        8015  }
        -
        8016 }
        -
        8017 
        -
        8018 #if VMA_STATS_STRING_ENABLED
        -
        8019 
        -
        8020 static void VmaPrintStatInfo(VmaJsonWriter& json, const VmaStatInfo& stat)
        -
        8021 {
        -
        8022  json.BeginObject();
        -
        8023 
        -
        8024  json.WriteString("Blocks");
        -
        8025  json.WriteNumber(stat.blockCount);
        -
        8026 
        -
        8027  json.WriteString("Allocations");
        -
        8028  json.WriteNumber(stat.allocationCount);
        -
        8029 
        -
        8030  json.WriteString("UnusedRanges");
        -
        8031  json.WriteNumber(stat.unusedRangeCount);
        -
        8032 
        -
        8033  json.WriteString("UsedBytes");
        -
        8034  json.WriteNumber(stat.usedBytes);
        +
        7978  break;
        +
        7979  case ALLOCATION_TYPE_DEDICATED:
        +
        7980  VMA_ASSERT((m_DedicatedAllocation.m_pMappedData != VMA_NULL) == (m_MapCount != 0));
        +
        7981  return m_DedicatedAllocation.m_pMappedData;
        +
        7982  default:
        +
        7983  VMA_ASSERT(0);
        +
        7984  return VMA_NULL;
        +
        7985  }
        +
        7986 }
        +
        7987 
        +
        7988 bool VmaAllocation_T::CanBecomeLost() const
        +
        7989 {
        +
        7990  switch(m_Type)
        +
        7991  {
        +
        7992  case ALLOCATION_TYPE_BLOCK:
        +
        7993  return m_BlockAllocation.m_CanBecomeLost;
        +
        7994  case ALLOCATION_TYPE_DEDICATED:
        +
        7995  return false;
        +
        7996  default:
        +
        7997  VMA_ASSERT(0);
        +
        7998  return false;
        +
        7999  }
        +
        8000 }
        +
        8001 
        +
        8002 bool VmaAllocation_T::MakeLost(uint32_t currentFrameIndex, uint32_t frameInUseCount)
        +
        8003 {
        +
        8004  VMA_ASSERT(CanBecomeLost());
        +
        8005 
        +
        8006  /*
        +
        8007  Warning: This is a carefully designed algorithm.
        +
        8008  Do not modify unless you really know what you're doing :)
        +
        8009  */
        +
        8010  uint32_t localLastUseFrameIndex = GetLastUseFrameIndex();
        +
        8011  for(;;)
        +
        8012  {
        +
        8013  if(localLastUseFrameIndex == VMA_FRAME_INDEX_LOST)
        +
        8014  {
        +
        8015  VMA_ASSERT(0);
        +
        8016  return false;
        +
        8017  }
        +
        8018  else if(localLastUseFrameIndex + frameInUseCount >= currentFrameIndex)
        +
        8019  {
        +
        8020  return false;
        +
        8021  }
        +
        8022  else // Last use time earlier than current time.
        +
        8023  {
        +
        8024  if(CompareExchangeLastUseFrameIndex(localLastUseFrameIndex, VMA_FRAME_INDEX_LOST))
        +
        8025  {
        +
        8026  // Setting hAllocation.LastUseFrameIndex atomic to VMA_FRAME_INDEX_LOST is enough to mark it as LOST.
        +
        8027  // Calling code just needs to unregister this allocation in owning VmaDeviceMemoryBlock.
        +
        8028  return true;
        +
        8029  }
        +
        8030  }
        +
        8031  }
        +
        8032 }
        +
        8033 
        +
        8034 #if VMA_STATS_STRING_ENABLED
        8035 
        -
        8036  json.WriteString("UnusedBytes");
        -
        8037  json.WriteNumber(stat.unusedBytes);
        -
        8038 
        -
        8039  if(stat.allocationCount > 1)
        -
        8040  {
        -
        8041  json.WriteString("AllocationSize");
        -
        8042  json.BeginObject(true);
        -
        8043  json.WriteString("Min");
        -
        8044  json.WriteNumber(stat.allocationSizeMin);
        -
        8045  json.WriteString("Avg");
        -
        8046  json.WriteNumber(stat.allocationSizeAvg);
        -
        8047  json.WriteString("Max");
        -
        8048  json.WriteNumber(stat.allocationSizeMax);
        -
        8049  json.EndObject();
        -
        8050  }
        -
        8051 
        -
        8052  if(stat.unusedRangeCount > 1)
        -
        8053  {
        -
        8054  json.WriteString("UnusedRangeSize");
        -
        8055  json.BeginObject(true);
        -
        8056  json.WriteString("Min");
        -
        8057  json.WriteNumber(stat.unusedRangeSizeMin);
        -
        8058  json.WriteString("Avg");
        -
        8059  json.WriteNumber(stat.unusedRangeSizeAvg);
        -
        8060  json.WriteString("Max");
        -
        8061  json.WriteNumber(stat.unusedRangeSizeMax);
        -
        8062  json.EndObject();
        -
        8063  }
        -
        8064 
        -
        8065  json.EndObject();
        -
        8066 }
        -
        8067 
        -
        8068 #endif // #if VMA_STATS_STRING_ENABLED
        -
        8069 
        -
        8070 struct VmaSuballocationItemSizeLess
        -
        8071 {
        -
        8072  bool operator()(
        -
        8073  const VmaSuballocationList::iterator lhs,
        -
        8074  const VmaSuballocationList::iterator rhs) const
        -
        8075  {
        -
        8076  return lhs->size < rhs->size;
        -
        8077  }
        -
        8078  bool operator()(
        -
        8079  const VmaSuballocationList::iterator lhs,
        -
        8080  VkDeviceSize rhsSize) const
        -
        8081  {
        -
        8082  return lhs->size < rhsSize;
        -
        8083  }
        -
        8084 };
        -
        8085 
        -
        8086 
        -
        8088 // class VmaBlockMetadata
        -
        8089 
        -
        8090 VmaBlockMetadata::VmaBlockMetadata(VmaAllocator hAllocator) :
        -
        8091  m_Size(0),
        -
        8092  m_pAllocationCallbacks(hAllocator->GetAllocationCallbacks())
        -
        8093 {
        -
        8094 }
        -
        8095 
        -
        8096 #if VMA_STATS_STRING_ENABLED
        -
        8097 
        -
        8098 void VmaBlockMetadata::PrintDetailedMap_Begin(class VmaJsonWriter& json,
        -
        8099  VkDeviceSize unusedBytes,
        -
        8100  size_t allocationCount,
        -
        8101  size_t unusedRangeCount) const
        -
        8102 {
        -
        8103  json.BeginObject();
        +
        8036 // Correspond to values of enum VmaSuballocationType.
        +
        8037 static const char* VMA_SUBALLOCATION_TYPE_NAMES[] = {
        +
        8038  "FREE",
        +
        8039  "UNKNOWN",
        +
        8040  "BUFFER",
        +
        8041  "IMAGE_UNKNOWN",
        +
        8042  "IMAGE_LINEAR",
        +
        8043  "IMAGE_OPTIMAL",
        +
        8044 };
        +
        8045 
        +
        8046 void VmaAllocation_T::PrintParameters(class VmaJsonWriter& json) const
        +
        8047 {
        +
        8048  json.WriteString("Type");
        +
        8049  json.WriteString(VMA_SUBALLOCATION_TYPE_NAMES[m_SuballocationType]);
        +
        8050 
        +
        8051  json.WriteString("Size");
        +
        8052  json.WriteNumber(m_Size);
        +
        8053 
        +
        8054  if(m_pUserData != VMA_NULL)
        +
        8055  {
        +
        8056  json.WriteString("UserData");
        +
        8057  if(IsUserDataString())
        +
        8058  {
        +
        8059  json.WriteString((const char*)m_pUserData);
        +
        8060  }
        +
        8061  else
        +
        8062  {
        +
        8063  json.BeginString();
        +
        8064  json.ContinueString_Pointer(m_pUserData);
        +
        8065  json.EndString();
        +
        8066  }
        +
        8067  }
        +
        8068 
        +
        8069  json.WriteString("CreationFrameIndex");
        +
        8070  json.WriteNumber(m_CreationFrameIndex);
        +
        8071 
        +
        8072  json.WriteString("LastUseFrameIndex");
        +
        8073  json.WriteNumber(GetLastUseFrameIndex());
        +
        8074 
        +
        8075  if(m_BufferImageUsage != 0)
        +
        8076  {
        +
        8077  json.WriteString("Usage");
        +
        8078  json.WriteNumber(m_BufferImageUsage);
        +
        8079  }
        +
        8080 }
        +
        8081 
        +
        8082 #endif
        +
        8083 
        +
        8084 void VmaAllocation_T::FreeUserDataString(VmaAllocator hAllocator)
        +
        8085 {
        +
        8086  VMA_ASSERT(IsUserDataString());
        +
        8087  VmaFreeString(hAllocator->GetAllocationCallbacks(), (char*)m_pUserData);
        +
        8088  m_pUserData = VMA_NULL;
        +
        8089 }
        +
        8090 
        +
        8091 void VmaAllocation_T::BlockAllocMap()
        +
        8092 {
        +
        8093  VMA_ASSERT(GetType() == ALLOCATION_TYPE_BLOCK);
        +
        8094 
        +
        8095  if((m_MapCount & ~MAP_COUNT_FLAG_PERSISTENT_MAP) < 0x7F)
        +
        8096  {
        +
        8097  ++m_MapCount;
        +
        8098  }
        +
        8099  else
        +
        8100  {
        +
        8101  VMA_ASSERT(0 && "Allocation mapped too many times simultaneously.");
        +
        8102  }
        +
        8103 }
        8104 
        -
        8105  json.WriteString("TotalBytes");
        -
        8106  json.WriteNumber(GetSize());
        -
        8107 
        -
        8108  json.WriteString("UnusedBytes");
        -
        8109  json.WriteNumber(unusedBytes);
        -
        8110 
        -
        8111  json.WriteString("Allocations");
        -
        8112  json.WriteNumber((uint64_t)allocationCount);
        -
        8113 
        -
        8114  json.WriteString("UnusedRanges");
        -
        8115  json.WriteNumber((uint64_t)unusedRangeCount);
        -
        8116 
        -
        8117  json.WriteString("Suballocations");
        -
        8118  json.BeginArray();
        -
        8119 }
        -
        8120 
        -
        8121 void VmaBlockMetadata::PrintDetailedMap_Allocation(class VmaJsonWriter& json,
        -
        8122  VkDeviceSize offset,
        -
        8123  VmaAllocation hAllocation) const
        -
        8124 {
        -
        8125  json.BeginObject(true);
        -
        8126 
        -
        8127  json.WriteString("Offset");
        -
        8128  json.WriteNumber(offset);
        -
        8129 
        -
        8130  hAllocation->PrintParameters(json);
        -
        8131 
        -
        8132  json.EndObject();
        -
        8133 }
        -
        8134 
        -
        8135 void VmaBlockMetadata::PrintDetailedMap_UnusedRange(class VmaJsonWriter& json,
        -
        8136  VkDeviceSize offset,
        -
        8137  VkDeviceSize size) const
        -
        8138 {
        -
        8139  json.BeginObject(true);
        -
        8140 
        -
        8141  json.WriteString("Offset");
        -
        8142  json.WriteNumber(offset);
        -
        8143 
        -
        8144  json.WriteString("Type");
        -
        8145  json.WriteString(VMA_SUBALLOCATION_TYPE_NAMES[VMA_SUBALLOCATION_TYPE_FREE]);
        -
        8146 
        -
        8147  json.WriteString("Size");
        -
        8148  json.WriteNumber(size);
        -
        8149 
        -
        8150  json.EndObject();
        -
        8151 }
        -
        8152 
        -
        8153 void VmaBlockMetadata::PrintDetailedMap_End(class VmaJsonWriter& json) const
        -
        8154 {
        -
        8155  json.EndArray();
        -
        8156  json.EndObject();
        -
        8157 }
        -
        8158 
        -
        8159 #endif // #if VMA_STATS_STRING_ENABLED
        -
        8160 
        -
        8162 // class VmaBlockMetadata_Generic
        -
        8163 
        -
        8164 VmaBlockMetadata_Generic::VmaBlockMetadata_Generic(VmaAllocator hAllocator) :
        -
        8165  VmaBlockMetadata(hAllocator),
        -
        8166  m_FreeCount(0),
        -
        8167  m_SumFreeSize(0),
        -
        8168  m_Suballocations(VmaStlAllocator<VmaSuballocation>(hAllocator->GetAllocationCallbacks())),
        -
        8169  m_FreeSuballocationsBySize(VmaStlAllocator<VmaSuballocationList::iterator>(hAllocator->GetAllocationCallbacks()))
        -
        8170 {
        -
        8171 }
        -
        8172 
        -
        8173 VmaBlockMetadata_Generic::~VmaBlockMetadata_Generic()
        -
        8174 {
        +
        8105 void VmaAllocation_T::BlockAllocUnmap()
        +
        8106 {
        +
        8107  VMA_ASSERT(GetType() == ALLOCATION_TYPE_BLOCK);
        +
        8108 
        +
        8109  if((m_MapCount & ~MAP_COUNT_FLAG_PERSISTENT_MAP) != 0)
        +
        8110  {
        +
        8111  --m_MapCount;
        +
        8112  }
        +
        8113  else
        +
        8114  {
        +
        8115  VMA_ASSERT(0 && "Unmapping allocation not previously mapped.");
        +
        8116  }
        +
        8117 }
        +
        8118 
        +
        8119 VkResult VmaAllocation_T::DedicatedAllocMap(VmaAllocator hAllocator, void** ppData)
        +
        8120 {
        +
        8121  VMA_ASSERT(GetType() == ALLOCATION_TYPE_DEDICATED);
        +
        8122 
        +
        8123  if(m_MapCount != 0)
        +
        8124  {
        +
        8125  if((m_MapCount & ~MAP_COUNT_FLAG_PERSISTENT_MAP) < 0x7F)
        +
        8126  {
        +
        8127  VMA_ASSERT(m_DedicatedAllocation.m_pMappedData != VMA_NULL);
        +
        8128  *ppData = m_DedicatedAllocation.m_pMappedData;
        +
        8129  ++m_MapCount;
        +
        8130  return VK_SUCCESS;
        +
        8131  }
        +
        8132  else
        +
        8133  {
        +
        8134  VMA_ASSERT(0 && "Dedicated allocation mapped too many times simultaneously.");
        +
        8135  return VK_ERROR_MEMORY_MAP_FAILED;
        +
        8136  }
        +
        8137  }
        +
        8138  else
        +
        8139  {
        +
        8140  VkResult result = (*hAllocator->GetVulkanFunctions().vkMapMemory)(
        +
        8141  hAllocator->m_hDevice,
        +
        8142  m_DedicatedAllocation.m_hMemory,
        +
        8143  0, // offset
        +
        8144  VK_WHOLE_SIZE,
        +
        8145  0, // flags
        +
        8146  ppData);
        +
        8147  if(result == VK_SUCCESS)
        +
        8148  {
        +
        8149  m_DedicatedAllocation.m_pMappedData = *ppData;
        +
        8150  m_MapCount = 1;
        +
        8151  }
        +
        8152  return result;
        +
        8153  }
        +
        8154 }
        +
        8155 
        +
        8156 void VmaAllocation_T::DedicatedAllocUnmap(VmaAllocator hAllocator)
        +
        8157 {
        +
        8158  VMA_ASSERT(GetType() == ALLOCATION_TYPE_DEDICATED);
        +
        8159 
        +
        8160  if((m_MapCount & ~MAP_COUNT_FLAG_PERSISTENT_MAP) != 0)
        +
        8161  {
        +
        8162  --m_MapCount;
        +
        8163  if(m_MapCount == 0)
        +
        8164  {
        +
        8165  m_DedicatedAllocation.m_pMappedData = VMA_NULL;
        +
        8166  (*hAllocator->GetVulkanFunctions().vkUnmapMemory)(
        +
        8167  hAllocator->m_hDevice,
        +
        8168  m_DedicatedAllocation.m_hMemory);
        +
        8169  }
        +
        8170  }
        +
        8171  else
        +
        8172  {
        +
        8173  VMA_ASSERT(0 && "Unmapping dedicated allocation not previously mapped.");
        +
        8174  }
        8175 }
        8176 
        -
        8177 void VmaBlockMetadata_Generic::Init(VkDeviceSize size)
        -
        8178 {
        -
        8179  VmaBlockMetadata::Init(size);
        -
        8180 
        -
        8181  m_FreeCount = 1;
        -
        8182  m_SumFreeSize = size;
        -
        8183 
        -
        8184  VmaSuballocation suballoc = {};
        -
        8185  suballoc.offset = 0;
        -
        8186  suballoc.size = size;
        -
        8187  suballoc.type = VMA_SUBALLOCATION_TYPE_FREE;
        -
        8188  suballoc.hAllocation = VK_NULL_HANDLE;
        -
        8189 
        -
        8190  VMA_ASSERT(size > VMA_MIN_FREE_SUBALLOCATION_SIZE_TO_REGISTER);
        -
        8191  m_Suballocations.push_back(suballoc);
        -
        8192  VmaSuballocationList::iterator suballocItem = m_Suballocations.end();
        -
        8193  --suballocItem;
        -
        8194  m_FreeSuballocationsBySize.push_back(suballocItem);
        -
        8195 }
        -
        8196 
        -
        8197 bool VmaBlockMetadata_Generic::Validate() const
        -
        8198 {
        -
        8199  VMA_VALIDATE(!m_Suballocations.empty());
        -
        8200 
        -
        8201  // Expected offset of new suballocation as calculated from previous ones.
        -
        8202  VkDeviceSize calculatedOffset = 0;
        -
        8203  // Expected number of free suballocations as calculated from traversing their list.
        -
        8204  uint32_t calculatedFreeCount = 0;
        -
        8205  // Expected sum size of free suballocations as calculated from traversing their list.
        -
        8206  VkDeviceSize calculatedSumFreeSize = 0;
        -
        8207  // Expected number of free suballocations that should be registered in
        -
        8208  // m_FreeSuballocationsBySize calculated from traversing their list.
        -
        8209  size_t freeSuballocationsToRegister = 0;
        -
        8210  // True if previous visited suballocation was free.
        -
        8211  bool prevFree = false;
        -
        8212 
        -
        8213  for(VmaSuballocationList::const_iterator suballocItem = m_Suballocations.cbegin();
        -
        8214  suballocItem != m_Suballocations.cend();
        -
        8215  ++suballocItem)
        -
        8216  {
        -
        8217  const VmaSuballocation& subAlloc = *suballocItem;
        -
        8218 
        -
        8219  // Actual offset of this suballocation doesn't match expected one.
        -
        8220  VMA_VALIDATE(subAlloc.offset == calculatedOffset);
        -
        8221 
        -
        8222  const bool currFree = (subAlloc.type == VMA_SUBALLOCATION_TYPE_FREE);
        -
        8223  // Two adjacent free suballocations are invalid. They should be merged.
        -
        8224  VMA_VALIDATE(!prevFree || !currFree);
        -
        8225 
        -
        8226  VMA_VALIDATE(currFree == (subAlloc.hAllocation == VK_NULL_HANDLE));
        -
        8227 
        -
        8228  if(currFree)
        -
        8229  {
        -
        8230  calculatedSumFreeSize += subAlloc.size;
        -
        8231  ++calculatedFreeCount;
        -
        8232  if(subAlloc.size >= VMA_MIN_FREE_SUBALLOCATION_SIZE_TO_REGISTER)
        -
        8233  {
        -
        8234  ++freeSuballocationsToRegister;
        -
        8235  }
        -
        8236 
        -
        8237  // Margin required between allocations - every free space must be at least that large.
        -
        8238  VMA_VALIDATE(subAlloc.size >= VMA_DEBUG_MARGIN);
        -
        8239  }
        -
        8240  else
        -
        8241  {
        -
        8242  VMA_VALIDATE(subAlloc.hAllocation->GetOffset() == subAlloc.offset);
        -
        8243  VMA_VALIDATE(subAlloc.hAllocation->GetSize() == subAlloc.size);
        +
        8177 #if VMA_STATS_STRING_ENABLED
        +
        8178 
        +
        8179 static void VmaPrintStatInfo(VmaJsonWriter& json, const VmaStatInfo& stat)
        +
        8180 {
        +
        8181  json.BeginObject();
        +
        8182 
        +
        8183  json.WriteString("Blocks");
        +
        8184  json.WriteNumber(stat.blockCount);
        +
        8185 
        +
        8186  json.WriteString("Allocations");
        +
        8187  json.WriteNumber(stat.allocationCount);
        +
        8188 
        +
        8189  json.WriteString("UnusedRanges");
        +
        8190  json.WriteNumber(stat.unusedRangeCount);
        +
        8191 
        +
        8192  json.WriteString("UsedBytes");
        +
        8193  json.WriteNumber(stat.usedBytes);
        +
        8194 
        +
        8195  json.WriteString("UnusedBytes");
        +
        8196  json.WriteNumber(stat.unusedBytes);
        +
        8197 
        +
        8198  if(stat.allocationCount > 1)
        +
        8199  {
        +
        8200  json.WriteString("AllocationSize");
        +
        8201  json.BeginObject(true);
        +
        8202  json.WriteString("Min");
        +
        8203  json.WriteNumber(stat.allocationSizeMin);
        +
        8204  json.WriteString("Avg");
        +
        8205  json.WriteNumber(stat.allocationSizeAvg);
        +
        8206  json.WriteString("Max");
        +
        8207  json.WriteNumber(stat.allocationSizeMax);
        +
        8208  json.EndObject();
        +
        8209  }
        +
        8210 
        +
        8211  if(stat.unusedRangeCount > 1)
        +
        8212  {
        +
        8213  json.WriteString("UnusedRangeSize");
        +
        8214  json.BeginObject(true);
        +
        8215  json.WriteString("Min");
        +
        8216  json.WriteNumber(stat.unusedRangeSizeMin);
        +
        8217  json.WriteString("Avg");
        +
        8218  json.WriteNumber(stat.unusedRangeSizeAvg);
        +
        8219  json.WriteString("Max");
        +
        8220  json.WriteNumber(stat.unusedRangeSizeMax);
        +
        8221  json.EndObject();
        +
        8222  }
        +
        8223 
        +
        8224  json.EndObject();
        +
        8225 }
        +
        8226 
        +
        8227 #endif // #if VMA_STATS_STRING_ENABLED
        +
        8228 
        +
        8229 struct VmaSuballocationItemSizeLess
        +
        8230 {
        +
        8231  bool operator()(
        +
        8232  const VmaSuballocationList::iterator lhs,
        +
        8233  const VmaSuballocationList::iterator rhs) const
        +
        8234  {
        +
        8235  return lhs->size < rhs->size;
        +
        8236  }
        +
        8237  bool operator()(
        +
        8238  const VmaSuballocationList::iterator lhs,
        +
        8239  VkDeviceSize rhsSize) const
        +
        8240  {
        +
        8241  return lhs->size < rhsSize;
        +
        8242  }
        +
        8243 };
        8244 
        -
        8245  // Margin required between allocations - previous allocation must be free.
        -
        8246  VMA_VALIDATE(VMA_DEBUG_MARGIN == 0 || prevFree);
        -
        8247  }
        +
        8245 
        +
        8247 // class VmaBlockMetadata
        8248 
        -
        8249  calculatedOffset += subAlloc.size;
        -
        8250  prevFree = currFree;
        -
        8251  }
        -
        8252 
        -
        8253  // Number of free suballocations registered in m_FreeSuballocationsBySize doesn't
        -
        8254  // match expected one.
        -
        8255  VMA_VALIDATE(m_FreeSuballocationsBySize.size() == freeSuballocationsToRegister);
        +
        8249 VmaBlockMetadata::VmaBlockMetadata(VmaAllocator hAllocator) :
        +
        8250  m_Size(0),
        +
        8251  m_pAllocationCallbacks(hAllocator->GetAllocationCallbacks())
        +
        8252 {
        +
        8253 }
        +
        8254 
        +
        8255 #if VMA_STATS_STRING_ENABLED
        8256 
        -
        8257  VkDeviceSize lastSize = 0;
        -
        8258  for(size_t i = 0; i < m_FreeSuballocationsBySize.size(); ++i)
        -
        8259  {
        -
        8260  VmaSuballocationList::iterator suballocItem = m_FreeSuballocationsBySize[i];
        -
        8261 
        -
        8262  // Only free suballocations can be registered in m_FreeSuballocationsBySize.
        -
        8263  VMA_VALIDATE(suballocItem->type == VMA_SUBALLOCATION_TYPE_FREE);
        -
        8264  // They must be sorted by size ascending.
        -
        8265  VMA_VALIDATE(suballocItem->size >= lastSize);
        +
        8257 void VmaBlockMetadata::PrintDetailedMap_Begin(class VmaJsonWriter& json,
        +
        8258  VkDeviceSize unusedBytes,
        +
        8259  size_t allocationCount,
        +
        8260  size_t unusedRangeCount) const
        +
        8261 {
        +
        8262  json.BeginObject();
        +
        8263 
        +
        8264  json.WriteString("TotalBytes");
        +
        8265  json.WriteNumber(GetSize());
        8266 
        -
        8267  lastSize = suballocItem->size;
        -
        8268  }
        +
        8267  json.WriteString("UnusedBytes");
        +
        8268  json.WriteNumber(unusedBytes);
        8269 
        -
        8270  // Check if totals match calculacted values.
        -
        8271  VMA_VALIDATE(ValidateFreeSuballocationList());
        -
        8272  VMA_VALIDATE(calculatedOffset == GetSize());
        -
        8273  VMA_VALIDATE(calculatedSumFreeSize == m_SumFreeSize);
        -
        8274  VMA_VALIDATE(calculatedFreeCount == m_FreeCount);
        +
        8270  json.WriteString("Allocations");
        +
        8271  json.WriteNumber((uint64_t)allocationCount);
        +
        8272 
        +
        8273  json.WriteString("UnusedRanges");
        +
        8274  json.WriteNumber((uint64_t)unusedRangeCount);
        8275 
        -
        8276  return true;
        -
        8277 }
        -
        8278 
        -
        8279 VkDeviceSize VmaBlockMetadata_Generic::GetUnusedRangeSizeMax() const
        -
        8280 {
        -
        8281  if(!m_FreeSuballocationsBySize.empty())
        -
        8282  {
        -
        8283  return m_FreeSuballocationsBySize.back()->size;
        -
        8284  }
        -
        8285  else
        -
        8286  {
        -
        8287  return 0;
        -
        8288  }
        -
        8289 }
        +
        8276  json.WriteString("Suballocations");
        +
        8277  json.BeginArray();
        +
        8278 }
        +
        8279 
        +
        8280 void VmaBlockMetadata::PrintDetailedMap_Allocation(class VmaJsonWriter& json,
        +
        8281  VkDeviceSize offset,
        +
        8282  VmaAllocation hAllocation) const
        +
        8283 {
        +
        8284  json.BeginObject(true);
        +
        8285 
        +
        8286  json.WriteString("Offset");
        +
        8287  json.WriteNumber(offset);
        +
        8288 
        +
        8289  hAllocation->PrintParameters(json);
        8290 
        -
        8291 bool VmaBlockMetadata_Generic::IsEmpty() const
        -
        8292 {
        -
        8293  return (m_Suballocations.size() == 1) && (m_FreeCount == 1);
        -
        8294 }
        -
        8295 
        -
        8296 void VmaBlockMetadata_Generic::CalcAllocationStatInfo(VmaStatInfo& outInfo) const
        +
        8291  json.EndObject();
        +
        8292 }
        +
        8293 
        +
        8294 void VmaBlockMetadata::PrintDetailedMap_UnusedRange(class VmaJsonWriter& json,
        +
        8295  VkDeviceSize offset,
        +
        8296  VkDeviceSize size) const
        8297 {
        -
        8298  outInfo.blockCount = 1;
        -
        8299 
        -
        8300  const uint32_t rangeCount = (uint32_t)m_Suballocations.size();
        -
        8301  outInfo.allocationCount = rangeCount - m_FreeCount;
        -
        8302  outInfo.unusedRangeCount = m_FreeCount;
        -
        8303 
        -
        8304  outInfo.unusedBytes = m_SumFreeSize;
        -
        8305  outInfo.usedBytes = GetSize() - outInfo.unusedBytes;
        -
        8306 
        -
        8307  outInfo.allocationSizeMin = UINT64_MAX;
        -
        8308  outInfo.allocationSizeMax = 0;
        -
        8309  outInfo.unusedRangeSizeMin = UINT64_MAX;
        -
        8310  outInfo.unusedRangeSizeMax = 0;
        +
        8298  json.BeginObject(true);
        +
        8299 
        +
        8300  json.WriteString("Offset");
        +
        8301  json.WriteNumber(offset);
        +
        8302 
        +
        8303  json.WriteString("Type");
        +
        8304  json.WriteString(VMA_SUBALLOCATION_TYPE_NAMES[VMA_SUBALLOCATION_TYPE_FREE]);
        +
        8305 
        +
        8306  json.WriteString("Size");
        +
        8307  json.WriteNumber(size);
        +
        8308 
        +
        8309  json.EndObject();
        +
        8310 }
        8311 
        -
        8312  for(VmaSuballocationList::const_iterator suballocItem = m_Suballocations.cbegin();
        -
        8313  suballocItem != m_Suballocations.cend();
        -
        8314  ++suballocItem)
        -
        8315  {
        -
        8316  const VmaSuballocation& suballoc = *suballocItem;
        -
        8317  if(suballoc.type != VMA_SUBALLOCATION_TYPE_FREE)
        -
        8318  {
        -
        8319  outInfo.allocationSizeMin = VMA_MIN(outInfo.allocationSizeMin, suballoc.size);
        -
        8320  outInfo.allocationSizeMax = VMA_MAX(outInfo.allocationSizeMax, suballoc.size);
        -
        8321  }
        -
        8322  else
        -
        8323  {
        -
        8324  outInfo.unusedRangeSizeMin = VMA_MIN(outInfo.unusedRangeSizeMin, suballoc.size);
        -
        8325  outInfo.unusedRangeSizeMax = VMA_MAX(outInfo.unusedRangeSizeMax, suballoc.size);
        -
        8326  }
        -
        8327  }
        -
        8328 }
        -
        8329 
        -
        8330 void VmaBlockMetadata_Generic::AddPoolStats(VmaPoolStats& inoutStats) const
        -
        8331 {
        -
        8332  const uint32_t rangeCount = (uint32_t)m_Suballocations.size();
        -
        8333 
        -
        8334  inoutStats.size += GetSize();
        -
        8335  inoutStats.unusedSize += m_SumFreeSize;
        -
        8336  inoutStats.allocationCount += rangeCount - m_FreeCount;
        -
        8337  inoutStats.unusedRangeCount += m_FreeCount;
        -
        8338  inoutStats.unusedRangeSizeMax = VMA_MAX(inoutStats.unusedRangeSizeMax, GetUnusedRangeSizeMax());
        -
        8339 }
        -
        8340 
        -
        8341 #if VMA_STATS_STRING_ENABLED
        +
        8312 void VmaBlockMetadata::PrintDetailedMap_End(class VmaJsonWriter& json) const
        +
        8313 {
        +
        8314  json.EndArray();
        +
        8315  json.EndObject();
        +
        8316 }
        +
        8317 
        +
        8318 #endif // #if VMA_STATS_STRING_ENABLED
        +
        8319 
        +
        8321 // class VmaBlockMetadata_Generic
        +
        8322 
        +
        8323 VmaBlockMetadata_Generic::VmaBlockMetadata_Generic(VmaAllocator hAllocator) :
        +
        8324  VmaBlockMetadata(hAllocator),
        +
        8325  m_FreeCount(0),
        +
        8326  m_SumFreeSize(0),
        +
        8327  m_Suballocations(VmaStlAllocator<VmaSuballocation>(hAllocator->GetAllocationCallbacks())),
        +
        8328  m_FreeSuballocationsBySize(VmaStlAllocator<VmaSuballocationList::iterator>(hAllocator->GetAllocationCallbacks()))
        +
        8329 {
        +
        8330 }
        +
        8331 
        +
        8332 VmaBlockMetadata_Generic::~VmaBlockMetadata_Generic()
        +
        8333 {
        +
        8334 }
        +
        8335 
        +
        8336 void VmaBlockMetadata_Generic::Init(VkDeviceSize size)
        +
        8337 {
        +
        8338  VmaBlockMetadata::Init(size);
        +
        8339 
        +
        8340  m_FreeCount = 1;
        +
        8341  m_SumFreeSize = size;
        8342 
        -
        8343 void VmaBlockMetadata_Generic::PrintDetailedMap(class VmaJsonWriter& json) const
        -
        8344 {
        -
        8345  PrintDetailedMap_Begin(json,
        -
        8346  m_SumFreeSize, // unusedBytes
        -
        8347  m_Suballocations.size() - (size_t)m_FreeCount, // allocationCount
        -
        8348  m_FreeCount); // unusedRangeCount
        -
        8349 
        -
        8350  size_t i = 0;
        -
        8351  for(VmaSuballocationList::const_iterator suballocItem = m_Suballocations.cbegin();
        -
        8352  suballocItem != m_Suballocations.cend();
        -
        8353  ++suballocItem, ++i)
        -
        8354  {
        -
        8355  if(suballocItem->type == VMA_SUBALLOCATION_TYPE_FREE)
        -
        8356  {
        -
        8357  PrintDetailedMap_UnusedRange(json, suballocItem->offset, suballocItem->size);
        -
        8358  }
        -
        8359  else
        -
        8360  {
        -
        8361  PrintDetailedMap_Allocation(json, suballocItem->offset, suballocItem->hAllocation);
        -
        8362  }
        -
        8363  }
        -
        8364 
        -
        8365  PrintDetailedMap_End(json);
        -
        8366 }
        -
        8367 
        -
        8368 #endif // #if VMA_STATS_STRING_ENABLED
        -
        8369 
        -
        8370 bool VmaBlockMetadata_Generic::CreateAllocationRequest(
        -
        8371  uint32_t currentFrameIndex,
        -
        8372  uint32_t frameInUseCount,
        -
        8373  VkDeviceSize bufferImageGranularity,
        -
        8374  VkDeviceSize allocSize,
        -
        8375  VkDeviceSize allocAlignment,
        -
        8376  bool upperAddress,
        -
        8377  VmaSuballocationType allocType,
        -
        8378  bool canMakeOtherLost,
        -
        8379  uint32_t strategy,
        -
        8380  VmaAllocationRequest* pAllocationRequest)
        -
        8381 {
        -
        8382  VMA_ASSERT(allocSize > 0);
        -
        8383  VMA_ASSERT(!upperAddress);
        -
        8384  VMA_ASSERT(allocType != VMA_SUBALLOCATION_TYPE_FREE);
        -
        8385  VMA_ASSERT(pAllocationRequest != VMA_NULL);
        -
        8386  VMA_HEAVY_ASSERT(Validate());
        -
        8387 
        -
        8388  pAllocationRequest->type = VmaAllocationRequestType::Normal;
        -
        8389 
        -
        8390  // There is not enough total free space in this block to fullfill the request: Early return.
        -
        8391  if(canMakeOtherLost == false &&
        -
        8392  m_SumFreeSize < allocSize + 2 * VMA_DEBUG_MARGIN)
        -
        8393  {
        -
        8394  return false;
        -
        8395  }
        -
        8396 
        -
        8397  // New algorithm, efficiently searching freeSuballocationsBySize.
        -
        8398  const size_t freeSuballocCount = m_FreeSuballocationsBySize.size();
        -
        8399  if(freeSuballocCount > 0)
        -
        8400  {
        -
        8401  if(strategy == VMA_ALLOCATION_CREATE_STRATEGY_BEST_FIT_BIT)
        -
        8402  {
        -
        8403  // Find first free suballocation with size not less than allocSize + 2 * VMA_DEBUG_MARGIN.
        -
        8404  VmaSuballocationList::iterator* const it = VmaBinaryFindFirstNotLess(
        -
        8405  m_FreeSuballocationsBySize.data(),
        -
        8406  m_FreeSuballocationsBySize.data() + freeSuballocCount,
        -
        8407  allocSize + 2 * VMA_DEBUG_MARGIN,
        -
        8408  VmaSuballocationItemSizeLess());
        -
        8409  size_t index = it - m_FreeSuballocationsBySize.data();
        -
        8410  for(; index < freeSuballocCount; ++index)
        -
        8411  {
        -
        8412  if(CheckAllocation(
        -
        8413  currentFrameIndex,
        -
        8414  frameInUseCount,
        -
        8415  bufferImageGranularity,
        -
        8416  allocSize,
        -
        8417  allocAlignment,
        -
        8418  allocType,
        -
        8419  m_FreeSuballocationsBySize[index],
        -
        8420  false, // canMakeOtherLost
        -
        8421  &pAllocationRequest->offset,
        -
        8422  &pAllocationRequest->itemsToMakeLostCount,
        -
        8423  &pAllocationRequest->sumFreeSize,
        -
        8424  &pAllocationRequest->sumItemSize))
        -
        8425  {
        -
        8426  pAllocationRequest->item = m_FreeSuballocationsBySize[index];
        -
        8427  return true;
        -
        8428  }
        -
        8429  }
        -
        8430  }
        -
        8431  else if(strategy == VMA_ALLOCATION_INTERNAL_STRATEGY_MIN_OFFSET)
        -
        8432  {
        -
        8433  for(VmaSuballocationList::iterator it = m_Suballocations.begin();
        -
        8434  it != m_Suballocations.end();
        -
        8435  ++it)
        -
        8436  {
        -
        8437  if(it->type == VMA_SUBALLOCATION_TYPE_FREE && CheckAllocation(
        -
        8438  currentFrameIndex,
        -
        8439  frameInUseCount,
        -
        8440  bufferImageGranularity,
        -
        8441  allocSize,
        -
        8442  allocAlignment,
        -
        8443  allocType,
        -
        8444  it,
        -
        8445  false, // canMakeOtherLost
        -
        8446  &pAllocationRequest->offset,
        -
        8447  &pAllocationRequest->itemsToMakeLostCount,
        -
        8448  &pAllocationRequest->sumFreeSize,
        -
        8449  &pAllocationRequest->sumItemSize))
        -
        8450  {
        -
        8451  pAllocationRequest->item = it;
        -
        8452  return true;
        -
        8453  }
        -
        8454  }
        -
        8455  }
        -
        8456  else // WORST_FIT, FIRST_FIT
        -
        8457  {
        -
        8458  // Search staring from biggest suballocations.
        -
        8459  for(size_t index = freeSuballocCount; index--; )
        -
        8460  {
        -
        8461  if(CheckAllocation(
        -
        8462  currentFrameIndex,
        -
        8463  frameInUseCount,
        -
        8464  bufferImageGranularity,
        -
        8465  allocSize,
        -
        8466  allocAlignment,
        -
        8467  allocType,
        -
        8468  m_FreeSuballocationsBySize[index],
        -
        8469  false, // canMakeOtherLost
        -
        8470  &pAllocationRequest->offset,
        -
        8471  &pAllocationRequest->itemsToMakeLostCount,
        -
        8472  &pAllocationRequest->sumFreeSize,
        -
        8473  &pAllocationRequest->sumItemSize))
        -
        8474  {
        -
        8475  pAllocationRequest->item = m_FreeSuballocationsBySize[index];
        -
        8476  return true;
        -
        8477  }
        -
        8478  }
        -
        8479  }
        -
        8480  }
        -
        8481 
        -
        8482  if(canMakeOtherLost)
        -
        8483  {
        -
        8484  // Brute-force algorithm. TODO: Come up with something better.
        -
        8485 
        -
        8486  bool found = false;
        -
        8487  VmaAllocationRequest tmpAllocRequest = {};
        -
        8488  tmpAllocRequest.type = VmaAllocationRequestType::Normal;
        -
        8489  for(VmaSuballocationList::iterator suballocIt = m_Suballocations.begin();
        -
        8490  suballocIt != m_Suballocations.end();
        -
        8491  ++suballocIt)
        -
        8492  {
        -
        8493  if(suballocIt->type == VMA_SUBALLOCATION_TYPE_FREE ||
        -
        8494  suballocIt->hAllocation->CanBecomeLost())
        -
        8495  {
        -
        8496  if(CheckAllocation(
        -
        8497  currentFrameIndex,
        -
        8498  frameInUseCount,
        -
        8499  bufferImageGranularity,
        -
        8500  allocSize,
        -
        8501  allocAlignment,
        -
        8502  allocType,
        -
        8503  suballocIt,
        -
        8504  canMakeOtherLost,
        -
        8505  &tmpAllocRequest.offset,
        -
        8506  &tmpAllocRequest.itemsToMakeLostCount,
        -
        8507  &tmpAllocRequest.sumFreeSize,
        -
        8508  &tmpAllocRequest.sumItemSize))
        -
        8509  {
        -
        8510  if(strategy == VMA_ALLOCATION_CREATE_STRATEGY_FIRST_FIT_BIT)
        -
        8511  {
        -
        8512  *pAllocationRequest = tmpAllocRequest;
        -
        8513  pAllocationRequest->item = suballocIt;
        -
        8514  break;
        -
        8515  }
        -
        8516  if(!found || tmpAllocRequest.CalcCost() < pAllocationRequest->CalcCost())
        -
        8517  {
        -
        8518  *pAllocationRequest = tmpAllocRequest;
        -
        8519  pAllocationRequest->item = suballocIt;
        -
        8520  found = true;
        -
        8521  }
        -
        8522  }
        -
        8523  }
        -
        8524  }
        -
        8525 
        -
        8526  return found;
        -
        8527  }
        +
        8343  VmaSuballocation suballoc = {};
        +
        8344  suballoc.offset = 0;
        +
        8345  suballoc.size = size;
        +
        8346  suballoc.type = VMA_SUBALLOCATION_TYPE_FREE;
        +
        8347  suballoc.hAllocation = VK_NULL_HANDLE;
        +
        8348 
        +
        8349  VMA_ASSERT(size > VMA_MIN_FREE_SUBALLOCATION_SIZE_TO_REGISTER);
        +
        8350  m_Suballocations.push_back(suballoc);
        +
        8351  VmaSuballocationList::iterator suballocItem = m_Suballocations.end();
        +
        8352  --suballocItem;
        +
        8353  m_FreeSuballocationsBySize.push_back(suballocItem);
        +
        8354 }
        +
        8355 
        +
        8356 bool VmaBlockMetadata_Generic::Validate() const
        +
        8357 {
        +
        8358  VMA_VALIDATE(!m_Suballocations.empty());
        +
        8359 
        +
        8360  // Expected offset of new suballocation as calculated from previous ones.
        +
        8361  VkDeviceSize calculatedOffset = 0;
        +
        8362  // Expected number of free suballocations as calculated from traversing their list.
        +
        8363  uint32_t calculatedFreeCount = 0;
        +
        8364  // Expected sum size of free suballocations as calculated from traversing their list.
        +
        8365  VkDeviceSize calculatedSumFreeSize = 0;
        +
        8366  // Expected number of free suballocations that should be registered in
        +
        8367  // m_FreeSuballocationsBySize calculated from traversing their list.
        +
        8368  size_t freeSuballocationsToRegister = 0;
        +
        8369  // True if previous visited suballocation was free.
        +
        8370  bool prevFree = false;
        +
        8371 
        +
        8372  for(VmaSuballocationList::const_iterator suballocItem = m_Suballocations.cbegin();
        +
        8373  suballocItem != m_Suballocations.cend();
        +
        8374  ++suballocItem)
        +
        8375  {
        +
        8376  const VmaSuballocation& subAlloc = *suballocItem;
        +
        8377 
        +
        8378  // Actual offset of this suballocation doesn't match expected one.
        +
        8379  VMA_VALIDATE(subAlloc.offset == calculatedOffset);
        +
        8380 
        +
        8381  const bool currFree = (subAlloc.type == VMA_SUBALLOCATION_TYPE_FREE);
        +
        8382  // Two adjacent free suballocations are invalid. They should be merged.
        +
        8383  VMA_VALIDATE(!prevFree || !currFree);
        +
        8384 
        +
        8385  VMA_VALIDATE(currFree == (subAlloc.hAllocation == VK_NULL_HANDLE));
        +
        8386 
        +
        8387  if(currFree)
        +
        8388  {
        +
        8389  calculatedSumFreeSize += subAlloc.size;
        +
        8390  ++calculatedFreeCount;
        +
        8391  if(subAlloc.size >= VMA_MIN_FREE_SUBALLOCATION_SIZE_TO_REGISTER)
        +
        8392  {
        +
        8393  ++freeSuballocationsToRegister;
        +
        8394  }
        +
        8395 
        +
        8396  // Margin required between allocations - every free space must be at least that large.
        +
        8397  VMA_VALIDATE(subAlloc.size >= VMA_DEBUG_MARGIN);
        +
        8398  }
        +
        8399  else
        +
        8400  {
        +
        8401  VMA_VALIDATE(subAlloc.hAllocation->GetOffset() == subAlloc.offset);
        +
        8402  VMA_VALIDATE(subAlloc.hAllocation->GetSize() == subAlloc.size);
        +
        8403 
        +
        8404  // Margin required between allocations - previous allocation must be free.
        +
        8405  VMA_VALIDATE(VMA_DEBUG_MARGIN == 0 || prevFree);
        +
        8406  }
        +
        8407 
        +
        8408  calculatedOffset += subAlloc.size;
        +
        8409  prevFree = currFree;
        +
        8410  }
        +
        8411 
        +
        8412  // Number of free suballocations registered in m_FreeSuballocationsBySize doesn't
        +
        8413  // match expected one.
        +
        8414  VMA_VALIDATE(m_FreeSuballocationsBySize.size() == freeSuballocationsToRegister);
        +
        8415 
        +
        8416  VkDeviceSize lastSize = 0;
        +
        8417  for(size_t i = 0; i < m_FreeSuballocationsBySize.size(); ++i)
        +
        8418  {
        +
        8419  VmaSuballocationList::iterator suballocItem = m_FreeSuballocationsBySize[i];
        +
        8420 
        +
        8421  // Only free suballocations can be registered in m_FreeSuballocationsBySize.
        +
        8422  VMA_VALIDATE(suballocItem->type == VMA_SUBALLOCATION_TYPE_FREE);
        +
        8423  // They must be sorted by size ascending.
        +
        8424  VMA_VALIDATE(suballocItem->size >= lastSize);
        +
        8425 
        +
        8426  lastSize = suballocItem->size;
        +
        8427  }
        +
        8428 
        +
        8429  // Check if totals match calculacted values.
        +
        8430  VMA_VALIDATE(ValidateFreeSuballocationList());
        +
        8431  VMA_VALIDATE(calculatedOffset == GetSize());
        +
        8432  VMA_VALIDATE(calculatedSumFreeSize == m_SumFreeSize);
        +
        8433  VMA_VALIDATE(calculatedFreeCount == m_FreeCount);
        +
        8434 
        +
        8435  return true;
        +
        8436 }
        +
        8437 
        +
        8438 VkDeviceSize VmaBlockMetadata_Generic::GetUnusedRangeSizeMax() const
        +
        8439 {
        +
        8440  if(!m_FreeSuballocationsBySize.empty())
        +
        8441  {
        +
        8442  return m_FreeSuballocationsBySize.back()->size;
        +
        8443  }
        +
        8444  else
        +
        8445  {
        +
        8446  return 0;
        +
        8447  }
        +
        8448 }
        +
        8449 
        +
        8450 bool VmaBlockMetadata_Generic::IsEmpty() const
        +
        8451 {
        +
        8452  return (m_Suballocations.size() == 1) && (m_FreeCount == 1);
        +
        8453 }
        +
        8454 
        +
        8455 void VmaBlockMetadata_Generic::CalcAllocationStatInfo(VmaStatInfo& outInfo) const
        +
        8456 {
        +
        8457  outInfo.blockCount = 1;
        +
        8458 
        +
        8459  const uint32_t rangeCount = (uint32_t)m_Suballocations.size();
        +
        8460  outInfo.allocationCount = rangeCount - m_FreeCount;
        +
        8461  outInfo.unusedRangeCount = m_FreeCount;
        +
        8462 
        +
        8463  outInfo.unusedBytes = m_SumFreeSize;
        +
        8464  outInfo.usedBytes = GetSize() - outInfo.unusedBytes;
        +
        8465 
        +
        8466  outInfo.allocationSizeMin = UINT64_MAX;
        +
        8467  outInfo.allocationSizeMax = 0;
        +
        8468  outInfo.unusedRangeSizeMin = UINT64_MAX;
        +
        8469  outInfo.unusedRangeSizeMax = 0;
        +
        8470 
        +
        8471  for(VmaSuballocationList::const_iterator suballocItem = m_Suballocations.cbegin();
        +
        8472  suballocItem != m_Suballocations.cend();
        +
        8473  ++suballocItem)
        +
        8474  {
        +
        8475  const VmaSuballocation& suballoc = *suballocItem;
        +
        8476  if(suballoc.type != VMA_SUBALLOCATION_TYPE_FREE)
        +
        8477  {
        +
        8478  outInfo.allocationSizeMin = VMA_MIN(outInfo.allocationSizeMin, suballoc.size);
        +
        8479  outInfo.allocationSizeMax = VMA_MAX(outInfo.allocationSizeMax, suballoc.size);
        +
        8480  }
        +
        8481  else
        +
        8482  {
        +
        8483  outInfo.unusedRangeSizeMin = VMA_MIN(outInfo.unusedRangeSizeMin, suballoc.size);
        +
        8484  outInfo.unusedRangeSizeMax = VMA_MAX(outInfo.unusedRangeSizeMax, suballoc.size);
        +
        8485  }
        +
        8486  }
        +
        8487 }
        +
        8488 
        +
        8489 void VmaBlockMetadata_Generic::AddPoolStats(VmaPoolStats& inoutStats) const
        +
        8490 {
        +
        8491  const uint32_t rangeCount = (uint32_t)m_Suballocations.size();
        +
        8492 
        +
        8493  inoutStats.size += GetSize();
        +
        8494  inoutStats.unusedSize += m_SumFreeSize;
        +
        8495  inoutStats.allocationCount += rangeCount - m_FreeCount;
        +
        8496  inoutStats.unusedRangeCount += m_FreeCount;
        +
        8497  inoutStats.unusedRangeSizeMax = VMA_MAX(inoutStats.unusedRangeSizeMax, GetUnusedRangeSizeMax());
        +
        8498 }
        +
        8499 
        +
        8500 #if VMA_STATS_STRING_ENABLED
        +
        8501 
        +
        8502 void VmaBlockMetadata_Generic::PrintDetailedMap(class VmaJsonWriter& json) const
        +
        8503 {
        +
        8504  PrintDetailedMap_Begin(json,
        +
        8505  m_SumFreeSize, // unusedBytes
        +
        8506  m_Suballocations.size() - (size_t)m_FreeCount, // allocationCount
        +
        8507  m_FreeCount); // unusedRangeCount
        +
        8508 
        +
        8509  size_t i = 0;
        +
        8510  for(VmaSuballocationList::const_iterator suballocItem = m_Suballocations.cbegin();
        +
        8511  suballocItem != m_Suballocations.cend();
        +
        8512  ++suballocItem, ++i)
        +
        8513  {
        +
        8514  if(suballocItem->type == VMA_SUBALLOCATION_TYPE_FREE)
        +
        8515  {
        +
        8516  PrintDetailedMap_UnusedRange(json, suballocItem->offset, suballocItem->size);
        +
        8517  }
        +
        8518  else
        +
        8519  {
        +
        8520  PrintDetailedMap_Allocation(json, suballocItem->offset, suballocItem->hAllocation);
        +
        8521  }
        +
        8522  }
        +
        8523 
        +
        8524  PrintDetailedMap_End(json);
        +
        8525 }
        +
        8526 
        +
        8527 #endif // #if VMA_STATS_STRING_ENABLED
        8528 
        -
        8529  return false;
        -
        8530 }
        -
        8531 
        -
        8532 bool VmaBlockMetadata_Generic::MakeRequestedAllocationsLost(
        -
        8533  uint32_t currentFrameIndex,
        -
        8534  uint32_t frameInUseCount,
        -
        8535  VmaAllocationRequest* pAllocationRequest)
        -
        8536 {
        -
        8537  VMA_ASSERT(pAllocationRequest && pAllocationRequest->type == VmaAllocationRequestType::Normal);
        -
        8538 
        -
        8539  while(pAllocationRequest->itemsToMakeLostCount > 0)
        -
        8540  {
        -
        8541  if(pAllocationRequest->item->type == VMA_SUBALLOCATION_TYPE_FREE)
        -
        8542  {
        -
        8543  ++pAllocationRequest->item;
        -
        8544  }
        -
        8545  VMA_ASSERT(pAllocationRequest->item != m_Suballocations.end());
        -
        8546  VMA_ASSERT(pAllocationRequest->item->hAllocation != VK_NULL_HANDLE);
        -
        8547  VMA_ASSERT(pAllocationRequest->item->hAllocation->CanBecomeLost());
        -
        8548  if(pAllocationRequest->item->hAllocation->MakeLost(currentFrameIndex, frameInUseCount))
        -
        8549  {
        -
        8550  pAllocationRequest->item = FreeSuballocation(pAllocationRequest->item);
        -
        8551  --pAllocationRequest->itemsToMakeLostCount;
        -
        8552  }
        -
        8553  else
        -
        8554  {
        -
        8555  return false;
        -
        8556  }
        -
        8557  }
        -
        8558 
        -
        8559  VMA_HEAVY_ASSERT(Validate());
        -
        8560  VMA_ASSERT(pAllocationRequest->item != m_Suballocations.end());
        -
        8561  VMA_ASSERT(pAllocationRequest->item->type == VMA_SUBALLOCATION_TYPE_FREE);
        -
        8562 
        -
        8563  return true;
        -
        8564 }
        -
        8565 
        -
        8566 uint32_t VmaBlockMetadata_Generic::MakeAllocationsLost(uint32_t currentFrameIndex, uint32_t frameInUseCount)
        -
        8567 {
        -
        8568  uint32_t lostAllocationCount = 0;
        -
        8569  for(VmaSuballocationList::iterator it = m_Suballocations.begin();
        -
        8570  it != m_Suballocations.end();
        -
        8571  ++it)
        -
        8572  {
        -
        8573  if(it->type != VMA_SUBALLOCATION_TYPE_FREE &&
        -
        8574  it->hAllocation->CanBecomeLost() &&
        -
        8575  it->hAllocation->MakeLost(currentFrameIndex, frameInUseCount))
        -
        8576  {
        -
        8577  it = FreeSuballocation(it);
        -
        8578  ++lostAllocationCount;
        -
        8579  }
        -
        8580  }
        -
        8581  return lostAllocationCount;
        -
        8582 }
        -
        8583 
        -
        8584 VkResult VmaBlockMetadata_Generic::CheckCorruption(const void* pBlockData)
        -
        8585 {
        -
        8586  for(VmaSuballocationList::iterator it = m_Suballocations.begin();
        -
        8587  it != m_Suballocations.end();
        -
        8588  ++it)
        -
        8589  {
        -
        8590  if(it->type != VMA_SUBALLOCATION_TYPE_FREE)
        +
        8529 bool VmaBlockMetadata_Generic::CreateAllocationRequest(
        +
        8530  uint32_t currentFrameIndex,
        +
        8531  uint32_t frameInUseCount,
        +
        8532  VkDeviceSize bufferImageGranularity,
        +
        8533  VkDeviceSize allocSize,
        +
        8534  VkDeviceSize allocAlignment,
        +
        8535  bool upperAddress,
        +
        8536  VmaSuballocationType allocType,
        +
        8537  bool canMakeOtherLost,
        +
        8538  uint32_t strategy,
        +
        8539  VmaAllocationRequest* pAllocationRequest)
        +
        8540 {
        +
        8541  VMA_ASSERT(allocSize > 0);
        +
        8542  VMA_ASSERT(!upperAddress);
        +
        8543  VMA_ASSERT(allocType != VMA_SUBALLOCATION_TYPE_FREE);
        +
        8544  VMA_ASSERT(pAllocationRequest != VMA_NULL);
        +
        8545  VMA_HEAVY_ASSERT(Validate());
        +
        8546 
        +
        8547  pAllocationRequest->type = VmaAllocationRequestType::Normal;
        +
        8548 
        +
        8549  // There is not enough total free space in this block to fullfill the request: Early return.
        +
        8550  if(canMakeOtherLost == false &&
        +
        8551  m_SumFreeSize < allocSize + 2 * VMA_DEBUG_MARGIN)
        +
        8552  {
        +
        8553  return false;
        +
        8554  }
        +
        8555 
        +
        8556  // New algorithm, efficiently searching freeSuballocationsBySize.
        +
        8557  const size_t freeSuballocCount = m_FreeSuballocationsBySize.size();
        +
        8558  if(freeSuballocCount > 0)
        +
        8559  {
        +
        8560  if(strategy == VMA_ALLOCATION_CREATE_STRATEGY_BEST_FIT_BIT)
        +
        8561  {
        +
        8562  // Find first free suballocation with size not less than allocSize + 2 * VMA_DEBUG_MARGIN.
        +
        8563  VmaSuballocationList::iterator* const it = VmaBinaryFindFirstNotLess(
        +
        8564  m_FreeSuballocationsBySize.data(),
        +
        8565  m_FreeSuballocationsBySize.data() + freeSuballocCount,
        +
        8566  allocSize + 2 * VMA_DEBUG_MARGIN,
        +
        8567  VmaSuballocationItemSizeLess());
        +
        8568  size_t index = it - m_FreeSuballocationsBySize.data();
        +
        8569  for(; index < freeSuballocCount; ++index)
        +
        8570  {
        +
        8571  if(CheckAllocation(
        +
        8572  currentFrameIndex,
        +
        8573  frameInUseCount,
        +
        8574  bufferImageGranularity,
        +
        8575  allocSize,
        +
        8576  allocAlignment,
        +
        8577  allocType,
        +
        8578  m_FreeSuballocationsBySize[index],
        +
        8579  false, // canMakeOtherLost
        +
        8580  &pAllocationRequest->offset,
        +
        8581  &pAllocationRequest->itemsToMakeLostCount,
        +
        8582  &pAllocationRequest->sumFreeSize,
        +
        8583  &pAllocationRequest->sumItemSize))
        +
        8584  {
        +
        8585  pAllocationRequest->item = m_FreeSuballocationsBySize[index];
        +
        8586  return true;
        +
        8587  }
        +
        8588  }
        +
        8589  }
        +
        8590  else if(strategy == VMA_ALLOCATION_INTERNAL_STRATEGY_MIN_OFFSET)
        8591  {
        -
        8592  if(!VmaValidateMagicValue(pBlockData, it->offset - VMA_DEBUG_MARGIN))
        -
        8593  {
        -
        8594  VMA_ASSERT(0 && "MEMORY CORRUPTION DETECTED BEFORE VALIDATED ALLOCATION!");
        -
        8595  return VK_ERROR_VALIDATION_FAILED_EXT;
        -
        8596  }
        -
        8597  if(!VmaValidateMagicValue(pBlockData, it->offset + it->size))
        -
        8598  {
        -
        8599  VMA_ASSERT(0 && "MEMORY CORRUPTION DETECTED AFTER VALIDATED ALLOCATION!");
        -
        8600  return VK_ERROR_VALIDATION_FAILED_EXT;
        -
        8601  }
        -
        8602  }
        -
        8603  }
        -
        8604 
        -
        8605  return VK_SUCCESS;
        -
        8606 }
        -
        8607 
        -
        8608 void VmaBlockMetadata_Generic::Alloc(
        -
        8609  const VmaAllocationRequest& request,
        -
        8610  VmaSuballocationType type,
        -
        8611  VkDeviceSize allocSize,
        -
        8612  VmaAllocation hAllocation)
        -
        8613 {
        -
        8614  VMA_ASSERT(request.type == VmaAllocationRequestType::Normal);
        -
        8615  VMA_ASSERT(request.item != m_Suballocations.end());
        -
        8616  VmaSuballocation& suballoc = *request.item;
        -
        8617  // Given suballocation is a free block.
        -
        8618  VMA_ASSERT(suballoc.type == VMA_SUBALLOCATION_TYPE_FREE);
        -
        8619  // Given offset is inside this suballocation.
        -
        8620  VMA_ASSERT(request.offset >= suballoc.offset);
        -
        8621  const VkDeviceSize paddingBegin = request.offset - suballoc.offset;
        -
        8622  VMA_ASSERT(suballoc.size >= paddingBegin + allocSize);
        -
        8623  const VkDeviceSize paddingEnd = suballoc.size - paddingBegin - allocSize;
        -
        8624 
        -
        8625  // Unregister this free suballocation from m_FreeSuballocationsBySize and update
        -
        8626  // it to become used.
        -
        8627  UnregisterFreeSuballocation(request.item);
        -
        8628 
        -
        8629  suballoc.offset = request.offset;
        -
        8630  suballoc.size = allocSize;
        -
        8631  suballoc.type = type;
        -
        8632  suballoc.hAllocation = hAllocation;
        -
        8633 
        -
        8634  // If there are any free bytes remaining at the end, insert new free suballocation after current one.
        -
        8635  if(paddingEnd)
        -
        8636  {
        -
        8637  VmaSuballocation paddingSuballoc = {};
        -
        8638  paddingSuballoc.offset = request.offset + allocSize;
        -
        8639  paddingSuballoc.size = paddingEnd;
        -
        8640  paddingSuballoc.type = VMA_SUBALLOCATION_TYPE_FREE;
        -
        8641  VmaSuballocationList::iterator next = request.item;
        -
        8642  ++next;
        -
        8643  const VmaSuballocationList::iterator paddingEndItem =
        -
        8644  m_Suballocations.insert(next, paddingSuballoc);
        -
        8645  RegisterFreeSuballocation(paddingEndItem);
        -
        8646  }
        -
        8647 
        -
        8648  // If there are any free bytes remaining at the beginning, insert new free suballocation before current one.
        -
        8649  if(paddingBegin)
        -
        8650  {
        -
        8651  VmaSuballocation paddingSuballoc = {};
        -
        8652  paddingSuballoc.offset = request.offset - paddingBegin;
        -
        8653  paddingSuballoc.size = paddingBegin;
        -
        8654  paddingSuballoc.type = VMA_SUBALLOCATION_TYPE_FREE;
        -
        8655  const VmaSuballocationList::iterator paddingBeginItem =
        -
        8656  m_Suballocations.insert(request.item, paddingSuballoc);
        -
        8657  RegisterFreeSuballocation(paddingBeginItem);
        -
        8658  }
        -
        8659 
        -
        8660  // Update totals.
        -
        8661  m_FreeCount = m_FreeCount - 1;
        -
        8662  if(paddingBegin > 0)
        -
        8663  {
        -
        8664  ++m_FreeCount;
        -
        8665  }
        -
        8666  if(paddingEnd > 0)
        -
        8667  {
        -
        8668  ++m_FreeCount;
        -
        8669  }
        -
        8670  m_SumFreeSize -= allocSize;
        -
        8671 }
        -
        8672 
        -
        8673 void VmaBlockMetadata_Generic::Free(const VmaAllocation allocation)
        -
        8674 {
        -
        8675  for(VmaSuballocationList::iterator suballocItem = m_Suballocations.begin();
        -
        8676  suballocItem != m_Suballocations.end();
        -
        8677  ++suballocItem)
        -
        8678  {
        -
        8679  VmaSuballocation& suballoc = *suballocItem;
        -
        8680  if(suballoc.hAllocation == allocation)
        -
        8681  {
        -
        8682  FreeSuballocation(suballocItem);
        -
        8683  VMA_HEAVY_ASSERT(Validate());
        -
        8684  return;
        -
        8685  }
        +
        8592  for(VmaSuballocationList::iterator it = m_Suballocations.begin();
        +
        8593  it != m_Suballocations.end();
        +
        8594  ++it)
        +
        8595  {
        +
        8596  if(it->type == VMA_SUBALLOCATION_TYPE_FREE && CheckAllocation(
        +
        8597  currentFrameIndex,
        +
        8598  frameInUseCount,
        +
        8599  bufferImageGranularity,
        +
        8600  allocSize,
        +
        8601  allocAlignment,
        +
        8602  allocType,
        +
        8603  it,
        +
        8604  false, // canMakeOtherLost
        +
        8605  &pAllocationRequest->offset,
        +
        8606  &pAllocationRequest->itemsToMakeLostCount,
        +
        8607  &pAllocationRequest->sumFreeSize,
        +
        8608  &pAllocationRequest->sumItemSize))
        +
        8609  {
        +
        8610  pAllocationRequest->item = it;
        +
        8611  return true;
        +
        8612  }
        +
        8613  }
        +
        8614  }
        +
        8615  else // WORST_FIT, FIRST_FIT
        +
        8616  {
        +
        8617  // Search staring from biggest suballocations.
        +
        8618  for(size_t index = freeSuballocCount; index--; )
        +
        8619  {
        +
        8620  if(CheckAllocation(
        +
        8621  currentFrameIndex,
        +
        8622  frameInUseCount,
        +
        8623  bufferImageGranularity,
        +
        8624  allocSize,
        +
        8625  allocAlignment,
        +
        8626  allocType,
        +
        8627  m_FreeSuballocationsBySize[index],
        +
        8628  false, // canMakeOtherLost
        +
        8629  &pAllocationRequest->offset,
        +
        8630  &pAllocationRequest->itemsToMakeLostCount,
        +
        8631  &pAllocationRequest->sumFreeSize,
        +
        8632  &pAllocationRequest->sumItemSize))
        +
        8633  {
        +
        8634  pAllocationRequest->item = m_FreeSuballocationsBySize[index];
        +
        8635  return true;
        +
        8636  }
        +
        8637  }
        +
        8638  }
        +
        8639  }
        +
        8640 
        +
        8641  if(canMakeOtherLost)
        +
        8642  {
        +
        8643  // Brute-force algorithm. TODO: Come up with something better.
        +
        8644 
        +
        8645  bool found = false;
        +
        8646  VmaAllocationRequest tmpAllocRequest = {};
        +
        8647  tmpAllocRequest.type = VmaAllocationRequestType::Normal;
        +
        8648  for(VmaSuballocationList::iterator suballocIt = m_Suballocations.begin();
        +
        8649  suballocIt != m_Suballocations.end();
        +
        8650  ++suballocIt)
        +
        8651  {
        +
        8652  if(suballocIt->type == VMA_SUBALLOCATION_TYPE_FREE ||
        +
        8653  suballocIt->hAllocation->CanBecomeLost())
        +
        8654  {
        +
        8655  if(CheckAllocation(
        +
        8656  currentFrameIndex,
        +
        8657  frameInUseCount,
        +
        8658  bufferImageGranularity,
        +
        8659  allocSize,
        +
        8660  allocAlignment,
        +
        8661  allocType,
        +
        8662  suballocIt,
        +
        8663  canMakeOtherLost,
        +
        8664  &tmpAllocRequest.offset,
        +
        8665  &tmpAllocRequest.itemsToMakeLostCount,
        +
        8666  &tmpAllocRequest.sumFreeSize,
        +
        8667  &tmpAllocRequest.sumItemSize))
        +
        8668  {
        +
        8669  if(strategy == VMA_ALLOCATION_CREATE_STRATEGY_FIRST_FIT_BIT)
        +
        8670  {
        +
        8671  *pAllocationRequest = tmpAllocRequest;
        +
        8672  pAllocationRequest->item = suballocIt;
        +
        8673  break;
        +
        8674  }
        +
        8675  if(!found || tmpAllocRequest.CalcCost() < pAllocationRequest->CalcCost())
        +
        8676  {
        +
        8677  *pAllocationRequest = tmpAllocRequest;
        +
        8678  pAllocationRequest->item = suballocIt;
        +
        8679  found = true;
        +
        8680  }
        +
        8681  }
        +
        8682  }
        +
        8683  }
        +
        8684 
        +
        8685  return found;
        8686  }
        -
        8687  VMA_ASSERT(0 && "Not found!");
        -
        8688 }
        -
        8689 
        -
        8690 void VmaBlockMetadata_Generic::FreeAtOffset(VkDeviceSize offset)
        -
        8691 {
        -
        8692  for(VmaSuballocationList::iterator suballocItem = m_Suballocations.begin();
        -
        8693  suballocItem != m_Suballocations.end();
        -
        8694  ++suballocItem)
        -
        8695  {
        -
        8696  VmaSuballocation& suballoc = *suballocItem;
        -
        8697  if(suballoc.offset == offset)
        -
        8698  {
        -
        8699  FreeSuballocation(suballocItem);
        -
        8700  return;
        -
        8701  }
        -
        8702  }
        -
        8703  VMA_ASSERT(0 && "Not found!");
        -
        8704 }
        -
        8705 
        -
        8706 bool VmaBlockMetadata_Generic::ValidateFreeSuballocationList() const
        -
        8707 {
        -
        8708  VkDeviceSize lastSize = 0;
        -
        8709  for(size_t i = 0, count = m_FreeSuballocationsBySize.size(); i < count; ++i)
        -
        8710  {
        -
        8711  const VmaSuballocationList::iterator it = m_FreeSuballocationsBySize[i];
        -
        8712 
        -
        8713  VMA_VALIDATE(it->type == VMA_SUBALLOCATION_TYPE_FREE);
        -
        8714  VMA_VALIDATE(it->size >= VMA_MIN_FREE_SUBALLOCATION_SIZE_TO_REGISTER);
        -
        8715  VMA_VALIDATE(it->size >= lastSize);
        -
        8716  lastSize = it->size;
        -
        8717  }
        -
        8718  return true;
        -
        8719 }
        -
        8720 
        -
        8721 bool VmaBlockMetadata_Generic::CheckAllocation(
        -
        8722  uint32_t currentFrameIndex,
        -
        8723  uint32_t frameInUseCount,
        -
        8724  VkDeviceSize bufferImageGranularity,
        -
        8725  VkDeviceSize allocSize,
        -
        8726  VkDeviceSize allocAlignment,
        -
        8727  VmaSuballocationType allocType,
        -
        8728  VmaSuballocationList::const_iterator suballocItem,
        -
        8729  bool canMakeOtherLost,
        -
        8730  VkDeviceSize* pOffset,
        -
        8731  size_t* itemsToMakeLostCount,
        -
        8732  VkDeviceSize* pSumFreeSize,
        -
        8733  VkDeviceSize* pSumItemSize) const
        -
        8734 {
        -
        8735  VMA_ASSERT(allocSize > 0);
        -
        8736  VMA_ASSERT(allocType != VMA_SUBALLOCATION_TYPE_FREE);
        -
        8737  VMA_ASSERT(suballocItem != m_Suballocations.cend());
        -
        8738  VMA_ASSERT(pOffset != VMA_NULL);
        -
        8739 
        -
        8740  *itemsToMakeLostCount = 0;
        -
        8741  *pSumFreeSize = 0;
        -
        8742  *pSumItemSize = 0;
        -
        8743 
        -
        8744  if(canMakeOtherLost)
        -
        8745  {
        -
        8746  if(suballocItem->type == VMA_SUBALLOCATION_TYPE_FREE)
        -
        8747  {
        -
        8748  *pSumFreeSize = suballocItem->size;
        -
        8749  }
        -
        8750  else
        -
        8751  {
        -
        8752  if(suballocItem->hAllocation->CanBecomeLost() &&
        -
        8753  suballocItem->hAllocation->GetLastUseFrameIndex() + frameInUseCount < currentFrameIndex)
        -
        8754  {
        -
        8755  ++*itemsToMakeLostCount;
        -
        8756  *pSumItemSize = suballocItem->size;
        -
        8757  }
        -
        8758  else
        -
        8759  {
        -
        8760  return false;
        -
        8761  }
        -
        8762  }
        +
        8687 
        +
        8688  return false;
        +
        8689 }
        +
        8690 
        +
        8691 bool VmaBlockMetadata_Generic::MakeRequestedAllocationsLost(
        +
        8692  uint32_t currentFrameIndex,
        +
        8693  uint32_t frameInUseCount,
        +
        8694  VmaAllocationRequest* pAllocationRequest)
        +
        8695 {
        +
        8696  VMA_ASSERT(pAllocationRequest && pAllocationRequest->type == VmaAllocationRequestType::Normal);
        +
        8697 
        +
        8698  while(pAllocationRequest->itemsToMakeLostCount > 0)
        +
        8699  {
        +
        8700  if(pAllocationRequest->item->type == VMA_SUBALLOCATION_TYPE_FREE)
        +
        8701  {
        +
        8702  ++pAllocationRequest->item;
        +
        8703  }
        +
        8704  VMA_ASSERT(pAllocationRequest->item != m_Suballocations.end());
        +
        8705  VMA_ASSERT(pAllocationRequest->item->hAllocation != VK_NULL_HANDLE);
        +
        8706  VMA_ASSERT(pAllocationRequest->item->hAllocation->CanBecomeLost());
        +
        8707  if(pAllocationRequest->item->hAllocation->MakeLost(currentFrameIndex, frameInUseCount))
        +
        8708  {
        +
        8709  pAllocationRequest->item = FreeSuballocation(pAllocationRequest->item);
        +
        8710  --pAllocationRequest->itemsToMakeLostCount;
        +
        8711  }
        +
        8712  else
        +
        8713  {
        +
        8714  return false;
        +
        8715  }
        +
        8716  }
        +
        8717 
        +
        8718  VMA_HEAVY_ASSERT(Validate());
        +
        8719  VMA_ASSERT(pAllocationRequest->item != m_Suballocations.end());
        +
        8720  VMA_ASSERT(pAllocationRequest->item->type == VMA_SUBALLOCATION_TYPE_FREE);
        +
        8721 
        +
        8722  return true;
        +
        8723 }
        +
        8724 
        +
        8725 uint32_t VmaBlockMetadata_Generic::MakeAllocationsLost(uint32_t currentFrameIndex, uint32_t frameInUseCount)
        +
        8726 {
        +
        8727  uint32_t lostAllocationCount = 0;
        +
        8728  for(VmaSuballocationList::iterator it = m_Suballocations.begin();
        +
        8729  it != m_Suballocations.end();
        +
        8730  ++it)
        +
        8731  {
        +
        8732  if(it->type != VMA_SUBALLOCATION_TYPE_FREE &&
        +
        8733  it->hAllocation->CanBecomeLost() &&
        +
        8734  it->hAllocation->MakeLost(currentFrameIndex, frameInUseCount))
        +
        8735  {
        +
        8736  it = FreeSuballocation(it);
        +
        8737  ++lostAllocationCount;
        +
        8738  }
        +
        8739  }
        +
        8740  return lostAllocationCount;
        +
        8741 }
        +
        8742 
        +
        8743 VkResult VmaBlockMetadata_Generic::CheckCorruption(const void* pBlockData)
        +
        8744 {
        +
        8745  for(VmaSuballocationList::iterator it = m_Suballocations.begin();
        +
        8746  it != m_Suballocations.end();
        +
        8747  ++it)
        +
        8748  {
        +
        8749  if(it->type != VMA_SUBALLOCATION_TYPE_FREE)
        +
        8750  {
        +
        8751  if(!VmaValidateMagicValue(pBlockData, it->offset - VMA_DEBUG_MARGIN))
        +
        8752  {
        +
        8753  VMA_ASSERT(0 && "MEMORY CORRUPTION DETECTED BEFORE VALIDATED ALLOCATION!");
        +
        8754  return VK_ERROR_VALIDATION_FAILED_EXT;
        +
        8755  }
        +
        8756  if(!VmaValidateMagicValue(pBlockData, it->offset + it->size))
        +
        8757  {
        +
        8758  VMA_ASSERT(0 && "MEMORY CORRUPTION DETECTED AFTER VALIDATED ALLOCATION!");
        +
        8759  return VK_ERROR_VALIDATION_FAILED_EXT;
        +
        8760  }
        +
        8761  }
        +
        8762  }
        8763 
        -
        8764  // Remaining size is too small for this request: Early return.
        -
        8765  if(GetSize() - suballocItem->offset < allocSize)
        -
        8766  {
        -
        8767  return false;
        -
        8768  }
        -
        8769 
        -
        8770  // Start from offset equal to beginning of this suballocation.
        -
        8771  *pOffset = suballocItem->offset;
        -
        8772 
        -
        8773  // Apply VMA_DEBUG_MARGIN at the beginning.
        -
        8774  if(VMA_DEBUG_MARGIN > 0)
        -
        8775  {
        -
        8776  *pOffset += VMA_DEBUG_MARGIN;
        -
        8777  }
        -
        8778 
        -
        8779  // Apply alignment.
        -
        8780  *pOffset = VmaAlignUp(*pOffset, allocAlignment);
        -
        8781 
        -
        8782  // Check previous suballocations for BufferImageGranularity conflicts.
        -
        8783  // Make bigger alignment if necessary.
        -
        8784  if(bufferImageGranularity > 1)
        -
        8785  {
        -
        8786  bool bufferImageGranularityConflict = false;
        -
        8787  VmaSuballocationList::const_iterator prevSuballocItem = suballocItem;
        -
        8788  while(prevSuballocItem != m_Suballocations.cbegin())
        -
        8789  {
        -
        8790  --prevSuballocItem;
        -
        8791  const VmaSuballocation& prevSuballoc = *prevSuballocItem;
        -
        8792  if(VmaBlocksOnSamePage(prevSuballoc.offset, prevSuballoc.size, *pOffset, bufferImageGranularity))
        -
        8793  {
        -
        8794  if(VmaIsBufferImageGranularityConflict(prevSuballoc.type, allocType))
        -
        8795  {
        -
        8796  bufferImageGranularityConflict = true;
        -
        8797  break;
        -
        8798  }
        -
        8799  }
        -
        8800  else
        -
        8801  // Already on previous page.
        -
        8802  break;
        -
        8803  }
        -
        8804  if(bufferImageGranularityConflict)
        -
        8805  {
        -
        8806  *pOffset = VmaAlignUp(*pOffset, bufferImageGranularity);
        -
        8807  }
        -
        8808  }
        -
        8809 
        -
        8810  // Now that we have final *pOffset, check if we are past suballocItem.
        -
        8811  // If yes, return false - this function should be called for another suballocItem as starting point.
        -
        8812  if(*pOffset >= suballocItem->offset + suballocItem->size)
        -
        8813  {
        -
        8814  return false;
        -
        8815  }
        -
        8816 
        -
        8817  // Calculate padding at the beginning based on current offset.
        -
        8818  const VkDeviceSize paddingBegin = *pOffset - suballocItem->offset;
        -
        8819 
        -
        8820  // Calculate required margin at the end.
        -
        8821  const VkDeviceSize requiredEndMargin = VMA_DEBUG_MARGIN;
        -
        8822 
        -
        8823  const VkDeviceSize totalSize = paddingBegin + allocSize + requiredEndMargin;
        -
        8824  // Another early return check.
        -
        8825  if(suballocItem->offset + totalSize > GetSize())
        -
        8826  {
        -
        8827  return false;
        -
        8828  }
        -
        8829 
        -
        8830  // Advance lastSuballocItem until desired size is reached.
        -
        8831  // Update itemsToMakeLostCount.
        -
        8832  VmaSuballocationList::const_iterator lastSuballocItem = suballocItem;
        -
        8833  if(totalSize > suballocItem->size)
        -
        8834  {
        -
        8835  VkDeviceSize remainingSize = totalSize - suballocItem->size;
        -
        8836  while(remainingSize > 0)
        -
        8837  {
        -
        8838  ++lastSuballocItem;
        -
        8839  if(lastSuballocItem == m_Suballocations.cend())
        -
        8840  {
        -
        8841  return false;
        -
        8842  }
        -
        8843  if(lastSuballocItem->type == VMA_SUBALLOCATION_TYPE_FREE)
        -
        8844  {
        -
        8845  *pSumFreeSize += lastSuballocItem->size;
        -
        8846  }
        -
        8847  else
        -
        8848  {
        -
        8849  VMA_ASSERT(lastSuballocItem->hAllocation != VK_NULL_HANDLE);
        -
        8850  if(lastSuballocItem->hAllocation->CanBecomeLost() &&
        -
        8851  lastSuballocItem->hAllocation->GetLastUseFrameIndex() + frameInUseCount < currentFrameIndex)
        -
        8852  {
        -
        8853  ++*itemsToMakeLostCount;
        -
        8854  *pSumItemSize += lastSuballocItem->size;
        -
        8855  }
        -
        8856  else
        -
        8857  {
        -
        8858  return false;
        -
        8859  }
        -
        8860  }
        -
        8861  remainingSize = (lastSuballocItem->size < remainingSize) ?
        -
        8862  remainingSize - lastSuballocItem->size : 0;
        -
        8863  }
        -
        8864  }
        -
        8865 
        -
        8866  // Check next suballocations for BufferImageGranularity conflicts.
        -
        8867  // If conflict exists, we must mark more allocations lost or fail.
        -
        8868  if(bufferImageGranularity > 1)
        -
        8869  {
        -
        8870  VmaSuballocationList::const_iterator nextSuballocItem = lastSuballocItem;
        -
        8871  ++nextSuballocItem;
        -
        8872  while(nextSuballocItem != m_Suballocations.cend())
        -
        8873  {
        -
        8874  const VmaSuballocation& nextSuballoc = *nextSuballocItem;
        -
        8875  if(VmaBlocksOnSamePage(*pOffset, allocSize, nextSuballoc.offset, bufferImageGranularity))
        -
        8876  {
        -
        8877  if(VmaIsBufferImageGranularityConflict(allocType, nextSuballoc.type))
        -
        8878  {
        -
        8879  VMA_ASSERT(nextSuballoc.hAllocation != VK_NULL_HANDLE);
        -
        8880  if(nextSuballoc.hAllocation->CanBecomeLost() &&
        -
        8881  nextSuballoc.hAllocation->GetLastUseFrameIndex() + frameInUseCount < currentFrameIndex)
        -
        8882  {
        -
        8883  ++*itemsToMakeLostCount;
        -
        8884  }
        -
        8885  else
        -
        8886  {
        -
        8887  return false;
        -
        8888  }
        -
        8889  }
        -
        8890  }
        -
        8891  else
        -
        8892  {
        -
        8893  // Already on next page.
        -
        8894  break;
        -
        8895  }
        -
        8896  ++nextSuballocItem;
        -
        8897  }
        -
        8898  }
        -
        8899  }
        -
        8900  else
        -
        8901  {
        -
        8902  const VmaSuballocation& suballoc = *suballocItem;
        -
        8903  VMA_ASSERT(suballoc.type == VMA_SUBALLOCATION_TYPE_FREE);
        -
        8904 
        -
        8905  *pSumFreeSize = suballoc.size;
        -
        8906 
        -
        8907  // Size of this suballocation is too small for this request: Early return.
        -
        8908  if(suballoc.size < allocSize)
        -
        8909  {
        -
        8910  return false;
        -
        8911  }
        -
        8912 
        -
        8913  // Start from offset equal to beginning of this suballocation.
        -
        8914  *pOffset = suballoc.offset;
        -
        8915 
        -
        8916  // Apply VMA_DEBUG_MARGIN at the beginning.
        -
        8917  if(VMA_DEBUG_MARGIN > 0)
        -
        8918  {
        -
        8919  *pOffset += VMA_DEBUG_MARGIN;
        -
        8920  }
        -
        8921 
        -
        8922  // Apply alignment.
        -
        8923  *pOffset = VmaAlignUp(*pOffset, allocAlignment);
        -
        8924 
        -
        8925  // Check previous suballocations for BufferImageGranularity conflicts.
        -
        8926  // Make bigger alignment if necessary.
        -
        8927  if(bufferImageGranularity > 1)
        -
        8928  {
        -
        8929  bool bufferImageGranularityConflict = false;
        -
        8930  VmaSuballocationList::const_iterator prevSuballocItem = suballocItem;
        -
        8931  while(prevSuballocItem != m_Suballocations.cbegin())
        -
        8932  {
        -
        8933  --prevSuballocItem;
        -
        8934  const VmaSuballocation& prevSuballoc = *prevSuballocItem;
        -
        8935  if(VmaBlocksOnSamePage(prevSuballoc.offset, prevSuballoc.size, *pOffset, bufferImageGranularity))
        -
        8936  {
        -
        8937  if(VmaIsBufferImageGranularityConflict(prevSuballoc.type, allocType))
        -
        8938  {
        -
        8939  bufferImageGranularityConflict = true;
        -
        8940  break;
        -
        8941  }
        -
        8942  }
        -
        8943  else
        -
        8944  // Already on previous page.
        -
        8945  break;
        -
        8946  }
        -
        8947  if(bufferImageGranularityConflict)
        +
        8764  return VK_SUCCESS;
        +
        8765 }
        +
        8766 
        +
        8767 void VmaBlockMetadata_Generic::Alloc(
        +
        8768  const VmaAllocationRequest& request,
        +
        8769  VmaSuballocationType type,
        +
        8770  VkDeviceSize allocSize,
        +
        8771  VmaAllocation hAllocation)
        +
        8772 {
        +
        8773  VMA_ASSERT(request.type == VmaAllocationRequestType::Normal);
        +
        8774  VMA_ASSERT(request.item != m_Suballocations.end());
        +
        8775  VmaSuballocation& suballoc = *request.item;
        +
        8776  // Given suballocation is a free block.
        +
        8777  VMA_ASSERT(suballoc.type == VMA_SUBALLOCATION_TYPE_FREE);
        +
        8778  // Given offset is inside this suballocation.
        +
        8779  VMA_ASSERT(request.offset >= suballoc.offset);
        +
        8780  const VkDeviceSize paddingBegin = request.offset - suballoc.offset;
        +
        8781  VMA_ASSERT(suballoc.size >= paddingBegin + allocSize);
        +
        8782  const VkDeviceSize paddingEnd = suballoc.size - paddingBegin - allocSize;
        +
        8783 
        +
        8784  // Unregister this free suballocation from m_FreeSuballocationsBySize and update
        +
        8785  // it to become used.
        +
        8786  UnregisterFreeSuballocation(request.item);
        +
        8787 
        +
        8788  suballoc.offset = request.offset;
        +
        8789  suballoc.size = allocSize;
        +
        8790  suballoc.type = type;
        +
        8791  suballoc.hAllocation = hAllocation;
        +
        8792 
        +
        8793  // If there are any free bytes remaining at the end, insert new free suballocation after current one.
        +
        8794  if(paddingEnd)
        +
        8795  {
        +
        8796  VmaSuballocation paddingSuballoc = {};
        +
        8797  paddingSuballoc.offset = request.offset + allocSize;
        +
        8798  paddingSuballoc.size = paddingEnd;
        +
        8799  paddingSuballoc.type = VMA_SUBALLOCATION_TYPE_FREE;
        +
        8800  VmaSuballocationList::iterator next = request.item;
        +
        8801  ++next;
        +
        8802  const VmaSuballocationList::iterator paddingEndItem =
        +
        8803  m_Suballocations.insert(next, paddingSuballoc);
        +
        8804  RegisterFreeSuballocation(paddingEndItem);
        +
        8805  }
        +
        8806 
        +
        8807  // If there are any free bytes remaining at the beginning, insert new free suballocation before current one.
        +
        8808  if(paddingBegin)
        +
        8809  {
        +
        8810  VmaSuballocation paddingSuballoc = {};
        +
        8811  paddingSuballoc.offset = request.offset - paddingBegin;
        +
        8812  paddingSuballoc.size = paddingBegin;
        +
        8813  paddingSuballoc.type = VMA_SUBALLOCATION_TYPE_FREE;
        +
        8814  const VmaSuballocationList::iterator paddingBeginItem =
        +
        8815  m_Suballocations.insert(request.item, paddingSuballoc);
        +
        8816  RegisterFreeSuballocation(paddingBeginItem);
        +
        8817  }
        +
        8818 
        +
        8819  // Update totals.
        +
        8820  m_FreeCount = m_FreeCount - 1;
        +
        8821  if(paddingBegin > 0)
        +
        8822  {
        +
        8823  ++m_FreeCount;
        +
        8824  }
        +
        8825  if(paddingEnd > 0)
        +
        8826  {
        +
        8827  ++m_FreeCount;
        +
        8828  }
        +
        8829  m_SumFreeSize -= allocSize;
        +
        8830 }
        +
        8831 
        +
        8832 void VmaBlockMetadata_Generic::Free(const VmaAllocation allocation)
        +
        8833 {
        +
        8834  for(VmaSuballocationList::iterator suballocItem = m_Suballocations.begin();
        +
        8835  suballocItem != m_Suballocations.end();
        +
        8836  ++suballocItem)
        +
        8837  {
        +
        8838  VmaSuballocation& suballoc = *suballocItem;
        +
        8839  if(suballoc.hAllocation == allocation)
        +
        8840  {
        +
        8841  FreeSuballocation(suballocItem);
        +
        8842  VMA_HEAVY_ASSERT(Validate());
        +
        8843  return;
        +
        8844  }
        +
        8845  }
        +
        8846  VMA_ASSERT(0 && "Not found!");
        +
        8847 }
        +
        8848 
        +
        8849 void VmaBlockMetadata_Generic::FreeAtOffset(VkDeviceSize offset)
        +
        8850 {
        +
        8851  for(VmaSuballocationList::iterator suballocItem = m_Suballocations.begin();
        +
        8852  suballocItem != m_Suballocations.end();
        +
        8853  ++suballocItem)
        +
        8854  {
        +
        8855  VmaSuballocation& suballoc = *suballocItem;
        +
        8856  if(suballoc.offset == offset)
        +
        8857  {
        +
        8858  FreeSuballocation(suballocItem);
        +
        8859  return;
        +
        8860  }
        +
        8861  }
        +
        8862  VMA_ASSERT(0 && "Not found!");
        +
        8863 }
        +
        8864 
        +
        8865 bool VmaBlockMetadata_Generic::ValidateFreeSuballocationList() const
        +
        8866 {
        +
        8867  VkDeviceSize lastSize = 0;
        +
        8868  for(size_t i = 0, count = m_FreeSuballocationsBySize.size(); i < count; ++i)
        +
        8869  {
        +
        8870  const VmaSuballocationList::iterator it = m_FreeSuballocationsBySize[i];
        +
        8871 
        +
        8872  VMA_VALIDATE(it->type == VMA_SUBALLOCATION_TYPE_FREE);
        +
        8873  VMA_VALIDATE(it->size >= VMA_MIN_FREE_SUBALLOCATION_SIZE_TO_REGISTER);
        +
        8874  VMA_VALIDATE(it->size >= lastSize);
        +
        8875  lastSize = it->size;
        +
        8876  }
        +
        8877  return true;
        +
        8878 }
        +
        8879 
        +
        8880 bool VmaBlockMetadata_Generic::CheckAllocation(
        +
        8881  uint32_t currentFrameIndex,
        +
        8882  uint32_t frameInUseCount,
        +
        8883  VkDeviceSize bufferImageGranularity,
        +
        8884  VkDeviceSize allocSize,
        +
        8885  VkDeviceSize allocAlignment,
        +
        8886  VmaSuballocationType allocType,
        +
        8887  VmaSuballocationList::const_iterator suballocItem,
        +
        8888  bool canMakeOtherLost,
        +
        8889  VkDeviceSize* pOffset,
        +
        8890  size_t* itemsToMakeLostCount,
        +
        8891  VkDeviceSize* pSumFreeSize,
        +
        8892  VkDeviceSize* pSumItemSize) const
        +
        8893 {
        +
        8894  VMA_ASSERT(allocSize > 0);
        +
        8895  VMA_ASSERT(allocType != VMA_SUBALLOCATION_TYPE_FREE);
        +
        8896  VMA_ASSERT(suballocItem != m_Suballocations.cend());
        +
        8897  VMA_ASSERT(pOffset != VMA_NULL);
        +
        8898 
        +
        8899  *itemsToMakeLostCount = 0;
        +
        8900  *pSumFreeSize = 0;
        +
        8901  *pSumItemSize = 0;
        +
        8902 
        +
        8903  if(canMakeOtherLost)
        +
        8904  {
        +
        8905  if(suballocItem->type == VMA_SUBALLOCATION_TYPE_FREE)
        +
        8906  {
        +
        8907  *pSumFreeSize = suballocItem->size;
        +
        8908  }
        +
        8909  else
        +
        8910  {
        +
        8911  if(suballocItem->hAllocation->CanBecomeLost() &&
        +
        8912  suballocItem->hAllocation->GetLastUseFrameIndex() + frameInUseCount < currentFrameIndex)
        +
        8913  {
        +
        8914  ++*itemsToMakeLostCount;
        +
        8915  *pSumItemSize = suballocItem->size;
        +
        8916  }
        +
        8917  else
        +
        8918  {
        +
        8919  return false;
        +
        8920  }
        +
        8921  }
        +
        8922 
        +
        8923  // Remaining size is too small for this request: Early return.
        +
        8924  if(GetSize() - suballocItem->offset < allocSize)
        +
        8925  {
        +
        8926  return false;
        +
        8927  }
        +
        8928 
        +
        8929  // Start from offset equal to beginning of this suballocation.
        +
        8930  *pOffset = suballocItem->offset;
        +
        8931 
        +
        8932  // Apply VMA_DEBUG_MARGIN at the beginning.
        +
        8933  if(VMA_DEBUG_MARGIN > 0)
        +
        8934  {
        +
        8935  *pOffset += VMA_DEBUG_MARGIN;
        +
        8936  }
        +
        8937 
        +
        8938  // Apply alignment.
        +
        8939  *pOffset = VmaAlignUp(*pOffset, allocAlignment);
        +
        8940 
        +
        8941  // Check previous suballocations for BufferImageGranularity conflicts.
        +
        8942  // Make bigger alignment if necessary.
        +
        8943  if(bufferImageGranularity > 1)
        +
        8944  {
        +
        8945  bool bufferImageGranularityConflict = false;
        +
        8946  VmaSuballocationList::const_iterator prevSuballocItem = suballocItem;
        +
        8947  while(prevSuballocItem != m_Suballocations.cbegin())
        8948  {
        -
        8949  *pOffset = VmaAlignUp(*pOffset, bufferImageGranularity);
        -
        8950  }
        -
        8951  }
        -
        8952 
        -
        8953  // Calculate padding at the beginning based on current offset.
        -
        8954  const VkDeviceSize paddingBegin = *pOffset - suballoc.offset;
        -
        8955 
        -
        8956  // Calculate required margin at the end.
        -
        8957  const VkDeviceSize requiredEndMargin = VMA_DEBUG_MARGIN;
        -
        8958 
        -
        8959  // Fail if requested size plus margin before and after is bigger than size of this suballocation.
        -
        8960  if(paddingBegin + allocSize + requiredEndMargin > suballoc.size)
        -
        8961  {
        -
        8962  return false;
        -
        8963  }
        -
        8964 
        -
        8965  // Check next suballocations for BufferImageGranularity conflicts.
        -
        8966  // If conflict exists, allocation cannot be made here.
        -
        8967  if(bufferImageGranularity > 1)
        -
        8968  {
        -
        8969  VmaSuballocationList::const_iterator nextSuballocItem = suballocItem;
        -
        8970  ++nextSuballocItem;
        -
        8971  while(nextSuballocItem != m_Suballocations.cend())
        -
        8972  {
        -
        8973  const VmaSuballocation& nextSuballoc = *nextSuballocItem;
        -
        8974  if(VmaBlocksOnSamePage(*pOffset, allocSize, nextSuballoc.offset, bufferImageGranularity))
        -
        8975  {
        -
        8976  if(VmaIsBufferImageGranularityConflict(allocType, nextSuballoc.type))
        -
        8977  {
        -
        8978  return false;
        -
        8979  }
        -
        8980  }
        -
        8981  else
        -
        8982  {
        -
        8983  // Already on next page.
        -
        8984  break;
        -
        8985  }
        -
        8986  ++nextSuballocItem;
        -
        8987  }
        -
        8988  }
        -
        8989  }
        -
        8990 
        -
        8991  // All tests passed: Success. pOffset is already filled.
        -
        8992  return true;
        -
        8993 }
        -
        8994 
        -
        8995 void VmaBlockMetadata_Generic::MergeFreeWithNext(VmaSuballocationList::iterator item)
        -
        8996 {
        -
        8997  VMA_ASSERT(item != m_Suballocations.end());
        -
        8998  VMA_ASSERT(item->type == VMA_SUBALLOCATION_TYPE_FREE);
        -
        8999 
        -
        9000  VmaSuballocationList::iterator nextItem = item;
        -
        9001  ++nextItem;
        -
        9002  VMA_ASSERT(nextItem != m_Suballocations.end());
        -
        9003  VMA_ASSERT(nextItem->type == VMA_SUBALLOCATION_TYPE_FREE);
        -
        9004 
        -
        9005  item->size += nextItem->size;
        -
        9006  --m_FreeCount;
        -
        9007  m_Suballocations.erase(nextItem);
        -
        9008 }
        -
        9009 
        -
        9010 VmaSuballocationList::iterator VmaBlockMetadata_Generic::FreeSuballocation(VmaSuballocationList::iterator suballocItem)
        -
        9011 {
        -
        9012  // Change this suballocation to be marked as free.
        -
        9013  VmaSuballocation& suballoc = *suballocItem;
        -
        9014  suballoc.type = VMA_SUBALLOCATION_TYPE_FREE;
        -
        9015  suballoc.hAllocation = VK_NULL_HANDLE;
        -
        9016 
        -
        9017  // Update totals.
        -
        9018  ++m_FreeCount;
        -
        9019  m_SumFreeSize += suballoc.size;
        -
        9020 
        -
        9021  // Merge with previous and/or next suballocation if it's also free.
        -
        9022  bool mergeWithNext = false;
        -
        9023  bool mergeWithPrev = false;
        -
        9024 
        -
        9025  VmaSuballocationList::iterator nextItem = suballocItem;
        -
        9026  ++nextItem;
        -
        9027  if((nextItem != m_Suballocations.end()) && (nextItem->type == VMA_SUBALLOCATION_TYPE_FREE))
        -
        9028  {
        -
        9029  mergeWithNext = true;
        -
        9030  }
        -
        9031 
        -
        9032  VmaSuballocationList::iterator prevItem = suballocItem;
        -
        9033  if(suballocItem != m_Suballocations.begin())
        -
        9034  {
        -
        9035  --prevItem;
        -
        9036  if(prevItem->type == VMA_SUBALLOCATION_TYPE_FREE)
        -
        9037  {
        -
        9038  mergeWithPrev = true;
        -
        9039  }
        -
        9040  }
        -
        9041 
        -
        9042  if(mergeWithNext)
        -
        9043  {
        -
        9044  UnregisterFreeSuballocation(nextItem);
        -
        9045  MergeFreeWithNext(suballocItem);
        -
        9046  }
        -
        9047 
        -
        9048  if(mergeWithPrev)
        -
        9049  {
        -
        9050  UnregisterFreeSuballocation(prevItem);
        -
        9051  MergeFreeWithNext(prevItem);
        -
        9052  RegisterFreeSuballocation(prevItem);
        -
        9053  return prevItem;
        -
        9054  }
        -
        9055  else
        -
        9056  {
        -
        9057  RegisterFreeSuballocation(suballocItem);
        -
        9058  return suballocItem;
        -
        9059  }
        -
        9060 }
        -
        9061 
        -
        9062 void VmaBlockMetadata_Generic::RegisterFreeSuballocation(VmaSuballocationList::iterator item)
        -
        9063 {
        -
        9064  VMA_ASSERT(item->type == VMA_SUBALLOCATION_TYPE_FREE);
        -
        9065  VMA_ASSERT(item->size > 0);
        -
        9066 
        -
        9067  // You may want to enable this validation at the beginning or at the end of
        -
        9068  // this function, depending on what do you want to check.
        -
        9069  VMA_HEAVY_ASSERT(ValidateFreeSuballocationList());
        -
        9070 
        -
        9071  if(item->size >= VMA_MIN_FREE_SUBALLOCATION_SIZE_TO_REGISTER)
        -
        9072  {
        -
        9073  if(m_FreeSuballocationsBySize.empty())
        -
        9074  {
        -
        9075  m_FreeSuballocationsBySize.push_back(item);
        -
        9076  }
        -
        9077  else
        -
        9078  {
        -
        9079  VmaVectorInsertSorted<VmaSuballocationItemSizeLess>(m_FreeSuballocationsBySize, item);
        -
        9080  }
        -
        9081  }
        -
        9082 
        -
        9083  //VMA_HEAVY_ASSERT(ValidateFreeSuballocationList());
        -
        9084 }
        -
        9085 
        -
        9086 
        -
        9087 void VmaBlockMetadata_Generic::UnregisterFreeSuballocation(VmaSuballocationList::iterator item)
        -
        9088 {
        -
        9089  VMA_ASSERT(item->type == VMA_SUBALLOCATION_TYPE_FREE);
        -
        9090  VMA_ASSERT(item->size > 0);
        -
        9091 
        -
        9092  // You may want to enable this validation at the beginning or at the end of
        -
        9093  // this function, depending on what do you want to check.
        -
        9094  VMA_HEAVY_ASSERT(ValidateFreeSuballocationList());
        -
        9095 
        -
        9096  if(item->size >= VMA_MIN_FREE_SUBALLOCATION_SIZE_TO_REGISTER)
        -
        9097  {
        -
        9098  VmaSuballocationList::iterator* const it = VmaBinaryFindFirstNotLess(
        -
        9099  m_FreeSuballocationsBySize.data(),
        -
        9100  m_FreeSuballocationsBySize.data() + m_FreeSuballocationsBySize.size(),
        -
        9101  item,
        -
        9102  VmaSuballocationItemSizeLess());
        -
        9103  for(size_t index = it - m_FreeSuballocationsBySize.data();
        -
        9104  index < m_FreeSuballocationsBySize.size();
        -
        9105  ++index)
        -
        9106  {
        -
        9107  if(m_FreeSuballocationsBySize[index] == item)
        -
        9108  {
        -
        9109  VmaVectorRemove(m_FreeSuballocationsBySize, index);
        -
        9110  return;
        -
        9111  }
        -
        9112  VMA_ASSERT((m_FreeSuballocationsBySize[index]->size == item->size) && "Not found.");
        -
        9113  }
        -
        9114  VMA_ASSERT(0 && "Not found.");
        -
        9115  }
        -
        9116 
        -
        9117  //VMA_HEAVY_ASSERT(ValidateFreeSuballocationList());
        -
        9118 }
        -
        9119 
        -
        9120 bool VmaBlockMetadata_Generic::IsBufferImageGranularityConflictPossible(
        -
        9121  VkDeviceSize bufferImageGranularity,
        -
        9122  VmaSuballocationType& inOutPrevSuballocType) const
        -
        9123 {
        -
        9124  if(bufferImageGranularity == 1 || IsEmpty())
        -
        9125  {
        -
        9126  return false;
        -
        9127  }
        -
        9128 
        -
        9129  VkDeviceSize minAlignment = VK_WHOLE_SIZE;
        -
        9130  bool typeConflictFound = false;
        -
        9131  for(VmaSuballocationList::const_iterator it = m_Suballocations.cbegin();
        -
        9132  it != m_Suballocations.cend();
        -
        9133  ++it)
        -
        9134  {
        -
        9135  const VmaSuballocationType suballocType = it->type;
        -
        9136  if(suballocType != VMA_SUBALLOCATION_TYPE_FREE)
        -
        9137  {
        -
        9138  minAlignment = VMA_MIN(minAlignment, it->hAllocation->GetAlignment());
        -
        9139  if(VmaIsBufferImageGranularityConflict(inOutPrevSuballocType, suballocType))
        -
        9140  {
        -
        9141  typeConflictFound = true;
        -
        9142  }
        -
        9143  inOutPrevSuballocType = suballocType;
        -
        9144  }
        -
        9145  }
        -
        9146 
        -
        9147  return typeConflictFound || minAlignment >= bufferImageGranularity;
        -
        9148 }
        +
        8949  --prevSuballocItem;
        +
        8950  const VmaSuballocation& prevSuballoc = *prevSuballocItem;
        +
        8951  if(VmaBlocksOnSamePage(prevSuballoc.offset, prevSuballoc.size, *pOffset, bufferImageGranularity))
        +
        8952  {
        +
        8953  if(VmaIsBufferImageGranularityConflict(prevSuballoc.type, allocType))
        +
        8954  {
        +
        8955  bufferImageGranularityConflict = true;
        +
        8956  break;
        +
        8957  }
        +
        8958  }
        +
        8959  else
        +
        8960  // Already on previous page.
        +
        8961  break;
        +
        8962  }
        +
        8963  if(bufferImageGranularityConflict)
        +
        8964  {
        +
        8965  *pOffset = VmaAlignUp(*pOffset, bufferImageGranularity);
        +
        8966  }
        +
        8967  }
        +
        8968 
        +
        8969  // Now that we have final *pOffset, check if we are past suballocItem.
        +
        8970  // If yes, return false - this function should be called for another suballocItem as starting point.
        +
        8971  if(*pOffset >= suballocItem->offset + suballocItem->size)
        +
        8972  {
        +
        8973  return false;
        +
        8974  }
        +
        8975 
        +
        8976  // Calculate padding at the beginning based on current offset.
        +
        8977  const VkDeviceSize paddingBegin = *pOffset - suballocItem->offset;
        +
        8978 
        +
        8979  // Calculate required margin at the end.
        +
        8980  const VkDeviceSize requiredEndMargin = VMA_DEBUG_MARGIN;
        +
        8981 
        +
        8982  const VkDeviceSize totalSize = paddingBegin + allocSize + requiredEndMargin;
        +
        8983  // Another early return check.
        +
        8984  if(suballocItem->offset + totalSize > GetSize())
        +
        8985  {
        +
        8986  return false;
        +
        8987  }
        +
        8988 
        +
        8989  // Advance lastSuballocItem until desired size is reached.
        +
        8990  // Update itemsToMakeLostCount.
        +
        8991  VmaSuballocationList::const_iterator lastSuballocItem = suballocItem;
        +
        8992  if(totalSize > suballocItem->size)
        +
        8993  {
        +
        8994  VkDeviceSize remainingSize = totalSize - suballocItem->size;
        +
        8995  while(remainingSize > 0)
        +
        8996  {
        +
        8997  ++lastSuballocItem;
        +
        8998  if(lastSuballocItem == m_Suballocations.cend())
        +
        8999  {
        +
        9000  return false;
        +
        9001  }
        +
        9002  if(lastSuballocItem->type == VMA_SUBALLOCATION_TYPE_FREE)
        +
        9003  {
        +
        9004  *pSumFreeSize += lastSuballocItem->size;
        +
        9005  }
        +
        9006  else
        +
        9007  {
        +
        9008  VMA_ASSERT(lastSuballocItem->hAllocation != VK_NULL_HANDLE);
        +
        9009  if(lastSuballocItem->hAllocation->CanBecomeLost() &&
        +
        9010  lastSuballocItem->hAllocation->GetLastUseFrameIndex() + frameInUseCount < currentFrameIndex)
        +
        9011  {
        +
        9012  ++*itemsToMakeLostCount;
        +
        9013  *pSumItemSize += lastSuballocItem->size;
        +
        9014  }
        +
        9015  else
        +
        9016  {
        +
        9017  return false;
        +
        9018  }
        +
        9019  }
        +
        9020  remainingSize = (lastSuballocItem->size < remainingSize) ?
        +
        9021  remainingSize - lastSuballocItem->size : 0;
        +
        9022  }
        +
        9023  }
        +
        9024 
        +
        9025  // Check next suballocations for BufferImageGranularity conflicts.
        +
        9026  // If conflict exists, we must mark more allocations lost or fail.
        +
        9027  if(bufferImageGranularity > 1)
        +
        9028  {
        +
        9029  VmaSuballocationList::const_iterator nextSuballocItem = lastSuballocItem;
        +
        9030  ++nextSuballocItem;
        +
        9031  while(nextSuballocItem != m_Suballocations.cend())
        +
        9032  {
        +
        9033  const VmaSuballocation& nextSuballoc = *nextSuballocItem;
        +
        9034  if(VmaBlocksOnSamePage(*pOffset, allocSize, nextSuballoc.offset, bufferImageGranularity))
        +
        9035  {
        +
        9036  if(VmaIsBufferImageGranularityConflict(allocType, nextSuballoc.type))
        +
        9037  {
        +
        9038  VMA_ASSERT(nextSuballoc.hAllocation != VK_NULL_HANDLE);
        +
        9039  if(nextSuballoc.hAllocation->CanBecomeLost() &&
        +
        9040  nextSuballoc.hAllocation->GetLastUseFrameIndex() + frameInUseCount < currentFrameIndex)
        +
        9041  {
        +
        9042  ++*itemsToMakeLostCount;
        +
        9043  }
        +
        9044  else
        +
        9045  {
        +
        9046  return false;
        +
        9047  }
        +
        9048  }
        +
        9049  }
        +
        9050  else
        +
        9051  {
        +
        9052  // Already on next page.
        +
        9053  break;
        +
        9054  }
        +
        9055  ++nextSuballocItem;
        +
        9056  }
        +
        9057  }
        +
        9058  }
        +
        9059  else
        +
        9060  {
        +
        9061  const VmaSuballocation& suballoc = *suballocItem;
        +
        9062  VMA_ASSERT(suballoc.type == VMA_SUBALLOCATION_TYPE_FREE);
        +
        9063 
        +
        9064  *pSumFreeSize = suballoc.size;
        +
        9065 
        +
        9066  // Size of this suballocation is too small for this request: Early return.
        +
        9067  if(suballoc.size < allocSize)
        +
        9068  {
        +
        9069  return false;
        +
        9070  }
        +
        9071 
        +
        9072  // Start from offset equal to beginning of this suballocation.
        +
        9073  *pOffset = suballoc.offset;
        +
        9074 
        +
        9075  // Apply VMA_DEBUG_MARGIN at the beginning.
        +
        9076  if(VMA_DEBUG_MARGIN > 0)
        +
        9077  {
        +
        9078  *pOffset += VMA_DEBUG_MARGIN;
        +
        9079  }
        +
        9080 
        +
        9081  // Apply alignment.
        +
        9082  *pOffset = VmaAlignUp(*pOffset, allocAlignment);
        +
        9083 
        +
        9084  // Check previous suballocations for BufferImageGranularity conflicts.
        +
        9085  // Make bigger alignment if necessary.
        +
        9086  if(bufferImageGranularity > 1)
        +
        9087  {
        +
        9088  bool bufferImageGranularityConflict = false;
        +
        9089  VmaSuballocationList::const_iterator prevSuballocItem = suballocItem;
        +
        9090  while(prevSuballocItem != m_Suballocations.cbegin())
        +
        9091  {
        +
        9092  --prevSuballocItem;
        +
        9093  const VmaSuballocation& prevSuballoc = *prevSuballocItem;
        +
        9094  if(VmaBlocksOnSamePage(prevSuballoc.offset, prevSuballoc.size, *pOffset, bufferImageGranularity))
        +
        9095  {
        +
        9096  if(VmaIsBufferImageGranularityConflict(prevSuballoc.type, allocType))
        +
        9097  {
        +
        9098  bufferImageGranularityConflict = true;
        +
        9099  break;
        +
        9100  }
        +
        9101  }
        +
        9102  else
        +
        9103  // Already on previous page.
        +
        9104  break;
        +
        9105  }
        +
        9106  if(bufferImageGranularityConflict)
        +
        9107  {
        +
        9108  *pOffset = VmaAlignUp(*pOffset, bufferImageGranularity);
        +
        9109  }
        +
        9110  }
        +
        9111 
        +
        9112  // Calculate padding at the beginning based on current offset.
        +
        9113  const VkDeviceSize paddingBegin = *pOffset - suballoc.offset;
        +
        9114 
        +
        9115  // Calculate required margin at the end.
        +
        9116  const VkDeviceSize requiredEndMargin = VMA_DEBUG_MARGIN;
        +
        9117 
        +
        9118  // Fail if requested size plus margin before and after is bigger than size of this suballocation.
        +
        9119  if(paddingBegin + allocSize + requiredEndMargin > suballoc.size)
        +
        9120  {
        +
        9121  return false;
        +
        9122  }
        +
        9123 
        +
        9124  // Check next suballocations for BufferImageGranularity conflicts.
        +
        9125  // If conflict exists, allocation cannot be made here.
        +
        9126  if(bufferImageGranularity > 1)
        +
        9127  {
        +
        9128  VmaSuballocationList::const_iterator nextSuballocItem = suballocItem;
        +
        9129  ++nextSuballocItem;
        +
        9130  while(nextSuballocItem != m_Suballocations.cend())
        +
        9131  {
        +
        9132  const VmaSuballocation& nextSuballoc = *nextSuballocItem;
        +
        9133  if(VmaBlocksOnSamePage(*pOffset, allocSize, nextSuballoc.offset, bufferImageGranularity))
        +
        9134  {
        +
        9135  if(VmaIsBufferImageGranularityConflict(allocType, nextSuballoc.type))
        +
        9136  {
        +
        9137  return false;
        +
        9138  }
        +
        9139  }
        +
        9140  else
        +
        9141  {
        +
        9142  // Already on next page.
        +
        9143  break;
        +
        9144  }
        +
        9145  ++nextSuballocItem;
        +
        9146  }
        +
        9147  }
        +
        9148  }
        9149 
        -
        9151 // class VmaBlockMetadata_Linear
        -
        9152 
        -
        9153 VmaBlockMetadata_Linear::VmaBlockMetadata_Linear(VmaAllocator hAllocator) :
        -
        9154  VmaBlockMetadata(hAllocator),
        -
        9155  m_SumFreeSize(0),
        -
        9156  m_Suballocations0(VmaStlAllocator<VmaSuballocation>(hAllocator->GetAllocationCallbacks())),
        -
        9157  m_Suballocations1(VmaStlAllocator<VmaSuballocation>(hAllocator->GetAllocationCallbacks())),
        -
        9158  m_1stVectorIndex(0),
        -
        9159  m_2ndVectorMode(SECOND_VECTOR_EMPTY),
        -
        9160  m_1stNullItemsBeginCount(0),
        -
        9161  m_1stNullItemsMiddleCount(0),
        -
        9162  m_2ndNullItemsCount(0)
        -
        9163 {
        -
        9164 }
        -
        9165 
        -
        9166 VmaBlockMetadata_Linear::~VmaBlockMetadata_Linear()
        -
        9167 {
        -
        9168 }
        -
        9169 
        -
        9170 void VmaBlockMetadata_Linear::Init(VkDeviceSize size)
        -
        9171 {
        -
        9172  VmaBlockMetadata::Init(size);
        -
        9173  m_SumFreeSize = size;
        -
        9174 }
        -
        9175 
        -
        9176 bool VmaBlockMetadata_Linear::Validate() const
        -
        9177 {
        -
        9178  const SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        -
        9179  const SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        -
        9180 
        -
        9181  VMA_VALIDATE(suballocations2nd.empty() == (m_2ndVectorMode == SECOND_VECTOR_EMPTY));
        -
        9182  VMA_VALIDATE(!suballocations1st.empty() ||
        -
        9183  suballocations2nd.empty() ||
        -
        9184  m_2ndVectorMode != SECOND_VECTOR_RING_BUFFER);
        -
        9185 
        -
        9186  if(!suballocations1st.empty())
        +
        9150  // All tests passed: Success. pOffset is already filled.
        +
        9151  return true;
        +
        9152 }
        +
        9153 
        +
        9154 void VmaBlockMetadata_Generic::MergeFreeWithNext(VmaSuballocationList::iterator item)
        +
        9155 {
        +
        9156  VMA_ASSERT(item != m_Suballocations.end());
        +
        9157  VMA_ASSERT(item->type == VMA_SUBALLOCATION_TYPE_FREE);
        +
        9158 
        +
        9159  VmaSuballocationList::iterator nextItem = item;
        +
        9160  ++nextItem;
        +
        9161  VMA_ASSERT(nextItem != m_Suballocations.end());
        +
        9162  VMA_ASSERT(nextItem->type == VMA_SUBALLOCATION_TYPE_FREE);
        +
        9163 
        +
        9164  item->size += nextItem->size;
        +
        9165  --m_FreeCount;
        +
        9166  m_Suballocations.erase(nextItem);
        +
        9167 }
        +
        9168 
        +
        9169 VmaSuballocationList::iterator VmaBlockMetadata_Generic::FreeSuballocation(VmaSuballocationList::iterator suballocItem)
        +
        9170 {
        +
        9171  // Change this suballocation to be marked as free.
        +
        9172  VmaSuballocation& suballoc = *suballocItem;
        +
        9173  suballoc.type = VMA_SUBALLOCATION_TYPE_FREE;
        +
        9174  suballoc.hAllocation = VK_NULL_HANDLE;
        +
        9175 
        +
        9176  // Update totals.
        +
        9177  ++m_FreeCount;
        +
        9178  m_SumFreeSize += suballoc.size;
        +
        9179 
        +
        9180  // Merge with previous and/or next suballocation if it's also free.
        +
        9181  bool mergeWithNext = false;
        +
        9182  bool mergeWithPrev = false;
        +
        9183 
        +
        9184  VmaSuballocationList::iterator nextItem = suballocItem;
        +
        9185  ++nextItem;
        +
        9186  if((nextItem != m_Suballocations.end()) && (nextItem->type == VMA_SUBALLOCATION_TYPE_FREE))
        9187  {
        -
        9188  // Null item at the beginning should be accounted into m_1stNullItemsBeginCount.
        -
        9189  VMA_VALIDATE(suballocations1st[m_1stNullItemsBeginCount].hAllocation != VK_NULL_HANDLE);
        -
        9190  // Null item at the end should be just pop_back().
        -
        9191  VMA_VALIDATE(suballocations1st.back().hAllocation != VK_NULL_HANDLE);
        -
        9192  }
        -
        9193  if(!suballocations2nd.empty())
        -
        9194  {
        -
        9195  // Null item at the end should be just pop_back().
        -
        9196  VMA_VALIDATE(suballocations2nd.back().hAllocation != VK_NULL_HANDLE);
        -
        9197  }
        -
        9198 
        -
        9199  VMA_VALIDATE(m_1stNullItemsBeginCount + m_1stNullItemsMiddleCount <= suballocations1st.size());
        -
        9200  VMA_VALIDATE(m_2ndNullItemsCount <= suballocations2nd.size());
        -
        9201 
        -
        9202  VkDeviceSize sumUsedSize = 0;
        -
        9203  const size_t suballoc1stCount = suballocations1st.size();
        -
        9204  VkDeviceSize offset = VMA_DEBUG_MARGIN;
        -
        9205 
        -
        9206  if(m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER)
        -
        9207  {
        -
        9208  const size_t suballoc2ndCount = suballocations2nd.size();
        -
        9209  size_t nullItem2ndCount = 0;
        -
        9210  for(size_t i = 0; i < suballoc2ndCount; ++i)
        -
        9211  {
        -
        9212  const VmaSuballocation& suballoc = suballocations2nd[i];
        -
        9213  const bool currFree = (suballoc.type == VMA_SUBALLOCATION_TYPE_FREE);
        -
        9214 
        -
        9215  VMA_VALIDATE(currFree == (suballoc.hAllocation == VK_NULL_HANDLE));
        -
        9216  VMA_VALIDATE(suballoc.offset >= offset);
        -
        9217 
        -
        9218  if(!currFree)
        -
        9219  {
        -
        9220  VMA_VALIDATE(suballoc.hAllocation->GetOffset() == suballoc.offset);
        -
        9221  VMA_VALIDATE(suballoc.hAllocation->GetSize() == suballoc.size);
        -
        9222  sumUsedSize += suballoc.size;
        -
        9223  }
        -
        9224  else
        -
        9225  {
        -
        9226  ++nullItem2ndCount;
        -
        9227  }
        -
        9228 
        -
        9229  offset = suballoc.offset + suballoc.size + VMA_DEBUG_MARGIN;
        -
        9230  }
        -
        9231 
        -
        9232  VMA_VALIDATE(nullItem2ndCount == m_2ndNullItemsCount);
        -
        9233  }
        -
        9234 
        -
        9235  for(size_t i = 0; i < m_1stNullItemsBeginCount; ++i)
        -
        9236  {
        -
        9237  const VmaSuballocation& suballoc = suballocations1st[i];
        -
        9238  VMA_VALIDATE(suballoc.type == VMA_SUBALLOCATION_TYPE_FREE &&
        -
        9239  suballoc.hAllocation == VK_NULL_HANDLE);
        +
        9188  mergeWithNext = true;
        +
        9189  }
        +
        9190 
        +
        9191  VmaSuballocationList::iterator prevItem = suballocItem;
        +
        9192  if(suballocItem != m_Suballocations.begin())
        +
        9193  {
        +
        9194  --prevItem;
        +
        9195  if(prevItem->type == VMA_SUBALLOCATION_TYPE_FREE)
        +
        9196  {
        +
        9197  mergeWithPrev = true;
        +
        9198  }
        +
        9199  }
        +
        9200 
        +
        9201  if(mergeWithNext)
        +
        9202  {
        +
        9203  UnregisterFreeSuballocation(nextItem);
        +
        9204  MergeFreeWithNext(suballocItem);
        +
        9205  }
        +
        9206 
        +
        9207  if(mergeWithPrev)
        +
        9208  {
        +
        9209  UnregisterFreeSuballocation(prevItem);
        +
        9210  MergeFreeWithNext(prevItem);
        +
        9211  RegisterFreeSuballocation(prevItem);
        +
        9212  return prevItem;
        +
        9213  }
        +
        9214  else
        +
        9215  {
        +
        9216  RegisterFreeSuballocation(suballocItem);
        +
        9217  return suballocItem;
        +
        9218  }
        +
        9219 }
        +
        9220 
        +
        9221 void VmaBlockMetadata_Generic::RegisterFreeSuballocation(VmaSuballocationList::iterator item)
        +
        9222 {
        +
        9223  VMA_ASSERT(item->type == VMA_SUBALLOCATION_TYPE_FREE);
        +
        9224  VMA_ASSERT(item->size > 0);
        +
        9225 
        +
        9226  // You may want to enable this validation at the beginning or at the end of
        +
        9227  // this function, depending on what do you want to check.
        +
        9228  VMA_HEAVY_ASSERT(ValidateFreeSuballocationList());
        +
        9229 
        +
        9230  if(item->size >= VMA_MIN_FREE_SUBALLOCATION_SIZE_TO_REGISTER)
        +
        9231  {
        +
        9232  if(m_FreeSuballocationsBySize.empty())
        +
        9233  {
        +
        9234  m_FreeSuballocationsBySize.push_back(item);
        +
        9235  }
        +
        9236  else
        +
        9237  {
        +
        9238  VmaVectorInsertSorted<VmaSuballocationItemSizeLess>(m_FreeSuballocationsBySize, item);
        +
        9239  }
        9240  }
        9241 
        -
        9242  size_t nullItem1stCount = m_1stNullItemsBeginCount;
        -
        9243 
        -
        9244  for(size_t i = m_1stNullItemsBeginCount; i < suballoc1stCount; ++i)
        -
        9245  {
        -
        9246  const VmaSuballocation& suballoc = suballocations1st[i];
        -
        9247  const bool currFree = (suballoc.type == VMA_SUBALLOCATION_TYPE_FREE);
        -
        9248 
        -
        9249  VMA_VALIDATE(currFree == (suballoc.hAllocation == VK_NULL_HANDLE));
        -
        9250  VMA_VALIDATE(suballoc.offset >= offset);
        -
        9251  VMA_VALIDATE(i >= m_1stNullItemsBeginCount || currFree);
        -
        9252 
        -
        9253  if(!currFree)
        -
        9254  {
        -
        9255  VMA_VALIDATE(suballoc.hAllocation->GetOffset() == suballoc.offset);
        -
        9256  VMA_VALIDATE(suballoc.hAllocation->GetSize() == suballoc.size);
        -
        9257  sumUsedSize += suballoc.size;
        -
        9258  }
        -
        9259  else
        -
        9260  {
        -
        9261  ++nullItem1stCount;
        -
        9262  }
        -
        9263 
        -
        9264  offset = suballoc.offset + suballoc.size + VMA_DEBUG_MARGIN;
        -
        9265  }
        -
        9266  VMA_VALIDATE(nullItem1stCount == m_1stNullItemsBeginCount + m_1stNullItemsMiddleCount);
        -
        9267 
        -
        9268  if(m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK)
        -
        9269  {
        -
        9270  const size_t suballoc2ndCount = suballocations2nd.size();
        -
        9271  size_t nullItem2ndCount = 0;
        -
        9272  for(size_t i = suballoc2ndCount; i--; )
        -
        9273  {
        -
        9274  const VmaSuballocation& suballoc = suballocations2nd[i];
        -
        9275  const bool currFree = (suballoc.type == VMA_SUBALLOCATION_TYPE_FREE);
        -
        9276 
        -
        9277  VMA_VALIDATE(currFree == (suballoc.hAllocation == VK_NULL_HANDLE));
        -
        9278  VMA_VALIDATE(suballoc.offset >= offset);
        -
        9279 
        -
        9280  if(!currFree)
        -
        9281  {
        -
        9282  VMA_VALIDATE(suballoc.hAllocation->GetOffset() == suballoc.offset);
        -
        9283  VMA_VALIDATE(suballoc.hAllocation->GetSize() == suballoc.size);
        -
        9284  sumUsedSize += suballoc.size;
        -
        9285  }
        -
        9286  else
        -
        9287  {
        -
        9288  ++nullItem2ndCount;
        -
        9289  }
        -
        9290 
        -
        9291  offset = suballoc.offset + suballoc.size + VMA_DEBUG_MARGIN;
        -
        9292  }
        -
        9293 
        -
        9294  VMA_VALIDATE(nullItem2ndCount == m_2ndNullItemsCount);
        -
        9295  }
        -
        9296 
        -
        9297  VMA_VALIDATE(offset <= GetSize());
        -
        9298  VMA_VALIDATE(m_SumFreeSize == GetSize() - sumUsedSize);
        -
        9299 
        -
        9300  return true;
        -
        9301 }
        -
        9302 
        -
        9303 size_t VmaBlockMetadata_Linear::GetAllocationCount() const
        -
        9304 {
        -
        9305  return AccessSuballocations1st().size() - (m_1stNullItemsBeginCount + m_1stNullItemsMiddleCount) +
        -
        9306  AccessSuballocations2nd().size() - m_2ndNullItemsCount;
        +
        9242  //VMA_HEAVY_ASSERT(ValidateFreeSuballocationList());
        +
        9243 }
        +
        9244 
        +
        9245 
        +
        9246 void VmaBlockMetadata_Generic::UnregisterFreeSuballocation(VmaSuballocationList::iterator item)
        +
        9247 {
        +
        9248  VMA_ASSERT(item->type == VMA_SUBALLOCATION_TYPE_FREE);
        +
        9249  VMA_ASSERT(item->size > 0);
        +
        9250 
        +
        9251  // You may want to enable this validation at the beginning or at the end of
        +
        9252  // this function, depending on what do you want to check.
        +
        9253  VMA_HEAVY_ASSERT(ValidateFreeSuballocationList());
        +
        9254 
        +
        9255  if(item->size >= VMA_MIN_FREE_SUBALLOCATION_SIZE_TO_REGISTER)
        +
        9256  {
        +
        9257  VmaSuballocationList::iterator* const it = VmaBinaryFindFirstNotLess(
        +
        9258  m_FreeSuballocationsBySize.data(),
        +
        9259  m_FreeSuballocationsBySize.data() + m_FreeSuballocationsBySize.size(),
        +
        9260  item,
        +
        9261  VmaSuballocationItemSizeLess());
        +
        9262  for(size_t index = it - m_FreeSuballocationsBySize.data();
        +
        9263  index < m_FreeSuballocationsBySize.size();
        +
        9264  ++index)
        +
        9265  {
        +
        9266  if(m_FreeSuballocationsBySize[index] == item)
        +
        9267  {
        +
        9268  VmaVectorRemove(m_FreeSuballocationsBySize, index);
        +
        9269  return;
        +
        9270  }
        +
        9271  VMA_ASSERT((m_FreeSuballocationsBySize[index]->size == item->size) && "Not found.");
        +
        9272  }
        +
        9273  VMA_ASSERT(0 && "Not found.");
        +
        9274  }
        +
        9275 
        +
        9276  //VMA_HEAVY_ASSERT(ValidateFreeSuballocationList());
        +
        9277 }
        +
        9278 
        +
        9279 bool VmaBlockMetadata_Generic::IsBufferImageGranularityConflictPossible(
        +
        9280  VkDeviceSize bufferImageGranularity,
        +
        9281  VmaSuballocationType& inOutPrevSuballocType) const
        +
        9282 {
        +
        9283  if(bufferImageGranularity == 1 || IsEmpty())
        +
        9284  {
        +
        9285  return false;
        +
        9286  }
        +
        9287 
        +
        9288  VkDeviceSize minAlignment = VK_WHOLE_SIZE;
        +
        9289  bool typeConflictFound = false;
        +
        9290  for(VmaSuballocationList::const_iterator it = m_Suballocations.cbegin();
        +
        9291  it != m_Suballocations.cend();
        +
        9292  ++it)
        +
        9293  {
        +
        9294  const VmaSuballocationType suballocType = it->type;
        +
        9295  if(suballocType != VMA_SUBALLOCATION_TYPE_FREE)
        +
        9296  {
        +
        9297  minAlignment = VMA_MIN(minAlignment, it->hAllocation->GetAlignment());
        +
        9298  if(VmaIsBufferImageGranularityConflict(inOutPrevSuballocType, suballocType))
        +
        9299  {
        +
        9300  typeConflictFound = true;
        +
        9301  }
        +
        9302  inOutPrevSuballocType = suballocType;
        +
        9303  }
        +
        9304  }
        +
        9305 
        +
        9306  return typeConflictFound || minAlignment >= bufferImageGranularity;
        9307 }
        9308 
        -
        9309 VkDeviceSize VmaBlockMetadata_Linear::GetUnusedRangeSizeMax() const
        -
        9310 {
        -
        9311  const VkDeviceSize size = GetSize();
        -
        9312 
        -
        9313  /*
        -
        9314  We don't consider gaps inside allocation vectors with freed allocations because
        -
        9315  they are not suitable for reuse in linear allocator. We consider only space that
        -
        9316  is available for new allocations.
        -
        9317  */
        -
        9318  if(IsEmpty())
        -
        9319  {
        -
        9320  return size;
        -
        9321  }
        -
        9322 
        -
        9323  const SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        +
        9310 // class VmaBlockMetadata_Linear
        +
        9311 
        +
        9312 VmaBlockMetadata_Linear::VmaBlockMetadata_Linear(VmaAllocator hAllocator) :
        +
        9313  VmaBlockMetadata(hAllocator),
        +
        9314  m_SumFreeSize(0),
        +
        9315  m_Suballocations0(VmaStlAllocator<VmaSuballocation>(hAllocator->GetAllocationCallbacks())),
        +
        9316  m_Suballocations1(VmaStlAllocator<VmaSuballocation>(hAllocator->GetAllocationCallbacks())),
        +
        9317  m_1stVectorIndex(0),
        +
        9318  m_2ndVectorMode(SECOND_VECTOR_EMPTY),
        +
        9319  m_1stNullItemsBeginCount(0),
        +
        9320  m_1stNullItemsMiddleCount(0),
        +
        9321  m_2ndNullItemsCount(0)
        +
        9322 {
        +
        9323 }
        9324 
        -
        9325  switch(m_2ndVectorMode)
        -
        9326  {
        -
        9327  case SECOND_VECTOR_EMPTY:
        -
        9328  /*
        -
        9329  Available space is after end of 1st, as well as before beginning of 1st (which
        -
        9330  whould make it a ring buffer).
        -
        9331  */
        -
        9332  {
        -
        9333  const size_t suballocations1stCount = suballocations1st.size();
        -
        9334  VMA_ASSERT(suballocations1stCount > m_1stNullItemsBeginCount);
        -
        9335  const VmaSuballocation& firstSuballoc = suballocations1st[m_1stNullItemsBeginCount];
        -
        9336  const VmaSuballocation& lastSuballoc = suballocations1st[suballocations1stCount - 1];
        -
        9337  return VMA_MAX(
        -
        9338  firstSuballoc.offset,
        -
        9339  size - (lastSuballoc.offset + lastSuballoc.size));
        -
        9340  }
        -
        9341  break;
        -
        9342 
        -
        9343  case SECOND_VECTOR_RING_BUFFER:
        -
        9344  /*
        -
        9345  Available space is only between end of 2nd and beginning of 1st.
        -
        9346  */
        -
        9347  {
        -
        9348  const SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        -
        9349  const VmaSuballocation& lastSuballoc2nd = suballocations2nd.back();
        -
        9350  const VmaSuballocation& firstSuballoc1st = suballocations1st[m_1stNullItemsBeginCount];
        -
        9351  return firstSuballoc1st.offset - (lastSuballoc2nd.offset + lastSuballoc2nd.size);
        -
        9352  }
        -
        9353  break;
        -
        9354 
        -
        9355  case SECOND_VECTOR_DOUBLE_STACK:
        -
        9356  /*
        -
        9357  Available space is only between end of 1st and top of 2nd.
        -
        9358  */
        -
        9359  {
        -
        9360  const SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        -
        9361  const VmaSuballocation& topSuballoc2nd = suballocations2nd.back();
        -
        9362  const VmaSuballocation& lastSuballoc1st = suballocations1st.back();
        -
        9363  return topSuballoc2nd.offset - (lastSuballoc1st.offset + lastSuballoc1st.size);
        -
        9364  }
        -
        9365  break;
        -
        9366 
        -
        9367  default:
        -
        9368  VMA_ASSERT(0);
        -
        9369  return 0;
        -
        9370  }
        -
        9371 }
        -
        9372 
        -
        9373 void VmaBlockMetadata_Linear::CalcAllocationStatInfo(VmaStatInfo& outInfo) const
        -
        9374 {
        -
        9375  const VkDeviceSize size = GetSize();
        -
        9376  const SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        -
        9377  const SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        -
        9378  const size_t suballoc1stCount = suballocations1st.size();
        -
        9379  const size_t suballoc2ndCount = suballocations2nd.size();
        -
        9380 
        -
        9381  outInfo.blockCount = 1;
        -
        9382  outInfo.allocationCount = (uint32_t)GetAllocationCount();
        -
        9383  outInfo.unusedRangeCount = 0;
        -
        9384  outInfo.usedBytes = 0;
        -
        9385  outInfo.allocationSizeMin = UINT64_MAX;
        -
        9386  outInfo.allocationSizeMax = 0;
        -
        9387  outInfo.unusedRangeSizeMin = UINT64_MAX;
        -
        9388  outInfo.unusedRangeSizeMax = 0;
        -
        9389 
        -
        9390  VkDeviceSize lastOffset = 0;
        -
        9391 
        -
        9392  if(m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER)
        -
        9393  {
        -
        9394  const VkDeviceSize freeSpace2ndTo1stEnd = suballocations1st[m_1stNullItemsBeginCount].offset;
        -
        9395  size_t nextAlloc2ndIndex = 0;
        -
        9396  while(lastOffset < freeSpace2ndTo1stEnd)
        -
        9397  {
        -
        9398  // Find next non-null allocation or move nextAllocIndex to the end.
        -
        9399  while(nextAlloc2ndIndex < suballoc2ndCount &&
        -
        9400  suballocations2nd[nextAlloc2ndIndex].hAllocation == VK_NULL_HANDLE)
        -
        9401  {
        -
        9402  ++nextAlloc2ndIndex;
        -
        9403  }
        -
        9404 
        -
        9405  // Found non-null allocation.
        -
        9406  if(nextAlloc2ndIndex < suballoc2ndCount)
        -
        9407  {
        -
        9408  const VmaSuballocation& suballoc = suballocations2nd[nextAlloc2ndIndex];
        -
        9409 
        -
        9410  // 1. Process free space before this allocation.
        -
        9411  if(lastOffset < suballoc.offset)
        -
        9412  {
        -
        9413  // There is free space from lastOffset to suballoc.offset.
        -
        9414  const VkDeviceSize unusedRangeSize = suballoc.offset - lastOffset;
        -
        9415  ++outInfo.unusedRangeCount;
        -
        9416  outInfo.unusedBytes += unusedRangeSize;
        -
        9417  outInfo.unusedRangeSizeMin = VMA_MIN(outInfo.unusedRangeSizeMin, unusedRangeSize);
        -
        9418  outInfo.unusedRangeSizeMax = VMA_MIN(outInfo.unusedRangeSizeMax, unusedRangeSize);
        -
        9419  }
        -
        9420 
        -
        9421  // 2. Process this allocation.
        -
        9422  // There is allocation with suballoc.offset, suballoc.size.
        -
        9423  outInfo.usedBytes += suballoc.size;
        -
        9424  outInfo.allocationSizeMin = VMA_MIN(outInfo.allocationSizeMin, suballoc.size);
        -
        9425  outInfo.allocationSizeMax = VMA_MIN(outInfo.allocationSizeMax, suballoc.size);
        -
        9426 
        -
        9427  // 3. Prepare for next iteration.
        -
        9428  lastOffset = suballoc.offset + suballoc.size;
        -
        9429  ++nextAlloc2ndIndex;
        -
        9430  }
        -
        9431  // We are at the end.
        -
        9432  else
        -
        9433  {
        -
        9434  // There is free space from lastOffset to freeSpace2ndTo1stEnd.
        -
        9435  if(lastOffset < freeSpace2ndTo1stEnd)
        -
        9436  {
        -
        9437  const VkDeviceSize unusedRangeSize = freeSpace2ndTo1stEnd - lastOffset;
        -
        9438  ++outInfo.unusedRangeCount;
        -
        9439  outInfo.unusedBytes += unusedRangeSize;
        -
        9440  outInfo.unusedRangeSizeMin = VMA_MIN(outInfo.unusedRangeSizeMin, unusedRangeSize);
        -
        9441  outInfo.unusedRangeSizeMax = VMA_MIN(outInfo.unusedRangeSizeMax, unusedRangeSize);
        -
        9442  }
        -
        9443 
        -
        9444  // End of loop.
        -
        9445  lastOffset = freeSpace2ndTo1stEnd;
        -
        9446  }
        -
        9447  }
        -
        9448  }
        +
        9325 VmaBlockMetadata_Linear::~VmaBlockMetadata_Linear()
        +
        9326 {
        +
        9327 }
        +
        9328 
        +
        9329 void VmaBlockMetadata_Linear::Init(VkDeviceSize size)
        +
        9330 {
        +
        9331  VmaBlockMetadata::Init(size);
        +
        9332  m_SumFreeSize = size;
        +
        9333 }
        +
        9334 
        +
        9335 bool VmaBlockMetadata_Linear::Validate() const
        +
        9336 {
        +
        9337  const SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        +
        9338  const SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        +
        9339 
        +
        9340  VMA_VALIDATE(suballocations2nd.empty() == (m_2ndVectorMode == SECOND_VECTOR_EMPTY));
        +
        9341  VMA_VALIDATE(!suballocations1st.empty() ||
        +
        9342  suballocations2nd.empty() ||
        +
        9343  m_2ndVectorMode != SECOND_VECTOR_RING_BUFFER);
        +
        9344 
        +
        9345  if(!suballocations1st.empty())
        +
        9346  {
        +
        9347  // Null item at the beginning should be accounted into m_1stNullItemsBeginCount.
        +
        9348  VMA_VALIDATE(suballocations1st[m_1stNullItemsBeginCount].hAllocation != VK_NULL_HANDLE);
        +
        9349  // Null item at the end should be just pop_back().
        +
        9350  VMA_VALIDATE(suballocations1st.back().hAllocation != VK_NULL_HANDLE);
        +
        9351  }
        +
        9352  if(!suballocations2nd.empty())
        +
        9353  {
        +
        9354  // Null item at the end should be just pop_back().
        +
        9355  VMA_VALIDATE(suballocations2nd.back().hAllocation != VK_NULL_HANDLE);
        +
        9356  }
        +
        9357 
        +
        9358  VMA_VALIDATE(m_1stNullItemsBeginCount + m_1stNullItemsMiddleCount <= suballocations1st.size());
        +
        9359  VMA_VALIDATE(m_2ndNullItemsCount <= suballocations2nd.size());
        +
        9360 
        +
        9361  VkDeviceSize sumUsedSize = 0;
        +
        9362  const size_t suballoc1stCount = suballocations1st.size();
        +
        9363  VkDeviceSize offset = VMA_DEBUG_MARGIN;
        +
        9364 
        +
        9365  if(m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER)
        +
        9366  {
        +
        9367  const size_t suballoc2ndCount = suballocations2nd.size();
        +
        9368  size_t nullItem2ndCount = 0;
        +
        9369  for(size_t i = 0; i < suballoc2ndCount; ++i)
        +
        9370  {
        +
        9371  const VmaSuballocation& suballoc = suballocations2nd[i];
        +
        9372  const bool currFree = (suballoc.type == VMA_SUBALLOCATION_TYPE_FREE);
        +
        9373 
        +
        9374  VMA_VALIDATE(currFree == (suballoc.hAllocation == VK_NULL_HANDLE));
        +
        9375  VMA_VALIDATE(suballoc.offset >= offset);
        +
        9376 
        +
        9377  if(!currFree)
        +
        9378  {
        +
        9379  VMA_VALIDATE(suballoc.hAllocation->GetOffset() == suballoc.offset);
        +
        9380  VMA_VALIDATE(suballoc.hAllocation->GetSize() == suballoc.size);
        +
        9381  sumUsedSize += suballoc.size;
        +
        9382  }
        +
        9383  else
        +
        9384  {
        +
        9385  ++nullItem2ndCount;
        +
        9386  }
        +
        9387 
        +
        9388  offset = suballoc.offset + suballoc.size + VMA_DEBUG_MARGIN;
        +
        9389  }
        +
        9390 
        +
        9391  VMA_VALIDATE(nullItem2ndCount == m_2ndNullItemsCount);
        +
        9392  }
        +
        9393 
        +
        9394  for(size_t i = 0; i < m_1stNullItemsBeginCount; ++i)
        +
        9395  {
        +
        9396  const VmaSuballocation& suballoc = suballocations1st[i];
        +
        9397  VMA_VALIDATE(suballoc.type == VMA_SUBALLOCATION_TYPE_FREE &&
        +
        9398  suballoc.hAllocation == VK_NULL_HANDLE);
        +
        9399  }
        +
        9400 
        +
        9401  size_t nullItem1stCount = m_1stNullItemsBeginCount;
        +
        9402 
        +
        9403  for(size_t i = m_1stNullItemsBeginCount; i < suballoc1stCount; ++i)
        +
        9404  {
        +
        9405  const VmaSuballocation& suballoc = suballocations1st[i];
        +
        9406  const bool currFree = (suballoc.type == VMA_SUBALLOCATION_TYPE_FREE);
        +
        9407 
        +
        9408  VMA_VALIDATE(currFree == (suballoc.hAllocation == VK_NULL_HANDLE));
        +
        9409  VMA_VALIDATE(suballoc.offset >= offset);
        +
        9410  VMA_VALIDATE(i >= m_1stNullItemsBeginCount || currFree);
        +
        9411 
        +
        9412  if(!currFree)
        +
        9413  {
        +
        9414  VMA_VALIDATE(suballoc.hAllocation->GetOffset() == suballoc.offset);
        +
        9415  VMA_VALIDATE(suballoc.hAllocation->GetSize() == suballoc.size);
        +
        9416  sumUsedSize += suballoc.size;
        +
        9417  }
        +
        9418  else
        +
        9419  {
        +
        9420  ++nullItem1stCount;
        +
        9421  }
        +
        9422 
        +
        9423  offset = suballoc.offset + suballoc.size + VMA_DEBUG_MARGIN;
        +
        9424  }
        +
        9425  VMA_VALIDATE(nullItem1stCount == m_1stNullItemsBeginCount + m_1stNullItemsMiddleCount);
        +
        9426 
        +
        9427  if(m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK)
        +
        9428  {
        +
        9429  const size_t suballoc2ndCount = suballocations2nd.size();
        +
        9430  size_t nullItem2ndCount = 0;
        +
        9431  for(size_t i = suballoc2ndCount; i--; )
        +
        9432  {
        +
        9433  const VmaSuballocation& suballoc = suballocations2nd[i];
        +
        9434  const bool currFree = (suballoc.type == VMA_SUBALLOCATION_TYPE_FREE);
        +
        9435 
        +
        9436  VMA_VALIDATE(currFree == (suballoc.hAllocation == VK_NULL_HANDLE));
        +
        9437  VMA_VALIDATE(suballoc.offset >= offset);
        +
        9438 
        +
        9439  if(!currFree)
        +
        9440  {
        +
        9441  VMA_VALIDATE(suballoc.hAllocation->GetOffset() == suballoc.offset);
        +
        9442  VMA_VALIDATE(suballoc.hAllocation->GetSize() == suballoc.size);
        +
        9443  sumUsedSize += suballoc.size;
        +
        9444  }
        +
        9445  else
        +
        9446  {
        +
        9447  ++nullItem2ndCount;
        +
        9448  }
        9449 
        -
        9450  size_t nextAlloc1stIndex = m_1stNullItemsBeginCount;
        -
        9451  const VkDeviceSize freeSpace1stTo2ndEnd =
        -
        9452  m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK ? suballocations2nd.back().offset : size;
        -
        9453  while(lastOffset < freeSpace1stTo2ndEnd)
        -
        9454  {
        -
        9455  // Find next non-null allocation or move nextAllocIndex to the end.
        -
        9456  while(nextAlloc1stIndex < suballoc1stCount &&
        -
        9457  suballocations1st[nextAlloc1stIndex].hAllocation == VK_NULL_HANDLE)
        -
        9458  {
        -
        9459  ++nextAlloc1stIndex;
        -
        9460  }
        +
        9450  offset = suballoc.offset + suballoc.size + VMA_DEBUG_MARGIN;
        +
        9451  }
        +
        9452 
        +
        9453  VMA_VALIDATE(nullItem2ndCount == m_2ndNullItemsCount);
        +
        9454  }
        +
        9455 
        +
        9456  VMA_VALIDATE(offset <= GetSize());
        +
        9457  VMA_VALIDATE(m_SumFreeSize == GetSize() - sumUsedSize);
        +
        9458 
        +
        9459  return true;
        +
        9460 }
        9461 
        -
        9462  // Found non-null allocation.
        -
        9463  if(nextAlloc1stIndex < suballoc1stCount)
        -
        9464  {
        -
        9465  const VmaSuballocation& suballoc = suballocations1st[nextAlloc1stIndex];
        -
        9466 
        -
        9467  // 1. Process free space before this allocation.
        -
        9468  if(lastOffset < suballoc.offset)
        -
        9469  {
        -
        9470  // There is free space from lastOffset to suballoc.offset.
        -
        9471  const VkDeviceSize unusedRangeSize = suballoc.offset - lastOffset;
        -
        9472  ++outInfo.unusedRangeCount;
        -
        9473  outInfo.unusedBytes += unusedRangeSize;
        -
        9474  outInfo.unusedRangeSizeMin = VMA_MIN(outInfo.unusedRangeSizeMin, unusedRangeSize);
        -
        9475  outInfo.unusedRangeSizeMax = VMA_MIN(outInfo.unusedRangeSizeMax, unusedRangeSize);
        -
        9476  }
        -
        9477 
        -
        9478  // 2. Process this allocation.
        -
        9479  // There is allocation with suballoc.offset, suballoc.size.
        -
        9480  outInfo.usedBytes += suballoc.size;
        -
        9481  outInfo.allocationSizeMin = VMA_MIN(outInfo.allocationSizeMin, suballoc.size);
        -
        9482  outInfo.allocationSizeMax = VMA_MIN(outInfo.allocationSizeMax, suballoc.size);
        -
        9483 
        -
        9484  // 3. Prepare for next iteration.
        -
        9485  lastOffset = suballoc.offset + suballoc.size;
        -
        9486  ++nextAlloc1stIndex;
        -
        9487  }
        -
        9488  // We are at the end.
        -
        9489  else
        -
        9490  {
        -
        9491  // There is free space from lastOffset to freeSpace1stTo2ndEnd.
        -
        9492  if(lastOffset < freeSpace1stTo2ndEnd)
        -
        9493  {
        -
        9494  const VkDeviceSize unusedRangeSize = freeSpace1stTo2ndEnd - lastOffset;
        -
        9495  ++outInfo.unusedRangeCount;
        -
        9496  outInfo.unusedBytes += unusedRangeSize;
        -
        9497  outInfo.unusedRangeSizeMin = VMA_MIN(outInfo.unusedRangeSizeMin, unusedRangeSize);
        -
        9498  outInfo.unusedRangeSizeMax = VMA_MIN(outInfo.unusedRangeSizeMax, unusedRangeSize);
        -
        9499  }
        -
        9500 
        -
        9501  // End of loop.
        -
        9502  lastOffset = freeSpace1stTo2ndEnd;
        -
        9503  }
        -
        9504  }
        -
        9505 
        -
        9506  if(m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK)
        -
        9507  {
        -
        9508  size_t nextAlloc2ndIndex = suballocations2nd.size() - 1;
        -
        9509  while(lastOffset < size)
        -
        9510  {
        -
        9511  // Find next non-null allocation or move nextAllocIndex to the end.
        -
        9512  while(nextAlloc2ndIndex != SIZE_MAX &&
        -
        9513  suballocations2nd[nextAlloc2ndIndex].hAllocation == VK_NULL_HANDLE)
        -
        9514  {
        -
        9515  --nextAlloc2ndIndex;
        -
        9516  }
        -
        9517 
        -
        9518  // Found non-null allocation.
        -
        9519  if(nextAlloc2ndIndex != SIZE_MAX)
        -
        9520  {
        -
        9521  const VmaSuballocation& suballoc = suballocations2nd[nextAlloc2ndIndex];
        -
        9522 
        -
        9523  // 1. Process free space before this allocation.
        -
        9524  if(lastOffset < suballoc.offset)
        -
        9525  {
        -
        9526  // There is free space from lastOffset to suballoc.offset.
        -
        9527  const VkDeviceSize unusedRangeSize = suballoc.offset - lastOffset;
        -
        9528  ++outInfo.unusedRangeCount;
        -
        9529  outInfo.unusedBytes += unusedRangeSize;
        -
        9530  outInfo.unusedRangeSizeMin = VMA_MIN(outInfo.unusedRangeSizeMin, unusedRangeSize);
        -
        9531  outInfo.unusedRangeSizeMax = VMA_MIN(outInfo.unusedRangeSizeMax, unusedRangeSize);
        -
        9532  }
        -
        9533 
        -
        9534  // 2. Process this allocation.
        -
        9535  // There is allocation with suballoc.offset, suballoc.size.
        -
        9536  outInfo.usedBytes += suballoc.size;
        -
        9537  outInfo.allocationSizeMin = VMA_MIN(outInfo.allocationSizeMin, suballoc.size);
        -
        9538  outInfo.allocationSizeMax = VMA_MIN(outInfo.allocationSizeMax, suballoc.size);
        -
        9539 
        -
        9540  // 3. Prepare for next iteration.
        -
        9541  lastOffset = suballoc.offset + suballoc.size;
        -
        9542  --nextAlloc2ndIndex;
        -
        9543  }
        -
        9544  // We are at the end.
        -
        9545  else
        -
        9546  {
        -
        9547  // There is free space from lastOffset to size.
        -
        9548  if(lastOffset < size)
        -
        9549  {
        -
        9550  const VkDeviceSize unusedRangeSize = size - lastOffset;
        -
        9551  ++outInfo.unusedRangeCount;
        -
        9552  outInfo.unusedBytes += unusedRangeSize;
        -
        9553  outInfo.unusedRangeSizeMin = VMA_MIN(outInfo.unusedRangeSizeMin, unusedRangeSize);
        -
        9554  outInfo.unusedRangeSizeMax = VMA_MIN(outInfo.unusedRangeSizeMax, unusedRangeSize);
        -
        9555  }
        -
        9556 
        -
        9557  // End of loop.
        -
        9558  lastOffset = size;
        -
        9559  }
        -
        9560  }
        -
        9561  }
        -
        9562 
        -
        9563  outInfo.unusedBytes = size - outInfo.usedBytes;
        -
        9564 }
        -
        9565 
        -
        9566 void VmaBlockMetadata_Linear::AddPoolStats(VmaPoolStats& inoutStats) const
        -
        9567 {
        -
        9568  const SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        -
        9569  const SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        -
        9570  const VkDeviceSize size = GetSize();
        -
        9571  const size_t suballoc1stCount = suballocations1st.size();
        -
        9572  const size_t suballoc2ndCount = suballocations2nd.size();
        -
        9573 
        -
        9574  inoutStats.size += size;
        -
        9575 
        -
        9576  VkDeviceSize lastOffset = 0;
        -
        9577 
        -
        9578  if(m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER)
        -
        9579  {
        -
        9580  const VkDeviceSize freeSpace2ndTo1stEnd = suballocations1st[m_1stNullItemsBeginCount].offset;
        -
        9581  size_t nextAlloc2ndIndex = m_1stNullItemsBeginCount;
        -
        9582  while(lastOffset < freeSpace2ndTo1stEnd)
        -
        9583  {
        -
        9584  // Find next non-null allocation or move nextAlloc2ndIndex to the end.
        -
        9585  while(nextAlloc2ndIndex < suballoc2ndCount &&
        -
        9586  suballocations2nd[nextAlloc2ndIndex].hAllocation == VK_NULL_HANDLE)
        -
        9587  {
        +
        9462 size_t VmaBlockMetadata_Linear::GetAllocationCount() const
        +
        9463 {
        +
        9464  return AccessSuballocations1st().size() - (m_1stNullItemsBeginCount + m_1stNullItemsMiddleCount) +
        +
        9465  AccessSuballocations2nd().size() - m_2ndNullItemsCount;
        +
        9466 }
        +
        9467 
        +
        9468 VkDeviceSize VmaBlockMetadata_Linear::GetUnusedRangeSizeMax() const
        +
        9469 {
        +
        9470  const VkDeviceSize size = GetSize();
        +
        9471 
        +
        9472  /*
        +
        9473  We don't consider gaps inside allocation vectors with freed allocations because
        +
        9474  they are not suitable for reuse in linear allocator. We consider only space that
        +
        9475  is available for new allocations.
        +
        9476  */
        +
        9477  if(IsEmpty())
        +
        9478  {
        +
        9479  return size;
        +
        9480  }
        +
        9481 
        +
        9482  const SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        +
        9483 
        +
        9484  switch(m_2ndVectorMode)
        +
        9485  {
        +
        9486  case SECOND_VECTOR_EMPTY:
        +
        9487  /*
        +
        9488  Available space is after end of 1st, as well as before beginning of 1st (which
        +
        9489  whould make it a ring buffer).
        +
        9490  */
        +
        9491  {
        +
        9492  const size_t suballocations1stCount = suballocations1st.size();
        +
        9493  VMA_ASSERT(suballocations1stCount > m_1stNullItemsBeginCount);
        +
        9494  const VmaSuballocation& firstSuballoc = suballocations1st[m_1stNullItemsBeginCount];
        +
        9495  const VmaSuballocation& lastSuballoc = suballocations1st[suballocations1stCount - 1];
        +
        9496  return VMA_MAX(
        +
        9497  firstSuballoc.offset,
        +
        9498  size - (lastSuballoc.offset + lastSuballoc.size));
        +
        9499  }
        +
        9500  break;
        +
        9501 
        +
        9502  case SECOND_VECTOR_RING_BUFFER:
        +
        9503  /*
        +
        9504  Available space is only between end of 2nd and beginning of 1st.
        +
        9505  */
        +
        9506  {
        +
        9507  const SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        +
        9508  const VmaSuballocation& lastSuballoc2nd = suballocations2nd.back();
        +
        9509  const VmaSuballocation& firstSuballoc1st = suballocations1st[m_1stNullItemsBeginCount];
        +
        9510  return firstSuballoc1st.offset - (lastSuballoc2nd.offset + lastSuballoc2nd.size);
        +
        9511  }
        +
        9512  break;
        +
        9513 
        +
        9514  case SECOND_VECTOR_DOUBLE_STACK:
        +
        9515  /*
        +
        9516  Available space is only between end of 1st and top of 2nd.
        +
        9517  */
        +
        9518  {
        +
        9519  const SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        +
        9520  const VmaSuballocation& topSuballoc2nd = suballocations2nd.back();
        +
        9521  const VmaSuballocation& lastSuballoc1st = suballocations1st.back();
        +
        9522  return topSuballoc2nd.offset - (lastSuballoc1st.offset + lastSuballoc1st.size);
        +
        9523  }
        +
        9524  break;
        +
        9525 
        +
        9526  default:
        +
        9527  VMA_ASSERT(0);
        +
        9528  return 0;
        +
        9529  }
        +
        9530 }
        +
        9531 
        +
        9532 void VmaBlockMetadata_Linear::CalcAllocationStatInfo(VmaStatInfo& outInfo) const
        +
        9533 {
        +
        9534  const VkDeviceSize size = GetSize();
        +
        9535  const SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        +
        9536  const SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        +
        9537  const size_t suballoc1stCount = suballocations1st.size();
        +
        9538  const size_t suballoc2ndCount = suballocations2nd.size();
        +
        9539 
        +
        9540  outInfo.blockCount = 1;
        +
        9541  outInfo.allocationCount = (uint32_t)GetAllocationCount();
        +
        9542  outInfo.unusedRangeCount = 0;
        +
        9543  outInfo.usedBytes = 0;
        +
        9544  outInfo.allocationSizeMin = UINT64_MAX;
        +
        9545  outInfo.allocationSizeMax = 0;
        +
        9546  outInfo.unusedRangeSizeMin = UINT64_MAX;
        +
        9547  outInfo.unusedRangeSizeMax = 0;
        +
        9548 
        +
        9549  VkDeviceSize lastOffset = 0;
        +
        9550 
        +
        9551  if(m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER)
        +
        9552  {
        +
        9553  const VkDeviceSize freeSpace2ndTo1stEnd = suballocations1st[m_1stNullItemsBeginCount].offset;
        +
        9554  size_t nextAlloc2ndIndex = 0;
        +
        9555  while(lastOffset < freeSpace2ndTo1stEnd)
        +
        9556  {
        +
        9557  // Find next non-null allocation or move nextAllocIndex to the end.
        +
        9558  while(nextAlloc2ndIndex < suballoc2ndCount &&
        +
        9559  suballocations2nd[nextAlloc2ndIndex].hAllocation == VK_NULL_HANDLE)
        +
        9560  {
        +
        9561  ++nextAlloc2ndIndex;
        +
        9562  }
        +
        9563 
        +
        9564  // Found non-null allocation.
        +
        9565  if(nextAlloc2ndIndex < suballoc2ndCount)
        +
        9566  {
        +
        9567  const VmaSuballocation& suballoc = suballocations2nd[nextAlloc2ndIndex];
        +
        9568 
        +
        9569  // 1. Process free space before this allocation.
        +
        9570  if(lastOffset < suballoc.offset)
        +
        9571  {
        +
        9572  // There is free space from lastOffset to suballoc.offset.
        +
        9573  const VkDeviceSize unusedRangeSize = suballoc.offset - lastOffset;
        +
        9574  ++outInfo.unusedRangeCount;
        +
        9575  outInfo.unusedBytes += unusedRangeSize;
        +
        9576  outInfo.unusedRangeSizeMin = VMA_MIN(outInfo.unusedRangeSizeMin, unusedRangeSize);
        +
        9577  outInfo.unusedRangeSizeMax = VMA_MIN(outInfo.unusedRangeSizeMax, unusedRangeSize);
        +
        9578  }
        +
        9579 
        +
        9580  // 2. Process this allocation.
        +
        9581  // There is allocation with suballoc.offset, suballoc.size.
        +
        9582  outInfo.usedBytes += suballoc.size;
        +
        9583  outInfo.allocationSizeMin = VMA_MIN(outInfo.allocationSizeMin, suballoc.size);
        +
        9584  outInfo.allocationSizeMax = VMA_MIN(outInfo.allocationSizeMax, suballoc.size);
        +
        9585 
        +
        9586  // 3. Prepare for next iteration.
        +
        9587  lastOffset = suballoc.offset + suballoc.size;
        9588  ++nextAlloc2ndIndex;
        9589  }
        -
        9590 
        -
        9591  // Found non-null allocation.
        -
        9592  if(nextAlloc2ndIndex < suballoc2ndCount)
        -
        9593  {
        -
        9594  const VmaSuballocation& suballoc = suballocations2nd[nextAlloc2ndIndex];
        -
        9595 
        -
        9596  // 1. Process free space before this allocation.
        -
        9597  if(lastOffset < suballoc.offset)
        -
        9598  {
        -
        9599  // There is free space from lastOffset to suballoc.offset.
        -
        9600  const VkDeviceSize unusedRangeSize = suballoc.offset - lastOffset;
        -
        9601  inoutStats.unusedSize += unusedRangeSize;
        -
        9602  ++inoutStats.unusedRangeCount;
        -
        9603  inoutStats.unusedRangeSizeMax = VMA_MAX(inoutStats.unusedRangeSizeMax, unusedRangeSize);
        -
        9604  }
        -
        9605 
        -
        9606  // 2. Process this allocation.
        -
        9607  // There is allocation with suballoc.offset, suballoc.size.
        -
        9608  ++inoutStats.allocationCount;
        -
        9609 
        -
        9610  // 3. Prepare for next iteration.
        -
        9611  lastOffset = suballoc.offset + suballoc.size;
        -
        9612  ++nextAlloc2ndIndex;
        -
        9613  }
        -
        9614  // We are at the end.
        -
        9615  else
        -
        9616  {
        -
        9617  if(lastOffset < freeSpace2ndTo1stEnd)
        -
        9618  {
        -
        9619  // There is free space from lastOffset to freeSpace2ndTo1stEnd.
        -
        9620  const VkDeviceSize unusedRangeSize = freeSpace2ndTo1stEnd - lastOffset;
        -
        9621  inoutStats.unusedSize += unusedRangeSize;
        -
        9622  ++inoutStats.unusedRangeCount;
        -
        9623  inoutStats.unusedRangeSizeMax = VMA_MAX(inoutStats.unusedRangeSizeMax, unusedRangeSize);
        -
        9624  }
        -
        9625 
        -
        9626  // End of loop.
        -
        9627  lastOffset = freeSpace2ndTo1stEnd;
        -
        9628  }
        -
        9629  }
        -
        9630  }
        -
        9631 
        -
        9632  size_t nextAlloc1stIndex = m_1stNullItemsBeginCount;
        -
        9633  const VkDeviceSize freeSpace1stTo2ndEnd =
        -
        9634  m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK ? suballocations2nd.back().offset : size;
        -
        9635  while(lastOffset < freeSpace1stTo2ndEnd)
        -
        9636  {
        -
        9637  // Find next non-null allocation or move nextAllocIndex to the end.
        -
        9638  while(nextAlloc1stIndex < suballoc1stCount &&
        -
        9639  suballocations1st[nextAlloc1stIndex].hAllocation == VK_NULL_HANDLE)
        -
        9640  {
        -
        9641  ++nextAlloc1stIndex;
        -
        9642  }
        -
        9643 
        -
        9644  // Found non-null allocation.
        -
        9645  if(nextAlloc1stIndex < suballoc1stCount)
        -
        9646  {
        -
        9647  const VmaSuballocation& suballoc = suballocations1st[nextAlloc1stIndex];
        -
        9648 
        -
        9649  // 1. Process free space before this allocation.
        -
        9650  if(lastOffset < suballoc.offset)
        -
        9651  {
        -
        9652  // There is free space from lastOffset to suballoc.offset.
        -
        9653  const VkDeviceSize unusedRangeSize = suballoc.offset - lastOffset;
        -
        9654  inoutStats.unusedSize += unusedRangeSize;
        -
        9655  ++inoutStats.unusedRangeCount;
        -
        9656  inoutStats.unusedRangeSizeMax = VMA_MAX(inoutStats.unusedRangeSizeMax, unusedRangeSize);
        -
        9657  }
        -
        9658 
        -
        9659  // 2. Process this allocation.
        -
        9660  // There is allocation with suballoc.offset, suballoc.size.
        -
        9661  ++inoutStats.allocationCount;
        -
        9662 
        -
        9663  // 3. Prepare for next iteration.
        -
        9664  lastOffset = suballoc.offset + suballoc.size;
        -
        9665  ++nextAlloc1stIndex;
        -
        9666  }
        -
        9667  // We are at the end.
        -
        9668  else
        +
        9590  // We are at the end.
        +
        9591  else
        +
        9592  {
        +
        9593  // There is free space from lastOffset to freeSpace2ndTo1stEnd.
        +
        9594  if(lastOffset < freeSpace2ndTo1stEnd)
        +
        9595  {
        +
        9596  const VkDeviceSize unusedRangeSize = freeSpace2ndTo1stEnd - lastOffset;
        +
        9597  ++outInfo.unusedRangeCount;
        +
        9598  outInfo.unusedBytes += unusedRangeSize;
        +
        9599  outInfo.unusedRangeSizeMin = VMA_MIN(outInfo.unusedRangeSizeMin, unusedRangeSize);
        +
        9600  outInfo.unusedRangeSizeMax = VMA_MIN(outInfo.unusedRangeSizeMax, unusedRangeSize);
        +
        9601  }
        +
        9602 
        +
        9603  // End of loop.
        +
        9604  lastOffset = freeSpace2ndTo1stEnd;
        +
        9605  }
        +
        9606  }
        +
        9607  }
        +
        9608 
        +
        9609  size_t nextAlloc1stIndex = m_1stNullItemsBeginCount;
        +
        9610  const VkDeviceSize freeSpace1stTo2ndEnd =
        +
        9611  m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK ? suballocations2nd.back().offset : size;
        +
        9612  while(lastOffset < freeSpace1stTo2ndEnd)
        +
        9613  {
        +
        9614  // Find next non-null allocation or move nextAllocIndex to the end.
        +
        9615  while(nextAlloc1stIndex < suballoc1stCount &&
        +
        9616  suballocations1st[nextAlloc1stIndex].hAllocation == VK_NULL_HANDLE)
        +
        9617  {
        +
        9618  ++nextAlloc1stIndex;
        +
        9619  }
        +
        9620 
        +
        9621  // Found non-null allocation.
        +
        9622  if(nextAlloc1stIndex < suballoc1stCount)
        +
        9623  {
        +
        9624  const VmaSuballocation& suballoc = suballocations1st[nextAlloc1stIndex];
        +
        9625 
        +
        9626  // 1. Process free space before this allocation.
        +
        9627  if(lastOffset < suballoc.offset)
        +
        9628  {
        +
        9629  // There is free space from lastOffset to suballoc.offset.
        +
        9630  const VkDeviceSize unusedRangeSize = suballoc.offset - lastOffset;
        +
        9631  ++outInfo.unusedRangeCount;
        +
        9632  outInfo.unusedBytes += unusedRangeSize;
        +
        9633  outInfo.unusedRangeSizeMin = VMA_MIN(outInfo.unusedRangeSizeMin, unusedRangeSize);
        +
        9634  outInfo.unusedRangeSizeMax = VMA_MIN(outInfo.unusedRangeSizeMax, unusedRangeSize);
        +
        9635  }
        +
        9636 
        +
        9637  // 2. Process this allocation.
        +
        9638  // There is allocation with suballoc.offset, suballoc.size.
        +
        9639  outInfo.usedBytes += suballoc.size;
        +
        9640  outInfo.allocationSizeMin = VMA_MIN(outInfo.allocationSizeMin, suballoc.size);
        +
        9641  outInfo.allocationSizeMax = VMA_MIN(outInfo.allocationSizeMax, suballoc.size);
        +
        9642 
        +
        9643  // 3. Prepare for next iteration.
        +
        9644  lastOffset = suballoc.offset + suballoc.size;
        +
        9645  ++nextAlloc1stIndex;
        +
        9646  }
        +
        9647  // We are at the end.
        +
        9648  else
        +
        9649  {
        +
        9650  // There is free space from lastOffset to freeSpace1stTo2ndEnd.
        +
        9651  if(lastOffset < freeSpace1stTo2ndEnd)
        +
        9652  {
        +
        9653  const VkDeviceSize unusedRangeSize = freeSpace1stTo2ndEnd - lastOffset;
        +
        9654  ++outInfo.unusedRangeCount;
        +
        9655  outInfo.unusedBytes += unusedRangeSize;
        +
        9656  outInfo.unusedRangeSizeMin = VMA_MIN(outInfo.unusedRangeSizeMin, unusedRangeSize);
        +
        9657  outInfo.unusedRangeSizeMax = VMA_MIN(outInfo.unusedRangeSizeMax, unusedRangeSize);
        +
        9658  }
        +
        9659 
        +
        9660  // End of loop.
        +
        9661  lastOffset = freeSpace1stTo2ndEnd;
        +
        9662  }
        +
        9663  }
        +
        9664 
        +
        9665  if(m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK)
        +
        9666  {
        +
        9667  size_t nextAlloc2ndIndex = suballocations2nd.size() - 1;
        +
        9668  while(lastOffset < size)
        9669  {
        -
        9670  if(lastOffset < freeSpace1stTo2ndEnd)
        -
        9671  {
        -
        9672  // There is free space from lastOffset to freeSpace1stTo2ndEnd.
        -
        9673  const VkDeviceSize unusedRangeSize = freeSpace1stTo2ndEnd - lastOffset;
        -
        9674  inoutStats.unusedSize += unusedRangeSize;
        -
        9675  ++inoutStats.unusedRangeCount;
        -
        9676  inoutStats.unusedRangeSizeMax = VMA_MAX(inoutStats.unusedRangeSizeMax, unusedRangeSize);
        -
        9677  }
        -
        9678 
        -
        9679  // End of loop.
        -
        9680  lastOffset = freeSpace1stTo2ndEnd;
        -
        9681  }
        -
        9682  }
        -
        9683 
        -
        9684  if(m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK)
        -
        9685  {
        -
        9686  size_t nextAlloc2ndIndex = suballocations2nd.size() - 1;
        -
        9687  while(lastOffset < size)
        -
        9688  {
        -
        9689  // Find next non-null allocation or move nextAlloc2ndIndex to the end.
        -
        9690  while(nextAlloc2ndIndex != SIZE_MAX &&
        -
        9691  suballocations2nd[nextAlloc2ndIndex].hAllocation == VK_NULL_HANDLE)
        -
        9692  {
        -
        9693  --nextAlloc2ndIndex;
        -
        9694  }
        -
        9695 
        -
        9696  // Found non-null allocation.
        -
        9697  if(nextAlloc2ndIndex != SIZE_MAX)
        -
        9698  {
        -
        9699  const VmaSuballocation& suballoc = suballocations2nd[nextAlloc2ndIndex];
        -
        9700 
        -
        9701  // 1. Process free space before this allocation.
        -
        9702  if(lastOffset < suballoc.offset)
        -
        9703  {
        -
        9704  // There is free space from lastOffset to suballoc.offset.
        -
        9705  const VkDeviceSize unusedRangeSize = suballoc.offset - lastOffset;
        -
        9706  inoutStats.unusedSize += unusedRangeSize;
        -
        9707  ++inoutStats.unusedRangeCount;
        -
        9708  inoutStats.unusedRangeSizeMax = VMA_MAX(inoutStats.unusedRangeSizeMax, unusedRangeSize);
        -
        9709  }
        -
        9710 
        -
        9711  // 2. Process this allocation.
        -
        9712  // There is allocation with suballoc.offset, suballoc.size.
        -
        9713  ++inoutStats.allocationCount;
        -
        9714 
        -
        9715  // 3. Prepare for next iteration.
        -
        9716  lastOffset = suballoc.offset + suballoc.size;
        -
        9717  --nextAlloc2ndIndex;
        +
        9670  // Find next non-null allocation or move nextAllocIndex to the end.
        +
        9671  while(nextAlloc2ndIndex != SIZE_MAX &&
        +
        9672  suballocations2nd[nextAlloc2ndIndex].hAllocation == VK_NULL_HANDLE)
        +
        9673  {
        +
        9674  --nextAlloc2ndIndex;
        +
        9675  }
        +
        9676 
        +
        9677  // Found non-null allocation.
        +
        9678  if(nextAlloc2ndIndex != SIZE_MAX)
        +
        9679  {
        +
        9680  const VmaSuballocation& suballoc = suballocations2nd[nextAlloc2ndIndex];
        +
        9681 
        +
        9682  // 1. Process free space before this allocation.
        +
        9683  if(lastOffset < suballoc.offset)
        +
        9684  {
        +
        9685  // There is free space from lastOffset to suballoc.offset.
        +
        9686  const VkDeviceSize unusedRangeSize = suballoc.offset - lastOffset;
        +
        9687  ++outInfo.unusedRangeCount;
        +
        9688  outInfo.unusedBytes += unusedRangeSize;
        +
        9689  outInfo.unusedRangeSizeMin = VMA_MIN(outInfo.unusedRangeSizeMin, unusedRangeSize);
        +
        9690  outInfo.unusedRangeSizeMax = VMA_MIN(outInfo.unusedRangeSizeMax, unusedRangeSize);
        +
        9691  }
        +
        9692 
        +
        9693  // 2. Process this allocation.
        +
        9694  // There is allocation with suballoc.offset, suballoc.size.
        +
        9695  outInfo.usedBytes += suballoc.size;
        +
        9696  outInfo.allocationSizeMin = VMA_MIN(outInfo.allocationSizeMin, suballoc.size);
        +
        9697  outInfo.allocationSizeMax = VMA_MIN(outInfo.allocationSizeMax, suballoc.size);
        +
        9698 
        +
        9699  // 3. Prepare for next iteration.
        +
        9700  lastOffset = suballoc.offset + suballoc.size;
        +
        9701  --nextAlloc2ndIndex;
        +
        9702  }
        +
        9703  // We are at the end.
        +
        9704  else
        +
        9705  {
        +
        9706  // There is free space from lastOffset to size.
        +
        9707  if(lastOffset < size)
        +
        9708  {
        +
        9709  const VkDeviceSize unusedRangeSize = size - lastOffset;
        +
        9710  ++outInfo.unusedRangeCount;
        +
        9711  outInfo.unusedBytes += unusedRangeSize;
        +
        9712  outInfo.unusedRangeSizeMin = VMA_MIN(outInfo.unusedRangeSizeMin, unusedRangeSize);
        +
        9713  outInfo.unusedRangeSizeMax = VMA_MIN(outInfo.unusedRangeSizeMax, unusedRangeSize);
        +
        9714  }
        +
        9715 
        +
        9716  // End of loop.
        +
        9717  lastOffset = size;
        9718  }
        -
        9719  // We are at the end.
        -
        9720  else
        -
        9721  {
        -
        9722  if(lastOffset < size)
        -
        9723  {
        -
        9724  // There is free space from lastOffset to size.
        -
        9725  const VkDeviceSize unusedRangeSize = size - lastOffset;
        -
        9726  inoutStats.unusedSize += unusedRangeSize;
        -
        9727  ++inoutStats.unusedRangeCount;
        -
        9728  inoutStats.unusedRangeSizeMax = VMA_MAX(inoutStats.unusedRangeSizeMax, unusedRangeSize);
        -
        9729  }
        -
        9730 
        -
        9731  // End of loop.
        -
        9732  lastOffset = size;
        -
        9733  }
        -
        9734  }
        -
        9735  }
        -
        9736 }
        -
        9737 
        -
        9738 #if VMA_STATS_STRING_ENABLED
        -
        9739 void VmaBlockMetadata_Linear::PrintDetailedMap(class VmaJsonWriter& json) const
        -
        9740 {
        -
        9741  const VkDeviceSize size = GetSize();
        -
        9742  const SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        -
        9743  const SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        -
        9744  const size_t suballoc1stCount = suballocations1st.size();
        -
        9745  const size_t suballoc2ndCount = suballocations2nd.size();
        -
        9746 
        -
        9747  // FIRST PASS
        -
        9748 
        -
        9749  size_t unusedRangeCount = 0;
        -
        9750  VkDeviceSize usedBytes = 0;
        -
        9751 
        -
        9752  VkDeviceSize lastOffset = 0;
        -
        9753 
        -
        9754  size_t alloc2ndCount = 0;
        -
        9755  if(m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER)
        -
        9756  {
        -
        9757  const VkDeviceSize freeSpace2ndTo1stEnd = suballocations1st[m_1stNullItemsBeginCount].offset;
        -
        9758  size_t nextAlloc2ndIndex = 0;
        -
        9759  while(lastOffset < freeSpace2ndTo1stEnd)
        -
        9760  {
        -
        9761  // Find next non-null allocation or move nextAlloc2ndIndex to the end.
        -
        9762  while(nextAlloc2ndIndex < suballoc2ndCount &&
        -
        9763  suballocations2nd[nextAlloc2ndIndex].hAllocation == VK_NULL_HANDLE)
        -
        9764  {
        -
        9765  ++nextAlloc2ndIndex;
        -
        9766  }
        -
        9767 
        -
        9768  // Found non-null allocation.
        -
        9769  if(nextAlloc2ndIndex < suballoc2ndCount)
        -
        9770  {
        -
        9771  const VmaSuballocation& suballoc = suballocations2nd[nextAlloc2ndIndex];
        -
        9772 
        -
        9773  // 1. Process free space before this allocation.
        -
        9774  if(lastOffset < suballoc.offset)
        -
        9775  {
        -
        9776  // There is free space from lastOffset to suballoc.offset.
        -
        9777  ++unusedRangeCount;
        -
        9778  }
        -
        9779 
        -
        9780  // 2. Process this allocation.
        -
        9781  // There is allocation with suballoc.offset, suballoc.size.
        -
        9782  ++alloc2ndCount;
        -
        9783  usedBytes += suballoc.size;
        -
        9784 
        -
        9785  // 3. Prepare for next iteration.
        -
        9786  lastOffset = suballoc.offset + suballoc.size;
        -
        9787  ++nextAlloc2ndIndex;
        -
        9788  }
        -
        9789  // We are at the end.
        -
        9790  else
        -
        9791  {
        -
        9792  if(lastOffset < freeSpace2ndTo1stEnd)
        -
        9793  {
        -
        9794  // There is free space from lastOffset to freeSpace2ndTo1stEnd.
        -
        9795  ++unusedRangeCount;
        -
        9796  }
        -
        9797 
        -
        9798  // End of loop.
        -
        9799  lastOffset = freeSpace2ndTo1stEnd;
        -
        9800  }
        +
        9719  }
        +
        9720  }
        +
        9721 
        +
        9722  outInfo.unusedBytes = size - outInfo.usedBytes;
        +
        9723 }
        +
        9724 
        +
        9725 void VmaBlockMetadata_Linear::AddPoolStats(VmaPoolStats& inoutStats) const
        +
        9726 {
        +
        9727  const SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        +
        9728  const SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        +
        9729  const VkDeviceSize size = GetSize();
        +
        9730  const size_t suballoc1stCount = suballocations1st.size();
        +
        9731  const size_t suballoc2ndCount = suballocations2nd.size();
        +
        9732 
        +
        9733  inoutStats.size += size;
        +
        9734 
        +
        9735  VkDeviceSize lastOffset = 0;
        +
        9736 
        +
        9737  if(m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER)
        +
        9738  {
        +
        9739  const VkDeviceSize freeSpace2ndTo1stEnd = suballocations1st[m_1stNullItemsBeginCount].offset;
        +
        9740  size_t nextAlloc2ndIndex = m_1stNullItemsBeginCount;
        +
        9741  while(lastOffset < freeSpace2ndTo1stEnd)
        +
        9742  {
        +
        9743  // Find next non-null allocation or move nextAlloc2ndIndex to the end.
        +
        9744  while(nextAlloc2ndIndex < suballoc2ndCount &&
        +
        9745  suballocations2nd[nextAlloc2ndIndex].hAllocation == VK_NULL_HANDLE)
        +
        9746  {
        +
        9747  ++nextAlloc2ndIndex;
        +
        9748  }
        +
        9749 
        +
        9750  // Found non-null allocation.
        +
        9751  if(nextAlloc2ndIndex < suballoc2ndCount)
        +
        9752  {
        +
        9753  const VmaSuballocation& suballoc = suballocations2nd[nextAlloc2ndIndex];
        +
        9754 
        +
        9755  // 1. Process free space before this allocation.
        +
        9756  if(lastOffset < suballoc.offset)
        +
        9757  {
        +
        9758  // There is free space from lastOffset to suballoc.offset.
        +
        9759  const VkDeviceSize unusedRangeSize = suballoc.offset - lastOffset;
        +
        9760  inoutStats.unusedSize += unusedRangeSize;
        +
        9761  ++inoutStats.unusedRangeCount;
        +
        9762  inoutStats.unusedRangeSizeMax = VMA_MAX(inoutStats.unusedRangeSizeMax, unusedRangeSize);
        +
        9763  }
        +
        9764 
        +
        9765  // 2. Process this allocation.
        +
        9766  // There is allocation with suballoc.offset, suballoc.size.
        +
        9767  ++inoutStats.allocationCount;
        +
        9768 
        +
        9769  // 3. Prepare for next iteration.
        +
        9770  lastOffset = suballoc.offset + suballoc.size;
        +
        9771  ++nextAlloc2ndIndex;
        +
        9772  }
        +
        9773  // We are at the end.
        +
        9774  else
        +
        9775  {
        +
        9776  if(lastOffset < freeSpace2ndTo1stEnd)
        +
        9777  {
        +
        9778  // There is free space from lastOffset to freeSpace2ndTo1stEnd.
        +
        9779  const VkDeviceSize unusedRangeSize = freeSpace2ndTo1stEnd - lastOffset;
        +
        9780  inoutStats.unusedSize += unusedRangeSize;
        +
        9781  ++inoutStats.unusedRangeCount;
        +
        9782  inoutStats.unusedRangeSizeMax = VMA_MAX(inoutStats.unusedRangeSizeMax, unusedRangeSize);
        +
        9783  }
        +
        9784 
        +
        9785  // End of loop.
        +
        9786  lastOffset = freeSpace2ndTo1stEnd;
        +
        9787  }
        +
        9788  }
        +
        9789  }
        +
        9790 
        +
        9791  size_t nextAlloc1stIndex = m_1stNullItemsBeginCount;
        +
        9792  const VkDeviceSize freeSpace1stTo2ndEnd =
        +
        9793  m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK ? suballocations2nd.back().offset : size;
        +
        9794  while(lastOffset < freeSpace1stTo2ndEnd)
        +
        9795  {
        +
        9796  // Find next non-null allocation or move nextAllocIndex to the end.
        +
        9797  while(nextAlloc1stIndex < suballoc1stCount &&
        +
        9798  suballocations1st[nextAlloc1stIndex].hAllocation == VK_NULL_HANDLE)
        +
        9799  {
        +
        9800  ++nextAlloc1stIndex;
        9801  }
        -
        9802  }
        -
        9803 
        -
        9804  size_t nextAlloc1stIndex = m_1stNullItemsBeginCount;
        -
        9805  size_t alloc1stCount = 0;
        -
        9806  const VkDeviceSize freeSpace1stTo2ndEnd =
        -
        9807  m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK ? suballocations2nd.back().offset : size;
        -
        9808  while(lastOffset < freeSpace1stTo2ndEnd)
        -
        9809  {
        -
        9810  // Find next non-null allocation or move nextAllocIndex to the end.
        -
        9811  while(nextAlloc1stIndex < suballoc1stCount &&
        -
        9812  suballocations1st[nextAlloc1stIndex].hAllocation == VK_NULL_HANDLE)
        -
        9813  {
        -
        9814  ++nextAlloc1stIndex;
        -
        9815  }
        -
        9816 
        -
        9817  // Found non-null allocation.
        -
        9818  if(nextAlloc1stIndex < suballoc1stCount)
        -
        9819  {
        -
        9820  const VmaSuballocation& suballoc = suballocations1st[nextAlloc1stIndex];
        +
        9802 
        +
        9803  // Found non-null allocation.
        +
        9804  if(nextAlloc1stIndex < suballoc1stCount)
        +
        9805  {
        +
        9806  const VmaSuballocation& suballoc = suballocations1st[nextAlloc1stIndex];
        +
        9807 
        +
        9808  // 1. Process free space before this allocation.
        +
        9809  if(lastOffset < suballoc.offset)
        +
        9810  {
        +
        9811  // There is free space from lastOffset to suballoc.offset.
        +
        9812  const VkDeviceSize unusedRangeSize = suballoc.offset - lastOffset;
        +
        9813  inoutStats.unusedSize += unusedRangeSize;
        +
        9814  ++inoutStats.unusedRangeCount;
        +
        9815  inoutStats.unusedRangeSizeMax = VMA_MAX(inoutStats.unusedRangeSizeMax, unusedRangeSize);
        +
        9816  }
        +
        9817 
        +
        9818  // 2. Process this allocation.
        +
        9819  // There is allocation with suballoc.offset, suballoc.size.
        +
        9820  ++inoutStats.allocationCount;
        9821 
        -
        9822  // 1. Process free space before this allocation.
        -
        9823  if(lastOffset < suballoc.offset)
        -
        9824  {
        -
        9825  // There is free space from lastOffset to suballoc.offset.
        -
        9826  ++unusedRangeCount;
        -
        9827  }
        -
        9828 
        -
        9829  // 2. Process this allocation.
        -
        9830  // There is allocation with suballoc.offset, suballoc.size.
        -
        9831  ++alloc1stCount;
        -
        9832  usedBytes += suballoc.size;
        -
        9833 
        -
        9834  // 3. Prepare for next iteration.
        -
        9835  lastOffset = suballoc.offset + suballoc.size;
        -
        9836  ++nextAlloc1stIndex;
        -
        9837  }
        -
        9838  // We are at the end.
        -
        9839  else
        -
        9840  {
        -
        9841  if(lastOffset < size)
        -
        9842  {
        -
        9843  // There is free space from lastOffset to freeSpace1stTo2ndEnd.
        -
        9844  ++unusedRangeCount;
        -
        9845  }
        -
        9846 
        -
        9847  // End of loop.
        -
        9848  lastOffset = freeSpace1stTo2ndEnd;
        -
        9849  }
        -
        9850  }
        -
        9851 
        -
        9852  if(m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK)
        -
        9853  {
        -
        9854  size_t nextAlloc2ndIndex = suballocations2nd.size() - 1;
        -
        9855  while(lastOffset < size)
        -
        9856  {
        -
        9857  // Find next non-null allocation or move nextAlloc2ndIndex to the end.
        -
        9858  while(nextAlloc2ndIndex != SIZE_MAX &&
        -
        9859  suballocations2nd[nextAlloc2ndIndex].hAllocation == VK_NULL_HANDLE)
        -
        9860  {
        -
        9861  --nextAlloc2ndIndex;
        -
        9862  }
        -
        9863 
        -
        9864  // Found non-null allocation.
        -
        9865  if(nextAlloc2ndIndex != SIZE_MAX)
        -
        9866  {
        -
        9867  const VmaSuballocation& suballoc = suballocations2nd[nextAlloc2ndIndex];
        -
        9868 
        -
        9869  // 1. Process free space before this allocation.
        -
        9870  if(lastOffset < suballoc.offset)
        -
        9871  {
        -
        9872  // There is free space from lastOffset to suballoc.offset.
        -
        9873  ++unusedRangeCount;
        -
        9874  }
        -
        9875 
        -
        9876  // 2. Process this allocation.
        -
        9877  // There is allocation with suballoc.offset, suballoc.size.
        -
        9878  ++alloc2ndCount;
        -
        9879  usedBytes += suballoc.size;
        -
        9880 
        -
        9881  // 3. Prepare for next iteration.
        -
        9882  lastOffset = suballoc.offset + suballoc.size;
        -
        9883  --nextAlloc2ndIndex;
        -
        9884  }
        -
        9885  // We are at the end.
        -
        9886  else
        -
        9887  {
        -
        9888  if(lastOffset < size)
        -
        9889  {
        -
        9890  // There is free space from lastOffset to size.
        -
        9891  ++unusedRangeCount;
        -
        9892  }
        -
        9893 
        -
        9894  // End of loop.
        -
        9895  lastOffset = size;
        -
        9896  }
        -
        9897  }
        -
        9898  }
        -
        9899 
        -
        9900  const VkDeviceSize unusedBytes = size - usedBytes;
        -
        9901  PrintDetailedMap_Begin(json, unusedBytes, alloc1stCount + alloc2ndCount, unusedRangeCount);
        -
        9902 
        -
        9903  // SECOND PASS
        -
        9904  lastOffset = 0;
        +
        9822  // 3. Prepare for next iteration.
        +
        9823  lastOffset = suballoc.offset + suballoc.size;
        +
        9824  ++nextAlloc1stIndex;
        +
        9825  }
        +
        9826  // We are at the end.
        +
        9827  else
        +
        9828  {
        +
        9829  if(lastOffset < freeSpace1stTo2ndEnd)
        +
        9830  {
        +
        9831  // There is free space from lastOffset to freeSpace1stTo2ndEnd.
        +
        9832  const VkDeviceSize unusedRangeSize = freeSpace1stTo2ndEnd - lastOffset;
        +
        9833  inoutStats.unusedSize += unusedRangeSize;
        +
        9834  ++inoutStats.unusedRangeCount;
        +
        9835  inoutStats.unusedRangeSizeMax = VMA_MAX(inoutStats.unusedRangeSizeMax, unusedRangeSize);
        +
        9836  }
        +
        9837 
        +
        9838  // End of loop.
        +
        9839  lastOffset = freeSpace1stTo2ndEnd;
        +
        9840  }
        +
        9841  }
        +
        9842 
        +
        9843  if(m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK)
        +
        9844  {
        +
        9845  size_t nextAlloc2ndIndex = suballocations2nd.size() - 1;
        +
        9846  while(lastOffset < size)
        +
        9847  {
        +
        9848  // Find next non-null allocation or move nextAlloc2ndIndex to the end.
        +
        9849  while(nextAlloc2ndIndex != SIZE_MAX &&
        +
        9850  suballocations2nd[nextAlloc2ndIndex].hAllocation == VK_NULL_HANDLE)
        +
        9851  {
        +
        9852  --nextAlloc2ndIndex;
        +
        9853  }
        +
        9854 
        +
        9855  // Found non-null allocation.
        +
        9856  if(nextAlloc2ndIndex != SIZE_MAX)
        +
        9857  {
        +
        9858  const VmaSuballocation& suballoc = suballocations2nd[nextAlloc2ndIndex];
        +
        9859 
        +
        9860  // 1. Process free space before this allocation.
        +
        9861  if(lastOffset < suballoc.offset)
        +
        9862  {
        +
        9863  // There is free space from lastOffset to suballoc.offset.
        +
        9864  const VkDeviceSize unusedRangeSize = suballoc.offset - lastOffset;
        +
        9865  inoutStats.unusedSize += unusedRangeSize;
        +
        9866  ++inoutStats.unusedRangeCount;
        +
        9867  inoutStats.unusedRangeSizeMax = VMA_MAX(inoutStats.unusedRangeSizeMax, unusedRangeSize);
        +
        9868  }
        +
        9869 
        +
        9870  // 2. Process this allocation.
        +
        9871  // There is allocation with suballoc.offset, suballoc.size.
        +
        9872  ++inoutStats.allocationCount;
        +
        9873 
        +
        9874  // 3. Prepare for next iteration.
        +
        9875  lastOffset = suballoc.offset + suballoc.size;
        +
        9876  --nextAlloc2ndIndex;
        +
        9877  }
        +
        9878  // We are at the end.
        +
        9879  else
        +
        9880  {
        +
        9881  if(lastOffset < size)
        +
        9882  {
        +
        9883  // There is free space from lastOffset to size.
        +
        9884  const VkDeviceSize unusedRangeSize = size - lastOffset;
        +
        9885  inoutStats.unusedSize += unusedRangeSize;
        +
        9886  ++inoutStats.unusedRangeCount;
        +
        9887  inoutStats.unusedRangeSizeMax = VMA_MAX(inoutStats.unusedRangeSizeMax, unusedRangeSize);
        +
        9888  }
        +
        9889 
        +
        9890  // End of loop.
        +
        9891  lastOffset = size;
        +
        9892  }
        +
        9893  }
        +
        9894  }
        +
        9895 }
        +
        9896 
        +
        9897 #if VMA_STATS_STRING_ENABLED
        +
        9898 void VmaBlockMetadata_Linear::PrintDetailedMap(class VmaJsonWriter& json) const
        +
        9899 {
        +
        9900  const VkDeviceSize size = GetSize();
        +
        9901  const SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        +
        9902  const SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        +
        9903  const size_t suballoc1stCount = suballocations1st.size();
        +
        9904  const size_t suballoc2ndCount = suballocations2nd.size();
        9905 
        -
        9906  if(m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER)
        -
        9907  {
        -
        9908  const VkDeviceSize freeSpace2ndTo1stEnd = suballocations1st[m_1stNullItemsBeginCount].offset;
        -
        9909  size_t nextAlloc2ndIndex = 0;
        -
        9910  while(lastOffset < freeSpace2ndTo1stEnd)
        -
        9911  {
        -
        9912  // Find next non-null allocation or move nextAlloc2ndIndex to the end.
        -
        9913  while(nextAlloc2ndIndex < suballoc2ndCount &&
        -
        9914  suballocations2nd[nextAlloc2ndIndex].hAllocation == VK_NULL_HANDLE)
        -
        9915  {
        -
        9916  ++nextAlloc2ndIndex;
        -
        9917  }
        -
        9918 
        -
        9919  // Found non-null allocation.
        -
        9920  if(nextAlloc2ndIndex < suballoc2ndCount)
        -
        9921  {
        -
        9922  const VmaSuballocation& suballoc = suballocations2nd[nextAlloc2ndIndex];
        -
        9923 
        -
        9924  // 1. Process free space before this allocation.
        -
        9925  if(lastOffset < suballoc.offset)
        -
        9926  {
        -
        9927  // There is free space from lastOffset to suballoc.offset.
        -
        9928  const VkDeviceSize unusedRangeSize = suballoc.offset - lastOffset;
        -
        9929  PrintDetailedMap_UnusedRange(json, lastOffset, unusedRangeSize);
        -
        9930  }
        +
        9906  // FIRST PASS
        +
        9907 
        +
        9908  size_t unusedRangeCount = 0;
        +
        9909  VkDeviceSize usedBytes = 0;
        +
        9910 
        +
        9911  VkDeviceSize lastOffset = 0;
        +
        9912 
        +
        9913  size_t alloc2ndCount = 0;
        +
        9914  if(m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER)
        +
        9915  {
        +
        9916  const VkDeviceSize freeSpace2ndTo1stEnd = suballocations1st[m_1stNullItemsBeginCount].offset;
        +
        9917  size_t nextAlloc2ndIndex = 0;
        +
        9918  while(lastOffset < freeSpace2ndTo1stEnd)
        +
        9919  {
        +
        9920  // Find next non-null allocation or move nextAlloc2ndIndex to the end.
        +
        9921  while(nextAlloc2ndIndex < suballoc2ndCount &&
        +
        9922  suballocations2nd[nextAlloc2ndIndex].hAllocation == VK_NULL_HANDLE)
        +
        9923  {
        +
        9924  ++nextAlloc2ndIndex;
        +
        9925  }
        +
        9926 
        +
        9927  // Found non-null allocation.
        +
        9928  if(nextAlloc2ndIndex < suballoc2ndCount)
        +
        9929  {
        +
        9930  const VmaSuballocation& suballoc = suballocations2nd[nextAlloc2ndIndex];
        9931 
        -
        9932  // 2. Process this allocation.
        -
        9933  // There is allocation with suballoc.offset, suballoc.size.
        -
        9934  PrintDetailedMap_Allocation(json, suballoc.offset, suballoc.hAllocation);
        -
        9935 
        -
        9936  // 3. Prepare for next iteration.
        -
        9937  lastOffset = suballoc.offset + suballoc.size;
        -
        9938  ++nextAlloc2ndIndex;
        -
        9939  }
        -
        9940  // We are at the end.
        -
        9941  else
        -
        9942  {
        -
        9943  if(lastOffset < freeSpace2ndTo1stEnd)
        -
        9944  {
        -
        9945  // There is free space from lastOffset to freeSpace2ndTo1stEnd.
        -
        9946  const VkDeviceSize unusedRangeSize = freeSpace2ndTo1stEnd - lastOffset;
        -
        9947  PrintDetailedMap_UnusedRange(json, lastOffset, unusedRangeSize);
        -
        9948  }
        -
        9949 
        -
        9950  // End of loop.
        -
        9951  lastOffset = freeSpace2ndTo1stEnd;
        -
        9952  }
        -
        9953  }
        -
        9954  }
        -
        9955 
        -
        9956  nextAlloc1stIndex = m_1stNullItemsBeginCount;
        -
        9957  while(lastOffset < freeSpace1stTo2ndEnd)
        -
        9958  {
        -
        9959  // Find next non-null allocation or move nextAllocIndex to the end.
        -
        9960  while(nextAlloc1stIndex < suballoc1stCount &&
        -
        9961  suballocations1st[nextAlloc1stIndex].hAllocation == VK_NULL_HANDLE)
        -
        9962  {
        -
        9963  ++nextAlloc1stIndex;
        -
        9964  }
        -
        9965 
        -
        9966  // Found non-null allocation.
        -
        9967  if(nextAlloc1stIndex < suballoc1stCount)
        -
        9968  {
        -
        9969  const VmaSuballocation& suballoc = suballocations1st[nextAlloc1stIndex];
        -
        9970 
        -
        9971  // 1. Process free space before this allocation.
        -
        9972  if(lastOffset < suballoc.offset)
        -
        9973  {
        -
        9974  // There is free space from lastOffset to suballoc.offset.
        -
        9975  const VkDeviceSize unusedRangeSize = suballoc.offset - lastOffset;
        -
        9976  PrintDetailedMap_UnusedRange(json, lastOffset, unusedRangeSize);
        -
        9977  }
        -
        9978 
        -
        9979  // 2. Process this allocation.
        -
        9980  // There is allocation with suballoc.offset, suballoc.size.
        -
        9981  PrintDetailedMap_Allocation(json, suballoc.offset, suballoc.hAllocation);
        -
        9982 
        -
        9983  // 3. Prepare for next iteration.
        -
        9984  lastOffset = suballoc.offset + suballoc.size;
        -
        9985  ++nextAlloc1stIndex;
        -
        9986  }
        -
        9987  // We are at the end.
        -
        9988  else
        -
        9989  {
        -
        9990  if(lastOffset < freeSpace1stTo2ndEnd)
        -
        9991  {
        -
        9992  // There is free space from lastOffset to freeSpace1stTo2ndEnd.
        -
        9993  const VkDeviceSize unusedRangeSize = freeSpace1stTo2ndEnd - lastOffset;
        -
        9994  PrintDetailedMap_UnusedRange(json, lastOffset, unusedRangeSize);
        -
        9995  }
        -
        9996 
        -
        9997  // End of loop.
        -
        9998  lastOffset = freeSpace1stTo2ndEnd;
        -
        9999  }
        -
        10000  }
        -
        10001 
        -
        10002  if(m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK)
        -
        10003  {
        -
        10004  size_t nextAlloc2ndIndex = suballocations2nd.size() - 1;
        -
        10005  while(lastOffset < size)
        -
        10006  {
        -
        10007  // Find next non-null allocation or move nextAlloc2ndIndex to the end.
        -
        10008  while(nextAlloc2ndIndex != SIZE_MAX &&
        -
        10009  suballocations2nd[nextAlloc2ndIndex].hAllocation == VK_NULL_HANDLE)
        -
        10010  {
        -
        10011  --nextAlloc2ndIndex;
        -
        10012  }
        -
        10013 
        -
        10014  // Found non-null allocation.
        -
        10015  if(nextAlloc2ndIndex != SIZE_MAX)
        -
        10016  {
        -
        10017  const VmaSuballocation& suballoc = suballocations2nd[nextAlloc2ndIndex];
        -
        10018 
        -
        10019  // 1. Process free space before this allocation.
        -
        10020  if(lastOffset < suballoc.offset)
        -
        10021  {
        -
        10022  // There is free space from lastOffset to suballoc.offset.
        -
        10023  const VkDeviceSize unusedRangeSize = suballoc.offset - lastOffset;
        -
        10024  PrintDetailedMap_UnusedRange(json, lastOffset, unusedRangeSize);
        -
        10025  }
        -
        10026 
        -
        10027  // 2. Process this allocation.
        -
        10028  // There is allocation with suballoc.offset, suballoc.size.
        -
        10029  PrintDetailedMap_Allocation(json, suballoc.offset, suballoc.hAllocation);
        -
        10030 
        -
        10031  // 3. Prepare for next iteration.
        -
        10032  lastOffset = suballoc.offset + suballoc.size;
        -
        10033  --nextAlloc2ndIndex;
        -
        10034  }
        -
        10035  // We are at the end.
        -
        10036  else
        -
        10037  {
        -
        10038  if(lastOffset < size)
        -
        10039  {
        -
        10040  // There is free space from lastOffset to size.
        -
        10041  const VkDeviceSize unusedRangeSize = size - lastOffset;
        -
        10042  PrintDetailedMap_UnusedRange(json, lastOffset, unusedRangeSize);
        -
        10043  }
        -
        10044 
        -
        10045  // End of loop.
        -
        10046  lastOffset = size;
        -
        10047  }
        -
        10048  }
        -
        10049  }
        -
        10050 
        -
        10051  PrintDetailedMap_End(json);
        -
        10052 }
        -
        10053 #endif // #if VMA_STATS_STRING_ENABLED
        -
        10054 
        -
        10055 bool VmaBlockMetadata_Linear::CreateAllocationRequest(
        -
        10056  uint32_t currentFrameIndex,
        -
        10057  uint32_t frameInUseCount,
        -
        10058  VkDeviceSize bufferImageGranularity,
        -
        10059  VkDeviceSize allocSize,
        -
        10060  VkDeviceSize allocAlignment,
        -
        10061  bool upperAddress,
        -
        10062  VmaSuballocationType allocType,
        -
        10063  bool canMakeOtherLost,
        -
        10064  uint32_t strategy,
        -
        10065  VmaAllocationRequest* pAllocationRequest)
        -
        10066 {
        -
        10067  VMA_ASSERT(allocSize > 0);
        -
        10068  VMA_ASSERT(allocType != VMA_SUBALLOCATION_TYPE_FREE);
        -
        10069  VMA_ASSERT(pAllocationRequest != VMA_NULL);
        -
        10070  VMA_HEAVY_ASSERT(Validate());
        -
        10071  return upperAddress ?
        -
        10072  CreateAllocationRequest_UpperAddress(
        -
        10073  currentFrameIndex, frameInUseCount, bufferImageGranularity,
        -
        10074  allocSize, allocAlignment, allocType, canMakeOtherLost, strategy, pAllocationRequest) :
        -
        10075  CreateAllocationRequest_LowerAddress(
        -
        10076  currentFrameIndex, frameInUseCount, bufferImageGranularity,
        -
        10077  allocSize, allocAlignment, allocType, canMakeOtherLost, strategy, pAllocationRequest);
        -
        10078 }
        -
        10079 
        -
        10080 bool VmaBlockMetadata_Linear::CreateAllocationRequest_UpperAddress(
        -
        10081  uint32_t currentFrameIndex,
        -
        10082  uint32_t frameInUseCount,
        -
        10083  VkDeviceSize bufferImageGranularity,
        -
        10084  VkDeviceSize allocSize,
        -
        10085  VkDeviceSize allocAlignment,
        -
        10086  VmaSuballocationType allocType,
        -
        10087  bool canMakeOtherLost,
        -
        10088  uint32_t strategy,
        -
        10089  VmaAllocationRequest* pAllocationRequest)
        -
        10090 {
        -
        10091  const VkDeviceSize size = GetSize();
        -
        10092  SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        -
        10093  SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        -
        10094 
        -
        10095  if(m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER)
        -
        10096  {
        -
        10097  VMA_ASSERT(0 && "Trying to use pool with linear algorithm as double stack, while it is already being used as ring buffer.");
        -
        10098  return false;
        -
        10099  }
        -
        10100 
        -
        10101  // Try to allocate before 2nd.back(), or end of block if 2nd.empty().
        -
        10102  if(allocSize > size)
        -
        10103  {
        -
        10104  return false;
        -
        10105  }
        -
        10106  VkDeviceSize resultBaseOffset = size - allocSize;
        -
        10107  if(!suballocations2nd.empty())
        -
        10108  {
        -
        10109  const VmaSuballocation& lastSuballoc = suballocations2nd.back();
        -
        10110  resultBaseOffset = lastSuballoc.offset - allocSize;
        -
        10111  if(allocSize > lastSuballoc.offset)
        -
        10112  {
        -
        10113  return false;
        -
        10114  }
        -
        10115  }
        -
        10116 
        -
        10117  // Start from offset equal to end of free space.
        -
        10118  VkDeviceSize resultOffset = resultBaseOffset;
        -
        10119 
        -
        10120  // Apply VMA_DEBUG_MARGIN at the end.
        -
        10121  if(VMA_DEBUG_MARGIN > 0)
        -
        10122  {
        -
        10123  if(resultOffset < VMA_DEBUG_MARGIN)
        -
        10124  {
        -
        10125  return false;
        -
        10126  }
        -
        10127  resultOffset -= VMA_DEBUG_MARGIN;
        -
        10128  }
        -
        10129 
        -
        10130  // Apply alignment.
        -
        10131  resultOffset = VmaAlignDown(resultOffset, allocAlignment);
        -
        10132 
        -
        10133  // Check next suballocations from 2nd for BufferImageGranularity conflicts.
        -
        10134  // Make bigger alignment if necessary.
        -
        10135  if(bufferImageGranularity > 1 && !suballocations2nd.empty())
        -
        10136  {
        -
        10137  bool bufferImageGranularityConflict = false;
        -
        10138  for(size_t nextSuballocIndex = suballocations2nd.size(); nextSuballocIndex--; )
        -
        10139  {
        -
        10140  const VmaSuballocation& nextSuballoc = suballocations2nd[nextSuballocIndex];
        -
        10141  if(VmaBlocksOnSamePage(resultOffset, allocSize, nextSuballoc.offset, bufferImageGranularity))
        -
        10142  {
        -
        10143  if(VmaIsBufferImageGranularityConflict(nextSuballoc.type, allocType))
        -
        10144  {
        -
        10145  bufferImageGranularityConflict = true;
        -
        10146  break;
        -
        10147  }
        -
        10148  }
        -
        10149  else
        -
        10150  // Already on previous page.
        -
        10151  break;
        -
        10152  }
        -
        10153  if(bufferImageGranularityConflict)
        -
        10154  {
        -
        10155  resultOffset = VmaAlignDown(resultOffset, bufferImageGranularity);
        -
        10156  }
        -
        10157  }
        -
        10158 
        -
        10159  // There is enough free space.
        -
        10160  const VkDeviceSize endOf1st = !suballocations1st.empty() ?
        -
        10161  suballocations1st.back().offset + suballocations1st.back().size :
        -
        10162  0;
        -
        10163  if(endOf1st + VMA_DEBUG_MARGIN <= resultOffset)
        -
        10164  {
        -
        10165  // Check previous suballocations for BufferImageGranularity conflicts.
        -
        10166  // If conflict exists, allocation cannot be made here.
        -
        10167  if(bufferImageGranularity > 1)
        -
        10168  {
        -
        10169  for(size_t prevSuballocIndex = suballocations1st.size(); prevSuballocIndex--; )
        -
        10170  {
        -
        10171  const VmaSuballocation& prevSuballoc = suballocations1st[prevSuballocIndex];
        -
        10172  if(VmaBlocksOnSamePage(prevSuballoc.offset, prevSuballoc.size, resultOffset, bufferImageGranularity))
        -
        10173  {
        -
        10174  if(VmaIsBufferImageGranularityConflict(allocType, prevSuballoc.type))
        -
        10175  {
        -
        10176  return false;
        -
        10177  }
        -
        10178  }
        -
        10179  else
        +
        9932  // 1. Process free space before this allocation.
        +
        9933  if(lastOffset < suballoc.offset)
        +
        9934  {
        +
        9935  // There is free space from lastOffset to suballoc.offset.
        +
        9936  ++unusedRangeCount;
        +
        9937  }
        +
        9938 
        +
        9939  // 2. Process this allocation.
        +
        9940  // There is allocation with suballoc.offset, suballoc.size.
        +
        9941  ++alloc2ndCount;
        +
        9942  usedBytes += suballoc.size;
        +
        9943 
        +
        9944  // 3. Prepare for next iteration.
        +
        9945  lastOffset = suballoc.offset + suballoc.size;
        +
        9946  ++nextAlloc2ndIndex;
        +
        9947  }
        +
        9948  // We are at the end.
        +
        9949  else
        +
        9950  {
        +
        9951  if(lastOffset < freeSpace2ndTo1stEnd)
        +
        9952  {
        +
        9953  // There is free space from lastOffset to freeSpace2ndTo1stEnd.
        +
        9954  ++unusedRangeCount;
        +
        9955  }
        +
        9956 
        +
        9957  // End of loop.
        +
        9958  lastOffset = freeSpace2ndTo1stEnd;
        +
        9959  }
        +
        9960  }
        +
        9961  }
        +
        9962 
        +
        9963  size_t nextAlloc1stIndex = m_1stNullItemsBeginCount;
        +
        9964  size_t alloc1stCount = 0;
        +
        9965  const VkDeviceSize freeSpace1stTo2ndEnd =
        +
        9966  m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK ? suballocations2nd.back().offset : size;
        +
        9967  while(lastOffset < freeSpace1stTo2ndEnd)
        +
        9968  {
        +
        9969  // Find next non-null allocation or move nextAllocIndex to the end.
        +
        9970  while(nextAlloc1stIndex < suballoc1stCount &&
        +
        9971  suballocations1st[nextAlloc1stIndex].hAllocation == VK_NULL_HANDLE)
        +
        9972  {
        +
        9973  ++nextAlloc1stIndex;
        +
        9974  }
        +
        9975 
        +
        9976  // Found non-null allocation.
        +
        9977  if(nextAlloc1stIndex < suballoc1stCount)
        +
        9978  {
        +
        9979  const VmaSuballocation& suballoc = suballocations1st[nextAlloc1stIndex];
        +
        9980 
        +
        9981  // 1. Process free space before this allocation.
        +
        9982  if(lastOffset < suballoc.offset)
        +
        9983  {
        +
        9984  // There is free space from lastOffset to suballoc.offset.
        +
        9985  ++unusedRangeCount;
        +
        9986  }
        +
        9987 
        +
        9988  // 2. Process this allocation.
        +
        9989  // There is allocation with suballoc.offset, suballoc.size.
        +
        9990  ++alloc1stCount;
        +
        9991  usedBytes += suballoc.size;
        +
        9992 
        +
        9993  // 3. Prepare for next iteration.
        +
        9994  lastOffset = suballoc.offset + suballoc.size;
        +
        9995  ++nextAlloc1stIndex;
        +
        9996  }
        +
        9997  // We are at the end.
        +
        9998  else
        +
        9999  {
        +
        10000  if(lastOffset < size)
        +
        10001  {
        +
        10002  // There is free space from lastOffset to freeSpace1stTo2ndEnd.
        +
        10003  ++unusedRangeCount;
        +
        10004  }
        +
        10005 
        +
        10006  // End of loop.
        +
        10007  lastOffset = freeSpace1stTo2ndEnd;
        +
        10008  }
        +
        10009  }
        +
        10010 
        +
        10011  if(m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK)
        +
        10012  {
        +
        10013  size_t nextAlloc2ndIndex = suballocations2nd.size() - 1;
        +
        10014  while(lastOffset < size)
        +
        10015  {
        +
        10016  // Find next non-null allocation or move nextAlloc2ndIndex to the end.
        +
        10017  while(nextAlloc2ndIndex != SIZE_MAX &&
        +
        10018  suballocations2nd[nextAlloc2ndIndex].hAllocation == VK_NULL_HANDLE)
        +
        10019  {
        +
        10020  --nextAlloc2ndIndex;
        +
        10021  }
        +
        10022 
        +
        10023  // Found non-null allocation.
        +
        10024  if(nextAlloc2ndIndex != SIZE_MAX)
        +
        10025  {
        +
        10026  const VmaSuballocation& suballoc = suballocations2nd[nextAlloc2ndIndex];
        +
        10027 
        +
        10028  // 1. Process free space before this allocation.
        +
        10029  if(lastOffset < suballoc.offset)
        +
        10030  {
        +
        10031  // There is free space from lastOffset to suballoc.offset.
        +
        10032  ++unusedRangeCount;
        +
        10033  }
        +
        10034 
        +
        10035  // 2. Process this allocation.
        +
        10036  // There is allocation with suballoc.offset, suballoc.size.
        +
        10037  ++alloc2ndCount;
        +
        10038  usedBytes += suballoc.size;
        +
        10039 
        +
        10040  // 3. Prepare for next iteration.
        +
        10041  lastOffset = suballoc.offset + suballoc.size;
        +
        10042  --nextAlloc2ndIndex;
        +
        10043  }
        +
        10044  // We are at the end.
        +
        10045  else
        +
        10046  {
        +
        10047  if(lastOffset < size)
        +
        10048  {
        +
        10049  // There is free space from lastOffset to size.
        +
        10050  ++unusedRangeCount;
        +
        10051  }
        +
        10052 
        +
        10053  // End of loop.
        +
        10054  lastOffset = size;
        +
        10055  }
        +
        10056  }
        +
        10057  }
        +
        10058 
        +
        10059  const VkDeviceSize unusedBytes = size - usedBytes;
        +
        10060  PrintDetailedMap_Begin(json, unusedBytes, alloc1stCount + alloc2ndCount, unusedRangeCount);
        +
        10061 
        +
        10062  // SECOND PASS
        +
        10063  lastOffset = 0;
        +
        10064 
        +
        10065  if(m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER)
        +
        10066  {
        +
        10067  const VkDeviceSize freeSpace2ndTo1stEnd = suballocations1st[m_1stNullItemsBeginCount].offset;
        +
        10068  size_t nextAlloc2ndIndex = 0;
        +
        10069  while(lastOffset < freeSpace2ndTo1stEnd)
        +
        10070  {
        +
        10071  // Find next non-null allocation or move nextAlloc2ndIndex to the end.
        +
        10072  while(nextAlloc2ndIndex < suballoc2ndCount &&
        +
        10073  suballocations2nd[nextAlloc2ndIndex].hAllocation == VK_NULL_HANDLE)
        +
        10074  {
        +
        10075  ++nextAlloc2ndIndex;
        +
        10076  }
        +
        10077 
        +
        10078  // Found non-null allocation.
        +
        10079  if(nextAlloc2ndIndex < suballoc2ndCount)
        +
        10080  {
        +
        10081  const VmaSuballocation& suballoc = suballocations2nd[nextAlloc2ndIndex];
        +
        10082 
        +
        10083  // 1. Process free space before this allocation.
        +
        10084  if(lastOffset < suballoc.offset)
        +
        10085  {
        +
        10086  // There is free space from lastOffset to suballoc.offset.
        +
        10087  const VkDeviceSize unusedRangeSize = suballoc.offset - lastOffset;
        +
        10088  PrintDetailedMap_UnusedRange(json, lastOffset, unusedRangeSize);
        +
        10089  }
        +
        10090 
        +
        10091  // 2. Process this allocation.
        +
        10092  // There is allocation with suballoc.offset, suballoc.size.
        +
        10093  PrintDetailedMap_Allocation(json, suballoc.offset, suballoc.hAllocation);
        +
        10094 
        +
        10095  // 3. Prepare for next iteration.
        +
        10096  lastOffset = suballoc.offset + suballoc.size;
        +
        10097  ++nextAlloc2ndIndex;
        +
        10098  }
        +
        10099  // We are at the end.
        +
        10100  else
        +
        10101  {
        +
        10102  if(lastOffset < freeSpace2ndTo1stEnd)
        +
        10103  {
        +
        10104  // There is free space from lastOffset to freeSpace2ndTo1stEnd.
        +
        10105  const VkDeviceSize unusedRangeSize = freeSpace2ndTo1stEnd - lastOffset;
        +
        10106  PrintDetailedMap_UnusedRange(json, lastOffset, unusedRangeSize);
        +
        10107  }
        +
        10108 
        +
        10109  // End of loop.
        +
        10110  lastOffset = freeSpace2ndTo1stEnd;
        +
        10111  }
        +
        10112  }
        +
        10113  }
        +
        10114 
        +
        10115  nextAlloc1stIndex = m_1stNullItemsBeginCount;
        +
        10116  while(lastOffset < freeSpace1stTo2ndEnd)
        +
        10117  {
        +
        10118  // Find next non-null allocation or move nextAllocIndex to the end.
        +
        10119  while(nextAlloc1stIndex < suballoc1stCount &&
        +
        10120  suballocations1st[nextAlloc1stIndex].hAllocation == VK_NULL_HANDLE)
        +
        10121  {
        +
        10122  ++nextAlloc1stIndex;
        +
        10123  }
        +
        10124 
        +
        10125  // Found non-null allocation.
        +
        10126  if(nextAlloc1stIndex < suballoc1stCount)
        +
        10127  {
        +
        10128  const VmaSuballocation& suballoc = suballocations1st[nextAlloc1stIndex];
        +
        10129 
        +
        10130  // 1. Process free space before this allocation.
        +
        10131  if(lastOffset < suballoc.offset)
        +
        10132  {
        +
        10133  // There is free space from lastOffset to suballoc.offset.
        +
        10134  const VkDeviceSize unusedRangeSize = suballoc.offset - lastOffset;
        +
        10135  PrintDetailedMap_UnusedRange(json, lastOffset, unusedRangeSize);
        +
        10136  }
        +
        10137 
        +
        10138  // 2. Process this allocation.
        +
        10139  // There is allocation with suballoc.offset, suballoc.size.
        +
        10140  PrintDetailedMap_Allocation(json, suballoc.offset, suballoc.hAllocation);
        +
        10141 
        +
        10142  // 3. Prepare for next iteration.
        +
        10143  lastOffset = suballoc.offset + suballoc.size;
        +
        10144  ++nextAlloc1stIndex;
        +
        10145  }
        +
        10146  // We are at the end.
        +
        10147  else
        +
        10148  {
        +
        10149  if(lastOffset < freeSpace1stTo2ndEnd)
        +
        10150  {
        +
        10151  // There is free space from lastOffset to freeSpace1stTo2ndEnd.
        +
        10152  const VkDeviceSize unusedRangeSize = freeSpace1stTo2ndEnd - lastOffset;
        +
        10153  PrintDetailedMap_UnusedRange(json, lastOffset, unusedRangeSize);
        +
        10154  }
        +
        10155 
        +
        10156  // End of loop.
        +
        10157  lastOffset = freeSpace1stTo2ndEnd;
        +
        10158  }
        +
        10159  }
        +
        10160 
        +
        10161  if(m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK)
        +
        10162  {
        +
        10163  size_t nextAlloc2ndIndex = suballocations2nd.size() - 1;
        +
        10164  while(lastOffset < size)
        +
        10165  {
        +
        10166  // Find next non-null allocation or move nextAlloc2ndIndex to the end.
        +
        10167  while(nextAlloc2ndIndex != SIZE_MAX &&
        +
        10168  suballocations2nd[nextAlloc2ndIndex].hAllocation == VK_NULL_HANDLE)
        +
        10169  {
        +
        10170  --nextAlloc2ndIndex;
        +
        10171  }
        +
        10172 
        +
        10173  // Found non-null allocation.
        +
        10174  if(nextAlloc2ndIndex != SIZE_MAX)
        +
        10175  {
        +
        10176  const VmaSuballocation& suballoc = suballocations2nd[nextAlloc2ndIndex];
        +
        10177 
        +
        10178  // 1. Process free space before this allocation.
        +
        10179  if(lastOffset < suballoc.offset)
        10180  {
        -
        10181  // Already on next page.
        -
        10182  break;
        -
        10183  }
        -
        10184  }
        -
        10185  }
        -
        10186 
        -
        10187  // All tests passed: Success.
        -
        10188  pAllocationRequest->offset = resultOffset;
        -
        10189  pAllocationRequest->sumFreeSize = resultBaseOffset + allocSize - endOf1st;
        -
        10190  pAllocationRequest->sumItemSize = 0;
        -
        10191  // pAllocationRequest->item unused.
        -
        10192  pAllocationRequest->itemsToMakeLostCount = 0;
        -
        10193  pAllocationRequest->type = VmaAllocationRequestType::UpperAddress;
        -
        10194  return true;
        -
        10195  }
        -
        10196 
        -
        10197  return false;
        -
        10198 }
        -
        10199 
        -
        10200 bool VmaBlockMetadata_Linear::CreateAllocationRequest_LowerAddress(
        -
        10201  uint32_t currentFrameIndex,
        -
        10202  uint32_t frameInUseCount,
        -
        10203  VkDeviceSize bufferImageGranularity,
        -
        10204  VkDeviceSize allocSize,
        -
        10205  VkDeviceSize allocAlignment,
        -
        10206  VmaSuballocationType allocType,
        -
        10207  bool canMakeOtherLost,
        -
        10208  uint32_t strategy,
        -
        10209  VmaAllocationRequest* pAllocationRequest)
        -
        10210 {
        -
        10211  const VkDeviceSize size = GetSize();
        -
        10212  SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        -
        10213  SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        -
        10214 
        -
        10215  if(m_2ndVectorMode == SECOND_VECTOR_EMPTY || m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK)
        -
        10216  {
        -
        10217  // Try to allocate at the end of 1st vector.
        -
        10218 
        -
        10219  VkDeviceSize resultBaseOffset = 0;
        -
        10220  if(!suballocations1st.empty())
        -
        10221  {
        -
        10222  const VmaSuballocation& lastSuballoc = suballocations1st.back();
        -
        10223  resultBaseOffset = lastSuballoc.offset + lastSuballoc.size;
        -
        10224  }
        -
        10225 
        -
        10226  // Start from offset equal to beginning of free space.
        -
        10227  VkDeviceSize resultOffset = resultBaseOffset;
        -
        10228 
        -
        10229  // Apply VMA_DEBUG_MARGIN at the beginning.
        -
        10230  if(VMA_DEBUG_MARGIN > 0)
        -
        10231  {
        -
        10232  resultOffset += VMA_DEBUG_MARGIN;
        -
        10233  }
        -
        10234 
        -
        10235  // Apply alignment.
        -
        10236  resultOffset = VmaAlignUp(resultOffset, allocAlignment);
        -
        10237 
        -
        10238  // Check previous suballocations for BufferImageGranularity conflicts.
        -
        10239  // Make bigger alignment if necessary.
        -
        10240  if(bufferImageGranularity > 1 && !suballocations1st.empty())
        -
        10241  {
        -
        10242  bool bufferImageGranularityConflict = false;
        -
        10243  for(size_t prevSuballocIndex = suballocations1st.size(); prevSuballocIndex--; )
        -
        10244  {
        -
        10245  const VmaSuballocation& prevSuballoc = suballocations1st[prevSuballocIndex];
        -
        10246  if(VmaBlocksOnSamePage(prevSuballoc.offset, prevSuballoc.size, resultOffset, bufferImageGranularity))
        -
        10247  {
        -
        10248  if(VmaIsBufferImageGranularityConflict(prevSuballoc.type, allocType))
        -
        10249  {
        -
        10250  bufferImageGranularityConflict = true;
        -
        10251  break;
        -
        10252  }
        -
        10253  }
        -
        10254  else
        -
        10255  // Already on previous page.
        -
        10256  break;
        -
        10257  }
        -
        10258  if(bufferImageGranularityConflict)
        -
        10259  {
        -
        10260  resultOffset = VmaAlignUp(resultOffset, bufferImageGranularity);
        -
        10261  }
        -
        10262  }
        -
        10263 
        -
        10264  const VkDeviceSize freeSpaceEnd = m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK ?
        -
        10265  suballocations2nd.back().offset : size;
        -
        10266 
        -
        10267  // There is enough free space at the end after alignment.
        -
        10268  if(resultOffset + allocSize + VMA_DEBUG_MARGIN <= freeSpaceEnd)
        -
        10269  {
        -
        10270  // Check next suballocations for BufferImageGranularity conflicts.
        -
        10271  // If conflict exists, allocation cannot be made here.
        -
        10272  if(bufferImageGranularity > 1 && m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK)
        -
        10273  {
        -
        10274  for(size_t nextSuballocIndex = suballocations2nd.size(); nextSuballocIndex--; )
        -
        10275  {
        -
        10276  const VmaSuballocation& nextSuballoc = suballocations2nd[nextSuballocIndex];
        -
        10277  if(VmaBlocksOnSamePage(resultOffset, allocSize, nextSuballoc.offset, bufferImageGranularity))
        -
        10278  {
        -
        10279  if(VmaIsBufferImageGranularityConflict(allocType, nextSuballoc.type))
        -
        10280  {
        -
        10281  return false;
        -
        10282  }
        -
        10283  }
        -
        10284  else
        -
        10285  {
        -
        10286  // Already on previous page.
        -
        10287  break;
        -
        10288  }
        -
        10289  }
        -
        10290  }
        +
        10181  // There is free space from lastOffset to suballoc.offset.
        +
        10182  const VkDeviceSize unusedRangeSize = suballoc.offset - lastOffset;
        +
        10183  PrintDetailedMap_UnusedRange(json, lastOffset, unusedRangeSize);
        +
        10184  }
        +
        10185 
        +
        10186  // 2. Process this allocation.
        +
        10187  // There is allocation with suballoc.offset, suballoc.size.
        +
        10188  PrintDetailedMap_Allocation(json, suballoc.offset, suballoc.hAllocation);
        +
        10189 
        +
        10190  // 3. Prepare for next iteration.
        +
        10191  lastOffset = suballoc.offset + suballoc.size;
        +
        10192  --nextAlloc2ndIndex;
        +
        10193  }
        +
        10194  // We are at the end.
        +
        10195  else
        +
        10196  {
        +
        10197  if(lastOffset < size)
        +
        10198  {
        +
        10199  // There is free space from lastOffset to size.
        +
        10200  const VkDeviceSize unusedRangeSize = size - lastOffset;
        +
        10201  PrintDetailedMap_UnusedRange(json, lastOffset, unusedRangeSize);
        +
        10202  }
        +
        10203 
        +
        10204  // End of loop.
        +
        10205  lastOffset = size;
        +
        10206  }
        +
        10207  }
        +
        10208  }
        +
        10209 
        +
        10210  PrintDetailedMap_End(json);
        +
        10211 }
        +
        10212 #endif // #if VMA_STATS_STRING_ENABLED
        +
        10213 
        +
        10214 bool VmaBlockMetadata_Linear::CreateAllocationRequest(
        +
        10215  uint32_t currentFrameIndex,
        +
        10216  uint32_t frameInUseCount,
        +
        10217  VkDeviceSize bufferImageGranularity,
        +
        10218  VkDeviceSize allocSize,
        +
        10219  VkDeviceSize allocAlignment,
        +
        10220  bool upperAddress,
        +
        10221  VmaSuballocationType allocType,
        +
        10222  bool canMakeOtherLost,
        +
        10223  uint32_t strategy,
        +
        10224  VmaAllocationRequest* pAllocationRequest)
        +
        10225 {
        +
        10226  VMA_ASSERT(allocSize > 0);
        +
        10227  VMA_ASSERT(allocType != VMA_SUBALLOCATION_TYPE_FREE);
        +
        10228  VMA_ASSERT(pAllocationRequest != VMA_NULL);
        +
        10229  VMA_HEAVY_ASSERT(Validate());
        +
        10230  return upperAddress ?
        +
        10231  CreateAllocationRequest_UpperAddress(
        +
        10232  currentFrameIndex, frameInUseCount, bufferImageGranularity,
        +
        10233  allocSize, allocAlignment, allocType, canMakeOtherLost, strategy, pAllocationRequest) :
        +
        10234  CreateAllocationRequest_LowerAddress(
        +
        10235  currentFrameIndex, frameInUseCount, bufferImageGranularity,
        +
        10236  allocSize, allocAlignment, allocType, canMakeOtherLost, strategy, pAllocationRequest);
        +
        10237 }
        +
        10238 
        +
        10239 bool VmaBlockMetadata_Linear::CreateAllocationRequest_UpperAddress(
        +
        10240  uint32_t currentFrameIndex,
        +
        10241  uint32_t frameInUseCount,
        +
        10242  VkDeviceSize bufferImageGranularity,
        +
        10243  VkDeviceSize allocSize,
        +
        10244  VkDeviceSize allocAlignment,
        +
        10245  VmaSuballocationType allocType,
        +
        10246  bool canMakeOtherLost,
        +
        10247  uint32_t strategy,
        +
        10248  VmaAllocationRequest* pAllocationRequest)
        +
        10249 {
        +
        10250  const VkDeviceSize size = GetSize();
        +
        10251  SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        +
        10252  SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        +
        10253 
        +
        10254  if(m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER)
        +
        10255  {
        +
        10256  VMA_ASSERT(0 && "Trying to use pool with linear algorithm as double stack, while it is already being used as ring buffer.");
        +
        10257  return false;
        +
        10258  }
        +
        10259 
        +
        10260  // Try to allocate before 2nd.back(), or end of block if 2nd.empty().
        +
        10261  if(allocSize > size)
        +
        10262  {
        +
        10263  return false;
        +
        10264  }
        +
        10265  VkDeviceSize resultBaseOffset = size - allocSize;
        +
        10266  if(!suballocations2nd.empty())
        +
        10267  {
        +
        10268  const VmaSuballocation& lastSuballoc = suballocations2nd.back();
        +
        10269  resultBaseOffset = lastSuballoc.offset - allocSize;
        +
        10270  if(allocSize > lastSuballoc.offset)
        +
        10271  {
        +
        10272  return false;
        +
        10273  }
        +
        10274  }
        +
        10275 
        +
        10276  // Start from offset equal to end of free space.
        +
        10277  VkDeviceSize resultOffset = resultBaseOffset;
        +
        10278 
        +
        10279  // Apply VMA_DEBUG_MARGIN at the end.
        +
        10280  if(VMA_DEBUG_MARGIN > 0)
        +
        10281  {
        +
        10282  if(resultOffset < VMA_DEBUG_MARGIN)
        +
        10283  {
        +
        10284  return false;
        +
        10285  }
        +
        10286  resultOffset -= VMA_DEBUG_MARGIN;
        +
        10287  }
        +
        10288 
        +
        10289  // Apply alignment.
        +
        10290  resultOffset = VmaAlignDown(resultOffset, allocAlignment);
        10291 
        -
        10292  // All tests passed: Success.
        -
        10293  pAllocationRequest->offset = resultOffset;
        -
        10294  pAllocationRequest->sumFreeSize = freeSpaceEnd - resultBaseOffset;
        -
        10295  pAllocationRequest->sumItemSize = 0;
        -
        10296  // pAllocationRequest->item, customData unused.
        -
        10297  pAllocationRequest->type = VmaAllocationRequestType::EndOf1st;
        -
        10298  pAllocationRequest->itemsToMakeLostCount = 0;
        -
        10299  return true;
        -
        10300  }
        -
        10301  }
        -
        10302 
        -
        10303  // Wrap-around to end of 2nd vector. Try to allocate there, watching for the
        -
        10304  // beginning of 1st vector as the end of free space.
        -
        10305  if(m_2ndVectorMode == SECOND_VECTOR_EMPTY || m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER)
        -
        10306  {
        -
        10307  VMA_ASSERT(!suballocations1st.empty());
        -
        10308 
        -
        10309  VkDeviceSize resultBaseOffset = 0;
        -
        10310  if(!suballocations2nd.empty())
        -
        10311  {
        -
        10312  const VmaSuballocation& lastSuballoc = suballocations2nd.back();
        -
        10313  resultBaseOffset = lastSuballoc.offset + lastSuballoc.size;
        -
        10314  }
        -
        10315 
        -
        10316  // Start from offset equal to beginning of free space.
        -
        10317  VkDeviceSize resultOffset = resultBaseOffset;
        -
        10318 
        -
        10319  // Apply VMA_DEBUG_MARGIN at the beginning.
        -
        10320  if(VMA_DEBUG_MARGIN > 0)
        -
        10321  {
        -
        10322  resultOffset += VMA_DEBUG_MARGIN;
        -
        10323  }
        -
        10324 
        -
        10325  // Apply alignment.
        -
        10326  resultOffset = VmaAlignUp(resultOffset, allocAlignment);
        -
        10327 
        -
        10328  // Check previous suballocations for BufferImageGranularity conflicts.
        -
        10329  // Make bigger alignment if necessary.
        -
        10330  if(bufferImageGranularity > 1 && !suballocations2nd.empty())
        -
        10331  {
        -
        10332  bool bufferImageGranularityConflict = false;
        -
        10333  for(size_t prevSuballocIndex = suballocations2nd.size(); prevSuballocIndex--; )
        -
        10334  {
        -
        10335  const VmaSuballocation& prevSuballoc = suballocations2nd[prevSuballocIndex];
        -
        10336  if(VmaBlocksOnSamePage(prevSuballoc.offset, prevSuballoc.size, resultOffset, bufferImageGranularity))
        -
        10337  {
        -
        10338  if(VmaIsBufferImageGranularityConflict(prevSuballoc.type, allocType))
        -
        10339  {
        -
        10340  bufferImageGranularityConflict = true;
        -
        10341  break;
        -
        10342  }
        -
        10343  }
        -
        10344  else
        -
        10345  // Already on previous page.
        -
        10346  break;
        -
        10347  }
        -
        10348  if(bufferImageGranularityConflict)
        -
        10349  {
        -
        10350  resultOffset = VmaAlignUp(resultOffset, bufferImageGranularity);
        -
        10351  }
        -
        10352  }
        -
        10353 
        -
        10354  pAllocationRequest->itemsToMakeLostCount = 0;
        -
        10355  pAllocationRequest->sumItemSize = 0;
        -
        10356  size_t index1st = m_1stNullItemsBeginCount;
        -
        10357 
        -
        10358  if(canMakeOtherLost)
        -
        10359  {
        -
        10360  while(index1st < suballocations1st.size() &&
        -
        10361  resultOffset + allocSize + VMA_DEBUG_MARGIN > suballocations1st[index1st].offset)
        -
        10362  {
        -
        10363  // Next colliding allocation at the beginning of 1st vector found. Try to make it lost.
        -
        10364  const VmaSuballocation& suballoc = suballocations1st[index1st];
        -
        10365  if(suballoc.type == VMA_SUBALLOCATION_TYPE_FREE)
        -
        10366  {
        -
        10367  // No problem.
        -
        10368  }
        -
        10369  else
        -
        10370  {
        -
        10371  VMA_ASSERT(suballoc.hAllocation != VK_NULL_HANDLE);
        -
        10372  if(suballoc.hAllocation->CanBecomeLost() &&
        -
        10373  suballoc.hAllocation->GetLastUseFrameIndex() + frameInUseCount < currentFrameIndex)
        -
        10374  {
        -
        10375  ++pAllocationRequest->itemsToMakeLostCount;
        -
        10376  pAllocationRequest->sumItemSize += suballoc.size;
        -
        10377  }
        -
        10378  else
        -
        10379  {
        -
        10380  return false;
        -
        10381  }
        -
        10382  }
        -
        10383  ++index1st;
        -
        10384  }
        -
        10385 
        -
        10386  // Check next suballocations for BufferImageGranularity conflicts.
        -
        10387  // If conflict exists, we must mark more allocations lost or fail.
        -
        10388  if(bufferImageGranularity > 1)
        -
        10389  {
        -
        10390  while(index1st < suballocations1st.size())
        -
        10391  {
        -
        10392  const VmaSuballocation& suballoc = suballocations1st[index1st];
        -
        10393  if(VmaBlocksOnSamePage(resultOffset, allocSize, suballoc.offset, bufferImageGranularity))
        -
        10394  {
        -
        10395  if(suballoc.hAllocation != VK_NULL_HANDLE)
        -
        10396  {
        -
        10397  // Not checking actual VmaIsBufferImageGranularityConflict(allocType, suballoc.type).
        -
        10398  if(suballoc.hAllocation->CanBecomeLost() &&
        -
        10399  suballoc.hAllocation->GetLastUseFrameIndex() + frameInUseCount < currentFrameIndex)
        -
        10400  {
        -
        10401  ++pAllocationRequest->itemsToMakeLostCount;
        -
        10402  pAllocationRequest->sumItemSize += suballoc.size;
        -
        10403  }
        -
        10404  else
        -
        10405  {
        -
        10406  return false;
        -
        10407  }
        -
        10408  }
        -
        10409  }
        -
        10410  else
        -
        10411  {
        -
        10412  // Already on next page.
        -
        10413  break;
        -
        10414  }
        -
        10415  ++index1st;
        -
        10416  }
        -
        10417  }
        -
        10418 
        -
        10419  // Special case: There is not enough room at the end for this allocation, even after making all from the 1st lost.
        -
        10420  if(index1st == suballocations1st.size() &&
        -
        10421  resultOffset + allocSize + VMA_DEBUG_MARGIN > size)
        -
        10422  {
        -
        10423  // TODO: This is a known bug that it's not yet implemented and the allocation is failing.
        -
        10424  VMA_DEBUG_LOG("Unsupported special case in custom pool with linear allocation algorithm used as ring buffer with allocations that can be lost.");
        -
        10425  }
        -
        10426  }
        -
        10427 
        -
        10428  // There is enough free space at the end after alignment.
        -
        10429  if((index1st == suballocations1st.size() && resultOffset + allocSize + VMA_DEBUG_MARGIN <= size) ||
        -
        10430  (index1st < suballocations1st.size() && resultOffset + allocSize + VMA_DEBUG_MARGIN <= suballocations1st[index1st].offset))
        -
        10431  {
        -
        10432  // Check next suballocations for BufferImageGranularity conflicts.
        -
        10433  // If conflict exists, allocation cannot be made here.
        -
        10434  if(bufferImageGranularity > 1)
        -
        10435  {
        -
        10436  for(size_t nextSuballocIndex = index1st;
        -
        10437  nextSuballocIndex < suballocations1st.size();
        -
        10438  nextSuballocIndex++)
        -
        10439  {
        -
        10440  const VmaSuballocation& nextSuballoc = suballocations1st[nextSuballocIndex];
        -
        10441  if(VmaBlocksOnSamePage(resultOffset, allocSize, nextSuballoc.offset, bufferImageGranularity))
        -
        10442  {
        -
        10443  if(VmaIsBufferImageGranularityConflict(allocType, nextSuballoc.type))
        -
        10444  {
        -
        10445  return false;
        -
        10446  }
        +
        10292  // Check next suballocations from 2nd for BufferImageGranularity conflicts.
        +
        10293  // Make bigger alignment if necessary.
        +
        10294  if(bufferImageGranularity > 1 && !suballocations2nd.empty())
        +
        10295  {
        +
        10296  bool bufferImageGranularityConflict = false;
        +
        10297  for(size_t nextSuballocIndex = suballocations2nd.size(); nextSuballocIndex--; )
        +
        10298  {
        +
        10299  const VmaSuballocation& nextSuballoc = suballocations2nd[nextSuballocIndex];
        +
        10300  if(VmaBlocksOnSamePage(resultOffset, allocSize, nextSuballoc.offset, bufferImageGranularity))
        +
        10301  {
        +
        10302  if(VmaIsBufferImageGranularityConflict(nextSuballoc.type, allocType))
        +
        10303  {
        +
        10304  bufferImageGranularityConflict = true;
        +
        10305  break;
        +
        10306  }
        +
        10307  }
        +
        10308  else
        +
        10309  // Already on previous page.
        +
        10310  break;
        +
        10311  }
        +
        10312  if(bufferImageGranularityConflict)
        +
        10313  {
        +
        10314  resultOffset = VmaAlignDown(resultOffset, bufferImageGranularity);
        +
        10315  }
        +
        10316  }
        +
        10317 
        +
        10318  // There is enough free space.
        +
        10319  const VkDeviceSize endOf1st = !suballocations1st.empty() ?
        +
        10320  suballocations1st.back().offset + suballocations1st.back().size :
        +
        10321  0;
        +
        10322  if(endOf1st + VMA_DEBUG_MARGIN <= resultOffset)
        +
        10323  {
        +
        10324  // Check previous suballocations for BufferImageGranularity conflicts.
        +
        10325  // If conflict exists, allocation cannot be made here.
        +
        10326  if(bufferImageGranularity > 1)
        +
        10327  {
        +
        10328  for(size_t prevSuballocIndex = suballocations1st.size(); prevSuballocIndex--; )
        +
        10329  {
        +
        10330  const VmaSuballocation& prevSuballoc = suballocations1st[prevSuballocIndex];
        +
        10331  if(VmaBlocksOnSamePage(prevSuballoc.offset, prevSuballoc.size, resultOffset, bufferImageGranularity))
        +
        10332  {
        +
        10333  if(VmaIsBufferImageGranularityConflict(allocType, prevSuballoc.type))
        +
        10334  {
        +
        10335  return false;
        +
        10336  }
        +
        10337  }
        +
        10338  else
        +
        10339  {
        +
        10340  // Already on next page.
        +
        10341  break;
        +
        10342  }
        +
        10343  }
        +
        10344  }
        +
        10345 
        +
        10346  // All tests passed: Success.
        +
        10347  pAllocationRequest->offset = resultOffset;
        +
        10348  pAllocationRequest->sumFreeSize = resultBaseOffset + allocSize - endOf1st;
        +
        10349  pAllocationRequest->sumItemSize = 0;
        +
        10350  // pAllocationRequest->item unused.
        +
        10351  pAllocationRequest->itemsToMakeLostCount = 0;
        +
        10352  pAllocationRequest->type = VmaAllocationRequestType::UpperAddress;
        +
        10353  return true;
        +
        10354  }
        +
        10355 
        +
        10356  return false;
        +
        10357 }
        +
        10358 
        +
        10359 bool VmaBlockMetadata_Linear::CreateAllocationRequest_LowerAddress(
        +
        10360  uint32_t currentFrameIndex,
        +
        10361  uint32_t frameInUseCount,
        +
        10362  VkDeviceSize bufferImageGranularity,
        +
        10363  VkDeviceSize allocSize,
        +
        10364  VkDeviceSize allocAlignment,
        +
        10365  VmaSuballocationType allocType,
        +
        10366  bool canMakeOtherLost,
        +
        10367  uint32_t strategy,
        +
        10368  VmaAllocationRequest* pAllocationRequest)
        +
        10369 {
        +
        10370  const VkDeviceSize size = GetSize();
        +
        10371  SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        +
        10372  SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        +
        10373 
        +
        10374  if(m_2ndVectorMode == SECOND_VECTOR_EMPTY || m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK)
        +
        10375  {
        +
        10376  // Try to allocate at the end of 1st vector.
        +
        10377 
        +
        10378  VkDeviceSize resultBaseOffset = 0;
        +
        10379  if(!suballocations1st.empty())
        +
        10380  {
        +
        10381  const VmaSuballocation& lastSuballoc = suballocations1st.back();
        +
        10382  resultBaseOffset = lastSuballoc.offset + lastSuballoc.size;
        +
        10383  }
        +
        10384 
        +
        10385  // Start from offset equal to beginning of free space.
        +
        10386  VkDeviceSize resultOffset = resultBaseOffset;
        +
        10387 
        +
        10388  // Apply VMA_DEBUG_MARGIN at the beginning.
        +
        10389  if(VMA_DEBUG_MARGIN > 0)
        +
        10390  {
        +
        10391  resultOffset += VMA_DEBUG_MARGIN;
        +
        10392  }
        +
        10393 
        +
        10394  // Apply alignment.
        +
        10395  resultOffset = VmaAlignUp(resultOffset, allocAlignment);
        +
        10396 
        +
        10397  // Check previous suballocations for BufferImageGranularity conflicts.
        +
        10398  // Make bigger alignment if necessary.
        +
        10399  if(bufferImageGranularity > 1 && !suballocations1st.empty())
        +
        10400  {
        +
        10401  bool bufferImageGranularityConflict = false;
        +
        10402  for(size_t prevSuballocIndex = suballocations1st.size(); prevSuballocIndex--; )
        +
        10403  {
        +
        10404  const VmaSuballocation& prevSuballoc = suballocations1st[prevSuballocIndex];
        +
        10405  if(VmaBlocksOnSamePage(prevSuballoc.offset, prevSuballoc.size, resultOffset, bufferImageGranularity))
        +
        10406  {
        +
        10407  if(VmaIsBufferImageGranularityConflict(prevSuballoc.type, allocType))
        +
        10408  {
        +
        10409  bufferImageGranularityConflict = true;
        +
        10410  break;
        +
        10411  }
        +
        10412  }
        +
        10413  else
        +
        10414  // Already on previous page.
        +
        10415  break;
        +
        10416  }
        +
        10417  if(bufferImageGranularityConflict)
        +
        10418  {
        +
        10419  resultOffset = VmaAlignUp(resultOffset, bufferImageGranularity);
        +
        10420  }
        +
        10421  }
        +
        10422 
        +
        10423  const VkDeviceSize freeSpaceEnd = m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK ?
        +
        10424  suballocations2nd.back().offset : size;
        +
        10425 
        +
        10426  // There is enough free space at the end after alignment.
        +
        10427  if(resultOffset + allocSize + VMA_DEBUG_MARGIN <= freeSpaceEnd)
        +
        10428  {
        +
        10429  // Check next suballocations for BufferImageGranularity conflicts.
        +
        10430  // If conflict exists, allocation cannot be made here.
        +
        10431  if(bufferImageGranularity > 1 && m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK)
        +
        10432  {
        +
        10433  for(size_t nextSuballocIndex = suballocations2nd.size(); nextSuballocIndex--; )
        +
        10434  {
        +
        10435  const VmaSuballocation& nextSuballoc = suballocations2nd[nextSuballocIndex];
        +
        10436  if(VmaBlocksOnSamePage(resultOffset, allocSize, nextSuballoc.offset, bufferImageGranularity))
        +
        10437  {
        +
        10438  if(VmaIsBufferImageGranularityConflict(allocType, nextSuballoc.type))
        +
        10439  {
        +
        10440  return false;
        +
        10441  }
        +
        10442  }
        +
        10443  else
        +
        10444  {
        +
        10445  // Already on previous page.
        +
        10446  break;
        10447  }
        -
        10448  else
        -
        10449  {
        -
        10450  // Already on next page.
        -
        10451  break;
        -
        10452  }
        -
        10453  }
        -
        10454  }
        -
        10455 
        -
        10456  // All tests passed: Success.
        -
        10457  pAllocationRequest->offset = resultOffset;
        -
        10458  pAllocationRequest->sumFreeSize =
        -
        10459  (index1st < suballocations1st.size() ? suballocations1st[index1st].offset : size)
        -
        10460  - resultBaseOffset
        -
        10461  - pAllocationRequest->sumItemSize;
        -
        10462  pAllocationRequest->type = VmaAllocationRequestType::EndOf2nd;
        -
        10463  // pAllocationRequest->item, customData unused.
        -
        10464  return true;
        -
        10465  }
        -
        10466  }
        +
        10448  }
        +
        10449  }
        +
        10450 
        +
        10451  // All tests passed: Success.
        +
        10452  pAllocationRequest->offset = resultOffset;
        +
        10453  pAllocationRequest->sumFreeSize = freeSpaceEnd - resultBaseOffset;
        +
        10454  pAllocationRequest->sumItemSize = 0;
        +
        10455  // pAllocationRequest->item, customData unused.
        +
        10456  pAllocationRequest->type = VmaAllocationRequestType::EndOf1st;
        +
        10457  pAllocationRequest->itemsToMakeLostCount = 0;
        +
        10458  return true;
        +
        10459  }
        +
        10460  }
        +
        10461 
        +
        10462  // Wrap-around to end of 2nd vector. Try to allocate there, watching for the
        +
        10463  // beginning of 1st vector as the end of free space.
        +
        10464  if(m_2ndVectorMode == SECOND_VECTOR_EMPTY || m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER)
        +
        10465  {
        +
        10466  VMA_ASSERT(!suballocations1st.empty());
        10467 
        -
        10468  return false;
        -
        10469 }
        -
        10470 
        -
        10471 bool VmaBlockMetadata_Linear::MakeRequestedAllocationsLost(
        -
        10472  uint32_t currentFrameIndex,
        -
        10473  uint32_t frameInUseCount,
        -
        10474  VmaAllocationRequest* pAllocationRequest)
        -
        10475 {
        -
        10476  if(pAllocationRequest->itemsToMakeLostCount == 0)
        -
        10477  {
        -
        10478  return true;
        -
        10479  }
        -
        10480 
        -
        10481  VMA_ASSERT(m_2ndVectorMode == SECOND_VECTOR_EMPTY || m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER);
        -
        10482 
        -
        10483  // We always start from 1st.
        -
        10484  SuballocationVectorType* suballocations = &AccessSuballocations1st();
        -
        10485  size_t index = m_1stNullItemsBeginCount;
        -
        10486  size_t madeLostCount = 0;
        -
        10487  while(madeLostCount < pAllocationRequest->itemsToMakeLostCount)
        -
        10488  {
        -
        10489  if(index == suballocations->size())
        +
        10468  VkDeviceSize resultBaseOffset = 0;
        +
        10469  if(!suballocations2nd.empty())
        +
        10470  {
        +
        10471  const VmaSuballocation& lastSuballoc = suballocations2nd.back();
        +
        10472  resultBaseOffset = lastSuballoc.offset + lastSuballoc.size;
        +
        10473  }
        +
        10474 
        +
        10475  // Start from offset equal to beginning of free space.
        +
        10476  VkDeviceSize resultOffset = resultBaseOffset;
        +
        10477 
        +
        10478  // Apply VMA_DEBUG_MARGIN at the beginning.
        +
        10479  if(VMA_DEBUG_MARGIN > 0)
        +
        10480  {
        +
        10481  resultOffset += VMA_DEBUG_MARGIN;
        +
        10482  }
        +
        10483 
        +
        10484  // Apply alignment.
        +
        10485  resultOffset = VmaAlignUp(resultOffset, allocAlignment);
        +
        10486 
        +
        10487  // Check previous suballocations for BufferImageGranularity conflicts.
        +
        10488  // Make bigger alignment if necessary.
        +
        10489  if(bufferImageGranularity > 1 && !suballocations2nd.empty())
        10490  {
        -
        10491  index = 0;
        -
        10492  // If we get to the end of 1st, we wrap around to beginning of 2nd of 1st.
        -
        10493  if(m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER)
        -
        10494  {
        -
        10495  suballocations = &AccessSuballocations2nd();
        -
        10496  }
        -
        10497  // else: m_2ndVectorMode == SECOND_VECTOR_EMPTY:
        -
        10498  // suballocations continues pointing at AccessSuballocations1st().
        -
        10499  VMA_ASSERT(!suballocations->empty());
        -
        10500  }
        -
        10501  VmaSuballocation& suballoc = (*suballocations)[index];
        -
        10502  if(suballoc.type != VMA_SUBALLOCATION_TYPE_FREE)
        -
        10503  {
        -
        10504  VMA_ASSERT(suballoc.hAllocation != VK_NULL_HANDLE);
        -
        10505  VMA_ASSERT(suballoc.hAllocation->CanBecomeLost());
        -
        10506  if(suballoc.hAllocation->MakeLost(currentFrameIndex, frameInUseCount))
        -
        10507  {
        -
        10508  suballoc.type = VMA_SUBALLOCATION_TYPE_FREE;
        -
        10509  suballoc.hAllocation = VK_NULL_HANDLE;
        -
        10510  m_SumFreeSize += suballoc.size;
        -
        10511  if(suballocations == &AccessSuballocations1st())
        -
        10512  {
        -
        10513  ++m_1stNullItemsMiddleCount;
        -
        10514  }
        -
        10515  else
        -
        10516  {
        -
        10517  ++m_2ndNullItemsCount;
        -
        10518  }
        -
        10519  ++madeLostCount;
        -
        10520  }
        -
        10521  else
        -
        10522  {
        -
        10523  return false;
        -
        10524  }
        -
        10525  }
        -
        10526  ++index;
        -
        10527  }
        -
        10528 
        -
        10529  CleanupAfterFree();
        -
        10530  //VMA_HEAVY_ASSERT(Validate()); // Already called by ClanupAfterFree().
        -
        10531 
        -
        10532  return true;
        -
        10533 }
        -
        10534 
        -
        10535 uint32_t VmaBlockMetadata_Linear::MakeAllocationsLost(uint32_t currentFrameIndex, uint32_t frameInUseCount)
        -
        10536 {
        -
        10537  uint32_t lostAllocationCount = 0;
        -
        10538 
        -
        10539  SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        -
        10540  for(size_t i = m_1stNullItemsBeginCount, count = suballocations1st.size(); i < count; ++i)
        -
        10541  {
        -
        10542  VmaSuballocation& suballoc = suballocations1st[i];
        -
        10543  if(suballoc.type != VMA_SUBALLOCATION_TYPE_FREE &&
        -
        10544  suballoc.hAllocation->CanBecomeLost() &&
        -
        10545  suballoc.hAllocation->MakeLost(currentFrameIndex, frameInUseCount))
        -
        10546  {
        -
        10547  suballoc.type = VMA_SUBALLOCATION_TYPE_FREE;
        -
        10548  suballoc.hAllocation = VK_NULL_HANDLE;
        -
        10549  ++m_1stNullItemsMiddleCount;
        -
        10550  m_SumFreeSize += suballoc.size;
        -
        10551  ++lostAllocationCount;
        -
        10552  }
        -
        10553  }
        -
        10554 
        -
        10555  SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        -
        10556  for(size_t i = 0, count = suballocations2nd.size(); i < count; ++i)
        -
        10557  {
        -
        10558  VmaSuballocation& suballoc = suballocations2nd[i];
        -
        10559  if(suballoc.type != VMA_SUBALLOCATION_TYPE_FREE &&
        -
        10560  suballoc.hAllocation->CanBecomeLost() &&
        -
        10561  suballoc.hAllocation->MakeLost(currentFrameIndex, frameInUseCount))
        -
        10562  {
        -
        10563  suballoc.type = VMA_SUBALLOCATION_TYPE_FREE;
        -
        10564  suballoc.hAllocation = VK_NULL_HANDLE;
        -
        10565  ++m_2ndNullItemsCount;
        -
        10566  m_SumFreeSize += suballoc.size;
        -
        10567  ++lostAllocationCount;
        -
        10568  }
        -
        10569  }
        -
        10570 
        -
        10571  if(lostAllocationCount)
        -
        10572  {
        -
        10573  CleanupAfterFree();
        -
        10574  }
        -
        10575 
        -
        10576  return lostAllocationCount;
        -
        10577 }
        -
        10578 
        -
        10579 VkResult VmaBlockMetadata_Linear::CheckCorruption(const void* pBlockData)
        -
        10580 {
        -
        10581  SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        -
        10582  for(size_t i = m_1stNullItemsBeginCount, count = suballocations1st.size(); i < count; ++i)
        -
        10583  {
        -
        10584  const VmaSuballocation& suballoc = suballocations1st[i];
        -
        10585  if(suballoc.type != VMA_SUBALLOCATION_TYPE_FREE)
        -
        10586  {
        -
        10587  if(!VmaValidateMagicValue(pBlockData, suballoc.offset - VMA_DEBUG_MARGIN))
        -
        10588  {
        -
        10589  VMA_ASSERT(0 && "MEMORY CORRUPTION DETECTED BEFORE VALIDATED ALLOCATION!");
        -
        10590  return VK_ERROR_VALIDATION_FAILED_EXT;
        -
        10591  }
        -
        10592  if(!VmaValidateMagicValue(pBlockData, suballoc.offset + suballoc.size))
        -
        10593  {
        -
        10594  VMA_ASSERT(0 && "MEMORY CORRUPTION DETECTED AFTER VALIDATED ALLOCATION!");
        -
        10595  return VK_ERROR_VALIDATION_FAILED_EXT;
        -
        10596  }
        -
        10597  }
        -
        10598  }
        -
        10599 
        -
        10600  SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        -
        10601  for(size_t i = 0, count = suballocations2nd.size(); i < count; ++i)
        -
        10602  {
        -
        10603  const VmaSuballocation& suballoc = suballocations2nd[i];
        -
        10604  if(suballoc.type != VMA_SUBALLOCATION_TYPE_FREE)
        -
        10605  {
        -
        10606  if(!VmaValidateMagicValue(pBlockData, suballoc.offset - VMA_DEBUG_MARGIN))
        -
        10607  {
        -
        10608  VMA_ASSERT(0 && "MEMORY CORRUPTION DETECTED BEFORE VALIDATED ALLOCATION!");
        -
        10609  return VK_ERROR_VALIDATION_FAILED_EXT;
        -
        10610  }
        -
        10611  if(!VmaValidateMagicValue(pBlockData, suballoc.offset + suballoc.size))
        -
        10612  {
        -
        10613  VMA_ASSERT(0 && "MEMORY CORRUPTION DETECTED AFTER VALIDATED ALLOCATION!");
        -
        10614  return VK_ERROR_VALIDATION_FAILED_EXT;
        -
        10615  }
        -
        10616  }
        -
        10617  }
        -
        10618 
        -
        10619  return VK_SUCCESS;
        -
        10620 }
        -
        10621 
        -
        10622 void VmaBlockMetadata_Linear::Alloc(
        -
        10623  const VmaAllocationRequest& request,
        -
        10624  VmaSuballocationType type,
        -
        10625  VkDeviceSize allocSize,
        -
        10626  VmaAllocation hAllocation)
        -
        10627 {
        -
        10628  const VmaSuballocation newSuballoc = { request.offset, allocSize, hAllocation, type };
        +
        10491  bool bufferImageGranularityConflict = false;
        +
        10492  for(size_t prevSuballocIndex = suballocations2nd.size(); prevSuballocIndex--; )
        +
        10493  {
        +
        10494  const VmaSuballocation& prevSuballoc = suballocations2nd[prevSuballocIndex];
        +
        10495  if(VmaBlocksOnSamePage(prevSuballoc.offset, prevSuballoc.size, resultOffset, bufferImageGranularity))
        +
        10496  {
        +
        10497  if(VmaIsBufferImageGranularityConflict(prevSuballoc.type, allocType))
        +
        10498  {
        +
        10499  bufferImageGranularityConflict = true;
        +
        10500  break;
        +
        10501  }
        +
        10502  }
        +
        10503  else
        +
        10504  // Already on previous page.
        +
        10505  break;
        +
        10506  }
        +
        10507  if(bufferImageGranularityConflict)
        +
        10508  {
        +
        10509  resultOffset = VmaAlignUp(resultOffset, bufferImageGranularity);
        +
        10510  }
        +
        10511  }
        +
        10512 
        +
        10513  pAllocationRequest->itemsToMakeLostCount = 0;
        +
        10514  pAllocationRequest->sumItemSize = 0;
        +
        10515  size_t index1st = m_1stNullItemsBeginCount;
        +
        10516 
        +
        10517  if(canMakeOtherLost)
        +
        10518  {
        +
        10519  while(index1st < suballocations1st.size() &&
        +
        10520  resultOffset + allocSize + VMA_DEBUG_MARGIN > suballocations1st[index1st].offset)
        +
        10521  {
        +
        10522  // Next colliding allocation at the beginning of 1st vector found. Try to make it lost.
        +
        10523  const VmaSuballocation& suballoc = suballocations1st[index1st];
        +
        10524  if(suballoc.type == VMA_SUBALLOCATION_TYPE_FREE)
        +
        10525  {
        +
        10526  // No problem.
        +
        10527  }
        +
        10528  else
        +
        10529  {
        +
        10530  VMA_ASSERT(suballoc.hAllocation != VK_NULL_HANDLE);
        +
        10531  if(suballoc.hAllocation->CanBecomeLost() &&
        +
        10532  suballoc.hAllocation->GetLastUseFrameIndex() + frameInUseCount < currentFrameIndex)
        +
        10533  {
        +
        10534  ++pAllocationRequest->itemsToMakeLostCount;
        +
        10535  pAllocationRequest->sumItemSize += suballoc.size;
        +
        10536  }
        +
        10537  else
        +
        10538  {
        +
        10539  return false;
        +
        10540  }
        +
        10541  }
        +
        10542  ++index1st;
        +
        10543  }
        +
        10544 
        +
        10545  // Check next suballocations for BufferImageGranularity conflicts.
        +
        10546  // If conflict exists, we must mark more allocations lost or fail.
        +
        10547  if(bufferImageGranularity > 1)
        +
        10548  {
        +
        10549  while(index1st < suballocations1st.size())
        +
        10550  {
        +
        10551  const VmaSuballocation& suballoc = suballocations1st[index1st];
        +
        10552  if(VmaBlocksOnSamePage(resultOffset, allocSize, suballoc.offset, bufferImageGranularity))
        +
        10553  {
        +
        10554  if(suballoc.hAllocation != VK_NULL_HANDLE)
        +
        10555  {
        +
        10556  // Not checking actual VmaIsBufferImageGranularityConflict(allocType, suballoc.type).
        +
        10557  if(suballoc.hAllocation->CanBecomeLost() &&
        +
        10558  suballoc.hAllocation->GetLastUseFrameIndex() + frameInUseCount < currentFrameIndex)
        +
        10559  {
        +
        10560  ++pAllocationRequest->itemsToMakeLostCount;
        +
        10561  pAllocationRequest->sumItemSize += suballoc.size;
        +
        10562  }
        +
        10563  else
        +
        10564  {
        +
        10565  return false;
        +
        10566  }
        +
        10567  }
        +
        10568  }
        +
        10569  else
        +
        10570  {
        +
        10571  // Already on next page.
        +
        10572  break;
        +
        10573  }
        +
        10574  ++index1st;
        +
        10575  }
        +
        10576  }
        +
        10577 
        +
        10578  // Special case: There is not enough room at the end for this allocation, even after making all from the 1st lost.
        +
        10579  if(index1st == suballocations1st.size() &&
        +
        10580  resultOffset + allocSize + VMA_DEBUG_MARGIN > size)
        +
        10581  {
        +
        10582  // TODO: This is a known bug that it's not yet implemented and the allocation is failing.
        +
        10583  VMA_DEBUG_LOG("Unsupported special case in custom pool with linear allocation algorithm used as ring buffer with allocations that can be lost.");
        +
        10584  }
        +
        10585  }
        +
        10586 
        +
        10587  // There is enough free space at the end after alignment.
        +
        10588  if((index1st == suballocations1st.size() && resultOffset + allocSize + VMA_DEBUG_MARGIN <= size) ||
        +
        10589  (index1st < suballocations1st.size() && resultOffset + allocSize + VMA_DEBUG_MARGIN <= suballocations1st[index1st].offset))
        +
        10590  {
        +
        10591  // Check next suballocations for BufferImageGranularity conflicts.
        +
        10592  // If conflict exists, allocation cannot be made here.
        +
        10593  if(bufferImageGranularity > 1)
        +
        10594  {
        +
        10595  for(size_t nextSuballocIndex = index1st;
        +
        10596  nextSuballocIndex < suballocations1st.size();
        +
        10597  nextSuballocIndex++)
        +
        10598  {
        +
        10599  const VmaSuballocation& nextSuballoc = suballocations1st[nextSuballocIndex];
        +
        10600  if(VmaBlocksOnSamePage(resultOffset, allocSize, nextSuballoc.offset, bufferImageGranularity))
        +
        10601  {
        +
        10602  if(VmaIsBufferImageGranularityConflict(allocType, nextSuballoc.type))
        +
        10603  {
        +
        10604  return false;
        +
        10605  }
        +
        10606  }
        +
        10607  else
        +
        10608  {
        +
        10609  // Already on next page.
        +
        10610  break;
        +
        10611  }
        +
        10612  }
        +
        10613  }
        +
        10614 
        +
        10615  // All tests passed: Success.
        +
        10616  pAllocationRequest->offset = resultOffset;
        +
        10617  pAllocationRequest->sumFreeSize =
        +
        10618  (index1st < suballocations1st.size() ? suballocations1st[index1st].offset : size)
        +
        10619  - resultBaseOffset
        +
        10620  - pAllocationRequest->sumItemSize;
        +
        10621  pAllocationRequest->type = VmaAllocationRequestType::EndOf2nd;
        +
        10622  // pAllocationRequest->item, customData unused.
        +
        10623  return true;
        +
        10624  }
        +
        10625  }
        +
        10626 
        +
        10627  return false;
        +
        10628 }
        10629 
        -
        10630  switch(request.type)
        -
        10631  {
        -
        10632  case VmaAllocationRequestType::UpperAddress:
        -
        10633  {
        -
        10634  VMA_ASSERT(m_2ndVectorMode != SECOND_VECTOR_RING_BUFFER &&
        -
        10635  "CRITICAL ERROR: Trying to use linear allocator as double stack while it was already used as ring buffer.");
        -
        10636  SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        -
        10637  suballocations2nd.push_back(newSuballoc);
        -
        10638  m_2ndVectorMode = SECOND_VECTOR_DOUBLE_STACK;
        -
        10639  }
        -
        10640  break;
        -
        10641  case VmaAllocationRequestType::EndOf1st:
        -
        10642  {
        -
        10643  SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        -
        10644 
        -
        10645  VMA_ASSERT(suballocations1st.empty() ||
        -
        10646  request.offset >= suballocations1st.back().offset + suballocations1st.back().size);
        -
        10647  // Check if it fits before the end of the block.
        -
        10648  VMA_ASSERT(request.offset + allocSize <= GetSize());
        -
        10649 
        -
        10650  suballocations1st.push_back(newSuballoc);
        -
        10651  }
        -
        10652  break;
        -
        10653  case VmaAllocationRequestType::EndOf2nd:
        -
        10654  {
        -
        10655  SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        -
        10656  // New allocation at the end of 2-part ring buffer, so before first allocation from 1st vector.
        -
        10657  VMA_ASSERT(!suballocations1st.empty() &&
        -
        10658  request.offset + allocSize <= suballocations1st[m_1stNullItemsBeginCount].offset);
        -
        10659  SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        -
        10660 
        -
        10661  switch(m_2ndVectorMode)
        -
        10662  {
        -
        10663  case SECOND_VECTOR_EMPTY:
        -
        10664  // First allocation from second part ring buffer.
        -
        10665  VMA_ASSERT(suballocations2nd.empty());
        -
        10666  m_2ndVectorMode = SECOND_VECTOR_RING_BUFFER;
        -
        10667  break;
        -
        10668  case SECOND_VECTOR_RING_BUFFER:
        -
        10669  // 2-part ring buffer is already started.
        -
        10670  VMA_ASSERT(!suballocations2nd.empty());
        -
        10671  break;
        -
        10672  case SECOND_VECTOR_DOUBLE_STACK:
        -
        10673  VMA_ASSERT(0 && "CRITICAL ERROR: Trying to use linear allocator as ring buffer while it was already used as double stack.");
        -
        10674  break;
        -
        10675  default:
        -
        10676  VMA_ASSERT(0);
        -
        10677  }
        -
        10678 
        -
        10679  suballocations2nd.push_back(newSuballoc);
        -
        10680  }
        -
        10681  break;
        -
        10682  default:
        -
        10683  VMA_ASSERT(0 && "CRITICAL INTERNAL ERROR.");
        -
        10684  }
        -
        10685 
        -
        10686  m_SumFreeSize -= newSuballoc.size;
        -
        10687 }
        -
        10688 
        -
        10689 void VmaBlockMetadata_Linear::Free(const VmaAllocation allocation)
        -
        10690 {
        -
        10691  FreeAtOffset(allocation->GetOffset());
        +
        10630 bool VmaBlockMetadata_Linear::MakeRequestedAllocationsLost(
        +
        10631  uint32_t currentFrameIndex,
        +
        10632  uint32_t frameInUseCount,
        +
        10633  VmaAllocationRequest* pAllocationRequest)
        +
        10634 {
        +
        10635  if(pAllocationRequest->itemsToMakeLostCount == 0)
        +
        10636  {
        +
        10637  return true;
        +
        10638  }
        +
        10639 
        +
        10640  VMA_ASSERT(m_2ndVectorMode == SECOND_VECTOR_EMPTY || m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER);
        +
        10641 
        +
        10642  // We always start from 1st.
        +
        10643  SuballocationVectorType* suballocations = &AccessSuballocations1st();
        +
        10644  size_t index = m_1stNullItemsBeginCount;
        +
        10645  size_t madeLostCount = 0;
        +
        10646  while(madeLostCount < pAllocationRequest->itemsToMakeLostCount)
        +
        10647  {
        +
        10648  if(index == suballocations->size())
        +
        10649  {
        +
        10650  index = 0;
        +
        10651  // If we get to the end of 1st, we wrap around to beginning of 2nd of 1st.
        +
        10652  if(m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER)
        +
        10653  {
        +
        10654  suballocations = &AccessSuballocations2nd();
        +
        10655  }
        +
        10656  // else: m_2ndVectorMode == SECOND_VECTOR_EMPTY:
        +
        10657  // suballocations continues pointing at AccessSuballocations1st().
        +
        10658  VMA_ASSERT(!suballocations->empty());
        +
        10659  }
        +
        10660  VmaSuballocation& suballoc = (*suballocations)[index];
        +
        10661  if(suballoc.type != VMA_SUBALLOCATION_TYPE_FREE)
        +
        10662  {
        +
        10663  VMA_ASSERT(suballoc.hAllocation != VK_NULL_HANDLE);
        +
        10664  VMA_ASSERT(suballoc.hAllocation->CanBecomeLost());
        +
        10665  if(suballoc.hAllocation->MakeLost(currentFrameIndex, frameInUseCount))
        +
        10666  {
        +
        10667  suballoc.type = VMA_SUBALLOCATION_TYPE_FREE;
        +
        10668  suballoc.hAllocation = VK_NULL_HANDLE;
        +
        10669  m_SumFreeSize += suballoc.size;
        +
        10670  if(suballocations == &AccessSuballocations1st())
        +
        10671  {
        +
        10672  ++m_1stNullItemsMiddleCount;
        +
        10673  }
        +
        10674  else
        +
        10675  {
        +
        10676  ++m_2ndNullItemsCount;
        +
        10677  }
        +
        10678  ++madeLostCount;
        +
        10679  }
        +
        10680  else
        +
        10681  {
        +
        10682  return false;
        +
        10683  }
        +
        10684  }
        +
        10685  ++index;
        +
        10686  }
        +
        10687 
        +
        10688  CleanupAfterFree();
        +
        10689  //VMA_HEAVY_ASSERT(Validate()); // Already called by ClanupAfterFree().
        +
        10690 
        +
        10691  return true;
        10692 }
        10693 
        -
        10694 void VmaBlockMetadata_Linear::FreeAtOffset(VkDeviceSize offset)
        +
        10694 uint32_t VmaBlockMetadata_Linear::MakeAllocationsLost(uint32_t currentFrameIndex, uint32_t frameInUseCount)
        10695 {
        -
        10696  SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        -
        10697  SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        -
        10698 
        -
        10699  if(!suballocations1st.empty())
        +
        10696  uint32_t lostAllocationCount = 0;
        +
        10697 
        +
        10698  SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        +
        10699  for(size_t i = m_1stNullItemsBeginCount, count = suballocations1st.size(); i < count; ++i)
        10700  {
        -
        10701  // First allocation: Mark it as next empty at the beginning.
        -
        10702  VmaSuballocation& firstSuballoc = suballocations1st[m_1stNullItemsBeginCount];
        -
        10703  if(firstSuballoc.offset == offset)
        -
        10704  {
        -
        10705  firstSuballoc.type = VMA_SUBALLOCATION_TYPE_FREE;
        -
        10706  firstSuballoc.hAllocation = VK_NULL_HANDLE;
        -
        10707  m_SumFreeSize += firstSuballoc.size;
        -
        10708  ++m_1stNullItemsBeginCount;
        -
        10709  CleanupAfterFree();
        -
        10710  return;
        +
        10701  VmaSuballocation& suballoc = suballocations1st[i];
        +
        10702  if(suballoc.type != VMA_SUBALLOCATION_TYPE_FREE &&
        +
        10703  suballoc.hAllocation->CanBecomeLost() &&
        +
        10704  suballoc.hAllocation->MakeLost(currentFrameIndex, frameInUseCount))
        +
        10705  {
        +
        10706  suballoc.type = VMA_SUBALLOCATION_TYPE_FREE;
        +
        10707  suballoc.hAllocation = VK_NULL_HANDLE;
        +
        10708  ++m_1stNullItemsMiddleCount;
        +
        10709  m_SumFreeSize += suballoc.size;
        +
        10710  ++lostAllocationCount;
        10711  }
        10712  }
        10713 
        -
        10714  // Last allocation in 2-part ring buffer or top of upper stack (same logic).
        -
        10715  if(m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER ||
        -
        10716  m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK)
        -
        10717  {
        -
        10718  VmaSuballocation& lastSuballoc = suballocations2nd.back();
        -
        10719  if(lastSuballoc.offset == offset)
        -
        10720  {
        -
        10721  m_SumFreeSize += lastSuballoc.size;
        -
        10722  suballocations2nd.pop_back();
        -
        10723  CleanupAfterFree();
        -
        10724  return;
        -
        10725  }
        -
        10726  }
        -
        10727  // Last allocation in 1st vector.
        -
        10728  else if(m_2ndVectorMode == SECOND_VECTOR_EMPTY)
        -
        10729  {
        -
        10730  VmaSuballocation& lastSuballoc = suballocations1st.back();
        -
        10731  if(lastSuballoc.offset == offset)
        -
        10732  {
        -
        10733  m_SumFreeSize += lastSuballoc.size;
        -
        10734  suballocations1st.pop_back();
        -
        10735  CleanupAfterFree();
        -
        10736  return;
        -
        10737  }
        -
        10738  }
        -
        10739 
        -
        10740  // Item from the middle of 1st vector.
        -
        10741  {
        -
        10742  VmaSuballocation refSuballoc;
        -
        10743  refSuballoc.offset = offset;
        -
        10744  // Rest of members stays uninitialized intentionally for better performance.
        -
        10745  SuballocationVectorType::iterator it = VmaBinaryFindSorted(
        -
        10746  suballocations1st.begin() + m_1stNullItemsBeginCount,
        -
        10747  suballocations1st.end(),
        -
        10748  refSuballoc,
        -
        10749  VmaSuballocationOffsetLess());
        -
        10750  if(it != suballocations1st.end())
        -
        10751  {
        -
        10752  it->type = VMA_SUBALLOCATION_TYPE_FREE;
        -
        10753  it->hAllocation = VK_NULL_HANDLE;
        -
        10754  ++m_1stNullItemsMiddleCount;
        -
        10755  m_SumFreeSize += it->size;
        -
        10756  CleanupAfterFree();
        -
        10757  return;
        -
        10758  }
        -
        10759  }
        -
        10760 
        -
        10761  if(m_2ndVectorMode != SECOND_VECTOR_EMPTY)
        -
        10762  {
        -
        10763  // Item from the middle of 2nd vector.
        -
        10764  VmaSuballocation refSuballoc;
        -
        10765  refSuballoc.offset = offset;
        -
        10766  // Rest of members stays uninitialized intentionally for better performance.
        -
        10767  SuballocationVectorType::iterator it = m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER ?
        -
        10768  VmaBinaryFindSorted(suballocations2nd.begin(), suballocations2nd.end(), refSuballoc, VmaSuballocationOffsetLess()) :
        -
        10769  VmaBinaryFindSorted(suballocations2nd.begin(), suballocations2nd.end(), refSuballoc, VmaSuballocationOffsetGreater());
        -
        10770  if(it != suballocations2nd.end())
        -
        10771  {
        -
        10772  it->type = VMA_SUBALLOCATION_TYPE_FREE;
        -
        10773  it->hAllocation = VK_NULL_HANDLE;
        -
        10774  ++m_2ndNullItemsCount;
        -
        10775  m_SumFreeSize += it->size;
        -
        10776  CleanupAfterFree();
        -
        10777  return;
        -
        10778  }
        -
        10779  }
        +
        10714  SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        +
        10715  for(size_t i = 0, count = suballocations2nd.size(); i < count; ++i)
        +
        10716  {
        +
        10717  VmaSuballocation& suballoc = suballocations2nd[i];
        +
        10718  if(suballoc.type != VMA_SUBALLOCATION_TYPE_FREE &&
        +
        10719  suballoc.hAllocation->CanBecomeLost() &&
        +
        10720  suballoc.hAllocation->MakeLost(currentFrameIndex, frameInUseCount))
        +
        10721  {
        +
        10722  suballoc.type = VMA_SUBALLOCATION_TYPE_FREE;
        +
        10723  suballoc.hAllocation = VK_NULL_HANDLE;
        +
        10724  ++m_2ndNullItemsCount;
        +
        10725  m_SumFreeSize += suballoc.size;
        +
        10726  ++lostAllocationCount;
        +
        10727  }
        +
        10728  }
        +
        10729 
        +
        10730  if(lostAllocationCount)
        +
        10731  {
        +
        10732  CleanupAfterFree();
        +
        10733  }
        +
        10734 
        +
        10735  return lostAllocationCount;
        +
        10736 }
        +
        10737 
        +
        10738 VkResult VmaBlockMetadata_Linear::CheckCorruption(const void* pBlockData)
        +
        10739 {
        +
        10740  SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        +
        10741  for(size_t i = m_1stNullItemsBeginCount, count = suballocations1st.size(); i < count; ++i)
        +
        10742  {
        +
        10743  const VmaSuballocation& suballoc = suballocations1st[i];
        +
        10744  if(suballoc.type != VMA_SUBALLOCATION_TYPE_FREE)
        +
        10745  {
        +
        10746  if(!VmaValidateMagicValue(pBlockData, suballoc.offset - VMA_DEBUG_MARGIN))
        +
        10747  {
        +
        10748  VMA_ASSERT(0 && "MEMORY CORRUPTION DETECTED BEFORE VALIDATED ALLOCATION!");
        +
        10749  return VK_ERROR_VALIDATION_FAILED_EXT;
        +
        10750  }
        +
        10751  if(!VmaValidateMagicValue(pBlockData, suballoc.offset + suballoc.size))
        +
        10752  {
        +
        10753  VMA_ASSERT(0 && "MEMORY CORRUPTION DETECTED AFTER VALIDATED ALLOCATION!");
        +
        10754  return VK_ERROR_VALIDATION_FAILED_EXT;
        +
        10755  }
        +
        10756  }
        +
        10757  }
        +
        10758 
        +
        10759  SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        +
        10760  for(size_t i = 0, count = suballocations2nd.size(); i < count; ++i)
        +
        10761  {
        +
        10762  const VmaSuballocation& suballoc = suballocations2nd[i];
        +
        10763  if(suballoc.type != VMA_SUBALLOCATION_TYPE_FREE)
        +
        10764  {
        +
        10765  if(!VmaValidateMagicValue(pBlockData, suballoc.offset - VMA_DEBUG_MARGIN))
        +
        10766  {
        +
        10767  VMA_ASSERT(0 && "MEMORY CORRUPTION DETECTED BEFORE VALIDATED ALLOCATION!");
        +
        10768  return VK_ERROR_VALIDATION_FAILED_EXT;
        +
        10769  }
        +
        10770  if(!VmaValidateMagicValue(pBlockData, suballoc.offset + suballoc.size))
        +
        10771  {
        +
        10772  VMA_ASSERT(0 && "MEMORY CORRUPTION DETECTED AFTER VALIDATED ALLOCATION!");
        +
        10773  return VK_ERROR_VALIDATION_FAILED_EXT;
        +
        10774  }
        +
        10775  }
        +
        10776  }
        +
        10777 
        +
        10778  return VK_SUCCESS;
        +
        10779 }
        10780 
        -
        10781  VMA_ASSERT(0 && "Allocation to free not found in linear allocator!");
        -
        10782 }
        -
        10783 
        -
        10784 bool VmaBlockMetadata_Linear::ShouldCompact1st() const
        -
        10785 {
        -
        10786  const size_t nullItemCount = m_1stNullItemsBeginCount + m_1stNullItemsMiddleCount;
        -
        10787  const size_t suballocCount = AccessSuballocations1st().size();
        -
        10788  return suballocCount > 32 && nullItemCount * 2 >= (suballocCount - nullItemCount) * 3;
        -
        10789 }
        -
        10790 
        -
        10791 void VmaBlockMetadata_Linear::CleanupAfterFree()
        -
        10792 {
        -
        10793  SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        -
        10794  SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        -
        10795 
        -
        10796  if(IsEmpty())
        -
        10797  {
        -
        10798  suballocations1st.clear();
        -
        10799  suballocations2nd.clear();
        -
        10800  m_1stNullItemsBeginCount = 0;
        -
        10801  m_1stNullItemsMiddleCount = 0;
        -
        10802  m_2ndNullItemsCount = 0;
        -
        10803  m_2ndVectorMode = SECOND_VECTOR_EMPTY;
        -
        10804  }
        -
        10805  else
        -
        10806  {
        -
        10807  const size_t suballoc1stCount = suballocations1st.size();
        -
        10808  const size_t nullItem1stCount = m_1stNullItemsBeginCount + m_1stNullItemsMiddleCount;
        -
        10809  VMA_ASSERT(nullItem1stCount <= suballoc1stCount);
        -
        10810 
        -
        10811  // Find more null items at the beginning of 1st vector.
        -
        10812  while(m_1stNullItemsBeginCount < suballoc1stCount &&
        -
        10813  suballocations1st[m_1stNullItemsBeginCount].hAllocation == VK_NULL_HANDLE)
        -
        10814  {
        -
        10815  ++m_1stNullItemsBeginCount;
        -
        10816  --m_1stNullItemsMiddleCount;
        -
        10817  }
        -
        10818 
        -
        10819  // Find more null items at the end of 1st vector.
        -
        10820  while(m_1stNullItemsMiddleCount > 0 &&
        -
        10821  suballocations1st.back().hAllocation == VK_NULL_HANDLE)
        -
        10822  {
        -
        10823  --m_1stNullItemsMiddleCount;
        -
        10824  suballocations1st.pop_back();
        -
        10825  }
        -
        10826 
        -
        10827  // Find more null items at the end of 2nd vector.
        -
        10828  while(m_2ndNullItemsCount > 0 &&
        -
        10829  suballocations2nd.back().hAllocation == VK_NULL_HANDLE)
        -
        10830  {
        -
        10831  --m_2ndNullItemsCount;
        -
        10832  suballocations2nd.pop_back();
        -
        10833  }
        -
        10834 
        -
        10835  // Find more null items at the beginning of 2nd vector.
        -
        10836  while(m_2ndNullItemsCount > 0 &&
        -
        10837  suballocations2nd[0].hAllocation == VK_NULL_HANDLE)
        -
        10838  {
        -
        10839  --m_2ndNullItemsCount;
        -
        10840  VmaVectorRemove(suballocations2nd, 0);
        -
        10841  }
        -
        10842 
        -
        10843  if(ShouldCompact1st())
        -
        10844  {
        -
        10845  const size_t nonNullItemCount = suballoc1stCount - nullItem1stCount;
        -
        10846  size_t srcIndex = m_1stNullItemsBeginCount;
        -
        10847  for(size_t dstIndex = 0; dstIndex < nonNullItemCount; ++dstIndex)
        -
        10848  {
        -
        10849  while(suballocations1st[srcIndex].hAllocation == VK_NULL_HANDLE)
        -
        10850  {
        -
        10851  ++srcIndex;
        -
        10852  }
        -
        10853  if(dstIndex != srcIndex)
        -
        10854  {
        -
        10855  suballocations1st[dstIndex] = suballocations1st[srcIndex];
        -
        10856  }
        -
        10857  ++srcIndex;
        -
        10858  }
        -
        10859  suballocations1st.resize(nonNullItemCount);
        -
        10860  m_1stNullItemsBeginCount = 0;
        -
        10861  m_1stNullItemsMiddleCount = 0;
        -
        10862  }
        -
        10863 
        -
        10864  // 2nd vector became empty.
        -
        10865  if(suballocations2nd.empty())
        -
        10866  {
        -
        10867  m_2ndVectorMode = SECOND_VECTOR_EMPTY;
        -
        10868  }
        -
        10869 
        -
        10870  // 1st vector became empty.
        -
        10871  if(suballocations1st.size() - m_1stNullItemsBeginCount == 0)
        -
        10872  {
        -
        10873  suballocations1st.clear();
        -
        10874  m_1stNullItemsBeginCount = 0;
        -
        10875 
        -
        10876  if(!suballocations2nd.empty() && m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER)
        -
        10877  {
        -
        10878  // Swap 1st with 2nd. Now 2nd is empty.
        -
        10879  m_2ndVectorMode = SECOND_VECTOR_EMPTY;
        -
        10880  m_1stNullItemsMiddleCount = m_2ndNullItemsCount;
        -
        10881  while(m_1stNullItemsBeginCount < suballocations2nd.size() &&
        -
        10882  suballocations2nd[m_1stNullItemsBeginCount].hAllocation == VK_NULL_HANDLE)
        -
        10883  {
        -
        10884  ++m_1stNullItemsBeginCount;
        -
        10885  --m_1stNullItemsMiddleCount;
        -
        10886  }
        -
        10887  m_2ndNullItemsCount = 0;
        -
        10888  m_1stVectorIndex ^= 1;
        -
        10889  }
        -
        10890  }
        -
        10891  }
        -
        10892 
        -
        10893  VMA_HEAVY_ASSERT(Validate());
        -
        10894 }
        -
        10895 
        -
        10896 
        -
        10898 // class VmaBlockMetadata_Buddy
        -
        10899 
        -
        10900 VmaBlockMetadata_Buddy::VmaBlockMetadata_Buddy(VmaAllocator hAllocator) :
        -
        10901  VmaBlockMetadata(hAllocator),
        -
        10902  m_Root(VMA_NULL),
        -
        10903  m_AllocationCount(0),
        -
        10904  m_FreeCount(1),
        -
        10905  m_SumFreeSize(0)
        -
        10906 {
        -
        10907  memset(m_FreeList, 0, sizeof(m_FreeList));
        -
        10908 }
        -
        10909 
        -
        10910 VmaBlockMetadata_Buddy::~VmaBlockMetadata_Buddy()
        -
        10911 {
        -
        10912  DeleteNode(m_Root);
        -
        10913 }
        -
        10914 
        -
        10915 void VmaBlockMetadata_Buddy::Init(VkDeviceSize size)
        -
        10916 {
        -
        10917  VmaBlockMetadata::Init(size);
        -
        10918 
        -
        10919  m_UsableSize = VmaPrevPow2(size);
        -
        10920  m_SumFreeSize = m_UsableSize;
        -
        10921 
        -
        10922  // Calculate m_LevelCount.
        -
        10923  m_LevelCount = 1;
        -
        10924  while(m_LevelCount < MAX_LEVELS &&
        -
        10925  LevelToNodeSize(m_LevelCount) >= MIN_NODE_SIZE)
        -
        10926  {
        -
        10927  ++m_LevelCount;
        -
        10928  }
        -
        10929 
        -
        10930  Node* rootNode = vma_new(GetAllocationCallbacks(), Node)();
        -
        10931  rootNode->offset = 0;
        -
        10932  rootNode->type = Node::TYPE_FREE;
        -
        10933  rootNode->parent = VMA_NULL;
        -
        10934  rootNode->buddy = VMA_NULL;
        -
        10935 
        -
        10936  m_Root = rootNode;
        -
        10937  AddToFreeListFront(0, rootNode);
        -
        10938 }
        +
        10781 void VmaBlockMetadata_Linear::Alloc(
        +
        10782  const VmaAllocationRequest& request,
        +
        10783  VmaSuballocationType type,
        +
        10784  VkDeviceSize allocSize,
        +
        10785  VmaAllocation hAllocation)
        +
        10786 {
        +
        10787  const VmaSuballocation newSuballoc = { request.offset, allocSize, hAllocation, type };
        +
        10788 
        +
        10789  switch(request.type)
        +
        10790  {
        +
        10791  case VmaAllocationRequestType::UpperAddress:
        +
        10792  {
        +
        10793  VMA_ASSERT(m_2ndVectorMode != SECOND_VECTOR_RING_BUFFER &&
        +
        10794  "CRITICAL ERROR: Trying to use linear allocator as double stack while it was already used as ring buffer.");
        +
        10795  SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        +
        10796  suballocations2nd.push_back(newSuballoc);
        +
        10797  m_2ndVectorMode = SECOND_VECTOR_DOUBLE_STACK;
        +
        10798  }
        +
        10799  break;
        +
        10800  case VmaAllocationRequestType::EndOf1st:
        +
        10801  {
        +
        10802  SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        +
        10803 
        +
        10804  VMA_ASSERT(suballocations1st.empty() ||
        +
        10805  request.offset >= suballocations1st.back().offset + suballocations1st.back().size);
        +
        10806  // Check if it fits before the end of the block.
        +
        10807  VMA_ASSERT(request.offset + allocSize <= GetSize());
        +
        10808 
        +
        10809  suballocations1st.push_back(newSuballoc);
        +
        10810  }
        +
        10811  break;
        +
        10812  case VmaAllocationRequestType::EndOf2nd:
        +
        10813  {
        +
        10814  SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        +
        10815  // New allocation at the end of 2-part ring buffer, so before first allocation from 1st vector.
        +
        10816  VMA_ASSERT(!suballocations1st.empty() &&
        +
        10817  request.offset + allocSize <= suballocations1st[m_1stNullItemsBeginCount].offset);
        +
        10818  SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        +
        10819 
        +
        10820  switch(m_2ndVectorMode)
        +
        10821  {
        +
        10822  case SECOND_VECTOR_EMPTY:
        +
        10823  // First allocation from second part ring buffer.
        +
        10824  VMA_ASSERT(suballocations2nd.empty());
        +
        10825  m_2ndVectorMode = SECOND_VECTOR_RING_BUFFER;
        +
        10826  break;
        +
        10827  case SECOND_VECTOR_RING_BUFFER:
        +
        10828  // 2-part ring buffer is already started.
        +
        10829  VMA_ASSERT(!suballocations2nd.empty());
        +
        10830  break;
        +
        10831  case SECOND_VECTOR_DOUBLE_STACK:
        +
        10832  VMA_ASSERT(0 && "CRITICAL ERROR: Trying to use linear allocator as ring buffer while it was already used as double stack.");
        +
        10833  break;
        +
        10834  default:
        +
        10835  VMA_ASSERT(0);
        +
        10836  }
        +
        10837 
        +
        10838  suballocations2nd.push_back(newSuballoc);
        +
        10839  }
        +
        10840  break;
        +
        10841  default:
        +
        10842  VMA_ASSERT(0 && "CRITICAL INTERNAL ERROR.");
        +
        10843  }
        +
        10844 
        +
        10845  m_SumFreeSize -= newSuballoc.size;
        +
        10846 }
        +
        10847 
        +
        10848 void VmaBlockMetadata_Linear::Free(const VmaAllocation allocation)
        +
        10849 {
        +
        10850  FreeAtOffset(allocation->GetOffset());
        +
        10851 }
        +
        10852 
        +
        10853 void VmaBlockMetadata_Linear::FreeAtOffset(VkDeviceSize offset)
        +
        10854 {
        +
        10855  SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        +
        10856  SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        +
        10857 
        +
        10858  if(!suballocations1st.empty())
        +
        10859  {
        +
        10860  // First allocation: Mark it as next empty at the beginning.
        +
        10861  VmaSuballocation& firstSuballoc = suballocations1st[m_1stNullItemsBeginCount];
        +
        10862  if(firstSuballoc.offset == offset)
        +
        10863  {
        +
        10864  firstSuballoc.type = VMA_SUBALLOCATION_TYPE_FREE;
        +
        10865  firstSuballoc.hAllocation = VK_NULL_HANDLE;
        +
        10866  m_SumFreeSize += firstSuballoc.size;
        +
        10867  ++m_1stNullItemsBeginCount;
        +
        10868  CleanupAfterFree();
        +
        10869  return;
        +
        10870  }
        +
        10871  }
        +
        10872 
        +
        10873  // Last allocation in 2-part ring buffer or top of upper stack (same logic).
        +
        10874  if(m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER ||
        +
        10875  m_2ndVectorMode == SECOND_VECTOR_DOUBLE_STACK)
        +
        10876  {
        +
        10877  VmaSuballocation& lastSuballoc = suballocations2nd.back();
        +
        10878  if(lastSuballoc.offset == offset)
        +
        10879  {
        +
        10880  m_SumFreeSize += lastSuballoc.size;
        +
        10881  suballocations2nd.pop_back();
        +
        10882  CleanupAfterFree();
        +
        10883  return;
        +
        10884  }
        +
        10885  }
        +
        10886  // Last allocation in 1st vector.
        +
        10887  else if(m_2ndVectorMode == SECOND_VECTOR_EMPTY)
        +
        10888  {
        +
        10889  VmaSuballocation& lastSuballoc = suballocations1st.back();
        +
        10890  if(lastSuballoc.offset == offset)
        +
        10891  {
        +
        10892  m_SumFreeSize += lastSuballoc.size;
        +
        10893  suballocations1st.pop_back();
        +
        10894  CleanupAfterFree();
        +
        10895  return;
        +
        10896  }
        +
        10897  }
        +
        10898 
        +
        10899  // Item from the middle of 1st vector.
        +
        10900  {
        +
        10901  VmaSuballocation refSuballoc;
        +
        10902  refSuballoc.offset = offset;
        +
        10903  // Rest of members stays uninitialized intentionally for better performance.
        +
        10904  SuballocationVectorType::iterator it = VmaBinaryFindSorted(
        +
        10905  suballocations1st.begin() + m_1stNullItemsBeginCount,
        +
        10906  suballocations1st.end(),
        +
        10907  refSuballoc,
        +
        10908  VmaSuballocationOffsetLess());
        +
        10909  if(it != suballocations1st.end())
        +
        10910  {
        +
        10911  it->type = VMA_SUBALLOCATION_TYPE_FREE;
        +
        10912  it->hAllocation = VK_NULL_HANDLE;
        +
        10913  ++m_1stNullItemsMiddleCount;
        +
        10914  m_SumFreeSize += it->size;
        +
        10915  CleanupAfterFree();
        +
        10916  return;
        +
        10917  }
        +
        10918  }
        +
        10919 
        +
        10920  if(m_2ndVectorMode != SECOND_VECTOR_EMPTY)
        +
        10921  {
        +
        10922  // Item from the middle of 2nd vector.
        +
        10923  VmaSuballocation refSuballoc;
        +
        10924  refSuballoc.offset = offset;
        +
        10925  // Rest of members stays uninitialized intentionally for better performance.
        +
        10926  SuballocationVectorType::iterator it = m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER ?
        +
        10927  VmaBinaryFindSorted(suballocations2nd.begin(), suballocations2nd.end(), refSuballoc, VmaSuballocationOffsetLess()) :
        +
        10928  VmaBinaryFindSorted(suballocations2nd.begin(), suballocations2nd.end(), refSuballoc, VmaSuballocationOffsetGreater());
        +
        10929  if(it != suballocations2nd.end())
        +
        10930  {
        +
        10931  it->type = VMA_SUBALLOCATION_TYPE_FREE;
        +
        10932  it->hAllocation = VK_NULL_HANDLE;
        +
        10933  ++m_2ndNullItemsCount;
        +
        10934  m_SumFreeSize += it->size;
        +
        10935  CleanupAfterFree();
        +
        10936  return;
        +
        10937  }
        +
        10938  }
        10939 
        -
        10940 bool VmaBlockMetadata_Buddy::Validate() const
        -
        10941 {
        -
        10942  // Validate tree.
        -
        10943  ValidationContext ctx;
        -
        10944  if(!ValidateNode(ctx, VMA_NULL, m_Root, 0, LevelToNodeSize(0)))
        -
        10945  {
        -
        10946  VMA_VALIDATE(false && "ValidateNode failed.");
        -
        10947  }
        -
        10948  VMA_VALIDATE(m_AllocationCount == ctx.calculatedAllocationCount);
        -
        10949  VMA_VALIDATE(m_SumFreeSize == ctx.calculatedSumFreeSize);
        -
        10950 
        -
        10951  // Validate free node lists.
        -
        10952  for(uint32_t level = 0; level < m_LevelCount; ++level)
        -
        10953  {
        -
        10954  VMA_VALIDATE(m_FreeList[level].front == VMA_NULL ||
        -
        10955  m_FreeList[level].front->free.prev == VMA_NULL);
        -
        10956 
        -
        10957  for(Node* node = m_FreeList[level].front;
        -
        10958  node != VMA_NULL;
        -
        10959  node = node->free.next)
        -
        10960  {
        -
        10961  VMA_VALIDATE(node->type == Node::TYPE_FREE);
        -
        10962 
        -
        10963  if(node->free.next == VMA_NULL)
        -
        10964  {
        -
        10965  VMA_VALIDATE(m_FreeList[level].back == node);
        -
        10966  }
        -
        10967  else
        -
        10968  {
        -
        10969  VMA_VALIDATE(node->free.next->free.prev == node);
        -
        10970  }
        -
        10971  }
        -
        10972  }
        -
        10973 
        -
        10974  // Validate that free lists ar higher levels are empty.
        -
        10975  for(uint32_t level = m_LevelCount; level < MAX_LEVELS; ++level)
        -
        10976  {
        -
        10977  VMA_VALIDATE(m_FreeList[level].front == VMA_NULL && m_FreeList[level].back == VMA_NULL);
        -
        10978  }
        -
        10979 
        -
        10980  return true;
        -
        10981 }
        -
        10982 
        -
        10983 VkDeviceSize VmaBlockMetadata_Buddy::GetUnusedRangeSizeMax() const
        -
        10984 {
        -
        10985  for(uint32_t level = 0; level < m_LevelCount; ++level)
        -
        10986  {
        -
        10987  if(m_FreeList[level].front != VMA_NULL)
        -
        10988  {
        -
        10989  return LevelToNodeSize(level);
        -
        10990  }
        -
        10991  }
        -
        10992  return 0;
        -
        10993 }
        -
        10994 
        -
        10995 void VmaBlockMetadata_Buddy::CalcAllocationStatInfo(VmaStatInfo& outInfo) const
        -
        10996 {
        -
        10997  const VkDeviceSize unusableSize = GetUnusableSize();
        -
        10998 
        -
        10999  outInfo.blockCount = 1;
        -
        11000 
        -
        11001  outInfo.allocationCount = outInfo.unusedRangeCount = 0;
        -
        11002  outInfo.usedBytes = outInfo.unusedBytes = 0;
        -
        11003 
        -
        11004  outInfo.allocationSizeMax = outInfo.unusedRangeSizeMax = 0;
        -
        11005  outInfo.allocationSizeMin = outInfo.unusedRangeSizeMin = UINT64_MAX;
        -
        11006  outInfo.allocationSizeAvg = outInfo.unusedRangeSizeAvg = 0; // Unused.
        -
        11007 
        -
        11008  CalcAllocationStatInfoNode(outInfo, m_Root, LevelToNodeSize(0));
        -
        11009 
        -
        11010  if(unusableSize > 0)
        -
        11011  {
        -
        11012  ++outInfo.unusedRangeCount;
        -
        11013  outInfo.unusedBytes += unusableSize;
        -
        11014  outInfo.unusedRangeSizeMax = VMA_MAX(outInfo.unusedRangeSizeMax, unusableSize);
        -
        11015  outInfo.unusedRangeSizeMin = VMA_MIN(outInfo.unusedRangeSizeMin, unusableSize);
        -
        11016  }
        -
        11017 }
        -
        11018 
        -
        11019 void VmaBlockMetadata_Buddy::AddPoolStats(VmaPoolStats& inoutStats) const
        -
        11020 {
        -
        11021  const VkDeviceSize unusableSize = GetUnusableSize();
        +
        10940  VMA_ASSERT(0 && "Allocation to free not found in linear allocator!");
        +
        10941 }
        +
        10942 
        +
        10943 bool VmaBlockMetadata_Linear::ShouldCompact1st() const
        +
        10944 {
        +
        10945  const size_t nullItemCount = m_1stNullItemsBeginCount + m_1stNullItemsMiddleCount;
        +
        10946  const size_t suballocCount = AccessSuballocations1st().size();
        +
        10947  return suballocCount > 32 && nullItemCount * 2 >= (suballocCount - nullItemCount) * 3;
        +
        10948 }
        +
        10949 
        +
        10950 void VmaBlockMetadata_Linear::CleanupAfterFree()
        +
        10951 {
        +
        10952  SuballocationVectorType& suballocations1st = AccessSuballocations1st();
        +
        10953  SuballocationVectorType& suballocations2nd = AccessSuballocations2nd();
        +
        10954 
        +
        10955  if(IsEmpty())
        +
        10956  {
        +
        10957  suballocations1st.clear();
        +
        10958  suballocations2nd.clear();
        +
        10959  m_1stNullItemsBeginCount = 0;
        +
        10960  m_1stNullItemsMiddleCount = 0;
        +
        10961  m_2ndNullItemsCount = 0;
        +
        10962  m_2ndVectorMode = SECOND_VECTOR_EMPTY;
        +
        10963  }
        +
        10964  else
        +
        10965  {
        +
        10966  const size_t suballoc1stCount = suballocations1st.size();
        +
        10967  const size_t nullItem1stCount = m_1stNullItemsBeginCount + m_1stNullItemsMiddleCount;
        +
        10968  VMA_ASSERT(nullItem1stCount <= suballoc1stCount);
        +
        10969 
        +
        10970  // Find more null items at the beginning of 1st vector.
        +
        10971  while(m_1stNullItemsBeginCount < suballoc1stCount &&
        +
        10972  suballocations1st[m_1stNullItemsBeginCount].hAllocation == VK_NULL_HANDLE)
        +
        10973  {
        +
        10974  ++m_1stNullItemsBeginCount;
        +
        10975  --m_1stNullItemsMiddleCount;
        +
        10976  }
        +
        10977 
        +
        10978  // Find more null items at the end of 1st vector.
        +
        10979  while(m_1stNullItemsMiddleCount > 0 &&
        +
        10980  suballocations1st.back().hAllocation == VK_NULL_HANDLE)
        +
        10981  {
        +
        10982  --m_1stNullItemsMiddleCount;
        +
        10983  suballocations1st.pop_back();
        +
        10984  }
        +
        10985 
        +
        10986  // Find more null items at the end of 2nd vector.
        +
        10987  while(m_2ndNullItemsCount > 0 &&
        +
        10988  suballocations2nd.back().hAllocation == VK_NULL_HANDLE)
        +
        10989  {
        +
        10990  --m_2ndNullItemsCount;
        +
        10991  suballocations2nd.pop_back();
        +
        10992  }
        +
        10993 
        +
        10994  // Find more null items at the beginning of 2nd vector.
        +
        10995  while(m_2ndNullItemsCount > 0 &&
        +
        10996  suballocations2nd[0].hAllocation == VK_NULL_HANDLE)
        +
        10997  {
        +
        10998  --m_2ndNullItemsCount;
        +
        10999  VmaVectorRemove(suballocations2nd, 0);
        +
        11000  }
        +
        11001 
        +
        11002  if(ShouldCompact1st())
        +
        11003  {
        +
        11004  const size_t nonNullItemCount = suballoc1stCount - nullItem1stCount;
        +
        11005  size_t srcIndex = m_1stNullItemsBeginCount;
        +
        11006  for(size_t dstIndex = 0; dstIndex < nonNullItemCount; ++dstIndex)
        +
        11007  {
        +
        11008  while(suballocations1st[srcIndex].hAllocation == VK_NULL_HANDLE)
        +
        11009  {
        +
        11010  ++srcIndex;
        +
        11011  }
        +
        11012  if(dstIndex != srcIndex)
        +
        11013  {
        +
        11014  suballocations1st[dstIndex] = suballocations1st[srcIndex];
        +
        11015  }
        +
        11016  ++srcIndex;
        +
        11017  }
        +
        11018  suballocations1st.resize(nonNullItemCount);
        +
        11019  m_1stNullItemsBeginCount = 0;
        +
        11020  m_1stNullItemsMiddleCount = 0;
        +
        11021  }
        11022 
        -
        11023  inoutStats.size += GetSize();
        -
        11024  inoutStats.unusedSize += m_SumFreeSize + unusableSize;
        -
        11025  inoutStats.allocationCount += m_AllocationCount;
        -
        11026  inoutStats.unusedRangeCount += m_FreeCount;
        -
        11027  inoutStats.unusedRangeSizeMax = VMA_MAX(inoutStats.unusedRangeSizeMax, GetUnusedRangeSizeMax());
        +
        11023  // 2nd vector became empty.
        +
        11024  if(suballocations2nd.empty())
        +
        11025  {
        +
        11026  m_2ndVectorMode = SECOND_VECTOR_EMPTY;
        +
        11027  }
        11028 
        -
        11029  if(unusableSize > 0)
        -
        11030  {
        -
        11031  ++inoutStats.unusedRangeCount;
        -
        11032  // Not updating inoutStats.unusedRangeSizeMax with unusableSize because this space is not available for allocations.
        -
        11033  }
        -
        11034 }
        -
        11035 
        -
        11036 #if VMA_STATS_STRING_ENABLED
        -
        11037 
        -
        11038 void VmaBlockMetadata_Buddy::PrintDetailedMap(class VmaJsonWriter& json) const
        -
        11039 {
        -
        11040  // TODO optimize
        -
        11041  VmaStatInfo stat;
        -
        11042  CalcAllocationStatInfo(stat);
        -
        11043 
        -
        11044  PrintDetailedMap_Begin(
        -
        11045  json,
        -
        11046  stat.unusedBytes,
        -
        11047  stat.allocationCount,
        -
        11048  stat.unusedRangeCount);
        -
        11049 
        -
        11050  PrintDetailedMapNode(json, m_Root, LevelToNodeSize(0));
        +
        11029  // 1st vector became empty.
        +
        11030  if(suballocations1st.size() - m_1stNullItemsBeginCount == 0)
        +
        11031  {
        +
        11032  suballocations1st.clear();
        +
        11033  m_1stNullItemsBeginCount = 0;
        +
        11034 
        +
        11035  if(!suballocations2nd.empty() && m_2ndVectorMode == SECOND_VECTOR_RING_BUFFER)
        +
        11036  {
        +
        11037  // Swap 1st with 2nd. Now 2nd is empty.
        +
        11038  m_2ndVectorMode = SECOND_VECTOR_EMPTY;
        +
        11039  m_1stNullItemsMiddleCount = m_2ndNullItemsCount;
        +
        11040  while(m_1stNullItemsBeginCount < suballocations2nd.size() &&
        +
        11041  suballocations2nd[m_1stNullItemsBeginCount].hAllocation == VK_NULL_HANDLE)
        +
        11042  {
        +
        11043  ++m_1stNullItemsBeginCount;
        +
        11044  --m_1stNullItemsMiddleCount;
        +
        11045  }
        +
        11046  m_2ndNullItemsCount = 0;
        +
        11047  m_1stVectorIndex ^= 1;
        +
        11048  }
        +
        11049  }
        +
        11050  }
        11051 
        -
        11052  const VkDeviceSize unusableSize = GetUnusableSize();
        -
        11053  if(unusableSize > 0)
        -
        11054  {
        -
        11055  PrintDetailedMap_UnusedRange(json,
        -
        11056  m_UsableSize, // offset
        -
        11057  unusableSize); // size
        -
        11058  }
        -
        11059 
        -
        11060  PrintDetailedMap_End(json);
        -
        11061 }
        -
        11062 
        -
        11063 #endif // #if VMA_STATS_STRING_ENABLED
        -
        11064 
        -
        11065 bool VmaBlockMetadata_Buddy::CreateAllocationRequest(
        -
        11066  uint32_t currentFrameIndex,
        -
        11067  uint32_t frameInUseCount,
        -
        11068  VkDeviceSize bufferImageGranularity,
        -
        11069  VkDeviceSize allocSize,
        -
        11070  VkDeviceSize allocAlignment,
        -
        11071  bool upperAddress,
        -
        11072  VmaSuballocationType allocType,
        -
        11073  bool canMakeOtherLost,
        -
        11074  uint32_t strategy,
        -
        11075  VmaAllocationRequest* pAllocationRequest)
        -
        11076 {
        -
        11077  VMA_ASSERT(!upperAddress && "VMA_ALLOCATION_CREATE_UPPER_ADDRESS_BIT can be used only with linear algorithm.");
        -
        11078 
        -
        11079  // Simple way to respect bufferImageGranularity. May be optimized some day.
        -
        11080  // Whenever it might be an OPTIMAL image...
        -
        11081  if(allocType == VMA_SUBALLOCATION_TYPE_UNKNOWN ||
        -
        11082  allocType == VMA_SUBALLOCATION_TYPE_IMAGE_UNKNOWN ||
        -
        11083  allocType == VMA_SUBALLOCATION_TYPE_IMAGE_OPTIMAL)
        -
        11084  {
        -
        11085  allocAlignment = VMA_MAX(allocAlignment, bufferImageGranularity);
        -
        11086  allocSize = VMA_MAX(allocSize, bufferImageGranularity);
        +
        11052  VMA_HEAVY_ASSERT(Validate());
        +
        11053 }
        +
        11054 
        +
        11055 
        +
        11057 // class VmaBlockMetadata_Buddy
        +
        11058 
        +
        11059 VmaBlockMetadata_Buddy::VmaBlockMetadata_Buddy(VmaAllocator hAllocator) :
        +
        11060  VmaBlockMetadata(hAllocator),
        +
        11061  m_Root(VMA_NULL),
        +
        11062  m_AllocationCount(0),
        +
        11063  m_FreeCount(1),
        +
        11064  m_SumFreeSize(0)
        +
        11065 {
        +
        11066  memset(m_FreeList, 0, sizeof(m_FreeList));
        +
        11067 }
        +
        11068 
        +
        11069 VmaBlockMetadata_Buddy::~VmaBlockMetadata_Buddy()
        +
        11070 {
        +
        11071  DeleteNode(m_Root);
        +
        11072 }
        +
        11073 
        +
        11074 void VmaBlockMetadata_Buddy::Init(VkDeviceSize size)
        +
        11075 {
        +
        11076  VmaBlockMetadata::Init(size);
        +
        11077 
        +
        11078  m_UsableSize = VmaPrevPow2(size);
        +
        11079  m_SumFreeSize = m_UsableSize;
        +
        11080 
        +
        11081  // Calculate m_LevelCount.
        +
        11082  m_LevelCount = 1;
        +
        11083  while(m_LevelCount < MAX_LEVELS &&
        +
        11084  LevelToNodeSize(m_LevelCount) >= MIN_NODE_SIZE)
        +
        11085  {
        +
        11086  ++m_LevelCount;
        11087  }
        11088 
        -
        11089  if(allocSize > m_UsableSize)
        -
        11090  {
        -
        11091  return false;
        -
        11092  }
        -
        11093 
        -
        11094  const uint32_t targetLevel = AllocSizeToLevel(allocSize);
        -
        11095  for(uint32_t level = targetLevel + 1; level--; )
        -
        11096  {
        -
        11097  for(Node* freeNode = m_FreeList[level].front;
        -
        11098  freeNode != VMA_NULL;
        -
        11099  freeNode = freeNode->free.next)
        -
        11100  {
        -
        11101  if(freeNode->offset % allocAlignment == 0)
        -
        11102  {
        -
        11103  pAllocationRequest->type = VmaAllocationRequestType::Normal;
        -
        11104  pAllocationRequest->offset = freeNode->offset;
        -
        11105  pAllocationRequest->sumFreeSize = LevelToNodeSize(level);
        -
        11106  pAllocationRequest->sumItemSize = 0;
        -
        11107  pAllocationRequest->itemsToMakeLostCount = 0;
        -
        11108  pAllocationRequest->customData = (void*)(uintptr_t)level;
        -
        11109  return true;
        -
        11110  }
        -
        11111  }
        -
        11112  }
        -
        11113 
        -
        11114  return false;
        -
        11115 }
        -
        11116 
        -
        11117 bool VmaBlockMetadata_Buddy::MakeRequestedAllocationsLost(
        -
        11118  uint32_t currentFrameIndex,
        -
        11119  uint32_t frameInUseCount,
        -
        11120  VmaAllocationRequest* pAllocationRequest)
        -
        11121 {
        -
        11122  /*
        -
        11123  Lost allocations are not supported in buddy allocator at the moment.
        -
        11124  Support might be added in the future.
        -
        11125  */
        -
        11126  return pAllocationRequest->itemsToMakeLostCount == 0;
        -
        11127 }
        -
        11128 
        -
        11129 uint32_t VmaBlockMetadata_Buddy::MakeAllocationsLost(uint32_t currentFrameIndex, uint32_t frameInUseCount)
        -
        11130 {
        -
        11131  /*
        -
        11132  Lost allocations are not supported in buddy allocator at the moment.
        -
        11133  Support might be added in the future.
        -
        11134  */
        -
        11135  return 0;
        -
        11136 }
        -
        11137 
        -
        11138 void VmaBlockMetadata_Buddy::Alloc(
        -
        11139  const VmaAllocationRequest& request,
        -
        11140  VmaSuballocationType type,
        -
        11141  VkDeviceSize allocSize,
        -
        11142  VmaAllocation hAllocation)
        -
        11143 {
        -
        11144  VMA_ASSERT(request.type == VmaAllocationRequestType::Normal);
        -
        11145 
        -
        11146  const uint32_t targetLevel = AllocSizeToLevel(allocSize);
        -
        11147  uint32_t currLevel = (uint32_t)(uintptr_t)request.customData;
        -
        11148 
        -
        11149  Node* currNode = m_FreeList[currLevel].front;
        -
        11150  VMA_ASSERT(currNode != VMA_NULL && currNode->type == Node::TYPE_FREE);
        -
        11151  while(currNode->offset != request.offset)
        -
        11152  {
        -
        11153  currNode = currNode->free.next;
        -
        11154  VMA_ASSERT(currNode != VMA_NULL && currNode->type == Node::TYPE_FREE);
        -
        11155  }
        -
        11156 
        -
        11157  // Go down, splitting free nodes.
        -
        11158  while(currLevel < targetLevel)
        -
        11159  {
        -
        11160  // currNode is already first free node at currLevel.
        -
        11161  // Remove it from list of free nodes at this currLevel.
        -
        11162  RemoveFromFreeList(currLevel, currNode);
        -
        11163 
        -
        11164  const uint32_t childrenLevel = currLevel + 1;
        -
        11165 
        -
        11166  // Create two free sub-nodes.
        -
        11167  Node* leftChild = vma_new(GetAllocationCallbacks(), Node)();
        -
        11168  Node* rightChild = vma_new(GetAllocationCallbacks(), Node)();
        -
        11169 
        -
        11170  leftChild->offset = currNode->offset;
        -
        11171  leftChild->type = Node::TYPE_FREE;
        -
        11172  leftChild->parent = currNode;
        -
        11173  leftChild->buddy = rightChild;
        -
        11174 
        -
        11175  rightChild->offset = currNode->offset + LevelToNodeSize(childrenLevel);
        -
        11176  rightChild->type = Node::TYPE_FREE;
        -
        11177  rightChild->parent = currNode;
        -
        11178  rightChild->buddy = leftChild;
        -
        11179 
        -
        11180  // Convert current currNode to split type.
        -
        11181  currNode->type = Node::TYPE_SPLIT;
        -
        11182  currNode->split.leftChild = leftChild;
        -
        11183 
        -
        11184  // Add child nodes to free list. Order is important!
        -
        11185  AddToFreeListFront(childrenLevel, rightChild);
        -
        11186  AddToFreeListFront(childrenLevel, leftChild);
        +
        11089  Node* rootNode = vma_new(GetAllocationCallbacks(), Node)();
        +
        11090  rootNode->offset = 0;
        +
        11091  rootNode->type = Node::TYPE_FREE;
        +
        11092  rootNode->parent = VMA_NULL;
        +
        11093  rootNode->buddy = VMA_NULL;
        +
        11094 
        +
        11095  m_Root = rootNode;
        +
        11096  AddToFreeListFront(0, rootNode);
        +
        11097 }
        +
        11098 
        +
        11099 bool VmaBlockMetadata_Buddy::Validate() const
        +
        11100 {
        +
        11101  // Validate tree.
        +
        11102  ValidationContext ctx;
        +
        11103  if(!ValidateNode(ctx, VMA_NULL, m_Root, 0, LevelToNodeSize(0)))
        +
        11104  {
        +
        11105  VMA_VALIDATE(false && "ValidateNode failed.");
        +
        11106  }
        +
        11107  VMA_VALIDATE(m_AllocationCount == ctx.calculatedAllocationCount);
        +
        11108  VMA_VALIDATE(m_SumFreeSize == ctx.calculatedSumFreeSize);
        +
        11109 
        +
        11110  // Validate free node lists.
        +
        11111  for(uint32_t level = 0; level < m_LevelCount; ++level)
        +
        11112  {
        +
        11113  VMA_VALIDATE(m_FreeList[level].front == VMA_NULL ||
        +
        11114  m_FreeList[level].front->free.prev == VMA_NULL);
        +
        11115 
        +
        11116  for(Node* node = m_FreeList[level].front;
        +
        11117  node != VMA_NULL;
        +
        11118  node = node->free.next)
        +
        11119  {
        +
        11120  VMA_VALIDATE(node->type == Node::TYPE_FREE);
        +
        11121 
        +
        11122  if(node->free.next == VMA_NULL)
        +
        11123  {
        +
        11124  VMA_VALIDATE(m_FreeList[level].back == node);
        +
        11125  }
        +
        11126  else
        +
        11127  {
        +
        11128  VMA_VALIDATE(node->free.next->free.prev == node);
        +
        11129  }
        +
        11130  }
        +
        11131  }
        +
        11132 
        +
        11133  // Validate that free lists ar higher levels are empty.
        +
        11134  for(uint32_t level = m_LevelCount; level < MAX_LEVELS; ++level)
        +
        11135  {
        +
        11136  VMA_VALIDATE(m_FreeList[level].front == VMA_NULL && m_FreeList[level].back == VMA_NULL);
        +
        11137  }
        +
        11138 
        +
        11139  return true;
        +
        11140 }
        +
        11141 
        +
        11142 VkDeviceSize VmaBlockMetadata_Buddy::GetUnusedRangeSizeMax() const
        +
        11143 {
        +
        11144  for(uint32_t level = 0; level < m_LevelCount; ++level)
        +
        11145  {
        +
        11146  if(m_FreeList[level].front != VMA_NULL)
        +
        11147  {
        +
        11148  return LevelToNodeSize(level);
        +
        11149  }
        +
        11150  }
        +
        11151  return 0;
        +
        11152 }
        +
        11153 
        +
        11154 void VmaBlockMetadata_Buddy::CalcAllocationStatInfo(VmaStatInfo& outInfo) const
        +
        11155 {
        +
        11156  const VkDeviceSize unusableSize = GetUnusableSize();
        +
        11157 
        +
        11158  outInfo.blockCount = 1;
        +
        11159 
        +
        11160  outInfo.allocationCount = outInfo.unusedRangeCount = 0;
        +
        11161  outInfo.usedBytes = outInfo.unusedBytes = 0;
        +
        11162 
        +
        11163  outInfo.allocationSizeMax = outInfo.unusedRangeSizeMax = 0;
        +
        11164  outInfo.allocationSizeMin = outInfo.unusedRangeSizeMin = UINT64_MAX;
        +
        11165  outInfo.allocationSizeAvg = outInfo.unusedRangeSizeAvg = 0; // Unused.
        +
        11166 
        +
        11167  CalcAllocationStatInfoNode(outInfo, m_Root, LevelToNodeSize(0));
        +
        11168 
        +
        11169  if(unusableSize > 0)
        +
        11170  {
        +
        11171  ++outInfo.unusedRangeCount;
        +
        11172  outInfo.unusedBytes += unusableSize;
        +
        11173  outInfo.unusedRangeSizeMax = VMA_MAX(outInfo.unusedRangeSizeMax, unusableSize);
        +
        11174  outInfo.unusedRangeSizeMin = VMA_MIN(outInfo.unusedRangeSizeMin, unusableSize);
        +
        11175  }
        +
        11176 }
        +
        11177 
        +
        11178 void VmaBlockMetadata_Buddy::AddPoolStats(VmaPoolStats& inoutStats) const
        +
        11179 {
        +
        11180  const VkDeviceSize unusableSize = GetUnusableSize();
        +
        11181 
        +
        11182  inoutStats.size += GetSize();
        +
        11183  inoutStats.unusedSize += m_SumFreeSize + unusableSize;
        +
        11184  inoutStats.allocationCount += m_AllocationCount;
        +
        11185  inoutStats.unusedRangeCount += m_FreeCount;
        +
        11186  inoutStats.unusedRangeSizeMax = VMA_MAX(inoutStats.unusedRangeSizeMax, GetUnusedRangeSizeMax());
        11187 
        -
        11188  ++m_FreeCount;
        -
        11189  //m_SumFreeSize -= LevelToNodeSize(currLevel) % 2; // Useful only when level node sizes can be non power of 2.
        -
        11190  ++currLevel;
        -
        11191  currNode = m_FreeList[currLevel].front;
        -
        11192 
        -
        11193  /*
        -
        11194  We can be sure that currNode, as left child of node previously split,
        -
        11195  also fullfills the alignment requirement.
        -
        11196  */
        -
        11197  }
        -
        11198 
        -
        11199  // Remove from free list.
        -
        11200  VMA_ASSERT(currLevel == targetLevel &&
        -
        11201  currNode != VMA_NULL &&
        -
        11202  currNode->type == Node::TYPE_FREE);
        -
        11203  RemoveFromFreeList(currLevel, currNode);
        -
        11204 
        -
        11205  // Convert to allocation node.
        -
        11206  currNode->type = Node::TYPE_ALLOCATION;
        -
        11207  currNode->allocation.alloc = hAllocation;
        +
        11188  if(unusableSize > 0)
        +
        11189  {
        +
        11190  ++inoutStats.unusedRangeCount;
        +
        11191  // Not updating inoutStats.unusedRangeSizeMax with unusableSize because this space is not available for allocations.
        +
        11192  }
        +
        11193 }
        +
        11194 
        +
        11195 #if VMA_STATS_STRING_ENABLED
        +
        11196 
        +
        11197 void VmaBlockMetadata_Buddy::PrintDetailedMap(class VmaJsonWriter& json) const
        +
        11198 {
        +
        11199  // TODO optimize
        +
        11200  VmaStatInfo stat;
        +
        11201  CalcAllocationStatInfo(stat);
        +
        11202 
        +
        11203  PrintDetailedMap_Begin(
        +
        11204  json,
        +
        11205  stat.unusedBytes,
        +
        11206  stat.allocationCount,
        +
        11207  stat.unusedRangeCount);
        11208 
        -
        11209  ++m_AllocationCount;
        -
        11210  --m_FreeCount;
        -
        11211  m_SumFreeSize -= allocSize;
        -
        11212 }
        -
        11213 
        -
        11214 void VmaBlockMetadata_Buddy::DeleteNode(Node* node)
        -
        11215 {
        -
        11216  if(node->type == Node::TYPE_SPLIT)
        -
        11217  {
        -
        11218  DeleteNode(node->split.leftChild->buddy);
        -
        11219  DeleteNode(node->split.leftChild);
        -
        11220  }
        +
        11209  PrintDetailedMapNode(json, m_Root, LevelToNodeSize(0));
        +
        11210 
        +
        11211  const VkDeviceSize unusableSize = GetUnusableSize();
        +
        11212  if(unusableSize > 0)
        +
        11213  {
        +
        11214  PrintDetailedMap_UnusedRange(json,
        +
        11215  m_UsableSize, // offset
        +
        11216  unusableSize); // size
        +
        11217  }
        +
        11218 
        +
        11219  PrintDetailedMap_End(json);
        +
        11220 }
        11221 
        -
        11222  vma_delete(GetAllocationCallbacks(), node);
        -
        11223 }
        -
        11224 
        -
        11225 bool VmaBlockMetadata_Buddy::ValidateNode(ValidationContext& ctx, const Node* parent, const Node* curr, uint32_t level, VkDeviceSize levelNodeSize) const
        -
        11226 {
        -
        11227  VMA_VALIDATE(level < m_LevelCount);
        -
        11228  VMA_VALIDATE(curr->parent == parent);
        -
        11229  VMA_VALIDATE((curr->buddy == VMA_NULL) == (parent == VMA_NULL));
        -
        11230  VMA_VALIDATE(curr->buddy == VMA_NULL || curr->buddy->buddy == curr);
        -
        11231  switch(curr->type)
        -
        11232  {
        -
        11233  case Node::TYPE_FREE:
        -
        11234  // curr->free.prev, next are validated separately.
        -
        11235  ctx.calculatedSumFreeSize += levelNodeSize;
        -
        11236  ++ctx.calculatedFreeCount;
        -
        11237  break;
        -
        11238  case Node::TYPE_ALLOCATION:
        -
        11239  ++ctx.calculatedAllocationCount;
        -
        11240  ctx.calculatedSumFreeSize += levelNodeSize - curr->allocation.alloc->GetSize();
        -
        11241  VMA_VALIDATE(curr->allocation.alloc != VK_NULL_HANDLE);
        -
        11242  break;
        -
        11243  case Node::TYPE_SPLIT:
        -
        11244  {
        -
        11245  const uint32_t childrenLevel = level + 1;
        -
        11246  const VkDeviceSize childrenLevelNodeSize = levelNodeSize / 2;
        -
        11247  const Node* const leftChild = curr->split.leftChild;
        -
        11248  VMA_VALIDATE(leftChild != VMA_NULL);
        -
        11249  VMA_VALIDATE(leftChild->offset == curr->offset);
        -
        11250  if(!ValidateNode(ctx, curr, leftChild, childrenLevel, childrenLevelNodeSize))
        -
        11251  {
        -
        11252  VMA_VALIDATE(false && "ValidateNode for left child failed.");
        -
        11253  }
        -
        11254  const Node* const rightChild = leftChild->buddy;
        -
        11255  VMA_VALIDATE(rightChild->offset == curr->offset + childrenLevelNodeSize);
        -
        11256  if(!ValidateNode(ctx, curr, rightChild, childrenLevel, childrenLevelNodeSize))
        -
        11257  {
        -
        11258  VMA_VALIDATE(false && "ValidateNode for right child failed.");
        -
        11259  }
        -
        11260  }
        -
        11261  break;
        -
        11262  default:
        -
        11263  return false;
        -
        11264  }
        -
        11265 
        -
        11266  return true;
        -
        11267 }
        -
        11268 
        -
        11269 uint32_t VmaBlockMetadata_Buddy::AllocSizeToLevel(VkDeviceSize allocSize) const
        -
        11270 {
        -
        11271  // I know this could be optimized somehow e.g. by using std::log2p1 from C++20.
        -
        11272  uint32_t level = 0;
        -
        11273  VkDeviceSize currLevelNodeSize = m_UsableSize;
        -
        11274  VkDeviceSize nextLevelNodeSize = currLevelNodeSize >> 1;
        -
        11275  while(allocSize <= nextLevelNodeSize && level + 1 < m_LevelCount)
        -
        11276  {
        -
        11277  ++level;
        -
        11278  currLevelNodeSize = nextLevelNodeSize;
        -
        11279  nextLevelNodeSize = currLevelNodeSize >> 1;
        -
        11280  }
        -
        11281  return level;
        -
        11282 }
        -
        11283 
        -
        11284 void VmaBlockMetadata_Buddy::FreeAtOffset(VmaAllocation alloc, VkDeviceSize offset)
        -
        11285 {
        -
        11286  // Find node and level.
        -
        11287  Node* node = m_Root;
        -
        11288  VkDeviceSize nodeOffset = 0;
        -
        11289  uint32_t level = 0;
        -
        11290  VkDeviceSize levelNodeSize = LevelToNodeSize(0);
        -
        11291  while(node->type == Node::TYPE_SPLIT)
        -
        11292  {
        -
        11293  const VkDeviceSize nextLevelSize = levelNodeSize >> 1;
        -
        11294  if(offset < nodeOffset + nextLevelSize)
        -
        11295  {
        -
        11296  node = node->split.leftChild;
        -
        11297  }
        -
        11298  else
        -
        11299  {
        -
        11300  node = node->split.leftChild->buddy;
        -
        11301  nodeOffset += nextLevelSize;
        -
        11302  }
        -
        11303  ++level;
        -
        11304  levelNodeSize = nextLevelSize;
        -
        11305  }
        -
        11306 
        -
        11307  VMA_ASSERT(node != VMA_NULL && node->type == Node::TYPE_ALLOCATION);
        -
        11308  VMA_ASSERT(alloc == VK_NULL_HANDLE || node->allocation.alloc == alloc);
        -
        11309 
        -
        11310  ++m_FreeCount;
        -
        11311  --m_AllocationCount;
        -
        11312  m_SumFreeSize += alloc->GetSize();
        -
        11313 
        -
        11314  node->type = Node::TYPE_FREE;
        -
        11315 
        -
        11316  // Join free nodes if possible.
        -
        11317  while(level > 0 && node->buddy->type == Node::TYPE_FREE)
        +
        11222 #endif // #if VMA_STATS_STRING_ENABLED
        +
        11223 
        +
        11224 bool VmaBlockMetadata_Buddy::CreateAllocationRequest(
        +
        11225  uint32_t currentFrameIndex,
        +
        11226  uint32_t frameInUseCount,
        +
        11227  VkDeviceSize bufferImageGranularity,
        +
        11228  VkDeviceSize allocSize,
        +
        11229  VkDeviceSize allocAlignment,
        +
        11230  bool upperAddress,
        +
        11231  VmaSuballocationType allocType,
        +
        11232  bool canMakeOtherLost,
        +
        11233  uint32_t strategy,
        +
        11234  VmaAllocationRequest* pAllocationRequest)
        +
        11235 {
        +
        11236  VMA_ASSERT(!upperAddress && "VMA_ALLOCATION_CREATE_UPPER_ADDRESS_BIT can be used only with linear algorithm.");
        +
        11237 
        +
        11238  // Simple way to respect bufferImageGranularity. May be optimized some day.
        +
        11239  // Whenever it might be an OPTIMAL image...
        +
        11240  if(allocType == VMA_SUBALLOCATION_TYPE_UNKNOWN ||
        +
        11241  allocType == VMA_SUBALLOCATION_TYPE_IMAGE_UNKNOWN ||
        +
        11242  allocType == VMA_SUBALLOCATION_TYPE_IMAGE_OPTIMAL)
        +
        11243  {
        +
        11244  allocAlignment = VMA_MAX(allocAlignment, bufferImageGranularity);
        +
        11245  allocSize = VMA_MAX(allocSize, bufferImageGranularity);
        +
        11246  }
        +
        11247 
        +
        11248  if(allocSize > m_UsableSize)
        +
        11249  {
        +
        11250  return false;
        +
        11251  }
        +
        11252 
        +
        11253  const uint32_t targetLevel = AllocSizeToLevel(allocSize);
        +
        11254  for(uint32_t level = targetLevel + 1; level--; )
        +
        11255  {
        +
        11256  for(Node* freeNode = m_FreeList[level].front;
        +
        11257  freeNode != VMA_NULL;
        +
        11258  freeNode = freeNode->free.next)
        +
        11259  {
        +
        11260  if(freeNode->offset % allocAlignment == 0)
        +
        11261  {
        +
        11262  pAllocationRequest->type = VmaAllocationRequestType::Normal;
        +
        11263  pAllocationRequest->offset = freeNode->offset;
        +
        11264  pAllocationRequest->sumFreeSize = LevelToNodeSize(level);
        +
        11265  pAllocationRequest->sumItemSize = 0;
        +
        11266  pAllocationRequest->itemsToMakeLostCount = 0;
        +
        11267  pAllocationRequest->customData = (void*)(uintptr_t)level;
        +
        11268  return true;
        +
        11269  }
        +
        11270  }
        +
        11271  }
        +
        11272 
        +
        11273  return false;
        +
        11274 }
        +
        11275 
        +
        11276 bool VmaBlockMetadata_Buddy::MakeRequestedAllocationsLost(
        +
        11277  uint32_t currentFrameIndex,
        +
        11278  uint32_t frameInUseCount,
        +
        11279  VmaAllocationRequest* pAllocationRequest)
        +
        11280 {
        +
        11281  /*
        +
        11282  Lost allocations are not supported in buddy allocator at the moment.
        +
        11283  Support might be added in the future.
        +
        11284  */
        +
        11285  return pAllocationRequest->itemsToMakeLostCount == 0;
        +
        11286 }
        +
        11287 
        +
        11288 uint32_t VmaBlockMetadata_Buddy::MakeAllocationsLost(uint32_t currentFrameIndex, uint32_t frameInUseCount)
        +
        11289 {
        +
        11290  /*
        +
        11291  Lost allocations are not supported in buddy allocator at the moment.
        +
        11292  Support might be added in the future.
        +
        11293  */
        +
        11294  return 0;
        +
        11295 }
        +
        11296 
        +
        11297 void VmaBlockMetadata_Buddy::Alloc(
        +
        11298  const VmaAllocationRequest& request,
        +
        11299  VmaSuballocationType type,
        +
        11300  VkDeviceSize allocSize,
        +
        11301  VmaAllocation hAllocation)
        +
        11302 {
        +
        11303  VMA_ASSERT(request.type == VmaAllocationRequestType::Normal);
        +
        11304 
        +
        11305  const uint32_t targetLevel = AllocSizeToLevel(allocSize);
        +
        11306  uint32_t currLevel = (uint32_t)(uintptr_t)request.customData;
        +
        11307 
        +
        11308  Node* currNode = m_FreeList[currLevel].front;
        +
        11309  VMA_ASSERT(currNode != VMA_NULL && currNode->type == Node::TYPE_FREE);
        +
        11310  while(currNode->offset != request.offset)
        +
        11311  {
        +
        11312  currNode = currNode->free.next;
        +
        11313  VMA_ASSERT(currNode != VMA_NULL && currNode->type == Node::TYPE_FREE);
        +
        11314  }
        +
        11315 
        +
        11316  // Go down, splitting free nodes.
        +
        11317  while(currLevel < targetLevel)
        11318  {
        -
        11319  RemoveFromFreeList(level, node->buddy);
        -
        11320  Node* const parent = node->parent;
        -
        11321 
        -
        11322  vma_delete(GetAllocationCallbacks(), node->buddy);
        -
        11323  vma_delete(GetAllocationCallbacks(), node);
        -
        11324  parent->type = Node::TYPE_FREE;
        -
        11325 
        -
        11326  node = parent;
        -
        11327  --level;
        -
        11328  //m_SumFreeSize += LevelToNodeSize(level) % 2; // Useful only when level node sizes can be non power of 2.
        -
        11329  --m_FreeCount;
        -
        11330  }
        -
        11331 
        -
        11332  AddToFreeListFront(level, node);
        -
        11333 }
        -
        11334 
        -
        11335 void VmaBlockMetadata_Buddy::CalcAllocationStatInfoNode(VmaStatInfo& outInfo, const Node* node, VkDeviceSize levelNodeSize) const
        -
        11336 {
        -
        11337  switch(node->type)
        -
        11338  {
        -
        11339  case Node::TYPE_FREE:
        -
        11340  ++outInfo.unusedRangeCount;
        -
        11341  outInfo.unusedBytes += levelNodeSize;
        -
        11342  outInfo.unusedRangeSizeMax = VMA_MAX(outInfo.unusedRangeSizeMax, levelNodeSize);
        -
        11343  outInfo.unusedRangeSizeMin = VMA_MAX(outInfo.unusedRangeSizeMin, levelNodeSize);
        -
        11344  break;
        -
        11345  case Node::TYPE_ALLOCATION:
        -
        11346  {
        -
        11347  const VkDeviceSize allocSize = node->allocation.alloc->GetSize();
        -
        11348  ++outInfo.allocationCount;
        -
        11349  outInfo.usedBytes += allocSize;
        -
        11350  outInfo.allocationSizeMax = VMA_MAX(outInfo.allocationSizeMax, allocSize);
        -
        11351  outInfo.allocationSizeMin = VMA_MAX(outInfo.allocationSizeMin, allocSize);
        -
        11352 
        -
        11353  const VkDeviceSize unusedRangeSize = levelNodeSize - allocSize;
        -
        11354  if(unusedRangeSize > 0)
        -
        11355  {
        -
        11356  ++outInfo.unusedRangeCount;
        -
        11357  outInfo.unusedBytes += unusedRangeSize;
        -
        11358  outInfo.unusedRangeSizeMax = VMA_MAX(outInfo.unusedRangeSizeMax, unusedRangeSize);
        -
        11359  outInfo.unusedRangeSizeMin = VMA_MAX(outInfo.unusedRangeSizeMin, unusedRangeSize);
        -
        11360  }
        -
        11361  }
        -
        11362  break;
        -
        11363  case Node::TYPE_SPLIT:
        -
        11364  {
        -
        11365  const VkDeviceSize childrenNodeSize = levelNodeSize / 2;
        -
        11366  const Node* const leftChild = node->split.leftChild;
        -
        11367  CalcAllocationStatInfoNode(outInfo, leftChild, childrenNodeSize);
        -
        11368  const Node* const rightChild = leftChild->buddy;
        -
        11369  CalcAllocationStatInfoNode(outInfo, rightChild, childrenNodeSize);
        -
        11370  }
        -
        11371  break;
        -
        11372  default:
        -
        11373  VMA_ASSERT(0);
        -
        11374  }
        -
        11375 }
        -
        11376 
        -
        11377 void VmaBlockMetadata_Buddy::AddToFreeListFront(uint32_t level, Node* node)
        -
        11378 {
        -
        11379  VMA_ASSERT(node->type == Node::TYPE_FREE);
        +
        11319  // currNode is already first free node at currLevel.
        +
        11320  // Remove it from list of free nodes at this currLevel.
        +
        11321  RemoveFromFreeList(currLevel, currNode);
        +
        11322 
        +
        11323  const uint32_t childrenLevel = currLevel + 1;
        +
        11324 
        +
        11325  // Create two free sub-nodes.
        +
        11326  Node* leftChild = vma_new(GetAllocationCallbacks(), Node)();
        +
        11327  Node* rightChild = vma_new(GetAllocationCallbacks(), Node)();
        +
        11328 
        +
        11329  leftChild->offset = currNode->offset;
        +
        11330  leftChild->type = Node::TYPE_FREE;
        +
        11331  leftChild->parent = currNode;
        +
        11332  leftChild->buddy = rightChild;
        +
        11333 
        +
        11334  rightChild->offset = currNode->offset + LevelToNodeSize(childrenLevel);
        +
        11335  rightChild->type = Node::TYPE_FREE;
        +
        11336  rightChild->parent = currNode;
        +
        11337  rightChild->buddy = leftChild;
        +
        11338 
        +
        11339  // Convert current currNode to split type.
        +
        11340  currNode->type = Node::TYPE_SPLIT;
        +
        11341  currNode->split.leftChild = leftChild;
        +
        11342 
        +
        11343  // Add child nodes to free list. Order is important!
        +
        11344  AddToFreeListFront(childrenLevel, rightChild);
        +
        11345  AddToFreeListFront(childrenLevel, leftChild);
        +
        11346 
        +
        11347  ++m_FreeCount;
        +
        11348  //m_SumFreeSize -= LevelToNodeSize(currLevel) % 2; // Useful only when level node sizes can be non power of 2.
        +
        11349  ++currLevel;
        +
        11350  currNode = m_FreeList[currLevel].front;
        +
        11351 
        +
        11352  /*
        +
        11353  We can be sure that currNode, as left child of node previously split,
        +
        11354  also fullfills the alignment requirement.
        +
        11355  */
        +
        11356  }
        +
        11357 
        +
        11358  // Remove from free list.
        +
        11359  VMA_ASSERT(currLevel == targetLevel &&
        +
        11360  currNode != VMA_NULL &&
        +
        11361  currNode->type == Node::TYPE_FREE);
        +
        11362  RemoveFromFreeList(currLevel, currNode);
        +
        11363 
        +
        11364  // Convert to allocation node.
        +
        11365  currNode->type = Node::TYPE_ALLOCATION;
        +
        11366  currNode->allocation.alloc = hAllocation;
        +
        11367 
        +
        11368  ++m_AllocationCount;
        +
        11369  --m_FreeCount;
        +
        11370  m_SumFreeSize -= allocSize;
        +
        11371 }
        +
        11372 
        +
        11373 void VmaBlockMetadata_Buddy::DeleteNode(Node* node)
        +
        11374 {
        +
        11375  if(node->type == Node::TYPE_SPLIT)
        +
        11376  {
        +
        11377  DeleteNode(node->split.leftChild->buddy);
        +
        11378  DeleteNode(node->split.leftChild);
        +
        11379  }
        11380 
        -
        11381  // List is empty.
        -
        11382  Node* const frontNode = m_FreeList[level].front;
        -
        11383  if(frontNode == VMA_NULL)
        -
        11384  {
        -
        11385  VMA_ASSERT(m_FreeList[level].back == VMA_NULL);
        -
        11386  node->free.prev = node->free.next = VMA_NULL;
        -
        11387  m_FreeList[level].front = m_FreeList[level].back = node;
        -
        11388  }
        -
        11389  else
        -
        11390  {
        -
        11391  VMA_ASSERT(frontNode->free.prev == VMA_NULL);
        -
        11392  node->free.prev = VMA_NULL;
        -
        11393  node->free.next = frontNode;
        -
        11394  frontNode->free.prev = node;
        -
        11395  m_FreeList[level].front = node;
        -
        11396  }
        -
        11397 }
        -
        11398 
        -
        11399 void VmaBlockMetadata_Buddy::RemoveFromFreeList(uint32_t level, Node* node)
        -
        11400 {
        -
        11401  VMA_ASSERT(m_FreeList[level].front != VMA_NULL);
        -
        11402 
        -
        11403  // It is at the front.
        -
        11404  if(node->free.prev == VMA_NULL)
        -
        11405  {
        -
        11406  VMA_ASSERT(m_FreeList[level].front == node);
        -
        11407  m_FreeList[level].front = node->free.next;
        -
        11408  }
        -
        11409  else
        -
        11410  {
        -
        11411  Node* const prevFreeNode = node->free.prev;
        -
        11412  VMA_ASSERT(prevFreeNode->free.next == node);
        -
        11413  prevFreeNode->free.next = node->free.next;
        -
        11414  }
        -
        11415 
        -
        11416  // It is at the back.
        -
        11417  if(node->free.next == VMA_NULL)
        -
        11418  {
        -
        11419  VMA_ASSERT(m_FreeList[level].back == node);
        -
        11420  m_FreeList[level].back = node->free.prev;
        -
        11421  }
        -
        11422  else
        -
        11423  {
        -
        11424  Node* const nextFreeNode = node->free.next;
        -
        11425  VMA_ASSERT(nextFreeNode->free.prev == node);
        -
        11426  nextFreeNode->free.prev = node->free.prev;
        -
        11427  }
        -
        11428 }
        -
        11429 
        -
        11430 #if VMA_STATS_STRING_ENABLED
        -
        11431 void VmaBlockMetadata_Buddy::PrintDetailedMapNode(class VmaJsonWriter& json, const Node* node, VkDeviceSize levelNodeSize) const
        -
        11432 {
        -
        11433  switch(node->type)
        -
        11434  {
        -
        11435  case Node::TYPE_FREE:
        -
        11436  PrintDetailedMap_UnusedRange(json, node->offset, levelNodeSize);
        -
        11437  break;
        -
        11438  case Node::TYPE_ALLOCATION:
        -
        11439  {
        -
        11440  PrintDetailedMap_Allocation(json, node->offset, node->allocation.alloc);
        -
        11441  const VkDeviceSize allocSize = node->allocation.alloc->GetSize();
        -
        11442  if(allocSize < levelNodeSize)
        -
        11443  {
        -
        11444  PrintDetailedMap_UnusedRange(json, node->offset + allocSize, levelNodeSize - allocSize);
        -
        11445  }
        -
        11446  }
        -
        11447  break;
        -
        11448  case Node::TYPE_SPLIT:
        -
        11449  {
        -
        11450  const VkDeviceSize childrenNodeSize = levelNodeSize / 2;
        -
        11451  const Node* const leftChild = node->split.leftChild;
        -
        11452  PrintDetailedMapNode(json, leftChild, childrenNodeSize);
        -
        11453  const Node* const rightChild = leftChild->buddy;
        -
        11454  PrintDetailedMapNode(json, rightChild, childrenNodeSize);
        -
        11455  }
        -
        11456  break;
        -
        11457  default:
        -
        11458  VMA_ASSERT(0);
        -
        11459  }
        -
        11460 }
        -
        11461 #endif // #if VMA_STATS_STRING_ENABLED
        -
        11462 
        -
        11463 
        -
        11465 // class VmaDeviceMemoryBlock
        -
        11466 
        -
        11467 VmaDeviceMemoryBlock::VmaDeviceMemoryBlock(VmaAllocator hAllocator) :
        -
        11468  m_pMetadata(VMA_NULL),
        -
        11469  m_MemoryTypeIndex(UINT32_MAX),
        -
        11470  m_Id(0),
        -
        11471  m_hMemory(VK_NULL_HANDLE),
        -
        11472  m_MapCount(0),
        -
        11473  m_pMappedData(VMA_NULL)
        -
        11474 {
        -
        11475 }
        -
        11476 
        -
        11477 void VmaDeviceMemoryBlock::Init(
        -
        11478  VmaAllocator hAllocator,
        -
        11479  VmaPool hParentPool,
        -
        11480  uint32_t newMemoryTypeIndex,
        -
        11481  VkDeviceMemory newMemory,
        -
        11482  VkDeviceSize newSize,
        -
        11483  uint32_t id,
        -
        11484  uint32_t algorithm)
        -
        11485 {
        -
        11486  VMA_ASSERT(m_hMemory == VK_NULL_HANDLE);
        -
        11487 
        -
        11488  m_hParentPool = hParentPool;
        -
        11489  m_MemoryTypeIndex = newMemoryTypeIndex;
        -
        11490  m_Id = id;
        -
        11491  m_hMemory = newMemory;
        -
        11492 
        -
        11493  switch(algorithm)
        -
        11494  {
        -
        11495  case VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT:
        -
        11496  m_pMetadata = vma_new(hAllocator, VmaBlockMetadata_Linear)(hAllocator);
        -
        11497  break;
        -
        11498  case VMA_POOL_CREATE_BUDDY_ALGORITHM_BIT:
        -
        11499  m_pMetadata = vma_new(hAllocator, VmaBlockMetadata_Buddy)(hAllocator);
        -
        11500  break;
        -
        11501  default:
        -
        11502  VMA_ASSERT(0);
        -
        11503  // Fall-through.
        -
        11504  case 0:
        -
        11505  m_pMetadata = vma_new(hAllocator, VmaBlockMetadata_Generic)(hAllocator);
        -
        11506  }
        -
        11507  m_pMetadata->Init(newSize);
        -
        11508 }
        -
        11509 
        -
        11510 void VmaDeviceMemoryBlock::Destroy(VmaAllocator allocator)
        -
        11511 {
        -
        11512  // This is the most important assert in the entire library.
        -
        11513  // Hitting it means you have some memory leak - unreleased VmaAllocation objects.
        -
        11514  VMA_ASSERT(m_pMetadata->IsEmpty() && "Some allocations were not freed before destruction of this memory block!");
        -
        11515 
        -
        11516  VMA_ASSERT(m_hMemory != VK_NULL_HANDLE);
        -
        11517  allocator->FreeVulkanMemory(m_MemoryTypeIndex, m_pMetadata->GetSize(), m_hMemory);
        -
        11518  m_hMemory = VK_NULL_HANDLE;
        -
        11519 
        -
        11520  vma_delete(allocator, m_pMetadata);
        -
        11521  m_pMetadata = VMA_NULL;
        -
        11522 }
        -
        11523 
        -
        11524 bool VmaDeviceMemoryBlock::Validate() const
        -
        11525 {
        -
        11526  VMA_VALIDATE((m_hMemory != VK_NULL_HANDLE) &&
        -
        11527  (m_pMetadata->GetSize() != 0));
        -
        11528 
        -
        11529  return m_pMetadata->Validate();
        -
        11530 }
        -
        11531 
        -
        11532 VkResult VmaDeviceMemoryBlock::CheckCorruption(VmaAllocator hAllocator)
        -
        11533 {
        -
        11534  void* pData = nullptr;
        -
        11535  VkResult res = Map(hAllocator, 1, &pData);
        -
        11536  if(res != VK_SUCCESS)
        -
        11537  {
        -
        11538  return res;
        -
        11539  }
        -
        11540 
        -
        11541  res = m_pMetadata->CheckCorruption(pData);
        -
        11542 
        -
        11543  Unmap(hAllocator, 1);
        -
        11544 
        -
        11545  return res;
        -
        11546 }
        -
        11547 
        -
        11548 VkResult VmaDeviceMemoryBlock::Map(VmaAllocator hAllocator, uint32_t count, void** ppData)
        -
        11549 {
        -
        11550  if(count == 0)
        -
        11551  {
        -
        11552  return VK_SUCCESS;
        -
        11553  }
        -
        11554 
        -
        11555  VmaMutexLock lock(m_Mutex, hAllocator->m_UseMutex);
        -
        11556  if(m_MapCount != 0)
        -
        11557  {
        -
        11558  m_MapCount += count;
        -
        11559  VMA_ASSERT(m_pMappedData != VMA_NULL);
        -
        11560  if(ppData != VMA_NULL)
        -
        11561  {
        -
        11562  *ppData = m_pMappedData;
        -
        11563  }
        -
        11564  return VK_SUCCESS;
        -
        11565  }
        -
        11566  else
        -
        11567  {
        -
        11568  VkResult result = (*hAllocator->GetVulkanFunctions().vkMapMemory)(
        -
        11569  hAllocator->m_hDevice,
        -
        11570  m_hMemory,
        -
        11571  0, // offset
        -
        11572  VK_WHOLE_SIZE,
        -
        11573  0, // flags
        -
        11574  &m_pMappedData);
        -
        11575  if(result == VK_SUCCESS)
        -
        11576  {
        -
        11577  if(ppData != VMA_NULL)
        -
        11578  {
        -
        11579  *ppData = m_pMappedData;
        -
        11580  }
        -
        11581  m_MapCount = count;
        -
        11582  }
        -
        11583  return result;
        -
        11584  }
        -
        11585 }
        -
        11586 
        -
        11587 void VmaDeviceMemoryBlock::Unmap(VmaAllocator hAllocator, uint32_t count)
        -
        11588 {
        -
        11589  if(count == 0)
        -
        11590  {
        -
        11591  return;
        -
        11592  }
        -
        11593 
        -
        11594  VmaMutexLock lock(m_Mutex, hAllocator->m_UseMutex);
        -
        11595  if(m_MapCount >= count)
        -
        11596  {
        -
        11597  m_MapCount -= count;
        -
        11598  if(m_MapCount == 0)
        -
        11599  {
        -
        11600  m_pMappedData = VMA_NULL;
        -
        11601  (*hAllocator->GetVulkanFunctions().vkUnmapMemory)(hAllocator->m_hDevice, m_hMemory);
        -
        11602  }
        -
        11603  }
        -
        11604  else
        -
        11605  {
        -
        11606  VMA_ASSERT(0 && "VkDeviceMemory block is being unmapped while it was not previously mapped.");
        -
        11607  }
        -
        11608 }
        -
        11609 
        -
        11610 VkResult VmaDeviceMemoryBlock::WriteMagicValueAroundAllocation(VmaAllocator hAllocator, VkDeviceSize allocOffset, VkDeviceSize allocSize)
        -
        11611 {
        -
        11612  VMA_ASSERT(VMA_DEBUG_MARGIN > 0 && VMA_DEBUG_MARGIN % 4 == 0 && VMA_DEBUG_DETECT_CORRUPTION);
        -
        11613  VMA_ASSERT(allocOffset >= VMA_DEBUG_MARGIN);
        -
        11614 
        -
        11615  void* pData;
        -
        11616  VkResult res = Map(hAllocator, 1, &pData);
        -
        11617  if(res != VK_SUCCESS)
        -
        11618  {
        -
        11619  return res;
        -
        11620  }
        +
        11381  vma_delete(GetAllocationCallbacks(), node);
        +
        11382 }
        +
        11383 
        +
        11384 bool VmaBlockMetadata_Buddy::ValidateNode(ValidationContext& ctx, const Node* parent, const Node* curr, uint32_t level, VkDeviceSize levelNodeSize) const
        +
        11385 {
        +
        11386  VMA_VALIDATE(level < m_LevelCount);
        +
        11387  VMA_VALIDATE(curr->parent == parent);
        +
        11388  VMA_VALIDATE((curr->buddy == VMA_NULL) == (parent == VMA_NULL));
        +
        11389  VMA_VALIDATE(curr->buddy == VMA_NULL || curr->buddy->buddy == curr);
        +
        11390  switch(curr->type)
        +
        11391  {
        +
        11392  case Node::TYPE_FREE:
        +
        11393  // curr->free.prev, next are validated separately.
        +
        11394  ctx.calculatedSumFreeSize += levelNodeSize;
        +
        11395  ++ctx.calculatedFreeCount;
        +
        11396  break;
        +
        11397  case Node::TYPE_ALLOCATION:
        +
        11398  ++ctx.calculatedAllocationCount;
        +
        11399  ctx.calculatedSumFreeSize += levelNodeSize - curr->allocation.alloc->GetSize();
        +
        11400  VMA_VALIDATE(curr->allocation.alloc != VK_NULL_HANDLE);
        +
        11401  break;
        +
        11402  case Node::TYPE_SPLIT:
        +
        11403  {
        +
        11404  const uint32_t childrenLevel = level + 1;
        +
        11405  const VkDeviceSize childrenLevelNodeSize = levelNodeSize / 2;
        +
        11406  const Node* const leftChild = curr->split.leftChild;
        +
        11407  VMA_VALIDATE(leftChild != VMA_NULL);
        +
        11408  VMA_VALIDATE(leftChild->offset == curr->offset);
        +
        11409  if(!ValidateNode(ctx, curr, leftChild, childrenLevel, childrenLevelNodeSize))
        +
        11410  {
        +
        11411  VMA_VALIDATE(false && "ValidateNode for left child failed.");
        +
        11412  }
        +
        11413  const Node* const rightChild = leftChild->buddy;
        +
        11414  VMA_VALIDATE(rightChild->offset == curr->offset + childrenLevelNodeSize);
        +
        11415  if(!ValidateNode(ctx, curr, rightChild, childrenLevel, childrenLevelNodeSize))
        +
        11416  {
        +
        11417  VMA_VALIDATE(false && "ValidateNode for right child failed.");
        +
        11418  }
        +
        11419  }
        +
        11420  break;
        +
        11421  default:
        +
        11422  return false;
        +
        11423  }
        +
        11424 
        +
        11425  return true;
        +
        11426 }
        +
        11427 
        +
        11428 uint32_t VmaBlockMetadata_Buddy::AllocSizeToLevel(VkDeviceSize allocSize) const
        +
        11429 {
        +
        11430  // I know this could be optimized somehow e.g. by using std::log2p1 from C++20.
        +
        11431  uint32_t level = 0;
        +
        11432  VkDeviceSize currLevelNodeSize = m_UsableSize;
        +
        11433  VkDeviceSize nextLevelNodeSize = currLevelNodeSize >> 1;
        +
        11434  while(allocSize <= nextLevelNodeSize && level + 1 < m_LevelCount)
        +
        11435  {
        +
        11436  ++level;
        +
        11437  currLevelNodeSize = nextLevelNodeSize;
        +
        11438  nextLevelNodeSize = currLevelNodeSize >> 1;
        +
        11439  }
        +
        11440  return level;
        +
        11441 }
        +
        11442 
        +
        11443 void VmaBlockMetadata_Buddy::FreeAtOffset(VmaAllocation alloc, VkDeviceSize offset)
        +
        11444 {
        +
        11445  // Find node and level.
        +
        11446  Node* node = m_Root;
        +
        11447  VkDeviceSize nodeOffset = 0;
        +
        11448  uint32_t level = 0;
        +
        11449  VkDeviceSize levelNodeSize = LevelToNodeSize(0);
        +
        11450  while(node->type == Node::TYPE_SPLIT)
        +
        11451  {
        +
        11452  const VkDeviceSize nextLevelSize = levelNodeSize >> 1;
        +
        11453  if(offset < nodeOffset + nextLevelSize)
        +
        11454  {
        +
        11455  node = node->split.leftChild;
        +
        11456  }
        +
        11457  else
        +
        11458  {
        +
        11459  node = node->split.leftChild->buddy;
        +
        11460  nodeOffset += nextLevelSize;
        +
        11461  }
        +
        11462  ++level;
        +
        11463  levelNodeSize = nextLevelSize;
        +
        11464  }
        +
        11465 
        +
        11466  VMA_ASSERT(node != VMA_NULL && node->type == Node::TYPE_ALLOCATION);
        +
        11467  VMA_ASSERT(alloc == VK_NULL_HANDLE || node->allocation.alloc == alloc);
        +
        11468 
        +
        11469  ++m_FreeCount;
        +
        11470  --m_AllocationCount;
        +
        11471  m_SumFreeSize += alloc->GetSize();
        +
        11472 
        +
        11473  node->type = Node::TYPE_FREE;
        +
        11474 
        +
        11475  // Join free nodes if possible.
        +
        11476  while(level > 0 && node->buddy->type == Node::TYPE_FREE)
        +
        11477  {
        +
        11478  RemoveFromFreeList(level, node->buddy);
        +
        11479  Node* const parent = node->parent;
        +
        11480 
        +
        11481  vma_delete(GetAllocationCallbacks(), node->buddy);
        +
        11482  vma_delete(GetAllocationCallbacks(), node);
        +
        11483  parent->type = Node::TYPE_FREE;
        +
        11484 
        +
        11485  node = parent;
        +
        11486  --level;
        +
        11487  //m_SumFreeSize += LevelToNodeSize(level) % 2; // Useful only when level node sizes can be non power of 2.
        +
        11488  --m_FreeCount;
        +
        11489  }
        +
        11490 
        +
        11491  AddToFreeListFront(level, node);
        +
        11492 }
        +
        11493 
        +
        11494 void VmaBlockMetadata_Buddy::CalcAllocationStatInfoNode(VmaStatInfo& outInfo, const Node* node, VkDeviceSize levelNodeSize) const
        +
        11495 {
        +
        11496  switch(node->type)
        +
        11497  {
        +
        11498  case Node::TYPE_FREE:
        +
        11499  ++outInfo.unusedRangeCount;
        +
        11500  outInfo.unusedBytes += levelNodeSize;
        +
        11501  outInfo.unusedRangeSizeMax = VMA_MAX(outInfo.unusedRangeSizeMax, levelNodeSize);
        +
        11502  outInfo.unusedRangeSizeMin = VMA_MAX(outInfo.unusedRangeSizeMin, levelNodeSize);
        +
        11503  break;
        +
        11504  case Node::TYPE_ALLOCATION:
        +
        11505  {
        +
        11506  const VkDeviceSize allocSize = node->allocation.alloc->GetSize();
        +
        11507  ++outInfo.allocationCount;
        +
        11508  outInfo.usedBytes += allocSize;
        +
        11509  outInfo.allocationSizeMax = VMA_MAX(outInfo.allocationSizeMax, allocSize);
        +
        11510  outInfo.allocationSizeMin = VMA_MAX(outInfo.allocationSizeMin, allocSize);
        +
        11511 
        +
        11512  const VkDeviceSize unusedRangeSize = levelNodeSize - allocSize;
        +
        11513  if(unusedRangeSize > 0)
        +
        11514  {
        +
        11515  ++outInfo.unusedRangeCount;
        +
        11516  outInfo.unusedBytes += unusedRangeSize;
        +
        11517  outInfo.unusedRangeSizeMax = VMA_MAX(outInfo.unusedRangeSizeMax, unusedRangeSize);
        +
        11518  outInfo.unusedRangeSizeMin = VMA_MAX(outInfo.unusedRangeSizeMin, unusedRangeSize);
        +
        11519  }
        +
        11520  }
        +
        11521  break;
        +
        11522  case Node::TYPE_SPLIT:
        +
        11523  {
        +
        11524  const VkDeviceSize childrenNodeSize = levelNodeSize / 2;
        +
        11525  const Node* const leftChild = node->split.leftChild;
        +
        11526  CalcAllocationStatInfoNode(outInfo, leftChild, childrenNodeSize);
        +
        11527  const Node* const rightChild = leftChild->buddy;
        +
        11528  CalcAllocationStatInfoNode(outInfo, rightChild, childrenNodeSize);
        +
        11529  }
        +
        11530  break;
        +
        11531  default:
        +
        11532  VMA_ASSERT(0);
        +
        11533  }
        +
        11534 }
        +
        11535 
        +
        11536 void VmaBlockMetadata_Buddy::AddToFreeListFront(uint32_t level, Node* node)
        +
        11537 {
        +
        11538  VMA_ASSERT(node->type == Node::TYPE_FREE);
        +
        11539 
        +
        11540  // List is empty.
        +
        11541  Node* const frontNode = m_FreeList[level].front;
        +
        11542  if(frontNode == VMA_NULL)
        +
        11543  {
        +
        11544  VMA_ASSERT(m_FreeList[level].back == VMA_NULL);
        +
        11545  node->free.prev = node->free.next = VMA_NULL;
        +
        11546  m_FreeList[level].front = m_FreeList[level].back = node;
        +
        11547  }
        +
        11548  else
        +
        11549  {
        +
        11550  VMA_ASSERT(frontNode->free.prev == VMA_NULL);
        +
        11551  node->free.prev = VMA_NULL;
        +
        11552  node->free.next = frontNode;
        +
        11553  frontNode->free.prev = node;
        +
        11554  m_FreeList[level].front = node;
        +
        11555  }
        +
        11556 }
        +
        11557 
        +
        11558 void VmaBlockMetadata_Buddy::RemoveFromFreeList(uint32_t level, Node* node)
        +
        11559 {
        +
        11560  VMA_ASSERT(m_FreeList[level].front != VMA_NULL);
        +
        11561 
        +
        11562  // It is at the front.
        +
        11563  if(node->free.prev == VMA_NULL)
        +
        11564  {
        +
        11565  VMA_ASSERT(m_FreeList[level].front == node);
        +
        11566  m_FreeList[level].front = node->free.next;
        +
        11567  }
        +
        11568  else
        +
        11569  {
        +
        11570  Node* const prevFreeNode = node->free.prev;
        +
        11571  VMA_ASSERT(prevFreeNode->free.next == node);
        +
        11572  prevFreeNode->free.next = node->free.next;
        +
        11573  }
        +
        11574 
        +
        11575  // It is at the back.
        +
        11576  if(node->free.next == VMA_NULL)
        +
        11577  {
        +
        11578  VMA_ASSERT(m_FreeList[level].back == node);
        +
        11579  m_FreeList[level].back = node->free.prev;
        +
        11580  }
        +
        11581  else
        +
        11582  {
        +
        11583  Node* const nextFreeNode = node->free.next;
        +
        11584  VMA_ASSERT(nextFreeNode->free.prev == node);
        +
        11585  nextFreeNode->free.prev = node->free.prev;
        +
        11586  }
        +
        11587 }
        +
        11588 
        +
        11589 #if VMA_STATS_STRING_ENABLED
        +
        11590 void VmaBlockMetadata_Buddy::PrintDetailedMapNode(class VmaJsonWriter& json, const Node* node, VkDeviceSize levelNodeSize) const
        +
        11591 {
        +
        11592  switch(node->type)
        +
        11593  {
        +
        11594  case Node::TYPE_FREE:
        +
        11595  PrintDetailedMap_UnusedRange(json, node->offset, levelNodeSize);
        +
        11596  break;
        +
        11597  case Node::TYPE_ALLOCATION:
        +
        11598  {
        +
        11599  PrintDetailedMap_Allocation(json, node->offset, node->allocation.alloc);
        +
        11600  const VkDeviceSize allocSize = node->allocation.alloc->GetSize();
        +
        11601  if(allocSize < levelNodeSize)
        +
        11602  {
        +
        11603  PrintDetailedMap_UnusedRange(json, node->offset + allocSize, levelNodeSize - allocSize);
        +
        11604  }
        +
        11605  }
        +
        11606  break;
        +
        11607  case Node::TYPE_SPLIT:
        +
        11608  {
        +
        11609  const VkDeviceSize childrenNodeSize = levelNodeSize / 2;
        +
        11610  const Node* const leftChild = node->split.leftChild;
        +
        11611  PrintDetailedMapNode(json, leftChild, childrenNodeSize);
        +
        11612  const Node* const rightChild = leftChild->buddy;
        +
        11613  PrintDetailedMapNode(json, rightChild, childrenNodeSize);
        +
        11614  }
        +
        11615  break;
        +
        11616  default:
        +
        11617  VMA_ASSERT(0);
        +
        11618  }
        +
        11619 }
        +
        11620 #endif // #if VMA_STATS_STRING_ENABLED
        11621 
        -
        11622  VmaWriteMagicValue(pData, allocOffset - VMA_DEBUG_MARGIN);
        -
        11623  VmaWriteMagicValue(pData, allocOffset + allocSize);
        -
        11624 
        -
        11625  Unmap(hAllocator, 1);
        -
        11626 
        -
        11627  return VK_SUCCESS;
        -
        11628 }
        -
        11629 
        -
        11630 VkResult VmaDeviceMemoryBlock::ValidateMagicValueAroundAllocation(VmaAllocator hAllocator, VkDeviceSize allocOffset, VkDeviceSize allocSize)
        -
        11631 {
        -
        11632  VMA_ASSERT(VMA_DEBUG_MARGIN > 0 && VMA_DEBUG_MARGIN % 4 == 0 && VMA_DEBUG_DETECT_CORRUPTION);
        -
        11633  VMA_ASSERT(allocOffset >= VMA_DEBUG_MARGIN);
        -
        11634 
        -
        11635  void* pData;
        -
        11636  VkResult res = Map(hAllocator, 1, &pData);
        -
        11637  if(res != VK_SUCCESS)
        -
        11638  {
        -
        11639  return res;
        -
        11640  }
        -
        11641 
        -
        11642  if(!VmaValidateMagicValue(pData, allocOffset - VMA_DEBUG_MARGIN))
        -
        11643  {
        -
        11644  VMA_ASSERT(0 && "MEMORY CORRUPTION DETECTED BEFORE FREED ALLOCATION!");
        -
        11645  }
        -
        11646  else if(!VmaValidateMagicValue(pData, allocOffset + allocSize))
        -
        11647  {
        -
        11648  VMA_ASSERT(0 && "MEMORY CORRUPTION DETECTED AFTER FREED ALLOCATION!");
        -
        11649  }
        -
        11650 
        -
        11651  Unmap(hAllocator, 1);
        -
        11652 
        -
        11653  return VK_SUCCESS;
        -
        11654 }
        -
        11655 
        -
        11656 VkResult VmaDeviceMemoryBlock::BindBufferMemory(
        -
        11657  const VmaAllocator hAllocator,
        -
        11658  const VmaAllocation hAllocation,
        -
        11659  VkDeviceSize allocationLocalOffset,
        -
        11660  VkBuffer hBuffer,
        -
        11661  const void* pNext)
        -
        11662 {
        -
        11663  VMA_ASSERT(hAllocation->GetType() == VmaAllocation_T::ALLOCATION_TYPE_BLOCK &&
        -
        11664  hAllocation->GetBlock() == this);
        -
        11665  VMA_ASSERT(allocationLocalOffset < hAllocation->GetSize() &&
        -
        11666  "Invalid allocationLocalOffset. Did you forget that this offset is relative to the beginning of the allocation, not the whole memory block?");
        -
        11667  const VkDeviceSize memoryOffset = hAllocation->GetOffset() + allocationLocalOffset;
        -
        11668  // This lock is important so that we don't call vkBind... and/or vkMap... simultaneously on the same VkDeviceMemory from multiple threads.
        -
        11669  VmaMutexLock lock(m_Mutex, hAllocator->m_UseMutex);
        -
        11670  return hAllocator->BindVulkanBuffer(m_hMemory, memoryOffset, hBuffer, pNext);
        -
        11671 }
        -
        11672 
        -
        11673 VkResult VmaDeviceMemoryBlock::BindImageMemory(
        -
        11674  const VmaAllocator hAllocator,
        -
        11675  const VmaAllocation hAllocation,
        -
        11676  VkDeviceSize allocationLocalOffset,
        -
        11677  VkImage hImage,
        -
        11678  const void* pNext)
        -
        11679 {
        -
        11680  VMA_ASSERT(hAllocation->GetType() == VmaAllocation_T::ALLOCATION_TYPE_BLOCK &&
        -
        11681  hAllocation->GetBlock() == this);
        -
        11682  VMA_ASSERT(allocationLocalOffset < hAllocation->GetSize() &&
        -
        11683  "Invalid allocationLocalOffset. Did you forget that this offset is relative to the beginning of the allocation, not the whole memory block?");
        -
        11684  const VkDeviceSize memoryOffset = hAllocation->GetOffset() + allocationLocalOffset;
        -
        11685  // This lock is important so that we don't call vkBind... and/or vkMap... simultaneously on the same VkDeviceMemory from multiple threads.
        -
        11686  VmaMutexLock lock(m_Mutex, hAllocator->m_UseMutex);
        -
        11687  return hAllocator->BindVulkanImage(m_hMemory, memoryOffset, hImage, pNext);
        -
        11688 }
        -
        11689 
        -
        11690 static void InitStatInfo(VmaStatInfo& outInfo)
        -
        11691 {
        -
        11692  memset(&outInfo, 0, sizeof(outInfo));
        -
        11693  outInfo.allocationSizeMin = UINT64_MAX;
        -
        11694  outInfo.unusedRangeSizeMin = UINT64_MAX;
        -
        11695 }
        -
        11696 
        -
        11697 // Adds statistics srcInfo into inoutInfo, like: inoutInfo += srcInfo.
        -
        11698 static void VmaAddStatInfo(VmaStatInfo& inoutInfo, const VmaStatInfo& srcInfo)
        -
        11699 {
        -
        11700  inoutInfo.blockCount += srcInfo.blockCount;
        -
        11701  inoutInfo.allocationCount += srcInfo.allocationCount;
        -
        11702  inoutInfo.unusedRangeCount += srcInfo.unusedRangeCount;
        -
        11703  inoutInfo.usedBytes += srcInfo.usedBytes;
        -
        11704  inoutInfo.unusedBytes += srcInfo.unusedBytes;
        -
        11705  inoutInfo.allocationSizeMin = VMA_MIN(inoutInfo.allocationSizeMin, srcInfo.allocationSizeMin);
        -
        11706  inoutInfo.allocationSizeMax = VMA_MAX(inoutInfo.allocationSizeMax, srcInfo.allocationSizeMax);
        -
        11707  inoutInfo.unusedRangeSizeMin = VMA_MIN(inoutInfo.unusedRangeSizeMin, srcInfo.unusedRangeSizeMin);
        -
        11708  inoutInfo.unusedRangeSizeMax = VMA_MAX(inoutInfo.unusedRangeSizeMax, srcInfo.unusedRangeSizeMax);
        -
        11709 }
        -
        11710 
        -
        11711 static void VmaPostprocessCalcStatInfo(VmaStatInfo& inoutInfo)
        -
        11712 {
        -
        11713  inoutInfo.allocationSizeAvg = (inoutInfo.allocationCount > 0) ?
        -
        11714  VmaRoundDiv<VkDeviceSize>(inoutInfo.usedBytes, inoutInfo.allocationCount) : 0;
        -
        11715  inoutInfo.unusedRangeSizeAvg = (inoutInfo.unusedRangeCount > 0) ?
        -
        11716  VmaRoundDiv<VkDeviceSize>(inoutInfo.unusedBytes, inoutInfo.unusedRangeCount) : 0;
        -
        11717 }
        -
        11718 
        -
        11719 VmaPool_T::VmaPool_T(
        -
        11720  VmaAllocator hAllocator,
        -
        11721  const VmaPoolCreateInfo& createInfo,
        -
        11722  VkDeviceSize preferredBlockSize) :
        -
        11723  m_BlockVector(
        -
        11724  hAllocator,
        -
        11725  this, // hParentPool
        -
        11726  createInfo.memoryTypeIndex,
        -
        11727  createInfo.blockSize != 0 ? createInfo.blockSize : preferredBlockSize,
        -
        11728  createInfo.minBlockCount,
        -
        11729  createInfo.maxBlockCount,
        -
        11730  (createInfo.flags & VMA_POOL_CREATE_IGNORE_BUFFER_IMAGE_GRANULARITY_BIT) != 0 ? 1 : hAllocator->GetBufferImageGranularity(),
        -
        11731  createInfo.frameInUseCount,
        -
        11732  createInfo.blockSize != 0, // explicitBlockSize
        -
        11733  createInfo.flags & VMA_POOL_CREATE_ALGORITHM_MASK), // algorithm
        -
        11734  m_Id(0),
        -
        11735  m_Name(VMA_NULL)
        -
        11736 {
        -
        11737 }
        -
        11738 
        -
        11739 VmaPool_T::~VmaPool_T()
        -
        11740 {
        -
        11741 }
        -
        11742 
        -
        11743 void VmaPool_T::SetName(const char* pName)
        -
        11744 {
        -
        11745  const VkAllocationCallbacks* allocs = m_BlockVector.GetAllocator()->GetAllocationCallbacks();
        -
        11746  VmaFreeString(allocs, m_Name);
        -
        11747 
        -
        11748  if(pName != VMA_NULL)
        +
        11622 
        +
        11624 // class VmaDeviceMemoryBlock
        +
        11625 
        +
        11626 VmaDeviceMemoryBlock::VmaDeviceMemoryBlock(VmaAllocator hAllocator) :
        +
        11627  m_pMetadata(VMA_NULL),
        +
        11628  m_MemoryTypeIndex(UINT32_MAX),
        +
        11629  m_Id(0),
        +
        11630  m_hMemory(VK_NULL_HANDLE),
        +
        11631  m_MapCount(0),
        +
        11632  m_pMappedData(VMA_NULL)
        +
        11633 {
        +
        11634 }
        +
        11635 
        +
        11636 void VmaDeviceMemoryBlock::Init(
        +
        11637  VmaAllocator hAllocator,
        +
        11638  VmaPool hParentPool,
        +
        11639  uint32_t newMemoryTypeIndex,
        +
        11640  VkDeviceMemory newMemory,
        +
        11641  VkDeviceSize newSize,
        +
        11642  uint32_t id,
        +
        11643  uint32_t algorithm)
        +
        11644 {
        +
        11645  VMA_ASSERT(m_hMemory == VK_NULL_HANDLE);
        +
        11646 
        +
        11647  m_hParentPool = hParentPool;
        +
        11648  m_MemoryTypeIndex = newMemoryTypeIndex;
        +
        11649  m_Id = id;
        +
        11650  m_hMemory = newMemory;
        +
        11651 
        +
        11652  switch(algorithm)
        +
        11653  {
        +
        11654  case VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT:
        +
        11655  m_pMetadata = vma_new(hAllocator, VmaBlockMetadata_Linear)(hAllocator);
        +
        11656  break;
        +
        11657  case VMA_POOL_CREATE_BUDDY_ALGORITHM_BIT:
        +
        11658  m_pMetadata = vma_new(hAllocator, VmaBlockMetadata_Buddy)(hAllocator);
        +
        11659  break;
        +
        11660  default:
        +
        11661  VMA_ASSERT(0);
        +
        11662  // Fall-through.
        +
        11663  case 0:
        +
        11664  m_pMetadata = vma_new(hAllocator, VmaBlockMetadata_Generic)(hAllocator);
        +
        11665  }
        +
        11666  m_pMetadata->Init(newSize);
        +
        11667 }
        +
        11668 
        +
        11669 void VmaDeviceMemoryBlock::Destroy(VmaAllocator allocator)
        +
        11670 {
        +
        11671  // This is the most important assert in the entire library.
        +
        11672  // Hitting it means you have some memory leak - unreleased VmaAllocation objects.
        +
        11673  VMA_ASSERT(m_pMetadata->IsEmpty() && "Some allocations were not freed before destruction of this memory block!");
        +
        11674 
        +
        11675  VMA_ASSERT(m_hMemory != VK_NULL_HANDLE);
        +
        11676  allocator->FreeVulkanMemory(m_MemoryTypeIndex, m_pMetadata->GetSize(), m_hMemory);
        +
        11677  m_hMemory = VK_NULL_HANDLE;
        +
        11678 
        +
        11679  vma_delete(allocator, m_pMetadata);
        +
        11680  m_pMetadata = VMA_NULL;
        +
        11681 }
        +
        11682 
        +
        11683 bool VmaDeviceMemoryBlock::Validate() const
        +
        11684 {
        +
        11685  VMA_VALIDATE((m_hMemory != VK_NULL_HANDLE) &&
        +
        11686  (m_pMetadata->GetSize() != 0));
        +
        11687 
        +
        11688  return m_pMetadata->Validate();
        +
        11689 }
        +
        11690 
        +
        11691 VkResult VmaDeviceMemoryBlock::CheckCorruption(VmaAllocator hAllocator)
        +
        11692 {
        +
        11693  void* pData = nullptr;
        +
        11694  VkResult res = Map(hAllocator, 1, &pData);
        +
        11695  if(res != VK_SUCCESS)
        +
        11696  {
        +
        11697  return res;
        +
        11698  }
        +
        11699 
        +
        11700  res = m_pMetadata->CheckCorruption(pData);
        +
        11701 
        +
        11702  Unmap(hAllocator, 1);
        +
        11703 
        +
        11704  return res;
        +
        11705 }
        +
        11706 
        +
        11707 VkResult VmaDeviceMemoryBlock::Map(VmaAllocator hAllocator, uint32_t count, void** ppData)
        +
        11708 {
        +
        11709  if(count == 0)
        +
        11710  {
        +
        11711  return VK_SUCCESS;
        +
        11712  }
        +
        11713 
        +
        11714  VmaMutexLock lock(m_Mutex, hAllocator->m_UseMutex);
        +
        11715  if(m_MapCount != 0)
        +
        11716  {
        +
        11717  m_MapCount += count;
        +
        11718  VMA_ASSERT(m_pMappedData != VMA_NULL);
        +
        11719  if(ppData != VMA_NULL)
        +
        11720  {
        +
        11721  *ppData = m_pMappedData;
        +
        11722  }
        +
        11723  return VK_SUCCESS;
        +
        11724  }
        +
        11725  else
        +
        11726  {
        +
        11727  VkResult result = (*hAllocator->GetVulkanFunctions().vkMapMemory)(
        +
        11728  hAllocator->m_hDevice,
        +
        11729  m_hMemory,
        +
        11730  0, // offset
        +
        11731  VK_WHOLE_SIZE,
        +
        11732  0, // flags
        +
        11733  &m_pMappedData);
        +
        11734  if(result == VK_SUCCESS)
        +
        11735  {
        +
        11736  if(ppData != VMA_NULL)
        +
        11737  {
        +
        11738  *ppData = m_pMappedData;
        +
        11739  }
        +
        11740  m_MapCount = count;
        +
        11741  }
        +
        11742  return result;
        +
        11743  }
        +
        11744 }
        +
        11745 
        +
        11746 void VmaDeviceMemoryBlock::Unmap(VmaAllocator hAllocator, uint32_t count)
        +
        11747 {
        +
        11748  if(count == 0)
        11749  {
        -
        11750  m_Name = VmaCreateStringCopy(allocs, pName);
        +
        11750  return;
        11751  }
        -
        11752  else
        -
        11753  {
        -
        11754  m_Name = VMA_NULL;
        -
        11755  }
        -
        11756 }
        -
        11757 
        -
        11758 #if VMA_STATS_STRING_ENABLED
        -
        11759 
        -
        11760 #endif // #if VMA_STATS_STRING_ENABLED
        -
        11761 
        -
        11762 VmaBlockVector::VmaBlockVector(
        -
        11763  VmaAllocator hAllocator,
        -
        11764  VmaPool hParentPool,
        -
        11765  uint32_t memoryTypeIndex,
        -
        11766  VkDeviceSize preferredBlockSize,
        -
        11767  size_t minBlockCount,
        -
        11768  size_t maxBlockCount,
        -
        11769  VkDeviceSize bufferImageGranularity,
        -
        11770  uint32_t frameInUseCount,
        -
        11771  bool explicitBlockSize,
        -
        11772  uint32_t algorithm) :
        -
        11773  m_hAllocator(hAllocator),
        -
        11774  m_hParentPool(hParentPool),
        -
        11775  m_MemoryTypeIndex(memoryTypeIndex),
        -
        11776  m_PreferredBlockSize(preferredBlockSize),
        -
        11777  m_MinBlockCount(minBlockCount),
        -
        11778  m_MaxBlockCount(maxBlockCount),
        -
        11779  m_BufferImageGranularity(bufferImageGranularity),
        -
        11780  m_FrameInUseCount(frameInUseCount),
        -
        11781  m_ExplicitBlockSize(explicitBlockSize),
        -
        11782  m_Algorithm(algorithm),
        -
        11783  m_HasEmptyBlock(false),
        -
        11784  m_Blocks(VmaStlAllocator<VmaDeviceMemoryBlock*>(hAllocator->GetAllocationCallbacks())),
        -
        11785  m_NextBlockId(0)
        -
        11786 {
        +
        11752 
        +
        11753  VmaMutexLock lock(m_Mutex, hAllocator->m_UseMutex);
        +
        11754  if(m_MapCount >= count)
        +
        11755  {
        +
        11756  m_MapCount -= count;
        +
        11757  if(m_MapCount == 0)
        +
        11758  {
        +
        11759  m_pMappedData = VMA_NULL;
        +
        11760  (*hAllocator->GetVulkanFunctions().vkUnmapMemory)(hAllocator->m_hDevice, m_hMemory);
        +
        11761  }
        +
        11762  }
        +
        11763  else
        +
        11764  {
        +
        11765  VMA_ASSERT(0 && "VkDeviceMemory block is being unmapped while it was not previously mapped.");
        +
        11766  }
        +
        11767 }
        +
        11768 
        +
        11769 VkResult VmaDeviceMemoryBlock::WriteMagicValueAroundAllocation(VmaAllocator hAllocator, VkDeviceSize allocOffset, VkDeviceSize allocSize)
        +
        11770 {
        +
        11771  VMA_ASSERT(VMA_DEBUG_MARGIN > 0 && VMA_DEBUG_MARGIN % 4 == 0 && VMA_DEBUG_DETECT_CORRUPTION);
        +
        11772  VMA_ASSERT(allocOffset >= VMA_DEBUG_MARGIN);
        +
        11773 
        +
        11774  void* pData;
        +
        11775  VkResult res = Map(hAllocator, 1, &pData);
        +
        11776  if(res != VK_SUCCESS)
        +
        11777  {
        +
        11778  return res;
        +
        11779  }
        +
        11780 
        +
        11781  VmaWriteMagicValue(pData, allocOffset - VMA_DEBUG_MARGIN);
        +
        11782  VmaWriteMagicValue(pData, allocOffset + allocSize);
        +
        11783 
        +
        11784  Unmap(hAllocator, 1);
        +
        11785 
        +
        11786  return VK_SUCCESS;
        11787 }
        11788 
        -
        11789 VmaBlockVector::~VmaBlockVector()
        +
        11789 VkResult VmaDeviceMemoryBlock::ValidateMagicValueAroundAllocation(VmaAllocator hAllocator, VkDeviceSize allocOffset, VkDeviceSize allocSize)
        11790 {
        -
        11791  for(size_t i = m_Blocks.size(); i--; )
        -
        11792  {
        -
        11793  m_Blocks[i]->Destroy(m_hAllocator);
        -
        11794  vma_delete(m_hAllocator, m_Blocks[i]);
        -
        11795  }
        -
        11796 }
        -
        11797 
        -
        11798 VkResult VmaBlockVector::CreateMinBlocks()
        -
        11799 {
        -
        11800  for(size_t i = 0; i < m_MinBlockCount; ++i)
        -
        11801  {
        -
        11802  VkResult res = CreateBlock(m_PreferredBlockSize, VMA_NULL);
        -
        11803  if(res != VK_SUCCESS)
        -
        11804  {
        -
        11805  return res;
        -
        11806  }
        -
        11807  }
        -
        11808  return VK_SUCCESS;
        -
        11809 }
        -
        11810 
        -
        11811 void VmaBlockVector::GetPoolStats(VmaPoolStats* pStats)
        -
        11812 {
        -
        11813  VmaMutexLockRead lock(m_Mutex, m_hAllocator->m_UseMutex);
        +
        11791  VMA_ASSERT(VMA_DEBUG_MARGIN > 0 && VMA_DEBUG_MARGIN % 4 == 0 && VMA_DEBUG_DETECT_CORRUPTION);
        +
        11792  VMA_ASSERT(allocOffset >= VMA_DEBUG_MARGIN);
        +
        11793 
        +
        11794  void* pData;
        +
        11795  VkResult res = Map(hAllocator, 1, &pData);
        +
        11796  if(res != VK_SUCCESS)
        +
        11797  {
        +
        11798  return res;
        +
        11799  }
        +
        11800 
        +
        11801  if(!VmaValidateMagicValue(pData, allocOffset - VMA_DEBUG_MARGIN))
        +
        11802  {
        +
        11803  VMA_ASSERT(0 && "MEMORY CORRUPTION DETECTED BEFORE FREED ALLOCATION!");
        +
        11804  }
        +
        11805  else if(!VmaValidateMagicValue(pData, allocOffset + allocSize))
        +
        11806  {
        +
        11807  VMA_ASSERT(0 && "MEMORY CORRUPTION DETECTED AFTER FREED ALLOCATION!");
        +
        11808  }
        +
        11809 
        +
        11810  Unmap(hAllocator, 1);
        +
        11811 
        +
        11812  return VK_SUCCESS;
        +
        11813 }
        11814 
        -
        11815  const size_t blockCount = m_Blocks.size();
        -
        11816 
        -
        11817  pStats->size = 0;
        -
        11818  pStats->unusedSize = 0;
        -
        11819  pStats->allocationCount = 0;
        -
        11820  pStats->unusedRangeCount = 0;
        -
        11821  pStats->unusedRangeSizeMax = 0;
        -
        11822  pStats->blockCount = blockCount;
        -
        11823 
        -
        11824  for(uint32_t blockIndex = 0; blockIndex < blockCount; ++blockIndex)
        -
        11825  {
        -
        11826  const VmaDeviceMemoryBlock* const pBlock = m_Blocks[blockIndex];
        -
        11827  VMA_ASSERT(pBlock);
        -
        11828  VMA_HEAVY_ASSERT(pBlock->Validate());
        -
        11829  pBlock->m_pMetadata->AddPoolStats(*pStats);
        -
        11830  }
        -
        11831 }
        -
        11832 
        -
        11833 bool VmaBlockVector::IsEmpty()
        -
        11834 {
        -
        11835  VmaMutexLockRead lock(m_Mutex, m_hAllocator->m_UseMutex);
        -
        11836  return m_Blocks.empty();
        -
        11837 }
        -
        11838 
        -
        11839 bool VmaBlockVector::IsCorruptionDetectionEnabled() const
        -
        11840 {
        -
        11841  const uint32_t requiredMemFlags = VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT | VK_MEMORY_PROPERTY_HOST_COHERENT_BIT;
        -
        11842  return (VMA_DEBUG_DETECT_CORRUPTION != 0) &&
        -
        11843  (VMA_DEBUG_MARGIN > 0) &&
        -
        11844  (m_Algorithm == 0 || m_Algorithm == VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT) &&
        -
        11845  (m_hAllocator->m_MemProps.memoryTypes[m_MemoryTypeIndex].propertyFlags & requiredMemFlags) == requiredMemFlags;
        -
        11846 }
        -
        11847 
        -
        11848 static const uint32_t VMA_ALLOCATION_TRY_COUNT = 32;
        -
        11849 
        -
        11850 VkResult VmaBlockVector::Allocate(
        -
        11851  uint32_t currentFrameIndex,
        -
        11852  VkDeviceSize size,
        -
        11853  VkDeviceSize alignment,
        -
        11854  const VmaAllocationCreateInfo& createInfo,
        -
        11855  VmaSuballocationType suballocType,
        -
        11856  size_t allocationCount,
        -
        11857  VmaAllocation* pAllocations)
        +
        11815 VkResult VmaDeviceMemoryBlock::BindBufferMemory(
        +
        11816  const VmaAllocator hAllocator,
        +
        11817  const VmaAllocation hAllocation,
        +
        11818  VkDeviceSize allocationLocalOffset,
        +
        11819  VkBuffer hBuffer,
        +
        11820  const void* pNext)
        +
        11821 {
        +
        11822  VMA_ASSERT(hAllocation->GetType() == VmaAllocation_T::ALLOCATION_TYPE_BLOCK &&
        +
        11823  hAllocation->GetBlock() == this);
        +
        11824  VMA_ASSERT(allocationLocalOffset < hAllocation->GetSize() &&
        +
        11825  "Invalid allocationLocalOffset. Did you forget that this offset is relative to the beginning of the allocation, not the whole memory block?");
        +
        11826  const VkDeviceSize memoryOffset = hAllocation->GetOffset() + allocationLocalOffset;
        +
        11827  // This lock is important so that we don't call vkBind... and/or vkMap... simultaneously on the same VkDeviceMemory from multiple threads.
        +
        11828  VmaMutexLock lock(m_Mutex, hAllocator->m_UseMutex);
        +
        11829  return hAllocator->BindVulkanBuffer(m_hMemory, memoryOffset, hBuffer, pNext);
        +
        11830 }
        +
        11831 
        +
        11832 VkResult VmaDeviceMemoryBlock::BindImageMemory(
        +
        11833  const VmaAllocator hAllocator,
        +
        11834  const VmaAllocation hAllocation,
        +
        11835  VkDeviceSize allocationLocalOffset,
        +
        11836  VkImage hImage,
        +
        11837  const void* pNext)
        +
        11838 {
        +
        11839  VMA_ASSERT(hAllocation->GetType() == VmaAllocation_T::ALLOCATION_TYPE_BLOCK &&
        +
        11840  hAllocation->GetBlock() == this);
        +
        11841  VMA_ASSERT(allocationLocalOffset < hAllocation->GetSize() &&
        +
        11842  "Invalid allocationLocalOffset. Did you forget that this offset is relative to the beginning of the allocation, not the whole memory block?");
        +
        11843  const VkDeviceSize memoryOffset = hAllocation->GetOffset() + allocationLocalOffset;
        +
        11844  // This lock is important so that we don't call vkBind... and/or vkMap... simultaneously on the same VkDeviceMemory from multiple threads.
        +
        11845  VmaMutexLock lock(m_Mutex, hAllocator->m_UseMutex);
        +
        11846  return hAllocator->BindVulkanImage(m_hMemory, memoryOffset, hImage, pNext);
        +
        11847 }
        +
        11848 
        +
        11849 static void InitStatInfo(VmaStatInfo& outInfo)
        +
        11850 {
        +
        11851  memset(&outInfo, 0, sizeof(outInfo));
        +
        11852  outInfo.allocationSizeMin = UINT64_MAX;
        +
        11853  outInfo.unusedRangeSizeMin = UINT64_MAX;
        +
        11854 }
        +
        11855 
        +
        11856 // Adds statistics srcInfo into inoutInfo, like: inoutInfo += srcInfo.
        +
        11857 static void VmaAddStatInfo(VmaStatInfo& inoutInfo, const VmaStatInfo& srcInfo)
        11858 {
        -
        11859  size_t allocIndex;
        -
        11860  VkResult res = VK_SUCCESS;
        -
        11861 
        -
        11862  if(IsCorruptionDetectionEnabled())
        -
        11863  {
        -
        11864  size = VmaAlignUp<VkDeviceSize>(size, sizeof(VMA_CORRUPTION_DETECTION_MAGIC_VALUE));
        -
        11865  alignment = VmaAlignUp<VkDeviceSize>(alignment, sizeof(VMA_CORRUPTION_DETECTION_MAGIC_VALUE));
        -
        11866  }
        -
        11867 
        -
        11868  {
        -
        11869  VmaMutexLockWrite lock(m_Mutex, m_hAllocator->m_UseMutex);
        -
        11870  for(allocIndex = 0; allocIndex < allocationCount; ++allocIndex)
        -
        11871  {
        -
        11872  res = AllocatePage(
        -
        11873  currentFrameIndex,
        -
        11874  size,
        -
        11875  alignment,
        -
        11876  createInfo,
        -
        11877  suballocType,
        -
        11878  pAllocations + allocIndex);
        -
        11879  if(res != VK_SUCCESS)
        -
        11880  {
        -
        11881  break;
        -
        11882  }
        -
        11883  }
        -
        11884  }
        -
        11885 
        -
        11886  if(res != VK_SUCCESS)
        -
        11887  {
        -
        11888  // Free all already created allocations.
        -
        11889  while(allocIndex--)
        -
        11890  {
        -
        11891  Free(pAllocations[allocIndex]);
        -
        11892  }
        -
        11893  memset(pAllocations, 0, sizeof(VmaAllocation) * allocationCount);
        -
        11894  }
        -
        11895 
        -
        11896  return res;
        -
        11897 }
        -
        11898 
        -
        11899 VkResult VmaBlockVector::AllocatePage(
        -
        11900  uint32_t currentFrameIndex,
        -
        11901  VkDeviceSize size,
        -
        11902  VkDeviceSize alignment,
        -
        11903  const VmaAllocationCreateInfo& createInfo,
        -
        11904  VmaSuballocationType suballocType,
        -
        11905  VmaAllocation* pAllocation)
        -
        11906 {
        -
        11907  const bool isUpperAddress = (createInfo.flags & VMA_ALLOCATION_CREATE_UPPER_ADDRESS_BIT) != 0;
        -
        11908  bool canMakeOtherLost = (createInfo.flags & VMA_ALLOCATION_CREATE_CAN_MAKE_OTHER_LOST_BIT) != 0;
        -
        11909  const bool mapped = (createInfo.flags & VMA_ALLOCATION_CREATE_MAPPED_BIT) != 0;
        -
        11910  const bool isUserDataString = (createInfo.flags & VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT) != 0;
        -
        11911 
        -
        11912  const bool withinBudget = (createInfo.flags & VMA_ALLOCATION_CREATE_WITHIN_BUDGET_BIT) != 0;
        -
        11913  VkDeviceSize freeMemory;
        -
        11914  {
        -
        11915  const uint32_t heapIndex = m_hAllocator->MemoryTypeIndexToHeapIndex(m_MemoryTypeIndex);
        -
        11916  VmaBudget heapBudget = {};
        -
        11917  m_hAllocator->GetBudget(&heapBudget, heapIndex, 1);
        -
        11918  freeMemory = (heapBudget.usage < heapBudget.budget) ? (heapBudget.budget - heapBudget.usage) : 0;
        -
        11919  }
        -
        11920 
        -
        11921  const bool canFallbackToDedicated = !IsCustomPool();
        -
        11922  const bool canCreateNewBlock =
        -
        11923  ((createInfo.flags & VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT) == 0) &&
        -
        11924  (m_Blocks.size() < m_MaxBlockCount) &&
        -
        11925  (freeMemory >= size || !canFallbackToDedicated);
        -
        11926  uint32_t strategy = createInfo.flags & VMA_ALLOCATION_CREATE_STRATEGY_MASK;
        -
        11927 
        -
        11928  // If linearAlgorithm is used, canMakeOtherLost is available only when used as ring buffer.
        -
        11929  // Which in turn is available only when maxBlockCount = 1.
        -
        11930  if(m_Algorithm == VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT && m_MaxBlockCount > 1)
        -
        11931  {
        -
        11932  canMakeOtherLost = false;
        -
        11933  }
        -
        11934 
        -
        11935  // Upper address can only be used with linear allocator and within single memory block.
        -
        11936  if(isUpperAddress &&
        -
        11937  (m_Algorithm != VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT || m_MaxBlockCount > 1))
        -
        11938  {
        -
        11939  return VK_ERROR_FEATURE_NOT_PRESENT;
        -
        11940  }
        -
        11941 
        -
        11942  // Validate strategy.
        -
        11943  switch(strategy)
        -
        11944  {
        -
        11945  case 0:
        -
        11946  strategy = VMA_ALLOCATION_CREATE_STRATEGY_BEST_FIT_BIT;
        -
        11947  break;
        -
        11948  case VMA_ALLOCATION_CREATE_STRATEGY_BEST_FIT_BIT:
        -
        11949  case VMA_ALLOCATION_CREATE_STRATEGY_WORST_FIT_BIT:
        -
        11950  case VMA_ALLOCATION_CREATE_STRATEGY_FIRST_FIT_BIT:
        -
        11951  break;
        -
        11952  default:
        -
        11953  return VK_ERROR_FEATURE_NOT_PRESENT;
        +
        11859  inoutInfo.blockCount += srcInfo.blockCount;
        +
        11860  inoutInfo.allocationCount += srcInfo.allocationCount;
        +
        11861  inoutInfo.unusedRangeCount += srcInfo.unusedRangeCount;
        +
        11862  inoutInfo.usedBytes += srcInfo.usedBytes;
        +
        11863  inoutInfo.unusedBytes += srcInfo.unusedBytes;
        +
        11864  inoutInfo.allocationSizeMin = VMA_MIN(inoutInfo.allocationSizeMin, srcInfo.allocationSizeMin);
        +
        11865  inoutInfo.allocationSizeMax = VMA_MAX(inoutInfo.allocationSizeMax, srcInfo.allocationSizeMax);
        +
        11866  inoutInfo.unusedRangeSizeMin = VMA_MIN(inoutInfo.unusedRangeSizeMin, srcInfo.unusedRangeSizeMin);
        +
        11867  inoutInfo.unusedRangeSizeMax = VMA_MAX(inoutInfo.unusedRangeSizeMax, srcInfo.unusedRangeSizeMax);
        +
        11868 }
        +
        11869 
        +
        11870 static void VmaPostprocessCalcStatInfo(VmaStatInfo& inoutInfo)
        +
        11871 {
        +
        11872  inoutInfo.allocationSizeAvg = (inoutInfo.allocationCount > 0) ?
        +
        11873  VmaRoundDiv<VkDeviceSize>(inoutInfo.usedBytes, inoutInfo.allocationCount) : 0;
        +
        11874  inoutInfo.unusedRangeSizeAvg = (inoutInfo.unusedRangeCount > 0) ?
        +
        11875  VmaRoundDiv<VkDeviceSize>(inoutInfo.unusedBytes, inoutInfo.unusedRangeCount) : 0;
        +
        11876 }
        +
        11877 
        +
        11878 VmaPool_T::VmaPool_T(
        +
        11879  VmaAllocator hAllocator,
        +
        11880  const VmaPoolCreateInfo& createInfo,
        +
        11881  VkDeviceSize preferredBlockSize) :
        +
        11882  m_BlockVector(
        +
        11883  hAllocator,
        +
        11884  this, // hParentPool
        +
        11885  createInfo.memoryTypeIndex,
        +
        11886  createInfo.blockSize != 0 ? createInfo.blockSize : preferredBlockSize,
        +
        11887  createInfo.minBlockCount,
        +
        11888  createInfo.maxBlockCount,
        +
        11889  (createInfo.flags & VMA_POOL_CREATE_IGNORE_BUFFER_IMAGE_GRANULARITY_BIT) != 0 ? 1 : hAllocator->GetBufferImageGranularity(),
        +
        11890  createInfo.frameInUseCount,
        +
        11891  createInfo.blockSize != 0, // explicitBlockSize
        +
        11892  createInfo.flags & VMA_POOL_CREATE_ALGORITHM_MASK), // algorithm
        +
        11893  m_Id(0),
        +
        11894  m_Name(VMA_NULL)
        +
        11895 {
        +
        11896 }
        +
        11897 
        +
        11898 VmaPool_T::~VmaPool_T()
        +
        11899 {
        +
        11900 }
        +
        11901 
        +
        11902 void VmaPool_T::SetName(const char* pName)
        +
        11903 {
        +
        11904  const VkAllocationCallbacks* allocs = m_BlockVector.GetAllocator()->GetAllocationCallbacks();
        +
        11905  VmaFreeString(allocs, m_Name);
        +
        11906 
        +
        11907  if(pName != VMA_NULL)
        +
        11908  {
        +
        11909  m_Name = VmaCreateStringCopy(allocs, pName);
        +
        11910  }
        +
        11911  else
        +
        11912  {
        +
        11913  m_Name = VMA_NULL;
        +
        11914  }
        +
        11915 }
        +
        11916 
        +
        11917 #if VMA_STATS_STRING_ENABLED
        +
        11918 
        +
        11919 #endif // #if VMA_STATS_STRING_ENABLED
        +
        11920 
        +
        11921 VmaBlockVector::VmaBlockVector(
        +
        11922  VmaAllocator hAllocator,
        +
        11923  VmaPool hParentPool,
        +
        11924  uint32_t memoryTypeIndex,
        +
        11925  VkDeviceSize preferredBlockSize,
        +
        11926  size_t minBlockCount,
        +
        11927  size_t maxBlockCount,
        +
        11928  VkDeviceSize bufferImageGranularity,
        +
        11929  uint32_t frameInUseCount,
        +
        11930  bool explicitBlockSize,
        +
        11931  uint32_t algorithm) :
        +
        11932  m_hAllocator(hAllocator),
        +
        11933  m_hParentPool(hParentPool),
        +
        11934  m_MemoryTypeIndex(memoryTypeIndex),
        +
        11935  m_PreferredBlockSize(preferredBlockSize),
        +
        11936  m_MinBlockCount(minBlockCount),
        +
        11937  m_MaxBlockCount(maxBlockCount),
        +
        11938  m_BufferImageGranularity(bufferImageGranularity),
        +
        11939  m_FrameInUseCount(frameInUseCount),
        +
        11940  m_ExplicitBlockSize(explicitBlockSize),
        +
        11941  m_Algorithm(algorithm),
        +
        11942  m_HasEmptyBlock(false),
        +
        11943  m_Blocks(VmaStlAllocator<VmaDeviceMemoryBlock*>(hAllocator->GetAllocationCallbacks())),
        +
        11944  m_NextBlockId(0)
        +
        11945 {
        +
        11946 }
        +
        11947 
        +
        11948 VmaBlockVector::~VmaBlockVector()
        +
        11949 {
        +
        11950  for(size_t i = m_Blocks.size(); i--; )
        +
        11951  {
        +
        11952  m_Blocks[i]->Destroy(m_hAllocator);
        +
        11953  vma_delete(m_hAllocator, m_Blocks[i]);
        11954  }
        -
        11955 
        -
        11956  // Early reject: requested allocation size is larger that maximum block size for this block vector.
        -
        11957  if(size + 2 * VMA_DEBUG_MARGIN > m_PreferredBlockSize)
        -
        11958  {
        -
        11959  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        -
        11960  }
        -
        11961 
        -
        11962  /*
        -
        11963  Under certain condition, this whole section can be skipped for optimization, so
        -
        11964  we move on directly to trying to allocate with canMakeOtherLost. That's the case
        -
        11965  e.g. for custom pools with linear algorithm.
        -
        11966  */
        -
        11967  if(!canMakeOtherLost || canCreateNewBlock)
        -
        11968  {
        -
        11969  // 1. Search existing allocations. Try to allocate without making other allocations lost.
        -
        11970  VmaAllocationCreateFlags allocFlagsCopy = createInfo.flags;
        -
        11971  allocFlagsCopy &= ~VMA_ALLOCATION_CREATE_CAN_MAKE_OTHER_LOST_BIT;
        -
        11972 
        -
        11973  if(m_Algorithm == VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT)
        -
        11974  {
        -
        11975  // Use only last block.
        -
        11976  if(!m_Blocks.empty())
        -
        11977  {
        -
        11978  VmaDeviceMemoryBlock* const pCurrBlock = m_Blocks.back();
        -
        11979  VMA_ASSERT(pCurrBlock);
        -
        11980  VkResult res = AllocateFromBlock(
        -
        11981  pCurrBlock,
        -
        11982  currentFrameIndex,
        -
        11983  size,
        -
        11984  alignment,
        -
        11985  allocFlagsCopy,
        -
        11986  createInfo.pUserData,
        -
        11987  suballocType,
        -
        11988  strategy,
        -
        11989  pAllocation);
        -
        11990  if(res == VK_SUCCESS)
        -
        11991  {
        -
        11992  VMA_DEBUG_LOG(" Returned from last block #%u", pCurrBlock->GetId());
        -
        11993  return VK_SUCCESS;
        -
        11994  }
        -
        11995  }
        -
        11996  }
        -
        11997  else
        -
        11998  {
        -
        11999  if(strategy == VMA_ALLOCATION_CREATE_STRATEGY_BEST_FIT_BIT)
        -
        12000  {
        -
        12001  // Forward order in m_Blocks - prefer blocks with smallest amount of free space.
        -
        12002  for(size_t blockIndex = 0; blockIndex < m_Blocks.size(); ++blockIndex )
        -
        12003  {
        -
        12004  VmaDeviceMemoryBlock* const pCurrBlock = m_Blocks[blockIndex];
        -
        12005  VMA_ASSERT(pCurrBlock);
        -
        12006  VkResult res = AllocateFromBlock(
        -
        12007  pCurrBlock,
        -
        12008  currentFrameIndex,
        -
        12009  size,
        -
        12010  alignment,
        -
        12011  allocFlagsCopy,
        -
        12012  createInfo.pUserData,
        -
        12013  suballocType,
        -
        12014  strategy,
        -
        12015  pAllocation);
        -
        12016  if(res == VK_SUCCESS)
        -
        12017  {
        -
        12018  VMA_DEBUG_LOG(" Returned from existing block #%u", pCurrBlock->GetId());
        -
        12019  return VK_SUCCESS;
        -
        12020  }
        -
        12021  }
        -
        12022  }
        -
        12023  else // WORST_FIT, FIRST_FIT
        -
        12024  {
        -
        12025  // Backward order in m_Blocks - prefer blocks with largest amount of free space.
        -
        12026  for(size_t blockIndex = m_Blocks.size(); blockIndex--; )
        -
        12027  {
        -
        12028  VmaDeviceMemoryBlock* const pCurrBlock = m_Blocks[blockIndex];
        -
        12029  VMA_ASSERT(pCurrBlock);
        -
        12030  VkResult res = AllocateFromBlock(
        -
        12031  pCurrBlock,
        -
        12032  currentFrameIndex,
        -
        12033  size,
        -
        12034  alignment,
        -
        12035  allocFlagsCopy,
        -
        12036  createInfo.pUserData,
        -
        12037  suballocType,
        -
        12038  strategy,
        -
        12039  pAllocation);
        -
        12040  if(res == VK_SUCCESS)
        -
        12041  {
        -
        12042  VMA_DEBUG_LOG(" Returned from existing block #%u", pCurrBlock->GetId());
        -
        12043  return VK_SUCCESS;
        -
        12044  }
        -
        12045  }
        -
        12046  }
        -
        12047  }
        -
        12048 
        -
        12049  // 2. Try to create new block.
        -
        12050  if(canCreateNewBlock)
        -
        12051  {
        -
        12052  // Calculate optimal size for new block.
        -
        12053  VkDeviceSize newBlockSize = m_PreferredBlockSize;
        -
        12054  uint32_t newBlockSizeShift = 0;
        -
        12055  const uint32_t NEW_BLOCK_SIZE_SHIFT_MAX = 3;
        -
        12056 
        -
        12057  if(!m_ExplicitBlockSize)
        -
        12058  {
        -
        12059  // Allocate 1/8, 1/4, 1/2 as first blocks.
        -
        12060  const VkDeviceSize maxExistingBlockSize = CalcMaxBlockSize();
        -
        12061  for(uint32_t i = 0; i < NEW_BLOCK_SIZE_SHIFT_MAX; ++i)
        -
        12062  {
        -
        12063  const VkDeviceSize smallerNewBlockSize = newBlockSize / 2;
        -
        12064  if(smallerNewBlockSize > maxExistingBlockSize && smallerNewBlockSize >= size * 2)
        -
        12065  {
        -
        12066  newBlockSize = smallerNewBlockSize;
        -
        12067  ++newBlockSizeShift;
        -
        12068  }
        -
        12069  else
        -
        12070  {
        -
        12071  break;
        -
        12072  }
        -
        12073  }
        -
        12074  }
        -
        12075 
        -
        12076  size_t newBlockIndex = 0;
        -
        12077  VkResult res = (newBlockSize <= freeMemory || !canFallbackToDedicated) ?
        -
        12078  CreateBlock(newBlockSize, &newBlockIndex) : VK_ERROR_OUT_OF_DEVICE_MEMORY;
        -
        12079  // Allocation of this size failed? Try 1/2, 1/4, 1/8 of m_PreferredBlockSize.
        -
        12080  if(!m_ExplicitBlockSize)
        -
        12081  {
        -
        12082  while(res < 0 && newBlockSizeShift < NEW_BLOCK_SIZE_SHIFT_MAX)
        -
        12083  {
        -
        12084  const VkDeviceSize smallerNewBlockSize = newBlockSize / 2;
        -
        12085  if(smallerNewBlockSize >= size)
        -
        12086  {
        -
        12087  newBlockSize = smallerNewBlockSize;
        -
        12088  ++newBlockSizeShift;
        -
        12089  res = (newBlockSize <= freeMemory || !canFallbackToDedicated) ?
        -
        12090  CreateBlock(newBlockSize, &newBlockIndex) : VK_ERROR_OUT_OF_DEVICE_MEMORY;
        -
        12091  }
        -
        12092  else
        -
        12093  {
        -
        12094  break;
        -
        12095  }
        -
        12096  }
        -
        12097  }
        -
        12098 
        -
        12099  if(res == VK_SUCCESS)
        -
        12100  {
        -
        12101  VmaDeviceMemoryBlock* const pBlock = m_Blocks[newBlockIndex];
        -
        12102  VMA_ASSERT(pBlock->m_pMetadata->GetSize() >= size);
        -
        12103 
        -
        12104  res = AllocateFromBlock(
        -
        12105  pBlock,
        -
        12106  currentFrameIndex,
        -
        12107  size,
        -
        12108  alignment,
        -
        12109  allocFlagsCopy,
        -
        12110  createInfo.pUserData,
        -
        12111  suballocType,
        -
        12112  strategy,
        -
        12113  pAllocation);
        -
        12114  if(res == VK_SUCCESS)
        -
        12115  {
        -
        12116  VMA_DEBUG_LOG(" Created new block #%u Size=%llu", pBlock->GetId(), newBlockSize);
        -
        12117  return VK_SUCCESS;
        -
        12118  }
        -
        12119  else
        -
        12120  {
        -
        12121  // Allocation from new block failed, possibly due to VMA_DEBUG_MARGIN or alignment.
        -
        12122  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        -
        12123  }
        -
        12124  }
        -
        12125  }
        -
        12126  }
        -
        12127 
        -
        12128  // 3. Try to allocate from existing blocks with making other allocations lost.
        -
        12129  if(canMakeOtherLost)
        -
        12130  {
        -
        12131  uint32_t tryIndex = 0;
        -
        12132  for(; tryIndex < VMA_ALLOCATION_TRY_COUNT; ++tryIndex)
        +
        11955 }
        +
        11956 
        +
        11957 VkResult VmaBlockVector::CreateMinBlocks()
        +
        11958 {
        +
        11959  for(size_t i = 0; i < m_MinBlockCount; ++i)
        +
        11960  {
        +
        11961  VkResult res = CreateBlock(m_PreferredBlockSize, VMA_NULL);
        +
        11962  if(res != VK_SUCCESS)
        +
        11963  {
        +
        11964  return res;
        +
        11965  }
        +
        11966  }
        +
        11967  return VK_SUCCESS;
        +
        11968 }
        +
        11969 
        +
        11970 void VmaBlockVector::GetPoolStats(VmaPoolStats* pStats)
        +
        11971 {
        +
        11972  VmaMutexLockRead lock(m_Mutex, m_hAllocator->m_UseMutex);
        +
        11973 
        +
        11974  const size_t blockCount = m_Blocks.size();
        +
        11975 
        +
        11976  pStats->size = 0;
        +
        11977  pStats->unusedSize = 0;
        +
        11978  pStats->allocationCount = 0;
        +
        11979  pStats->unusedRangeCount = 0;
        +
        11980  pStats->unusedRangeSizeMax = 0;
        +
        11981  pStats->blockCount = blockCount;
        +
        11982 
        +
        11983  for(uint32_t blockIndex = 0; blockIndex < blockCount; ++blockIndex)
        +
        11984  {
        +
        11985  const VmaDeviceMemoryBlock* const pBlock = m_Blocks[blockIndex];
        +
        11986  VMA_ASSERT(pBlock);
        +
        11987  VMA_HEAVY_ASSERT(pBlock->Validate());
        +
        11988  pBlock->m_pMetadata->AddPoolStats(*pStats);
        +
        11989  }
        +
        11990 }
        +
        11991 
        +
        11992 bool VmaBlockVector::IsEmpty()
        +
        11993 {
        +
        11994  VmaMutexLockRead lock(m_Mutex, m_hAllocator->m_UseMutex);
        +
        11995  return m_Blocks.empty();
        +
        11996 }
        +
        11997 
        +
        11998 bool VmaBlockVector::IsCorruptionDetectionEnabled() const
        +
        11999 {
        +
        12000  const uint32_t requiredMemFlags = VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT | VK_MEMORY_PROPERTY_HOST_COHERENT_BIT;
        +
        12001  return (VMA_DEBUG_DETECT_CORRUPTION != 0) &&
        +
        12002  (VMA_DEBUG_MARGIN > 0) &&
        +
        12003  (m_Algorithm == 0 || m_Algorithm == VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT) &&
        +
        12004  (m_hAllocator->m_MemProps.memoryTypes[m_MemoryTypeIndex].propertyFlags & requiredMemFlags) == requiredMemFlags;
        +
        12005 }
        +
        12006 
        +
        12007 static const uint32_t VMA_ALLOCATION_TRY_COUNT = 32;
        +
        12008 
        +
        12009 VkResult VmaBlockVector::Allocate(
        +
        12010  uint32_t currentFrameIndex,
        +
        12011  VkDeviceSize size,
        +
        12012  VkDeviceSize alignment,
        +
        12013  const VmaAllocationCreateInfo& createInfo,
        +
        12014  VmaSuballocationType suballocType,
        +
        12015  size_t allocationCount,
        +
        12016  VmaAllocation* pAllocations)
        +
        12017 {
        +
        12018  size_t allocIndex;
        +
        12019  VkResult res = VK_SUCCESS;
        +
        12020 
        +
        12021  if(IsCorruptionDetectionEnabled())
        +
        12022  {
        +
        12023  size = VmaAlignUp<VkDeviceSize>(size, sizeof(VMA_CORRUPTION_DETECTION_MAGIC_VALUE));
        +
        12024  alignment = VmaAlignUp<VkDeviceSize>(alignment, sizeof(VMA_CORRUPTION_DETECTION_MAGIC_VALUE));
        +
        12025  }
        +
        12026 
        +
        12027  {
        +
        12028  VmaMutexLockWrite lock(m_Mutex, m_hAllocator->m_UseMutex);
        +
        12029  for(allocIndex = 0; allocIndex < allocationCount; ++allocIndex)
        +
        12030  {
        +
        12031  res = AllocatePage(
        +
        12032  currentFrameIndex,
        +
        12033  size,
        +
        12034  alignment,
        +
        12035  createInfo,
        +
        12036  suballocType,
        +
        12037  pAllocations + allocIndex);
        +
        12038  if(res != VK_SUCCESS)
        +
        12039  {
        +
        12040  break;
        +
        12041  }
        +
        12042  }
        +
        12043  }
        +
        12044 
        +
        12045  if(res != VK_SUCCESS)
        +
        12046  {
        +
        12047  // Free all already created allocations.
        +
        12048  while(allocIndex--)
        +
        12049  {
        +
        12050  Free(pAllocations[allocIndex]);
        +
        12051  }
        +
        12052  memset(pAllocations, 0, sizeof(VmaAllocation) * allocationCount);
        +
        12053  }
        +
        12054 
        +
        12055  return res;
        +
        12056 }
        +
        12057 
        +
        12058 VkResult VmaBlockVector::AllocatePage(
        +
        12059  uint32_t currentFrameIndex,
        +
        12060  VkDeviceSize size,
        +
        12061  VkDeviceSize alignment,
        +
        12062  const VmaAllocationCreateInfo& createInfo,
        +
        12063  VmaSuballocationType suballocType,
        +
        12064  VmaAllocation* pAllocation)
        +
        12065 {
        +
        12066  const bool isUpperAddress = (createInfo.flags & VMA_ALLOCATION_CREATE_UPPER_ADDRESS_BIT) != 0;
        +
        12067  bool canMakeOtherLost = (createInfo.flags & VMA_ALLOCATION_CREATE_CAN_MAKE_OTHER_LOST_BIT) != 0;
        +
        12068  const bool mapped = (createInfo.flags & VMA_ALLOCATION_CREATE_MAPPED_BIT) != 0;
        +
        12069  const bool isUserDataString = (createInfo.flags & VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT) != 0;
        +
        12070 
        +
        12071  const bool withinBudget = (createInfo.flags & VMA_ALLOCATION_CREATE_WITHIN_BUDGET_BIT) != 0;
        +
        12072  VkDeviceSize freeMemory;
        +
        12073  {
        +
        12074  const uint32_t heapIndex = m_hAllocator->MemoryTypeIndexToHeapIndex(m_MemoryTypeIndex);
        +
        12075  VmaBudget heapBudget = {};
        +
        12076  m_hAllocator->GetBudget(&heapBudget, heapIndex, 1);
        +
        12077  freeMemory = (heapBudget.usage < heapBudget.budget) ? (heapBudget.budget - heapBudget.usage) : 0;
        +
        12078  }
        +
        12079 
        +
        12080  const bool canFallbackToDedicated = !IsCustomPool();
        +
        12081  const bool canCreateNewBlock =
        +
        12082  ((createInfo.flags & VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT) == 0) &&
        +
        12083  (m_Blocks.size() < m_MaxBlockCount) &&
        +
        12084  (freeMemory >= size || !canFallbackToDedicated);
        +
        12085  uint32_t strategy = createInfo.flags & VMA_ALLOCATION_CREATE_STRATEGY_MASK;
        +
        12086 
        +
        12087  // If linearAlgorithm is used, canMakeOtherLost is available only when used as ring buffer.
        +
        12088  // Which in turn is available only when maxBlockCount = 1.
        +
        12089  if(m_Algorithm == VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT && m_MaxBlockCount > 1)
        +
        12090  {
        +
        12091  canMakeOtherLost = false;
        +
        12092  }
        +
        12093 
        +
        12094  // Upper address can only be used with linear allocator and within single memory block.
        +
        12095  if(isUpperAddress &&
        +
        12096  (m_Algorithm != VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT || m_MaxBlockCount > 1))
        +
        12097  {
        +
        12098  return VK_ERROR_FEATURE_NOT_PRESENT;
        +
        12099  }
        +
        12100 
        +
        12101  // Validate strategy.
        +
        12102  switch(strategy)
        +
        12103  {
        +
        12104  case 0:
        +
        12105  strategy = VMA_ALLOCATION_CREATE_STRATEGY_BEST_FIT_BIT;
        +
        12106  break;
        +
        12107  case VMA_ALLOCATION_CREATE_STRATEGY_BEST_FIT_BIT:
        +
        12108  case VMA_ALLOCATION_CREATE_STRATEGY_WORST_FIT_BIT:
        +
        12109  case VMA_ALLOCATION_CREATE_STRATEGY_FIRST_FIT_BIT:
        +
        12110  break;
        +
        12111  default:
        +
        12112  return VK_ERROR_FEATURE_NOT_PRESENT;
        +
        12113  }
        +
        12114 
        +
        12115  // Early reject: requested allocation size is larger that maximum block size for this block vector.
        +
        12116  if(size + 2 * VMA_DEBUG_MARGIN > m_PreferredBlockSize)
        +
        12117  {
        +
        12118  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        +
        12119  }
        +
        12120 
        +
        12121  /*
        +
        12122  Under certain condition, this whole section can be skipped for optimization, so
        +
        12123  we move on directly to trying to allocate with canMakeOtherLost. That's the case
        +
        12124  e.g. for custom pools with linear algorithm.
        +
        12125  */
        +
        12126  if(!canMakeOtherLost || canCreateNewBlock)
        +
        12127  {
        +
        12128  // 1. Search existing allocations. Try to allocate without making other allocations lost.
        +
        12129  VmaAllocationCreateFlags allocFlagsCopy = createInfo.flags;
        +
        12130  allocFlagsCopy &= ~VMA_ALLOCATION_CREATE_CAN_MAKE_OTHER_LOST_BIT;
        +
        12131 
        +
        12132  if(m_Algorithm == VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT)
        12133  {
        -
        12134  VmaDeviceMemoryBlock* pBestRequestBlock = VMA_NULL;
        -
        12135  VmaAllocationRequest bestRequest = {};
        -
        12136  VkDeviceSize bestRequestCost = VK_WHOLE_SIZE;
        -
        12137 
        -
        12138  // 1. Search existing allocations.
        -
        12139  if(strategy == VMA_ALLOCATION_CREATE_STRATEGY_BEST_FIT_BIT)
        -
        12140  {
        -
        12141  // Forward order in m_Blocks - prefer blocks with smallest amount of free space.
        -
        12142  for(size_t blockIndex = 0; blockIndex < m_Blocks.size(); ++blockIndex )
        -
        12143  {
        -
        12144  VmaDeviceMemoryBlock* const pCurrBlock = m_Blocks[blockIndex];
        -
        12145  VMA_ASSERT(pCurrBlock);
        -
        12146  VmaAllocationRequest currRequest = {};
        -
        12147  if(pCurrBlock->m_pMetadata->CreateAllocationRequest(
        -
        12148  currentFrameIndex,
        -
        12149  m_FrameInUseCount,
        -
        12150  m_BufferImageGranularity,
        -
        12151  size,
        -
        12152  alignment,
        -
        12153  (createInfo.flags & VMA_ALLOCATION_CREATE_UPPER_ADDRESS_BIT) != 0,
        -
        12154  suballocType,
        -
        12155  canMakeOtherLost,
        -
        12156  strategy,
        -
        12157  &currRequest))
        -
        12158  {
        -
        12159  const VkDeviceSize currRequestCost = currRequest.CalcCost();
        -
        12160  if(pBestRequestBlock == VMA_NULL ||
        -
        12161  currRequestCost < bestRequestCost)
        -
        12162  {
        -
        12163  pBestRequestBlock = pCurrBlock;
        -
        12164  bestRequest = currRequest;
        -
        12165  bestRequestCost = currRequestCost;
        -
        12166 
        -
        12167  if(bestRequestCost == 0)
        -
        12168  {
        -
        12169  break;
        -
        12170  }
        -
        12171  }
        -
        12172  }
        -
        12173  }
        -
        12174  }
        -
        12175  else // WORST_FIT, FIRST_FIT
        -
        12176  {
        -
        12177  // Backward order in m_Blocks - prefer blocks with largest amount of free space.
        -
        12178  for(size_t blockIndex = m_Blocks.size(); blockIndex--; )
        -
        12179  {
        -
        12180  VmaDeviceMemoryBlock* const pCurrBlock = m_Blocks[blockIndex];
        -
        12181  VMA_ASSERT(pCurrBlock);
        -
        12182  VmaAllocationRequest currRequest = {};
        -
        12183  if(pCurrBlock->m_pMetadata->CreateAllocationRequest(
        -
        12184  currentFrameIndex,
        -
        12185  m_FrameInUseCount,
        -
        12186  m_BufferImageGranularity,
        -
        12187  size,
        -
        12188  alignment,
        -
        12189  (createInfo.flags & VMA_ALLOCATION_CREATE_UPPER_ADDRESS_BIT) != 0,
        -
        12190  suballocType,
        -
        12191  canMakeOtherLost,
        -
        12192  strategy,
        -
        12193  &currRequest))
        -
        12194  {
        -
        12195  const VkDeviceSize currRequestCost = currRequest.CalcCost();
        -
        12196  if(pBestRequestBlock == VMA_NULL ||
        -
        12197  currRequestCost < bestRequestCost ||
        -
        12198  strategy == VMA_ALLOCATION_CREATE_STRATEGY_FIRST_FIT_BIT)
        -
        12199  {
        -
        12200  pBestRequestBlock = pCurrBlock;
        -
        12201  bestRequest = currRequest;
        -
        12202  bestRequestCost = currRequestCost;
        -
        12203 
        -
        12204  if(bestRequestCost == 0 ||
        -
        12205  strategy == VMA_ALLOCATION_CREATE_STRATEGY_FIRST_FIT_BIT)
        -
        12206  {
        -
        12207  break;
        -
        12208  }
        -
        12209  }
        -
        12210  }
        -
        12211  }
        -
        12212  }
        -
        12213 
        -
        12214  if(pBestRequestBlock != VMA_NULL)
        -
        12215  {
        -
        12216  if(mapped)
        -
        12217  {
        -
        12218  VkResult res = pBestRequestBlock->Map(m_hAllocator, 1, VMA_NULL);
        -
        12219  if(res != VK_SUCCESS)
        -
        12220  {
        -
        12221  return res;
        -
        12222  }
        -
        12223  }
        -
        12224 
        -
        12225  if(pBestRequestBlock->m_pMetadata->MakeRequestedAllocationsLost(
        -
        12226  currentFrameIndex,
        -
        12227  m_FrameInUseCount,
        -
        12228  &bestRequest))
        -
        12229  {
        -
        12230  // Allocate from this pBlock.
        -
        12231  *pAllocation = m_hAllocator->m_AllocationObjectAllocator.Allocate();
        -
        12232  (*pAllocation)->Ctor(currentFrameIndex, isUserDataString);
        -
        12233  pBestRequestBlock->m_pMetadata->Alloc(bestRequest, suballocType, size, *pAllocation);
        -
        12234  UpdateHasEmptyBlock();
        -
        12235  (*pAllocation)->InitBlockAllocation(
        -
        12236  pBestRequestBlock,
        -
        12237  bestRequest.offset,
        -
        12238  alignment,
        -
        12239  size,
        -
        12240  m_MemoryTypeIndex,
        -
        12241  suballocType,
        -
        12242  mapped,
        -
        12243  (createInfo.flags & VMA_ALLOCATION_CREATE_CAN_BECOME_LOST_BIT) != 0);
        -
        12244  VMA_HEAVY_ASSERT(pBestRequestBlock->Validate());
        -
        12245  VMA_DEBUG_LOG(" Returned from existing block");
        -
        12246  (*pAllocation)->SetUserData(m_hAllocator, createInfo.pUserData);
        -
        12247  m_hAllocator->m_Budget.AddAllocation(m_hAllocator->MemoryTypeIndexToHeapIndex(m_MemoryTypeIndex), size);
        -
        12248  if(VMA_DEBUG_INITIALIZE_ALLOCATIONS)
        -
        12249  {
        -
        12250  m_hAllocator->FillAllocation(*pAllocation, VMA_ALLOCATION_FILL_PATTERN_CREATED);
        -
        12251  }
        -
        12252  if(IsCorruptionDetectionEnabled())
        -
        12253  {
        -
        12254  VkResult res = pBestRequestBlock->WriteMagicValueAroundAllocation(m_hAllocator, bestRequest.offset, size);
        -
        12255  VMA_ASSERT(res == VK_SUCCESS && "Couldn't map block memory to write magic value.");
        -
        12256  }
        -
        12257  return VK_SUCCESS;
        -
        12258  }
        -
        12259  // else: Some allocations must have been touched while we are here. Next try.
        -
        12260  }
        -
        12261  else
        -
        12262  {
        -
        12263  // Could not find place in any of the blocks - break outer loop.
        -
        12264  break;
        -
        12265  }
        -
        12266  }
        -
        12267  /* Maximum number of tries exceeded - a very unlike event when many other
        -
        12268  threads are simultaneously touching allocations making it impossible to make
        -
        12269  lost at the same time as we try to allocate. */
        -
        12270  if(tryIndex == VMA_ALLOCATION_TRY_COUNT)
        -
        12271  {
        -
        12272  return VK_ERROR_TOO_MANY_OBJECTS;
        -
        12273  }
        -
        12274  }
        -
        12275 
        -
        12276  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        -
        12277 }
        -
        12278 
        -
        12279 void VmaBlockVector::Free(
        -
        12280  const VmaAllocation hAllocation)
        -
        12281 {
        -
        12282  VmaDeviceMemoryBlock* pBlockToDelete = VMA_NULL;
        -
        12283 
        -
        12284  bool budgetExceeded = false;
        -
        12285  {
        -
        12286  const uint32_t heapIndex = m_hAllocator->MemoryTypeIndexToHeapIndex(m_MemoryTypeIndex);
        -
        12287  VmaBudget heapBudget = {};
        -
        12288  m_hAllocator->GetBudget(&heapBudget, heapIndex, 1);
        -
        12289  budgetExceeded = heapBudget.usage >= heapBudget.budget;
        -
        12290  }
        -
        12291 
        -
        12292  // Scope for lock.
        -
        12293  {
        -
        12294  VmaMutexLockWrite lock(m_Mutex, m_hAllocator->m_UseMutex);
        -
        12295 
        -
        12296  VmaDeviceMemoryBlock* pBlock = hAllocation->GetBlock();
        -
        12297 
        -
        12298  if(IsCorruptionDetectionEnabled())
        -
        12299  {
        -
        12300  VkResult res = pBlock->ValidateMagicValueAroundAllocation(m_hAllocator, hAllocation->GetOffset(), hAllocation->GetSize());
        -
        12301  VMA_ASSERT(res == VK_SUCCESS && "Couldn't map block memory to validate magic value.");
        -
        12302  }
        -
        12303 
        -
        12304  if(hAllocation->IsPersistentMap())
        -
        12305  {
        -
        12306  pBlock->Unmap(m_hAllocator, 1);
        -
        12307  }
        -
        12308 
        -
        12309  pBlock->m_pMetadata->Free(hAllocation);
        -
        12310  VMA_HEAVY_ASSERT(pBlock->Validate());
        -
        12311 
        -
        12312  VMA_DEBUG_LOG(" Freed from MemoryTypeIndex=%u", m_MemoryTypeIndex);
        -
        12313 
        -
        12314  const bool canDeleteBlock = m_Blocks.size() > m_MinBlockCount;
        -
        12315  // pBlock became empty after this deallocation.
        -
        12316  if(pBlock->m_pMetadata->IsEmpty())
        -
        12317  {
        -
        12318  // Already has empty block. We don't want to have two, so delete this one.
        -
        12319  if((m_HasEmptyBlock || budgetExceeded) && canDeleteBlock)
        -
        12320  {
        -
        12321  pBlockToDelete = pBlock;
        -
        12322  Remove(pBlock);
        -
        12323  }
        -
        12324  // else: We now have an empty block - leave it.
        -
        12325  }
        -
        12326  // pBlock didn't become empty, but we have another empty block - find and free that one.
        -
        12327  // (This is optional, heuristics.)
        -
        12328  else if(m_HasEmptyBlock && canDeleteBlock)
        -
        12329  {
        -
        12330  VmaDeviceMemoryBlock* pLastBlock = m_Blocks.back();
        -
        12331  if(pLastBlock->m_pMetadata->IsEmpty())
        -
        12332  {
        -
        12333  pBlockToDelete = pLastBlock;
        -
        12334  m_Blocks.pop_back();
        -
        12335  }
        -
        12336  }
        -
        12337 
        -
        12338  UpdateHasEmptyBlock();
        -
        12339  IncrementallySortBlocks();
        -
        12340  }
        -
        12341 
        -
        12342  // Destruction of a free block. Deferred until this point, outside of mutex
        -
        12343  // lock, for performance reason.
        -
        12344  if(pBlockToDelete != VMA_NULL)
        -
        12345  {
        -
        12346  VMA_DEBUG_LOG(" Deleted empty block");
        -
        12347  pBlockToDelete->Destroy(m_hAllocator);
        -
        12348  vma_delete(m_hAllocator, pBlockToDelete);
        -
        12349  }
        -
        12350 }
        -
        12351 
        -
        12352 VkDeviceSize VmaBlockVector::CalcMaxBlockSize() const
        -
        12353 {
        -
        12354  VkDeviceSize result = 0;
        -
        12355  for(size_t i = m_Blocks.size(); i--; )
        -
        12356  {
        -
        12357  result = VMA_MAX(result, m_Blocks[i]->m_pMetadata->GetSize());
        -
        12358  if(result >= m_PreferredBlockSize)
        -
        12359  {
        -
        12360  break;
        -
        12361  }
        -
        12362  }
        -
        12363  return result;
        -
        12364 }
        -
        12365 
        -
        12366 void VmaBlockVector::Remove(VmaDeviceMemoryBlock* pBlock)
        -
        12367 {
        -
        12368  for(uint32_t blockIndex = 0; blockIndex < m_Blocks.size(); ++blockIndex)
        -
        12369  {
        -
        12370  if(m_Blocks[blockIndex] == pBlock)
        -
        12371  {
        -
        12372  VmaVectorRemove(m_Blocks, blockIndex);
        -
        12373  return;
        -
        12374  }
        -
        12375  }
        -
        12376  VMA_ASSERT(0);
        -
        12377 }
        -
        12378 
        -
        12379 void VmaBlockVector::IncrementallySortBlocks()
        -
        12380 {
        -
        12381  if(m_Algorithm != VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT)
        -
        12382  {
        -
        12383  // Bubble sort only until first swap.
        -
        12384  for(size_t i = 1; i < m_Blocks.size(); ++i)
        -
        12385  {
        -
        12386  if(m_Blocks[i - 1]->m_pMetadata->GetSumFreeSize() > m_Blocks[i]->m_pMetadata->GetSumFreeSize())
        -
        12387  {
        -
        12388  VMA_SWAP(m_Blocks[i - 1], m_Blocks[i]);
        -
        12389  return;
        -
        12390  }
        -
        12391  }
        -
        12392  }
        -
        12393 }
        -
        12394 
        -
        12395 VkResult VmaBlockVector::AllocateFromBlock(
        -
        12396  VmaDeviceMemoryBlock* pBlock,
        -
        12397  uint32_t currentFrameIndex,
        -
        12398  VkDeviceSize size,
        -
        12399  VkDeviceSize alignment,
        -
        12400  VmaAllocationCreateFlags allocFlags,
        -
        12401  void* pUserData,
        -
        12402  VmaSuballocationType suballocType,
        -
        12403  uint32_t strategy,
        -
        12404  VmaAllocation* pAllocation)
        -
        12405 {
        -
        12406  VMA_ASSERT((allocFlags & VMA_ALLOCATION_CREATE_CAN_MAKE_OTHER_LOST_BIT) == 0);
        -
        12407  const bool isUpperAddress = (allocFlags & VMA_ALLOCATION_CREATE_UPPER_ADDRESS_BIT) != 0;
        -
        12408  const bool mapped = (allocFlags & VMA_ALLOCATION_CREATE_MAPPED_BIT) != 0;
        -
        12409  const bool isUserDataString = (allocFlags & VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT) != 0;
        -
        12410 
        -
        12411  VmaAllocationRequest currRequest = {};
        -
        12412  if(pBlock->m_pMetadata->CreateAllocationRequest(
        -
        12413  currentFrameIndex,
        -
        12414  m_FrameInUseCount,
        -
        12415  m_BufferImageGranularity,
        -
        12416  size,
        -
        12417  alignment,
        -
        12418  isUpperAddress,
        -
        12419  suballocType,
        -
        12420  false, // canMakeOtherLost
        -
        12421  strategy,
        -
        12422  &currRequest))
        -
        12423  {
        -
        12424  // Allocate from pCurrBlock.
        -
        12425  VMA_ASSERT(currRequest.itemsToMakeLostCount == 0);
        -
        12426 
        -
        12427  if(mapped)
        -
        12428  {
        -
        12429  VkResult res = pBlock->Map(m_hAllocator, 1, VMA_NULL);
        -
        12430  if(res != VK_SUCCESS)
        -
        12431  {
        -
        12432  return res;
        -
        12433  }
        -
        12434  }
        -
        12435 
        -
        12436  *pAllocation = m_hAllocator->m_AllocationObjectAllocator.Allocate();
        -
        12437  (*pAllocation)->Ctor(currentFrameIndex, isUserDataString);
        -
        12438  pBlock->m_pMetadata->Alloc(currRequest, suballocType, size, *pAllocation);
        -
        12439  UpdateHasEmptyBlock();
        -
        12440  (*pAllocation)->InitBlockAllocation(
        -
        12441  pBlock,
        -
        12442  currRequest.offset,
        -
        12443  alignment,
        -
        12444  size,
        -
        12445  m_MemoryTypeIndex,
        -
        12446  suballocType,
        -
        12447  mapped,
        -
        12448  (allocFlags & VMA_ALLOCATION_CREATE_CAN_BECOME_LOST_BIT) != 0);
        -
        12449  VMA_HEAVY_ASSERT(pBlock->Validate());
        -
        12450  (*pAllocation)->SetUserData(m_hAllocator, pUserData);
        -
        12451  m_hAllocator->m_Budget.AddAllocation(m_hAllocator->MemoryTypeIndexToHeapIndex(m_MemoryTypeIndex), size);
        -
        12452  if(VMA_DEBUG_INITIALIZE_ALLOCATIONS)
        -
        12453  {
        -
        12454  m_hAllocator->FillAllocation(*pAllocation, VMA_ALLOCATION_FILL_PATTERN_CREATED);
        -
        12455  }
        +
        12134  // Use only last block.
        +
        12135  if(!m_Blocks.empty())
        +
        12136  {
        +
        12137  VmaDeviceMemoryBlock* const pCurrBlock = m_Blocks.back();
        +
        12138  VMA_ASSERT(pCurrBlock);
        +
        12139  VkResult res = AllocateFromBlock(
        +
        12140  pCurrBlock,
        +
        12141  currentFrameIndex,
        +
        12142  size,
        +
        12143  alignment,
        +
        12144  allocFlagsCopy,
        +
        12145  createInfo.pUserData,
        +
        12146  suballocType,
        +
        12147  strategy,
        +
        12148  pAllocation);
        +
        12149  if(res == VK_SUCCESS)
        +
        12150  {
        +
        12151  VMA_DEBUG_LOG(" Returned from last block #%u", pCurrBlock->GetId());
        +
        12152  return VK_SUCCESS;
        +
        12153  }
        +
        12154  }
        +
        12155  }
        +
        12156  else
        +
        12157  {
        +
        12158  if(strategy == VMA_ALLOCATION_CREATE_STRATEGY_BEST_FIT_BIT)
        +
        12159  {
        +
        12160  // Forward order in m_Blocks - prefer blocks with smallest amount of free space.
        +
        12161  for(size_t blockIndex = 0; blockIndex < m_Blocks.size(); ++blockIndex )
        +
        12162  {
        +
        12163  VmaDeviceMemoryBlock* const pCurrBlock = m_Blocks[blockIndex];
        +
        12164  VMA_ASSERT(pCurrBlock);
        +
        12165  VkResult res = AllocateFromBlock(
        +
        12166  pCurrBlock,
        +
        12167  currentFrameIndex,
        +
        12168  size,
        +
        12169  alignment,
        +
        12170  allocFlagsCopy,
        +
        12171  createInfo.pUserData,
        +
        12172  suballocType,
        +
        12173  strategy,
        +
        12174  pAllocation);
        +
        12175  if(res == VK_SUCCESS)
        +
        12176  {
        +
        12177  VMA_DEBUG_LOG(" Returned from existing block #%u", pCurrBlock->GetId());
        +
        12178  return VK_SUCCESS;
        +
        12179  }
        +
        12180  }
        +
        12181  }
        +
        12182  else // WORST_FIT, FIRST_FIT
        +
        12183  {
        +
        12184  // Backward order in m_Blocks - prefer blocks with largest amount of free space.
        +
        12185  for(size_t blockIndex = m_Blocks.size(); blockIndex--; )
        +
        12186  {
        +
        12187  VmaDeviceMemoryBlock* const pCurrBlock = m_Blocks[blockIndex];
        +
        12188  VMA_ASSERT(pCurrBlock);
        +
        12189  VkResult res = AllocateFromBlock(
        +
        12190  pCurrBlock,
        +
        12191  currentFrameIndex,
        +
        12192  size,
        +
        12193  alignment,
        +
        12194  allocFlagsCopy,
        +
        12195  createInfo.pUserData,
        +
        12196  suballocType,
        +
        12197  strategy,
        +
        12198  pAllocation);
        +
        12199  if(res == VK_SUCCESS)
        +
        12200  {
        +
        12201  VMA_DEBUG_LOG(" Returned from existing block #%u", pCurrBlock->GetId());
        +
        12202  return VK_SUCCESS;
        +
        12203  }
        +
        12204  }
        +
        12205  }
        +
        12206  }
        +
        12207 
        +
        12208  // 2. Try to create new block.
        +
        12209  if(canCreateNewBlock)
        +
        12210  {
        +
        12211  // Calculate optimal size for new block.
        +
        12212  VkDeviceSize newBlockSize = m_PreferredBlockSize;
        +
        12213  uint32_t newBlockSizeShift = 0;
        +
        12214  const uint32_t NEW_BLOCK_SIZE_SHIFT_MAX = 3;
        +
        12215 
        +
        12216  if(!m_ExplicitBlockSize)
        +
        12217  {
        +
        12218  // Allocate 1/8, 1/4, 1/2 as first blocks.
        +
        12219  const VkDeviceSize maxExistingBlockSize = CalcMaxBlockSize();
        +
        12220  for(uint32_t i = 0; i < NEW_BLOCK_SIZE_SHIFT_MAX; ++i)
        +
        12221  {
        +
        12222  const VkDeviceSize smallerNewBlockSize = newBlockSize / 2;
        +
        12223  if(smallerNewBlockSize > maxExistingBlockSize && smallerNewBlockSize >= size * 2)
        +
        12224  {
        +
        12225  newBlockSize = smallerNewBlockSize;
        +
        12226  ++newBlockSizeShift;
        +
        12227  }
        +
        12228  else
        +
        12229  {
        +
        12230  break;
        +
        12231  }
        +
        12232  }
        +
        12233  }
        +
        12234 
        +
        12235  size_t newBlockIndex = 0;
        +
        12236  VkResult res = (newBlockSize <= freeMemory || !canFallbackToDedicated) ?
        +
        12237  CreateBlock(newBlockSize, &newBlockIndex) : VK_ERROR_OUT_OF_DEVICE_MEMORY;
        +
        12238  // Allocation of this size failed? Try 1/2, 1/4, 1/8 of m_PreferredBlockSize.
        +
        12239  if(!m_ExplicitBlockSize)
        +
        12240  {
        +
        12241  while(res < 0 && newBlockSizeShift < NEW_BLOCK_SIZE_SHIFT_MAX)
        +
        12242  {
        +
        12243  const VkDeviceSize smallerNewBlockSize = newBlockSize / 2;
        +
        12244  if(smallerNewBlockSize >= size)
        +
        12245  {
        +
        12246  newBlockSize = smallerNewBlockSize;
        +
        12247  ++newBlockSizeShift;
        +
        12248  res = (newBlockSize <= freeMemory || !canFallbackToDedicated) ?
        +
        12249  CreateBlock(newBlockSize, &newBlockIndex) : VK_ERROR_OUT_OF_DEVICE_MEMORY;
        +
        12250  }
        +
        12251  else
        +
        12252  {
        +
        12253  break;
        +
        12254  }
        +
        12255  }
        +
        12256  }
        +
        12257 
        +
        12258  if(res == VK_SUCCESS)
        +
        12259  {
        +
        12260  VmaDeviceMemoryBlock* const pBlock = m_Blocks[newBlockIndex];
        +
        12261  VMA_ASSERT(pBlock->m_pMetadata->GetSize() >= size);
        +
        12262 
        +
        12263  res = AllocateFromBlock(
        +
        12264  pBlock,
        +
        12265  currentFrameIndex,
        +
        12266  size,
        +
        12267  alignment,
        +
        12268  allocFlagsCopy,
        +
        12269  createInfo.pUserData,
        +
        12270  suballocType,
        +
        12271  strategy,
        +
        12272  pAllocation);
        +
        12273  if(res == VK_SUCCESS)
        +
        12274  {
        +
        12275  VMA_DEBUG_LOG(" Created new block #%u Size=%llu", pBlock->GetId(), newBlockSize);
        +
        12276  return VK_SUCCESS;
        +
        12277  }
        +
        12278  else
        +
        12279  {
        +
        12280  // Allocation from new block failed, possibly due to VMA_DEBUG_MARGIN or alignment.
        +
        12281  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        +
        12282  }
        +
        12283  }
        +
        12284  }
        +
        12285  }
        +
        12286 
        +
        12287  // 3. Try to allocate from existing blocks with making other allocations lost.
        +
        12288  if(canMakeOtherLost)
        +
        12289  {
        +
        12290  uint32_t tryIndex = 0;
        +
        12291  for(; tryIndex < VMA_ALLOCATION_TRY_COUNT; ++tryIndex)
        +
        12292  {
        +
        12293  VmaDeviceMemoryBlock* pBestRequestBlock = VMA_NULL;
        +
        12294  VmaAllocationRequest bestRequest = {};
        +
        12295  VkDeviceSize bestRequestCost = VK_WHOLE_SIZE;
        +
        12296 
        +
        12297  // 1. Search existing allocations.
        +
        12298  if(strategy == VMA_ALLOCATION_CREATE_STRATEGY_BEST_FIT_BIT)
        +
        12299  {
        +
        12300  // Forward order in m_Blocks - prefer blocks with smallest amount of free space.
        +
        12301  for(size_t blockIndex = 0; blockIndex < m_Blocks.size(); ++blockIndex )
        +
        12302  {
        +
        12303  VmaDeviceMemoryBlock* const pCurrBlock = m_Blocks[blockIndex];
        +
        12304  VMA_ASSERT(pCurrBlock);
        +
        12305  VmaAllocationRequest currRequest = {};
        +
        12306  if(pCurrBlock->m_pMetadata->CreateAllocationRequest(
        +
        12307  currentFrameIndex,
        +
        12308  m_FrameInUseCount,
        +
        12309  m_BufferImageGranularity,
        +
        12310  size,
        +
        12311  alignment,
        +
        12312  (createInfo.flags & VMA_ALLOCATION_CREATE_UPPER_ADDRESS_BIT) != 0,
        +
        12313  suballocType,
        +
        12314  canMakeOtherLost,
        +
        12315  strategy,
        +
        12316  &currRequest))
        +
        12317  {
        +
        12318  const VkDeviceSize currRequestCost = currRequest.CalcCost();
        +
        12319  if(pBestRequestBlock == VMA_NULL ||
        +
        12320  currRequestCost < bestRequestCost)
        +
        12321  {
        +
        12322  pBestRequestBlock = pCurrBlock;
        +
        12323  bestRequest = currRequest;
        +
        12324  bestRequestCost = currRequestCost;
        +
        12325 
        +
        12326  if(bestRequestCost == 0)
        +
        12327  {
        +
        12328  break;
        +
        12329  }
        +
        12330  }
        +
        12331  }
        +
        12332  }
        +
        12333  }
        +
        12334  else // WORST_FIT, FIRST_FIT
        +
        12335  {
        +
        12336  // Backward order in m_Blocks - prefer blocks with largest amount of free space.
        +
        12337  for(size_t blockIndex = m_Blocks.size(); blockIndex--; )
        +
        12338  {
        +
        12339  VmaDeviceMemoryBlock* const pCurrBlock = m_Blocks[blockIndex];
        +
        12340  VMA_ASSERT(pCurrBlock);
        +
        12341  VmaAllocationRequest currRequest = {};
        +
        12342  if(pCurrBlock->m_pMetadata->CreateAllocationRequest(
        +
        12343  currentFrameIndex,
        +
        12344  m_FrameInUseCount,
        +
        12345  m_BufferImageGranularity,
        +
        12346  size,
        +
        12347  alignment,
        +
        12348  (createInfo.flags & VMA_ALLOCATION_CREATE_UPPER_ADDRESS_BIT) != 0,
        +
        12349  suballocType,
        +
        12350  canMakeOtherLost,
        +
        12351  strategy,
        +
        12352  &currRequest))
        +
        12353  {
        +
        12354  const VkDeviceSize currRequestCost = currRequest.CalcCost();
        +
        12355  if(pBestRequestBlock == VMA_NULL ||
        +
        12356  currRequestCost < bestRequestCost ||
        +
        12357  strategy == VMA_ALLOCATION_CREATE_STRATEGY_FIRST_FIT_BIT)
        +
        12358  {
        +
        12359  pBestRequestBlock = pCurrBlock;
        +
        12360  bestRequest = currRequest;
        +
        12361  bestRequestCost = currRequestCost;
        +
        12362 
        +
        12363  if(bestRequestCost == 0 ||
        +
        12364  strategy == VMA_ALLOCATION_CREATE_STRATEGY_FIRST_FIT_BIT)
        +
        12365  {
        +
        12366  break;
        +
        12367  }
        +
        12368  }
        +
        12369  }
        +
        12370  }
        +
        12371  }
        +
        12372 
        +
        12373  if(pBestRequestBlock != VMA_NULL)
        +
        12374  {
        +
        12375  if(mapped)
        +
        12376  {
        +
        12377  VkResult res = pBestRequestBlock->Map(m_hAllocator, 1, VMA_NULL);
        +
        12378  if(res != VK_SUCCESS)
        +
        12379  {
        +
        12380  return res;
        +
        12381  }
        +
        12382  }
        +
        12383 
        +
        12384  if(pBestRequestBlock->m_pMetadata->MakeRequestedAllocationsLost(
        +
        12385  currentFrameIndex,
        +
        12386  m_FrameInUseCount,
        +
        12387  &bestRequest))
        +
        12388  {
        +
        12389  // Allocate from this pBlock.
        +
        12390  *pAllocation = m_hAllocator->m_AllocationObjectAllocator.Allocate(currentFrameIndex, isUserDataString);
        +
        12391  pBestRequestBlock->m_pMetadata->Alloc(bestRequest, suballocType, size, *pAllocation);
        +
        12392  UpdateHasEmptyBlock();
        +
        12393  (*pAllocation)->InitBlockAllocation(
        +
        12394  pBestRequestBlock,
        +
        12395  bestRequest.offset,
        +
        12396  alignment,
        +
        12397  size,
        +
        12398  m_MemoryTypeIndex,
        +
        12399  suballocType,
        +
        12400  mapped,
        +
        12401  (createInfo.flags & VMA_ALLOCATION_CREATE_CAN_BECOME_LOST_BIT) != 0);
        +
        12402  VMA_HEAVY_ASSERT(pBestRequestBlock->Validate());
        +
        12403  VMA_DEBUG_LOG(" Returned from existing block");
        +
        12404  (*pAllocation)->SetUserData(m_hAllocator, createInfo.pUserData);
        +
        12405  m_hAllocator->m_Budget.AddAllocation(m_hAllocator->MemoryTypeIndexToHeapIndex(m_MemoryTypeIndex), size);
        +
        12406  if(VMA_DEBUG_INITIALIZE_ALLOCATIONS)
        +
        12407  {
        +
        12408  m_hAllocator->FillAllocation(*pAllocation, VMA_ALLOCATION_FILL_PATTERN_CREATED);
        +
        12409  }
        +
        12410  if(IsCorruptionDetectionEnabled())
        +
        12411  {
        +
        12412  VkResult res = pBestRequestBlock->WriteMagicValueAroundAllocation(m_hAllocator, bestRequest.offset, size);
        +
        12413  VMA_ASSERT(res == VK_SUCCESS && "Couldn't map block memory to write magic value.");
        +
        12414  }
        +
        12415  return VK_SUCCESS;
        +
        12416  }
        +
        12417  // else: Some allocations must have been touched while we are here. Next try.
        +
        12418  }
        +
        12419  else
        +
        12420  {
        +
        12421  // Could not find place in any of the blocks - break outer loop.
        +
        12422  break;
        +
        12423  }
        +
        12424  }
        +
        12425  /* Maximum number of tries exceeded - a very unlike event when many other
        +
        12426  threads are simultaneously touching allocations making it impossible to make
        +
        12427  lost at the same time as we try to allocate. */
        +
        12428  if(tryIndex == VMA_ALLOCATION_TRY_COUNT)
        +
        12429  {
        +
        12430  return VK_ERROR_TOO_MANY_OBJECTS;
        +
        12431  }
        +
        12432  }
        +
        12433 
        +
        12434  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        +
        12435 }
        +
        12436 
        +
        12437 void VmaBlockVector::Free(
        +
        12438  const VmaAllocation hAllocation)
        +
        12439 {
        +
        12440  VmaDeviceMemoryBlock* pBlockToDelete = VMA_NULL;
        +
        12441 
        +
        12442  bool budgetExceeded = false;
        +
        12443  {
        +
        12444  const uint32_t heapIndex = m_hAllocator->MemoryTypeIndexToHeapIndex(m_MemoryTypeIndex);
        +
        12445  VmaBudget heapBudget = {};
        +
        12446  m_hAllocator->GetBudget(&heapBudget, heapIndex, 1);
        +
        12447  budgetExceeded = heapBudget.usage >= heapBudget.budget;
        +
        12448  }
        +
        12449 
        +
        12450  // Scope for lock.
        +
        12451  {
        +
        12452  VmaMutexLockWrite lock(m_Mutex, m_hAllocator->m_UseMutex);
        +
        12453 
        +
        12454  VmaDeviceMemoryBlock* pBlock = hAllocation->GetBlock();
        +
        12455 
        12456  if(IsCorruptionDetectionEnabled())
        12457  {
        -
        12458  VkResult res = pBlock->WriteMagicValueAroundAllocation(m_hAllocator, currRequest.offset, size);
        -
        12459  VMA_ASSERT(res == VK_SUCCESS && "Couldn't map block memory to write magic value.");
        +
        12458  VkResult res = pBlock->ValidateMagicValueAroundAllocation(m_hAllocator, hAllocation->GetOffset(), hAllocation->GetSize());
        +
        12459  VMA_ASSERT(res == VK_SUCCESS && "Couldn't map block memory to validate magic value.");
        12460  }
        -
        12461  return VK_SUCCESS;
        -
        12462  }
        -
        12463  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        -
        12464 }
        -
        12465 
        -
        12466 VkResult VmaBlockVector::CreateBlock(VkDeviceSize blockSize, size_t* pNewBlockIndex)
        -
        12467 {
        -
        12468  VkMemoryAllocateInfo allocInfo = { VK_STRUCTURE_TYPE_MEMORY_ALLOCATE_INFO };
        -
        12469  allocInfo.memoryTypeIndex = m_MemoryTypeIndex;
        -
        12470  allocInfo.allocationSize = blockSize;
        -
        12471  VkDeviceMemory mem = VK_NULL_HANDLE;
        -
        12472  VkResult res = m_hAllocator->AllocateVulkanMemory(&allocInfo, &mem);
        -
        12473  if(res < 0)
        -
        12474  {
        -
        12475  return res;
        -
        12476  }
        -
        12477 
        -
        12478  // New VkDeviceMemory successfully created.
        -
        12479 
        -
        12480  // Create new Allocation for it.
        -
        12481  VmaDeviceMemoryBlock* const pBlock = vma_new(m_hAllocator, VmaDeviceMemoryBlock)(m_hAllocator);
        -
        12482  pBlock->Init(
        -
        12483  m_hAllocator,
        -
        12484  m_hParentPool,
        -
        12485  m_MemoryTypeIndex,
        -
        12486  mem,
        -
        12487  allocInfo.allocationSize,
        -
        12488  m_NextBlockId++,
        -
        12489  m_Algorithm);
        -
        12490 
        -
        12491  m_Blocks.push_back(pBlock);
        -
        12492  if(pNewBlockIndex != VMA_NULL)
        -
        12493  {
        -
        12494  *pNewBlockIndex = m_Blocks.size() - 1;
        -
        12495  }
        -
        12496 
        -
        12497  return VK_SUCCESS;
        -
        12498 }
        +
        12461 
        +
        12462  if(hAllocation->IsPersistentMap())
        +
        12463  {
        +
        12464  pBlock->Unmap(m_hAllocator, 1);
        +
        12465  }
        +
        12466 
        +
        12467  pBlock->m_pMetadata->Free(hAllocation);
        +
        12468  VMA_HEAVY_ASSERT(pBlock->Validate());
        +
        12469 
        +
        12470  VMA_DEBUG_LOG(" Freed from MemoryTypeIndex=%u", m_MemoryTypeIndex);
        +
        12471 
        +
        12472  const bool canDeleteBlock = m_Blocks.size() > m_MinBlockCount;
        +
        12473  // pBlock became empty after this deallocation.
        +
        12474  if(pBlock->m_pMetadata->IsEmpty())
        +
        12475  {
        +
        12476  // Already has empty block. We don't want to have two, so delete this one.
        +
        12477  if((m_HasEmptyBlock || budgetExceeded) && canDeleteBlock)
        +
        12478  {
        +
        12479  pBlockToDelete = pBlock;
        +
        12480  Remove(pBlock);
        +
        12481  }
        +
        12482  // else: We now have an empty block - leave it.
        +
        12483  }
        +
        12484  // pBlock didn't become empty, but we have another empty block - find and free that one.
        +
        12485  // (This is optional, heuristics.)
        +
        12486  else if(m_HasEmptyBlock && canDeleteBlock)
        +
        12487  {
        +
        12488  VmaDeviceMemoryBlock* pLastBlock = m_Blocks.back();
        +
        12489  if(pLastBlock->m_pMetadata->IsEmpty())
        +
        12490  {
        +
        12491  pBlockToDelete = pLastBlock;
        +
        12492  m_Blocks.pop_back();
        +
        12493  }
        +
        12494  }
        +
        12495 
        +
        12496  UpdateHasEmptyBlock();
        +
        12497  IncrementallySortBlocks();
        +
        12498  }
        12499 
        -
        12500 void VmaBlockVector::ApplyDefragmentationMovesCpu(
        -
        12501  class VmaBlockVectorDefragmentationContext* pDefragCtx,
        -
        12502  const VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> >& moves)
        -
        12503 {
        -
        12504  const size_t blockCount = m_Blocks.size();
        -
        12505  const bool isNonCoherent = m_hAllocator->IsMemoryTypeNonCoherent(m_MemoryTypeIndex);
        -
        12506 
        -
        12507  enum BLOCK_FLAG
        -
        12508  {
        -
        12509  BLOCK_FLAG_USED = 0x00000001,
        -
        12510  BLOCK_FLAG_MAPPED_FOR_DEFRAGMENTATION = 0x00000002,
        -
        12511  };
        -
        12512 
        -
        12513  struct BlockInfo
        +
        12500  // Destruction of a free block. Deferred until this point, outside of mutex
        +
        12501  // lock, for performance reason.
        +
        12502  if(pBlockToDelete != VMA_NULL)
        +
        12503  {
        +
        12504  VMA_DEBUG_LOG(" Deleted empty block");
        +
        12505  pBlockToDelete->Destroy(m_hAllocator);
        +
        12506  vma_delete(m_hAllocator, pBlockToDelete);
        +
        12507  }
        +
        12508 }
        +
        12509 
        +
        12510 VkDeviceSize VmaBlockVector::CalcMaxBlockSize() const
        +
        12511 {
        +
        12512  VkDeviceSize result = 0;
        +
        12513  for(size_t i = m_Blocks.size(); i--; )
        12514  {
        -
        12515  uint32_t flags;
        -
        12516  void* pMappedData;
        -
        12517  };
        -
        12518  VmaVector< BlockInfo, VmaStlAllocator<BlockInfo> >
        -
        12519  blockInfo(blockCount, BlockInfo(), VmaStlAllocator<BlockInfo>(m_hAllocator->GetAllocationCallbacks()));
        -
        12520  memset(blockInfo.data(), 0, blockCount * sizeof(BlockInfo));
        -
        12521 
        -
        12522  // Go over all moves. Mark blocks that are used with BLOCK_FLAG_USED.
        -
        12523  const size_t moveCount = moves.size();
        -
        12524  for(size_t moveIndex = 0; moveIndex < moveCount; ++moveIndex)
        -
        12525  {
        -
        12526  const VmaDefragmentationMove& move = moves[moveIndex];
        -
        12527  blockInfo[move.srcBlockIndex].flags |= BLOCK_FLAG_USED;
        -
        12528  blockInfo[move.dstBlockIndex].flags |= BLOCK_FLAG_USED;
        -
        12529  }
        -
        12530 
        -
        12531  VMA_ASSERT(pDefragCtx->res == VK_SUCCESS);
        -
        12532 
        -
        12533  // Go over all blocks. Get mapped pointer or map if necessary.
        -
        12534  for(size_t blockIndex = 0; pDefragCtx->res == VK_SUCCESS && blockIndex < blockCount; ++blockIndex)
        -
        12535  {
        -
        12536  BlockInfo& currBlockInfo = blockInfo[blockIndex];
        -
        12537  VmaDeviceMemoryBlock* pBlock = m_Blocks[blockIndex];
        -
        12538  if((currBlockInfo.flags & BLOCK_FLAG_USED) != 0)
        -
        12539  {
        -
        12540  currBlockInfo.pMappedData = pBlock->GetMappedData();
        -
        12541  // It is not originally mapped - map it.
        -
        12542  if(currBlockInfo.pMappedData == VMA_NULL)
        -
        12543  {
        -
        12544  pDefragCtx->res = pBlock->Map(m_hAllocator, 1, &currBlockInfo.pMappedData);
        -
        12545  if(pDefragCtx->res == VK_SUCCESS)
        -
        12546  {
        -
        12547  currBlockInfo.flags |= BLOCK_FLAG_MAPPED_FOR_DEFRAGMENTATION;
        -
        12548  }
        -
        12549  }
        -
        12550  }
        -
        12551  }
        +
        12515  result = VMA_MAX(result, m_Blocks[i]->m_pMetadata->GetSize());
        +
        12516  if(result >= m_PreferredBlockSize)
        +
        12517  {
        +
        12518  break;
        +
        12519  }
        +
        12520  }
        +
        12521  return result;
        +
        12522 }
        +
        12523 
        +
        12524 void VmaBlockVector::Remove(VmaDeviceMemoryBlock* pBlock)
        +
        12525 {
        +
        12526  for(uint32_t blockIndex = 0; blockIndex < m_Blocks.size(); ++blockIndex)
        +
        12527  {
        +
        12528  if(m_Blocks[blockIndex] == pBlock)
        +
        12529  {
        +
        12530  VmaVectorRemove(m_Blocks, blockIndex);
        +
        12531  return;
        +
        12532  }
        +
        12533  }
        +
        12534  VMA_ASSERT(0);
        +
        12535 }
        +
        12536 
        +
        12537 void VmaBlockVector::IncrementallySortBlocks()
        +
        12538 {
        +
        12539  if(m_Algorithm != VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT)
        +
        12540  {
        +
        12541  // Bubble sort only until first swap.
        +
        12542  for(size_t i = 1; i < m_Blocks.size(); ++i)
        +
        12543  {
        +
        12544  if(m_Blocks[i - 1]->m_pMetadata->GetSumFreeSize() > m_Blocks[i]->m_pMetadata->GetSumFreeSize())
        +
        12545  {
        +
        12546  VMA_SWAP(m_Blocks[i - 1], m_Blocks[i]);
        +
        12547  return;
        +
        12548  }
        +
        12549  }
        +
        12550  }
        +
        12551 }
        12552 
        -
        12553  // Go over all moves. Do actual data transfer.
        -
        12554  if(pDefragCtx->res == VK_SUCCESS)
        -
        12555  {
        -
        12556  const VkDeviceSize nonCoherentAtomSize = m_hAllocator->m_PhysicalDeviceProperties.limits.nonCoherentAtomSize;
        -
        12557  VkMappedMemoryRange memRange = { VK_STRUCTURE_TYPE_MAPPED_MEMORY_RANGE };
        -
        12558 
        -
        12559  for(size_t moveIndex = 0; moveIndex < moveCount; ++moveIndex)
        -
        12560  {
        -
        12561  const VmaDefragmentationMove& move = moves[moveIndex];
        -
        12562 
        -
        12563  const BlockInfo& srcBlockInfo = blockInfo[move.srcBlockIndex];
        -
        12564  const BlockInfo& dstBlockInfo = blockInfo[move.dstBlockIndex];
        -
        12565 
        -
        12566  VMA_ASSERT(srcBlockInfo.pMappedData && dstBlockInfo.pMappedData);
        -
        12567 
        -
        12568  // Invalidate source.
        -
        12569  if(isNonCoherent)
        -
        12570  {
        -
        12571  VmaDeviceMemoryBlock* const pSrcBlock = m_Blocks[move.srcBlockIndex];
        -
        12572  memRange.memory = pSrcBlock->GetDeviceMemory();
        -
        12573  memRange.offset = VmaAlignDown(move.srcOffset, nonCoherentAtomSize);
        -
        12574  memRange.size = VMA_MIN(
        -
        12575  VmaAlignUp(move.size + (move.srcOffset - memRange.offset), nonCoherentAtomSize),
        -
        12576  pSrcBlock->m_pMetadata->GetSize() - memRange.offset);
        -
        12577  (*m_hAllocator->GetVulkanFunctions().vkInvalidateMappedMemoryRanges)(m_hAllocator->m_hDevice, 1, &memRange);
        -
        12578  }
        -
        12579 
        -
        12580  // THE PLACE WHERE ACTUAL DATA COPY HAPPENS.
        -
        12581  memmove(
        -
        12582  reinterpret_cast<char*>(dstBlockInfo.pMappedData) + move.dstOffset,
        -
        12583  reinterpret_cast<char*>(srcBlockInfo.pMappedData) + move.srcOffset,
        -
        12584  static_cast<size_t>(move.size));
        -
        12585 
        -
        12586  if(IsCorruptionDetectionEnabled())
        -
        12587  {
        -
        12588  VmaWriteMagicValue(dstBlockInfo.pMappedData, move.dstOffset - VMA_DEBUG_MARGIN);
        -
        12589  VmaWriteMagicValue(dstBlockInfo.pMappedData, move.dstOffset + move.size);
        -
        12590  }
        -
        12591 
        -
        12592  // Flush destination.
        -
        12593  if(isNonCoherent)
        -
        12594  {
        -
        12595  VmaDeviceMemoryBlock* const pDstBlock = m_Blocks[move.dstBlockIndex];
        -
        12596  memRange.memory = pDstBlock->GetDeviceMemory();
        -
        12597  memRange.offset = VmaAlignDown(move.dstOffset, nonCoherentAtomSize);
        -
        12598  memRange.size = VMA_MIN(
        -
        12599  VmaAlignUp(move.size + (move.dstOffset - memRange.offset), nonCoherentAtomSize),
        -
        12600  pDstBlock->m_pMetadata->GetSize() - memRange.offset);
        -
        12601  (*m_hAllocator->GetVulkanFunctions().vkFlushMappedMemoryRanges)(m_hAllocator->m_hDevice, 1, &memRange);
        -
        12602  }
        -
        12603  }
        -
        12604  }
        -
        12605 
        -
        12606  // Go over all blocks in reverse order. Unmap those that were mapped just for defragmentation.
        -
        12607  // Regardless of pCtx->res == VK_SUCCESS.
        -
        12608  for(size_t blockIndex = blockCount; blockIndex--; )
        -
        12609  {
        -
        12610  const BlockInfo& currBlockInfo = blockInfo[blockIndex];
        -
        12611  if((currBlockInfo.flags & BLOCK_FLAG_MAPPED_FOR_DEFRAGMENTATION) != 0)
        -
        12612  {
        -
        12613  VmaDeviceMemoryBlock* pBlock = m_Blocks[blockIndex];
        -
        12614  pBlock->Unmap(m_hAllocator, 1);
        -
        12615  }
        -
        12616  }
        -
        12617 }
        -
        12618 
        -
        12619 void VmaBlockVector::ApplyDefragmentationMovesGpu(
        -
        12620  class VmaBlockVectorDefragmentationContext* pDefragCtx,
        -
        12621  const VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> >& moves,
        -
        12622  VkCommandBuffer commandBuffer)
        -
        12623 {
        -
        12624  const size_t blockCount = m_Blocks.size();
        -
        12625 
        -
        12626  pDefragCtx->blockContexts.resize(blockCount);
        -
        12627  memset(pDefragCtx->blockContexts.data(), 0, blockCount * sizeof(VmaBlockDefragmentationContext));
        -
        12628 
        -
        12629  // Go over all moves. Mark blocks that are used with BLOCK_FLAG_USED.
        -
        12630  const size_t moveCount = moves.size();
        -
        12631  for(size_t moveIndex = 0; moveIndex < moveCount; ++moveIndex)
        -
        12632  {
        -
        12633  const VmaDefragmentationMove& move = moves[moveIndex];
        -
        12634  pDefragCtx->blockContexts[move.srcBlockIndex].flags |= VmaBlockDefragmentationContext::BLOCK_FLAG_USED;
        -
        12635  pDefragCtx->blockContexts[move.dstBlockIndex].flags |= VmaBlockDefragmentationContext::BLOCK_FLAG_USED;
        -
        12636  }
        -
        12637 
        -
        12638  VMA_ASSERT(pDefragCtx->res == VK_SUCCESS);
        -
        12639 
        -
        12640  // Go over all blocks. Create and bind buffer for whole block if necessary.
        -
        12641  {
        -
        12642  VkBufferCreateInfo bufCreateInfo;
        -
        12643  VmaFillGpuDefragmentationBufferCreateInfo(bufCreateInfo);
        -
        12644 
        -
        12645  for(size_t blockIndex = 0; pDefragCtx->res == VK_SUCCESS && blockIndex < blockCount; ++blockIndex)
        -
        12646  {
        -
        12647  VmaBlockDefragmentationContext& currBlockCtx = pDefragCtx->blockContexts[blockIndex];
        -
        12648  VmaDeviceMemoryBlock* pBlock = m_Blocks[blockIndex];
        -
        12649  if((currBlockCtx.flags & VmaBlockDefragmentationContext::BLOCK_FLAG_USED) != 0)
        -
        12650  {
        -
        12651  bufCreateInfo.size = pBlock->m_pMetadata->GetSize();
        -
        12652  pDefragCtx->res = (*m_hAllocator->GetVulkanFunctions().vkCreateBuffer)(
        -
        12653  m_hAllocator->m_hDevice, &bufCreateInfo, m_hAllocator->GetAllocationCallbacks(), &currBlockCtx.hBuffer);
        -
        12654  if(pDefragCtx->res == VK_SUCCESS)
        -
        12655  {
        -
        12656  pDefragCtx->res = (*m_hAllocator->GetVulkanFunctions().vkBindBufferMemory)(
        -
        12657  m_hAllocator->m_hDevice, currBlockCtx.hBuffer, pBlock->GetDeviceMemory(), 0);
        -
        12658  }
        -
        12659  }
        -
        12660  }
        -
        12661  }
        -
        12662 
        -
        12663  // Go over all moves. Post data transfer commands to command buffer.
        -
        12664  if(pDefragCtx->res == VK_SUCCESS)
        +
        12553 VkResult VmaBlockVector::AllocateFromBlock(
        +
        12554  VmaDeviceMemoryBlock* pBlock,
        +
        12555  uint32_t currentFrameIndex,
        +
        12556  VkDeviceSize size,
        +
        12557  VkDeviceSize alignment,
        +
        12558  VmaAllocationCreateFlags allocFlags,
        +
        12559  void* pUserData,
        +
        12560  VmaSuballocationType suballocType,
        +
        12561  uint32_t strategy,
        +
        12562  VmaAllocation* pAllocation)
        +
        12563 {
        +
        12564  VMA_ASSERT((allocFlags & VMA_ALLOCATION_CREATE_CAN_MAKE_OTHER_LOST_BIT) == 0);
        +
        12565  const bool isUpperAddress = (allocFlags & VMA_ALLOCATION_CREATE_UPPER_ADDRESS_BIT) != 0;
        +
        12566  const bool mapped = (allocFlags & VMA_ALLOCATION_CREATE_MAPPED_BIT) != 0;
        +
        12567  const bool isUserDataString = (allocFlags & VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT) != 0;
        +
        12568 
        +
        12569  VmaAllocationRequest currRequest = {};
        +
        12570  if(pBlock->m_pMetadata->CreateAllocationRequest(
        +
        12571  currentFrameIndex,
        +
        12572  m_FrameInUseCount,
        +
        12573  m_BufferImageGranularity,
        +
        12574  size,
        +
        12575  alignment,
        +
        12576  isUpperAddress,
        +
        12577  suballocType,
        +
        12578  false, // canMakeOtherLost
        +
        12579  strategy,
        +
        12580  &currRequest))
        +
        12581  {
        +
        12582  // Allocate from pCurrBlock.
        +
        12583  VMA_ASSERT(currRequest.itemsToMakeLostCount == 0);
        +
        12584 
        +
        12585  if(mapped)
        +
        12586  {
        +
        12587  VkResult res = pBlock->Map(m_hAllocator, 1, VMA_NULL);
        +
        12588  if(res != VK_SUCCESS)
        +
        12589  {
        +
        12590  return res;
        +
        12591  }
        +
        12592  }
        +
        12593 
        +
        12594  *pAllocation = m_hAllocator->m_AllocationObjectAllocator.Allocate(currentFrameIndex, isUserDataString);
        +
        12595  pBlock->m_pMetadata->Alloc(currRequest, suballocType, size, *pAllocation);
        +
        12596  UpdateHasEmptyBlock();
        +
        12597  (*pAllocation)->InitBlockAllocation(
        +
        12598  pBlock,
        +
        12599  currRequest.offset,
        +
        12600  alignment,
        +
        12601  size,
        +
        12602  m_MemoryTypeIndex,
        +
        12603  suballocType,
        +
        12604  mapped,
        +
        12605  (allocFlags & VMA_ALLOCATION_CREATE_CAN_BECOME_LOST_BIT) != 0);
        +
        12606  VMA_HEAVY_ASSERT(pBlock->Validate());
        +
        12607  (*pAllocation)->SetUserData(m_hAllocator, pUserData);
        +
        12608  m_hAllocator->m_Budget.AddAllocation(m_hAllocator->MemoryTypeIndexToHeapIndex(m_MemoryTypeIndex), size);
        +
        12609  if(VMA_DEBUG_INITIALIZE_ALLOCATIONS)
        +
        12610  {
        +
        12611  m_hAllocator->FillAllocation(*pAllocation, VMA_ALLOCATION_FILL_PATTERN_CREATED);
        +
        12612  }
        +
        12613  if(IsCorruptionDetectionEnabled())
        +
        12614  {
        +
        12615  VkResult res = pBlock->WriteMagicValueAroundAllocation(m_hAllocator, currRequest.offset, size);
        +
        12616  VMA_ASSERT(res == VK_SUCCESS && "Couldn't map block memory to write magic value.");
        +
        12617  }
        +
        12618  return VK_SUCCESS;
        +
        12619  }
        +
        12620  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        +
        12621 }
        +
        12622 
        +
        12623 VkResult VmaBlockVector::CreateBlock(VkDeviceSize blockSize, size_t* pNewBlockIndex)
        +
        12624 {
        +
        12625  VkMemoryAllocateInfo allocInfo = { VK_STRUCTURE_TYPE_MEMORY_ALLOCATE_INFO };
        +
        12626  allocInfo.memoryTypeIndex = m_MemoryTypeIndex;
        +
        12627  allocInfo.allocationSize = blockSize;
        +
        12628  VkDeviceMemory mem = VK_NULL_HANDLE;
        +
        12629  VkResult res = m_hAllocator->AllocateVulkanMemory(&allocInfo, &mem);
        +
        12630  if(res < 0)
        +
        12631  {
        +
        12632  return res;
        +
        12633  }
        +
        12634 
        +
        12635  // New VkDeviceMemory successfully created.
        +
        12636 
        +
        12637  // Create new Allocation for it.
        +
        12638  VmaDeviceMemoryBlock* const pBlock = vma_new(m_hAllocator, VmaDeviceMemoryBlock)(m_hAllocator);
        +
        12639  pBlock->Init(
        +
        12640  m_hAllocator,
        +
        12641  m_hParentPool,
        +
        12642  m_MemoryTypeIndex,
        +
        12643  mem,
        +
        12644  allocInfo.allocationSize,
        +
        12645  m_NextBlockId++,
        +
        12646  m_Algorithm);
        +
        12647 
        +
        12648  m_Blocks.push_back(pBlock);
        +
        12649  if(pNewBlockIndex != VMA_NULL)
        +
        12650  {
        +
        12651  *pNewBlockIndex = m_Blocks.size() - 1;
        +
        12652  }
        +
        12653 
        +
        12654  return VK_SUCCESS;
        +
        12655 }
        +
        12656 
        +
        12657 void VmaBlockVector::ApplyDefragmentationMovesCpu(
        +
        12658  class VmaBlockVectorDefragmentationContext* pDefragCtx,
        +
        12659  const VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> >& moves)
        +
        12660 {
        +
        12661  const size_t blockCount = m_Blocks.size();
        +
        12662  const bool isNonCoherent = m_hAllocator->IsMemoryTypeNonCoherent(m_MemoryTypeIndex);
        +
        12663 
        +
        12664  enum BLOCK_FLAG
        12665  {
        -
        12666  for(size_t moveIndex = 0; moveIndex < moveCount; ++moveIndex)
        -
        12667  {
        -
        12668  const VmaDefragmentationMove& move = moves[moveIndex];
        +
        12666  BLOCK_FLAG_USED = 0x00000001,
        +
        12667  BLOCK_FLAG_MAPPED_FOR_DEFRAGMENTATION = 0x00000002,
        +
        12668  };
        12669 
        -
        12670  const VmaBlockDefragmentationContext& srcBlockCtx = pDefragCtx->blockContexts[move.srcBlockIndex];
        -
        12671  const VmaBlockDefragmentationContext& dstBlockCtx = pDefragCtx->blockContexts[move.dstBlockIndex];
        -
        12672 
        -
        12673  VMA_ASSERT(srcBlockCtx.hBuffer && dstBlockCtx.hBuffer);
        -
        12674 
        -
        12675  VkBufferCopy region = {
        -
        12676  move.srcOffset,
        -
        12677  move.dstOffset,
        -
        12678  move.size };
        -
        12679  (*m_hAllocator->GetVulkanFunctions().vkCmdCopyBuffer)(
        -
        12680  commandBuffer, srcBlockCtx.hBuffer, dstBlockCtx.hBuffer, 1, &region);
        -
        12681  }
        -
        12682  }
        -
        12683 
        -
        12684  // Save buffers to defrag context for later destruction.
        -
        12685  if(pDefragCtx->res == VK_SUCCESS && moveCount > 0)
        -
        12686  {
        -
        12687  pDefragCtx->res = VK_NOT_READY;
        -
        12688  }
        -
        12689 }
        -
        12690 
        -
        12691 void VmaBlockVector::FreeEmptyBlocks(VmaDefragmentationStats* pDefragmentationStats)
        -
        12692 {
        -
        12693  for(size_t blockIndex = m_Blocks.size(); blockIndex--; )
        -
        12694  {
        -
        12695  VmaDeviceMemoryBlock* pBlock = m_Blocks[blockIndex];
        -
        12696  if(pBlock->m_pMetadata->IsEmpty())
        -
        12697  {
        -
        12698  if(m_Blocks.size() > m_MinBlockCount)
        -
        12699  {
        -
        12700  if(pDefragmentationStats != VMA_NULL)
        -
        12701  {
        -
        12702  ++pDefragmentationStats->deviceMemoryBlocksFreed;
        -
        12703  pDefragmentationStats->bytesFreed += pBlock->m_pMetadata->GetSize();
        -
        12704  }
        -
        12705 
        -
        12706  VmaVectorRemove(m_Blocks, blockIndex);
        -
        12707  pBlock->Destroy(m_hAllocator);
        -
        12708  vma_delete(m_hAllocator, pBlock);
        -
        12709  }
        -
        12710  else
        -
        12711  {
        -
        12712  break;
        -
        12713  }
        -
        12714  }
        -
        12715  }
        -
        12716  UpdateHasEmptyBlock();
        -
        12717 }
        -
        12718 
        -
        12719 void VmaBlockVector::UpdateHasEmptyBlock()
        -
        12720 {
        -
        12721  m_HasEmptyBlock = false;
        -
        12722  for(size_t index = 0, count = m_Blocks.size(); index < count; ++index)
        -
        12723  {
        -
        12724  VmaDeviceMemoryBlock* const pBlock = m_Blocks[index];
        -
        12725  if(pBlock->m_pMetadata->IsEmpty())
        -
        12726  {
        -
        12727  m_HasEmptyBlock = true;
        -
        12728  break;
        -
        12729  }
        -
        12730  }
        -
        12731 }
        -
        12732 
        -
        12733 #if VMA_STATS_STRING_ENABLED
        -
        12734 
        -
        12735 void VmaBlockVector::PrintDetailedMap(class VmaJsonWriter& json)
        -
        12736 {
        -
        12737  VmaMutexLockRead lock(m_Mutex, m_hAllocator->m_UseMutex);
        -
        12738 
        -
        12739  json.BeginObject();
        -
        12740 
        -
        12741  if(IsCustomPool())
        -
        12742  {
        -
        12743  const char* poolName = m_hParentPool->GetName();
        -
        12744  if(poolName != VMA_NULL && poolName[0] != '\0')
        -
        12745  {
        -
        12746  json.WriteString("Name");
        -
        12747  json.WriteString(poolName);
        -
        12748  }
        -
        12749 
        -
        12750  json.WriteString("MemoryTypeIndex");
        -
        12751  json.WriteNumber(m_MemoryTypeIndex);
        -
        12752 
        -
        12753  json.WriteString("BlockSize");
        -
        12754  json.WriteNumber(m_PreferredBlockSize);
        -
        12755 
        -
        12756  json.WriteString("BlockCount");
        -
        12757  json.BeginObject(true);
        -
        12758  if(m_MinBlockCount > 0)
        -
        12759  {
        -
        12760  json.WriteString("Min");
        -
        12761  json.WriteNumber((uint64_t)m_MinBlockCount);
        -
        12762  }
        -
        12763  if(m_MaxBlockCount < SIZE_MAX)
        -
        12764  {
        -
        12765  json.WriteString("Max");
        -
        12766  json.WriteNumber((uint64_t)m_MaxBlockCount);
        -
        12767  }
        -
        12768  json.WriteString("Cur");
        -
        12769  json.WriteNumber((uint64_t)m_Blocks.size());
        -
        12770  json.EndObject();
        -
        12771 
        -
        12772  if(m_FrameInUseCount > 0)
        -
        12773  {
        -
        12774  json.WriteString("FrameInUseCount");
        -
        12775  json.WriteNumber(m_FrameInUseCount);
        -
        12776  }
        -
        12777 
        -
        12778  if(m_Algorithm != 0)
        -
        12779  {
        -
        12780  json.WriteString("Algorithm");
        -
        12781  json.WriteString(VmaAlgorithmToStr(m_Algorithm));
        -
        12782  }
        -
        12783  }
        -
        12784  else
        -
        12785  {
        -
        12786  json.WriteString("PreferredBlockSize");
        -
        12787  json.WriteNumber(m_PreferredBlockSize);
        -
        12788  }
        -
        12789 
        -
        12790  json.WriteString("Blocks");
        -
        12791  json.BeginObject();
        -
        12792  for(size_t i = 0; i < m_Blocks.size(); ++i)
        -
        12793  {
        -
        12794  json.BeginString();
        -
        12795  json.ContinueString(m_Blocks[i]->GetId());
        -
        12796  json.EndString();
        -
        12797 
        -
        12798  m_Blocks[i]->m_pMetadata->PrintDetailedMap(json);
        -
        12799  }
        -
        12800  json.EndObject();
        +
        12670  struct BlockInfo
        +
        12671  {
        +
        12672  uint32_t flags;
        +
        12673  void* pMappedData;
        +
        12674  };
        +
        12675  VmaVector< BlockInfo, VmaStlAllocator<BlockInfo> >
        +
        12676  blockInfo(blockCount, BlockInfo(), VmaStlAllocator<BlockInfo>(m_hAllocator->GetAllocationCallbacks()));
        +
        12677  memset(blockInfo.data(), 0, blockCount * sizeof(BlockInfo));
        +
        12678 
        +
        12679  // Go over all moves. Mark blocks that are used with BLOCK_FLAG_USED.
        +
        12680  const size_t moveCount = moves.size();
        +
        12681  for(size_t moveIndex = 0; moveIndex < moveCount; ++moveIndex)
        +
        12682  {
        +
        12683  const VmaDefragmentationMove& move = moves[moveIndex];
        +
        12684  blockInfo[move.srcBlockIndex].flags |= BLOCK_FLAG_USED;
        +
        12685  blockInfo[move.dstBlockIndex].flags |= BLOCK_FLAG_USED;
        +
        12686  }
        +
        12687 
        +
        12688  VMA_ASSERT(pDefragCtx->res == VK_SUCCESS);
        +
        12689 
        +
        12690  // Go over all blocks. Get mapped pointer or map if necessary.
        +
        12691  for(size_t blockIndex = 0; pDefragCtx->res == VK_SUCCESS && blockIndex < blockCount; ++blockIndex)
        +
        12692  {
        +
        12693  BlockInfo& currBlockInfo = blockInfo[blockIndex];
        +
        12694  VmaDeviceMemoryBlock* pBlock = m_Blocks[blockIndex];
        +
        12695  if((currBlockInfo.flags & BLOCK_FLAG_USED) != 0)
        +
        12696  {
        +
        12697  currBlockInfo.pMappedData = pBlock->GetMappedData();
        +
        12698  // It is not originally mapped - map it.
        +
        12699  if(currBlockInfo.pMappedData == VMA_NULL)
        +
        12700  {
        +
        12701  pDefragCtx->res = pBlock->Map(m_hAllocator, 1, &currBlockInfo.pMappedData);
        +
        12702  if(pDefragCtx->res == VK_SUCCESS)
        +
        12703  {
        +
        12704  currBlockInfo.flags |= BLOCK_FLAG_MAPPED_FOR_DEFRAGMENTATION;
        +
        12705  }
        +
        12706  }
        +
        12707  }
        +
        12708  }
        +
        12709 
        +
        12710  // Go over all moves. Do actual data transfer.
        +
        12711  if(pDefragCtx->res == VK_SUCCESS)
        +
        12712  {
        +
        12713  const VkDeviceSize nonCoherentAtomSize = m_hAllocator->m_PhysicalDeviceProperties.limits.nonCoherentAtomSize;
        +
        12714  VkMappedMemoryRange memRange = { VK_STRUCTURE_TYPE_MAPPED_MEMORY_RANGE };
        +
        12715 
        +
        12716  for(size_t moveIndex = 0; moveIndex < moveCount; ++moveIndex)
        +
        12717  {
        +
        12718  const VmaDefragmentationMove& move = moves[moveIndex];
        +
        12719 
        +
        12720  const BlockInfo& srcBlockInfo = blockInfo[move.srcBlockIndex];
        +
        12721  const BlockInfo& dstBlockInfo = blockInfo[move.dstBlockIndex];
        +
        12722 
        +
        12723  VMA_ASSERT(srcBlockInfo.pMappedData && dstBlockInfo.pMappedData);
        +
        12724 
        +
        12725  // Invalidate source.
        +
        12726  if(isNonCoherent)
        +
        12727  {
        +
        12728  VmaDeviceMemoryBlock* const pSrcBlock = m_Blocks[move.srcBlockIndex];
        +
        12729  memRange.memory = pSrcBlock->GetDeviceMemory();
        +
        12730  memRange.offset = VmaAlignDown(move.srcOffset, nonCoherentAtomSize);
        +
        12731  memRange.size = VMA_MIN(
        +
        12732  VmaAlignUp(move.size + (move.srcOffset - memRange.offset), nonCoherentAtomSize),
        +
        12733  pSrcBlock->m_pMetadata->GetSize() - memRange.offset);
        +
        12734  (*m_hAllocator->GetVulkanFunctions().vkInvalidateMappedMemoryRanges)(m_hAllocator->m_hDevice, 1, &memRange);
        +
        12735  }
        +
        12736 
        +
        12737  // THE PLACE WHERE ACTUAL DATA COPY HAPPENS.
        +
        12738  memmove(
        +
        12739  reinterpret_cast<char*>(dstBlockInfo.pMappedData) + move.dstOffset,
        +
        12740  reinterpret_cast<char*>(srcBlockInfo.pMappedData) + move.srcOffset,
        +
        12741  static_cast<size_t>(move.size));
        +
        12742 
        +
        12743  if(IsCorruptionDetectionEnabled())
        +
        12744  {
        +
        12745  VmaWriteMagicValue(dstBlockInfo.pMappedData, move.dstOffset - VMA_DEBUG_MARGIN);
        +
        12746  VmaWriteMagicValue(dstBlockInfo.pMappedData, move.dstOffset + move.size);
        +
        12747  }
        +
        12748 
        +
        12749  // Flush destination.
        +
        12750  if(isNonCoherent)
        +
        12751  {
        +
        12752  VmaDeviceMemoryBlock* const pDstBlock = m_Blocks[move.dstBlockIndex];
        +
        12753  memRange.memory = pDstBlock->GetDeviceMemory();
        +
        12754  memRange.offset = VmaAlignDown(move.dstOffset, nonCoherentAtomSize);
        +
        12755  memRange.size = VMA_MIN(
        +
        12756  VmaAlignUp(move.size + (move.dstOffset - memRange.offset), nonCoherentAtomSize),
        +
        12757  pDstBlock->m_pMetadata->GetSize() - memRange.offset);
        +
        12758  (*m_hAllocator->GetVulkanFunctions().vkFlushMappedMemoryRanges)(m_hAllocator->m_hDevice, 1, &memRange);
        +
        12759  }
        +
        12760  }
        +
        12761  }
        +
        12762 
        +
        12763  // Go over all blocks in reverse order. Unmap those that were mapped just for defragmentation.
        +
        12764  // Regardless of pCtx->res == VK_SUCCESS.
        +
        12765  for(size_t blockIndex = blockCount; blockIndex--; )
        +
        12766  {
        +
        12767  const BlockInfo& currBlockInfo = blockInfo[blockIndex];
        +
        12768  if((currBlockInfo.flags & BLOCK_FLAG_MAPPED_FOR_DEFRAGMENTATION) != 0)
        +
        12769  {
        +
        12770  VmaDeviceMemoryBlock* pBlock = m_Blocks[blockIndex];
        +
        12771  pBlock->Unmap(m_hAllocator, 1);
        +
        12772  }
        +
        12773  }
        +
        12774 }
        +
        12775 
        +
        12776 void VmaBlockVector::ApplyDefragmentationMovesGpu(
        +
        12777  class VmaBlockVectorDefragmentationContext* pDefragCtx,
        +
        12778  VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> >& moves,
        +
        12779  VkCommandBuffer commandBuffer)
        +
        12780 {
        +
        12781  const size_t blockCount = m_Blocks.size();
        +
        12782 
        +
        12783  pDefragCtx->blockContexts.resize(blockCount);
        +
        12784  memset(pDefragCtx->blockContexts.data(), 0, blockCount * sizeof(VmaBlockDefragmentationContext));
        +
        12785 
        +
        12786  // Go over all moves. Mark blocks that are used with BLOCK_FLAG_USED.
        +
        12787  const size_t moveCount = moves.size();
        +
        12788  for(size_t moveIndex = 0; moveIndex < moveCount; ++moveIndex)
        +
        12789  {
        +
        12790  const VmaDefragmentationMove& move = moves[moveIndex];
        +
        12791 
        +
        12792  //if(move.type == VMA_ALLOCATION_TYPE_UNKNOWN)
        +
        12793  {
        +
        12794  // Old school move still require us to map the whole block
        +
        12795  pDefragCtx->blockContexts[move.srcBlockIndex].flags |= VmaBlockDefragmentationContext::BLOCK_FLAG_USED;
        +
        12796  pDefragCtx->blockContexts[move.dstBlockIndex].flags |= VmaBlockDefragmentationContext::BLOCK_FLAG_USED;
        +
        12797  }
        +
        12798  }
        +
        12799 
        +
        12800  VMA_ASSERT(pDefragCtx->res == VK_SUCCESS);
        12801 
        -
        12802  json.EndObject();
        -
        12803 }
        -
        12804 
        -
        12805 #endif // #if VMA_STATS_STRING_ENABLED
        +
        12802  // Go over all blocks. Create and bind buffer for whole block if necessary.
        +
        12803  {
        +
        12804  VkBufferCreateInfo bufCreateInfo;
        +
        12805  VmaFillGpuDefragmentationBufferCreateInfo(bufCreateInfo);
        12806 
        -
        12807 void VmaBlockVector::Defragment(
        -
        12808  class VmaBlockVectorDefragmentationContext* pCtx,
        -
        12809  VmaDefragmentationStats* pStats,
        -
        12810  VkDeviceSize& maxCpuBytesToMove, uint32_t& maxCpuAllocationsToMove,
        -
        12811  VkDeviceSize& maxGpuBytesToMove, uint32_t& maxGpuAllocationsToMove,
        -
        12812  VkCommandBuffer commandBuffer)
        -
        12813 {
        -
        12814  pCtx->res = VK_SUCCESS;
        -
        12815 
        -
        12816  const VkMemoryPropertyFlags memPropFlags =
        -
        12817  m_hAllocator->m_MemProps.memoryTypes[m_MemoryTypeIndex].propertyFlags;
        -
        12818  const bool isHostVisible = (memPropFlags & VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT) != 0;
        -
        12819 
        -
        12820  const bool canDefragmentOnCpu = maxCpuBytesToMove > 0 && maxCpuAllocationsToMove > 0 &&
        -
        12821  isHostVisible;
        -
        12822  const bool canDefragmentOnGpu = maxGpuBytesToMove > 0 && maxGpuAllocationsToMove > 0 &&
        -
        12823  !IsCorruptionDetectionEnabled() &&
        -
        12824  ((1u << m_MemoryTypeIndex) & m_hAllocator->GetGpuDefragmentationMemoryTypeBits()) != 0;
        -
        12825 
        -
        12826  // There are options to defragment this memory type.
        -
        12827  if(canDefragmentOnCpu || canDefragmentOnGpu)
        -
        12828  {
        -
        12829  bool defragmentOnGpu;
        -
        12830  // There is only one option to defragment this memory type.
        -
        12831  if(canDefragmentOnGpu != canDefragmentOnCpu)
        -
        12832  {
        -
        12833  defragmentOnGpu = canDefragmentOnGpu;
        -
        12834  }
        -
        12835  // Both options are available: Heuristics to choose the best one.
        -
        12836  else
        -
        12837  {
        -
        12838  defragmentOnGpu = (memPropFlags & VK_MEMORY_PROPERTY_DEVICE_LOCAL_BIT) != 0 ||
        -
        12839  m_hAllocator->IsIntegratedGpu();
        -
        12840  }
        -
        12841 
        -
        12842  bool overlappingMoveSupported = !defragmentOnGpu;
        -
        12843 
        -
        12844  if(m_hAllocator->m_UseMutex)
        -
        12845  {
        -
        12846  m_Mutex.LockWrite();
        -
        12847  pCtx->mutexLocked = true;
        -
        12848  }
        -
        12849 
        -
        12850  pCtx->Begin(overlappingMoveSupported);
        -
        12851 
        -
        12852  // Defragment.
        -
        12853 
        -
        12854  const VkDeviceSize maxBytesToMove = defragmentOnGpu ? maxGpuBytesToMove : maxCpuBytesToMove;
        -
        12855  const uint32_t maxAllocationsToMove = defragmentOnGpu ? maxGpuAllocationsToMove : maxCpuAllocationsToMove;
        -
        12856  VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> > moves =
        -
        12857  VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> >(VmaStlAllocator<VmaDefragmentationMove>(m_hAllocator->GetAllocationCallbacks()));
        -
        12858  pCtx->res = pCtx->GetAlgorithm()->Defragment(moves, maxBytesToMove, maxAllocationsToMove);
        -
        12859 
        -
        12860  // Accumulate statistics.
        -
        12861  if(pStats != VMA_NULL)
        -
        12862  {
        -
        12863  const VkDeviceSize bytesMoved = pCtx->GetAlgorithm()->GetBytesMoved();
        -
        12864  const uint32_t allocationsMoved = pCtx->GetAlgorithm()->GetAllocationsMoved();
        -
        12865  pStats->bytesMoved += bytesMoved;
        -
        12866  pStats->allocationsMoved += allocationsMoved;
        -
        12867  VMA_ASSERT(bytesMoved <= maxBytesToMove);
        -
        12868  VMA_ASSERT(allocationsMoved <= maxAllocationsToMove);
        -
        12869  if(defragmentOnGpu)
        -
        12870  {
        -
        12871  maxGpuBytesToMove -= bytesMoved;
        -
        12872  maxGpuAllocationsToMove -= allocationsMoved;
        -
        12873  }
        -
        12874  else
        -
        12875  {
        -
        12876  maxCpuBytesToMove -= bytesMoved;
        -
        12877  maxCpuAllocationsToMove -= allocationsMoved;
        -
        12878  }
        -
        12879  }
        -
        12880 
        -
        12881  if(pCtx->res >= VK_SUCCESS)
        -
        12882  {
        -
        12883  if(defragmentOnGpu)
        -
        12884  {
        -
        12885  ApplyDefragmentationMovesGpu(pCtx, moves, commandBuffer);
        -
        12886  }
        -
        12887  else
        -
        12888  {
        -
        12889  ApplyDefragmentationMovesCpu(pCtx, moves);
        -
        12890  }
        +
        12807  for(size_t blockIndex = 0; pDefragCtx->res == VK_SUCCESS && blockIndex < blockCount; ++blockIndex)
        +
        12808  {
        +
        12809  VmaBlockDefragmentationContext& currBlockCtx = pDefragCtx->blockContexts[blockIndex];
        +
        12810  VmaDeviceMemoryBlock* pBlock = m_Blocks[blockIndex];
        +
        12811  if((currBlockCtx.flags & VmaBlockDefragmentationContext::BLOCK_FLAG_USED) != 0)
        +
        12812  {
        +
        12813  bufCreateInfo.size = pBlock->m_pMetadata->GetSize();
        +
        12814  pDefragCtx->res = (*m_hAllocator->GetVulkanFunctions().vkCreateBuffer)(
        +
        12815  m_hAllocator->m_hDevice, &bufCreateInfo, m_hAllocator->GetAllocationCallbacks(), &currBlockCtx.hBuffer);
        +
        12816  if(pDefragCtx->res == VK_SUCCESS)
        +
        12817  {
        +
        12818  pDefragCtx->res = (*m_hAllocator->GetVulkanFunctions().vkBindBufferMemory)(
        +
        12819  m_hAllocator->m_hDevice, currBlockCtx.hBuffer, pBlock->GetDeviceMemory(), 0);
        +
        12820  }
        +
        12821  }
        +
        12822  }
        +
        12823  }
        +
        12824 
        +
        12825  // Go over all moves. Post data transfer commands to command buffer.
        +
        12826  if(pDefragCtx->res == VK_SUCCESS)
        +
        12827  {
        +
        12828  for(size_t moveIndex = 0; moveIndex < moveCount; ++moveIndex)
        +
        12829  {
        +
        12830  const VmaDefragmentationMove& move = moves[moveIndex];
        +
        12831 
        +
        12832  const VmaBlockDefragmentationContext& srcBlockCtx = pDefragCtx->blockContexts[move.srcBlockIndex];
        +
        12833  const VmaBlockDefragmentationContext& dstBlockCtx = pDefragCtx->blockContexts[move.dstBlockIndex];
        +
        12834 
        +
        12835  VMA_ASSERT(srcBlockCtx.hBuffer && dstBlockCtx.hBuffer);
        +
        12836 
        +
        12837  VkBufferCopy region = {
        +
        12838  move.srcOffset,
        +
        12839  move.dstOffset,
        +
        12840  move.size };
        +
        12841  (*m_hAllocator->GetVulkanFunctions().vkCmdCopyBuffer)(
        +
        12842  commandBuffer, srcBlockCtx.hBuffer, dstBlockCtx.hBuffer, 1, &region);
        +
        12843  }
        +
        12844  }
        +
        12845 
        +
        12846  // Save buffers to defrag context for later destruction.
        +
        12847  if(pDefragCtx->res == VK_SUCCESS && moveCount > 0)
        +
        12848  {
        +
        12849  pDefragCtx->res = VK_NOT_READY;
        +
        12850  }
        +
        12851 }
        +
        12852 
        +
        12853 void VmaBlockVector::FreeEmptyBlocks(VmaDefragmentationStats* pDefragmentationStats)
        +
        12854 {
        +
        12855  for(size_t blockIndex = m_Blocks.size(); blockIndex--; )
        +
        12856  {
        +
        12857  VmaDeviceMemoryBlock* pBlock = m_Blocks[blockIndex];
        +
        12858  if(pBlock->m_pMetadata->IsEmpty())
        +
        12859  {
        +
        12860  if(m_Blocks.size() > m_MinBlockCount)
        +
        12861  {
        +
        12862  if(pDefragmentationStats != VMA_NULL)
        +
        12863  {
        +
        12864  ++pDefragmentationStats->deviceMemoryBlocksFreed;
        +
        12865  pDefragmentationStats->bytesFreed += pBlock->m_pMetadata->GetSize();
        +
        12866  }
        +
        12867 
        +
        12868  VmaVectorRemove(m_Blocks, blockIndex);
        +
        12869  pBlock->Destroy(m_hAllocator);
        +
        12870  vma_delete(m_hAllocator, pBlock);
        +
        12871  }
        +
        12872  else
        +
        12873  {
        +
        12874  break;
        +
        12875  }
        +
        12876  }
        +
        12877  }
        +
        12878  UpdateHasEmptyBlock();
        +
        12879 }
        +
        12880 
        +
        12881 void VmaBlockVector::UpdateHasEmptyBlock()
        +
        12882 {
        +
        12883  m_HasEmptyBlock = false;
        +
        12884  for(size_t index = 0, count = m_Blocks.size(); index < count; ++index)
        +
        12885  {
        +
        12886  VmaDeviceMemoryBlock* const pBlock = m_Blocks[index];
        +
        12887  if(pBlock->m_pMetadata->IsEmpty())
        +
        12888  {
        +
        12889  m_HasEmptyBlock = true;
        +
        12890  break;
        12891  }
        12892  }
        12893 }
        12894 
        -
        12895 void VmaBlockVector::DefragmentationEnd(
        -
        12896  class VmaBlockVectorDefragmentationContext* pCtx,
        -
        12897  VmaDefragmentationStats* pStats)
        +
        12895 #if VMA_STATS_STRING_ENABLED
        +
        12896 
        +
        12897 void VmaBlockVector::PrintDetailedMap(class VmaJsonWriter& json)
        12898 {
        -
        12899  // Destroy buffers.
        -
        12900  for(size_t blockIndex = pCtx->blockContexts.size(); blockIndex--; )
        -
        12901  {
        -
        12902  VmaBlockDefragmentationContext& blockCtx = pCtx->blockContexts[blockIndex];
        -
        12903  if(blockCtx.hBuffer)
        -
        12904  {
        -
        12905  (*m_hAllocator->GetVulkanFunctions().vkDestroyBuffer)(
        -
        12906  m_hAllocator->m_hDevice, blockCtx.hBuffer, m_hAllocator->GetAllocationCallbacks());
        -
        12907  }
        -
        12908  }
        -
        12909 
        -
        12910  if(pCtx->res >= VK_SUCCESS)
        -
        12911  {
        -
        12912  FreeEmptyBlocks(pStats);
        -
        12913  }
        +
        12899  VmaMutexLockRead lock(m_Mutex, m_hAllocator->m_UseMutex);
        +
        12900 
        +
        12901  json.BeginObject();
        +
        12902 
        +
        12903  if(IsCustomPool())
        +
        12904  {
        +
        12905  const char* poolName = m_hParentPool->GetName();
        +
        12906  if(poolName != VMA_NULL && poolName[0] != '\0')
        +
        12907  {
        +
        12908  json.WriteString("Name");
        +
        12909  json.WriteString(poolName);
        +
        12910  }
        +
        12911 
        +
        12912  json.WriteString("MemoryTypeIndex");
        +
        12913  json.WriteNumber(m_MemoryTypeIndex);
        12914 
        -
        12915  if(pCtx->mutexLocked)
        -
        12916  {
        -
        12917  VMA_ASSERT(m_hAllocator->m_UseMutex);
        -
        12918  m_Mutex.UnlockWrite();
        -
        12919  }
        -
        12920 }
        -
        12921 
        -
        12922 size_t VmaBlockVector::CalcAllocationCount() const
        -
        12923 {
        -
        12924  size_t result = 0;
        -
        12925  for(size_t i = 0; i < m_Blocks.size(); ++i)
        -
        12926  {
        -
        12927  result += m_Blocks[i]->m_pMetadata->GetAllocationCount();
        -
        12928  }
        -
        12929  return result;
        -
        12930 }
        -
        12931 
        -
        12932 bool VmaBlockVector::IsBufferImageGranularityConflictPossible() const
        -
        12933 {
        -
        12934  if(m_BufferImageGranularity == 1)
        -
        12935  {
        -
        12936  return false;
        -
        12937  }
        -
        12938  VmaSuballocationType lastSuballocType = VMA_SUBALLOCATION_TYPE_FREE;
        -
        12939  for(size_t i = 0, count = m_Blocks.size(); i < count; ++i)
        -
        12940  {
        -
        12941  VmaDeviceMemoryBlock* const pBlock = m_Blocks[i];
        -
        12942  VMA_ASSERT(m_Algorithm == 0);
        -
        12943  VmaBlockMetadata_Generic* const pMetadata = (VmaBlockMetadata_Generic*)pBlock->m_pMetadata;
        -
        12944  if(pMetadata->IsBufferImageGranularityConflictPossible(m_BufferImageGranularity, lastSuballocType))
        -
        12945  {
        -
        12946  return true;
        -
        12947  }
        -
        12948  }
        -
        12949  return false;
        -
        12950 }
        +
        12915  json.WriteString("BlockSize");
        +
        12916  json.WriteNumber(m_PreferredBlockSize);
        +
        12917 
        +
        12918  json.WriteString("BlockCount");
        +
        12919  json.BeginObject(true);
        +
        12920  if(m_MinBlockCount > 0)
        +
        12921  {
        +
        12922  json.WriteString("Min");
        +
        12923  json.WriteNumber((uint64_t)m_MinBlockCount);
        +
        12924  }
        +
        12925  if(m_MaxBlockCount < SIZE_MAX)
        +
        12926  {
        +
        12927  json.WriteString("Max");
        +
        12928  json.WriteNumber((uint64_t)m_MaxBlockCount);
        +
        12929  }
        +
        12930  json.WriteString("Cur");
        +
        12931  json.WriteNumber((uint64_t)m_Blocks.size());
        +
        12932  json.EndObject();
        +
        12933 
        +
        12934  if(m_FrameInUseCount > 0)
        +
        12935  {
        +
        12936  json.WriteString("FrameInUseCount");
        +
        12937  json.WriteNumber(m_FrameInUseCount);
        +
        12938  }
        +
        12939 
        +
        12940  if(m_Algorithm != 0)
        +
        12941  {
        +
        12942  json.WriteString("Algorithm");
        +
        12943  json.WriteString(VmaAlgorithmToStr(m_Algorithm));
        +
        12944  }
        +
        12945  }
        +
        12946  else
        +
        12947  {
        +
        12948  json.WriteString("PreferredBlockSize");
        +
        12949  json.WriteNumber(m_PreferredBlockSize);
        +
        12950  }
        12951 
        -
        12952 void VmaBlockVector::MakePoolAllocationsLost(
        -
        12953  uint32_t currentFrameIndex,
        -
        12954  size_t* pLostAllocationCount)
        -
        12955 {
        -
        12956  VmaMutexLockWrite lock(m_Mutex, m_hAllocator->m_UseMutex);
        -
        12957  size_t lostAllocationCount = 0;
        -
        12958  for(uint32_t blockIndex = 0; blockIndex < m_Blocks.size(); ++blockIndex)
        -
        12959  {
        -
        12960  VmaDeviceMemoryBlock* const pBlock = m_Blocks[blockIndex];
        -
        12961  VMA_ASSERT(pBlock);
        -
        12962  lostAllocationCount += pBlock->m_pMetadata->MakeAllocationsLost(currentFrameIndex, m_FrameInUseCount);
        -
        12963  }
        -
        12964  if(pLostAllocationCount != VMA_NULL)
        -
        12965  {
        -
        12966  *pLostAllocationCount = lostAllocationCount;
        -
        12967  }
        -
        12968 }
        -
        12969 
        -
        12970 VkResult VmaBlockVector::CheckCorruption()
        -
        12971 {
        -
        12972  if(!IsCorruptionDetectionEnabled())
        -
        12973  {
        -
        12974  return VK_ERROR_FEATURE_NOT_PRESENT;
        -
        12975  }
        -
        12976 
        -
        12977  VmaMutexLockRead lock(m_Mutex, m_hAllocator->m_UseMutex);
        -
        12978  for(uint32_t blockIndex = 0; blockIndex < m_Blocks.size(); ++blockIndex)
        -
        12979  {
        -
        12980  VmaDeviceMemoryBlock* const pBlock = m_Blocks[blockIndex];
        -
        12981  VMA_ASSERT(pBlock);
        -
        12982  VkResult res = pBlock->CheckCorruption(m_hAllocator);
        -
        12983  if(res != VK_SUCCESS)
        -
        12984  {
        -
        12985  return res;
        -
        12986  }
        -
        12987  }
        -
        12988  return VK_SUCCESS;
        -
        12989 }
        -
        12990 
        -
        12991 void VmaBlockVector::AddStats(VmaStats* pStats)
        -
        12992 {
        -
        12993  const uint32_t memTypeIndex = m_MemoryTypeIndex;
        -
        12994  const uint32_t memHeapIndex = m_hAllocator->MemoryTypeIndexToHeapIndex(memTypeIndex);
        -
        12995 
        -
        12996  VmaMutexLockRead lock(m_Mutex, m_hAllocator->m_UseMutex);
        -
        12997 
        -
        12998  for(uint32_t blockIndex = 0; blockIndex < m_Blocks.size(); ++blockIndex)
        -
        12999  {
        -
        13000  const VmaDeviceMemoryBlock* const pBlock = m_Blocks[blockIndex];
        -
        13001  VMA_ASSERT(pBlock);
        -
        13002  VMA_HEAVY_ASSERT(pBlock->Validate());
        -
        13003  VmaStatInfo allocationStatInfo;
        -
        13004  pBlock->m_pMetadata->CalcAllocationStatInfo(allocationStatInfo);
        -
        13005  VmaAddStatInfo(pStats->total, allocationStatInfo);
        -
        13006  VmaAddStatInfo(pStats->memoryType[memTypeIndex], allocationStatInfo);
        -
        13007  VmaAddStatInfo(pStats->memoryHeap[memHeapIndex], allocationStatInfo);
        -
        13008  }
        -
        13009 }
        -
        13010 
        -
        13012 // VmaDefragmentationAlgorithm_Generic members definition
        -
        13013 
        -
        13014 VmaDefragmentationAlgorithm_Generic::VmaDefragmentationAlgorithm_Generic(
        -
        13015  VmaAllocator hAllocator,
        -
        13016  VmaBlockVector* pBlockVector,
        -
        13017  uint32_t currentFrameIndex,
        -
        13018  bool overlappingMoveSupported) :
        -
        13019  VmaDefragmentationAlgorithm(hAllocator, pBlockVector, currentFrameIndex),
        -
        13020  m_AllocationCount(0),
        -
        13021  m_AllAllocations(false),
        -
        13022  m_BytesMoved(0),
        -
        13023  m_AllocationsMoved(0),
        -
        13024  m_Blocks(VmaStlAllocator<BlockInfo*>(hAllocator->GetAllocationCallbacks()))
        -
        13025 {
        -
        13026  // Create block info for each block.
        -
        13027  const size_t blockCount = m_pBlockVector->m_Blocks.size();
        -
        13028  for(size_t blockIndex = 0; blockIndex < blockCount; ++blockIndex)
        -
        13029  {
        -
        13030  BlockInfo* pBlockInfo = vma_new(m_hAllocator, BlockInfo)(m_hAllocator->GetAllocationCallbacks());
        -
        13031  pBlockInfo->m_OriginalBlockIndex = blockIndex;
        -
        13032  pBlockInfo->m_pBlock = m_pBlockVector->m_Blocks[blockIndex];
        -
        13033  m_Blocks.push_back(pBlockInfo);
        -
        13034  }
        -
        13035 
        -
        13036  // Sort them by m_pBlock pointer value.
        -
        13037  VMA_SORT(m_Blocks.begin(), m_Blocks.end(), BlockPointerLess());
        -
        13038 }
        -
        13039 
        -
        13040 VmaDefragmentationAlgorithm_Generic::~VmaDefragmentationAlgorithm_Generic()
        -
        13041 {
        -
        13042  for(size_t i = m_Blocks.size(); i--; )
        -
        13043  {
        -
        13044  vma_delete(m_hAllocator, m_Blocks[i]);
        -
        13045  }
        -
        13046 }
        -
        13047 
        -
        13048 void VmaDefragmentationAlgorithm_Generic::AddAllocation(VmaAllocation hAlloc, VkBool32* pChanged)
        -
        13049 {
        -
        13050  // Now as we are inside VmaBlockVector::m_Mutex, we can make final check if this allocation was not lost.
        -
        13051  if(hAlloc->GetLastUseFrameIndex() != VMA_FRAME_INDEX_LOST)
        -
        13052  {
        -
        13053  VmaDeviceMemoryBlock* pBlock = hAlloc->GetBlock();
        -
        13054  BlockInfoVector::iterator it = VmaBinaryFindFirstNotLess(m_Blocks.begin(), m_Blocks.end(), pBlock, BlockPointerLess());
        -
        13055  if(it != m_Blocks.end() && (*it)->m_pBlock == pBlock)
        -
        13056  {
        -
        13057  AllocationInfo allocInfo = AllocationInfo(hAlloc, pChanged);
        -
        13058  (*it)->m_Allocations.push_back(allocInfo);
        -
        13059  }
        -
        13060  else
        -
        13061  {
        -
        13062  VMA_ASSERT(0);
        -
        13063  }
        -
        13064 
        -
        13065  ++m_AllocationCount;
        -
        13066  }
        -
        13067 }
        -
        13068 
        -
        13069 VkResult VmaDefragmentationAlgorithm_Generic::DefragmentRound(
        -
        13070  VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> >& moves,
        -
        13071  VkDeviceSize maxBytesToMove,
        -
        13072  uint32_t maxAllocationsToMove)
        -
        13073 {
        -
        13074  if(m_Blocks.empty())
        -
        13075  {
        -
        13076  return VK_SUCCESS;
        -
        13077  }
        -
        13078 
        -
        13079  // This is a choice based on research.
        -
        13080  // Option 1:
        -
        13081  uint32_t strategy = VMA_ALLOCATION_CREATE_STRATEGY_MIN_TIME_BIT;
        -
        13082  // Option 2:
        -
        13083  //uint32_t strategy = VMA_ALLOCATION_CREATE_STRATEGY_MIN_MEMORY_BIT;
        -
        13084  // Option 3:
        -
        13085  //uint32_t strategy = VMA_ALLOCATION_CREATE_STRATEGY_MIN_FRAGMENTATION_BIT;
        -
        13086 
        -
        13087  size_t srcBlockMinIndex = 0;
        -
        13088  // When FAST_ALGORITHM, move allocations from only last out of blocks that contain non-movable allocations.
        -
        13089  /*
        -
        13090  if(m_AlgorithmFlags & VMA_DEFRAGMENTATION_FAST_ALGORITHM_BIT)
        -
        13091  {
        -
        13092  const size_t blocksWithNonMovableCount = CalcBlocksWithNonMovableCount();
        -
        13093  if(blocksWithNonMovableCount > 0)
        -
        13094  {
        -
        13095  srcBlockMinIndex = blocksWithNonMovableCount - 1;
        -
        13096  }
        -
        13097  }
        -
        13098  */
        -
        13099 
        -
        13100  size_t srcBlockIndex = m_Blocks.size() - 1;
        -
        13101  size_t srcAllocIndex = SIZE_MAX;
        -
        13102  for(;;)
        -
        13103  {
        -
        13104  // 1. Find next allocation to move.
        -
        13105  // 1.1. Start from last to first m_Blocks - they are sorted from most "destination" to most "source".
        -
        13106  // 1.2. Then start from last to first m_Allocations.
        -
        13107  while(srcAllocIndex >= m_Blocks[srcBlockIndex]->m_Allocations.size())
        -
        13108  {
        -
        13109  if(m_Blocks[srcBlockIndex]->m_Allocations.empty())
        -
        13110  {
        -
        13111  // Finished: no more allocations to process.
        -
        13112  if(srcBlockIndex == srcBlockMinIndex)
        -
        13113  {
        -
        13114  return VK_SUCCESS;
        -
        13115  }
        -
        13116  else
        -
        13117  {
        -
        13118  --srcBlockIndex;
        -
        13119  srcAllocIndex = SIZE_MAX;
        -
        13120  }
        -
        13121  }
        -
        13122  else
        -
        13123  {
        -
        13124  srcAllocIndex = m_Blocks[srcBlockIndex]->m_Allocations.size() - 1;
        -
        13125  }
        -
        13126  }
        -
        13127 
        -
        13128  BlockInfo* pSrcBlockInfo = m_Blocks[srcBlockIndex];
        -
        13129  AllocationInfo& allocInfo = pSrcBlockInfo->m_Allocations[srcAllocIndex];
        -
        13130 
        -
        13131  const VkDeviceSize size = allocInfo.m_hAllocation->GetSize();
        -
        13132  const VkDeviceSize srcOffset = allocInfo.m_hAllocation->GetOffset();
        -
        13133  const VkDeviceSize alignment = allocInfo.m_hAllocation->GetAlignment();
        -
        13134  const VmaSuballocationType suballocType = allocInfo.m_hAllocation->GetSuballocationType();
        -
        13135 
        -
        13136  // 2. Try to find new place for this allocation in preceding or current block.
        -
        13137  for(size_t dstBlockIndex = 0; dstBlockIndex <= srcBlockIndex; ++dstBlockIndex)
        -
        13138  {
        -
        13139  BlockInfo* pDstBlockInfo = m_Blocks[dstBlockIndex];
        -
        13140  VmaAllocationRequest dstAllocRequest;
        -
        13141  if(pDstBlockInfo->m_pBlock->m_pMetadata->CreateAllocationRequest(
        -
        13142  m_CurrentFrameIndex,
        -
        13143  m_pBlockVector->GetFrameInUseCount(),
        -
        13144  m_pBlockVector->GetBufferImageGranularity(),
        -
        13145  size,
        -
        13146  alignment,
        -
        13147  false, // upperAddress
        -
        13148  suballocType,
        -
        13149  false, // canMakeOtherLost
        -
        13150  strategy,
        -
        13151  &dstAllocRequest) &&
        -
        13152  MoveMakesSense(
        -
        13153  dstBlockIndex, dstAllocRequest.offset, srcBlockIndex, srcOffset))
        -
        13154  {
        -
        13155  VMA_ASSERT(dstAllocRequest.itemsToMakeLostCount == 0);
        -
        13156 
        -
        13157  // Reached limit on number of allocations or bytes to move.
        -
        13158  if((m_AllocationsMoved + 1 > maxAllocationsToMove) ||
        -
        13159  (m_BytesMoved + size > maxBytesToMove))
        -
        13160  {
        -
        13161  return VK_SUCCESS;
        -
        13162  }
        -
        13163 
        -
        13164  VmaDefragmentationMove move;
        -
        13165  move.srcBlockIndex = pSrcBlockInfo->m_OriginalBlockIndex;
        -
        13166  move.dstBlockIndex = pDstBlockInfo->m_OriginalBlockIndex;
        -
        13167  move.srcOffset = srcOffset;
        -
        13168  move.dstOffset = dstAllocRequest.offset;
        -
        13169  move.size = size;
        -
        13170  moves.push_back(move);
        -
        13171 
        -
        13172  pDstBlockInfo->m_pBlock->m_pMetadata->Alloc(
        -
        13173  dstAllocRequest,
        -
        13174  suballocType,
        -
        13175  size,
        -
        13176  allocInfo.m_hAllocation);
        -
        13177  pSrcBlockInfo->m_pBlock->m_pMetadata->FreeAtOffset(srcOffset);
        -
        13178 
        -
        13179  allocInfo.m_hAllocation->ChangeBlockAllocation(m_hAllocator, pDstBlockInfo->m_pBlock, dstAllocRequest.offset);
        -
        13180 
        -
        13181  if(allocInfo.m_pChanged != VMA_NULL)
        -
        13182  {
        -
        13183  *allocInfo.m_pChanged = VK_TRUE;
        -
        13184  }
        -
        13185 
        -
        13186  ++m_AllocationsMoved;
        -
        13187  m_BytesMoved += size;
        -
        13188 
        -
        13189  VmaVectorRemove(pSrcBlockInfo->m_Allocations, srcAllocIndex);
        -
        13190 
        -
        13191  break;
        -
        13192  }
        -
        13193  }
        -
        13194 
        -
        13195  // If not processed, this allocInfo remains in pBlockInfo->m_Allocations for next round.
        -
        13196 
        -
        13197  if(srcAllocIndex > 0)
        -
        13198  {
        -
        13199  --srcAllocIndex;
        -
        13200  }
        -
        13201  else
        -
        13202  {
        -
        13203  if(srcBlockIndex > 0)
        -
        13204  {
        -
        13205  --srcBlockIndex;
        -
        13206  srcAllocIndex = SIZE_MAX;
        -
        13207  }
        -
        13208  else
        -
        13209  {
        -
        13210  return VK_SUCCESS;
        -
        13211  }
        -
        13212  }
        -
        13213  }
        -
        13214 }
        -
        13215 
        -
        13216 size_t VmaDefragmentationAlgorithm_Generic::CalcBlocksWithNonMovableCount() const
        -
        13217 {
        -
        13218  size_t result = 0;
        -
        13219  for(size_t i = 0; i < m_Blocks.size(); ++i)
        -
        13220  {
        -
        13221  if(m_Blocks[i]->m_HasNonMovableAllocations)
        -
        13222  {
        -
        13223  ++result;
        -
        13224  }
        -
        13225  }
        -
        13226  return result;
        -
        13227 }
        -
        13228 
        -
        13229 VkResult VmaDefragmentationAlgorithm_Generic::Defragment(
        -
        13230  VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> >& moves,
        -
        13231  VkDeviceSize maxBytesToMove,
        -
        13232  uint32_t maxAllocationsToMove)
        -
        13233 {
        -
        13234  if(!m_AllAllocations && m_AllocationCount == 0)
        -
        13235  {
        -
        13236  return VK_SUCCESS;
        -
        13237  }
        -
        13238 
        -
        13239  const size_t blockCount = m_Blocks.size();
        -
        13240  for(size_t blockIndex = 0; blockIndex < blockCount; ++blockIndex)
        -
        13241  {
        -
        13242  BlockInfo* pBlockInfo = m_Blocks[blockIndex];
        -
        13243 
        -
        13244  if(m_AllAllocations)
        -
        13245  {
        -
        13246  VmaBlockMetadata_Generic* pMetadata = (VmaBlockMetadata_Generic*)pBlockInfo->m_pBlock->m_pMetadata;
        -
        13247  for(VmaSuballocationList::const_iterator it = pMetadata->m_Suballocations.begin();
        -
        13248  it != pMetadata->m_Suballocations.end();
        -
        13249  ++it)
        -
        13250  {
        -
        13251  if(it->type != VMA_SUBALLOCATION_TYPE_FREE)
        -
        13252  {
        -
        13253  AllocationInfo allocInfo = AllocationInfo(it->hAllocation, VMA_NULL);
        -
        13254  pBlockInfo->m_Allocations.push_back(allocInfo);
        -
        13255  }
        -
        13256  }
        -
        13257  }
        -
        13258 
        -
        13259  pBlockInfo->CalcHasNonMovableAllocations();
        -
        13260 
        -
        13261  // This is a choice based on research.
        -
        13262  // Option 1:
        -
        13263  pBlockInfo->SortAllocationsByOffsetDescending();
        -
        13264  // Option 2:
        -
        13265  //pBlockInfo->SortAllocationsBySizeDescending();
        -
        13266  }
        -
        13267 
        -
        13268  // Sort m_Blocks this time by the main criterium, from most "destination" to most "source" blocks.
        -
        13269  VMA_SORT(m_Blocks.begin(), m_Blocks.end(), BlockInfoCompareMoveDestination());
        -
        13270 
        -
        13271  // This is a choice based on research.
        -
        13272  const uint32_t roundCount = 2;
        -
        13273 
        -
        13274  // Execute defragmentation rounds (the main part).
        -
        13275  VkResult result = VK_SUCCESS;
        -
        13276  for(uint32_t round = 0; (round < roundCount) && (result == VK_SUCCESS); ++round)
        -
        13277  {
        -
        13278  result = DefragmentRound(moves, maxBytesToMove, maxAllocationsToMove);
        -
        13279  }
        -
        13280 
        -
        13281  return result;
        -
        13282 }
        -
        13283 
        -
        13284 bool VmaDefragmentationAlgorithm_Generic::MoveMakesSense(
        -
        13285  size_t dstBlockIndex, VkDeviceSize dstOffset,
        -
        13286  size_t srcBlockIndex, VkDeviceSize srcOffset)
        -
        13287 {
        -
        13288  if(dstBlockIndex < srcBlockIndex)
        -
        13289  {
        -
        13290  return true;
        -
        13291  }
        -
        13292  if(dstBlockIndex > srcBlockIndex)
        -
        13293  {
        -
        13294  return false;
        -
        13295  }
        -
        13296  if(dstOffset < srcOffset)
        -
        13297  {
        -
        13298  return true;
        -
        13299  }
        -
        13300  return false;
        -
        13301 }
        -
        13302 
        -
        13304 // VmaDefragmentationAlgorithm_Fast
        -
        13305 
        -
        13306 VmaDefragmentationAlgorithm_Fast::VmaDefragmentationAlgorithm_Fast(
        -
        13307  VmaAllocator hAllocator,
        -
        13308  VmaBlockVector* pBlockVector,
        -
        13309  uint32_t currentFrameIndex,
        -
        13310  bool overlappingMoveSupported) :
        -
        13311  VmaDefragmentationAlgorithm(hAllocator, pBlockVector, currentFrameIndex),
        -
        13312  m_OverlappingMoveSupported(overlappingMoveSupported),
        -
        13313  m_AllocationCount(0),
        -
        13314  m_AllAllocations(false),
        -
        13315  m_BytesMoved(0),
        -
        13316  m_AllocationsMoved(0),
        -
        13317  m_BlockInfos(VmaStlAllocator<BlockInfo>(hAllocator->GetAllocationCallbacks()))
        -
        13318 {
        -
        13319  VMA_ASSERT(VMA_DEBUG_MARGIN == 0);
        -
        13320 
        -
        13321 }
        -
        13322 
        -
        13323 VmaDefragmentationAlgorithm_Fast::~VmaDefragmentationAlgorithm_Fast()
        -
        13324 {
        -
        13325 }
        -
        13326 
        -
        13327 VkResult VmaDefragmentationAlgorithm_Fast::Defragment(
        -
        13328  VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> >& moves,
        -
        13329  VkDeviceSize maxBytesToMove,
        -
        13330  uint32_t maxAllocationsToMove)
        -
        13331 {
        -
        13332  VMA_ASSERT(m_AllAllocations || m_pBlockVector->CalcAllocationCount() == m_AllocationCount);
        -
        13333 
        -
        13334  const size_t blockCount = m_pBlockVector->GetBlockCount();
        -
        13335  if(blockCount == 0 || maxBytesToMove == 0 || maxAllocationsToMove == 0)
        -
        13336  {
        -
        13337  return VK_SUCCESS;
        -
        13338  }
        -
        13339 
        -
        13340  PreprocessMetadata();
        -
        13341 
        -
        13342  // Sort blocks in order from most destination.
        -
        13343 
        -
        13344  m_BlockInfos.resize(blockCount);
        -
        13345  for(size_t i = 0; i < blockCount; ++i)
        -
        13346  {
        -
        13347  m_BlockInfos[i].origBlockIndex = i;
        -
        13348  }
        -
        13349 
        -
        13350  VMA_SORT(m_BlockInfos.begin(), m_BlockInfos.end(), [this](const BlockInfo& lhs, const BlockInfo& rhs) -> bool {
        -
        13351  return m_pBlockVector->GetBlock(lhs.origBlockIndex)->m_pMetadata->GetSumFreeSize() <
        -
        13352  m_pBlockVector->GetBlock(rhs.origBlockIndex)->m_pMetadata->GetSumFreeSize();
        -
        13353  });
        -
        13354 
        -
        13355  // THE MAIN ALGORITHM
        -
        13356 
        -
        13357  FreeSpaceDatabase freeSpaceDb;
        -
        13358 
        -
        13359  size_t dstBlockInfoIndex = 0;
        -
        13360  size_t dstOrigBlockIndex = m_BlockInfos[dstBlockInfoIndex].origBlockIndex;
        -
        13361  VmaDeviceMemoryBlock* pDstBlock = m_pBlockVector->GetBlock(dstOrigBlockIndex);
        -
        13362  VmaBlockMetadata_Generic* pDstMetadata = (VmaBlockMetadata_Generic*)pDstBlock->m_pMetadata;
        -
        13363  VkDeviceSize dstBlockSize = pDstMetadata->GetSize();
        -
        13364  VkDeviceSize dstOffset = 0;
        -
        13365 
        -
        13366  bool end = false;
        -
        13367  for(size_t srcBlockInfoIndex = 0; !end && srcBlockInfoIndex < blockCount; ++srcBlockInfoIndex)
        -
        13368  {
        -
        13369  const size_t srcOrigBlockIndex = m_BlockInfos[srcBlockInfoIndex].origBlockIndex;
        -
        13370  VmaDeviceMemoryBlock* const pSrcBlock = m_pBlockVector->GetBlock(srcOrigBlockIndex);
        -
        13371  VmaBlockMetadata_Generic* const pSrcMetadata = (VmaBlockMetadata_Generic*)pSrcBlock->m_pMetadata;
        -
        13372  for(VmaSuballocationList::iterator srcSuballocIt = pSrcMetadata->m_Suballocations.begin();
        -
        13373  !end && srcSuballocIt != pSrcMetadata->m_Suballocations.end(); )
        -
        13374  {
        -
        13375  VmaAllocation_T* const pAlloc = srcSuballocIt->hAllocation;
        -
        13376  const VkDeviceSize srcAllocAlignment = pAlloc->GetAlignment();
        -
        13377  const VkDeviceSize srcAllocSize = srcSuballocIt->size;
        -
        13378  if(m_AllocationsMoved == maxAllocationsToMove ||
        -
        13379  m_BytesMoved + srcAllocSize > maxBytesToMove)
        -
        13380  {
        -
        13381  end = true;
        -
        13382  break;
        -
        13383  }
        -
        13384  const VkDeviceSize srcAllocOffset = srcSuballocIt->offset;
        -
        13385 
        -
        13386  // Try to place it in one of free spaces from the database.
        -
        13387  size_t freeSpaceInfoIndex;
        -
        13388  VkDeviceSize dstAllocOffset;
        -
        13389  if(freeSpaceDb.Fetch(srcAllocAlignment, srcAllocSize,
        -
        13390  freeSpaceInfoIndex, dstAllocOffset))
        -
        13391  {
        -
        13392  size_t freeSpaceOrigBlockIndex = m_BlockInfos[freeSpaceInfoIndex].origBlockIndex;
        -
        13393  VmaDeviceMemoryBlock* pFreeSpaceBlock = m_pBlockVector->GetBlock(freeSpaceOrigBlockIndex);
        -
        13394  VmaBlockMetadata_Generic* pFreeSpaceMetadata = (VmaBlockMetadata_Generic*)pFreeSpaceBlock->m_pMetadata;
        -
        13395 
        -
        13396  // Same block
        -
        13397  if(freeSpaceInfoIndex == srcBlockInfoIndex)
        -
        13398  {
        -
        13399  VMA_ASSERT(dstAllocOffset <= srcAllocOffset);
        +
        12952  json.WriteString("Blocks");
        +
        12953  json.BeginObject();
        +
        12954  for(size_t i = 0; i < m_Blocks.size(); ++i)
        +
        12955  {
        +
        12956  json.BeginString();
        +
        12957  json.ContinueString(m_Blocks[i]->GetId());
        +
        12958  json.EndString();
        +
        12959 
        +
        12960  m_Blocks[i]->m_pMetadata->PrintDetailedMap(json);
        +
        12961  }
        +
        12962  json.EndObject();
        +
        12963 
        +
        12964  json.EndObject();
        +
        12965 }
        +
        12966 
        +
        12967 #endif // #if VMA_STATS_STRING_ENABLED
        +
        12968 
        +
        12969 void VmaBlockVector::Defragment(
        +
        12970  class VmaBlockVectorDefragmentationContext* pCtx,
        +
        12971  VmaDefragmentationStats* pStats, VmaDefragmentationFlags flags,
        +
        12972  VkDeviceSize& maxCpuBytesToMove, uint32_t& maxCpuAllocationsToMove,
        +
        12973  VkDeviceSize& maxGpuBytesToMove, uint32_t& maxGpuAllocationsToMove,
        +
        12974  VkCommandBuffer commandBuffer)
        +
        12975 {
        +
        12976  pCtx->res = VK_SUCCESS;
        +
        12977 
        +
        12978  const VkMemoryPropertyFlags memPropFlags =
        +
        12979  m_hAllocator->m_MemProps.memoryTypes[m_MemoryTypeIndex].propertyFlags;
        +
        12980  const bool isHostVisible = (memPropFlags & VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT) != 0;
        +
        12981 
        +
        12982  const bool canDefragmentOnCpu = maxCpuBytesToMove > 0 && maxCpuAllocationsToMove > 0 &&
        +
        12983  isHostVisible;
        +
        12984  const bool canDefragmentOnGpu = maxGpuBytesToMove > 0 && maxGpuAllocationsToMove > 0 &&
        +
        12985  !IsCorruptionDetectionEnabled() &&
        +
        12986  ((1u << m_MemoryTypeIndex) & m_hAllocator->GetGpuDefragmentationMemoryTypeBits()) != 0;
        +
        12987 
        +
        12988  // There are options to defragment this memory type.
        +
        12989  if(canDefragmentOnCpu || canDefragmentOnGpu)
        +
        12990  {
        +
        12991  bool defragmentOnGpu;
        +
        12992  // There is only one option to defragment this memory type.
        +
        12993  if(canDefragmentOnGpu != canDefragmentOnCpu)
        +
        12994  {
        +
        12995  defragmentOnGpu = canDefragmentOnGpu;
        +
        12996  }
        +
        12997  // Both options are available: Heuristics to choose the best one.
        +
        12998  else
        +
        12999  {
        +
        13000  defragmentOnGpu = (memPropFlags & VK_MEMORY_PROPERTY_DEVICE_LOCAL_BIT) != 0 ||
        +
        13001  m_hAllocator->IsIntegratedGpu();
        +
        13002  }
        +
        13003 
        +
        13004  bool overlappingMoveSupported = !defragmentOnGpu;
        +
        13005 
        +
        13006  if(m_hAllocator->m_UseMutex)
        +
        13007  {
        +
        13008  if(flags & VMA_DEFRAGMENTATION_FLAG_INCREMENTAL)
        +
        13009  {
        +
        13010  if(!m_Mutex.TryLockWrite())
        +
        13011  {
        +
        13012  pCtx->res = VK_ERROR_INITIALIZATION_FAILED;
        +
        13013  return;
        +
        13014  }
        +
        13015  }
        +
        13016  else
        +
        13017  {
        +
        13018  m_Mutex.LockWrite();
        +
        13019  pCtx->mutexLocked = true;
        +
        13020  }
        +
        13021  }
        +
        13022 
        +
        13023  pCtx->Begin(overlappingMoveSupported, flags);
        +
        13024 
        +
        13025  // Defragment.
        +
        13026 
        +
        13027  const VkDeviceSize maxBytesToMove = defragmentOnGpu ? maxGpuBytesToMove : maxCpuBytesToMove;
        +
        13028  const uint32_t maxAllocationsToMove = defragmentOnGpu ? maxGpuAllocationsToMove : maxCpuAllocationsToMove;
        +
        13029  pCtx->res = pCtx->GetAlgorithm()->Defragment(pCtx->defragmentationMoves, maxBytesToMove, maxAllocationsToMove, flags);
        +
        13030 
        +
        13031  // Accumulate statistics.
        +
        13032  if(pStats != VMA_NULL)
        +
        13033  {
        +
        13034  const VkDeviceSize bytesMoved = pCtx->GetAlgorithm()->GetBytesMoved();
        +
        13035  const uint32_t allocationsMoved = pCtx->GetAlgorithm()->GetAllocationsMoved();
        +
        13036  pStats->bytesMoved += bytesMoved;
        +
        13037  pStats->allocationsMoved += allocationsMoved;
        +
        13038  VMA_ASSERT(bytesMoved <= maxBytesToMove);
        +
        13039  VMA_ASSERT(allocationsMoved <= maxAllocationsToMove);
        +
        13040  if(defragmentOnGpu)
        +
        13041  {
        +
        13042  maxGpuBytesToMove -= bytesMoved;
        +
        13043  maxGpuAllocationsToMove -= allocationsMoved;
        +
        13044  }
        +
        13045  else
        +
        13046  {
        +
        13047  maxCpuBytesToMove -= bytesMoved;
        +
        13048  maxCpuAllocationsToMove -= allocationsMoved;
        +
        13049  }
        +
        13050  }
        +
        13051 
        +
        13052  if(flags & VMA_DEFRAGMENTATION_FLAG_INCREMENTAL)
        +
        13053  {
        +
        13054  if(m_hAllocator->m_UseMutex)
        +
        13055  m_Mutex.UnlockWrite();
        +
        13056 
        +
        13057  if(pCtx->res >= VK_SUCCESS && !pCtx->defragmentationMoves.empty())
        +
        13058  pCtx->res = VK_NOT_READY;
        +
        13059 
        +
        13060  return;
        +
        13061  }
        +
        13062 
        +
        13063  if(pCtx->res >= VK_SUCCESS)
        +
        13064  {
        +
        13065  if(defragmentOnGpu)
        +
        13066  {
        +
        13067  ApplyDefragmentationMovesGpu(pCtx, pCtx->defragmentationMoves, commandBuffer);
        +
        13068  }
        +
        13069  else
        +
        13070  {
        +
        13071  ApplyDefragmentationMovesCpu(pCtx, pCtx->defragmentationMoves);
        +
        13072  }
        +
        13073  }
        +
        13074  }
        +
        13075 }
        +
        13076 
        +
        13077 void VmaBlockVector::DefragmentationEnd(
        +
        13078  class VmaBlockVectorDefragmentationContext* pCtx,
        +
        13079  VmaDefragmentationStats* pStats)
        +
        13080 {
        +
        13081  // Destroy buffers.
        +
        13082  for(size_t blockIndex = pCtx->blockContexts.size(); blockIndex--; )
        +
        13083  {
        +
        13084  VmaBlockDefragmentationContext& blockCtx = pCtx->blockContexts[blockIndex];
        +
        13085  if(blockCtx.hBuffer)
        +
        13086  {
        +
        13087  (*m_hAllocator->GetVulkanFunctions().vkDestroyBuffer)(
        +
        13088  m_hAllocator->m_hDevice, blockCtx.hBuffer, m_hAllocator->GetAllocationCallbacks());
        +
        13089  }
        +
        13090  }
        +
        13091 
        +
        13092  if(pCtx->res >= VK_SUCCESS)
        +
        13093  {
        +
        13094  FreeEmptyBlocks(pStats);
        +
        13095  }
        +
        13096 
        +
        13097  if(pCtx->mutexLocked)
        +
        13098  {
        +
        13099  VMA_ASSERT(m_hAllocator->m_UseMutex);
        +
        13100  m_Mutex.UnlockWrite();
        +
        13101  }
        +
        13102 }
        +
        13103 
        +
        13104 uint32_t VmaBlockVector::ProcessDefragmentations(
        +
        13105  class VmaBlockVectorDefragmentationContext *pCtx,
        +
        13106  VmaDefragmentationPassMoveInfo* pMove, uint32_t maxMoves)
        +
        13107 {
        +
        13108  VmaMutexLockWrite lock(m_Mutex, m_hAllocator->m_UseMutex);
        +
        13109 
        +
        13110  const uint32_t moveCount = std::min(uint32_t(pCtx->defragmentationMoves.size()) - pCtx->defragmentationMovesProcessed, maxMoves);
        +
        13111 
        +
        13112  for(uint32_t i = 0; i < moveCount; ++ i)
        +
        13113  {
        +
        13114  VmaDefragmentationMove& move = pCtx->defragmentationMoves[pCtx->defragmentationMovesProcessed + i];
        +
        13115 
        +
        13116  pMove->allocation = move.hAllocation;
        +
        13117  pMove->memory = move.pDstBlock->GetDeviceMemory();
        +
        13118  pMove->offset = move.dstOffset;
        +
        13119 
        +
        13120  ++ pMove;
        +
        13121  }
        +
        13122 
        +
        13123  pCtx->defragmentationMovesProcessed += moveCount;
        +
        13124 
        +
        13125  return moveCount;
        +
        13126 }
        +
        13127 
        +
        13128 void VmaBlockVector::CommitDefragmentations(
        +
        13129  class VmaBlockVectorDefragmentationContext *pCtx,
        +
        13130  VmaDefragmentationStats* pStats)
        +
        13131 {
        +
        13132  VmaMutexLockWrite lock(m_Mutex, m_hAllocator->m_UseMutex);
        +
        13133 
        +
        13134  for(uint32_t i = pCtx->defragmentationMovesCommitted; i < pCtx->defragmentationMovesProcessed; ++ i)
        +
        13135  {
        +
        13136  const VmaDefragmentationMove &move = pCtx->defragmentationMoves[i];
        +
        13137 
        +
        13138  move.pSrcBlock->m_pMetadata->FreeAtOffset(move.srcOffset);
        +
        13139  move.hAllocation->ChangeBlockAllocation(m_hAllocator, move.pDstBlock, move.dstOffset);
        +
        13140  }
        +
        13141 
        +
        13142  pCtx->defragmentationMovesCommitted = pCtx->defragmentationMovesProcessed;
        +
        13143  FreeEmptyBlocks(pStats);
        +
        13144 }
        +
        13145 
        +
        13146 size_t VmaBlockVector::CalcAllocationCount() const
        +
        13147 {
        +
        13148  size_t result = 0;
        +
        13149  for(size_t i = 0; i < m_Blocks.size(); ++i)
        +
        13150  {
        +
        13151  result += m_Blocks[i]->m_pMetadata->GetAllocationCount();
        +
        13152  }
        +
        13153  return result;
        +
        13154 }
        +
        13155 
        +
        13156 bool VmaBlockVector::IsBufferImageGranularityConflictPossible() const
        +
        13157 {
        +
        13158  if(m_BufferImageGranularity == 1)
        +
        13159  {
        +
        13160  return false;
        +
        13161  }
        +
        13162  VmaSuballocationType lastSuballocType = VMA_SUBALLOCATION_TYPE_FREE;
        +
        13163  for(size_t i = 0, count = m_Blocks.size(); i < count; ++i)
        +
        13164  {
        +
        13165  VmaDeviceMemoryBlock* const pBlock = m_Blocks[i];
        +
        13166  VMA_ASSERT(m_Algorithm == 0);
        +
        13167  VmaBlockMetadata_Generic* const pMetadata = (VmaBlockMetadata_Generic*)pBlock->m_pMetadata;
        +
        13168  if(pMetadata->IsBufferImageGranularityConflictPossible(m_BufferImageGranularity, lastSuballocType))
        +
        13169  {
        +
        13170  return true;
        +
        13171  }
        +
        13172  }
        +
        13173  return false;
        +
        13174 }
        +
        13175 
        +
        13176 void VmaBlockVector::MakePoolAllocationsLost(
        +
        13177  uint32_t currentFrameIndex,
        +
        13178  size_t* pLostAllocationCount)
        +
        13179 {
        +
        13180  VmaMutexLockWrite lock(m_Mutex, m_hAllocator->m_UseMutex);
        +
        13181  size_t lostAllocationCount = 0;
        +
        13182  for(uint32_t blockIndex = 0; blockIndex < m_Blocks.size(); ++blockIndex)
        +
        13183  {
        +
        13184  VmaDeviceMemoryBlock* const pBlock = m_Blocks[blockIndex];
        +
        13185  VMA_ASSERT(pBlock);
        +
        13186  lostAllocationCount += pBlock->m_pMetadata->MakeAllocationsLost(currentFrameIndex, m_FrameInUseCount);
        +
        13187  }
        +
        13188  if(pLostAllocationCount != VMA_NULL)
        +
        13189  {
        +
        13190  *pLostAllocationCount = lostAllocationCount;
        +
        13191  }
        +
        13192 }
        +
        13193 
        +
        13194 VkResult VmaBlockVector::CheckCorruption()
        +
        13195 {
        +
        13196  if(!IsCorruptionDetectionEnabled())
        +
        13197  {
        +
        13198  return VK_ERROR_FEATURE_NOT_PRESENT;
        +
        13199  }
        +
        13200 
        +
        13201  VmaMutexLockRead lock(m_Mutex, m_hAllocator->m_UseMutex);
        +
        13202  for(uint32_t blockIndex = 0; blockIndex < m_Blocks.size(); ++blockIndex)
        +
        13203  {
        +
        13204  VmaDeviceMemoryBlock* const pBlock = m_Blocks[blockIndex];
        +
        13205  VMA_ASSERT(pBlock);
        +
        13206  VkResult res = pBlock->CheckCorruption(m_hAllocator);
        +
        13207  if(res != VK_SUCCESS)
        +
        13208  {
        +
        13209  return res;
        +
        13210  }
        +
        13211  }
        +
        13212  return VK_SUCCESS;
        +
        13213 }
        +
        13214 
        +
        13215 void VmaBlockVector::AddStats(VmaStats* pStats)
        +
        13216 {
        +
        13217  const uint32_t memTypeIndex = m_MemoryTypeIndex;
        +
        13218  const uint32_t memHeapIndex = m_hAllocator->MemoryTypeIndexToHeapIndex(memTypeIndex);
        +
        13219 
        +
        13220  VmaMutexLockRead lock(m_Mutex, m_hAllocator->m_UseMutex);
        +
        13221 
        +
        13222  for(uint32_t blockIndex = 0; blockIndex < m_Blocks.size(); ++blockIndex)
        +
        13223  {
        +
        13224  const VmaDeviceMemoryBlock* const pBlock = m_Blocks[blockIndex];
        +
        13225  VMA_ASSERT(pBlock);
        +
        13226  VMA_HEAVY_ASSERT(pBlock->Validate());
        +
        13227  VmaStatInfo allocationStatInfo;
        +
        13228  pBlock->m_pMetadata->CalcAllocationStatInfo(allocationStatInfo);
        +
        13229  VmaAddStatInfo(pStats->total, allocationStatInfo);
        +
        13230  VmaAddStatInfo(pStats->memoryType[memTypeIndex], allocationStatInfo);
        +
        13231  VmaAddStatInfo(pStats->memoryHeap[memHeapIndex], allocationStatInfo);
        +
        13232  }
        +
        13233 }
        +
        13234 
        +
        13236 // VmaDefragmentationAlgorithm_Generic members definition
        +
        13237 
        +
        13238 VmaDefragmentationAlgorithm_Generic::VmaDefragmentationAlgorithm_Generic(
        +
        13239  VmaAllocator hAllocator,
        +
        13240  VmaBlockVector* pBlockVector,
        +
        13241  uint32_t currentFrameIndex,
        +
        13242  bool overlappingMoveSupported) :
        +
        13243  VmaDefragmentationAlgorithm(hAllocator, pBlockVector, currentFrameIndex),
        +
        13244  m_AllocationCount(0),
        +
        13245  m_AllAllocations(false),
        +
        13246  m_BytesMoved(0),
        +
        13247  m_AllocationsMoved(0),
        +
        13248  m_Blocks(VmaStlAllocator<BlockInfo*>(hAllocator->GetAllocationCallbacks()))
        +
        13249 {
        +
        13250  // Create block info for each block.
        +
        13251  const size_t blockCount = m_pBlockVector->m_Blocks.size();
        +
        13252  for(size_t blockIndex = 0; blockIndex < blockCount; ++blockIndex)
        +
        13253  {
        +
        13254  BlockInfo* pBlockInfo = vma_new(m_hAllocator, BlockInfo)(m_hAllocator->GetAllocationCallbacks());
        +
        13255  pBlockInfo->m_OriginalBlockIndex = blockIndex;
        +
        13256  pBlockInfo->m_pBlock = m_pBlockVector->m_Blocks[blockIndex];
        +
        13257  m_Blocks.push_back(pBlockInfo);
        +
        13258  }
        +
        13259 
        +
        13260  // Sort them by m_pBlock pointer value.
        +
        13261  VMA_SORT(m_Blocks.begin(), m_Blocks.end(), BlockPointerLess());
        +
        13262 }
        +
        13263 
        +
        13264 VmaDefragmentationAlgorithm_Generic::~VmaDefragmentationAlgorithm_Generic()
        +
        13265 {
        +
        13266  for(size_t i = m_Blocks.size(); i--; )
        +
        13267  {
        +
        13268  vma_delete(m_hAllocator, m_Blocks[i]);
        +
        13269  }
        +
        13270 }
        +
        13271 
        +
        13272 void VmaDefragmentationAlgorithm_Generic::AddAllocation(VmaAllocation hAlloc, VkBool32* pChanged)
        +
        13273 {
        +
        13274  // Now as we are inside VmaBlockVector::m_Mutex, we can make final check if this allocation was not lost.
        +
        13275  if(hAlloc->GetLastUseFrameIndex() != VMA_FRAME_INDEX_LOST)
        +
        13276  {
        +
        13277  VmaDeviceMemoryBlock* pBlock = hAlloc->GetBlock();
        +
        13278  BlockInfoVector::iterator it = VmaBinaryFindFirstNotLess(m_Blocks.begin(), m_Blocks.end(), pBlock, BlockPointerLess());
        +
        13279  if(it != m_Blocks.end() && (*it)->m_pBlock == pBlock)
        +
        13280  {
        +
        13281  AllocationInfo allocInfo = AllocationInfo(hAlloc, pChanged);
        +
        13282  (*it)->m_Allocations.push_back(allocInfo);
        +
        13283  }
        +
        13284  else
        +
        13285  {
        +
        13286  VMA_ASSERT(0);
        +
        13287  }
        +
        13288 
        +
        13289  ++m_AllocationCount;
        +
        13290  }
        +
        13291 }
        +
        13292 
        +
        13293 VkResult VmaDefragmentationAlgorithm_Generic::DefragmentRound(
        +
        13294  VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> >& moves,
        +
        13295  VkDeviceSize maxBytesToMove,
        +
        13296  uint32_t maxAllocationsToMove,
        +
        13297  bool freeOldAllocations)
        +
        13298 {
        +
        13299  if(m_Blocks.empty())
        +
        13300  {
        +
        13301  return VK_SUCCESS;
        +
        13302  }
        +
        13303 
        +
        13304  // This is a choice based on research.
        +
        13305  // Option 1:
        +
        13306  uint32_t strategy = VMA_ALLOCATION_CREATE_STRATEGY_MIN_TIME_BIT;
        +
        13307  // Option 2:
        +
        13308  //uint32_t strategy = VMA_ALLOCATION_CREATE_STRATEGY_MIN_MEMORY_BIT;
        +
        13309  // Option 3:
        +
        13310  //uint32_t strategy = VMA_ALLOCATION_CREATE_STRATEGY_MIN_FRAGMENTATION_BIT;
        +
        13311 
        +
        13312  size_t srcBlockMinIndex = 0;
        +
        13313  // When FAST_ALGORITHM, move allocations from only last out of blocks that contain non-movable allocations.
        +
        13314  /*
        +
        13315  if(m_AlgorithmFlags & VMA_DEFRAGMENTATION_FAST_ALGORITHM_BIT)
        +
        13316  {
        +
        13317  const size_t blocksWithNonMovableCount = CalcBlocksWithNonMovableCount();
        +
        13318  if(blocksWithNonMovableCount > 0)
        +
        13319  {
        +
        13320  srcBlockMinIndex = blocksWithNonMovableCount - 1;
        +
        13321  }
        +
        13322  }
        +
        13323  */
        +
        13324 
        +
        13325  size_t srcBlockIndex = m_Blocks.size() - 1;
        +
        13326  size_t srcAllocIndex = SIZE_MAX;
        +
        13327  for(;;)
        +
        13328  {
        +
        13329  // 1. Find next allocation to move.
        +
        13330  // 1.1. Start from last to first m_Blocks - they are sorted from most "destination" to most "source".
        +
        13331  // 1.2. Then start from last to first m_Allocations.
        +
        13332  while(srcAllocIndex >= m_Blocks[srcBlockIndex]->m_Allocations.size())
        +
        13333  {
        +
        13334  if(m_Blocks[srcBlockIndex]->m_Allocations.empty())
        +
        13335  {
        +
        13336  // Finished: no more allocations to process.
        +
        13337  if(srcBlockIndex == srcBlockMinIndex)
        +
        13338  {
        +
        13339  return VK_SUCCESS;
        +
        13340  }
        +
        13341  else
        +
        13342  {
        +
        13343  --srcBlockIndex;
        +
        13344  srcAllocIndex = SIZE_MAX;
        +
        13345  }
        +
        13346  }
        +
        13347  else
        +
        13348  {
        +
        13349  srcAllocIndex = m_Blocks[srcBlockIndex]->m_Allocations.size() - 1;
        +
        13350  }
        +
        13351  }
        +
        13352 
        +
        13353  BlockInfo* pSrcBlockInfo = m_Blocks[srcBlockIndex];
        +
        13354  AllocationInfo& allocInfo = pSrcBlockInfo->m_Allocations[srcAllocIndex];
        +
        13355 
        +
        13356  const VkDeviceSize size = allocInfo.m_hAllocation->GetSize();
        +
        13357  const VkDeviceSize srcOffset = allocInfo.m_hAllocation->GetOffset();
        +
        13358  const VkDeviceSize alignment = allocInfo.m_hAllocation->GetAlignment();
        +
        13359  const VmaSuballocationType suballocType = allocInfo.m_hAllocation->GetSuballocationType();
        +
        13360 
        +
        13361  // 2. Try to find new place for this allocation in preceding or current block.
        +
        13362  for(size_t dstBlockIndex = 0; dstBlockIndex <= srcBlockIndex; ++dstBlockIndex)
        +
        13363  {
        +
        13364  BlockInfo* pDstBlockInfo = m_Blocks[dstBlockIndex];
        +
        13365  VmaAllocationRequest dstAllocRequest;
        +
        13366  if(pDstBlockInfo->m_pBlock->m_pMetadata->CreateAllocationRequest(
        +
        13367  m_CurrentFrameIndex,
        +
        13368  m_pBlockVector->GetFrameInUseCount(),
        +
        13369  m_pBlockVector->GetBufferImageGranularity(),
        +
        13370  size,
        +
        13371  alignment,
        +
        13372  false, // upperAddress
        +
        13373  suballocType,
        +
        13374  false, // canMakeOtherLost
        +
        13375  strategy,
        +
        13376  &dstAllocRequest) &&
        +
        13377  MoveMakesSense(
        +
        13378  dstBlockIndex, dstAllocRequest.offset, srcBlockIndex, srcOffset))
        +
        13379  {
        +
        13380  VMA_ASSERT(dstAllocRequest.itemsToMakeLostCount == 0);
        +
        13381 
        +
        13382  // Reached limit on number of allocations or bytes to move.
        +
        13383  if((m_AllocationsMoved + 1 > maxAllocationsToMove) ||
        +
        13384  (m_BytesMoved + size > maxBytesToMove))
        +
        13385  {
        +
        13386  return VK_SUCCESS;
        +
        13387  }
        +
        13388 
        +
        13389  VmaDefragmentationMove move = {};
        +
        13390  move.srcBlockIndex = pSrcBlockInfo->m_OriginalBlockIndex;
        +
        13391  move.dstBlockIndex = pDstBlockInfo->m_OriginalBlockIndex;
        +
        13392  move.srcOffset = srcOffset;
        +
        13393  move.dstOffset = dstAllocRequest.offset;
        +
        13394  move.size = size;
        +
        13395  move.hAllocation = allocInfo.m_hAllocation;
        +
        13396  move.pSrcBlock = pSrcBlockInfo->m_pBlock;
        +
        13397  move.pDstBlock = pDstBlockInfo->m_pBlock;
        +
        13398 
        +
        13399  moves.push_back(move);
        13400 
        -
        13401  // MOVE OPTION 1: Move the allocation inside the same block by decreasing offset.
        -
        13402 
        -
        13403  VmaSuballocation suballoc = *srcSuballocIt;
        -
        13404  suballoc.offset = dstAllocOffset;
        -
        13405  suballoc.hAllocation->ChangeOffset(dstAllocOffset);
        -
        13406  m_BytesMoved += srcAllocSize;
        -
        13407  ++m_AllocationsMoved;
        -
        13408 
        -
        13409  VmaSuballocationList::iterator nextSuballocIt = srcSuballocIt;
        -
        13410  ++nextSuballocIt;
        -
        13411  pSrcMetadata->m_Suballocations.erase(srcSuballocIt);
        -
        13412  srcSuballocIt = nextSuballocIt;
        -
        13413 
        -
        13414  InsertSuballoc(pFreeSpaceMetadata, suballoc);
        -
        13415 
        -
        13416  VmaDefragmentationMove move = {
        -
        13417  srcOrigBlockIndex, freeSpaceOrigBlockIndex,
        -
        13418  srcAllocOffset, dstAllocOffset,
        -
        13419  srcAllocSize };
        -
        13420  moves.push_back(move);
        -
        13421  }
        -
        13422  // Different block
        -
        13423  else
        -
        13424  {
        -
        13425  // MOVE OPTION 2: Move the allocation to a different block.
        +
        13401  pDstBlockInfo->m_pBlock->m_pMetadata->Alloc(
        +
        13402  dstAllocRequest,
        +
        13403  suballocType,
        +
        13404  size,
        +
        13405  allocInfo.m_hAllocation);
        +
        13406 
        +
        13407  if(freeOldAllocations)
        +
        13408  {
        +
        13409  pSrcBlockInfo->m_pBlock->m_pMetadata->FreeAtOffset(srcOffset);
        +
        13410  allocInfo.m_hAllocation->ChangeBlockAllocation(m_hAllocator, pDstBlockInfo->m_pBlock, dstAllocRequest.offset);
        +
        13411  }
        +
        13412 
        +
        13413  if(allocInfo.m_pChanged != VMA_NULL)
        +
        13414  {
        +
        13415  *allocInfo.m_pChanged = VK_TRUE;
        +
        13416  }
        +
        13417 
        +
        13418  ++m_AllocationsMoved;
        +
        13419  m_BytesMoved += size;
        +
        13420 
        +
        13421  VmaVectorRemove(pSrcBlockInfo->m_Allocations, srcAllocIndex);
        +
        13422 
        +
        13423  break;
        +
        13424  }
        +
        13425  }
        13426 
        -
        13427  VMA_ASSERT(freeSpaceInfoIndex < srcBlockInfoIndex);
        +
        13427  // If not processed, this allocInfo remains in pBlockInfo->m_Allocations for next round.
        13428 
        -
        13429  VmaSuballocation suballoc = *srcSuballocIt;
        -
        13430  suballoc.offset = dstAllocOffset;
        -
        13431  suballoc.hAllocation->ChangeBlockAllocation(m_hAllocator, pFreeSpaceBlock, dstAllocOffset);
        -
        13432  m_BytesMoved += srcAllocSize;
        -
        13433  ++m_AllocationsMoved;
        -
        13434 
        -
        13435  VmaSuballocationList::iterator nextSuballocIt = srcSuballocIt;
        -
        13436  ++nextSuballocIt;
        -
        13437  pSrcMetadata->m_Suballocations.erase(srcSuballocIt);
        -
        13438  srcSuballocIt = nextSuballocIt;
        -
        13439 
        -
        13440  InsertSuballoc(pFreeSpaceMetadata, suballoc);
        -
        13441 
        -
        13442  VmaDefragmentationMove move = {
        -
        13443  srcOrigBlockIndex, freeSpaceOrigBlockIndex,
        -
        13444  srcAllocOffset, dstAllocOffset,
        -
        13445  srcAllocSize };
        -
        13446  moves.push_back(move);
        -
        13447  }
        -
        13448  }
        -
        13449  else
        -
        13450  {
        -
        13451  dstAllocOffset = VmaAlignUp(dstOffset, srcAllocAlignment);
        -
        13452 
        -
        13453  // If the allocation doesn't fit before the end of dstBlock, forward to next block.
        -
        13454  while(dstBlockInfoIndex < srcBlockInfoIndex &&
        -
        13455  dstAllocOffset + srcAllocSize > dstBlockSize)
        -
        13456  {
        -
        13457  // But before that, register remaining free space at the end of dst block.
        -
        13458  freeSpaceDb.Register(dstBlockInfoIndex, dstOffset, dstBlockSize - dstOffset);
        -
        13459 
        -
        13460  ++dstBlockInfoIndex;
        -
        13461  dstOrigBlockIndex = m_BlockInfos[dstBlockInfoIndex].origBlockIndex;
        -
        13462  pDstBlock = m_pBlockVector->GetBlock(dstOrigBlockIndex);
        -
        13463  pDstMetadata = (VmaBlockMetadata_Generic*)pDstBlock->m_pMetadata;
        -
        13464  dstBlockSize = pDstMetadata->GetSize();
        -
        13465  dstOffset = 0;
        -
        13466  dstAllocOffset = 0;
        -
        13467  }
        -
        13468 
        -
        13469  // Same block
        -
        13470  if(dstBlockInfoIndex == srcBlockInfoIndex)
        -
        13471  {
        -
        13472  VMA_ASSERT(dstAllocOffset <= srcAllocOffset);
        -
        13473 
        -
        13474  const bool overlap = dstAllocOffset + srcAllocSize > srcAllocOffset;
        -
        13475 
        -
        13476  bool skipOver = overlap;
        -
        13477  if(overlap && m_OverlappingMoveSupported && dstAllocOffset < srcAllocOffset)
        -
        13478  {
        -
        13479  // If destination and source place overlap, skip if it would move it
        -
        13480  // by only < 1/64 of its size.
        -
        13481  skipOver = (srcAllocOffset - dstAllocOffset) * 64 < srcAllocSize;
        -
        13482  }
        -
        13483 
        -
        13484  if(skipOver)
        -
        13485  {
        -
        13486  freeSpaceDb.Register(dstBlockInfoIndex, dstOffset, srcAllocOffset - dstOffset);
        -
        13487 
        -
        13488  dstOffset = srcAllocOffset + srcAllocSize;
        -
        13489  ++srcSuballocIt;
        -
        13490  }
        -
        13491  // MOVE OPTION 1: Move the allocation inside the same block by decreasing offset.
        -
        13492  else
        -
        13493  {
        -
        13494  srcSuballocIt->offset = dstAllocOffset;
        -
        13495  srcSuballocIt->hAllocation->ChangeOffset(dstAllocOffset);
        -
        13496  dstOffset = dstAllocOffset + srcAllocSize;
        -
        13497  m_BytesMoved += srcAllocSize;
        -
        13498  ++m_AllocationsMoved;
        -
        13499  ++srcSuballocIt;
        -
        13500  VmaDefragmentationMove move = {
        -
        13501  srcOrigBlockIndex, dstOrigBlockIndex,
        -
        13502  srcAllocOffset, dstAllocOffset,
        -
        13503  srcAllocSize };
        -
        13504  moves.push_back(move);
        -
        13505  }
        -
        13506  }
        -
        13507  // Different block
        -
        13508  else
        -
        13509  {
        -
        13510  // MOVE OPTION 2: Move the allocation to a different block.
        -
        13511 
        -
        13512  VMA_ASSERT(dstBlockInfoIndex < srcBlockInfoIndex);
        -
        13513  VMA_ASSERT(dstAllocOffset + srcAllocSize <= dstBlockSize);
        -
        13514 
        -
        13515  VmaSuballocation suballoc = *srcSuballocIt;
        -
        13516  suballoc.offset = dstAllocOffset;
        -
        13517  suballoc.hAllocation->ChangeBlockAllocation(m_hAllocator, pDstBlock, dstAllocOffset);
        -
        13518  dstOffset = dstAllocOffset + srcAllocSize;
        -
        13519  m_BytesMoved += srcAllocSize;
        -
        13520  ++m_AllocationsMoved;
        -
        13521 
        -
        13522  VmaSuballocationList::iterator nextSuballocIt = srcSuballocIt;
        -
        13523  ++nextSuballocIt;
        -
        13524  pSrcMetadata->m_Suballocations.erase(srcSuballocIt);
        -
        13525  srcSuballocIt = nextSuballocIt;
        -
        13526 
        -
        13527  pDstMetadata->m_Suballocations.push_back(suballoc);
        -
        13528 
        -
        13529  VmaDefragmentationMove move = {
        -
        13530  srcOrigBlockIndex, dstOrigBlockIndex,
        -
        13531  srcAllocOffset, dstAllocOffset,
        -
        13532  srcAllocSize };
        -
        13533  moves.push_back(move);
        -
        13534  }
        -
        13535  }
        -
        13536  }
        -
        13537  }
        +
        13429  if(srcAllocIndex > 0)
        +
        13430  {
        +
        13431  --srcAllocIndex;
        +
        13432  }
        +
        13433  else
        +
        13434  {
        +
        13435  if(srcBlockIndex > 0)
        +
        13436  {
        +
        13437  --srcBlockIndex;
        +
        13438  srcAllocIndex = SIZE_MAX;
        +
        13439  }
        +
        13440  else
        +
        13441  {
        +
        13442  return VK_SUCCESS;
        +
        13443  }
        +
        13444  }
        +
        13445  }
        +
        13446 }
        +
        13447 
        +
        13448 size_t VmaDefragmentationAlgorithm_Generic::CalcBlocksWithNonMovableCount() const
        +
        13449 {
        +
        13450  size_t result = 0;
        +
        13451  for(size_t i = 0; i < m_Blocks.size(); ++i)
        +
        13452  {
        +
        13453  if(m_Blocks[i]->m_HasNonMovableAllocations)
        +
        13454  {
        +
        13455  ++result;
        +
        13456  }
        +
        13457  }
        +
        13458  return result;
        +
        13459 }
        +
        13460 
        +
        13461 VkResult VmaDefragmentationAlgorithm_Generic::Defragment(
        +
        13462  VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> >& moves,
        +
        13463  VkDeviceSize maxBytesToMove,
        +
        13464  uint32_t maxAllocationsToMove,
        +
        13465  VmaDefragmentationFlags flags)
        +
        13466 {
        +
        13467  if(!m_AllAllocations && m_AllocationCount == 0)
        +
        13468  {
        +
        13469  return VK_SUCCESS;
        +
        13470  }
        +
        13471 
        +
        13472  const size_t blockCount = m_Blocks.size();
        +
        13473  for(size_t blockIndex = 0; blockIndex < blockCount; ++blockIndex)
        +
        13474  {
        +
        13475  BlockInfo* pBlockInfo = m_Blocks[blockIndex];
        +
        13476 
        +
        13477  if(m_AllAllocations)
        +
        13478  {
        +
        13479  VmaBlockMetadata_Generic* pMetadata = (VmaBlockMetadata_Generic*)pBlockInfo->m_pBlock->m_pMetadata;
        +
        13480  for(VmaSuballocationList::const_iterator it = pMetadata->m_Suballocations.begin();
        +
        13481  it != pMetadata->m_Suballocations.end();
        +
        13482  ++it)
        +
        13483  {
        +
        13484  if(it->type != VMA_SUBALLOCATION_TYPE_FREE)
        +
        13485  {
        +
        13486  AllocationInfo allocInfo = AllocationInfo(it->hAllocation, VMA_NULL);
        +
        13487  pBlockInfo->m_Allocations.push_back(allocInfo);
        +
        13488  }
        +
        13489  }
        +
        13490  }
        +
        13491 
        +
        13492  pBlockInfo->CalcHasNonMovableAllocations();
        +
        13493 
        +
        13494  // This is a choice based on research.
        +
        13495  // Option 1:
        +
        13496  pBlockInfo->SortAllocationsByOffsetDescending();
        +
        13497  // Option 2:
        +
        13498  //pBlockInfo->SortAllocationsBySizeDescending();
        +
        13499  }
        +
        13500 
        +
        13501  // Sort m_Blocks this time by the main criterium, from most "destination" to most "source" blocks.
        +
        13502  VMA_SORT(m_Blocks.begin(), m_Blocks.end(), BlockInfoCompareMoveDestination());
        +
        13503 
        +
        13504  // This is a choice based on research.
        +
        13505  const uint32_t roundCount = 2;
        +
        13506 
        +
        13507  // Execute defragmentation rounds (the main part).
        +
        13508  VkResult result = VK_SUCCESS;
        +
        13509  for(uint32_t round = 0; (round < roundCount) && (result == VK_SUCCESS); ++round)
        +
        13510  {
        +
        13511  result = DefragmentRound(moves, maxBytesToMove, maxAllocationsToMove, !(flags & VMA_DEFRAGMENTATION_FLAG_INCREMENTAL));
        +
        13512  }
        +
        13513 
        +
        13514  return result;
        +
        13515 }
        +
        13516 
        +
        13517 bool VmaDefragmentationAlgorithm_Generic::MoveMakesSense(
        +
        13518  size_t dstBlockIndex, VkDeviceSize dstOffset,
        +
        13519  size_t srcBlockIndex, VkDeviceSize srcOffset)
        +
        13520 {
        +
        13521  if(dstBlockIndex < srcBlockIndex)
        +
        13522  {
        +
        13523  return true;
        +
        13524  }
        +
        13525  if(dstBlockIndex > srcBlockIndex)
        +
        13526  {
        +
        13527  return false;
        +
        13528  }
        +
        13529  if(dstOffset < srcOffset)
        +
        13530  {
        +
        13531  return true;
        +
        13532  }
        +
        13533  return false;
        +
        13534 }
        +
        13535 
        +
        13537 // VmaDefragmentationAlgorithm_Fast
        13538 
        -
        13539  m_BlockInfos.clear();
        -
        13540 
        -
        13541  PostprocessMetadata();
        -
        13542 
        -
        13543  return VK_SUCCESS;
        -
        13544 }
        -
        13545 
        -
        13546 void VmaDefragmentationAlgorithm_Fast::PreprocessMetadata()
        -
        13547 {
        -
        13548  const size_t blockCount = m_pBlockVector->GetBlockCount();
        -
        13549  for(size_t blockIndex = 0; blockIndex < blockCount; ++blockIndex)
        -
        13550  {
        -
        13551  VmaBlockMetadata_Generic* const pMetadata =
        -
        13552  (VmaBlockMetadata_Generic*)m_pBlockVector->GetBlock(blockIndex)->m_pMetadata;
        -
        13553  pMetadata->m_FreeCount = 0;
        -
        13554  pMetadata->m_SumFreeSize = pMetadata->GetSize();
        -
        13555  pMetadata->m_FreeSuballocationsBySize.clear();
        -
        13556  for(VmaSuballocationList::iterator it = pMetadata->m_Suballocations.begin();
        -
        13557  it != pMetadata->m_Suballocations.end(); )
        -
        13558  {
        -
        13559  if(it->type == VMA_SUBALLOCATION_TYPE_FREE)
        -
        13560  {
        -
        13561  VmaSuballocationList::iterator nextIt = it;
        -
        13562  ++nextIt;
        -
        13563  pMetadata->m_Suballocations.erase(it);
        -
        13564  it = nextIt;
        -
        13565  }
        -
        13566  else
        -
        13567  {
        -
        13568  ++it;
        -
        13569  }
        -
        13570  }
        -
        13571  }
        -
        13572 }
        +
        13539 VmaDefragmentationAlgorithm_Fast::VmaDefragmentationAlgorithm_Fast(
        +
        13540  VmaAllocator hAllocator,
        +
        13541  VmaBlockVector* pBlockVector,
        +
        13542  uint32_t currentFrameIndex,
        +
        13543  bool overlappingMoveSupported) :
        +
        13544  VmaDefragmentationAlgorithm(hAllocator, pBlockVector, currentFrameIndex),
        +
        13545  m_OverlappingMoveSupported(overlappingMoveSupported),
        +
        13546  m_AllocationCount(0),
        +
        13547  m_AllAllocations(false),
        +
        13548  m_BytesMoved(0),
        +
        13549  m_AllocationsMoved(0),
        +
        13550  m_BlockInfos(VmaStlAllocator<BlockInfo>(hAllocator->GetAllocationCallbacks()))
        +
        13551 {
        +
        13552  VMA_ASSERT(VMA_DEBUG_MARGIN == 0);
        +
        13553 
        +
        13554 }
        +
        13555 
        +
        13556 VmaDefragmentationAlgorithm_Fast::~VmaDefragmentationAlgorithm_Fast()
        +
        13557 {
        +
        13558 }
        +
        13559 
        +
        13560 VkResult VmaDefragmentationAlgorithm_Fast::Defragment(
        +
        13561  VmaVector< VmaDefragmentationMove, VmaStlAllocator<VmaDefragmentationMove> >& moves,
        +
        13562  VkDeviceSize maxBytesToMove,
        +
        13563  uint32_t maxAllocationsToMove,
        +
        13564  VmaDefragmentationFlags flags)
        +
        13565 {
        +
        13566  VMA_ASSERT(m_AllAllocations || m_pBlockVector->CalcAllocationCount() == m_AllocationCount);
        +
        13567 
        +
        13568  const size_t blockCount = m_pBlockVector->GetBlockCount();
        +
        13569  if(blockCount == 0 || maxBytesToMove == 0 || maxAllocationsToMove == 0)
        +
        13570  {
        +
        13571  return VK_SUCCESS;
        +
        13572  }
        13573 
        -
        13574 void VmaDefragmentationAlgorithm_Fast::PostprocessMetadata()
        -
        13575 {
        -
        13576  const size_t blockCount = m_pBlockVector->GetBlockCount();
        -
        13577  for(size_t blockIndex = 0; blockIndex < blockCount; ++blockIndex)
        -
        13578  {
        -
        13579  VmaBlockMetadata_Generic* const pMetadata =
        -
        13580  (VmaBlockMetadata_Generic*)m_pBlockVector->GetBlock(blockIndex)->m_pMetadata;
        -
        13581  const VkDeviceSize blockSize = pMetadata->GetSize();
        -
        13582 
        -
        13583  // No allocations in this block - entire area is free.
        -
        13584  if(pMetadata->m_Suballocations.empty())
        -
        13585  {
        -
        13586  pMetadata->m_FreeCount = 1;
        -
        13587  //pMetadata->m_SumFreeSize is already set to blockSize.
        -
        13588  VmaSuballocation suballoc = {
        -
        13589  0, // offset
        -
        13590  blockSize, // size
        -
        13591  VMA_NULL, // hAllocation
        -
        13592  VMA_SUBALLOCATION_TYPE_FREE };
        -
        13593  pMetadata->m_Suballocations.push_back(suballoc);
        -
        13594  pMetadata->RegisterFreeSuballocation(pMetadata->m_Suballocations.begin());
        -
        13595  }
        -
        13596  // There are some allocations in this block.
        -
        13597  else
        -
        13598  {
        -
        13599  VkDeviceSize offset = 0;
        -
        13600  VmaSuballocationList::iterator it;
        -
        13601  for(it = pMetadata->m_Suballocations.begin();
        -
        13602  it != pMetadata->m_Suballocations.end();
        -
        13603  ++it)
        -
        13604  {
        -
        13605  VMA_ASSERT(it->type != VMA_SUBALLOCATION_TYPE_FREE);
        -
        13606  VMA_ASSERT(it->offset >= offset);
        -
        13607 
        -
        13608  // Need to insert preceding free space.
        -
        13609  if(it->offset > offset)
        -
        13610  {
        -
        13611  ++pMetadata->m_FreeCount;
        -
        13612  const VkDeviceSize freeSize = it->offset - offset;
        -
        13613  VmaSuballocation suballoc = {
        -
        13614  offset, // offset
        -
        13615  freeSize, // size
        -
        13616  VMA_NULL, // hAllocation
        -
        13617  VMA_SUBALLOCATION_TYPE_FREE };
        -
        13618  VmaSuballocationList::iterator precedingFreeIt = pMetadata->m_Suballocations.insert(it, suballoc);
        -
        13619  if(freeSize >= VMA_MIN_FREE_SUBALLOCATION_SIZE_TO_REGISTER)
        -
        13620  {
        -
        13621  pMetadata->m_FreeSuballocationsBySize.push_back(precedingFreeIt);
        -
        13622  }
        -
        13623  }
        -
        13624 
        -
        13625  pMetadata->m_SumFreeSize -= it->size;
        -
        13626  offset = it->offset + it->size;
        -
        13627  }
        -
        13628 
        -
        13629  // Need to insert trailing free space.
        -
        13630  if(offset < blockSize)
        -
        13631  {
        -
        13632  ++pMetadata->m_FreeCount;
        -
        13633  const VkDeviceSize freeSize = blockSize - offset;
        -
        13634  VmaSuballocation suballoc = {
        -
        13635  offset, // offset
        -
        13636  freeSize, // size
        -
        13637  VMA_NULL, // hAllocation
        -
        13638  VMA_SUBALLOCATION_TYPE_FREE };
        -
        13639  VMA_ASSERT(it == pMetadata->m_Suballocations.end());
        -
        13640  VmaSuballocationList::iterator trailingFreeIt = pMetadata->m_Suballocations.insert(it, suballoc);
        -
        13641  if(freeSize > VMA_MIN_FREE_SUBALLOCATION_SIZE_TO_REGISTER)
        -
        13642  {
        -
        13643  pMetadata->m_FreeSuballocationsBySize.push_back(trailingFreeIt);
        -
        13644  }
        -
        13645  }
        -
        13646 
        -
        13647  VMA_SORT(
        -
        13648  pMetadata->m_FreeSuballocationsBySize.begin(),
        -
        13649  pMetadata->m_FreeSuballocationsBySize.end(),
        -
        13650  VmaSuballocationItemSizeLess());
        -
        13651  }
        -
        13652 
        -
        13653  VMA_HEAVY_ASSERT(pMetadata->Validate());
        -
        13654  }
        -
        13655 }
        -
        13656 
        -
        13657 void VmaDefragmentationAlgorithm_Fast::InsertSuballoc(VmaBlockMetadata_Generic* pMetadata, const VmaSuballocation& suballoc)
        -
        13658 {
        -
        13659  // TODO: Optimize somehow. Remember iterator instead of searching for it linearly.
        -
        13660  VmaSuballocationList::iterator it = pMetadata->m_Suballocations.begin();
        -
        13661  while(it != pMetadata->m_Suballocations.end())
        -
        13662  {
        -
        13663  if(it->offset < suballoc.offset)
        -
        13664  {
        -
        13665  ++it;
        -
        13666  }
        -
        13667  }
        -
        13668  pMetadata->m_Suballocations.insert(it, suballoc);
        -
        13669 }
        -
        13670 
        -
        13672 // VmaBlockVectorDefragmentationContext
        -
        13673 
        -
        13674 VmaBlockVectorDefragmentationContext::VmaBlockVectorDefragmentationContext(
        -
        13675  VmaAllocator hAllocator,
        -
        13676  VmaPool hCustomPool,
        -
        13677  VmaBlockVector* pBlockVector,
        -
        13678  uint32_t currFrameIndex) :
        -
        13679  res(VK_SUCCESS),
        -
        13680  mutexLocked(false),
        -
        13681  blockContexts(VmaStlAllocator<VmaBlockDefragmentationContext>(hAllocator->GetAllocationCallbacks())),
        -
        13682  m_hAllocator(hAllocator),
        -
        13683  m_hCustomPool(hCustomPool),
        -
        13684  m_pBlockVector(pBlockVector),
        -
        13685  m_CurrFrameIndex(currFrameIndex),
        -
        13686  m_pAlgorithm(VMA_NULL),
        -
        13687  m_Allocations(VmaStlAllocator<AllocInfo>(hAllocator->GetAllocationCallbacks())),
        -
        13688  m_AllAllocations(false)
        -
        13689 {
        -
        13690 }
        +
        13574  PreprocessMetadata();
        +
        13575 
        +
        13576  // Sort blocks in order from most destination.
        +
        13577 
        +
        13578  m_BlockInfos.resize(blockCount);
        +
        13579  for(size_t i = 0; i < blockCount; ++i)
        +
        13580  {
        +
        13581  m_BlockInfos[i].origBlockIndex = i;
        +
        13582  }
        +
        13583 
        +
        13584  VMA_SORT(m_BlockInfos.begin(), m_BlockInfos.end(), [this](const BlockInfo& lhs, const BlockInfo& rhs) -> bool {
        +
        13585  return m_pBlockVector->GetBlock(lhs.origBlockIndex)->m_pMetadata->GetSumFreeSize() <
        +
        13586  m_pBlockVector->GetBlock(rhs.origBlockIndex)->m_pMetadata->GetSumFreeSize();
        +
        13587  });
        +
        13588 
        +
        13589  // THE MAIN ALGORITHM
        +
        13590 
        +
        13591  FreeSpaceDatabase freeSpaceDb;
        +
        13592 
        +
        13593  size_t dstBlockInfoIndex = 0;
        +
        13594  size_t dstOrigBlockIndex = m_BlockInfos[dstBlockInfoIndex].origBlockIndex;
        +
        13595  VmaDeviceMemoryBlock* pDstBlock = m_pBlockVector->GetBlock(dstOrigBlockIndex);
        +
        13596  VmaBlockMetadata_Generic* pDstMetadata = (VmaBlockMetadata_Generic*)pDstBlock->m_pMetadata;
        +
        13597  VkDeviceSize dstBlockSize = pDstMetadata->GetSize();
        +
        13598  VkDeviceSize dstOffset = 0;
        +
        13599 
        +
        13600  bool end = false;
        +
        13601  for(size_t srcBlockInfoIndex = 0; !end && srcBlockInfoIndex < blockCount; ++srcBlockInfoIndex)
        +
        13602  {
        +
        13603  const size_t srcOrigBlockIndex = m_BlockInfos[srcBlockInfoIndex].origBlockIndex;
        +
        13604  VmaDeviceMemoryBlock* const pSrcBlock = m_pBlockVector->GetBlock(srcOrigBlockIndex);
        +
        13605  VmaBlockMetadata_Generic* const pSrcMetadata = (VmaBlockMetadata_Generic*)pSrcBlock->m_pMetadata;
        +
        13606  for(VmaSuballocationList::iterator srcSuballocIt = pSrcMetadata->m_Suballocations.begin();
        +
        13607  !end && srcSuballocIt != pSrcMetadata->m_Suballocations.end(); )
        +
        13608  {
        +
        13609  VmaAllocation_T* const pAlloc = srcSuballocIt->hAllocation;
        +
        13610  const VkDeviceSize srcAllocAlignment = pAlloc->GetAlignment();
        +
        13611  const VkDeviceSize srcAllocSize = srcSuballocIt->size;
        +
        13612  if(m_AllocationsMoved == maxAllocationsToMove ||
        +
        13613  m_BytesMoved + srcAllocSize > maxBytesToMove)
        +
        13614  {
        +
        13615  end = true;
        +
        13616  break;
        +
        13617  }
        +
        13618  const VkDeviceSize srcAllocOffset = srcSuballocIt->offset;
        +
        13619 
        +
        13620  VmaDefragmentationMove move = {};
        +
        13621  // Try to place it in one of free spaces from the database.
        +
        13622  size_t freeSpaceInfoIndex;
        +
        13623  VkDeviceSize dstAllocOffset;
        +
        13624  if(freeSpaceDb.Fetch(srcAllocAlignment, srcAllocSize,
        +
        13625  freeSpaceInfoIndex, dstAllocOffset))
        +
        13626  {
        +
        13627  size_t freeSpaceOrigBlockIndex = m_BlockInfos[freeSpaceInfoIndex].origBlockIndex;
        +
        13628  VmaDeviceMemoryBlock* pFreeSpaceBlock = m_pBlockVector->GetBlock(freeSpaceOrigBlockIndex);
        +
        13629  VmaBlockMetadata_Generic* pFreeSpaceMetadata = (VmaBlockMetadata_Generic*)pFreeSpaceBlock->m_pMetadata;
        +
        13630 
        +
        13631  // Same block
        +
        13632  if(freeSpaceInfoIndex == srcBlockInfoIndex)
        +
        13633  {
        +
        13634  VMA_ASSERT(dstAllocOffset <= srcAllocOffset);
        +
        13635 
        +
        13636  // MOVE OPTION 1: Move the allocation inside the same block by decreasing offset.
        +
        13637 
        +
        13638  VmaSuballocation suballoc = *srcSuballocIt;
        +
        13639  suballoc.offset = dstAllocOffset;
        +
        13640  suballoc.hAllocation->ChangeOffset(dstAllocOffset);
        +
        13641  m_BytesMoved += srcAllocSize;
        +
        13642  ++m_AllocationsMoved;
        +
        13643 
        +
        13644  VmaSuballocationList::iterator nextSuballocIt = srcSuballocIt;
        +
        13645  ++nextSuballocIt;
        +
        13646  pSrcMetadata->m_Suballocations.erase(srcSuballocIt);
        +
        13647  srcSuballocIt = nextSuballocIt;
        +
        13648 
        +
        13649  InsertSuballoc(pFreeSpaceMetadata, suballoc);
        +
        13650 
        +
        13651  move.srcBlockIndex = srcOrigBlockIndex;
        +
        13652  move.dstBlockIndex = freeSpaceOrigBlockIndex;
        +
        13653  move.srcOffset = srcAllocOffset;
        +
        13654  move.dstOffset = dstAllocOffset;
        +
        13655  move.size = srcAllocSize;
        +
        13656 
        +
        13657  moves.push_back(move);
        +
        13658  }
        +
        13659  // Different block
        +
        13660  else
        +
        13661  {
        +
        13662  // MOVE OPTION 2: Move the allocation to a different block.
        +
        13663 
        +
        13664  VMA_ASSERT(freeSpaceInfoIndex < srcBlockInfoIndex);
        +
        13665 
        +
        13666  VmaSuballocation suballoc = *srcSuballocIt;
        +
        13667  suballoc.offset = dstAllocOffset;
        +
        13668  suballoc.hAllocation->ChangeBlockAllocation(m_hAllocator, pFreeSpaceBlock, dstAllocOffset);
        +
        13669  m_BytesMoved += srcAllocSize;
        +
        13670  ++m_AllocationsMoved;
        +
        13671 
        +
        13672  VmaSuballocationList::iterator nextSuballocIt = srcSuballocIt;
        +
        13673  ++nextSuballocIt;
        +
        13674  pSrcMetadata->m_Suballocations.erase(srcSuballocIt);
        +
        13675  srcSuballocIt = nextSuballocIt;
        +
        13676 
        +
        13677  InsertSuballoc(pFreeSpaceMetadata, suballoc);
        +
        13678 
        +
        13679  move.srcBlockIndex = srcOrigBlockIndex;
        +
        13680  move.dstBlockIndex = freeSpaceOrigBlockIndex;
        +
        13681  move.srcOffset = srcAllocOffset;
        +
        13682  move.dstOffset = dstAllocOffset;
        +
        13683  move.size = srcAllocSize;
        +
        13684 
        +
        13685  moves.push_back(move);
        +
        13686  }
        +
        13687  }
        +
        13688  else
        +
        13689  {
        +
        13690  dstAllocOffset = VmaAlignUp(dstOffset, srcAllocAlignment);
        13691 
        -
        13692 VmaBlockVectorDefragmentationContext::~VmaBlockVectorDefragmentationContext()
        -
        13693 {
        -
        13694  vma_delete(m_hAllocator, m_pAlgorithm);
        -
        13695 }
        -
        13696 
        -
        13697 void VmaBlockVectorDefragmentationContext::AddAllocation(VmaAllocation hAlloc, VkBool32* pChanged)
        -
        13698 {
        -
        13699  AllocInfo info = { hAlloc, pChanged };
        -
        13700  m_Allocations.push_back(info);
        -
        13701 }
        -
        13702 
        -
        13703 void VmaBlockVectorDefragmentationContext::Begin(bool overlappingMoveSupported)
        -
        13704 {
        -
        13705  const bool allAllocations = m_AllAllocations ||
        -
        13706  m_Allocations.size() == m_pBlockVector->CalcAllocationCount();
        +
        13692  // If the allocation doesn't fit before the end of dstBlock, forward to next block.
        +
        13693  while(dstBlockInfoIndex < srcBlockInfoIndex &&
        +
        13694  dstAllocOffset + srcAllocSize > dstBlockSize)
        +
        13695  {
        +
        13696  // But before that, register remaining free space at the end of dst block.
        +
        13697  freeSpaceDb.Register(dstBlockInfoIndex, dstOffset, dstBlockSize - dstOffset);
        +
        13698 
        +
        13699  ++dstBlockInfoIndex;
        +
        13700  dstOrigBlockIndex = m_BlockInfos[dstBlockInfoIndex].origBlockIndex;
        +
        13701  pDstBlock = m_pBlockVector->GetBlock(dstOrigBlockIndex);
        +
        13702  pDstMetadata = (VmaBlockMetadata_Generic*)pDstBlock->m_pMetadata;
        +
        13703  dstBlockSize = pDstMetadata->GetSize();
        +
        13704  dstOffset = 0;
        +
        13705  dstAllocOffset = 0;
        +
        13706  }
        13707 
        -
        13708  /********************************
        -
        13709  HERE IS THE CHOICE OF DEFRAGMENTATION ALGORITHM.
        -
        13710  ********************************/
        -
        13711 
        -
        13712  /*
        -
        13713  Fast algorithm is supported only when certain criteria are met:
        -
        13714  - VMA_DEBUG_MARGIN is 0.
        -
        13715  - All allocations in this block vector are moveable.
        -
        13716  - There is no possibility of image/buffer granularity conflict.
        -
        13717  */
        -
        13718  if(VMA_DEBUG_MARGIN == 0 &&
        -
        13719  allAllocations &&
        -
        13720  !m_pBlockVector->IsBufferImageGranularityConflictPossible())
        -
        13721  {
        -
        13722  m_pAlgorithm = vma_new(m_hAllocator, VmaDefragmentationAlgorithm_Fast)(
        -
        13723  m_hAllocator, m_pBlockVector, m_CurrFrameIndex, overlappingMoveSupported);
        -
        13724  }
        -
        13725  else
        -
        13726  {
        -
        13727  m_pAlgorithm = vma_new(m_hAllocator, VmaDefragmentationAlgorithm_Generic)(
        -
        13728  m_hAllocator, m_pBlockVector, m_CurrFrameIndex, overlappingMoveSupported);
        -
        13729  }
        -
        13730 
        -
        13731  if(allAllocations)
        -
        13732  {
        -
        13733  m_pAlgorithm->AddAll();
        -
        13734  }
        -
        13735  else
        -
        13736  {
        -
        13737  for(size_t i = 0, count = m_Allocations.size(); i < count; ++i)
        -
        13738  {
        -
        13739  m_pAlgorithm->AddAllocation(m_Allocations[i].hAlloc, m_Allocations[i].pChanged);
        -
        13740  }
        -
        13741  }
        -
        13742 }
        -
        13743 
        -
        13745 // VmaDefragmentationContext
        -
        13746 
        -
        13747 VmaDefragmentationContext_T::VmaDefragmentationContext_T(
        -
        13748  VmaAllocator hAllocator,
        -
        13749  uint32_t currFrameIndex,
        -
        13750  uint32_t flags,
        -
        13751  VmaDefragmentationStats* pStats) :
        -
        13752  m_hAllocator(hAllocator),
        -
        13753  m_CurrFrameIndex(currFrameIndex),
        -
        13754  m_Flags(flags),
        -
        13755  m_pStats(pStats),
        -
        13756  m_CustomPoolContexts(VmaStlAllocator<VmaBlockVectorDefragmentationContext*>(hAllocator->GetAllocationCallbacks()))
        -
        13757 {
        -
        13758  memset(m_DefaultPoolContexts, 0, sizeof(m_DefaultPoolContexts));
        -
        13759 }
        -
        13760 
        -
        13761 VmaDefragmentationContext_T::~VmaDefragmentationContext_T()
        -
        13762 {
        -
        13763  for(size_t i = m_CustomPoolContexts.size(); i--; )
        -
        13764  {
        -
        13765  VmaBlockVectorDefragmentationContext* pBlockVectorCtx = m_CustomPoolContexts[i];
        -
        13766  pBlockVectorCtx->GetBlockVector()->DefragmentationEnd(pBlockVectorCtx, m_pStats);
        -
        13767  vma_delete(m_hAllocator, pBlockVectorCtx);
        -
        13768  }
        -
        13769  for(size_t i = m_hAllocator->m_MemProps.memoryTypeCount; i--; )
        -
        13770  {
        -
        13771  VmaBlockVectorDefragmentationContext* pBlockVectorCtx = m_DefaultPoolContexts[i];
        -
        13772  if(pBlockVectorCtx)
        -
        13773  {
        -
        13774  pBlockVectorCtx->GetBlockVector()->DefragmentationEnd(pBlockVectorCtx, m_pStats);
        -
        13775  vma_delete(m_hAllocator, pBlockVectorCtx);
        -
        13776  }
        -
        13777  }
        -
        13778 }
        -
        13779 
        -
        13780 void VmaDefragmentationContext_T::AddPools(uint32_t poolCount, VmaPool* pPools)
        -
        13781 {
        -
        13782  for(uint32_t poolIndex = 0; poolIndex < poolCount; ++poolIndex)
        -
        13783  {
        -
        13784  VmaPool pool = pPools[poolIndex];
        -
        13785  VMA_ASSERT(pool);
        -
        13786  // Pools with algorithm other than default are not defragmented.
        -
        13787  if(pool->m_BlockVector.GetAlgorithm() == 0)
        -
        13788  {
        -
        13789  VmaBlockVectorDefragmentationContext* pBlockVectorDefragCtx = VMA_NULL;
        -
        13790 
        -
        13791  for(size_t i = m_CustomPoolContexts.size(); i--; )
        -
        13792  {
        -
        13793  if(m_CustomPoolContexts[i]->GetCustomPool() == pool)
        -
        13794  {
        -
        13795  pBlockVectorDefragCtx = m_CustomPoolContexts[i];
        -
        13796  break;
        -
        13797  }
        -
        13798  }
        -
        13799 
        -
        13800  if(!pBlockVectorDefragCtx)
        -
        13801  {
        -
        13802  pBlockVectorDefragCtx = vma_new(m_hAllocator, VmaBlockVectorDefragmentationContext)(
        -
        13803  m_hAllocator,
        -
        13804  pool,
        -
        13805  &pool->m_BlockVector,
        -
        13806  m_CurrFrameIndex);
        -
        13807  m_CustomPoolContexts.push_back(pBlockVectorDefragCtx);
        -
        13808  }
        -
        13809 
        -
        13810  pBlockVectorDefragCtx->AddAll();
        -
        13811  }
        -
        13812  }
        -
        13813 }
        -
        13814 
        -
        13815 void VmaDefragmentationContext_T::AddAllocations(
        -
        13816  uint32_t allocationCount,
        -
        13817  VmaAllocation* pAllocations,
        -
        13818  VkBool32* pAllocationsChanged)
        +
        13708  // Same block
        +
        13709  if(dstBlockInfoIndex == srcBlockInfoIndex)
        +
        13710  {
        +
        13711  VMA_ASSERT(dstAllocOffset <= srcAllocOffset);
        +
        13712 
        +
        13713  const bool overlap = dstAllocOffset + srcAllocSize > srcAllocOffset;
        +
        13714 
        +
        13715  bool skipOver = overlap;
        +
        13716  if(overlap && m_OverlappingMoveSupported && dstAllocOffset < srcAllocOffset)
        +
        13717  {
        +
        13718  // If destination and source place overlap, skip if it would move it
        +
        13719  // by only < 1/64 of its size.
        +
        13720  skipOver = (srcAllocOffset - dstAllocOffset) * 64 < srcAllocSize;
        +
        13721  }
        +
        13722 
        +
        13723  if(skipOver)
        +
        13724  {
        +
        13725  freeSpaceDb.Register(dstBlockInfoIndex, dstOffset, srcAllocOffset - dstOffset);
        +
        13726 
        +
        13727  dstOffset = srcAllocOffset + srcAllocSize;
        +
        13728  ++srcSuballocIt;
        +
        13729  }
        +
        13730  // MOVE OPTION 1: Move the allocation inside the same block by decreasing offset.
        +
        13731  else
        +
        13732  {
        +
        13733  srcSuballocIt->offset = dstAllocOffset;
        +
        13734  srcSuballocIt->hAllocation->ChangeOffset(dstAllocOffset);
        +
        13735  dstOffset = dstAllocOffset + srcAllocSize;
        +
        13736  m_BytesMoved += srcAllocSize;
        +
        13737  ++m_AllocationsMoved;
        +
        13738  ++srcSuballocIt;
        +
        13739 
        +
        13740  move.srcBlockIndex = srcOrigBlockIndex;
        +
        13741  move.dstBlockIndex = dstOrigBlockIndex;
        +
        13742  move.srcOffset = srcAllocOffset;
        +
        13743  move.dstOffset = dstAllocOffset;
        +
        13744  move.size = srcAllocSize;
        +
        13745 
        +
        13746  moves.push_back(move);
        +
        13747  }
        +
        13748  }
        +
        13749  // Different block
        +
        13750  else
        +
        13751  {
        +
        13752  // MOVE OPTION 2: Move the allocation to a different block.
        +
        13753 
        +
        13754  VMA_ASSERT(dstBlockInfoIndex < srcBlockInfoIndex);
        +
        13755  VMA_ASSERT(dstAllocOffset + srcAllocSize <= dstBlockSize);
        +
        13756 
        +
        13757  VmaSuballocation suballoc = *srcSuballocIt;
        +
        13758  suballoc.offset = dstAllocOffset;
        +
        13759  suballoc.hAllocation->ChangeBlockAllocation(m_hAllocator, pDstBlock, dstAllocOffset);
        +
        13760  dstOffset = dstAllocOffset + srcAllocSize;
        +
        13761  m_BytesMoved += srcAllocSize;
        +
        13762  ++m_AllocationsMoved;
        +
        13763 
        +
        13764  VmaSuballocationList::iterator nextSuballocIt = srcSuballocIt;
        +
        13765  ++nextSuballocIt;
        +
        13766  pSrcMetadata->m_Suballocations.erase(srcSuballocIt);
        +
        13767  srcSuballocIt = nextSuballocIt;
        +
        13768 
        +
        13769  pDstMetadata->m_Suballocations.push_back(suballoc);
        +
        13770 
        +
        13771  move.srcBlockIndex = srcOrigBlockIndex;
        +
        13772  move.dstBlockIndex = dstOrigBlockIndex;
        +
        13773  move.srcOffset = srcAllocOffset;
        +
        13774  move.dstOffset = dstAllocOffset;
        +
        13775  move.size = srcAllocSize;
        +
        13776 
        +
        13777  moves.push_back(move);
        +
        13778  }
        +
        13779  }
        +
        13780  }
        +
        13781  }
        +
        13782 
        +
        13783  m_BlockInfos.clear();
        +
        13784 
        +
        13785  PostprocessMetadata();
        +
        13786 
        +
        13787  return VK_SUCCESS;
        +
        13788 }
        +
        13789 
        +
        13790 void VmaDefragmentationAlgorithm_Fast::PreprocessMetadata()
        +
        13791 {
        +
        13792  const size_t blockCount = m_pBlockVector->GetBlockCount();
        +
        13793  for(size_t blockIndex = 0; blockIndex < blockCount; ++blockIndex)
        +
        13794  {
        +
        13795  VmaBlockMetadata_Generic* const pMetadata =
        +
        13796  (VmaBlockMetadata_Generic*)m_pBlockVector->GetBlock(blockIndex)->m_pMetadata;
        +
        13797  pMetadata->m_FreeCount = 0;
        +
        13798  pMetadata->m_SumFreeSize = pMetadata->GetSize();
        +
        13799  pMetadata->m_FreeSuballocationsBySize.clear();
        +
        13800  for(VmaSuballocationList::iterator it = pMetadata->m_Suballocations.begin();
        +
        13801  it != pMetadata->m_Suballocations.end(); )
        +
        13802  {
        +
        13803  if(it->type == VMA_SUBALLOCATION_TYPE_FREE)
        +
        13804  {
        +
        13805  VmaSuballocationList::iterator nextIt = it;
        +
        13806  ++nextIt;
        +
        13807  pMetadata->m_Suballocations.erase(it);
        +
        13808  it = nextIt;
        +
        13809  }
        +
        13810  else
        +
        13811  {
        +
        13812  ++it;
        +
        13813  }
        +
        13814  }
        +
        13815  }
        +
        13816 }
        +
        13817 
        +
        13818 void VmaDefragmentationAlgorithm_Fast::PostprocessMetadata()
        13819 {
        -
        13820  // Dispatch pAllocations among defragmentators. Create them when necessary.
        -
        13821  for(uint32_t allocIndex = 0; allocIndex < allocationCount; ++allocIndex)
        +
        13820  const size_t blockCount = m_pBlockVector->GetBlockCount();
        +
        13821  for(size_t blockIndex = 0; blockIndex < blockCount; ++blockIndex)
        13822  {
        -
        13823  const VmaAllocation hAlloc = pAllocations[allocIndex];
        -
        13824  VMA_ASSERT(hAlloc);
        -
        13825  // DedicatedAlloc cannot be defragmented.
        -
        13826  if((hAlloc->GetType() == VmaAllocation_T::ALLOCATION_TYPE_BLOCK) &&
        -
        13827  // Lost allocation cannot be defragmented.
        -
        13828  (hAlloc->GetLastUseFrameIndex() != VMA_FRAME_INDEX_LOST))
        +
        13823  VmaBlockMetadata_Generic* const pMetadata =
        +
        13824  (VmaBlockMetadata_Generic*)m_pBlockVector->GetBlock(blockIndex)->m_pMetadata;
        +
        13825  const VkDeviceSize blockSize = pMetadata->GetSize();
        +
        13826 
        +
        13827  // No allocations in this block - entire area is free.
        +
        13828  if(pMetadata->m_Suballocations.empty())
        13829  {
        -
        13830  VmaBlockVectorDefragmentationContext* pBlockVectorDefragCtx = VMA_NULL;
        -
        13831 
        -
        13832  const VmaPool hAllocPool = hAlloc->GetBlock()->GetParentPool();
        -
        13833  // This allocation belongs to custom pool.
        -
        13834  if(hAllocPool != VK_NULL_HANDLE)
        -
        13835  {
        -
        13836  // Pools with algorithm other than default are not defragmented.
        -
        13837  if(hAllocPool->m_BlockVector.GetAlgorithm() == 0)
        -
        13838  {
        -
        13839  for(size_t i = m_CustomPoolContexts.size(); i--; )
        -
        13840  {
        -
        13841  if(m_CustomPoolContexts[i]->GetCustomPool() == hAllocPool)
        -
        13842  {
        -
        13843  pBlockVectorDefragCtx = m_CustomPoolContexts[i];
        -
        13844  break;
        -
        13845  }
        -
        13846  }
        -
        13847  if(!pBlockVectorDefragCtx)
        -
        13848  {
        -
        13849  pBlockVectorDefragCtx = vma_new(m_hAllocator, VmaBlockVectorDefragmentationContext)(
        -
        13850  m_hAllocator,
        -
        13851  hAllocPool,
        -
        13852  &hAllocPool->m_BlockVector,
        -
        13853  m_CurrFrameIndex);
        -
        13854  m_CustomPoolContexts.push_back(pBlockVectorDefragCtx);
        -
        13855  }
        -
        13856  }
        -
        13857  }
        -
        13858  // This allocation belongs to default pool.
        -
        13859  else
        -
        13860  {
        -
        13861  const uint32_t memTypeIndex = hAlloc->GetMemoryTypeIndex();
        -
        13862  pBlockVectorDefragCtx = m_DefaultPoolContexts[memTypeIndex];
        -
        13863  if(!pBlockVectorDefragCtx)
        -
        13864  {
        -
        13865  pBlockVectorDefragCtx = vma_new(m_hAllocator, VmaBlockVectorDefragmentationContext)(
        -
        13866  m_hAllocator,
        -
        13867  VMA_NULL, // hCustomPool
        -
        13868  m_hAllocator->m_pBlockVectors[memTypeIndex],
        -
        13869  m_CurrFrameIndex);
        -
        13870  m_DefaultPoolContexts[memTypeIndex] = pBlockVectorDefragCtx;
        -
        13871  }
        -
        13872  }
        -
        13873 
        -
        13874  if(pBlockVectorDefragCtx)
        +
        13830  pMetadata->m_FreeCount = 1;
        +
        13831  //pMetadata->m_SumFreeSize is already set to blockSize.
        +
        13832  VmaSuballocation suballoc = {
        +
        13833  0, // offset
        +
        13834  blockSize, // size
        +
        13835  VMA_NULL, // hAllocation
        +
        13836  VMA_SUBALLOCATION_TYPE_FREE };
        +
        13837  pMetadata->m_Suballocations.push_back(suballoc);
        +
        13838  pMetadata->RegisterFreeSuballocation(pMetadata->m_Suballocations.begin());
        +
        13839  }
        +
        13840  // There are some allocations in this block.
        +
        13841  else
        +
        13842  {
        +
        13843  VkDeviceSize offset = 0;
        +
        13844  VmaSuballocationList::iterator it;
        +
        13845  for(it = pMetadata->m_Suballocations.begin();
        +
        13846  it != pMetadata->m_Suballocations.end();
        +
        13847  ++it)
        +
        13848  {
        +
        13849  VMA_ASSERT(it->type != VMA_SUBALLOCATION_TYPE_FREE);
        +
        13850  VMA_ASSERT(it->offset >= offset);
        +
        13851 
        +
        13852  // Need to insert preceding free space.
        +
        13853  if(it->offset > offset)
        +
        13854  {
        +
        13855  ++pMetadata->m_FreeCount;
        +
        13856  const VkDeviceSize freeSize = it->offset - offset;
        +
        13857  VmaSuballocation suballoc = {
        +
        13858  offset, // offset
        +
        13859  freeSize, // size
        +
        13860  VMA_NULL, // hAllocation
        +
        13861  VMA_SUBALLOCATION_TYPE_FREE };
        +
        13862  VmaSuballocationList::iterator precedingFreeIt = pMetadata->m_Suballocations.insert(it, suballoc);
        +
        13863  if(freeSize >= VMA_MIN_FREE_SUBALLOCATION_SIZE_TO_REGISTER)
        +
        13864  {
        +
        13865  pMetadata->m_FreeSuballocationsBySize.push_back(precedingFreeIt);
        +
        13866  }
        +
        13867  }
        +
        13868 
        +
        13869  pMetadata->m_SumFreeSize -= it->size;
        +
        13870  offset = it->offset + it->size;
        +
        13871  }
        +
        13872 
        +
        13873  // Need to insert trailing free space.
        +
        13874  if(offset < blockSize)
        13875  {
        -
        13876  VkBool32* const pChanged = (pAllocationsChanged != VMA_NULL) ?
        -
        13877  &pAllocationsChanged[allocIndex] : VMA_NULL;
        -
        13878  pBlockVectorDefragCtx->AddAllocation(hAlloc, pChanged);
        -
        13879  }
        -
        13880  }
        -
        13881  }
        -
        13882 }
        -
        13883 
        -
        13884 VkResult VmaDefragmentationContext_T::Defragment(
        -
        13885  VkDeviceSize maxCpuBytesToMove, uint32_t maxCpuAllocationsToMove,
        -
        13886  VkDeviceSize maxGpuBytesToMove, uint32_t maxGpuAllocationsToMove,
        -
        13887  VkCommandBuffer commandBuffer, VmaDefragmentationStats* pStats)
        -
        13888 {
        -
        13889  if(pStats)
        -
        13890  {
        -
        13891  memset(pStats, 0, sizeof(VmaDefragmentationStats));
        -
        13892  }
        -
        13893 
        -
        13894  if(commandBuffer == VK_NULL_HANDLE)
        -
        13895  {
        -
        13896  maxGpuBytesToMove = 0;
        -
        13897  maxGpuAllocationsToMove = 0;
        +
        13876  ++pMetadata->m_FreeCount;
        +
        13877  const VkDeviceSize freeSize = blockSize - offset;
        +
        13878  VmaSuballocation suballoc = {
        +
        13879  offset, // offset
        +
        13880  freeSize, // size
        +
        13881  VMA_NULL, // hAllocation
        +
        13882  VMA_SUBALLOCATION_TYPE_FREE };
        +
        13883  VMA_ASSERT(it == pMetadata->m_Suballocations.end());
        +
        13884  VmaSuballocationList::iterator trailingFreeIt = pMetadata->m_Suballocations.insert(it, suballoc);
        +
        13885  if(freeSize > VMA_MIN_FREE_SUBALLOCATION_SIZE_TO_REGISTER)
        +
        13886  {
        +
        13887  pMetadata->m_FreeSuballocationsBySize.push_back(trailingFreeIt);
        +
        13888  }
        +
        13889  }
        +
        13890 
        +
        13891  VMA_SORT(
        +
        13892  pMetadata->m_FreeSuballocationsBySize.begin(),
        +
        13893  pMetadata->m_FreeSuballocationsBySize.end(),
        +
        13894  VmaSuballocationItemSizeLess());
        +
        13895  }
        +
        13896 
        +
        13897  VMA_HEAVY_ASSERT(pMetadata->Validate());
        13898  }
        -
        13899 
        -
        13900  VkResult res = VK_SUCCESS;
        -
        13901 
        -
        13902  // Process default pools.
        -
        13903  for(uint32_t memTypeIndex = 0;
        -
        13904  memTypeIndex < m_hAllocator->GetMemoryTypeCount() && res >= VK_SUCCESS;
        -
        13905  ++memTypeIndex)
        +
        13899 }
        +
        13900 
        +
        13901 void VmaDefragmentationAlgorithm_Fast::InsertSuballoc(VmaBlockMetadata_Generic* pMetadata, const VmaSuballocation& suballoc)
        +
        13902 {
        +
        13903  // TODO: Optimize somehow. Remember iterator instead of searching for it linearly.
        +
        13904  VmaSuballocationList::iterator it = pMetadata->m_Suballocations.begin();
        +
        13905  while(it != pMetadata->m_Suballocations.end())
        13906  {
        -
        13907  VmaBlockVectorDefragmentationContext* pBlockVectorCtx = m_DefaultPoolContexts[memTypeIndex];
        -
        13908  if(pBlockVectorCtx)
        -
        13909  {
        -
        13910  VMA_ASSERT(pBlockVectorCtx->GetBlockVector());
        -
        13911  pBlockVectorCtx->GetBlockVector()->Defragment(
        -
        13912  pBlockVectorCtx,
        -
        13913  pStats,
        -
        13914  maxCpuBytesToMove, maxCpuAllocationsToMove,
        -
        13915  maxGpuBytesToMove, maxGpuAllocationsToMove,
        -
        13916  commandBuffer);
        -
        13917  if(pBlockVectorCtx->res != VK_SUCCESS)
        -
        13918  {
        -
        13919  res = pBlockVectorCtx->res;
        -
        13920  }
        -
        13921  }
        -
        13922  }
        -
        13923 
        -
        13924  // Process custom pools.
        -
        13925  for(size_t customCtxIndex = 0, customCtxCount = m_CustomPoolContexts.size();
        -
        13926  customCtxIndex < customCtxCount && res >= VK_SUCCESS;
        -
        13927  ++customCtxIndex)
        -
        13928  {
        -
        13929  VmaBlockVectorDefragmentationContext* pBlockVectorCtx = m_CustomPoolContexts[customCtxIndex];
        -
        13930  VMA_ASSERT(pBlockVectorCtx && pBlockVectorCtx->GetBlockVector());
        -
        13931  pBlockVectorCtx->GetBlockVector()->Defragment(
        -
        13932  pBlockVectorCtx,
        -
        13933  pStats,
        -
        13934  maxCpuBytesToMove, maxCpuAllocationsToMove,
        -
        13935  maxGpuBytesToMove, maxGpuAllocationsToMove,
        -
        13936  commandBuffer);
        -
        13937  if(pBlockVectorCtx->res != VK_SUCCESS)
        -
        13938  {
        -
        13939  res = pBlockVectorCtx->res;
        -
        13940  }
        -
        13941  }
        -
        13942 
        -
        13943  return res;
        -
        13944 }
        -
        13945 
        -
        13947 // VmaRecorder
        -
        13948 
        -
        13949 #if VMA_RECORDING_ENABLED
        +
        13907  if(it->offset < suballoc.offset)
        +
        13908  {
        +
        13909  ++it;
        +
        13910  }
        +
        13911  }
        +
        13912  pMetadata->m_Suballocations.insert(it, suballoc);
        +
        13913 }
        +
        13914 
        +
        13916 // VmaBlockVectorDefragmentationContext
        +
        13917 
        +
        13918 VmaBlockVectorDefragmentationContext::VmaBlockVectorDefragmentationContext(
        +
        13919  VmaAllocator hAllocator,
        +
        13920  VmaPool hCustomPool,
        +
        13921  VmaBlockVector* pBlockVector,
        +
        13922  uint32_t currFrameIndex) :
        +
        13923  res(VK_SUCCESS),
        +
        13924  mutexLocked(false),
        +
        13925  blockContexts(VmaStlAllocator<VmaBlockDefragmentationContext>(hAllocator->GetAllocationCallbacks())),
        +
        13926  defragmentationMoves(VmaStlAllocator<VmaDefragmentationMove>(hAllocator->GetAllocationCallbacks())),
        +
        13927  defragmentationMovesProcessed(0),
        +
        13928  defragmentationMovesCommitted(0),
        +
        13929  hasDefragmentationPlan(0),
        +
        13930  m_hAllocator(hAllocator),
        +
        13931  m_hCustomPool(hCustomPool),
        +
        13932  m_pBlockVector(pBlockVector),
        +
        13933  m_CurrFrameIndex(currFrameIndex),
        +
        13934  m_pAlgorithm(VMA_NULL),
        +
        13935  m_Allocations(VmaStlAllocator<AllocInfo>(hAllocator->GetAllocationCallbacks())),
        +
        13936  m_AllAllocations(false)
        +
        13937 {
        +
        13938 }
        +
        13939 
        +
        13940 VmaBlockVectorDefragmentationContext::~VmaBlockVectorDefragmentationContext()
        +
        13941 {
        +
        13942  vma_delete(m_hAllocator, m_pAlgorithm);
        +
        13943 }
        +
        13944 
        +
        13945 void VmaBlockVectorDefragmentationContext::AddAllocation(VmaAllocation hAlloc, VkBool32* pChanged)
        +
        13946 {
        +
        13947  AllocInfo info = { hAlloc, pChanged };
        +
        13948  m_Allocations.push_back(info);
        +
        13949 }
        13950 
        -
        13951 VmaRecorder::VmaRecorder() :
        -
        13952  m_UseMutex(true),
        -
        13953  m_Flags(0),
        -
        13954  m_File(VMA_NULL),
        -
        13955  m_Freq(INT64_MAX),
        -
        13956  m_StartCounter(INT64_MAX)
        -
        13957 {
        -
        13958 }
        +
        13951 void VmaBlockVectorDefragmentationContext::Begin(bool overlappingMoveSupported, VmaDefragmentationFlags flags)
        +
        13952 {
        +
        13953  const bool allAllocations = m_AllAllocations ||
        +
        13954  m_Allocations.size() == m_pBlockVector->CalcAllocationCount();
        +
        13955 
        +
        13956  /********************************
        +
        13957  HERE IS THE CHOICE OF DEFRAGMENTATION ALGORITHM.
        +
        13958  ********************************/
        13959 
        -
        13960 VkResult VmaRecorder::Init(const VmaRecordSettings& settings, bool useMutex)
        -
        13961 {
        -
        13962  m_UseMutex = useMutex;
        -
        13963  m_Flags = settings.flags;
        -
        13964 
        -
        13965  QueryPerformanceFrequency((LARGE_INTEGER*)&m_Freq);
        -
        13966  QueryPerformanceCounter((LARGE_INTEGER*)&m_StartCounter);
        -
        13967 
        -
        13968  // Open file for writing.
        -
        13969  errno_t err = fopen_s(&m_File, settings.pFilePath, "wb");
        -
        13970  if(err != 0)
        +
        13960  /*
        +
        13961  Fast algorithm is supported only when certain criteria are met:
        +
        13962  - VMA_DEBUG_MARGIN is 0.
        +
        13963  - All allocations in this block vector are moveable.
        +
        13964  - There is no possibility of image/buffer granularity conflict.
        +
        13965  - The defragmentation is not incremental
        +
        13966  */
        +
        13967  if(VMA_DEBUG_MARGIN == 0 &&
        +
        13968  allAllocations &&
        +
        13969  !m_pBlockVector->IsBufferImageGranularityConflictPossible() &&
        +
        13970  !(flags & VMA_DEFRAGMENTATION_FLAG_INCREMENTAL))
        13971  {
        -
        13972  return VK_ERROR_INITIALIZATION_FAILED;
        -
        13973  }
        -
        13974 
        -
        13975  // Write header.
        -
        13976  fprintf(m_File, "%s\n", "Vulkan Memory Allocator,Calls recording");
        -
        13977  fprintf(m_File, "%s\n", "1,8");
        -
        13978 
        -
        13979  return VK_SUCCESS;
        -
        13980 }
        -
        13981 
        -
        13982 VmaRecorder::~VmaRecorder()
        -
        13983 {
        -
        13984  if(m_File != VMA_NULL)
        -
        13985  {
        -
        13986  fclose(m_File);
        -
        13987  }
        -
        13988 }
        -
        13989 
        -
        13990 void VmaRecorder::RecordCreateAllocator(uint32_t frameIndex)
        -
        13991 {
        -
        13992  CallParams callParams;
        -
        13993  GetBasicParams(callParams);
        -
        13994 
        -
        13995  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        13996  fprintf(m_File, "%u,%.3f,%u,vmaCreateAllocator\n", callParams.threadId, callParams.time, frameIndex);
        -
        13997  Flush();
        -
        13998 }
        -
        13999 
        -
        14000 void VmaRecorder::RecordDestroyAllocator(uint32_t frameIndex)
        -
        14001 {
        -
        14002  CallParams callParams;
        -
        14003  GetBasicParams(callParams);
        -
        14004 
        -
        14005  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14006  fprintf(m_File, "%u,%.3f,%u,vmaDestroyAllocator\n", callParams.threadId, callParams.time, frameIndex);
        -
        14007  Flush();
        -
        14008 }
        -
        14009 
        -
        14010 void VmaRecorder::RecordCreatePool(uint32_t frameIndex, const VmaPoolCreateInfo& createInfo, VmaPool pool)
        -
        14011 {
        -
        14012  CallParams callParams;
        -
        14013  GetBasicParams(callParams);
        -
        14014 
        -
        14015  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14016  fprintf(m_File, "%u,%.3f,%u,vmaCreatePool,%u,%u,%llu,%llu,%llu,%u,%p\n", callParams.threadId, callParams.time, frameIndex,
        -
        14017  createInfo.memoryTypeIndex,
        -
        14018  createInfo.flags,
        -
        14019  createInfo.blockSize,
        -
        14020  (uint64_t)createInfo.minBlockCount,
        -
        14021  (uint64_t)createInfo.maxBlockCount,
        -
        14022  createInfo.frameInUseCount,
        -
        14023  pool);
        -
        14024  Flush();
        -
        14025 }
        -
        14026 
        -
        14027 void VmaRecorder::RecordDestroyPool(uint32_t frameIndex, VmaPool pool)
        -
        14028 {
        -
        14029  CallParams callParams;
        -
        14030  GetBasicParams(callParams);
        -
        14031 
        -
        14032  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14033  fprintf(m_File, "%u,%.3f,%u,vmaDestroyPool,%p\n", callParams.threadId, callParams.time, frameIndex,
        -
        14034  pool);
        -
        14035  Flush();
        -
        14036 }
        -
        14037 
        -
        14038 void VmaRecorder::RecordAllocateMemory(uint32_t frameIndex,
        -
        14039  const VkMemoryRequirements& vkMemReq,
        -
        14040  const VmaAllocationCreateInfo& createInfo,
        -
        14041  VmaAllocation allocation)
        -
        14042 {
        -
        14043  CallParams callParams;
        -
        14044  GetBasicParams(callParams);
        -
        14045 
        -
        14046  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14047  UserDataString userDataStr(createInfo.flags, createInfo.pUserData);
        -
        14048  fprintf(m_File, "%u,%.3f,%u,vmaAllocateMemory,%llu,%llu,%u,%u,%u,%u,%u,%u,%p,%p,%s\n", callParams.threadId, callParams.time, frameIndex,
        -
        14049  vkMemReq.size,
        -
        14050  vkMemReq.alignment,
        -
        14051  vkMemReq.memoryTypeBits,
        -
        14052  createInfo.flags,
        -
        14053  createInfo.usage,
        -
        14054  createInfo.requiredFlags,
        -
        14055  createInfo.preferredFlags,
        -
        14056  createInfo.memoryTypeBits,
        -
        14057  createInfo.pool,
        -
        14058  allocation,
        -
        14059  userDataStr.GetString());
        -
        14060  Flush();
        -
        14061 }
        -
        14062 
        -
        14063 void VmaRecorder::RecordAllocateMemoryPages(uint32_t frameIndex,
        -
        14064  const VkMemoryRequirements& vkMemReq,
        -
        14065  const VmaAllocationCreateInfo& createInfo,
        -
        14066  uint64_t allocationCount,
        -
        14067  const VmaAllocation* pAllocations)
        -
        14068 {
        -
        14069  CallParams callParams;
        -
        14070  GetBasicParams(callParams);
        -
        14071 
        -
        14072  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14073  UserDataString userDataStr(createInfo.flags, createInfo.pUserData);
        -
        14074  fprintf(m_File, "%u,%.3f,%u,vmaAllocateMemoryPages,%llu,%llu,%u,%u,%u,%u,%u,%u,%p,", callParams.threadId, callParams.time, frameIndex,
        -
        14075  vkMemReq.size,
        -
        14076  vkMemReq.alignment,
        -
        14077  vkMemReq.memoryTypeBits,
        -
        14078  createInfo.flags,
        -
        14079  createInfo.usage,
        -
        14080  createInfo.requiredFlags,
        -
        14081  createInfo.preferredFlags,
        -
        14082  createInfo.memoryTypeBits,
        -
        14083  createInfo.pool);
        -
        14084  PrintPointerList(allocationCount, pAllocations);
        -
        14085  fprintf(m_File, ",%s\n", userDataStr.GetString());
        -
        14086  Flush();
        -
        14087 }
        -
        14088 
        -
        14089 void VmaRecorder::RecordAllocateMemoryForBuffer(uint32_t frameIndex,
        -
        14090  const VkMemoryRequirements& vkMemReq,
        -
        14091  bool requiresDedicatedAllocation,
        -
        14092  bool prefersDedicatedAllocation,
        -
        14093  const VmaAllocationCreateInfo& createInfo,
        -
        14094  VmaAllocation allocation)
        -
        14095 {
        -
        14096  CallParams callParams;
        -
        14097  GetBasicParams(callParams);
        -
        14098 
        -
        14099  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14100  UserDataString userDataStr(createInfo.flags, createInfo.pUserData);
        -
        14101  fprintf(m_File, "%u,%.3f,%u,vmaAllocateMemoryForBuffer,%llu,%llu,%u,%u,%u,%u,%u,%u,%u,%u,%p,%p,%s\n", callParams.threadId, callParams.time, frameIndex,
        -
        14102  vkMemReq.size,
        -
        14103  vkMemReq.alignment,
        -
        14104  vkMemReq.memoryTypeBits,
        -
        14105  requiresDedicatedAllocation ? 1 : 0,
        -
        14106  prefersDedicatedAllocation ? 1 : 0,
        -
        14107  createInfo.flags,
        -
        14108  createInfo.usage,
        -
        14109  createInfo.requiredFlags,
        -
        14110  createInfo.preferredFlags,
        -
        14111  createInfo.memoryTypeBits,
        -
        14112  createInfo.pool,
        -
        14113  allocation,
        -
        14114  userDataStr.GetString());
        -
        14115  Flush();
        -
        14116 }
        -
        14117 
        -
        14118 void VmaRecorder::RecordAllocateMemoryForImage(uint32_t frameIndex,
        -
        14119  const VkMemoryRequirements& vkMemReq,
        -
        14120  bool requiresDedicatedAllocation,
        -
        14121  bool prefersDedicatedAllocation,
        -
        14122  const VmaAllocationCreateInfo& createInfo,
        -
        14123  VmaAllocation allocation)
        -
        14124 {
        -
        14125  CallParams callParams;
        -
        14126  GetBasicParams(callParams);
        -
        14127 
        -
        14128  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14129  UserDataString userDataStr(createInfo.flags, createInfo.pUserData);
        -
        14130  fprintf(m_File, "%u,%.3f,%u,vmaAllocateMemoryForImage,%llu,%llu,%u,%u,%u,%u,%u,%u,%u,%u,%p,%p,%s\n", callParams.threadId, callParams.time, frameIndex,
        -
        14131  vkMemReq.size,
        -
        14132  vkMemReq.alignment,
        -
        14133  vkMemReq.memoryTypeBits,
        -
        14134  requiresDedicatedAllocation ? 1 : 0,
        -
        14135  prefersDedicatedAllocation ? 1 : 0,
        -
        14136  createInfo.flags,
        -
        14137  createInfo.usage,
        -
        14138  createInfo.requiredFlags,
        -
        14139  createInfo.preferredFlags,
        -
        14140  createInfo.memoryTypeBits,
        -
        14141  createInfo.pool,
        -
        14142  allocation,
        -
        14143  userDataStr.GetString());
        -
        14144  Flush();
        -
        14145 }
        -
        14146 
        -
        14147 void VmaRecorder::RecordFreeMemory(uint32_t frameIndex,
        -
        14148  VmaAllocation allocation)
        -
        14149 {
        -
        14150  CallParams callParams;
        -
        14151  GetBasicParams(callParams);
        -
        14152 
        -
        14153  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14154  fprintf(m_File, "%u,%.3f,%u,vmaFreeMemory,%p\n", callParams.threadId, callParams.time, frameIndex,
        -
        14155  allocation);
        -
        14156  Flush();
        -
        14157 }
        -
        14158 
        -
        14159 void VmaRecorder::RecordFreeMemoryPages(uint32_t frameIndex,
        -
        14160  uint64_t allocationCount,
        -
        14161  const VmaAllocation* pAllocations)
        -
        14162 {
        -
        14163  CallParams callParams;
        -
        14164  GetBasicParams(callParams);
        -
        14165 
        -
        14166  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14167  fprintf(m_File, "%u,%.3f,%u,vmaFreeMemoryPages,", callParams.threadId, callParams.time, frameIndex);
        -
        14168  PrintPointerList(allocationCount, pAllocations);
        -
        14169  fprintf(m_File, "\n");
        -
        14170  Flush();
        -
        14171 }
        -
        14172 
        -
        14173 void VmaRecorder::RecordSetAllocationUserData(uint32_t frameIndex,
        -
        14174  VmaAllocation allocation,
        -
        14175  const void* pUserData)
        -
        14176 {
        -
        14177  CallParams callParams;
        -
        14178  GetBasicParams(callParams);
        -
        14179 
        -
        14180  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14181  UserDataString userDataStr(
        -
        14182  allocation->IsUserDataString() ? VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT : 0,
        -
        14183  pUserData);
        -
        14184  fprintf(m_File, "%u,%.3f,%u,vmaSetAllocationUserData,%p,%s\n", callParams.threadId, callParams.time, frameIndex,
        -
        14185  allocation,
        -
        14186  userDataStr.GetString());
        -
        14187  Flush();
        -
        14188 }
        -
        14189 
        -
        14190 void VmaRecorder::RecordCreateLostAllocation(uint32_t frameIndex,
        -
        14191  VmaAllocation allocation)
        -
        14192 {
        -
        14193  CallParams callParams;
        -
        14194  GetBasicParams(callParams);
        -
        14195 
        -
        14196  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14197  fprintf(m_File, "%u,%.3f,%u,vmaCreateLostAllocation,%p\n", callParams.threadId, callParams.time, frameIndex,
        -
        14198  allocation);
        -
        14199  Flush();
        -
        14200 }
        -
        14201 
        -
        14202 void VmaRecorder::RecordMapMemory(uint32_t frameIndex,
        -
        14203  VmaAllocation allocation)
        -
        14204 {
        -
        14205  CallParams callParams;
        -
        14206  GetBasicParams(callParams);
        -
        14207 
        -
        14208  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14209  fprintf(m_File, "%u,%.3f,%u,vmaMapMemory,%p\n", callParams.threadId, callParams.time, frameIndex,
        -
        14210  allocation);
        -
        14211  Flush();
        -
        14212 }
        -
        14213 
        -
        14214 void VmaRecorder::RecordUnmapMemory(uint32_t frameIndex,
        -
        14215  VmaAllocation allocation)
        -
        14216 {
        -
        14217  CallParams callParams;
        -
        14218  GetBasicParams(callParams);
        -
        14219 
        -
        14220  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14221  fprintf(m_File, "%u,%.3f,%u,vmaUnmapMemory,%p\n", callParams.threadId, callParams.time, frameIndex,
        -
        14222  allocation);
        -
        14223  Flush();
        -
        14224 }
        -
        14225 
        -
        14226 void VmaRecorder::RecordFlushAllocation(uint32_t frameIndex,
        -
        14227  VmaAllocation allocation, VkDeviceSize offset, VkDeviceSize size)
        -
        14228 {
        -
        14229  CallParams callParams;
        -
        14230  GetBasicParams(callParams);
        -
        14231 
        -
        14232  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14233  fprintf(m_File, "%u,%.3f,%u,vmaFlushAllocation,%p,%llu,%llu\n", callParams.threadId, callParams.time, frameIndex,
        -
        14234  allocation,
        -
        14235  offset,
        -
        14236  size);
        -
        14237  Flush();
        -
        14238 }
        +
        13972  m_pAlgorithm = vma_new(m_hAllocator, VmaDefragmentationAlgorithm_Fast)(
        +
        13973  m_hAllocator, m_pBlockVector, m_CurrFrameIndex, overlappingMoveSupported);
        +
        13974  }
        +
        13975  else
        +
        13976  {
        +
        13977  m_pAlgorithm = vma_new(m_hAllocator, VmaDefragmentationAlgorithm_Generic)(
        +
        13978  m_hAllocator, m_pBlockVector, m_CurrFrameIndex, overlappingMoveSupported);
        +
        13979  }
        +
        13980 
        +
        13981  if(allAllocations)
        +
        13982  {
        +
        13983  m_pAlgorithm->AddAll();
        +
        13984  }
        +
        13985  else
        +
        13986  {
        +
        13987  for(size_t i = 0, count = m_Allocations.size(); i < count; ++i)
        +
        13988  {
        +
        13989  m_pAlgorithm->AddAllocation(m_Allocations[i].hAlloc, m_Allocations[i].pChanged);
        +
        13990  }
        +
        13991  }
        +
        13992 }
        +
        13993 
        +
        13995 // VmaDefragmentationContext
        +
        13996 
        +
        13997 VmaDefragmentationContext_T::VmaDefragmentationContext_T(
        +
        13998  VmaAllocator hAllocator,
        +
        13999  uint32_t currFrameIndex,
        +
        14000  uint32_t flags,
        +
        14001  VmaDefragmentationStats* pStats) :
        +
        14002  m_hAllocator(hAllocator),
        +
        14003  m_CurrFrameIndex(currFrameIndex),
        +
        14004  m_Flags(flags),
        +
        14005  m_pStats(pStats),
        +
        14006  m_CustomPoolContexts(VmaStlAllocator<VmaBlockVectorDefragmentationContext*>(hAllocator->GetAllocationCallbacks()))
        +
        14007 {
        +
        14008  memset(m_DefaultPoolContexts, 0, sizeof(m_DefaultPoolContexts));
        +
        14009 }
        +
        14010 
        +
        14011 VmaDefragmentationContext_T::~VmaDefragmentationContext_T()
        +
        14012 {
        +
        14013  for(size_t i = m_CustomPoolContexts.size(); i--; )
        +
        14014  {
        +
        14015  VmaBlockVectorDefragmentationContext* pBlockVectorCtx = m_CustomPoolContexts[i];
        +
        14016  pBlockVectorCtx->GetBlockVector()->DefragmentationEnd(pBlockVectorCtx, m_pStats);
        +
        14017  vma_delete(m_hAllocator, pBlockVectorCtx);
        +
        14018  }
        +
        14019  for(size_t i = m_hAllocator->m_MemProps.memoryTypeCount; i--; )
        +
        14020  {
        +
        14021  VmaBlockVectorDefragmentationContext* pBlockVectorCtx = m_DefaultPoolContexts[i];
        +
        14022  if(pBlockVectorCtx)
        +
        14023  {
        +
        14024  pBlockVectorCtx->GetBlockVector()->DefragmentationEnd(pBlockVectorCtx, m_pStats);
        +
        14025  vma_delete(m_hAllocator, pBlockVectorCtx);
        +
        14026  }
        +
        14027  }
        +
        14028 }
        +
        14029 
        +
        14030 void VmaDefragmentationContext_T::AddPools(uint32_t poolCount, VmaPool* pPools)
        +
        14031 {
        +
        14032  for(uint32_t poolIndex = 0; poolIndex < poolCount; ++poolIndex)
        +
        14033  {
        +
        14034  VmaPool pool = pPools[poolIndex];
        +
        14035  VMA_ASSERT(pool);
        +
        14036  // Pools with algorithm other than default are not defragmented.
        +
        14037  if(pool->m_BlockVector.GetAlgorithm() == 0)
        +
        14038  {
        +
        14039  VmaBlockVectorDefragmentationContext* pBlockVectorDefragCtx = VMA_NULL;
        +
        14040 
        +
        14041  for(size_t i = m_CustomPoolContexts.size(); i--; )
        +
        14042  {
        +
        14043  if(m_CustomPoolContexts[i]->GetCustomPool() == pool)
        +
        14044  {
        +
        14045  pBlockVectorDefragCtx = m_CustomPoolContexts[i];
        +
        14046  break;
        +
        14047  }
        +
        14048  }
        +
        14049 
        +
        14050  if(!pBlockVectorDefragCtx)
        +
        14051  {
        +
        14052  pBlockVectorDefragCtx = vma_new(m_hAllocator, VmaBlockVectorDefragmentationContext)(
        +
        14053  m_hAllocator,
        +
        14054  pool,
        +
        14055  &pool->m_BlockVector,
        +
        14056  m_CurrFrameIndex);
        +
        14057  m_CustomPoolContexts.push_back(pBlockVectorDefragCtx);
        +
        14058  }
        +
        14059 
        +
        14060  pBlockVectorDefragCtx->AddAll();
        +
        14061  }
        +
        14062  }
        +
        14063 }
        +
        14064 
        +
        14065 void VmaDefragmentationContext_T::AddAllocations(
        +
        14066  uint32_t allocationCount,
        +
        14067  VmaAllocation* pAllocations,
        +
        14068  VkBool32* pAllocationsChanged)
        +
        14069 {
        +
        14070  // Dispatch pAllocations among defragmentators. Create them when necessary.
        +
        14071  for(uint32_t allocIndex = 0; allocIndex < allocationCount; ++allocIndex)
        +
        14072  {
        +
        14073  const VmaAllocation hAlloc = pAllocations[allocIndex];
        +
        14074  VMA_ASSERT(hAlloc);
        +
        14075  // DedicatedAlloc cannot be defragmented.
        +
        14076  if((hAlloc->GetType() == VmaAllocation_T::ALLOCATION_TYPE_BLOCK) &&
        +
        14077  // Lost allocation cannot be defragmented.
        +
        14078  (hAlloc->GetLastUseFrameIndex() != VMA_FRAME_INDEX_LOST))
        +
        14079  {
        +
        14080  VmaBlockVectorDefragmentationContext* pBlockVectorDefragCtx = VMA_NULL;
        +
        14081 
        +
        14082  const VmaPool hAllocPool = hAlloc->GetBlock()->GetParentPool();
        +
        14083  // This allocation belongs to custom pool.
        +
        14084  if(hAllocPool != VK_NULL_HANDLE)
        +
        14085  {
        +
        14086  // Pools with algorithm other than default are not defragmented.
        +
        14087  if(hAllocPool->m_BlockVector.GetAlgorithm() == 0)
        +
        14088  {
        +
        14089  for(size_t i = m_CustomPoolContexts.size(); i--; )
        +
        14090  {
        +
        14091  if(m_CustomPoolContexts[i]->GetCustomPool() == hAllocPool)
        +
        14092  {
        +
        14093  pBlockVectorDefragCtx = m_CustomPoolContexts[i];
        +
        14094  break;
        +
        14095  }
        +
        14096  }
        +
        14097  if(!pBlockVectorDefragCtx)
        +
        14098  {
        +
        14099  pBlockVectorDefragCtx = vma_new(m_hAllocator, VmaBlockVectorDefragmentationContext)(
        +
        14100  m_hAllocator,
        +
        14101  hAllocPool,
        +
        14102  &hAllocPool->m_BlockVector,
        +
        14103  m_CurrFrameIndex);
        +
        14104  m_CustomPoolContexts.push_back(pBlockVectorDefragCtx);
        +
        14105  }
        +
        14106  }
        +
        14107  }
        +
        14108  // This allocation belongs to default pool.
        +
        14109  else
        +
        14110  {
        +
        14111  const uint32_t memTypeIndex = hAlloc->GetMemoryTypeIndex();
        +
        14112  pBlockVectorDefragCtx = m_DefaultPoolContexts[memTypeIndex];
        +
        14113  if(!pBlockVectorDefragCtx)
        +
        14114  {
        +
        14115  pBlockVectorDefragCtx = vma_new(m_hAllocator, VmaBlockVectorDefragmentationContext)(
        +
        14116  m_hAllocator,
        +
        14117  VMA_NULL, // hCustomPool
        +
        14118  m_hAllocator->m_pBlockVectors[memTypeIndex],
        +
        14119  m_CurrFrameIndex);
        +
        14120  m_DefaultPoolContexts[memTypeIndex] = pBlockVectorDefragCtx;
        +
        14121  }
        +
        14122  }
        +
        14123 
        +
        14124  if(pBlockVectorDefragCtx)
        +
        14125  {
        +
        14126  VkBool32* const pChanged = (pAllocationsChanged != VMA_NULL) ?
        +
        14127  &pAllocationsChanged[allocIndex] : VMA_NULL;
        +
        14128  pBlockVectorDefragCtx->AddAllocation(hAlloc, pChanged);
        +
        14129  }
        +
        14130  }
        +
        14131  }
        +
        14132 }
        +
        14133 
        +
        14134 VkResult VmaDefragmentationContext_T::Defragment(
        +
        14135  VkDeviceSize maxCpuBytesToMove, uint32_t maxCpuAllocationsToMove,
        +
        14136  VkDeviceSize maxGpuBytesToMove, uint32_t maxGpuAllocationsToMove,
        +
        14137  VkCommandBuffer commandBuffer, VmaDefragmentationStats* pStats, VmaDefragmentationFlags flags)
        +
        14138 {
        +
        14139  if(pStats)
        +
        14140  {
        +
        14141  memset(pStats, 0, sizeof(VmaDefragmentationStats));
        +
        14142  }
        +
        14143 
        +
        14144  if(flags & VMA_DEFRAGMENTATION_FLAG_INCREMENTAL)
        +
        14145  {
        +
        14146  // For incremental defragmetnations, we just earmark how much we can move
        +
        14147  // The real meat is in the defragmentation steps
        +
        14148  m_MaxCpuBytesToMove = maxCpuBytesToMove;
        +
        14149  m_MaxCpuAllocationsToMove = maxCpuAllocationsToMove;
        +
        14150 
        +
        14151  m_MaxGpuBytesToMove = maxGpuBytesToMove;
        +
        14152  m_MaxGpuAllocationsToMove = maxGpuAllocationsToMove;
        +
        14153 
        +
        14154  if(m_MaxCpuBytesToMove == 0 && m_MaxCpuAllocationsToMove == 0 &&
        +
        14155  m_MaxGpuBytesToMove == 0 && m_MaxGpuAllocationsToMove == 0)
        +
        14156  return VK_SUCCESS;
        +
        14157 
        +
        14158  return VK_NOT_READY;
        +
        14159  }
        +
        14160 
        +
        14161  if(commandBuffer == VK_NULL_HANDLE)
        +
        14162  {
        +
        14163  maxGpuBytesToMove = 0;
        +
        14164  maxGpuAllocationsToMove = 0;
        +
        14165  }
        +
        14166 
        +
        14167  VkResult res = VK_SUCCESS;
        +
        14168 
        +
        14169  // Process default pools.
        +
        14170  for(uint32_t memTypeIndex = 0;
        +
        14171  memTypeIndex < m_hAllocator->GetMemoryTypeCount() && res >= VK_SUCCESS;
        +
        14172  ++memTypeIndex)
        +
        14173  {
        +
        14174  VmaBlockVectorDefragmentationContext* pBlockVectorCtx = m_DefaultPoolContexts[memTypeIndex];
        +
        14175  if(pBlockVectorCtx)
        +
        14176  {
        +
        14177  VMA_ASSERT(pBlockVectorCtx->GetBlockVector());
        +
        14178  pBlockVectorCtx->GetBlockVector()->Defragment(
        +
        14179  pBlockVectorCtx,
        +
        14180  pStats, flags,
        +
        14181  maxCpuBytesToMove, maxCpuAllocationsToMove,
        +
        14182  maxGpuBytesToMove, maxGpuAllocationsToMove,
        +
        14183  commandBuffer);
        +
        14184  if(pBlockVectorCtx->res != VK_SUCCESS)
        +
        14185  {
        +
        14186  res = pBlockVectorCtx->res;
        +
        14187  }
        +
        14188  }
        +
        14189  }
        +
        14190 
        +
        14191  // Process custom pools.
        +
        14192  for(size_t customCtxIndex = 0, customCtxCount = m_CustomPoolContexts.size();
        +
        14193  customCtxIndex < customCtxCount && res >= VK_SUCCESS;
        +
        14194  ++customCtxIndex)
        +
        14195  {
        +
        14196  VmaBlockVectorDefragmentationContext* pBlockVectorCtx = m_CustomPoolContexts[customCtxIndex];
        +
        14197  VMA_ASSERT(pBlockVectorCtx && pBlockVectorCtx->GetBlockVector());
        +
        14198  pBlockVectorCtx->GetBlockVector()->Defragment(
        +
        14199  pBlockVectorCtx,
        +
        14200  pStats, flags,
        +
        14201  maxCpuBytesToMove, maxCpuAllocationsToMove,
        +
        14202  maxGpuBytesToMove, maxGpuAllocationsToMove,
        +
        14203  commandBuffer);
        +
        14204  if(pBlockVectorCtx->res != VK_SUCCESS)
        +
        14205  {
        +
        14206  res = pBlockVectorCtx->res;
        +
        14207  }
        +
        14208  }
        +
        14209 
        +
        14210  return res;
        +
        14211 }
        +
        14212 
        +
        14213 VkResult VmaDefragmentationContext_T::DefragmentPassBegin(VmaDefragmentationPassInfo* pInfo)
        +
        14214 {
        +
        14215  VmaDefragmentationPassMoveInfo* pCurrentMove = pInfo->pMoves;
        +
        14216  uint32_t movesLeft = pInfo->moveCount;
        +
        14217 
        +
        14218  // Process default pools.
        +
        14219  for(uint32_t memTypeIndex = 0;
        +
        14220  memTypeIndex < m_hAllocator->GetMemoryTypeCount();
        +
        14221  ++memTypeIndex)
        +
        14222  {
        +
        14223  VmaBlockVectorDefragmentationContext *pBlockVectorCtx = m_DefaultPoolContexts[memTypeIndex];
        +
        14224  if(pBlockVectorCtx)
        +
        14225  {
        +
        14226  VMA_ASSERT(pBlockVectorCtx->GetBlockVector());
        +
        14227 
        +
        14228  if(!pBlockVectorCtx->hasDefragmentationPlan)
        +
        14229  {
        +
        14230  pBlockVectorCtx->GetBlockVector()->Defragment(
        +
        14231  pBlockVectorCtx,
        +
        14232  m_pStats, m_Flags,
        +
        14233  m_MaxCpuBytesToMove, m_MaxCpuAllocationsToMove,
        +
        14234  m_MaxGpuBytesToMove, m_MaxGpuAllocationsToMove,
        +
        14235  VK_NULL_HANDLE);
        +
        14236 
        +
        14237  if(pBlockVectorCtx->res < VK_SUCCESS)
        +
        14238  continue;
        14239 
        -
        14240 void VmaRecorder::RecordInvalidateAllocation(uint32_t frameIndex,
        -
        14241  VmaAllocation allocation, VkDeviceSize offset, VkDeviceSize size)
        -
        14242 {
        -
        14243  CallParams callParams;
        -
        14244  GetBasicParams(callParams);
        -
        14245 
        -
        14246  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14247  fprintf(m_File, "%u,%.3f,%u,vmaInvalidateAllocation,%p,%llu,%llu\n", callParams.threadId, callParams.time, frameIndex,
        -
        14248  allocation,
        -
        14249  offset,
        -
        14250  size);
        -
        14251  Flush();
        -
        14252 }
        -
        14253 
        -
        14254 void VmaRecorder::RecordCreateBuffer(uint32_t frameIndex,
        -
        14255  const VkBufferCreateInfo& bufCreateInfo,
        -
        14256  const VmaAllocationCreateInfo& allocCreateInfo,
        -
        14257  VmaAllocation allocation)
        -
        14258 {
        -
        14259  CallParams callParams;
        -
        14260  GetBasicParams(callParams);
        -
        14261 
        -
        14262  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14263  UserDataString userDataStr(allocCreateInfo.flags, allocCreateInfo.pUserData);
        -
        14264  fprintf(m_File, "%u,%.3f,%u,vmaCreateBuffer,%u,%llu,%u,%u,%u,%u,%u,%u,%u,%p,%p,%s\n", callParams.threadId, callParams.time, frameIndex,
        -
        14265  bufCreateInfo.flags,
        -
        14266  bufCreateInfo.size,
        -
        14267  bufCreateInfo.usage,
        -
        14268  bufCreateInfo.sharingMode,
        -
        14269  allocCreateInfo.flags,
        -
        14270  allocCreateInfo.usage,
        -
        14271  allocCreateInfo.requiredFlags,
        -
        14272  allocCreateInfo.preferredFlags,
        -
        14273  allocCreateInfo.memoryTypeBits,
        -
        14274  allocCreateInfo.pool,
        -
        14275  allocation,
        -
        14276  userDataStr.GetString());
        -
        14277  Flush();
        -
        14278 }
        -
        14279 
        -
        14280 void VmaRecorder::RecordCreateImage(uint32_t frameIndex,
        -
        14281  const VkImageCreateInfo& imageCreateInfo,
        -
        14282  const VmaAllocationCreateInfo& allocCreateInfo,
        -
        14283  VmaAllocation allocation)
        -
        14284 {
        -
        14285  CallParams callParams;
        -
        14286  GetBasicParams(callParams);
        -
        14287 
        -
        14288  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14289  UserDataString userDataStr(allocCreateInfo.flags, allocCreateInfo.pUserData);
        -
        14290  fprintf(m_File, "%u,%.3f,%u,vmaCreateImage,%u,%u,%u,%u,%u,%u,%u,%u,%u,%u,%u,%u,%u,%u,%u,%u,%u,%u,%p,%p,%s\n", callParams.threadId, callParams.time, frameIndex,
        -
        14291  imageCreateInfo.flags,
        -
        14292  imageCreateInfo.imageType,
        -
        14293  imageCreateInfo.format,
        -
        14294  imageCreateInfo.extent.width,
        -
        14295  imageCreateInfo.extent.height,
        -
        14296  imageCreateInfo.extent.depth,
        -
        14297  imageCreateInfo.mipLevels,
        -
        14298  imageCreateInfo.arrayLayers,
        -
        14299  imageCreateInfo.samples,
        -
        14300  imageCreateInfo.tiling,
        -
        14301  imageCreateInfo.usage,
        -
        14302  imageCreateInfo.sharingMode,
        -
        14303  imageCreateInfo.initialLayout,
        -
        14304  allocCreateInfo.flags,
        -
        14305  allocCreateInfo.usage,
        -
        14306  allocCreateInfo.requiredFlags,
        -
        14307  allocCreateInfo.preferredFlags,
        -
        14308  allocCreateInfo.memoryTypeBits,
        -
        14309  allocCreateInfo.pool,
        -
        14310  allocation,
        -
        14311  userDataStr.GetString());
        -
        14312  Flush();
        -
        14313 }
        +
        14240  pBlockVectorCtx->hasDefragmentationPlan = true;
        +
        14241  }
        +
        14242 
        +
        14243  const uint32_t processed = pBlockVectorCtx->GetBlockVector()->ProcessDefragmentations(
        +
        14244  pBlockVectorCtx,
        +
        14245  pCurrentMove, movesLeft);
        +
        14246 
        +
        14247  movesLeft -= processed;
        +
        14248  pCurrentMove += processed;
        +
        14249  }
        +
        14250  }
        +
        14251 
        +
        14252  // Process custom pools.
        +
        14253  for(size_t customCtxIndex = 0, customCtxCount = m_CustomPoolContexts.size();
        +
        14254  customCtxIndex < customCtxCount;
        +
        14255  ++customCtxIndex)
        +
        14256  {
        +
        14257  VmaBlockVectorDefragmentationContext *pBlockVectorCtx = m_CustomPoolContexts[customCtxIndex];
        +
        14258  VMA_ASSERT(pBlockVectorCtx && pBlockVectorCtx->GetBlockVector());
        +
        14259 
        +
        14260  if(!pBlockVectorCtx->hasDefragmentationPlan)
        +
        14261  {
        +
        14262  pBlockVectorCtx->GetBlockVector()->Defragment(
        +
        14263  pBlockVectorCtx,
        +
        14264  m_pStats, m_Flags,
        +
        14265  m_MaxCpuBytesToMove, m_MaxCpuAllocationsToMove,
        +
        14266  m_MaxGpuBytesToMove, m_MaxGpuAllocationsToMove,
        +
        14267  VK_NULL_HANDLE);
        +
        14268 
        +
        14269  if(pBlockVectorCtx->res < VK_SUCCESS)
        +
        14270  continue;
        +
        14271 
        +
        14272  pBlockVectorCtx->hasDefragmentationPlan = true;
        +
        14273  }
        +
        14274 
        +
        14275  const uint32_t processed = pBlockVectorCtx->GetBlockVector()->ProcessDefragmentations(
        +
        14276  pBlockVectorCtx,
        +
        14277  pCurrentMove, movesLeft);
        +
        14278 
        +
        14279  movesLeft -= processed;
        +
        14280  pCurrentMove += processed;
        +
        14281  }
        +
        14282 
        +
        14283  pInfo->moveCount = pInfo->moveCount - movesLeft;
        +
        14284 
        +
        14285  return VK_SUCCESS;
        +
        14286 }
        +
        14287 VkResult VmaDefragmentationContext_T::DefragmentPassEnd()
        +
        14288 {
        +
        14289  VkResult res = VK_SUCCESS;
        +
        14290 
        +
        14291  // Process default pools.
        +
        14292  for(uint32_t memTypeIndex = 0;
        +
        14293  memTypeIndex < m_hAllocator->GetMemoryTypeCount();
        +
        14294  ++memTypeIndex)
        +
        14295  {
        +
        14296  VmaBlockVectorDefragmentationContext *pBlockVectorCtx = m_DefaultPoolContexts[memTypeIndex];
        +
        14297  if(pBlockVectorCtx)
        +
        14298  {
        +
        14299  VMA_ASSERT(pBlockVectorCtx->GetBlockVector());
        +
        14300 
        +
        14301  if(!pBlockVectorCtx->hasDefragmentationPlan)
        +
        14302  {
        +
        14303  res = VK_NOT_READY;
        +
        14304  continue;
        +
        14305  }
        +
        14306 
        +
        14307  pBlockVectorCtx->GetBlockVector()->CommitDefragmentations(
        +
        14308  pBlockVectorCtx, m_pStats);
        +
        14309 
        +
        14310  if(pBlockVectorCtx->defragmentationMoves.size() != pBlockVectorCtx->defragmentationMovesCommitted)
        +
        14311  res = VK_NOT_READY;
        +
        14312  }
        +
        14313  }
        14314 
        -
        14315 void VmaRecorder::RecordDestroyBuffer(uint32_t frameIndex,
        -
        14316  VmaAllocation allocation)
        -
        14317 {
        -
        14318  CallParams callParams;
        -
        14319  GetBasicParams(callParams);
        -
        14320 
        -
        14321  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14322  fprintf(m_File, "%u,%.3f,%u,vmaDestroyBuffer,%p\n", callParams.threadId, callParams.time, frameIndex,
        -
        14323  allocation);
        -
        14324  Flush();
        -
        14325 }
        -
        14326 
        -
        14327 void VmaRecorder::RecordDestroyImage(uint32_t frameIndex,
        -
        14328  VmaAllocation allocation)
        -
        14329 {
        -
        14330  CallParams callParams;
        -
        14331  GetBasicParams(callParams);
        -
        14332 
        -
        14333  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14334  fprintf(m_File, "%u,%.3f,%u,vmaDestroyImage,%p\n", callParams.threadId, callParams.time, frameIndex,
        -
        14335  allocation);
        -
        14336  Flush();
        +
        14315  // Process custom pools.
        +
        14316  for(size_t customCtxIndex = 0, customCtxCount = m_CustomPoolContexts.size();
        +
        14317  customCtxIndex < customCtxCount;
        +
        14318  ++customCtxIndex)
        +
        14319  {
        +
        14320  VmaBlockVectorDefragmentationContext *pBlockVectorCtx = m_CustomPoolContexts[customCtxIndex];
        +
        14321  VMA_ASSERT(pBlockVectorCtx && pBlockVectorCtx->GetBlockVector());
        +
        14322 
        +
        14323  if(!pBlockVectorCtx->hasDefragmentationPlan)
        +
        14324  {
        +
        14325  res = VK_NOT_READY;
        +
        14326  continue;
        +
        14327  }
        +
        14328 
        +
        14329  pBlockVectorCtx->GetBlockVector()->CommitDefragmentations(
        +
        14330  pBlockVectorCtx, m_pStats);
        +
        14331 
        +
        14332  if(pBlockVectorCtx->defragmentationMoves.size() != pBlockVectorCtx->defragmentationMovesCommitted)
        +
        14333  res = VK_NOT_READY;
        +
        14334  }
        +
        14335 
        +
        14336  return res;
        14337 }
        14338 
        -
        14339 void VmaRecorder::RecordTouchAllocation(uint32_t frameIndex,
        -
        14340  VmaAllocation allocation)
        -
        14341 {
        -
        14342  CallParams callParams;
        -
        14343  GetBasicParams(callParams);
        -
        14344 
        -
        14345  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14346  fprintf(m_File, "%u,%.3f,%u,vmaTouchAllocation,%p\n", callParams.threadId, callParams.time, frameIndex,
        -
        14347  allocation);
        -
        14348  Flush();
        -
        14349 }
        -
        14350 
        -
        14351 void VmaRecorder::RecordGetAllocationInfo(uint32_t frameIndex,
        -
        14352  VmaAllocation allocation)
        -
        14353 {
        -
        14354  CallParams callParams;
        -
        14355  GetBasicParams(callParams);
        -
        14356 
        -
        14357  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14358  fprintf(m_File, "%u,%.3f,%u,vmaGetAllocationInfo,%p\n", callParams.threadId, callParams.time, frameIndex,
        -
        14359  allocation);
        -
        14360  Flush();
        -
        14361 }
        -
        14362 
        -
        14363 void VmaRecorder::RecordMakePoolAllocationsLost(uint32_t frameIndex,
        -
        14364  VmaPool pool)
        -
        14365 {
        -
        14366  CallParams callParams;
        -
        14367  GetBasicParams(callParams);
        -
        14368 
        -
        14369  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14370  fprintf(m_File, "%u,%.3f,%u,vmaMakePoolAllocationsLost,%p\n", callParams.threadId, callParams.time, frameIndex,
        -
        14371  pool);
        -
        14372  Flush();
        +
        14340 // VmaRecorder
        +
        14341 
        +
        14342 #if VMA_RECORDING_ENABLED
        +
        14343 
        +
        14344 VmaRecorder::VmaRecorder() :
        +
        14345  m_UseMutex(true),
        +
        14346  m_Flags(0),
        +
        14347  m_File(VMA_NULL),
        +
        14348  m_Freq(INT64_MAX),
        +
        14349  m_StartCounter(INT64_MAX)
        +
        14350 {
        +
        14351 }
        +
        14352 
        +
        14353 VkResult VmaRecorder::Init(const VmaRecordSettings& settings, bool useMutex)
        +
        14354 {
        +
        14355  m_UseMutex = useMutex;
        +
        14356  m_Flags = settings.flags;
        +
        14357 
        +
        14358  QueryPerformanceFrequency((LARGE_INTEGER*)&m_Freq);
        +
        14359  QueryPerformanceCounter((LARGE_INTEGER*)&m_StartCounter);
        +
        14360 
        +
        14361  // Open file for writing.
        +
        14362  errno_t err = fopen_s(&m_File, settings.pFilePath, "wb");
        +
        14363  if(err != 0)
        +
        14364  {
        +
        14365  return VK_ERROR_INITIALIZATION_FAILED;
        +
        14366  }
        +
        14367 
        +
        14368  // Write header.
        +
        14369  fprintf(m_File, "%s\n", "Vulkan Memory Allocator,Calls recording");
        +
        14370  fprintf(m_File, "%s\n", "1,8");
        +
        14371 
        +
        14372  return VK_SUCCESS;
        14373 }
        14374 
        -
        14375 void VmaRecorder::RecordDefragmentationBegin(uint32_t frameIndex,
        -
        14376  const VmaDefragmentationInfo2& info,
        -
        14377  VmaDefragmentationContext ctx)
        -
        14378 {
        -
        14379  CallParams callParams;
        -
        14380  GetBasicParams(callParams);
        -
        14381 
        -
        14382  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14383  fprintf(m_File, "%u,%.3f,%u,vmaDefragmentationBegin,%u,", callParams.threadId, callParams.time, frameIndex,
        -
        14384  info.flags);
        -
        14385  PrintPointerList(info.allocationCount, info.pAllocations);
        -
        14386  fprintf(m_File, ",");
        -
        14387  PrintPointerList(info.poolCount, info.pPools);
        -
        14388  fprintf(m_File, ",%llu,%u,%llu,%u,%p,%p\n",
        -
        14389  info.maxCpuBytesToMove,
        -
        14390  info.maxCpuAllocationsToMove,
        -
        14391  info.maxGpuBytesToMove,
        -
        14392  info.maxGpuAllocationsToMove,
        -
        14393  info.commandBuffer,
        -
        14394  ctx);
        -
        14395  Flush();
        -
        14396 }
        +
        14375 VmaRecorder::~VmaRecorder()
        +
        14376 {
        +
        14377  if(m_File != VMA_NULL)
        +
        14378  {
        +
        14379  fclose(m_File);
        +
        14380  }
        +
        14381 }
        +
        14382 
        +
        14383 void VmaRecorder::RecordCreateAllocator(uint32_t frameIndex)
        +
        14384 {
        +
        14385  CallParams callParams;
        +
        14386  GetBasicParams(callParams);
        +
        14387 
        +
        14388  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14389  fprintf(m_File, "%u,%.3f,%u,vmaCreateAllocator\n", callParams.threadId, callParams.time, frameIndex);
        +
        14390  Flush();
        +
        14391 }
        +
        14392 
        +
        14393 void VmaRecorder::RecordDestroyAllocator(uint32_t frameIndex)
        +
        14394 {
        +
        14395  CallParams callParams;
        +
        14396  GetBasicParams(callParams);
        14397 
        -
        14398 void VmaRecorder::RecordDefragmentationEnd(uint32_t frameIndex,
        -
        14399  VmaDefragmentationContext ctx)
        -
        14400 {
        -
        14401  CallParams callParams;
        -
        14402  GetBasicParams(callParams);
        -
        14403 
        -
        14404  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14405  fprintf(m_File, "%u,%.3f,%u,vmaDefragmentationEnd,%p\n", callParams.threadId, callParams.time, frameIndex,
        -
        14406  ctx);
        -
        14407  Flush();
        -
        14408 }
        -
        14409 
        -
        14410 void VmaRecorder::RecordSetPoolName(uint32_t frameIndex,
        -
        14411  VmaPool pool,
        -
        14412  const char* name)
        -
        14413 {
        -
        14414  CallParams callParams;
        -
        14415  GetBasicParams(callParams);
        -
        14416 
        -
        14417  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        -
        14418  fprintf(m_File, "%u,%.3f,%u,vmaSetPoolName,%p,%s\n", callParams.threadId, callParams.time, frameIndex,
        -
        14419  pool, name != VMA_NULL ? name : "");
        -
        14420  Flush();
        -
        14421 }
        -
        14422 
        -
        14423 VmaRecorder::UserDataString::UserDataString(VmaAllocationCreateFlags allocFlags, const void* pUserData)
        -
        14424 {
        -
        14425  if(pUserData != VMA_NULL)
        -
        14426  {
        -
        14427  if((allocFlags & VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT) != 0)
        -
        14428  {
        -
        14429  m_Str = (const char*)pUserData;
        -
        14430  }
        -
        14431  else
        -
        14432  {
        -
        14433  sprintf_s(m_PtrStr, "%p", pUserData);
        -
        14434  m_Str = m_PtrStr;
        -
        14435  }
        -
        14436  }
        -
        14437  else
        -
        14438  {
        -
        14439  m_Str = "";
        -
        14440  }
        -
        14441 }
        -
        14442 
        -
        14443 void VmaRecorder::WriteConfiguration(
        -
        14444  const VkPhysicalDeviceProperties& devProps,
        -
        14445  const VkPhysicalDeviceMemoryProperties& memProps,
        -
        14446  uint32_t vulkanApiVersion,
        -
        14447  bool dedicatedAllocationExtensionEnabled,
        -
        14448  bool bindMemory2ExtensionEnabled,
        -
        14449  bool memoryBudgetExtensionEnabled)
        -
        14450 {
        -
        14451  fprintf(m_File, "Config,Begin\n");
        -
        14452 
        -
        14453  fprintf(m_File, "VulkanApiVersion,%u,%u\n", VK_VERSION_MAJOR(vulkanApiVersion), VK_VERSION_MINOR(vulkanApiVersion));
        -
        14454 
        -
        14455  fprintf(m_File, "PhysicalDevice,apiVersion,%u\n", devProps.apiVersion);
        -
        14456  fprintf(m_File, "PhysicalDevice,driverVersion,%u\n", devProps.driverVersion);
        -
        14457  fprintf(m_File, "PhysicalDevice,vendorID,%u\n", devProps.vendorID);
        -
        14458  fprintf(m_File, "PhysicalDevice,deviceID,%u\n", devProps.deviceID);
        -
        14459  fprintf(m_File, "PhysicalDevice,deviceType,%u\n", devProps.deviceType);
        -
        14460  fprintf(m_File, "PhysicalDevice,deviceName,%s\n", devProps.deviceName);
        -
        14461 
        -
        14462  fprintf(m_File, "PhysicalDeviceLimits,maxMemoryAllocationCount,%u\n", devProps.limits.maxMemoryAllocationCount);
        -
        14463  fprintf(m_File, "PhysicalDeviceLimits,bufferImageGranularity,%llu\n", devProps.limits.bufferImageGranularity);
        -
        14464  fprintf(m_File, "PhysicalDeviceLimits,nonCoherentAtomSize,%llu\n", devProps.limits.nonCoherentAtomSize);
        -
        14465 
        -
        14466  fprintf(m_File, "PhysicalDeviceMemory,HeapCount,%u\n", memProps.memoryHeapCount);
        -
        14467  for(uint32_t i = 0; i < memProps.memoryHeapCount; ++i)
        -
        14468  {
        -
        14469  fprintf(m_File, "PhysicalDeviceMemory,Heap,%u,size,%llu\n", i, memProps.memoryHeaps[i].size);
        -
        14470  fprintf(m_File, "PhysicalDeviceMemory,Heap,%u,flags,%u\n", i, memProps.memoryHeaps[i].flags);
        -
        14471  }
        -
        14472  fprintf(m_File, "PhysicalDeviceMemory,TypeCount,%u\n", memProps.memoryTypeCount);
        -
        14473  for(uint32_t i = 0; i < memProps.memoryTypeCount; ++i)
        -
        14474  {
        -
        14475  fprintf(m_File, "PhysicalDeviceMemory,Type,%u,heapIndex,%u\n", i, memProps.memoryTypes[i].heapIndex);
        -
        14476  fprintf(m_File, "PhysicalDeviceMemory,Type,%u,propertyFlags,%u\n", i, memProps.memoryTypes[i].propertyFlags);
        -
        14477  }
        -
        14478 
        -
        14479  fprintf(m_File, "Extension,VK_KHR_dedicated_allocation,%u\n", dedicatedAllocationExtensionEnabled ? 1 : 0);
        -
        14480  fprintf(m_File, "Extension,VK_KHR_bind_memory2,%u\n", bindMemory2ExtensionEnabled ? 1 : 0);
        -
        14481  fprintf(m_File, "Extension,VK_EXT_memory_budget,%u\n", memoryBudgetExtensionEnabled ? 1 : 0);
        -
        14482 
        -
        14483  fprintf(m_File, "Macro,VMA_DEBUG_ALWAYS_DEDICATED_MEMORY,%u\n", VMA_DEBUG_ALWAYS_DEDICATED_MEMORY ? 1 : 0);
        -
        14484  fprintf(m_File, "Macro,VMA_DEBUG_ALIGNMENT,%llu\n", (VkDeviceSize)VMA_DEBUG_ALIGNMENT);
        -
        14485  fprintf(m_File, "Macro,VMA_DEBUG_MARGIN,%llu\n", (VkDeviceSize)VMA_DEBUG_MARGIN);
        -
        14486  fprintf(m_File, "Macro,VMA_DEBUG_INITIALIZE_ALLOCATIONS,%u\n", VMA_DEBUG_INITIALIZE_ALLOCATIONS ? 1 : 0);
        -
        14487  fprintf(m_File, "Macro,VMA_DEBUG_DETECT_CORRUPTION,%u\n", VMA_DEBUG_DETECT_CORRUPTION ? 1 : 0);
        -
        14488  fprintf(m_File, "Macro,VMA_DEBUG_GLOBAL_MUTEX,%u\n", VMA_DEBUG_GLOBAL_MUTEX ? 1 : 0);
        -
        14489  fprintf(m_File, "Macro,VMA_DEBUG_MIN_BUFFER_IMAGE_GRANULARITY,%llu\n", (VkDeviceSize)VMA_DEBUG_MIN_BUFFER_IMAGE_GRANULARITY);
        -
        14490  fprintf(m_File, "Macro,VMA_SMALL_HEAP_MAX_SIZE,%llu\n", (VkDeviceSize)VMA_SMALL_HEAP_MAX_SIZE);
        -
        14491  fprintf(m_File, "Macro,VMA_DEFAULT_LARGE_HEAP_BLOCK_SIZE,%llu\n", (VkDeviceSize)VMA_DEFAULT_LARGE_HEAP_BLOCK_SIZE);
        -
        14492 
        -
        14493  fprintf(m_File, "Config,End\n");
        -
        14494 }
        -
        14495 
        -
        14496 void VmaRecorder::GetBasicParams(CallParams& outParams)
        -
        14497 {
        -
        14498  outParams.threadId = GetCurrentThreadId();
        -
        14499 
        -
        14500  LARGE_INTEGER counter;
        -
        14501  QueryPerformanceCounter(&counter);
        -
        14502  outParams.time = (double)(counter.QuadPart - m_StartCounter) / (double)m_Freq;
        -
        14503 }
        -
        14504 
        -
        14505 void VmaRecorder::PrintPointerList(uint64_t count, const VmaAllocation* pItems)
        -
        14506 {
        -
        14507  if(count)
        -
        14508  {
        -
        14509  fprintf(m_File, "%p", pItems[0]);
        -
        14510  for(uint64_t i = 1; i < count; ++i)
        -
        14511  {
        -
        14512  fprintf(m_File, " %p", pItems[i]);
        -
        14513  }
        -
        14514  }
        -
        14515 }
        -
        14516 
        -
        14517 void VmaRecorder::Flush()
        -
        14518 {
        -
        14519  if((m_Flags & VMA_RECORD_FLUSH_AFTER_CALL_BIT) != 0)
        -
        14520  {
        -
        14521  fflush(m_File);
        -
        14522  }
        -
        14523 }
        -
        14524 
        -
        14525 #endif // #if VMA_RECORDING_ENABLED
        -
        14526 
        -
        14528 // VmaAllocationObjectAllocator
        -
        14529 
        -
        14530 VmaAllocationObjectAllocator::VmaAllocationObjectAllocator(const VkAllocationCallbacks* pAllocationCallbacks) :
        -
        14531  m_Allocator(pAllocationCallbacks, 1024)
        -
        14532 {
        -
        14533 }
        -
        14534 
        -
        14535 VmaAllocation VmaAllocationObjectAllocator::Allocate()
        -
        14536 {
        -
        14537  VmaMutexLock mutexLock(m_Mutex);
        -
        14538  return m_Allocator.Alloc();
        -
        14539 }
        -
        14540 
        -
        14541 void VmaAllocationObjectAllocator::Free(VmaAllocation hAlloc)
        +
        14398  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14399  fprintf(m_File, "%u,%.3f,%u,vmaDestroyAllocator\n", callParams.threadId, callParams.time, frameIndex);
        +
        14400  Flush();
        +
        14401 }
        +
        14402 
        +
        14403 void VmaRecorder::RecordCreatePool(uint32_t frameIndex, const VmaPoolCreateInfo& createInfo, VmaPool pool)
        +
        14404 {
        +
        14405  CallParams callParams;
        +
        14406  GetBasicParams(callParams);
        +
        14407 
        +
        14408  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14409  fprintf(m_File, "%u,%.3f,%u,vmaCreatePool,%u,%u,%llu,%llu,%llu,%u,%p\n", callParams.threadId, callParams.time, frameIndex,
        +
        14410  createInfo.memoryTypeIndex,
        +
        14411  createInfo.flags,
        +
        14412  createInfo.blockSize,
        +
        14413  (uint64_t)createInfo.minBlockCount,
        +
        14414  (uint64_t)createInfo.maxBlockCount,
        +
        14415  createInfo.frameInUseCount,
        +
        14416  pool);
        +
        14417  Flush();
        +
        14418 }
        +
        14419 
        +
        14420 void VmaRecorder::RecordDestroyPool(uint32_t frameIndex, VmaPool pool)
        +
        14421 {
        +
        14422  CallParams callParams;
        +
        14423  GetBasicParams(callParams);
        +
        14424 
        +
        14425  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14426  fprintf(m_File, "%u,%.3f,%u,vmaDestroyPool,%p\n", callParams.threadId, callParams.time, frameIndex,
        +
        14427  pool);
        +
        14428  Flush();
        +
        14429 }
        +
        14430 
        +
        14431 void VmaRecorder::RecordAllocateMemory(uint32_t frameIndex,
        +
        14432  const VkMemoryRequirements& vkMemReq,
        +
        14433  const VmaAllocationCreateInfo& createInfo,
        +
        14434  VmaAllocation allocation)
        +
        14435 {
        +
        14436  CallParams callParams;
        +
        14437  GetBasicParams(callParams);
        +
        14438 
        +
        14439  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14440  UserDataString userDataStr(createInfo.flags, createInfo.pUserData);
        +
        14441  fprintf(m_File, "%u,%.3f,%u,vmaAllocateMemory,%llu,%llu,%u,%u,%u,%u,%u,%u,%p,%p,%s\n", callParams.threadId, callParams.time, frameIndex,
        +
        14442  vkMemReq.size,
        +
        14443  vkMemReq.alignment,
        +
        14444  vkMemReq.memoryTypeBits,
        +
        14445  createInfo.flags,
        +
        14446  createInfo.usage,
        +
        14447  createInfo.requiredFlags,
        +
        14448  createInfo.preferredFlags,
        +
        14449  createInfo.memoryTypeBits,
        +
        14450  createInfo.pool,
        +
        14451  allocation,
        +
        14452  userDataStr.GetString());
        +
        14453  Flush();
        +
        14454 }
        +
        14455 
        +
        14456 void VmaRecorder::RecordAllocateMemoryPages(uint32_t frameIndex,
        +
        14457  const VkMemoryRequirements& vkMemReq,
        +
        14458  const VmaAllocationCreateInfo& createInfo,
        +
        14459  uint64_t allocationCount,
        +
        14460  const VmaAllocation* pAllocations)
        +
        14461 {
        +
        14462  CallParams callParams;
        +
        14463  GetBasicParams(callParams);
        +
        14464 
        +
        14465  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14466  UserDataString userDataStr(createInfo.flags, createInfo.pUserData);
        +
        14467  fprintf(m_File, "%u,%.3f,%u,vmaAllocateMemoryPages,%llu,%llu,%u,%u,%u,%u,%u,%u,%p,", callParams.threadId, callParams.time, frameIndex,
        +
        14468  vkMemReq.size,
        +
        14469  vkMemReq.alignment,
        +
        14470  vkMemReq.memoryTypeBits,
        +
        14471  createInfo.flags,
        +
        14472  createInfo.usage,
        +
        14473  createInfo.requiredFlags,
        +
        14474  createInfo.preferredFlags,
        +
        14475  createInfo.memoryTypeBits,
        +
        14476  createInfo.pool);
        +
        14477  PrintPointerList(allocationCount, pAllocations);
        +
        14478  fprintf(m_File, ",%s\n", userDataStr.GetString());
        +
        14479  Flush();
        +
        14480 }
        +
        14481 
        +
        14482 void VmaRecorder::RecordAllocateMemoryForBuffer(uint32_t frameIndex,
        +
        14483  const VkMemoryRequirements& vkMemReq,
        +
        14484  bool requiresDedicatedAllocation,
        +
        14485  bool prefersDedicatedAllocation,
        +
        14486  const VmaAllocationCreateInfo& createInfo,
        +
        14487  VmaAllocation allocation)
        +
        14488 {
        +
        14489  CallParams callParams;
        +
        14490  GetBasicParams(callParams);
        +
        14491 
        +
        14492  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14493  UserDataString userDataStr(createInfo.flags, createInfo.pUserData);
        +
        14494  fprintf(m_File, "%u,%.3f,%u,vmaAllocateMemoryForBuffer,%llu,%llu,%u,%u,%u,%u,%u,%u,%u,%u,%p,%p,%s\n", callParams.threadId, callParams.time, frameIndex,
        +
        14495  vkMemReq.size,
        +
        14496  vkMemReq.alignment,
        +
        14497  vkMemReq.memoryTypeBits,
        +
        14498  requiresDedicatedAllocation ? 1 : 0,
        +
        14499  prefersDedicatedAllocation ? 1 : 0,
        +
        14500  createInfo.flags,
        +
        14501  createInfo.usage,
        +
        14502  createInfo.requiredFlags,
        +
        14503  createInfo.preferredFlags,
        +
        14504  createInfo.memoryTypeBits,
        +
        14505  createInfo.pool,
        +
        14506  allocation,
        +
        14507  userDataStr.GetString());
        +
        14508  Flush();
        +
        14509 }
        +
        14510 
        +
        14511 void VmaRecorder::RecordAllocateMemoryForImage(uint32_t frameIndex,
        +
        14512  const VkMemoryRequirements& vkMemReq,
        +
        14513  bool requiresDedicatedAllocation,
        +
        14514  bool prefersDedicatedAllocation,
        +
        14515  const VmaAllocationCreateInfo& createInfo,
        +
        14516  VmaAllocation allocation)
        +
        14517 {
        +
        14518  CallParams callParams;
        +
        14519  GetBasicParams(callParams);
        +
        14520 
        +
        14521  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14522  UserDataString userDataStr(createInfo.flags, createInfo.pUserData);
        +
        14523  fprintf(m_File, "%u,%.3f,%u,vmaAllocateMemoryForImage,%llu,%llu,%u,%u,%u,%u,%u,%u,%u,%u,%p,%p,%s\n", callParams.threadId, callParams.time, frameIndex,
        +
        14524  vkMemReq.size,
        +
        14525  vkMemReq.alignment,
        +
        14526  vkMemReq.memoryTypeBits,
        +
        14527  requiresDedicatedAllocation ? 1 : 0,
        +
        14528  prefersDedicatedAllocation ? 1 : 0,
        +
        14529  createInfo.flags,
        +
        14530  createInfo.usage,
        +
        14531  createInfo.requiredFlags,
        +
        14532  createInfo.preferredFlags,
        +
        14533  createInfo.memoryTypeBits,
        +
        14534  createInfo.pool,
        +
        14535  allocation,
        +
        14536  userDataStr.GetString());
        +
        14537  Flush();
        +
        14538 }
        +
        14539 
        +
        14540 void VmaRecorder::RecordFreeMemory(uint32_t frameIndex,
        +
        14541  VmaAllocation allocation)
        14542 {
        -
        14543  VmaMutexLock mutexLock(m_Mutex);
        -
        14544  m_Allocator.Free(hAlloc);
        -
        14545 }
        -
        14546 
        -
        14548 // VmaAllocator_T
        -
        14549 
        -
        14550 VmaAllocator_T::VmaAllocator_T(const VmaAllocatorCreateInfo* pCreateInfo) :
        -
        14551  m_UseMutex((pCreateInfo->flags & VMA_ALLOCATOR_CREATE_EXTERNALLY_SYNCHRONIZED_BIT) == 0),
        -
        14552  m_VulkanApiVersion(pCreateInfo->vulkanApiVersion != 0 ? pCreateInfo->vulkanApiVersion : VK_API_VERSION_1_0),
        -
        14553  m_UseKhrDedicatedAllocation((pCreateInfo->flags & VMA_ALLOCATOR_CREATE_KHR_DEDICATED_ALLOCATION_BIT) != 0),
        -
        14554  m_UseKhrBindMemory2((pCreateInfo->flags & VMA_ALLOCATOR_CREATE_KHR_BIND_MEMORY2_BIT) != 0),
        -
        14555  m_UseExtMemoryBudget((pCreateInfo->flags & VMA_ALLOCATOR_CREATE_EXT_MEMORY_BUDGET_BIT) != 0),
        -
        14556  m_hDevice(pCreateInfo->device),
        -
        14557  m_hInstance(pCreateInfo->instance),
        -
        14558  m_AllocationCallbacksSpecified(pCreateInfo->pAllocationCallbacks != VMA_NULL),
        -
        14559  m_AllocationCallbacks(pCreateInfo->pAllocationCallbacks ?
        -
        14560  *pCreateInfo->pAllocationCallbacks : VmaEmptyAllocationCallbacks),
        -
        14561  m_AllocationObjectAllocator(&m_AllocationCallbacks),
        -
        14562  m_HeapSizeLimitMask(0),
        -
        14563  m_PreferredLargeHeapBlockSize(0),
        -
        14564  m_PhysicalDevice(pCreateInfo->physicalDevice),
        -
        14565  m_CurrentFrameIndex(0),
        -
        14566  m_GpuDefragmentationMemoryTypeBits(UINT32_MAX),
        -
        14567  m_Pools(VmaStlAllocator<VmaPool>(GetAllocationCallbacks())),
        -
        14568  m_NextPoolId(0)
        -
        14569 #if VMA_RECORDING_ENABLED
        -
        14570  ,m_pRecorder(VMA_NULL)
        -
        14571 #endif
        -
        14572 {
        -
        14573  if(m_VulkanApiVersion >= VK_MAKE_VERSION(1, 1, 0))
        -
        14574  {
        -
        14575  m_UseKhrDedicatedAllocation = false;
        -
        14576  m_UseKhrBindMemory2 = false;
        -
        14577  }
        -
        14578 
        -
        14579  if(VMA_DEBUG_DETECT_CORRUPTION)
        -
        14580  {
        -
        14581  // Needs to be multiply of uint32_t size because we are going to write VMA_CORRUPTION_DETECTION_MAGIC_VALUE to it.
        -
        14582  VMA_ASSERT(VMA_DEBUG_MARGIN % sizeof(uint32_t) == 0);
        -
        14583  }
        -
        14584 
        -
        14585  VMA_ASSERT(pCreateInfo->physicalDevice && pCreateInfo->device);
        -
        14586 
        -
        14587  if(m_VulkanApiVersion < VK_MAKE_VERSION(1, 1, 0))
        -
        14588  {
        -
        14589 #if !(VMA_DEDICATED_ALLOCATION)
        -
        14590  if((pCreateInfo->flags & VMA_ALLOCATOR_CREATE_KHR_DEDICATED_ALLOCATION_BIT) != 0)
        -
        14591  {
        -
        14592  VMA_ASSERT(0 && "VMA_ALLOCATOR_CREATE_KHR_DEDICATED_ALLOCATION_BIT set but required extensions are disabled by preprocessor macros.");
        -
        14593  }
        -
        14594 #endif
        -
        14595 #if !(VMA_BIND_MEMORY2)
        -
        14596  if((pCreateInfo->flags & VMA_ALLOCATOR_CREATE_KHR_BIND_MEMORY2_BIT) != 0)
        -
        14597  {
        -
        14598  VMA_ASSERT(0 && "VMA_ALLOCATOR_CREATE_KHR_BIND_MEMORY2_BIT set but required extension is disabled by preprocessor macros.");
        -
        14599  }
        -
        14600 #endif
        -
        14601  }
        -
        14602 #if !(VMA_MEMORY_BUDGET)
        -
        14603  if((pCreateInfo->flags & VMA_ALLOCATOR_CREATE_EXT_MEMORY_BUDGET_BIT) != 0)
        -
        14604  {
        -
        14605  VMA_ASSERT(0 && "VMA_ALLOCATOR_CREATE_EXT_MEMORY_BUDGET_BIT set but required extension is disabled by preprocessor macros.");
        -
        14606  }
        -
        14607 #endif
        -
        14608 #if VMA_VULKAN_VERSION < 1001000
        -
        14609  if(m_VulkanApiVersion >= VK_MAKE_VERSION(1, 1, 0))
        -
        14610  {
        -
        14611  VMA_ASSERT(0 && "vulkanApiVersion >= VK_API_VERSION_1_1 but required Vulkan version is disabled by preprocessor macros.");
        -
        14612  }
        -
        14613 #endif
        -
        14614 
        -
        14615  memset(&m_DeviceMemoryCallbacks, 0 ,sizeof(m_DeviceMemoryCallbacks));
        -
        14616  memset(&m_PhysicalDeviceProperties, 0, sizeof(m_PhysicalDeviceProperties));
        -
        14617  memset(&m_MemProps, 0, sizeof(m_MemProps));
        -
        14618 
        -
        14619  memset(&m_pBlockVectors, 0, sizeof(m_pBlockVectors));
        -
        14620  memset(&m_pDedicatedAllocations, 0, sizeof(m_pDedicatedAllocations));
        -
        14621  memset(&m_VulkanFunctions, 0, sizeof(m_VulkanFunctions));
        -
        14622 
        -
        14623  if(pCreateInfo->pDeviceMemoryCallbacks != VMA_NULL)
        -
        14624  {
        -
        14625  m_DeviceMemoryCallbacks.pfnAllocate = pCreateInfo->pDeviceMemoryCallbacks->pfnAllocate;
        -
        14626  m_DeviceMemoryCallbacks.pfnFree = pCreateInfo->pDeviceMemoryCallbacks->pfnFree;
        -
        14627  }
        -
        14628 
        -
        14629  ImportVulkanFunctions(pCreateInfo->pVulkanFunctions);
        -
        14630 
        -
        14631  (*m_VulkanFunctions.vkGetPhysicalDeviceProperties)(m_PhysicalDevice, &m_PhysicalDeviceProperties);
        -
        14632  (*m_VulkanFunctions.vkGetPhysicalDeviceMemoryProperties)(m_PhysicalDevice, &m_MemProps);
        -
        14633 
        -
        14634  VMA_ASSERT(VmaIsPow2(VMA_DEBUG_ALIGNMENT));
        -
        14635  VMA_ASSERT(VmaIsPow2(VMA_DEBUG_MIN_BUFFER_IMAGE_GRANULARITY));
        -
        14636  VMA_ASSERT(VmaIsPow2(m_PhysicalDeviceProperties.limits.bufferImageGranularity));
        -
        14637  VMA_ASSERT(VmaIsPow2(m_PhysicalDeviceProperties.limits.nonCoherentAtomSize));
        +
        14543  CallParams callParams;
        +
        14544  GetBasicParams(callParams);
        +
        14545 
        +
        14546  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14547  fprintf(m_File, "%u,%.3f,%u,vmaFreeMemory,%p\n", callParams.threadId, callParams.time, frameIndex,
        +
        14548  allocation);
        +
        14549  Flush();
        +
        14550 }
        +
        14551 
        +
        14552 void VmaRecorder::RecordFreeMemoryPages(uint32_t frameIndex,
        +
        14553  uint64_t allocationCount,
        +
        14554  const VmaAllocation* pAllocations)
        +
        14555 {
        +
        14556  CallParams callParams;
        +
        14557  GetBasicParams(callParams);
        +
        14558 
        +
        14559  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14560  fprintf(m_File, "%u,%.3f,%u,vmaFreeMemoryPages,", callParams.threadId, callParams.time, frameIndex);
        +
        14561  PrintPointerList(allocationCount, pAllocations);
        +
        14562  fprintf(m_File, "\n");
        +
        14563  Flush();
        +
        14564 }
        +
        14565 
        +
        14566 void VmaRecorder::RecordSetAllocationUserData(uint32_t frameIndex,
        +
        14567  VmaAllocation allocation,
        +
        14568  const void* pUserData)
        +
        14569 {
        +
        14570  CallParams callParams;
        +
        14571  GetBasicParams(callParams);
        +
        14572 
        +
        14573  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14574  UserDataString userDataStr(
        +
        14575  allocation->IsUserDataString() ? VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT : 0,
        +
        14576  pUserData);
        +
        14577  fprintf(m_File, "%u,%.3f,%u,vmaSetAllocationUserData,%p,%s\n", callParams.threadId, callParams.time, frameIndex,
        +
        14578  allocation,
        +
        14579  userDataStr.GetString());
        +
        14580  Flush();
        +
        14581 }
        +
        14582 
        +
        14583 void VmaRecorder::RecordCreateLostAllocation(uint32_t frameIndex,
        +
        14584  VmaAllocation allocation)
        +
        14585 {
        +
        14586  CallParams callParams;
        +
        14587  GetBasicParams(callParams);
        +
        14588 
        +
        14589  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14590  fprintf(m_File, "%u,%.3f,%u,vmaCreateLostAllocation,%p\n", callParams.threadId, callParams.time, frameIndex,
        +
        14591  allocation);
        +
        14592  Flush();
        +
        14593 }
        +
        14594 
        +
        14595 void VmaRecorder::RecordMapMemory(uint32_t frameIndex,
        +
        14596  VmaAllocation allocation)
        +
        14597 {
        +
        14598  CallParams callParams;
        +
        14599  GetBasicParams(callParams);
        +
        14600 
        +
        14601  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14602  fprintf(m_File, "%u,%.3f,%u,vmaMapMemory,%p\n", callParams.threadId, callParams.time, frameIndex,
        +
        14603  allocation);
        +
        14604  Flush();
        +
        14605 }
        +
        14606 
        +
        14607 void VmaRecorder::RecordUnmapMemory(uint32_t frameIndex,
        +
        14608  VmaAllocation allocation)
        +
        14609 {
        +
        14610  CallParams callParams;
        +
        14611  GetBasicParams(callParams);
        +
        14612 
        +
        14613  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14614  fprintf(m_File, "%u,%.3f,%u,vmaUnmapMemory,%p\n", callParams.threadId, callParams.time, frameIndex,
        +
        14615  allocation);
        +
        14616  Flush();
        +
        14617 }
        +
        14618 
        +
        14619 void VmaRecorder::RecordFlushAllocation(uint32_t frameIndex,
        +
        14620  VmaAllocation allocation, VkDeviceSize offset, VkDeviceSize size)
        +
        14621 {
        +
        14622  CallParams callParams;
        +
        14623  GetBasicParams(callParams);
        +
        14624 
        +
        14625  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14626  fprintf(m_File, "%u,%.3f,%u,vmaFlushAllocation,%p,%llu,%llu\n", callParams.threadId, callParams.time, frameIndex,
        +
        14627  allocation,
        +
        14628  offset,
        +
        14629  size);
        +
        14630  Flush();
        +
        14631 }
        +
        14632 
        +
        14633 void VmaRecorder::RecordInvalidateAllocation(uint32_t frameIndex,
        +
        14634  VmaAllocation allocation, VkDeviceSize offset, VkDeviceSize size)
        +
        14635 {
        +
        14636  CallParams callParams;
        +
        14637  GetBasicParams(callParams);
        14638 
        -
        14639  m_PreferredLargeHeapBlockSize = (pCreateInfo->preferredLargeHeapBlockSize != 0) ?
        -
        14640  pCreateInfo->preferredLargeHeapBlockSize : static_cast<VkDeviceSize>(VMA_DEFAULT_LARGE_HEAP_BLOCK_SIZE);
        -
        14641 
        -
        14642  if(pCreateInfo->pHeapSizeLimit != VMA_NULL)
        -
        14643  {
        -
        14644  for(uint32_t heapIndex = 0; heapIndex < GetMemoryHeapCount(); ++heapIndex)
        -
        14645  {
        -
        14646  const VkDeviceSize limit = pCreateInfo->pHeapSizeLimit[heapIndex];
        -
        14647  if(limit != VK_WHOLE_SIZE)
        -
        14648  {
        -
        14649  m_HeapSizeLimitMask |= 1u << heapIndex;
        -
        14650  if(limit < m_MemProps.memoryHeaps[heapIndex].size)
        -
        14651  {
        -
        14652  m_MemProps.memoryHeaps[heapIndex].size = limit;
        -
        14653  }
        -
        14654  }
        -
        14655  }
        -
        14656  }
        -
        14657 
        -
        14658  for(uint32_t memTypeIndex = 0; memTypeIndex < GetMemoryTypeCount(); ++memTypeIndex)
        -
        14659  {
        -
        14660  const VkDeviceSize preferredBlockSize = CalcPreferredBlockSize(memTypeIndex);
        -
        14661 
        -
        14662  m_pBlockVectors[memTypeIndex] = vma_new(this, VmaBlockVector)(
        -
        14663  this,
        -
        14664  VK_NULL_HANDLE, // hParentPool
        -
        14665  memTypeIndex,
        -
        14666  preferredBlockSize,
        -
        14667  0,
        -
        14668  SIZE_MAX,
        -
        14669  GetBufferImageGranularity(),
        -
        14670  pCreateInfo->frameInUseCount,
        -
        14671  false, // explicitBlockSize
        -
        14672  false); // linearAlgorithm
        -
        14673  // No need to call m_pBlockVectors[memTypeIndex][blockVectorTypeIndex]->CreateMinBlocks here,
        -
        14674  // becase minBlockCount is 0.
        -
        14675  m_pDedicatedAllocations[memTypeIndex] = vma_new(this, AllocationVectorType)(VmaStlAllocator<VmaAllocation>(GetAllocationCallbacks()));
        -
        14676 
        -
        14677  }
        -
        14678 }
        -
        14679 
        -
        14680 VkResult VmaAllocator_T::Init(const VmaAllocatorCreateInfo* pCreateInfo)
        -
        14681 {
        -
        14682  VkResult res = VK_SUCCESS;
        -
        14683 
        -
        14684  if(pCreateInfo->pRecordSettings != VMA_NULL &&
        -
        14685  !VmaStrIsEmpty(pCreateInfo->pRecordSettings->pFilePath))
        -
        14686  {
        -
        14687 #if VMA_RECORDING_ENABLED
        -
        14688  m_pRecorder = vma_new(this, VmaRecorder)();
        -
        14689  res = m_pRecorder->Init(*pCreateInfo->pRecordSettings, m_UseMutex);
        -
        14690  if(res != VK_SUCCESS)
        -
        14691  {
        -
        14692  return res;
        -
        14693  }
        -
        14694  m_pRecorder->WriteConfiguration(
        -
        14695  m_PhysicalDeviceProperties,
        -
        14696  m_MemProps,
        -
        14697  m_VulkanApiVersion,
        -
        14698  m_UseKhrDedicatedAllocation,
        -
        14699  m_UseKhrBindMemory2,
        -
        14700  m_UseExtMemoryBudget);
        -
        14701  m_pRecorder->RecordCreateAllocator(GetCurrentFrameIndex());
        -
        14702 #else
        -
        14703  VMA_ASSERT(0 && "VmaAllocatorCreateInfo::pRecordSettings used, but not supported due to VMA_RECORDING_ENABLED not defined to 1.");
        -
        14704  return VK_ERROR_FEATURE_NOT_PRESENT;
        -
        14705 #endif
        -
        14706  }
        +
        14639  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14640  fprintf(m_File, "%u,%.3f,%u,vmaInvalidateAllocation,%p,%llu,%llu\n", callParams.threadId, callParams.time, frameIndex,
        +
        14641  allocation,
        +
        14642  offset,
        +
        14643  size);
        +
        14644  Flush();
        +
        14645 }
        +
        14646 
        +
        14647 void VmaRecorder::RecordCreateBuffer(uint32_t frameIndex,
        +
        14648  const VkBufferCreateInfo& bufCreateInfo,
        +
        14649  const VmaAllocationCreateInfo& allocCreateInfo,
        +
        14650  VmaAllocation allocation)
        +
        14651 {
        +
        14652  CallParams callParams;
        +
        14653  GetBasicParams(callParams);
        +
        14654 
        +
        14655  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14656  UserDataString userDataStr(allocCreateInfo.flags, allocCreateInfo.pUserData);
        +
        14657  fprintf(m_File, "%u,%.3f,%u,vmaCreateBuffer,%u,%llu,%u,%u,%u,%u,%u,%u,%u,%p,%p,%s\n", callParams.threadId, callParams.time, frameIndex,
        +
        14658  bufCreateInfo.flags,
        +
        14659  bufCreateInfo.size,
        +
        14660  bufCreateInfo.usage,
        +
        14661  bufCreateInfo.sharingMode,
        +
        14662  allocCreateInfo.flags,
        +
        14663  allocCreateInfo.usage,
        +
        14664  allocCreateInfo.requiredFlags,
        +
        14665  allocCreateInfo.preferredFlags,
        +
        14666  allocCreateInfo.memoryTypeBits,
        +
        14667  allocCreateInfo.pool,
        +
        14668  allocation,
        +
        14669  userDataStr.GetString());
        +
        14670  Flush();
        +
        14671 }
        +
        14672 
        +
        14673 void VmaRecorder::RecordCreateImage(uint32_t frameIndex,
        +
        14674  const VkImageCreateInfo& imageCreateInfo,
        +
        14675  const VmaAllocationCreateInfo& allocCreateInfo,
        +
        14676  VmaAllocation allocation)
        +
        14677 {
        +
        14678  CallParams callParams;
        +
        14679  GetBasicParams(callParams);
        +
        14680 
        +
        14681  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14682  UserDataString userDataStr(allocCreateInfo.flags, allocCreateInfo.pUserData);
        +
        14683  fprintf(m_File, "%u,%.3f,%u,vmaCreateImage,%u,%u,%u,%u,%u,%u,%u,%u,%u,%u,%u,%u,%u,%u,%u,%u,%u,%u,%p,%p,%s\n", callParams.threadId, callParams.time, frameIndex,
        +
        14684  imageCreateInfo.flags,
        +
        14685  imageCreateInfo.imageType,
        +
        14686  imageCreateInfo.format,
        +
        14687  imageCreateInfo.extent.width,
        +
        14688  imageCreateInfo.extent.height,
        +
        14689  imageCreateInfo.extent.depth,
        +
        14690  imageCreateInfo.mipLevels,
        +
        14691  imageCreateInfo.arrayLayers,
        +
        14692  imageCreateInfo.samples,
        +
        14693  imageCreateInfo.tiling,
        +
        14694  imageCreateInfo.usage,
        +
        14695  imageCreateInfo.sharingMode,
        +
        14696  imageCreateInfo.initialLayout,
        +
        14697  allocCreateInfo.flags,
        +
        14698  allocCreateInfo.usage,
        +
        14699  allocCreateInfo.requiredFlags,
        +
        14700  allocCreateInfo.preferredFlags,
        +
        14701  allocCreateInfo.memoryTypeBits,
        +
        14702  allocCreateInfo.pool,
        +
        14703  allocation,
        +
        14704  userDataStr.GetString());
        +
        14705  Flush();
        +
        14706 }
        14707 
        -
        14708 #if VMA_MEMORY_BUDGET
        -
        14709  if(m_UseExtMemoryBudget)
        -
        14710  {
        -
        14711  UpdateVulkanBudget();
        -
        14712  }
        -
        14713 #endif // #if VMA_MEMORY_BUDGET
        -
        14714 
        -
        14715  return res;
        -
        14716 }
        -
        14717 
        -
        14718 VmaAllocator_T::~VmaAllocator_T()
        -
        14719 {
        -
        14720 #if VMA_RECORDING_ENABLED
        -
        14721  if(m_pRecorder != VMA_NULL)
        -
        14722  {
        -
        14723  m_pRecorder->RecordDestroyAllocator(GetCurrentFrameIndex());
        -
        14724  vma_delete(this, m_pRecorder);
        -
        14725  }
        -
        14726 #endif
        -
        14727 
        -
        14728  VMA_ASSERT(m_Pools.empty());
        -
        14729 
        -
        14730  for(size_t i = GetMemoryTypeCount(); i--; )
        -
        14731  {
        -
        14732  if(m_pDedicatedAllocations[i] != VMA_NULL && !m_pDedicatedAllocations[i]->empty())
        -
        14733  {
        -
        14734  VMA_ASSERT(0 && "Unfreed dedicated allocations found.");
        -
        14735  }
        -
        14736 
        -
        14737  vma_delete(this, m_pDedicatedAllocations[i]);
        -
        14738  vma_delete(this, m_pBlockVectors[i]);
        -
        14739  }
        -
        14740 }
        -
        14741 
        -
        14742 void VmaAllocator_T::ImportVulkanFunctions(const VmaVulkanFunctions* pVulkanFunctions)
        -
        14743 {
        -
        14744 #if VMA_STATIC_VULKAN_FUNCTIONS == 1
        -
        14745  m_VulkanFunctions.vkGetPhysicalDeviceProperties = (PFN_vkGetPhysicalDeviceProperties)vkGetPhysicalDeviceProperties;
        -
        14746  m_VulkanFunctions.vkGetPhysicalDeviceMemoryProperties = (PFN_vkGetPhysicalDeviceMemoryProperties)vkGetPhysicalDeviceMemoryProperties;
        -
        14747  m_VulkanFunctions.vkAllocateMemory = (PFN_vkAllocateMemory)vkAllocateMemory;
        -
        14748  m_VulkanFunctions.vkFreeMemory = (PFN_vkFreeMemory)vkFreeMemory;
        -
        14749  m_VulkanFunctions.vkMapMemory = (PFN_vkMapMemory)vkMapMemory;
        -
        14750  m_VulkanFunctions.vkUnmapMemory = (PFN_vkUnmapMemory)vkUnmapMemory;
        -
        14751  m_VulkanFunctions.vkFlushMappedMemoryRanges = (PFN_vkFlushMappedMemoryRanges)vkFlushMappedMemoryRanges;
        -
        14752  m_VulkanFunctions.vkInvalidateMappedMemoryRanges = (PFN_vkInvalidateMappedMemoryRanges)vkInvalidateMappedMemoryRanges;
        -
        14753  m_VulkanFunctions.vkBindBufferMemory = (PFN_vkBindBufferMemory)vkBindBufferMemory;
        -
        14754  m_VulkanFunctions.vkBindImageMemory = (PFN_vkBindImageMemory)vkBindImageMemory;
        -
        14755  m_VulkanFunctions.vkGetBufferMemoryRequirements = (PFN_vkGetBufferMemoryRequirements)vkGetBufferMemoryRequirements;
        -
        14756  m_VulkanFunctions.vkGetImageMemoryRequirements = (PFN_vkGetImageMemoryRequirements)vkGetImageMemoryRequirements;
        -
        14757  m_VulkanFunctions.vkCreateBuffer = (PFN_vkCreateBuffer)vkCreateBuffer;
        -
        14758  m_VulkanFunctions.vkDestroyBuffer = (PFN_vkDestroyBuffer)vkDestroyBuffer;
        -
        14759  m_VulkanFunctions.vkCreateImage = (PFN_vkCreateImage)vkCreateImage;
        -
        14760  m_VulkanFunctions.vkDestroyImage = (PFN_vkDestroyImage)vkDestroyImage;
        -
        14761  m_VulkanFunctions.vkCmdCopyBuffer = (PFN_vkCmdCopyBuffer)vkCmdCopyBuffer;
        -
        14762 #if VMA_VULKAN_VERSION >= 1001000
        -
        14763  if(m_VulkanApiVersion >= VK_MAKE_VERSION(1, 1, 0))
        -
        14764  {
        -
        14765  VMA_ASSERT(m_hInstance != VK_NULL_HANDLE);
        -
        14766  m_VulkanFunctions.vkGetBufferMemoryRequirements2KHR =
        -
        14767  (PFN_vkGetBufferMemoryRequirements2KHR)vkGetDeviceProcAddr(m_hDevice, "vkGetBufferMemoryRequirements2");
        -
        14768  m_VulkanFunctions.vkGetImageMemoryRequirements2KHR =
        -
        14769  (PFN_vkGetImageMemoryRequirements2KHR)vkGetDeviceProcAddr(m_hDevice, "vkGetImageMemoryRequirements2");
        -
        14770  m_VulkanFunctions.vkBindBufferMemory2KHR =
        -
        14771  (PFN_vkBindBufferMemory2KHR)vkGetDeviceProcAddr(m_hDevice, "vkBindBufferMemory2");
        -
        14772  m_VulkanFunctions.vkBindImageMemory2KHR =
        -
        14773  (PFN_vkBindImageMemory2KHR)vkGetDeviceProcAddr(m_hDevice, "vkBindImageMemory2");
        -
        14774  m_VulkanFunctions.vkGetPhysicalDeviceMemoryProperties2KHR =
        -
        14775  (PFN_vkGetPhysicalDeviceMemoryProperties2KHR)vkGetInstanceProcAddr(m_hInstance, "vkGetPhysicalDeviceMemoryProperties2");
        -
        14776  }
        -
        14777 #endif
        -
        14778 #if VMA_DEDICATED_ALLOCATION
        -
        14779  if(m_UseKhrDedicatedAllocation)
        -
        14780  {
        -
        14781  m_VulkanFunctions.vkGetBufferMemoryRequirements2KHR =
        -
        14782  (PFN_vkGetBufferMemoryRequirements2KHR)vkGetDeviceProcAddr(m_hDevice, "vkGetBufferMemoryRequirements2KHR");
        -
        14783  m_VulkanFunctions.vkGetImageMemoryRequirements2KHR =
        -
        14784  (PFN_vkGetImageMemoryRequirements2KHR)vkGetDeviceProcAddr(m_hDevice, "vkGetImageMemoryRequirements2KHR");
        -
        14785  }
        -
        14786 #endif
        -
        14787 #if VMA_BIND_MEMORY2
        -
        14788  if(m_UseKhrBindMemory2)
        -
        14789  {
        -
        14790  m_VulkanFunctions.vkBindBufferMemory2KHR =
        -
        14791  (PFN_vkBindBufferMemory2KHR)vkGetDeviceProcAddr(m_hDevice, "vkBindBufferMemory2KHR");
        -
        14792  m_VulkanFunctions.vkBindImageMemory2KHR =
        -
        14793  (PFN_vkBindImageMemory2KHR)vkGetDeviceProcAddr(m_hDevice, "vkBindImageMemory2KHR");
        -
        14794  }
        -
        14795 #endif // #if VMA_BIND_MEMORY2
        -
        14796 #if VMA_MEMORY_BUDGET
        -
        14797  if(m_UseExtMemoryBudget && m_VulkanApiVersion < VK_MAKE_VERSION(1, 1, 0))
        -
        14798  {
        -
        14799  VMA_ASSERT(m_hInstance != VK_NULL_HANDLE);
        -
        14800  m_VulkanFunctions.vkGetPhysicalDeviceMemoryProperties2KHR =
        -
        14801  (PFN_vkGetPhysicalDeviceMemoryProperties2KHR)vkGetInstanceProcAddr(m_hInstance, "vkGetPhysicalDeviceMemoryProperties2KHR");
        -
        14802  }
        -
        14803 #endif // #if VMA_MEMORY_BUDGET
        -
        14804 #endif // #if VMA_STATIC_VULKAN_FUNCTIONS == 1
        -
        14805 
        -
        14806 #define VMA_COPY_IF_NOT_NULL(funcName) \
        -
        14807  if(pVulkanFunctions->funcName != VMA_NULL) m_VulkanFunctions.funcName = pVulkanFunctions->funcName;
        -
        14808 
        -
        14809  if(pVulkanFunctions != VMA_NULL)
        -
        14810  {
        -
        14811  VMA_COPY_IF_NOT_NULL(vkGetPhysicalDeviceProperties);
        -
        14812  VMA_COPY_IF_NOT_NULL(vkGetPhysicalDeviceMemoryProperties);
        -
        14813  VMA_COPY_IF_NOT_NULL(vkAllocateMemory);
        -
        14814  VMA_COPY_IF_NOT_NULL(vkFreeMemory);
        -
        14815  VMA_COPY_IF_NOT_NULL(vkMapMemory);
        -
        14816  VMA_COPY_IF_NOT_NULL(vkUnmapMemory);
        -
        14817  VMA_COPY_IF_NOT_NULL(vkFlushMappedMemoryRanges);
        -
        14818  VMA_COPY_IF_NOT_NULL(vkInvalidateMappedMemoryRanges);
        -
        14819  VMA_COPY_IF_NOT_NULL(vkBindBufferMemory);
        -
        14820  VMA_COPY_IF_NOT_NULL(vkBindImageMemory);
        -
        14821  VMA_COPY_IF_NOT_NULL(vkGetBufferMemoryRequirements);
        -
        14822  VMA_COPY_IF_NOT_NULL(vkGetImageMemoryRequirements);
        -
        14823  VMA_COPY_IF_NOT_NULL(vkCreateBuffer);
        -
        14824  VMA_COPY_IF_NOT_NULL(vkDestroyBuffer);
        -
        14825  VMA_COPY_IF_NOT_NULL(vkCreateImage);
        -
        14826  VMA_COPY_IF_NOT_NULL(vkDestroyImage);
        -
        14827  VMA_COPY_IF_NOT_NULL(vkCmdCopyBuffer);
        -
        14828 #if VMA_DEDICATED_ALLOCATION || VMA_VULKAN_VERSION >= 1001000
        -
        14829  VMA_COPY_IF_NOT_NULL(vkGetBufferMemoryRequirements2KHR);
        -
        14830  VMA_COPY_IF_NOT_NULL(vkGetImageMemoryRequirements2KHR);
        -
        14831 #endif
        -
        14832 #if VMA_BIND_MEMORY2 || VMA_VULKAN_VERSION >= 1001000
        -
        14833  VMA_COPY_IF_NOT_NULL(vkBindBufferMemory2KHR);
        -
        14834  VMA_COPY_IF_NOT_NULL(vkBindImageMemory2KHR);
        -
        14835 #endif
        -
        14836 #if VMA_MEMORY_BUDGET
        -
        14837  VMA_COPY_IF_NOT_NULL(vkGetPhysicalDeviceMemoryProperties2KHR);
        -
        14838 #endif
        -
        14839  }
        -
        14840 
        -
        14841 #undef VMA_COPY_IF_NOT_NULL
        -
        14842 
        -
        14843  // If these asserts are hit, you must either #define VMA_STATIC_VULKAN_FUNCTIONS 1
        -
        14844  // or pass valid pointers as VmaAllocatorCreateInfo::pVulkanFunctions.
        -
        14845  VMA_ASSERT(m_VulkanFunctions.vkGetPhysicalDeviceProperties != VMA_NULL);
        -
        14846  VMA_ASSERT(m_VulkanFunctions.vkGetPhysicalDeviceMemoryProperties != VMA_NULL);
        -
        14847  VMA_ASSERT(m_VulkanFunctions.vkAllocateMemory != VMA_NULL);
        -
        14848  VMA_ASSERT(m_VulkanFunctions.vkFreeMemory != VMA_NULL);
        -
        14849  VMA_ASSERT(m_VulkanFunctions.vkMapMemory != VMA_NULL);
        -
        14850  VMA_ASSERT(m_VulkanFunctions.vkUnmapMemory != VMA_NULL);
        -
        14851  VMA_ASSERT(m_VulkanFunctions.vkFlushMappedMemoryRanges != VMA_NULL);
        -
        14852  VMA_ASSERT(m_VulkanFunctions.vkInvalidateMappedMemoryRanges != VMA_NULL);
        -
        14853  VMA_ASSERT(m_VulkanFunctions.vkBindBufferMemory != VMA_NULL);
        -
        14854  VMA_ASSERT(m_VulkanFunctions.vkBindImageMemory != VMA_NULL);
        -
        14855  VMA_ASSERT(m_VulkanFunctions.vkGetBufferMemoryRequirements != VMA_NULL);
        -
        14856  VMA_ASSERT(m_VulkanFunctions.vkGetImageMemoryRequirements != VMA_NULL);
        -
        14857  VMA_ASSERT(m_VulkanFunctions.vkCreateBuffer != VMA_NULL);
        -
        14858  VMA_ASSERT(m_VulkanFunctions.vkDestroyBuffer != VMA_NULL);
        -
        14859  VMA_ASSERT(m_VulkanFunctions.vkCreateImage != VMA_NULL);
        -
        14860  VMA_ASSERT(m_VulkanFunctions.vkDestroyImage != VMA_NULL);
        -
        14861  VMA_ASSERT(m_VulkanFunctions.vkCmdCopyBuffer != VMA_NULL);
        -
        14862 #if VMA_DEDICATED_ALLOCATION || VMA_VULKAN_VERSION >= 1001000
        -
        14863  if(m_VulkanApiVersion >= VK_MAKE_VERSION(1, 1, 0) || m_UseKhrDedicatedAllocation)
        -
        14864  {
        -
        14865  VMA_ASSERT(m_VulkanFunctions.vkGetBufferMemoryRequirements2KHR != VMA_NULL);
        -
        14866  VMA_ASSERT(m_VulkanFunctions.vkGetImageMemoryRequirements2KHR != VMA_NULL);
        -
        14867  }
        -
        14868 #endif
        -
        14869 #if VMA_BIND_MEMORY2 || VMA_VULKAN_VERSION >= 1001000
        -
        14870  if(m_VulkanApiVersion >= VK_MAKE_VERSION(1, 1, 0) || m_UseKhrBindMemory2)
        -
        14871  {
        -
        14872  VMA_ASSERT(m_VulkanFunctions.vkBindBufferMemory2KHR != VMA_NULL);
        -
        14873  VMA_ASSERT(m_VulkanFunctions.vkBindImageMemory2KHR != VMA_NULL);
        -
        14874  }
        -
        14875 #endif
        -
        14876 #if VMA_MEMORY_BUDGET || VMA_VULKAN_VERSION >= 1001000
        -
        14877  if(m_UseExtMemoryBudget || m_VulkanApiVersion >= VK_MAKE_VERSION(1, 1, 0))
        -
        14878  {
        -
        14879  VMA_ASSERT(m_VulkanFunctions.vkGetPhysicalDeviceMemoryProperties2KHR != VMA_NULL);
        -
        14880  }
        -
        14881 #endif
        -
        14882 }
        -
        14883 
        -
        14884 VkDeviceSize VmaAllocator_T::CalcPreferredBlockSize(uint32_t memTypeIndex)
        -
        14885 {
        -
        14886  const uint32_t heapIndex = MemoryTypeIndexToHeapIndex(memTypeIndex);
        -
        14887  const VkDeviceSize heapSize = m_MemProps.memoryHeaps[heapIndex].size;
        -
        14888  const bool isSmallHeap = heapSize <= VMA_SMALL_HEAP_MAX_SIZE;
        -
        14889  return VmaAlignUp(isSmallHeap ? (heapSize / 8) : m_PreferredLargeHeapBlockSize, (VkDeviceSize)32);
        -
        14890 }
        -
        14891 
        -
        14892 VkResult VmaAllocator_T::AllocateMemoryOfType(
        -
        14893  VkDeviceSize size,
        -
        14894  VkDeviceSize alignment,
        -
        14895  bool dedicatedAllocation,
        -
        14896  VkBuffer dedicatedBuffer,
        -
        14897  VkImage dedicatedImage,
        -
        14898  const VmaAllocationCreateInfo& createInfo,
        -
        14899  uint32_t memTypeIndex,
        -
        14900  VmaSuballocationType suballocType,
        -
        14901  size_t allocationCount,
        -
        14902  VmaAllocation* pAllocations)
        -
        14903 {
        -
        14904  VMA_ASSERT(pAllocations != VMA_NULL);
        -
        14905  VMA_DEBUG_LOG(" AllocateMemory: MemoryTypeIndex=%u, AllocationCount=%zu, Size=%llu", memTypeIndex, allocationCount, size);
        -
        14906 
        -
        14907  VmaAllocationCreateInfo finalCreateInfo = createInfo;
        -
        14908 
        -
        14909  // If memory type is not HOST_VISIBLE, disable MAPPED.
        -
        14910  if((finalCreateInfo.flags & VMA_ALLOCATION_CREATE_MAPPED_BIT) != 0 &&
        -
        14911  (m_MemProps.memoryTypes[memTypeIndex].propertyFlags & VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT) == 0)
        -
        14912  {
        -
        14913  finalCreateInfo.flags &= ~VMA_ALLOCATION_CREATE_MAPPED_BIT;
        -
        14914  }
        -
        14915  // If memory is lazily allocated, it should be always dedicated.
        -
        14916  if(finalCreateInfo.usage == VMA_MEMORY_USAGE_GPU_LAZILY_ALLOCATED)
        -
        14917  {
        -
        14918  finalCreateInfo.flags |= VMA_ALLOCATION_CREATE_DEDICATED_MEMORY_BIT;
        -
        14919  }
        -
        14920 
        -
        14921  VmaBlockVector* const blockVector = m_pBlockVectors[memTypeIndex];
        -
        14922  VMA_ASSERT(blockVector);
        -
        14923 
        -
        14924  const VkDeviceSize preferredBlockSize = blockVector->GetPreferredBlockSize();
        -
        14925  bool preferDedicatedMemory =
        -
        14926  VMA_DEBUG_ALWAYS_DEDICATED_MEMORY ||
        -
        14927  dedicatedAllocation ||
        -
        14928  // Heuristics: Allocate dedicated memory if requested size if greater than half of preferred block size.
        -
        14929  size > preferredBlockSize / 2;
        -
        14930 
        -
        14931  if(preferDedicatedMemory &&
        -
        14932  (finalCreateInfo.flags & VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT) == 0 &&
        -
        14933  finalCreateInfo.pool == VK_NULL_HANDLE)
        -
        14934  {
        -
        14935  finalCreateInfo.flags |= VMA_ALLOCATION_CREATE_DEDICATED_MEMORY_BIT;
        -
        14936  }
        -
        14937 
        -
        14938  if((finalCreateInfo.flags & VMA_ALLOCATION_CREATE_DEDICATED_MEMORY_BIT) != 0)
        -
        14939  {
        -
        14940  if((finalCreateInfo.flags & VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT) != 0)
        -
        14941  {
        -
        14942  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        -
        14943  }
        -
        14944  else
        -
        14945  {
        -
        14946  return AllocateDedicatedMemory(
        -
        14947  size,
        -
        14948  suballocType,
        -
        14949  memTypeIndex,
        -
        14950  (finalCreateInfo.flags & VMA_ALLOCATION_CREATE_WITHIN_BUDGET_BIT) != 0,
        -
        14951  (finalCreateInfo.flags & VMA_ALLOCATION_CREATE_MAPPED_BIT) != 0,
        -
        14952  (finalCreateInfo.flags & VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT) != 0,
        -
        14953  finalCreateInfo.pUserData,
        -
        14954  dedicatedBuffer,
        -
        14955  dedicatedImage,
        -
        14956  allocationCount,
        -
        14957  pAllocations);
        -
        14958  }
        -
        14959  }
        -
        14960  else
        -
        14961  {
        -
        14962  VkResult res = blockVector->Allocate(
        -
        14963  m_CurrentFrameIndex.load(),
        -
        14964  size,
        -
        14965  alignment,
        -
        14966  finalCreateInfo,
        -
        14967  suballocType,
        -
        14968  allocationCount,
        -
        14969  pAllocations);
        -
        14970  if(res == VK_SUCCESS)
        -
        14971  {
        -
        14972  return res;
        -
        14973  }
        -
        14974 
        -
        14975  // 5. Try dedicated memory.
        -
        14976  if((finalCreateInfo.flags & VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT) != 0)
        -
        14977  {
        -
        14978  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        -
        14979  }
        -
        14980  else
        -
        14981  {
        -
        14982  res = AllocateDedicatedMemory(
        -
        14983  size,
        -
        14984  suballocType,
        -
        14985  memTypeIndex,
        -
        14986  (finalCreateInfo.flags & VMA_ALLOCATION_CREATE_WITHIN_BUDGET_BIT) != 0,
        -
        14987  (finalCreateInfo.flags & VMA_ALLOCATION_CREATE_MAPPED_BIT) != 0,
        -
        14988  (finalCreateInfo.flags & VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT) != 0,
        -
        14989  finalCreateInfo.pUserData,
        -
        14990  dedicatedBuffer,
        -
        14991  dedicatedImage,
        -
        14992  allocationCount,
        -
        14993  pAllocations);
        -
        14994  if(res == VK_SUCCESS)
        -
        14995  {
        -
        14996  // Succeeded: AllocateDedicatedMemory function already filld pMemory, nothing more to do here.
        -
        14997  VMA_DEBUG_LOG(" Allocated as DedicatedMemory");
        -
        14998  return VK_SUCCESS;
        -
        14999  }
        -
        15000  else
        -
        15001  {
        -
        15002  // Everything failed: Return error code.
        -
        15003  VMA_DEBUG_LOG(" vkAllocateMemory FAILED");
        -
        15004  return res;
        -
        15005  }
        -
        15006  }
        -
        15007  }
        -
        15008 }
        -
        15009 
        -
        15010 VkResult VmaAllocator_T::AllocateDedicatedMemory(
        -
        15011  VkDeviceSize size,
        -
        15012  VmaSuballocationType suballocType,
        -
        15013  uint32_t memTypeIndex,
        -
        15014  bool withinBudget,
        -
        15015  bool map,
        -
        15016  bool isUserDataString,
        -
        15017  void* pUserData,
        -
        15018  VkBuffer dedicatedBuffer,
        -
        15019  VkImage dedicatedImage,
        -
        15020  size_t allocationCount,
        -
        15021  VmaAllocation* pAllocations)
        -
        15022 {
        -
        15023  VMA_ASSERT(allocationCount > 0 && pAllocations);
        -
        15024 
        -
        15025  if(withinBudget)
        -
        15026  {
        -
        15027  const uint32_t heapIndex = MemoryTypeIndexToHeapIndex(memTypeIndex);
        -
        15028  VmaBudget heapBudget = {};
        -
        15029  GetBudget(&heapBudget, heapIndex, 1);
        -
        15030  if(heapBudget.usage + size * allocationCount > heapBudget.budget)
        -
        15031  {
        -
        15032  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        -
        15033  }
        -
        15034  }
        +
        14708 void VmaRecorder::RecordDestroyBuffer(uint32_t frameIndex,
        +
        14709  VmaAllocation allocation)
        +
        14710 {
        +
        14711  CallParams callParams;
        +
        14712  GetBasicParams(callParams);
        +
        14713 
        +
        14714  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14715  fprintf(m_File, "%u,%.3f,%u,vmaDestroyBuffer,%p\n", callParams.threadId, callParams.time, frameIndex,
        +
        14716  allocation);
        +
        14717  Flush();
        +
        14718 }
        +
        14719 
        +
        14720 void VmaRecorder::RecordDestroyImage(uint32_t frameIndex,
        +
        14721  VmaAllocation allocation)
        +
        14722 {
        +
        14723  CallParams callParams;
        +
        14724  GetBasicParams(callParams);
        +
        14725 
        +
        14726  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14727  fprintf(m_File, "%u,%.3f,%u,vmaDestroyImage,%p\n", callParams.threadId, callParams.time, frameIndex,
        +
        14728  allocation);
        +
        14729  Flush();
        +
        14730 }
        +
        14731 
        +
        14732 void VmaRecorder::RecordTouchAllocation(uint32_t frameIndex,
        +
        14733  VmaAllocation allocation)
        +
        14734 {
        +
        14735  CallParams callParams;
        +
        14736  GetBasicParams(callParams);
        +
        14737 
        +
        14738  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14739  fprintf(m_File, "%u,%.3f,%u,vmaTouchAllocation,%p\n", callParams.threadId, callParams.time, frameIndex,
        +
        14740  allocation);
        +
        14741  Flush();
        +
        14742 }
        +
        14743 
        +
        14744 void VmaRecorder::RecordGetAllocationInfo(uint32_t frameIndex,
        +
        14745  VmaAllocation allocation)
        +
        14746 {
        +
        14747  CallParams callParams;
        +
        14748  GetBasicParams(callParams);
        +
        14749 
        +
        14750  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14751  fprintf(m_File, "%u,%.3f,%u,vmaGetAllocationInfo,%p\n", callParams.threadId, callParams.time, frameIndex,
        +
        14752  allocation);
        +
        14753  Flush();
        +
        14754 }
        +
        14755 
        +
        14756 void VmaRecorder::RecordMakePoolAllocationsLost(uint32_t frameIndex,
        +
        14757  VmaPool pool)
        +
        14758 {
        +
        14759  CallParams callParams;
        +
        14760  GetBasicParams(callParams);
        +
        14761 
        +
        14762  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14763  fprintf(m_File, "%u,%.3f,%u,vmaMakePoolAllocationsLost,%p\n", callParams.threadId, callParams.time, frameIndex,
        +
        14764  pool);
        +
        14765  Flush();
        +
        14766 }
        +
        14767 
        +
        14768 void VmaRecorder::RecordDefragmentationBegin(uint32_t frameIndex,
        +
        14769  const VmaDefragmentationInfo2& info,
        +
        14770  VmaDefragmentationContext ctx)
        +
        14771 {
        +
        14772  CallParams callParams;
        +
        14773  GetBasicParams(callParams);
        +
        14774 
        +
        14775  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14776  fprintf(m_File, "%u,%.3f,%u,vmaDefragmentationBegin,%u,", callParams.threadId, callParams.time, frameIndex,
        +
        14777  info.flags);
        +
        14778  PrintPointerList(info.allocationCount, info.pAllocations);
        +
        14779  fprintf(m_File, ",");
        +
        14780  PrintPointerList(info.poolCount, info.pPools);
        +
        14781  fprintf(m_File, ",%llu,%u,%llu,%u,%p,%p\n",
        +
        14782  info.maxCpuBytesToMove,
        +
        14783  info.maxCpuAllocationsToMove,
        +
        14784  info.maxGpuBytesToMove,
        +
        14785  info.maxGpuAllocationsToMove,
        +
        14786  info.commandBuffer,
        +
        14787  ctx);
        +
        14788  Flush();
        +
        14789 }
        +
        14790 
        +
        14791 void VmaRecorder::RecordDefragmentationEnd(uint32_t frameIndex,
        +
        14792  VmaDefragmentationContext ctx)
        +
        14793 {
        +
        14794  CallParams callParams;
        +
        14795  GetBasicParams(callParams);
        +
        14796 
        +
        14797  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14798  fprintf(m_File, "%u,%.3f,%u,vmaDefragmentationEnd,%p\n", callParams.threadId, callParams.time, frameIndex,
        +
        14799  ctx);
        +
        14800  Flush();
        +
        14801 }
        +
        14802 
        +
        14803 void VmaRecorder::RecordSetPoolName(uint32_t frameIndex,
        +
        14804  VmaPool pool,
        +
        14805  const char* name)
        +
        14806 {
        +
        14807  CallParams callParams;
        +
        14808  GetBasicParams(callParams);
        +
        14809 
        +
        14810  VmaMutexLock lock(m_FileMutex, m_UseMutex);
        +
        14811  fprintf(m_File, "%u,%.3f,%u,vmaSetPoolName,%p,%s\n", callParams.threadId, callParams.time, frameIndex,
        +
        14812  pool, name != VMA_NULL ? name : "");
        +
        14813  Flush();
        +
        14814 }
        +
        14815 
        +
        14816 VmaRecorder::UserDataString::UserDataString(VmaAllocationCreateFlags allocFlags, const void* pUserData)
        +
        14817 {
        +
        14818  if(pUserData != VMA_NULL)
        +
        14819  {
        +
        14820  if((allocFlags & VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT) != 0)
        +
        14821  {
        +
        14822  m_Str = (const char*)pUserData;
        +
        14823  }
        +
        14824  else
        +
        14825  {
        +
        14826  sprintf_s(m_PtrStr, "%p", pUserData);
        +
        14827  m_Str = m_PtrStr;
        +
        14828  }
        +
        14829  }
        +
        14830  else
        +
        14831  {
        +
        14832  m_Str = "";
        +
        14833  }
        +
        14834 }
        +
        14835 
        +
        14836 void VmaRecorder::WriteConfiguration(
        +
        14837  const VkPhysicalDeviceProperties& devProps,
        +
        14838  const VkPhysicalDeviceMemoryProperties& memProps,
        +
        14839  uint32_t vulkanApiVersion,
        +
        14840  bool dedicatedAllocationExtensionEnabled,
        +
        14841  bool bindMemory2ExtensionEnabled,
        +
        14842  bool memoryBudgetExtensionEnabled,
        +
        14843  bool deviceCoherentMemoryExtensionEnabled)
        +
        14844 {
        +
        14845  fprintf(m_File, "Config,Begin\n");
        +
        14846 
        +
        14847  fprintf(m_File, "VulkanApiVersion,%u,%u\n", VK_VERSION_MAJOR(vulkanApiVersion), VK_VERSION_MINOR(vulkanApiVersion));
        +
        14848 
        +
        14849  fprintf(m_File, "PhysicalDevice,apiVersion,%u\n", devProps.apiVersion);
        +
        14850  fprintf(m_File, "PhysicalDevice,driverVersion,%u\n", devProps.driverVersion);
        +
        14851  fprintf(m_File, "PhysicalDevice,vendorID,%u\n", devProps.vendorID);
        +
        14852  fprintf(m_File, "PhysicalDevice,deviceID,%u\n", devProps.deviceID);
        +
        14853  fprintf(m_File, "PhysicalDevice,deviceType,%u\n", devProps.deviceType);
        +
        14854  fprintf(m_File, "PhysicalDevice,deviceName,%s\n", devProps.deviceName);
        +
        14855 
        +
        14856  fprintf(m_File, "PhysicalDeviceLimits,maxMemoryAllocationCount,%u\n", devProps.limits.maxMemoryAllocationCount);
        +
        14857  fprintf(m_File, "PhysicalDeviceLimits,bufferImageGranularity,%llu\n", devProps.limits.bufferImageGranularity);
        +
        14858  fprintf(m_File, "PhysicalDeviceLimits,nonCoherentAtomSize,%llu\n", devProps.limits.nonCoherentAtomSize);
        +
        14859 
        +
        14860  fprintf(m_File, "PhysicalDeviceMemory,HeapCount,%u\n", memProps.memoryHeapCount);
        +
        14861  for(uint32_t i = 0; i < memProps.memoryHeapCount; ++i)
        +
        14862  {
        +
        14863  fprintf(m_File, "PhysicalDeviceMemory,Heap,%u,size,%llu\n", i, memProps.memoryHeaps[i].size);
        +
        14864  fprintf(m_File, "PhysicalDeviceMemory,Heap,%u,flags,%u\n", i, memProps.memoryHeaps[i].flags);
        +
        14865  }
        +
        14866  fprintf(m_File, "PhysicalDeviceMemory,TypeCount,%u\n", memProps.memoryTypeCount);
        +
        14867  for(uint32_t i = 0; i < memProps.memoryTypeCount; ++i)
        +
        14868  {
        +
        14869  fprintf(m_File, "PhysicalDeviceMemory,Type,%u,heapIndex,%u\n", i, memProps.memoryTypes[i].heapIndex);
        +
        14870  fprintf(m_File, "PhysicalDeviceMemory,Type,%u,propertyFlags,%u\n", i, memProps.memoryTypes[i].propertyFlags);
        +
        14871  }
        +
        14872 
        +
        14873  fprintf(m_File, "Extension,VK_KHR_dedicated_allocation,%u\n", dedicatedAllocationExtensionEnabled ? 1 : 0);
        +
        14874  fprintf(m_File, "Extension,VK_KHR_bind_memory2,%u\n", bindMemory2ExtensionEnabled ? 1 : 0);
        +
        14875  fprintf(m_File, "Extension,VK_EXT_memory_budget,%u\n", memoryBudgetExtensionEnabled ? 1 : 0);
        +
        14876  fprintf(m_File, "Extension,VK_AMD_device_coherent_memory,%u\n", deviceCoherentMemoryExtensionEnabled ? 1 : 0);
        +
        14877 
        +
        14878  fprintf(m_File, "Macro,VMA_DEBUG_ALWAYS_DEDICATED_MEMORY,%u\n", VMA_DEBUG_ALWAYS_DEDICATED_MEMORY ? 1 : 0);
        +
        14879  fprintf(m_File, "Macro,VMA_DEBUG_ALIGNMENT,%llu\n", (VkDeviceSize)VMA_DEBUG_ALIGNMENT);
        +
        14880  fprintf(m_File, "Macro,VMA_DEBUG_MARGIN,%llu\n", (VkDeviceSize)VMA_DEBUG_MARGIN);
        +
        14881  fprintf(m_File, "Macro,VMA_DEBUG_INITIALIZE_ALLOCATIONS,%u\n", VMA_DEBUG_INITIALIZE_ALLOCATIONS ? 1 : 0);
        +
        14882  fprintf(m_File, "Macro,VMA_DEBUG_DETECT_CORRUPTION,%u\n", VMA_DEBUG_DETECT_CORRUPTION ? 1 : 0);
        +
        14883  fprintf(m_File, "Macro,VMA_DEBUG_GLOBAL_MUTEX,%u\n", VMA_DEBUG_GLOBAL_MUTEX ? 1 : 0);
        +
        14884  fprintf(m_File, "Macro,VMA_DEBUG_MIN_BUFFER_IMAGE_GRANULARITY,%llu\n", (VkDeviceSize)VMA_DEBUG_MIN_BUFFER_IMAGE_GRANULARITY);
        +
        14885  fprintf(m_File, "Macro,VMA_SMALL_HEAP_MAX_SIZE,%llu\n", (VkDeviceSize)VMA_SMALL_HEAP_MAX_SIZE);
        +
        14886  fprintf(m_File, "Macro,VMA_DEFAULT_LARGE_HEAP_BLOCK_SIZE,%llu\n", (VkDeviceSize)VMA_DEFAULT_LARGE_HEAP_BLOCK_SIZE);
        +
        14887 
        +
        14888  fprintf(m_File, "Config,End\n");
        +
        14889 }
        +
        14890 
        +
        14891 void VmaRecorder::GetBasicParams(CallParams& outParams)
        +
        14892 {
        +
        14893  outParams.threadId = GetCurrentThreadId();
        +
        14894 
        +
        14895  LARGE_INTEGER counter;
        +
        14896  QueryPerformanceCounter(&counter);
        +
        14897  outParams.time = (double)(counter.QuadPart - m_StartCounter) / (double)m_Freq;
        +
        14898 }
        +
        14899 
        +
        14900 void VmaRecorder::PrintPointerList(uint64_t count, const VmaAllocation* pItems)
        +
        14901 {
        +
        14902  if(count)
        +
        14903  {
        +
        14904  fprintf(m_File, "%p", pItems[0]);
        +
        14905  for(uint64_t i = 1; i < count; ++i)
        +
        14906  {
        +
        14907  fprintf(m_File, " %p", pItems[i]);
        +
        14908  }
        +
        14909  }
        +
        14910 }
        +
        14911 
        +
        14912 void VmaRecorder::Flush()
        +
        14913 {
        +
        14914  if((m_Flags & VMA_RECORD_FLUSH_AFTER_CALL_BIT) != 0)
        +
        14915  {
        +
        14916  fflush(m_File);
        +
        14917  }
        +
        14918 }
        +
        14919 
        +
        14920 #endif // #if VMA_RECORDING_ENABLED
        +
        14921 
        +
        14923 // VmaAllocationObjectAllocator
        +
        14924 
        +
        14925 VmaAllocationObjectAllocator::VmaAllocationObjectAllocator(const VkAllocationCallbacks* pAllocationCallbacks) :
        +
        14926  m_Allocator(pAllocationCallbacks, 1024)
        +
        14927 {
        +
        14928 }
        +
        14929 
        +
        14930 template<typename... Types> VmaAllocation VmaAllocationObjectAllocator::Allocate(Types... args)
        +
        14931 {
        +
        14932  VmaMutexLock mutexLock(m_Mutex);
        +
        14933  return m_Allocator.Alloc<Types...>(std::forward<Types>(args)...);
        +
        14934 }
        +
        14935 
        +
        14936 void VmaAllocationObjectAllocator::Free(VmaAllocation hAlloc)
        +
        14937 {
        +
        14938  VmaMutexLock mutexLock(m_Mutex);
        +
        14939  m_Allocator.Free(hAlloc);
        +
        14940 }
        +
        14941 
        +
        14943 // VmaAllocator_T
        +
        14944 
        +
        14945 VmaAllocator_T::VmaAllocator_T(const VmaAllocatorCreateInfo* pCreateInfo) :
        +
        14946  m_UseMutex((pCreateInfo->flags & VMA_ALLOCATOR_CREATE_EXTERNALLY_SYNCHRONIZED_BIT) == 0),
        +
        14947  m_VulkanApiVersion(pCreateInfo->vulkanApiVersion != 0 ? pCreateInfo->vulkanApiVersion : VK_API_VERSION_1_0),
        +
        14948  m_UseKhrDedicatedAllocation((pCreateInfo->flags & VMA_ALLOCATOR_CREATE_KHR_DEDICATED_ALLOCATION_BIT) != 0),
        +
        14949  m_UseKhrBindMemory2((pCreateInfo->flags & VMA_ALLOCATOR_CREATE_KHR_BIND_MEMORY2_BIT) != 0),
        +
        14950  m_UseExtMemoryBudget((pCreateInfo->flags & VMA_ALLOCATOR_CREATE_EXT_MEMORY_BUDGET_BIT) != 0),
        +
        14951  m_UseAmdDeviceCoherentMemory((pCreateInfo->flags & VMA_ALLOCATOR_CREATE_AMD_DEVICE_COHERENT_MEMORY_BIT) != 0),
        +
        14952  m_hDevice(pCreateInfo->device),
        +
        14953  m_hInstance(pCreateInfo->instance),
        +
        14954  m_AllocationCallbacksSpecified(pCreateInfo->pAllocationCallbacks != VMA_NULL),
        +
        14955  m_AllocationCallbacks(pCreateInfo->pAllocationCallbacks ?
        +
        14956  *pCreateInfo->pAllocationCallbacks : VmaEmptyAllocationCallbacks),
        +
        14957  m_AllocationObjectAllocator(&m_AllocationCallbacks),
        +
        14958  m_HeapSizeLimitMask(0),
        +
        14959  m_PreferredLargeHeapBlockSize(0),
        +
        14960  m_PhysicalDevice(pCreateInfo->physicalDevice),
        +
        14961  m_CurrentFrameIndex(0),
        +
        14962  m_GpuDefragmentationMemoryTypeBits(UINT32_MAX),
        +
        14963  m_Pools(VmaStlAllocator<VmaPool>(GetAllocationCallbacks())),
        +
        14964  m_NextPoolId(0),
        +
        14965  m_GlobalMemoryTypeBits(UINT32_MAX)
        +
        14966 #if VMA_RECORDING_ENABLED
        +
        14967  ,m_pRecorder(VMA_NULL)
        +
        14968 #endif
        +
        14969 {
        +
        14970  if(m_VulkanApiVersion >= VK_MAKE_VERSION(1, 1, 0))
        +
        14971  {
        +
        14972  m_UseKhrDedicatedAllocation = false;
        +
        14973  m_UseKhrBindMemory2 = false;
        +
        14974  }
        +
        14975 
        +
        14976  if(VMA_DEBUG_DETECT_CORRUPTION)
        +
        14977  {
        +
        14978  // Needs to be multiply of uint32_t size because we are going to write VMA_CORRUPTION_DETECTION_MAGIC_VALUE to it.
        +
        14979  VMA_ASSERT(VMA_DEBUG_MARGIN % sizeof(uint32_t) == 0);
        +
        14980  }
        +
        14981 
        +
        14982  VMA_ASSERT(pCreateInfo->physicalDevice && pCreateInfo->device);
        +
        14983 
        +
        14984  if(m_VulkanApiVersion < VK_MAKE_VERSION(1, 1, 0))
        +
        14985  {
        +
        14986 #if !(VMA_DEDICATED_ALLOCATION)
        +
        14987  if((pCreateInfo->flags & VMA_ALLOCATOR_CREATE_KHR_DEDICATED_ALLOCATION_BIT) != 0)
        +
        14988  {
        +
        14989  VMA_ASSERT(0 && "VMA_ALLOCATOR_CREATE_KHR_DEDICATED_ALLOCATION_BIT set but required extensions are disabled by preprocessor macros.");
        +
        14990  }
        +
        14991 #endif
        +
        14992 #if !(VMA_BIND_MEMORY2)
        +
        14993  if((pCreateInfo->flags & VMA_ALLOCATOR_CREATE_KHR_BIND_MEMORY2_BIT) != 0)
        +
        14994  {
        +
        14995  VMA_ASSERT(0 && "VMA_ALLOCATOR_CREATE_KHR_BIND_MEMORY2_BIT set but required extension is disabled by preprocessor macros.");
        +
        14996  }
        +
        14997 #endif
        +
        14998  }
        +
        14999 #if !(VMA_MEMORY_BUDGET)
        +
        15000  if((pCreateInfo->flags & VMA_ALLOCATOR_CREATE_EXT_MEMORY_BUDGET_BIT) != 0)
        +
        15001  {
        +
        15002  VMA_ASSERT(0 && "VMA_ALLOCATOR_CREATE_EXT_MEMORY_BUDGET_BIT set but required extension is disabled by preprocessor macros.");
        +
        15003  }
        +
        15004 #endif
        +
        15005 #if VMA_VULKAN_VERSION < 1001000
        +
        15006  if(m_VulkanApiVersion >= VK_MAKE_VERSION(1, 1, 0))
        +
        15007  {
        +
        15008  VMA_ASSERT(0 && "vulkanApiVersion >= VK_API_VERSION_1_1 but required Vulkan version is disabled by preprocessor macros.");
        +
        15009  }
        +
        15010 #endif
        +
        15011 
        +
        15012  memset(&m_DeviceMemoryCallbacks, 0 ,sizeof(m_DeviceMemoryCallbacks));
        +
        15013  memset(&m_PhysicalDeviceProperties, 0, sizeof(m_PhysicalDeviceProperties));
        +
        15014  memset(&m_MemProps, 0, sizeof(m_MemProps));
        +
        15015 
        +
        15016  memset(&m_pBlockVectors, 0, sizeof(m_pBlockVectors));
        +
        15017  memset(&m_pDedicatedAllocations, 0, sizeof(m_pDedicatedAllocations));
        +
        15018  memset(&m_VulkanFunctions, 0, sizeof(m_VulkanFunctions));
        +
        15019 
        +
        15020  if(pCreateInfo->pDeviceMemoryCallbacks != VMA_NULL)
        +
        15021  {
        +
        15022  m_DeviceMemoryCallbacks.pfnAllocate = pCreateInfo->pDeviceMemoryCallbacks->pfnAllocate;
        +
        15023  m_DeviceMemoryCallbacks.pfnFree = pCreateInfo->pDeviceMemoryCallbacks->pfnFree;
        +
        15024  }
        +
        15025 
        +
        15026  ImportVulkanFunctions(pCreateInfo->pVulkanFunctions);
        +
        15027 
        +
        15028  (*m_VulkanFunctions.vkGetPhysicalDeviceProperties)(m_PhysicalDevice, &m_PhysicalDeviceProperties);
        +
        15029  (*m_VulkanFunctions.vkGetPhysicalDeviceMemoryProperties)(m_PhysicalDevice, &m_MemProps);
        +
        15030 
        +
        15031  VMA_ASSERT(VmaIsPow2(VMA_DEBUG_ALIGNMENT));
        +
        15032  VMA_ASSERT(VmaIsPow2(VMA_DEBUG_MIN_BUFFER_IMAGE_GRANULARITY));
        +
        15033  VMA_ASSERT(VmaIsPow2(m_PhysicalDeviceProperties.limits.bufferImageGranularity));
        +
        15034  VMA_ASSERT(VmaIsPow2(m_PhysicalDeviceProperties.limits.nonCoherentAtomSize));
        15035 
        -
        15036  VkMemoryAllocateInfo allocInfo = { VK_STRUCTURE_TYPE_MEMORY_ALLOCATE_INFO };
        -
        15037  allocInfo.memoryTypeIndex = memTypeIndex;
        -
        15038  allocInfo.allocationSize = size;
        -
        15039 
        -
        15040 #if VMA_DEDICATED_ALLOCATION || VMA_VULKAN_VERSION >= 1001000
        -
        15041  VkMemoryDedicatedAllocateInfoKHR dedicatedAllocInfo = { VK_STRUCTURE_TYPE_MEMORY_DEDICATED_ALLOCATE_INFO_KHR };
        -
        15042  if(m_UseKhrDedicatedAllocation || m_VulkanApiVersion >= VK_MAKE_VERSION(1, 1, 0))
        -
        15043  {
        -
        15044  if(dedicatedBuffer != VK_NULL_HANDLE)
        -
        15045  {
        -
        15046  VMA_ASSERT(dedicatedImage == VK_NULL_HANDLE);
        -
        15047  dedicatedAllocInfo.buffer = dedicatedBuffer;
        -
        15048  allocInfo.pNext = &dedicatedAllocInfo;
        -
        15049  }
        -
        15050  else if(dedicatedImage != VK_NULL_HANDLE)
        -
        15051  {
        -
        15052  dedicatedAllocInfo.image = dedicatedImage;
        -
        15053  allocInfo.pNext = &dedicatedAllocInfo;
        +
        15036  m_PreferredLargeHeapBlockSize = (pCreateInfo->preferredLargeHeapBlockSize != 0) ?
        +
        15037  pCreateInfo->preferredLargeHeapBlockSize : static_cast<VkDeviceSize>(VMA_DEFAULT_LARGE_HEAP_BLOCK_SIZE);
        +
        15038 
        +
        15039  m_GlobalMemoryTypeBits = CalculateGlobalMemoryTypeBits();
        +
        15040 
        +
        15041  if(pCreateInfo->pHeapSizeLimit != VMA_NULL)
        +
        15042  {
        +
        15043  for(uint32_t heapIndex = 0; heapIndex < GetMemoryHeapCount(); ++heapIndex)
        +
        15044  {
        +
        15045  const VkDeviceSize limit = pCreateInfo->pHeapSizeLimit[heapIndex];
        +
        15046  if(limit != VK_WHOLE_SIZE)
        +
        15047  {
        +
        15048  m_HeapSizeLimitMask |= 1u << heapIndex;
        +
        15049  if(limit < m_MemProps.memoryHeaps[heapIndex].size)
        +
        15050  {
        +
        15051  m_MemProps.memoryHeaps[heapIndex].size = limit;
        +
        15052  }
        +
        15053  }
        15054  }
        15055  }
        -
        15056 #endif // #if VMA_DEDICATED_ALLOCATION || VMA_VULKAN_VERSION >= 1001000
        -
        15057 
        -
        15058  size_t allocIndex;
        -
        15059  VkResult res = VK_SUCCESS;
        -
        15060  for(allocIndex = 0; allocIndex < allocationCount; ++allocIndex)
        -
        15061  {
        -
        15062  res = AllocateDedicatedMemoryPage(
        -
        15063  size,
        -
        15064  suballocType,
        -
        15065  memTypeIndex,
        -
        15066  allocInfo,
        -
        15067  map,
        -
        15068  isUserDataString,
        -
        15069  pUserData,
        -
        15070  pAllocations + allocIndex);
        -
        15071  if(res != VK_SUCCESS)
        -
        15072  {
        -
        15073  break;
        -
        15074  }
        -
        15075  }
        -
        15076 
        -
        15077  if(res == VK_SUCCESS)
        -
        15078  {
        -
        15079  // Register them in m_pDedicatedAllocations.
        -
        15080  {
        -
        15081  VmaMutexLockWrite lock(m_DedicatedAllocationsMutex[memTypeIndex], m_UseMutex);
        -
        15082  AllocationVectorType* pDedicatedAllocations = m_pDedicatedAllocations[memTypeIndex];
        -
        15083  VMA_ASSERT(pDedicatedAllocations);
        -
        15084  for(allocIndex = 0; allocIndex < allocationCount; ++allocIndex)
        -
        15085  {
        -
        15086  VmaVectorInsertSorted<VmaPointerLess>(*pDedicatedAllocations, pAllocations[allocIndex]);
        -
        15087  }
        -
        15088  }
        -
        15089 
        -
        15090  VMA_DEBUG_LOG(" Allocated DedicatedMemory Count=%zu, MemoryTypeIndex=#%u", allocationCount, memTypeIndex);
        -
        15091  }
        -
        15092  else
        -
        15093  {
        -
        15094  // Free all already created allocations.
        -
        15095  while(allocIndex--)
        -
        15096  {
        -
        15097  VmaAllocation currAlloc = pAllocations[allocIndex];
        -
        15098  VkDeviceMemory hMemory = currAlloc->GetMemory();
        -
        15099 
        -
        15100  /*
        -
        15101  There is no need to call this, because Vulkan spec allows to skip vkUnmapMemory
        -
        15102  before vkFreeMemory.
        -
        15103 
        -
        15104  if(currAlloc->GetMappedData() != VMA_NULL)
        -
        15105  {
        -
        15106  (*m_VulkanFunctions.vkUnmapMemory)(m_hDevice, hMemory);
        -
        15107  }
        -
        15108  */
        -
        15109 
        -
        15110  FreeVulkanMemory(memTypeIndex, currAlloc->GetSize(), hMemory);
        -
        15111  m_Budget.RemoveAllocation(MemoryTypeIndexToHeapIndex(memTypeIndex), currAlloc->GetSize());
        -
        15112  currAlloc->SetUserData(this, VMA_NULL);
        -
        15113  currAlloc->Dtor();
        -
        15114  m_AllocationObjectAllocator.Free(currAlloc);
        -
        15115  }
        -
        15116 
        -
        15117  memset(pAllocations, 0, sizeof(VmaAllocation) * allocationCount);
        -
        15118  }
        -
        15119 
        -
        15120  return res;
        -
        15121 }
        -
        15122 
        -
        15123 VkResult VmaAllocator_T::AllocateDedicatedMemoryPage(
        -
        15124  VkDeviceSize size,
        -
        15125  VmaSuballocationType suballocType,
        -
        15126  uint32_t memTypeIndex,
        -
        15127  const VkMemoryAllocateInfo& allocInfo,
        -
        15128  bool map,
        -
        15129  bool isUserDataString,
        -
        15130  void* pUserData,
        -
        15131  VmaAllocation* pAllocation)
        -
        15132 {
        -
        15133  VkDeviceMemory hMemory = VK_NULL_HANDLE;
        -
        15134  VkResult res = AllocateVulkanMemory(&allocInfo, &hMemory);
        -
        15135  if(res < 0)
        -
        15136  {
        -
        15137  VMA_DEBUG_LOG(" vkAllocateMemory FAILED");
        -
        15138  return res;
        +
        15056 
        +
        15057  for(uint32_t memTypeIndex = 0; memTypeIndex < GetMemoryTypeCount(); ++memTypeIndex)
        +
        15058  {
        +
        15059  const VkDeviceSize preferredBlockSize = CalcPreferredBlockSize(memTypeIndex);
        +
        15060 
        +
        15061  m_pBlockVectors[memTypeIndex] = vma_new(this, VmaBlockVector)(
        +
        15062  this,
        +
        15063  VK_NULL_HANDLE, // hParentPool
        +
        15064  memTypeIndex,
        +
        15065  preferredBlockSize,
        +
        15066  0,
        +
        15067  SIZE_MAX,
        +
        15068  GetBufferImageGranularity(),
        +
        15069  pCreateInfo->frameInUseCount,
        +
        15070  false, // explicitBlockSize
        +
        15071  false); // linearAlgorithm
        +
        15072  // No need to call m_pBlockVectors[memTypeIndex][blockVectorTypeIndex]->CreateMinBlocks here,
        +
        15073  // becase minBlockCount is 0.
        +
        15074  m_pDedicatedAllocations[memTypeIndex] = vma_new(this, AllocationVectorType)(VmaStlAllocator<VmaAllocation>(GetAllocationCallbacks()));
        +
        15075 
        +
        15076  }
        +
        15077 }
        +
        15078 
        +
        15079 VkResult VmaAllocator_T::Init(const VmaAllocatorCreateInfo* pCreateInfo)
        +
        15080 {
        +
        15081  VkResult res = VK_SUCCESS;
        +
        15082 
        +
        15083  if(pCreateInfo->pRecordSettings != VMA_NULL &&
        +
        15084  !VmaStrIsEmpty(pCreateInfo->pRecordSettings->pFilePath))
        +
        15085  {
        +
        15086 #if VMA_RECORDING_ENABLED
        +
        15087  m_pRecorder = vma_new(this, VmaRecorder)();
        +
        15088  res = m_pRecorder->Init(*pCreateInfo->pRecordSettings, m_UseMutex);
        +
        15089  if(res != VK_SUCCESS)
        +
        15090  {
        +
        15091  return res;
        +
        15092  }
        +
        15093  m_pRecorder->WriteConfiguration(
        +
        15094  m_PhysicalDeviceProperties,
        +
        15095  m_MemProps,
        +
        15096  m_VulkanApiVersion,
        +
        15097  m_UseKhrDedicatedAllocation,
        +
        15098  m_UseKhrBindMemory2,
        +
        15099  m_UseExtMemoryBudget,
        +
        15100  m_UseAmdDeviceCoherentMemory);
        +
        15101  m_pRecorder->RecordCreateAllocator(GetCurrentFrameIndex());
        +
        15102 #else
        +
        15103  VMA_ASSERT(0 && "VmaAllocatorCreateInfo::pRecordSettings used, but not supported due to VMA_RECORDING_ENABLED not defined to 1.");
        +
        15104  return VK_ERROR_FEATURE_NOT_PRESENT;
        +
        15105 #endif
        +
        15106  }
        +
        15107 
        +
        15108 #if VMA_MEMORY_BUDGET
        +
        15109  if(m_UseExtMemoryBudget)
        +
        15110  {
        +
        15111  UpdateVulkanBudget();
        +
        15112  }
        +
        15113 #endif // #if VMA_MEMORY_BUDGET
        +
        15114 
        +
        15115  return res;
        +
        15116 }
        +
        15117 
        +
        15118 VmaAllocator_T::~VmaAllocator_T()
        +
        15119 {
        +
        15120 #if VMA_RECORDING_ENABLED
        +
        15121  if(m_pRecorder != VMA_NULL)
        +
        15122  {
        +
        15123  m_pRecorder->RecordDestroyAllocator(GetCurrentFrameIndex());
        +
        15124  vma_delete(this, m_pRecorder);
        +
        15125  }
        +
        15126 #endif
        +
        15127 
        +
        15128  VMA_ASSERT(m_Pools.empty());
        +
        15129 
        +
        15130  for(size_t i = GetMemoryTypeCount(); i--; )
        +
        15131  {
        +
        15132  if(m_pDedicatedAllocations[i] != VMA_NULL && !m_pDedicatedAllocations[i]->empty())
        +
        15133  {
        +
        15134  VMA_ASSERT(0 && "Unfreed dedicated allocations found.");
        +
        15135  }
        +
        15136 
        +
        15137  vma_delete(this, m_pDedicatedAllocations[i]);
        +
        15138  vma_delete(this, m_pBlockVectors[i]);
        15139  }
        -
        15140 
        -
        15141  void* pMappedData = VMA_NULL;
        -
        15142  if(map)
        -
        15143  {
        -
        15144  res = (*m_VulkanFunctions.vkMapMemory)(
        -
        15145  m_hDevice,
        -
        15146  hMemory,
        -
        15147  0,
        -
        15148  VK_WHOLE_SIZE,
        -
        15149  0,
        -
        15150  &pMappedData);
        -
        15151  if(res < 0)
        -
        15152  {
        -
        15153  VMA_DEBUG_LOG(" vkMapMemory FAILED");
        -
        15154  FreeVulkanMemory(memTypeIndex, size, hMemory);
        -
        15155  return res;
        -
        15156  }
        -
        15157  }
        -
        15158 
        -
        15159  *pAllocation = m_AllocationObjectAllocator.Allocate();
        -
        15160  (*pAllocation)->Ctor(m_CurrentFrameIndex.load(), isUserDataString);
        -
        15161  (*pAllocation)->InitDedicatedAllocation(memTypeIndex, hMemory, suballocType, pMappedData, size);
        -
        15162  (*pAllocation)->SetUserData(this, pUserData);
        -
        15163  m_Budget.AddAllocation(MemoryTypeIndexToHeapIndex(memTypeIndex), size);
        -
        15164  if(VMA_DEBUG_INITIALIZE_ALLOCATIONS)
        -
        15165  {
        -
        15166  FillAllocation(*pAllocation, VMA_ALLOCATION_FILL_PATTERN_CREATED);
        -
        15167  }
        -
        15168 
        -
        15169  return VK_SUCCESS;
        -
        15170 }
        -
        15171 
        -
        15172 void VmaAllocator_T::GetBufferMemoryRequirements(
        -
        15173  VkBuffer hBuffer,
        -
        15174  VkMemoryRequirements& memReq,
        -
        15175  bool& requiresDedicatedAllocation,
        -
        15176  bool& prefersDedicatedAllocation) const
        -
        15177 {
        -
        15178 #if VMA_DEDICATED_ALLOCATION || VMA_VULKAN_VERSION >= 1001000
        -
        15179  if(m_UseKhrDedicatedAllocation || m_VulkanApiVersion >= VK_MAKE_VERSION(1, 1, 0))
        +
        15140 }
        +
        15141 
        +
        15142 void VmaAllocator_T::ImportVulkanFunctions(const VmaVulkanFunctions* pVulkanFunctions)
        +
        15143 {
        +
        15144 #if VMA_STATIC_VULKAN_FUNCTIONS == 1
        +
        15145  m_VulkanFunctions.vkGetPhysicalDeviceProperties = (PFN_vkGetPhysicalDeviceProperties)vkGetPhysicalDeviceProperties;
        +
        15146  m_VulkanFunctions.vkGetPhysicalDeviceMemoryProperties = (PFN_vkGetPhysicalDeviceMemoryProperties)vkGetPhysicalDeviceMemoryProperties;
        +
        15147  m_VulkanFunctions.vkAllocateMemory = (PFN_vkAllocateMemory)vkAllocateMemory;
        +
        15148  m_VulkanFunctions.vkFreeMemory = (PFN_vkFreeMemory)vkFreeMemory;
        +
        15149  m_VulkanFunctions.vkMapMemory = (PFN_vkMapMemory)vkMapMemory;
        +
        15150  m_VulkanFunctions.vkUnmapMemory = (PFN_vkUnmapMemory)vkUnmapMemory;
        +
        15151  m_VulkanFunctions.vkFlushMappedMemoryRanges = (PFN_vkFlushMappedMemoryRanges)vkFlushMappedMemoryRanges;
        +
        15152  m_VulkanFunctions.vkInvalidateMappedMemoryRanges = (PFN_vkInvalidateMappedMemoryRanges)vkInvalidateMappedMemoryRanges;
        +
        15153  m_VulkanFunctions.vkBindBufferMemory = (PFN_vkBindBufferMemory)vkBindBufferMemory;
        +
        15154  m_VulkanFunctions.vkBindImageMemory = (PFN_vkBindImageMemory)vkBindImageMemory;
        +
        15155  m_VulkanFunctions.vkGetBufferMemoryRequirements = (PFN_vkGetBufferMemoryRequirements)vkGetBufferMemoryRequirements;
        +
        15156  m_VulkanFunctions.vkGetImageMemoryRequirements = (PFN_vkGetImageMemoryRequirements)vkGetImageMemoryRequirements;
        +
        15157  m_VulkanFunctions.vkCreateBuffer = (PFN_vkCreateBuffer)vkCreateBuffer;
        +
        15158  m_VulkanFunctions.vkDestroyBuffer = (PFN_vkDestroyBuffer)vkDestroyBuffer;
        +
        15159  m_VulkanFunctions.vkCreateImage = (PFN_vkCreateImage)vkCreateImage;
        +
        15160  m_VulkanFunctions.vkDestroyImage = (PFN_vkDestroyImage)vkDestroyImage;
        +
        15161  m_VulkanFunctions.vkCmdCopyBuffer = (PFN_vkCmdCopyBuffer)vkCmdCopyBuffer;
        +
        15162 #if VMA_VULKAN_VERSION >= 1001000
        +
        15163  if(m_VulkanApiVersion >= VK_MAKE_VERSION(1, 1, 0))
        +
        15164  {
        +
        15165  VMA_ASSERT(m_hInstance != VK_NULL_HANDLE);
        +
        15166  m_VulkanFunctions.vkGetBufferMemoryRequirements2KHR =
        +
        15167  (PFN_vkGetBufferMemoryRequirements2KHR)vkGetDeviceProcAddr(m_hDevice, "vkGetBufferMemoryRequirements2");
        +
        15168  m_VulkanFunctions.vkGetImageMemoryRequirements2KHR =
        +
        15169  (PFN_vkGetImageMemoryRequirements2KHR)vkGetDeviceProcAddr(m_hDevice, "vkGetImageMemoryRequirements2");
        +
        15170  m_VulkanFunctions.vkBindBufferMemory2KHR =
        +
        15171  (PFN_vkBindBufferMemory2KHR)vkGetDeviceProcAddr(m_hDevice, "vkBindBufferMemory2");
        +
        15172  m_VulkanFunctions.vkBindImageMemory2KHR =
        +
        15173  (PFN_vkBindImageMemory2KHR)vkGetDeviceProcAddr(m_hDevice, "vkBindImageMemory2");
        +
        15174  m_VulkanFunctions.vkGetPhysicalDeviceMemoryProperties2KHR =
        +
        15175  (PFN_vkGetPhysicalDeviceMemoryProperties2KHR)vkGetInstanceProcAddr(m_hInstance, "vkGetPhysicalDeviceMemoryProperties2");
        +
        15176  }
        +
        15177 #endif
        +
        15178 #if VMA_DEDICATED_ALLOCATION
        +
        15179  if(m_UseKhrDedicatedAllocation)
        15180  {
        -
        15181  VkBufferMemoryRequirementsInfo2KHR memReqInfo = { VK_STRUCTURE_TYPE_BUFFER_MEMORY_REQUIREMENTS_INFO_2_KHR };
        -
        15182  memReqInfo.buffer = hBuffer;
        -
        15183 
        -
        15184  VkMemoryDedicatedRequirementsKHR memDedicatedReq = { VK_STRUCTURE_TYPE_MEMORY_DEDICATED_REQUIREMENTS_KHR };
        -
        15185 
        -
        15186  VkMemoryRequirements2KHR memReq2 = { VK_STRUCTURE_TYPE_MEMORY_REQUIREMENTS_2_KHR };
        -
        15187  memReq2.pNext = &memDedicatedReq;
        -
        15188 
        -
        15189  (*m_VulkanFunctions.vkGetBufferMemoryRequirements2KHR)(m_hDevice, &memReqInfo, &memReq2);
        -
        15190 
        -
        15191  memReq = memReq2.memoryRequirements;
        -
        15192  requiresDedicatedAllocation = (memDedicatedReq.requiresDedicatedAllocation != VK_FALSE);
        -
        15193  prefersDedicatedAllocation = (memDedicatedReq.prefersDedicatedAllocation != VK_FALSE);
        +
        15181  m_VulkanFunctions.vkGetBufferMemoryRequirements2KHR =
        +
        15182  (PFN_vkGetBufferMemoryRequirements2KHR)vkGetDeviceProcAddr(m_hDevice, "vkGetBufferMemoryRequirements2KHR");
        +
        15183  m_VulkanFunctions.vkGetImageMemoryRequirements2KHR =
        +
        15184  (PFN_vkGetImageMemoryRequirements2KHR)vkGetDeviceProcAddr(m_hDevice, "vkGetImageMemoryRequirements2KHR");
        +
        15185  }
        +
        15186 #endif
        +
        15187 #if VMA_BIND_MEMORY2
        +
        15188  if(m_UseKhrBindMemory2)
        +
        15189  {
        +
        15190  m_VulkanFunctions.vkBindBufferMemory2KHR =
        +
        15191  (PFN_vkBindBufferMemory2KHR)vkGetDeviceProcAddr(m_hDevice, "vkBindBufferMemory2KHR");
        +
        15192  m_VulkanFunctions.vkBindImageMemory2KHR =
        +
        15193  (PFN_vkBindImageMemory2KHR)vkGetDeviceProcAddr(m_hDevice, "vkBindImageMemory2KHR");
        15194  }
        -
        15195  else
        -
        15196 #endif // #if VMA_DEDICATED_ALLOCATION || VMA_VULKAN_VERSION >= 1001000
        -
        15197  {
        -
        15198  (*m_VulkanFunctions.vkGetBufferMemoryRequirements)(m_hDevice, hBuffer, &memReq);
        -
        15199  requiresDedicatedAllocation = false;
        -
        15200  prefersDedicatedAllocation = false;
        -
        15201  }
        -
        15202 }
        -
        15203 
        -
        15204 void VmaAllocator_T::GetImageMemoryRequirements(
        -
        15205  VkImage hImage,
        -
        15206  VkMemoryRequirements& memReq,
        -
        15207  bool& requiresDedicatedAllocation,
        -
        15208  bool& prefersDedicatedAllocation) const
        -
        15209 {
        -
        15210 #if VMA_DEDICATED_ALLOCATION || VMA_VULKAN_VERSION >= 1001000
        -
        15211  if(m_UseKhrDedicatedAllocation || m_VulkanApiVersion >= VK_MAKE_VERSION(1, 1, 0))
        -
        15212  {
        -
        15213  VkImageMemoryRequirementsInfo2KHR memReqInfo = { VK_STRUCTURE_TYPE_IMAGE_MEMORY_REQUIREMENTS_INFO_2_KHR };
        -
        15214  memReqInfo.image = hImage;
        -
        15215 
        -
        15216  VkMemoryDedicatedRequirementsKHR memDedicatedReq = { VK_STRUCTURE_TYPE_MEMORY_DEDICATED_REQUIREMENTS_KHR };
        -
        15217 
        -
        15218  VkMemoryRequirements2KHR memReq2 = { VK_STRUCTURE_TYPE_MEMORY_REQUIREMENTS_2_KHR };
        -
        15219  memReq2.pNext = &memDedicatedReq;
        -
        15220 
        -
        15221  (*m_VulkanFunctions.vkGetImageMemoryRequirements2KHR)(m_hDevice, &memReqInfo, &memReq2);
        -
        15222 
        -
        15223  memReq = memReq2.memoryRequirements;
        -
        15224  requiresDedicatedAllocation = (memDedicatedReq.requiresDedicatedAllocation != VK_FALSE);
        -
        15225  prefersDedicatedAllocation = (memDedicatedReq.prefersDedicatedAllocation != VK_FALSE);
        -
        15226  }
        -
        15227  else
        -
        15228 #endif // #if VMA_DEDICATED_ALLOCATION || VMA_VULKAN_VERSION >= 1001000
        -
        15229  {
        -
        15230  (*m_VulkanFunctions.vkGetImageMemoryRequirements)(m_hDevice, hImage, &memReq);
        -
        15231  requiresDedicatedAllocation = false;
        -
        15232  prefersDedicatedAllocation = false;
        -
        15233  }
        -
        15234 }
        -
        15235 
        -
        15236 VkResult VmaAllocator_T::AllocateMemory(
        -
        15237  const VkMemoryRequirements& vkMemReq,
        -
        15238  bool requiresDedicatedAllocation,
        -
        15239  bool prefersDedicatedAllocation,
        -
        15240  VkBuffer dedicatedBuffer,
        -
        15241  VkImage dedicatedImage,
        -
        15242  const VmaAllocationCreateInfo& createInfo,
        -
        15243  VmaSuballocationType suballocType,
        -
        15244  size_t allocationCount,
        -
        15245  VmaAllocation* pAllocations)
        -
        15246 {
        -
        15247  memset(pAllocations, 0, sizeof(VmaAllocation) * allocationCount);
        -
        15248 
        -
        15249  VMA_ASSERT(VmaIsPow2(vkMemReq.alignment));
        -
        15250 
        -
        15251  if(vkMemReq.size == 0)
        -
        15252  {
        -
        15253  return VK_ERROR_VALIDATION_FAILED_EXT;
        -
        15254  }
        -
        15255  if((createInfo.flags & VMA_ALLOCATION_CREATE_DEDICATED_MEMORY_BIT) != 0 &&
        -
        15256  (createInfo.flags & VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT) != 0)
        -
        15257  {
        -
        15258  VMA_ASSERT(0 && "Specifying VMA_ALLOCATION_CREATE_DEDICATED_MEMORY_BIT together with VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT makes no sense.");
        -
        15259  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        -
        15260  }
        -
        15261  if((createInfo.flags & VMA_ALLOCATION_CREATE_MAPPED_BIT) != 0 &&
        -
        15262  (createInfo.flags & VMA_ALLOCATION_CREATE_CAN_BECOME_LOST_BIT) != 0)
        -
        15263  {
        -
        15264  VMA_ASSERT(0 && "Specifying VMA_ALLOCATION_CREATE_MAPPED_BIT together with VMA_ALLOCATION_CREATE_CAN_BECOME_LOST_BIT is invalid.");
        -
        15265  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        -
        15266  }
        -
        15267  if(requiresDedicatedAllocation)
        -
        15268  {
        -
        15269  if((createInfo.flags & VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT) != 0)
        -
        15270  {
        -
        15271  VMA_ASSERT(0 && "VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT specified while dedicated allocation is required.");
        -
        15272  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        -
        15273  }
        -
        15274  if(createInfo.pool != VK_NULL_HANDLE)
        -
        15275  {
        -
        15276  VMA_ASSERT(0 && "Pool specified while dedicated allocation is required.");
        -
        15277  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        -
        15278  }
        -
        15279  }
        -
        15280  if((createInfo.pool != VK_NULL_HANDLE) &&
        -
        15281  ((createInfo.flags & (VMA_ALLOCATION_CREATE_DEDICATED_MEMORY_BIT)) != 0))
        -
        15282  {
        -
        15283  VMA_ASSERT(0 && "Specifying VMA_ALLOCATION_CREATE_DEDICATED_MEMORY_BIT when pool != null is invalid.");
        -
        15284  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        -
        15285  }
        -
        15286 
        -
        15287  if(createInfo.pool != VK_NULL_HANDLE)
        -
        15288  {
        -
        15289  const VkDeviceSize alignmentForPool = VMA_MAX(
        -
        15290  vkMemReq.alignment,
        -
        15291  GetMemoryTypeMinAlignment(createInfo.pool->m_BlockVector.GetMemoryTypeIndex()));
        -
        15292 
        -
        15293  VmaAllocationCreateInfo createInfoForPool = createInfo;
        -
        15294  // If memory type is not HOST_VISIBLE, disable MAPPED.
        -
        15295  if((createInfoForPool.flags & VMA_ALLOCATION_CREATE_MAPPED_BIT) != 0 &&
        -
        15296  (m_MemProps.memoryTypes[createInfo.pool->m_BlockVector.GetMemoryTypeIndex()].propertyFlags & VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT) == 0)
        -
        15297  {
        -
        15298  createInfoForPool.flags &= ~VMA_ALLOCATION_CREATE_MAPPED_BIT;
        -
        15299  }
        -
        15300 
        -
        15301  return createInfo.pool->m_BlockVector.Allocate(
        -
        15302  m_CurrentFrameIndex.load(),
        -
        15303  vkMemReq.size,
        -
        15304  alignmentForPool,
        -
        15305  createInfoForPool,
        -
        15306  suballocType,
        -
        15307  allocationCount,
        -
        15308  pAllocations);
        -
        15309  }
        -
        15310  else
        -
        15311  {
        -
        15312  // Bit mask of memory Vulkan types acceptable for this allocation.
        -
        15313  uint32_t memoryTypeBits = vkMemReq.memoryTypeBits;
        -
        15314  uint32_t memTypeIndex = UINT32_MAX;
        -
        15315  VkResult res = vmaFindMemoryTypeIndex(this, memoryTypeBits, &createInfo, &memTypeIndex);
        -
        15316  if(res == VK_SUCCESS)
        -
        15317  {
        -
        15318  VkDeviceSize alignmentForMemType = VMA_MAX(
        -
        15319  vkMemReq.alignment,
        -
        15320  GetMemoryTypeMinAlignment(memTypeIndex));
        -
        15321 
        -
        15322  res = AllocateMemoryOfType(
        -
        15323  vkMemReq.size,
        -
        15324  alignmentForMemType,
        -
        15325  requiresDedicatedAllocation || prefersDedicatedAllocation,
        -
        15326  dedicatedBuffer,
        -
        15327  dedicatedImage,
        -
        15328  createInfo,
        -
        15329  memTypeIndex,
        -
        15330  suballocType,
        -
        15331  allocationCount,
        -
        15332  pAllocations);
        -
        15333  // Succeeded on first try.
        -
        15334  if(res == VK_SUCCESS)
        -
        15335  {
        -
        15336  return res;
        -
        15337  }
        -
        15338  // Allocation from this memory type failed. Try other compatible memory types.
        -
        15339  else
        -
        15340  {
        -
        15341  for(;;)
        -
        15342  {
        -
        15343  // Remove old memTypeIndex from list of possibilities.
        -
        15344  memoryTypeBits &= ~(1u << memTypeIndex);
        -
        15345  // Find alternative memTypeIndex.
        -
        15346  res = vmaFindMemoryTypeIndex(this, memoryTypeBits, &createInfo, &memTypeIndex);
        -
        15347  if(res == VK_SUCCESS)
        -
        15348  {
        -
        15349  alignmentForMemType = VMA_MAX(
        -
        15350  vkMemReq.alignment,
        -
        15351  GetMemoryTypeMinAlignment(memTypeIndex));
        -
        15352 
        -
        15353  res = AllocateMemoryOfType(
        -
        15354  vkMemReq.size,
        -
        15355  alignmentForMemType,
        -
        15356  requiresDedicatedAllocation || prefersDedicatedAllocation,
        -
        15357  dedicatedBuffer,
        -
        15358  dedicatedImage,
        -
        15359  createInfo,
        -
        15360  memTypeIndex,
        -
        15361  suballocType,
        -
        15362  allocationCount,
        -
        15363  pAllocations);
        -
        15364  // Allocation from this alternative memory type succeeded.
        -
        15365  if(res == VK_SUCCESS)
        -
        15366  {
        -
        15367  return res;
        -
        15368  }
        -
        15369  // else: Allocation from this memory type failed. Try next one - next loop iteration.
        -
        15370  }
        -
        15371  // No other matching memory type index could be found.
        -
        15372  else
        -
        15373  {
        -
        15374  // Not returning res, which is VK_ERROR_FEATURE_NOT_PRESENT, because we already failed to allocate once.
        -
        15375  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        -
        15376  }
        -
        15377  }
        -
        15378  }
        +
        15195 #endif // #if VMA_BIND_MEMORY2
        +
        15196 #if VMA_MEMORY_BUDGET
        +
        15197  if(m_UseExtMemoryBudget && m_VulkanApiVersion < VK_MAKE_VERSION(1, 1, 0))
        +
        15198  {
        +
        15199  VMA_ASSERT(m_hInstance != VK_NULL_HANDLE);
        +
        15200  m_VulkanFunctions.vkGetPhysicalDeviceMemoryProperties2KHR =
        +
        15201  (PFN_vkGetPhysicalDeviceMemoryProperties2KHR)vkGetInstanceProcAddr(m_hInstance, "vkGetPhysicalDeviceMemoryProperties2KHR");
        +
        15202  }
        +
        15203 #endif // #if VMA_MEMORY_BUDGET
        +
        15204 #endif // #if VMA_STATIC_VULKAN_FUNCTIONS == 1
        +
        15205 
        +
        15206 #define VMA_COPY_IF_NOT_NULL(funcName) \
        +
        15207  if(pVulkanFunctions->funcName != VMA_NULL) m_VulkanFunctions.funcName = pVulkanFunctions->funcName;
        +
        15208 
        +
        15209  if(pVulkanFunctions != VMA_NULL)
        +
        15210  {
        +
        15211  VMA_COPY_IF_NOT_NULL(vkGetPhysicalDeviceProperties);
        +
        15212  VMA_COPY_IF_NOT_NULL(vkGetPhysicalDeviceMemoryProperties);
        +
        15213  VMA_COPY_IF_NOT_NULL(vkAllocateMemory);
        +
        15214  VMA_COPY_IF_NOT_NULL(vkFreeMemory);
        +
        15215  VMA_COPY_IF_NOT_NULL(vkMapMemory);
        +
        15216  VMA_COPY_IF_NOT_NULL(vkUnmapMemory);
        +
        15217  VMA_COPY_IF_NOT_NULL(vkFlushMappedMemoryRanges);
        +
        15218  VMA_COPY_IF_NOT_NULL(vkInvalidateMappedMemoryRanges);
        +
        15219  VMA_COPY_IF_NOT_NULL(vkBindBufferMemory);
        +
        15220  VMA_COPY_IF_NOT_NULL(vkBindImageMemory);
        +
        15221  VMA_COPY_IF_NOT_NULL(vkGetBufferMemoryRequirements);
        +
        15222  VMA_COPY_IF_NOT_NULL(vkGetImageMemoryRequirements);
        +
        15223  VMA_COPY_IF_NOT_NULL(vkCreateBuffer);
        +
        15224  VMA_COPY_IF_NOT_NULL(vkDestroyBuffer);
        +
        15225  VMA_COPY_IF_NOT_NULL(vkCreateImage);
        +
        15226  VMA_COPY_IF_NOT_NULL(vkDestroyImage);
        +
        15227  VMA_COPY_IF_NOT_NULL(vkCmdCopyBuffer);
        +
        15228 #if VMA_DEDICATED_ALLOCATION || VMA_VULKAN_VERSION >= 1001000
        +
        15229  VMA_COPY_IF_NOT_NULL(vkGetBufferMemoryRequirements2KHR);
        +
        15230  VMA_COPY_IF_NOT_NULL(vkGetImageMemoryRequirements2KHR);
        +
        15231 #endif
        +
        15232 #if VMA_BIND_MEMORY2 || VMA_VULKAN_VERSION >= 1001000
        +
        15233  VMA_COPY_IF_NOT_NULL(vkBindBufferMemory2KHR);
        +
        15234  VMA_COPY_IF_NOT_NULL(vkBindImageMemory2KHR);
        +
        15235 #endif
        +
        15236 #if VMA_MEMORY_BUDGET
        +
        15237  VMA_COPY_IF_NOT_NULL(vkGetPhysicalDeviceMemoryProperties2KHR);
        +
        15238 #endif
        +
        15239  }
        +
        15240 
        +
        15241 #undef VMA_COPY_IF_NOT_NULL
        +
        15242 
        +
        15243  // If these asserts are hit, you must either #define VMA_STATIC_VULKAN_FUNCTIONS 1
        +
        15244  // or pass valid pointers as VmaAllocatorCreateInfo::pVulkanFunctions.
        +
        15245  VMA_ASSERT(m_VulkanFunctions.vkGetPhysicalDeviceProperties != VMA_NULL);
        +
        15246  VMA_ASSERT(m_VulkanFunctions.vkGetPhysicalDeviceMemoryProperties != VMA_NULL);
        +
        15247  VMA_ASSERT(m_VulkanFunctions.vkAllocateMemory != VMA_NULL);
        +
        15248  VMA_ASSERT(m_VulkanFunctions.vkFreeMemory != VMA_NULL);
        +
        15249  VMA_ASSERT(m_VulkanFunctions.vkMapMemory != VMA_NULL);
        +
        15250  VMA_ASSERT(m_VulkanFunctions.vkUnmapMemory != VMA_NULL);
        +
        15251  VMA_ASSERT(m_VulkanFunctions.vkFlushMappedMemoryRanges != VMA_NULL);
        +
        15252  VMA_ASSERT(m_VulkanFunctions.vkInvalidateMappedMemoryRanges != VMA_NULL);
        +
        15253  VMA_ASSERT(m_VulkanFunctions.vkBindBufferMemory != VMA_NULL);
        +
        15254  VMA_ASSERT(m_VulkanFunctions.vkBindImageMemory != VMA_NULL);
        +
        15255  VMA_ASSERT(m_VulkanFunctions.vkGetBufferMemoryRequirements != VMA_NULL);
        +
        15256  VMA_ASSERT(m_VulkanFunctions.vkGetImageMemoryRequirements != VMA_NULL);
        +
        15257  VMA_ASSERT(m_VulkanFunctions.vkCreateBuffer != VMA_NULL);
        +
        15258  VMA_ASSERT(m_VulkanFunctions.vkDestroyBuffer != VMA_NULL);
        +
        15259  VMA_ASSERT(m_VulkanFunctions.vkCreateImage != VMA_NULL);
        +
        15260  VMA_ASSERT(m_VulkanFunctions.vkDestroyImage != VMA_NULL);
        +
        15261  VMA_ASSERT(m_VulkanFunctions.vkCmdCopyBuffer != VMA_NULL);
        +
        15262 #if VMA_DEDICATED_ALLOCATION || VMA_VULKAN_VERSION >= 1001000
        +
        15263  if(m_VulkanApiVersion >= VK_MAKE_VERSION(1, 1, 0) || m_UseKhrDedicatedAllocation)
        +
        15264  {
        +
        15265  VMA_ASSERT(m_VulkanFunctions.vkGetBufferMemoryRequirements2KHR != VMA_NULL);
        +
        15266  VMA_ASSERT(m_VulkanFunctions.vkGetImageMemoryRequirements2KHR != VMA_NULL);
        +
        15267  }
        +
        15268 #endif
        +
        15269 #if VMA_BIND_MEMORY2 || VMA_VULKAN_VERSION >= 1001000
        +
        15270  if(m_VulkanApiVersion >= VK_MAKE_VERSION(1, 1, 0) || m_UseKhrBindMemory2)
        +
        15271  {
        +
        15272  VMA_ASSERT(m_VulkanFunctions.vkBindBufferMemory2KHR != VMA_NULL);
        +
        15273  VMA_ASSERT(m_VulkanFunctions.vkBindImageMemory2KHR != VMA_NULL);
        +
        15274  }
        +
        15275 #endif
        +
        15276 #if VMA_MEMORY_BUDGET || VMA_VULKAN_VERSION >= 1001000
        +
        15277  if(m_UseExtMemoryBudget || m_VulkanApiVersion >= VK_MAKE_VERSION(1, 1, 0))
        +
        15278  {
        +
        15279  VMA_ASSERT(m_VulkanFunctions.vkGetPhysicalDeviceMemoryProperties2KHR != VMA_NULL);
        +
        15280  }
        +
        15281 #endif
        +
        15282 }
        +
        15283 
        +
        15284 VkDeviceSize VmaAllocator_T::CalcPreferredBlockSize(uint32_t memTypeIndex)
        +
        15285 {
        +
        15286  const uint32_t heapIndex = MemoryTypeIndexToHeapIndex(memTypeIndex);
        +
        15287  const VkDeviceSize heapSize = m_MemProps.memoryHeaps[heapIndex].size;
        +
        15288  const bool isSmallHeap = heapSize <= VMA_SMALL_HEAP_MAX_SIZE;
        +
        15289  return VmaAlignUp(isSmallHeap ? (heapSize / 8) : m_PreferredLargeHeapBlockSize, (VkDeviceSize)32);
        +
        15290 }
        +
        15291 
        +
        15292 VkResult VmaAllocator_T::AllocateMemoryOfType(
        +
        15293  VkDeviceSize size,
        +
        15294  VkDeviceSize alignment,
        +
        15295  bool dedicatedAllocation,
        +
        15296  VkBuffer dedicatedBuffer,
        +
        15297  VkImage dedicatedImage,
        +
        15298  const VmaAllocationCreateInfo& createInfo,
        +
        15299  uint32_t memTypeIndex,
        +
        15300  VmaSuballocationType suballocType,
        +
        15301  size_t allocationCount,
        +
        15302  VmaAllocation* pAllocations)
        +
        15303 {
        +
        15304  VMA_ASSERT(pAllocations != VMA_NULL);
        +
        15305  VMA_DEBUG_LOG(" AllocateMemory: MemoryTypeIndex=%u, AllocationCount=%zu, Size=%llu", memTypeIndex, allocationCount, size);
        +
        15306 
        +
        15307  VmaAllocationCreateInfo finalCreateInfo = createInfo;
        +
        15308 
        +
        15309  // If memory type is not HOST_VISIBLE, disable MAPPED.
        +
        15310  if((finalCreateInfo.flags & VMA_ALLOCATION_CREATE_MAPPED_BIT) != 0 &&
        +
        15311  (m_MemProps.memoryTypes[memTypeIndex].propertyFlags & VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT) == 0)
        +
        15312  {
        +
        15313  finalCreateInfo.flags &= ~VMA_ALLOCATION_CREATE_MAPPED_BIT;
        +
        15314  }
        +
        15315  // If memory is lazily allocated, it should be always dedicated.
        +
        15316  if(finalCreateInfo.usage == VMA_MEMORY_USAGE_GPU_LAZILY_ALLOCATED)
        +
        15317  {
        +
        15318  finalCreateInfo.flags |= VMA_ALLOCATION_CREATE_DEDICATED_MEMORY_BIT;
        +
        15319  }
        +
        15320 
        +
        15321  VmaBlockVector* const blockVector = m_pBlockVectors[memTypeIndex];
        +
        15322  VMA_ASSERT(blockVector);
        +
        15323 
        +
        15324  const VkDeviceSize preferredBlockSize = blockVector->GetPreferredBlockSize();
        +
        15325  bool preferDedicatedMemory =
        +
        15326  VMA_DEBUG_ALWAYS_DEDICATED_MEMORY ||
        +
        15327  dedicatedAllocation ||
        +
        15328  // Heuristics: Allocate dedicated memory if requested size if greater than half of preferred block size.
        +
        15329  size > preferredBlockSize / 2;
        +
        15330 
        +
        15331  if(preferDedicatedMemory &&
        +
        15332  (finalCreateInfo.flags & VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT) == 0 &&
        +
        15333  finalCreateInfo.pool == VK_NULL_HANDLE)
        +
        15334  {
        +
        15335  finalCreateInfo.flags |= VMA_ALLOCATION_CREATE_DEDICATED_MEMORY_BIT;
        +
        15336  }
        +
        15337 
        +
        15338  if((finalCreateInfo.flags & VMA_ALLOCATION_CREATE_DEDICATED_MEMORY_BIT) != 0)
        +
        15339  {
        +
        15340  if((finalCreateInfo.flags & VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT) != 0)
        +
        15341  {
        +
        15342  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        +
        15343  }
        +
        15344  else
        +
        15345  {
        +
        15346  return AllocateDedicatedMemory(
        +
        15347  size,
        +
        15348  suballocType,
        +
        15349  memTypeIndex,
        +
        15350  (finalCreateInfo.flags & VMA_ALLOCATION_CREATE_WITHIN_BUDGET_BIT) != 0,
        +
        15351  (finalCreateInfo.flags & VMA_ALLOCATION_CREATE_MAPPED_BIT) != 0,
        +
        15352  (finalCreateInfo.flags & VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT) != 0,
        +
        15353  finalCreateInfo.pUserData,
        +
        15354  dedicatedBuffer,
        +
        15355  dedicatedImage,
        +
        15356  allocationCount,
        +
        15357  pAllocations);
        +
        15358  }
        +
        15359  }
        +
        15360  else
        +
        15361  {
        +
        15362  VkResult res = blockVector->Allocate(
        +
        15363  m_CurrentFrameIndex.load(),
        +
        15364  size,
        +
        15365  alignment,
        +
        15366  finalCreateInfo,
        +
        15367  suballocType,
        +
        15368  allocationCount,
        +
        15369  pAllocations);
        +
        15370  if(res == VK_SUCCESS)
        +
        15371  {
        +
        15372  return res;
        +
        15373  }
        +
        15374 
        +
        15375  // 5. Try dedicated memory.
        +
        15376  if((finalCreateInfo.flags & VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT) != 0)
        +
        15377  {
        +
        15378  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        15379  }
        -
        15380  // Can't find any single memory type maching requirements. res is VK_ERROR_FEATURE_NOT_PRESENT.
        -
        15381  else
        -
        15382  return res;
        -
        15383  }
        -
        15384 }
        -
        15385 
        -
        15386 void VmaAllocator_T::FreeMemory(
        -
        15387  size_t allocationCount,
        -
        15388  const VmaAllocation* pAllocations)
        -
        15389 {
        -
        15390  VMA_ASSERT(pAllocations);
        -
        15391 
        -
        15392  for(size_t allocIndex = allocationCount; allocIndex--; )
        -
        15393  {
        -
        15394  VmaAllocation allocation = pAllocations[allocIndex];
        -
        15395 
        -
        15396  if(allocation != VK_NULL_HANDLE)
        -
        15397  {
        -
        15398  if(TouchAllocation(allocation))
        -
        15399  {
        -
        15400  if(VMA_DEBUG_INITIALIZE_ALLOCATIONS)
        -
        15401  {
        -
        15402  FillAllocation(allocation, VMA_ALLOCATION_FILL_PATTERN_DESTROYED);
        -
        15403  }
        -
        15404 
        -
        15405  switch(allocation->GetType())
        -
        15406  {
        -
        15407  case VmaAllocation_T::ALLOCATION_TYPE_BLOCK:
        -
        15408  {
        -
        15409  VmaBlockVector* pBlockVector = VMA_NULL;
        -
        15410  VmaPool hPool = allocation->GetBlock()->GetParentPool();
        -
        15411  if(hPool != VK_NULL_HANDLE)
        -
        15412  {
        -
        15413  pBlockVector = &hPool->m_BlockVector;
        -
        15414  }
        -
        15415  else
        -
        15416  {
        -
        15417  const uint32_t memTypeIndex = allocation->GetMemoryTypeIndex();
        -
        15418  pBlockVector = m_pBlockVectors[memTypeIndex];
        -
        15419  }
        -
        15420  pBlockVector->Free(allocation);
        -
        15421  }
        -
        15422  break;
        -
        15423  case VmaAllocation_T::ALLOCATION_TYPE_DEDICATED:
        -
        15424  FreeDedicatedMemory(allocation);
        -
        15425  break;
        -
        15426  default:
        -
        15427  VMA_ASSERT(0);
        -
        15428  }
        -
        15429  }
        -
        15430 
        -
        15431  // Do this regardless of whether the allocation is lost. Lost allocations still account to Budget.AllocationBytes.
        -
        15432  m_Budget.RemoveAllocation(MemoryTypeIndexToHeapIndex(allocation->GetMemoryTypeIndex()), allocation->GetSize());
        -
        15433  allocation->SetUserData(this, VMA_NULL);
        -
        15434  allocation->Dtor();
        -
        15435  m_AllocationObjectAllocator.Free(allocation);
        -
        15436  }
        -
        15437  }
        -
        15438 }
        +
        15380  else
        +
        15381  {
        +
        15382  res = AllocateDedicatedMemory(
        +
        15383  size,
        +
        15384  suballocType,
        +
        15385  memTypeIndex,
        +
        15386  (finalCreateInfo.flags & VMA_ALLOCATION_CREATE_WITHIN_BUDGET_BIT) != 0,
        +
        15387  (finalCreateInfo.flags & VMA_ALLOCATION_CREATE_MAPPED_BIT) != 0,
        +
        15388  (finalCreateInfo.flags & VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT) != 0,
        +
        15389  finalCreateInfo.pUserData,
        +
        15390  dedicatedBuffer,
        +
        15391  dedicatedImage,
        +
        15392  allocationCount,
        +
        15393  pAllocations);
        +
        15394  if(res == VK_SUCCESS)
        +
        15395  {
        +
        15396  // Succeeded: AllocateDedicatedMemory function already filld pMemory, nothing more to do here.
        +
        15397  VMA_DEBUG_LOG(" Allocated as DedicatedMemory");
        +
        15398  return VK_SUCCESS;
        +
        15399  }
        +
        15400  else
        +
        15401  {
        +
        15402  // Everything failed: Return error code.
        +
        15403  VMA_DEBUG_LOG(" vkAllocateMemory FAILED");
        +
        15404  return res;
        +
        15405  }
        +
        15406  }
        +
        15407  }
        +
        15408 }
        +
        15409 
        +
        15410 VkResult VmaAllocator_T::AllocateDedicatedMemory(
        +
        15411  VkDeviceSize size,
        +
        15412  VmaSuballocationType suballocType,
        +
        15413  uint32_t memTypeIndex,
        +
        15414  bool withinBudget,
        +
        15415  bool map,
        +
        15416  bool isUserDataString,
        +
        15417  void* pUserData,
        +
        15418  VkBuffer dedicatedBuffer,
        +
        15419  VkImage dedicatedImage,
        +
        15420  size_t allocationCount,
        +
        15421  VmaAllocation* pAllocations)
        +
        15422 {
        +
        15423  VMA_ASSERT(allocationCount > 0 && pAllocations);
        +
        15424 
        +
        15425  if(withinBudget)
        +
        15426  {
        +
        15427  const uint32_t heapIndex = MemoryTypeIndexToHeapIndex(memTypeIndex);
        +
        15428  VmaBudget heapBudget = {};
        +
        15429  GetBudget(&heapBudget, heapIndex, 1);
        +
        15430  if(heapBudget.usage + size * allocationCount > heapBudget.budget)
        +
        15431  {
        +
        15432  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        +
        15433  }
        +
        15434  }
        +
        15435 
        +
        15436  VkMemoryAllocateInfo allocInfo = { VK_STRUCTURE_TYPE_MEMORY_ALLOCATE_INFO };
        +
        15437  allocInfo.memoryTypeIndex = memTypeIndex;
        +
        15438  allocInfo.allocationSize = size;
        15439 
        -
        15440 VkResult VmaAllocator_T::ResizeAllocation(
        -
        15441  const VmaAllocation alloc,
        -
        15442  VkDeviceSize newSize)
        -
        15443 {
        -
        15444  // This function is deprecated and so it does nothing. It's left for backward compatibility.
        -
        15445  if(newSize == 0 || alloc->GetLastUseFrameIndex() == VMA_FRAME_INDEX_LOST)
        -
        15446  {
        -
        15447  return VK_ERROR_VALIDATION_FAILED_EXT;
        -
        15448  }
        -
        15449  if(newSize == alloc->GetSize())
        -
        15450  {
        -
        15451  return VK_SUCCESS;
        -
        15452  }
        -
        15453  return VK_ERROR_OUT_OF_POOL_MEMORY;
        -
        15454 }
        -
        15455 
        -
        15456 void VmaAllocator_T::CalculateStats(VmaStats* pStats)
        -
        15457 {
        -
        15458  // Initialize.
        -
        15459  InitStatInfo(pStats->total);
        -
        15460  for(size_t i = 0; i < VK_MAX_MEMORY_TYPES; ++i)
        -
        15461  InitStatInfo(pStats->memoryType[i]);
        -
        15462  for(size_t i = 0; i < VK_MAX_MEMORY_HEAPS; ++i)
        -
        15463  InitStatInfo(pStats->memoryHeap[i]);
        -
        15464 
        -
        15465  // Process default pools.
        -
        15466  for(uint32_t memTypeIndex = 0; memTypeIndex < GetMemoryTypeCount(); ++memTypeIndex)
        -
        15467  {
        -
        15468  VmaBlockVector* const pBlockVector = m_pBlockVectors[memTypeIndex];
        -
        15469  VMA_ASSERT(pBlockVector);
        -
        15470  pBlockVector->AddStats(pStats);
        -
        15471  }
        -
        15472 
        -
        15473  // Process custom pools.
        -
        15474  {
        -
        15475  VmaMutexLockRead lock(m_PoolsMutex, m_UseMutex);
        -
        15476  for(size_t poolIndex = 0, poolCount = m_Pools.size(); poolIndex < poolCount; ++poolIndex)
        -
        15477  {
        -
        15478  m_Pools[poolIndex]->m_BlockVector.AddStats(pStats);
        -
        15479  }
        -
        15480  }
        -
        15481 
        -
        15482  // Process dedicated allocations.
        -
        15483  for(uint32_t memTypeIndex = 0; memTypeIndex < GetMemoryTypeCount(); ++memTypeIndex)
        -
        15484  {
        -
        15485  const uint32_t memHeapIndex = MemoryTypeIndexToHeapIndex(memTypeIndex);
        -
        15486  VmaMutexLockRead dedicatedAllocationsLock(m_DedicatedAllocationsMutex[memTypeIndex], m_UseMutex);
        -
        15487  AllocationVectorType* const pDedicatedAllocVector = m_pDedicatedAllocations[memTypeIndex];
        -
        15488  VMA_ASSERT(pDedicatedAllocVector);
        -
        15489  for(size_t allocIndex = 0, allocCount = pDedicatedAllocVector->size(); allocIndex < allocCount; ++allocIndex)
        -
        15490  {
        -
        15491  VmaStatInfo allocationStatInfo;
        -
        15492  (*pDedicatedAllocVector)[allocIndex]->DedicatedAllocCalcStatsInfo(allocationStatInfo);
        -
        15493  VmaAddStatInfo(pStats->total, allocationStatInfo);
        -
        15494  VmaAddStatInfo(pStats->memoryType[memTypeIndex], allocationStatInfo);
        -
        15495  VmaAddStatInfo(pStats->memoryHeap[memHeapIndex], allocationStatInfo);
        -
        15496  }
        -
        15497  }
        -
        15498 
        -
        15499  // Postprocess.
        -
        15500  VmaPostprocessCalcStatInfo(pStats->total);
        -
        15501  for(size_t i = 0; i < GetMemoryTypeCount(); ++i)
        -
        15502  VmaPostprocessCalcStatInfo(pStats->memoryType[i]);
        -
        15503  for(size_t i = 0; i < GetMemoryHeapCount(); ++i)
        -
        15504  VmaPostprocessCalcStatInfo(pStats->memoryHeap[i]);
        -
        15505 }
        -
        15506 
        -
        15507 void VmaAllocator_T::GetBudget(VmaBudget* outBudget, uint32_t firstHeap, uint32_t heapCount)
        -
        15508 {
        -
        15509 #if VMA_MEMORY_BUDGET
        -
        15510  if(m_UseExtMemoryBudget)
        -
        15511  {
        -
        15512  if(m_Budget.m_OperationsSinceBudgetFetch < 30)
        -
        15513  {
        -
        15514  VmaMutexLockRead lockRead(m_Budget.m_BudgetMutex, m_UseMutex);
        -
        15515  for(uint32_t i = 0; i < heapCount; ++i, ++outBudget)
        -
        15516  {
        -
        15517  const uint32_t heapIndex = firstHeap + i;
        +
        15440 #if VMA_DEDICATED_ALLOCATION || VMA_VULKAN_VERSION >= 1001000
        +
        15441  VkMemoryDedicatedAllocateInfoKHR dedicatedAllocInfo = { VK_STRUCTURE_TYPE_MEMORY_DEDICATED_ALLOCATE_INFO_KHR };
        +
        15442  if(m_UseKhrDedicatedAllocation || m_VulkanApiVersion >= VK_MAKE_VERSION(1, 1, 0))
        +
        15443  {
        +
        15444  if(dedicatedBuffer != VK_NULL_HANDLE)
        +
        15445  {
        +
        15446  VMA_ASSERT(dedicatedImage == VK_NULL_HANDLE);
        +
        15447  dedicatedAllocInfo.buffer = dedicatedBuffer;
        +
        15448  allocInfo.pNext = &dedicatedAllocInfo;
        +
        15449  }
        +
        15450  else if(dedicatedImage != VK_NULL_HANDLE)
        +
        15451  {
        +
        15452  dedicatedAllocInfo.image = dedicatedImage;
        +
        15453  allocInfo.pNext = &dedicatedAllocInfo;
        +
        15454  }
        +
        15455  }
        +
        15456 #endif // #if VMA_DEDICATED_ALLOCATION || VMA_VULKAN_VERSION >= 1001000
        +
        15457 
        +
        15458  size_t allocIndex;
        +
        15459  VkResult res = VK_SUCCESS;
        +
        15460  for(allocIndex = 0; allocIndex < allocationCount; ++allocIndex)
        +
        15461  {
        +
        15462  res = AllocateDedicatedMemoryPage(
        +
        15463  size,
        +
        15464  suballocType,
        +
        15465  memTypeIndex,
        +
        15466  allocInfo,
        +
        15467  map,
        +
        15468  isUserDataString,
        +
        15469  pUserData,
        +
        15470  pAllocations + allocIndex);
        +
        15471  if(res != VK_SUCCESS)
        +
        15472  {
        +
        15473  break;
        +
        15474  }
        +
        15475  }
        +
        15476 
        +
        15477  if(res == VK_SUCCESS)
        +
        15478  {
        +
        15479  // Register them in m_pDedicatedAllocations.
        +
        15480  {
        +
        15481  VmaMutexLockWrite lock(m_DedicatedAllocationsMutex[memTypeIndex], m_UseMutex);
        +
        15482  AllocationVectorType* pDedicatedAllocations = m_pDedicatedAllocations[memTypeIndex];
        +
        15483  VMA_ASSERT(pDedicatedAllocations);
        +
        15484  for(allocIndex = 0; allocIndex < allocationCount; ++allocIndex)
        +
        15485  {
        +
        15486  VmaVectorInsertSorted<VmaPointerLess>(*pDedicatedAllocations, pAllocations[allocIndex]);
        +
        15487  }
        +
        15488  }
        +
        15489 
        +
        15490  VMA_DEBUG_LOG(" Allocated DedicatedMemory Count=%zu, MemoryTypeIndex=#%u", allocationCount, memTypeIndex);
        +
        15491  }
        +
        15492  else
        +
        15493  {
        +
        15494  // Free all already created allocations.
        +
        15495  while(allocIndex--)
        +
        15496  {
        +
        15497  VmaAllocation currAlloc = pAllocations[allocIndex];
        +
        15498  VkDeviceMemory hMemory = currAlloc->GetMemory();
        +
        15499 
        +
        15500  /*
        +
        15501  There is no need to call this, because Vulkan spec allows to skip vkUnmapMemory
        +
        15502  before vkFreeMemory.
        +
        15503 
        +
        15504  if(currAlloc->GetMappedData() != VMA_NULL)
        +
        15505  {
        +
        15506  (*m_VulkanFunctions.vkUnmapMemory)(m_hDevice, hMemory);
        +
        15507  }
        +
        15508  */
        +
        15509 
        +
        15510  FreeVulkanMemory(memTypeIndex, currAlloc->GetSize(), hMemory);
        +
        15511  m_Budget.RemoveAllocation(MemoryTypeIndexToHeapIndex(memTypeIndex), currAlloc->GetSize());
        +
        15512  currAlloc->SetUserData(this, VMA_NULL);
        +
        15513  m_AllocationObjectAllocator.Free(currAlloc);
        +
        15514  }
        +
        15515 
        +
        15516  memset(pAllocations, 0, sizeof(VmaAllocation) * allocationCount);
        +
        15517  }
        15518 
        -
        15519  outBudget->blockBytes = m_Budget.m_BlockBytes[heapIndex];
        -
        15520  outBudget->allocationBytes = m_Budget.m_AllocationBytes[heapIndex];
        +
        15519  return res;
        +
        15520 }
        15521 
        -
        15522  if(m_Budget.m_VulkanUsage[heapIndex] + outBudget->blockBytes > m_Budget.m_BlockBytesAtBudgetFetch[heapIndex])
        -
        15523  {
        -
        15524  outBudget->usage = m_Budget.m_VulkanUsage[heapIndex] +
        -
        15525  outBudget->blockBytes - m_Budget.m_BlockBytesAtBudgetFetch[heapIndex];
        -
        15526  }
        -
        15527  else
        -
        15528  {
        -
        15529  outBudget->usage = 0;
        -
        15530  }
        -
        15531 
        -
        15532  // Have to take MIN with heap size because explicit HeapSizeLimit is included in it.
        -
        15533  outBudget->budget = VMA_MIN(
        -
        15534  m_Budget.m_VulkanBudget[heapIndex], m_MemProps.memoryHeaps[heapIndex].size);
        -
        15535  }
        -
        15536  }
        -
        15537  else
        -
        15538  {
        -
        15539  UpdateVulkanBudget(); // Outside of mutex lock
        -
        15540  GetBudget(outBudget, firstHeap, heapCount); // Recursion
        -
        15541  }
        -
        15542  }
        -
        15543  else
        -
        15544 #endif
        -
        15545  {
        -
        15546  for(uint32_t i = 0; i < heapCount; ++i, ++outBudget)
        -
        15547  {
        -
        15548  const uint32_t heapIndex = firstHeap + i;
        -
        15549 
        -
        15550  outBudget->blockBytes = m_Budget.m_BlockBytes[heapIndex];
        -
        15551  outBudget->allocationBytes = m_Budget.m_AllocationBytes[heapIndex];
        -
        15552 
        -
        15553  outBudget->usage = outBudget->blockBytes;
        -
        15554  outBudget->budget = m_MemProps.memoryHeaps[heapIndex].size * 8 / 10; // 80% heuristics.
        +
        15522 VkResult VmaAllocator_T::AllocateDedicatedMemoryPage(
        +
        15523  VkDeviceSize size,
        +
        15524  VmaSuballocationType suballocType,
        +
        15525  uint32_t memTypeIndex,
        +
        15526  const VkMemoryAllocateInfo& allocInfo,
        +
        15527  bool map,
        +
        15528  bool isUserDataString,
        +
        15529  void* pUserData,
        +
        15530  VmaAllocation* pAllocation)
        +
        15531 {
        +
        15532  VkDeviceMemory hMemory = VK_NULL_HANDLE;
        +
        15533  VkResult res = AllocateVulkanMemory(&allocInfo, &hMemory);
        +
        15534  if(res < 0)
        +
        15535  {
        +
        15536  VMA_DEBUG_LOG(" vkAllocateMemory FAILED");
        +
        15537  return res;
        +
        15538  }
        +
        15539 
        +
        15540  void* pMappedData = VMA_NULL;
        +
        15541  if(map)
        +
        15542  {
        +
        15543  res = (*m_VulkanFunctions.vkMapMemory)(
        +
        15544  m_hDevice,
        +
        15545  hMemory,
        +
        15546  0,
        +
        15547  VK_WHOLE_SIZE,
        +
        15548  0,
        +
        15549  &pMappedData);
        +
        15550  if(res < 0)
        +
        15551  {
        +
        15552  VMA_DEBUG_LOG(" vkMapMemory FAILED");
        +
        15553  FreeVulkanMemory(memTypeIndex, size, hMemory);
        +
        15554  return res;
        15555  }
        15556  }
        -
        15557 }
        -
        15558 
        -
        15559 static const uint32_t VMA_VENDOR_ID_AMD = 4098;
        -
        15560 
        -
        15561 VkResult VmaAllocator_T::DefragmentationBegin(
        -
        15562  const VmaDefragmentationInfo2& info,
        -
        15563  VmaDefragmentationStats* pStats,
        -
        15564  VmaDefragmentationContext* pContext)
        -
        15565 {
        -
        15566  if(info.pAllocationsChanged != VMA_NULL)
        -
        15567  {
        -
        15568  memset(info.pAllocationsChanged, 0, info.allocationCount * sizeof(VkBool32));
        -
        15569  }
        -
        15570 
        -
        15571  *pContext = vma_new(this, VmaDefragmentationContext_T)(
        -
        15572  this, m_CurrentFrameIndex.load(), info.flags, pStats);
        -
        15573 
        -
        15574  (*pContext)->AddPools(info.poolCount, info.pPools);
        -
        15575  (*pContext)->AddAllocations(
        -
        15576  info.allocationCount, info.pAllocations, info.pAllocationsChanged);
        -
        15577 
        -
        15578  VkResult res = (*pContext)->Defragment(
        -
        15579  info.maxCpuBytesToMove, info.maxCpuAllocationsToMove,
        -
        15580  info.maxGpuBytesToMove, info.maxGpuAllocationsToMove,
        -
        15581  info.commandBuffer, pStats);
        -
        15582 
        -
        15583  if(res != VK_NOT_READY)
        -
        15584  {
        -
        15585  vma_delete(this, *pContext);
        -
        15586  *pContext = VMA_NULL;
        -
        15587  }
        +
        15557 
        +
        15558  *pAllocation = m_AllocationObjectAllocator.Allocate(m_CurrentFrameIndex.load(), isUserDataString);
        +
        15559  (*pAllocation)->InitDedicatedAllocation(memTypeIndex, hMemory, suballocType, pMappedData, size);
        +
        15560  (*pAllocation)->SetUserData(this, pUserData);
        +
        15561  m_Budget.AddAllocation(MemoryTypeIndexToHeapIndex(memTypeIndex), size);
        +
        15562  if(VMA_DEBUG_INITIALIZE_ALLOCATIONS)
        +
        15563  {
        +
        15564  FillAllocation(*pAllocation, VMA_ALLOCATION_FILL_PATTERN_CREATED);
        +
        15565  }
        +
        15566 
        +
        15567  return VK_SUCCESS;
        +
        15568 }
        +
        15569 
        +
        15570 void VmaAllocator_T::GetBufferMemoryRequirements(
        +
        15571  VkBuffer hBuffer,
        +
        15572  VkMemoryRequirements& memReq,
        +
        15573  bool& requiresDedicatedAllocation,
        +
        15574  bool& prefersDedicatedAllocation) const
        +
        15575 {
        +
        15576 #if VMA_DEDICATED_ALLOCATION || VMA_VULKAN_VERSION >= 1001000
        +
        15577  if(m_UseKhrDedicatedAllocation || m_VulkanApiVersion >= VK_MAKE_VERSION(1, 1, 0))
        +
        15578  {
        +
        15579  VkBufferMemoryRequirementsInfo2KHR memReqInfo = { VK_STRUCTURE_TYPE_BUFFER_MEMORY_REQUIREMENTS_INFO_2_KHR };
        +
        15580  memReqInfo.buffer = hBuffer;
        +
        15581 
        +
        15582  VkMemoryDedicatedRequirementsKHR memDedicatedReq = { VK_STRUCTURE_TYPE_MEMORY_DEDICATED_REQUIREMENTS_KHR };
        +
        15583 
        +
        15584  VkMemoryRequirements2KHR memReq2 = { VK_STRUCTURE_TYPE_MEMORY_REQUIREMENTS_2_KHR };
        +
        15585  memReq2.pNext = &memDedicatedReq;
        +
        15586 
        +
        15587  (*m_VulkanFunctions.vkGetBufferMemoryRequirements2KHR)(m_hDevice, &memReqInfo, &memReq2);
        15588 
        -
        15589  return res;
        -
        15590 }
        -
        15591 
        -
        15592 VkResult VmaAllocator_T::DefragmentationEnd(
        -
        15593  VmaDefragmentationContext context)
        -
        15594 {
        -
        15595  vma_delete(this, context);
        -
        15596  return VK_SUCCESS;
        -
        15597 }
        -
        15598 
        -
        15599 void VmaAllocator_T::GetAllocationInfo(VmaAllocation hAllocation, VmaAllocationInfo* pAllocationInfo)
        -
        15600 {
        -
        15601  if(hAllocation->CanBecomeLost())
        -
        15602  {
        -
        15603  /*
        -
        15604  Warning: This is a carefully designed algorithm.
        -
        15605  Do not modify unless you really know what you're doing :)
        -
        15606  */
        -
        15607  const uint32_t localCurrFrameIndex = m_CurrentFrameIndex.load();
        -
        15608  uint32_t localLastUseFrameIndex = hAllocation->GetLastUseFrameIndex();
        -
        15609  for(;;)
        -
        15610  {
        -
        15611  if(localLastUseFrameIndex == VMA_FRAME_INDEX_LOST)
        -
        15612  {
        -
        15613  pAllocationInfo->memoryType = UINT32_MAX;
        -
        15614  pAllocationInfo->deviceMemory = VK_NULL_HANDLE;
        -
        15615  pAllocationInfo->offset = 0;
        -
        15616  pAllocationInfo->size = hAllocation->GetSize();
        -
        15617  pAllocationInfo->pMappedData = VMA_NULL;
        -
        15618  pAllocationInfo->pUserData = hAllocation->GetUserData();
        -
        15619  return;
        -
        15620  }
        -
        15621  else if(localLastUseFrameIndex == localCurrFrameIndex)
        -
        15622  {
        -
        15623  pAllocationInfo->memoryType = hAllocation->GetMemoryTypeIndex();
        -
        15624  pAllocationInfo->deviceMemory = hAllocation->GetMemory();
        -
        15625  pAllocationInfo->offset = hAllocation->GetOffset();
        -
        15626  pAllocationInfo->size = hAllocation->GetSize();
        -
        15627  pAllocationInfo->pMappedData = VMA_NULL;
        -
        15628  pAllocationInfo->pUserData = hAllocation->GetUserData();
        -
        15629  return;
        -
        15630  }
        -
        15631  else // Last use time earlier than current time.
        -
        15632  {
        -
        15633  if(hAllocation->CompareExchangeLastUseFrameIndex(localLastUseFrameIndex, localCurrFrameIndex))
        -
        15634  {
        -
        15635  localLastUseFrameIndex = localCurrFrameIndex;
        -
        15636  }
        -
        15637  }
        -
        15638  }
        -
        15639  }
        -
        15640  else
        -
        15641  {
        -
        15642 #if VMA_STATS_STRING_ENABLED
        -
        15643  uint32_t localCurrFrameIndex = m_CurrentFrameIndex.load();
        -
        15644  uint32_t localLastUseFrameIndex = hAllocation->GetLastUseFrameIndex();
        -
        15645  for(;;)
        -
        15646  {
        -
        15647  VMA_ASSERT(localLastUseFrameIndex != VMA_FRAME_INDEX_LOST);
        -
        15648  if(localLastUseFrameIndex == localCurrFrameIndex)
        -
        15649  {
        -
        15650  break;
        -
        15651  }
        -
        15652  else // Last use time earlier than current time.
        -
        15653  {
        -
        15654  if(hAllocation->CompareExchangeLastUseFrameIndex(localLastUseFrameIndex, localCurrFrameIndex))
        -
        15655  {
        -
        15656  localLastUseFrameIndex = localCurrFrameIndex;
        -
        15657  }
        -
        15658  }
        -
        15659  }
        -
        15660 #endif
        -
        15661 
        -
        15662  pAllocationInfo->memoryType = hAllocation->GetMemoryTypeIndex();
        -
        15663  pAllocationInfo->deviceMemory = hAllocation->GetMemory();
        -
        15664  pAllocationInfo->offset = hAllocation->GetOffset();
        -
        15665  pAllocationInfo->size = hAllocation->GetSize();
        -
        15666  pAllocationInfo->pMappedData = hAllocation->GetMappedData();
        -
        15667  pAllocationInfo->pUserData = hAllocation->GetUserData();
        -
        15668  }
        -
        15669 }
        -
        15670 
        -
        15671 bool VmaAllocator_T::TouchAllocation(VmaAllocation hAllocation)
        -
        15672 {
        -
        15673  // This is a stripped-down version of VmaAllocator_T::GetAllocationInfo.
        -
        15674  if(hAllocation->CanBecomeLost())
        -
        15675  {
        -
        15676  uint32_t localCurrFrameIndex = m_CurrentFrameIndex.load();
        -
        15677  uint32_t localLastUseFrameIndex = hAllocation->GetLastUseFrameIndex();
        -
        15678  for(;;)
        -
        15679  {
        -
        15680  if(localLastUseFrameIndex == VMA_FRAME_INDEX_LOST)
        -
        15681  {
        -
        15682  return false;
        -
        15683  }
        -
        15684  else if(localLastUseFrameIndex == localCurrFrameIndex)
        -
        15685  {
        -
        15686  return true;
        -
        15687  }
        -
        15688  else // Last use time earlier than current time.
        -
        15689  {
        -
        15690  if(hAllocation->CompareExchangeLastUseFrameIndex(localLastUseFrameIndex, localCurrFrameIndex))
        -
        15691  {
        -
        15692  localLastUseFrameIndex = localCurrFrameIndex;
        -
        15693  }
        -
        15694  }
        -
        15695  }
        -
        15696  }
        -
        15697  else
        -
        15698  {
        -
        15699 #if VMA_STATS_STRING_ENABLED
        -
        15700  uint32_t localCurrFrameIndex = m_CurrentFrameIndex.load();
        -
        15701  uint32_t localLastUseFrameIndex = hAllocation->GetLastUseFrameIndex();
        -
        15702  for(;;)
        -
        15703  {
        -
        15704  VMA_ASSERT(localLastUseFrameIndex != VMA_FRAME_INDEX_LOST);
        -
        15705  if(localLastUseFrameIndex == localCurrFrameIndex)
        -
        15706  {
        -
        15707  break;
        -
        15708  }
        -
        15709  else // Last use time earlier than current time.
        -
        15710  {
        -
        15711  if(hAllocation->CompareExchangeLastUseFrameIndex(localLastUseFrameIndex, localCurrFrameIndex))
        -
        15712  {
        -
        15713  localLastUseFrameIndex = localCurrFrameIndex;
        -
        15714  }
        -
        15715  }
        -
        15716  }
        -
        15717 #endif
        -
        15718 
        -
        15719  return true;
        -
        15720  }
        -
        15721 }
        -
        15722 
        -
        15723 VkResult VmaAllocator_T::CreatePool(const VmaPoolCreateInfo* pCreateInfo, VmaPool* pPool)
        -
        15724 {
        -
        15725  VMA_DEBUG_LOG(" CreatePool: MemoryTypeIndex=%u, flags=%u", pCreateInfo->memoryTypeIndex, pCreateInfo->flags);
        -
        15726 
        -
        15727  VmaPoolCreateInfo newCreateInfo = *pCreateInfo;
        -
        15728 
        -
        15729  if(newCreateInfo.maxBlockCount == 0)
        -
        15730  {
        -
        15731  newCreateInfo.maxBlockCount = SIZE_MAX;
        -
        15732  }
        -
        15733  if(newCreateInfo.minBlockCount > newCreateInfo.maxBlockCount)
        -
        15734  {
        -
        15735  return VK_ERROR_INITIALIZATION_FAILED;
        -
        15736  }
        -
        15737 
        -
        15738  const VkDeviceSize preferredBlockSize = CalcPreferredBlockSize(newCreateInfo.memoryTypeIndex);
        -
        15739 
        -
        15740  *pPool = vma_new(this, VmaPool_T)(this, newCreateInfo, preferredBlockSize);
        -
        15741 
        -
        15742  VkResult res = (*pPool)->m_BlockVector.CreateMinBlocks();
        -
        15743  if(res != VK_SUCCESS)
        -
        15744  {
        -
        15745  vma_delete(this, *pPool);
        -
        15746  *pPool = VMA_NULL;
        -
        15747  return res;
        -
        15748  }
        -
        15749 
        -
        15750  // Add to m_Pools.
        -
        15751  {
        -
        15752  VmaMutexLockWrite lock(m_PoolsMutex, m_UseMutex);
        -
        15753  (*pPool)->SetId(m_NextPoolId++);
        -
        15754  VmaVectorInsertSorted<VmaPointerLess>(m_Pools, *pPool);
        -
        15755  }
        -
        15756 
        -
        15757  return VK_SUCCESS;
        -
        15758 }
        -
        15759 
        -
        15760 void VmaAllocator_T::DestroyPool(VmaPool pool)
        -
        15761 {
        -
        15762  // Remove from m_Pools.
        -
        15763  {
        -
        15764  VmaMutexLockWrite lock(m_PoolsMutex, m_UseMutex);
        -
        15765  bool success = VmaVectorRemoveSorted<VmaPointerLess>(m_Pools, pool);
        -
        15766  VMA_ASSERT(success && "Pool not found in Allocator.");
        -
        15767  }
        -
        15768 
        -
        15769  vma_delete(this, pool);
        -
        15770 }
        -
        15771 
        -
        15772 void VmaAllocator_T::GetPoolStats(VmaPool pool, VmaPoolStats* pPoolStats)
        -
        15773 {
        -
        15774  pool->m_BlockVector.GetPoolStats(pPoolStats);
        -
        15775 }
        -
        15776 
        -
        15777 void VmaAllocator_T::SetCurrentFrameIndex(uint32_t frameIndex)
        -
        15778 {
        -
        15779  m_CurrentFrameIndex.store(frameIndex);
        -
        15780 
        -
        15781 #if VMA_MEMORY_BUDGET
        -
        15782  if(m_UseExtMemoryBudget)
        -
        15783  {
        -
        15784  UpdateVulkanBudget();
        -
        15785  }
        -
        15786 #endif // #if VMA_MEMORY_BUDGET
        -
        15787 }
        -
        15788 
        -
        15789 void VmaAllocator_T::MakePoolAllocationsLost(
        -
        15790  VmaPool hPool,
        -
        15791  size_t* pLostAllocationCount)
        -
        15792 {
        -
        15793  hPool->m_BlockVector.MakePoolAllocationsLost(
        -
        15794  m_CurrentFrameIndex.load(),
        -
        15795  pLostAllocationCount);
        -
        15796 }
        -
        15797 
        -
        15798 VkResult VmaAllocator_T::CheckPoolCorruption(VmaPool hPool)
        -
        15799 {
        -
        15800  return hPool->m_BlockVector.CheckCorruption();
        -
        15801 }
        +
        15589  memReq = memReq2.memoryRequirements;
        +
        15590  requiresDedicatedAllocation = (memDedicatedReq.requiresDedicatedAllocation != VK_FALSE);
        +
        15591  prefersDedicatedAllocation = (memDedicatedReq.prefersDedicatedAllocation != VK_FALSE);
        +
        15592  }
        +
        15593  else
        +
        15594 #endif // #if VMA_DEDICATED_ALLOCATION || VMA_VULKAN_VERSION >= 1001000
        +
        15595  {
        +
        15596  (*m_VulkanFunctions.vkGetBufferMemoryRequirements)(m_hDevice, hBuffer, &memReq);
        +
        15597  requiresDedicatedAllocation = false;
        +
        15598  prefersDedicatedAllocation = false;
        +
        15599  }
        +
        15600 }
        +
        15601 
        +
        15602 void VmaAllocator_T::GetImageMemoryRequirements(
        +
        15603  VkImage hImage,
        +
        15604  VkMemoryRequirements& memReq,
        +
        15605  bool& requiresDedicatedAllocation,
        +
        15606  bool& prefersDedicatedAllocation) const
        +
        15607 {
        +
        15608 #if VMA_DEDICATED_ALLOCATION || VMA_VULKAN_VERSION >= 1001000
        +
        15609  if(m_UseKhrDedicatedAllocation || m_VulkanApiVersion >= VK_MAKE_VERSION(1, 1, 0))
        +
        15610  {
        +
        15611  VkImageMemoryRequirementsInfo2KHR memReqInfo = { VK_STRUCTURE_TYPE_IMAGE_MEMORY_REQUIREMENTS_INFO_2_KHR };
        +
        15612  memReqInfo.image = hImage;
        +
        15613 
        +
        15614  VkMemoryDedicatedRequirementsKHR memDedicatedReq = { VK_STRUCTURE_TYPE_MEMORY_DEDICATED_REQUIREMENTS_KHR };
        +
        15615 
        +
        15616  VkMemoryRequirements2KHR memReq2 = { VK_STRUCTURE_TYPE_MEMORY_REQUIREMENTS_2_KHR };
        +
        15617  memReq2.pNext = &memDedicatedReq;
        +
        15618 
        +
        15619  (*m_VulkanFunctions.vkGetImageMemoryRequirements2KHR)(m_hDevice, &memReqInfo, &memReq2);
        +
        15620 
        +
        15621  memReq = memReq2.memoryRequirements;
        +
        15622  requiresDedicatedAllocation = (memDedicatedReq.requiresDedicatedAllocation != VK_FALSE);
        +
        15623  prefersDedicatedAllocation = (memDedicatedReq.prefersDedicatedAllocation != VK_FALSE);
        +
        15624  }
        +
        15625  else
        +
        15626 #endif // #if VMA_DEDICATED_ALLOCATION || VMA_VULKAN_VERSION >= 1001000
        +
        15627  {
        +
        15628  (*m_VulkanFunctions.vkGetImageMemoryRequirements)(m_hDevice, hImage, &memReq);
        +
        15629  requiresDedicatedAllocation = false;
        +
        15630  prefersDedicatedAllocation = false;
        +
        15631  }
        +
        15632 }
        +
        15633 
        +
        15634 VkResult VmaAllocator_T::AllocateMemory(
        +
        15635  const VkMemoryRequirements& vkMemReq,
        +
        15636  bool requiresDedicatedAllocation,
        +
        15637  bool prefersDedicatedAllocation,
        +
        15638  VkBuffer dedicatedBuffer,
        +
        15639  VkImage dedicatedImage,
        +
        15640  const VmaAllocationCreateInfo& createInfo,
        +
        15641  VmaSuballocationType suballocType,
        +
        15642  size_t allocationCount,
        +
        15643  VmaAllocation* pAllocations)
        +
        15644 {
        +
        15645  memset(pAllocations, 0, sizeof(VmaAllocation) * allocationCount);
        +
        15646 
        +
        15647  VMA_ASSERT(VmaIsPow2(vkMemReq.alignment));
        +
        15648 
        +
        15649  if(vkMemReq.size == 0)
        +
        15650  {
        +
        15651  return VK_ERROR_VALIDATION_FAILED_EXT;
        +
        15652  }
        +
        15653  if((createInfo.flags & VMA_ALLOCATION_CREATE_DEDICATED_MEMORY_BIT) != 0 &&
        +
        15654  (createInfo.flags & VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT) != 0)
        +
        15655  {
        +
        15656  VMA_ASSERT(0 && "Specifying VMA_ALLOCATION_CREATE_DEDICATED_MEMORY_BIT together with VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT makes no sense.");
        +
        15657  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        +
        15658  }
        +
        15659  if((createInfo.flags & VMA_ALLOCATION_CREATE_MAPPED_BIT) != 0 &&
        +
        15660  (createInfo.flags & VMA_ALLOCATION_CREATE_CAN_BECOME_LOST_BIT) != 0)
        +
        15661  {
        +
        15662  VMA_ASSERT(0 && "Specifying VMA_ALLOCATION_CREATE_MAPPED_BIT together with VMA_ALLOCATION_CREATE_CAN_BECOME_LOST_BIT is invalid.");
        +
        15663  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        +
        15664  }
        +
        15665  if(requiresDedicatedAllocation)
        +
        15666  {
        +
        15667  if((createInfo.flags & VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT) != 0)
        +
        15668  {
        +
        15669  VMA_ASSERT(0 && "VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT specified while dedicated allocation is required.");
        +
        15670  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        +
        15671  }
        +
        15672  if(createInfo.pool != VK_NULL_HANDLE)
        +
        15673  {
        +
        15674  VMA_ASSERT(0 && "Pool specified while dedicated allocation is required.");
        +
        15675  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        +
        15676  }
        +
        15677  }
        +
        15678  if((createInfo.pool != VK_NULL_HANDLE) &&
        +
        15679  ((createInfo.flags & (VMA_ALLOCATION_CREATE_DEDICATED_MEMORY_BIT)) != 0))
        +
        15680  {
        +
        15681  VMA_ASSERT(0 && "Specifying VMA_ALLOCATION_CREATE_DEDICATED_MEMORY_BIT when pool != null is invalid.");
        +
        15682  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        +
        15683  }
        +
        15684 
        +
        15685  if(createInfo.pool != VK_NULL_HANDLE)
        +
        15686  {
        +
        15687  const VkDeviceSize alignmentForPool = VMA_MAX(
        +
        15688  vkMemReq.alignment,
        +
        15689  GetMemoryTypeMinAlignment(createInfo.pool->m_BlockVector.GetMemoryTypeIndex()));
        +
        15690 
        +
        15691  VmaAllocationCreateInfo createInfoForPool = createInfo;
        +
        15692  // If memory type is not HOST_VISIBLE, disable MAPPED.
        +
        15693  if((createInfoForPool.flags & VMA_ALLOCATION_CREATE_MAPPED_BIT) != 0 &&
        +
        15694  (m_MemProps.memoryTypes[createInfo.pool->m_BlockVector.GetMemoryTypeIndex()].propertyFlags & VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT) == 0)
        +
        15695  {
        +
        15696  createInfoForPool.flags &= ~VMA_ALLOCATION_CREATE_MAPPED_BIT;
        +
        15697  }
        +
        15698 
        +
        15699  return createInfo.pool->m_BlockVector.Allocate(
        +
        15700  m_CurrentFrameIndex.load(),
        +
        15701  vkMemReq.size,
        +
        15702  alignmentForPool,
        +
        15703  createInfoForPool,
        +
        15704  suballocType,
        +
        15705  allocationCount,
        +
        15706  pAllocations);
        +
        15707  }
        +
        15708  else
        +
        15709  {
        +
        15710  // Bit mask of memory Vulkan types acceptable for this allocation.
        +
        15711  uint32_t memoryTypeBits = vkMemReq.memoryTypeBits;
        +
        15712  uint32_t memTypeIndex = UINT32_MAX;
        +
        15713  VkResult res = vmaFindMemoryTypeIndex(this, memoryTypeBits, &createInfo, &memTypeIndex);
        +
        15714  if(res == VK_SUCCESS)
        +
        15715  {
        +
        15716  VkDeviceSize alignmentForMemType = VMA_MAX(
        +
        15717  vkMemReq.alignment,
        +
        15718  GetMemoryTypeMinAlignment(memTypeIndex));
        +
        15719 
        +
        15720  res = AllocateMemoryOfType(
        +
        15721  vkMemReq.size,
        +
        15722  alignmentForMemType,
        +
        15723  requiresDedicatedAllocation || prefersDedicatedAllocation,
        +
        15724  dedicatedBuffer,
        +
        15725  dedicatedImage,
        +
        15726  createInfo,
        +
        15727  memTypeIndex,
        +
        15728  suballocType,
        +
        15729  allocationCount,
        +
        15730  pAllocations);
        +
        15731  // Succeeded on first try.
        +
        15732  if(res == VK_SUCCESS)
        +
        15733  {
        +
        15734  return res;
        +
        15735  }
        +
        15736  // Allocation from this memory type failed. Try other compatible memory types.
        +
        15737  else
        +
        15738  {
        +
        15739  for(;;)
        +
        15740  {
        +
        15741  // Remove old memTypeIndex from list of possibilities.
        +
        15742  memoryTypeBits &= ~(1u << memTypeIndex);
        +
        15743  // Find alternative memTypeIndex.
        +
        15744  res = vmaFindMemoryTypeIndex(this, memoryTypeBits, &createInfo, &memTypeIndex);
        +
        15745  if(res == VK_SUCCESS)
        +
        15746  {
        +
        15747  alignmentForMemType = VMA_MAX(
        +
        15748  vkMemReq.alignment,
        +
        15749  GetMemoryTypeMinAlignment(memTypeIndex));
        +
        15750 
        +
        15751  res = AllocateMemoryOfType(
        +
        15752  vkMemReq.size,
        +
        15753  alignmentForMemType,
        +
        15754  requiresDedicatedAllocation || prefersDedicatedAllocation,
        +
        15755  dedicatedBuffer,
        +
        15756  dedicatedImage,
        +
        15757  createInfo,
        +
        15758  memTypeIndex,
        +
        15759  suballocType,
        +
        15760  allocationCount,
        +
        15761  pAllocations);
        +
        15762  // Allocation from this alternative memory type succeeded.
        +
        15763  if(res == VK_SUCCESS)
        +
        15764  {
        +
        15765  return res;
        +
        15766  }
        +
        15767  // else: Allocation from this memory type failed. Try next one - next loop iteration.
        +
        15768  }
        +
        15769  // No other matching memory type index could be found.
        +
        15770  else
        +
        15771  {
        +
        15772  // Not returning res, which is VK_ERROR_FEATURE_NOT_PRESENT, because we already failed to allocate once.
        +
        15773  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        +
        15774  }
        +
        15775  }
        +
        15776  }
        +
        15777  }
        +
        15778  // Can't find any single memory type maching requirements. res is VK_ERROR_FEATURE_NOT_PRESENT.
        +
        15779  else
        +
        15780  return res;
        +
        15781  }
        +
        15782 }
        +
        15783 
        +
        15784 void VmaAllocator_T::FreeMemory(
        +
        15785  size_t allocationCount,
        +
        15786  const VmaAllocation* pAllocations)
        +
        15787 {
        +
        15788  VMA_ASSERT(pAllocations);
        +
        15789 
        +
        15790  for(size_t allocIndex = allocationCount; allocIndex--; )
        +
        15791  {
        +
        15792  VmaAllocation allocation = pAllocations[allocIndex];
        +
        15793 
        +
        15794  if(allocation != VK_NULL_HANDLE)
        +
        15795  {
        +
        15796  if(TouchAllocation(allocation))
        +
        15797  {
        +
        15798  if(VMA_DEBUG_INITIALIZE_ALLOCATIONS)
        +
        15799  {
        +
        15800  FillAllocation(allocation, VMA_ALLOCATION_FILL_PATTERN_DESTROYED);
        +
        15801  }
        15802 
        -
        15803 VkResult VmaAllocator_T::CheckCorruption(uint32_t memoryTypeBits)
        -
        15804 {
        -
        15805  VkResult finalRes = VK_ERROR_FEATURE_NOT_PRESENT;
        -
        15806 
        -
        15807  // Process default pools.
        -
        15808  for(uint32_t memTypeIndex = 0; memTypeIndex < GetMemoryTypeCount(); ++memTypeIndex)
        -
        15809  {
        -
        15810  if(((1u << memTypeIndex) & memoryTypeBits) != 0)
        -
        15811  {
        -
        15812  VmaBlockVector* const pBlockVector = m_pBlockVectors[memTypeIndex];
        -
        15813  VMA_ASSERT(pBlockVector);
        -
        15814  VkResult localRes = pBlockVector->CheckCorruption();
        -
        15815  switch(localRes)
        -
        15816  {
        -
        15817  case VK_ERROR_FEATURE_NOT_PRESENT:
        -
        15818  break;
        -
        15819  case VK_SUCCESS:
        -
        15820  finalRes = VK_SUCCESS;
        -
        15821  break;
        -
        15822  default:
        -
        15823  return localRes;
        -
        15824  }
        -
        15825  }
        -
        15826  }
        -
        15827 
        -
        15828  // Process custom pools.
        -
        15829  {
        -
        15830  VmaMutexLockRead lock(m_PoolsMutex, m_UseMutex);
        -
        15831  for(size_t poolIndex = 0, poolCount = m_Pools.size(); poolIndex < poolCount; ++poolIndex)
        -
        15832  {
        -
        15833  if(((1u << m_Pools[poolIndex]->m_BlockVector.GetMemoryTypeIndex()) & memoryTypeBits) != 0)
        -
        15834  {
        -
        15835  VkResult localRes = m_Pools[poolIndex]->m_BlockVector.CheckCorruption();
        -
        15836  switch(localRes)
        -
        15837  {
        -
        15838  case VK_ERROR_FEATURE_NOT_PRESENT:
        -
        15839  break;
        -
        15840  case VK_SUCCESS:
        -
        15841  finalRes = VK_SUCCESS;
        -
        15842  break;
        -
        15843  default:
        -
        15844  return localRes;
        -
        15845  }
        -
        15846  }
        -
        15847  }
        -
        15848  }
        -
        15849 
        -
        15850  return finalRes;
        +
        15803  switch(allocation->GetType())
        +
        15804  {
        +
        15805  case VmaAllocation_T::ALLOCATION_TYPE_BLOCK:
        +
        15806  {
        +
        15807  VmaBlockVector* pBlockVector = VMA_NULL;
        +
        15808  VmaPool hPool = allocation->GetBlock()->GetParentPool();
        +
        15809  if(hPool != VK_NULL_HANDLE)
        +
        15810  {
        +
        15811  pBlockVector = &hPool->m_BlockVector;
        +
        15812  }
        +
        15813  else
        +
        15814  {
        +
        15815  const uint32_t memTypeIndex = allocation->GetMemoryTypeIndex();
        +
        15816  pBlockVector = m_pBlockVectors[memTypeIndex];
        +
        15817  }
        +
        15818  pBlockVector->Free(allocation);
        +
        15819  }
        +
        15820  break;
        +
        15821  case VmaAllocation_T::ALLOCATION_TYPE_DEDICATED:
        +
        15822  FreeDedicatedMemory(allocation);
        +
        15823  break;
        +
        15824  default:
        +
        15825  VMA_ASSERT(0);
        +
        15826  }
        +
        15827  }
        +
        15828 
        +
        15829  // Do this regardless of whether the allocation is lost. Lost allocations still account to Budget.AllocationBytes.
        +
        15830  m_Budget.RemoveAllocation(MemoryTypeIndexToHeapIndex(allocation->GetMemoryTypeIndex()), allocation->GetSize());
        +
        15831  allocation->SetUserData(this, VMA_NULL);
        +
        15832  m_AllocationObjectAllocator.Free(allocation);
        +
        15833  }
        +
        15834  }
        +
        15835 }
        +
        15836 
        +
        15837 VkResult VmaAllocator_T::ResizeAllocation(
        +
        15838  const VmaAllocation alloc,
        +
        15839  VkDeviceSize newSize)
        +
        15840 {
        +
        15841  // This function is deprecated and so it does nothing. It's left for backward compatibility.
        +
        15842  if(newSize == 0 || alloc->GetLastUseFrameIndex() == VMA_FRAME_INDEX_LOST)
        +
        15843  {
        +
        15844  return VK_ERROR_VALIDATION_FAILED_EXT;
        +
        15845  }
        +
        15846  if(newSize == alloc->GetSize())
        +
        15847  {
        +
        15848  return VK_SUCCESS;
        +
        15849  }
        +
        15850  return VK_ERROR_OUT_OF_POOL_MEMORY;
        15851 }
        15852 
        -
        15853 void VmaAllocator_T::CreateLostAllocation(VmaAllocation* pAllocation)
        +
        15853 void VmaAllocator_T::CalculateStats(VmaStats* pStats)
        15854 {
        -
        15855  *pAllocation = m_AllocationObjectAllocator.Allocate();
        -
        15856  (*pAllocation)->Ctor(VMA_FRAME_INDEX_LOST, false);
        -
        15857  (*pAllocation)->InitLost();
        -
        15858 }
        -
        15859 
        -
        15860 VkResult VmaAllocator_T::AllocateVulkanMemory(const VkMemoryAllocateInfo* pAllocateInfo, VkDeviceMemory* pMemory)
        -
        15861 {
        -
        15862  const uint32_t heapIndex = MemoryTypeIndexToHeapIndex(pAllocateInfo->memoryTypeIndex);
        -
        15863 
        -
        15864  // HeapSizeLimit is in effect for this heap.
        -
        15865  if((m_HeapSizeLimitMask & (1u << heapIndex)) != 0)
        -
        15866  {
        -
        15867  const VkDeviceSize heapSize = m_MemProps.memoryHeaps[heapIndex].size;
        -
        15868  VkDeviceSize blockBytes = m_Budget.m_BlockBytes[heapIndex];
        -
        15869  for(;;)
        -
        15870  {
        -
        15871  const VkDeviceSize blockBytesAfterAllocation = blockBytes + pAllocateInfo->allocationSize;
        -
        15872  if(blockBytesAfterAllocation > heapSize)
        -
        15873  {
        -
        15874  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        -
        15875  }
        -
        15876  if(m_Budget.m_BlockBytes[heapIndex].compare_exchange_strong(blockBytes, blockBytesAfterAllocation))
        -
        15877  {
        -
        15878  break;
        -
        15879  }
        -
        15880  }
        -
        15881  }
        -
        15882  else
        -
        15883  {
        -
        15884  m_Budget.m_BlockBytes[heapIndex] += pAllocateInfo->allocationSize;
        -
        15885  }
        -
        15886 
        -
        15887  // VULKAN CALL vkAllocateMemory.
        -
        15888  VkResult res = (*m_VulkanFunctions.vkAllocateMemory)(m_hDevice, pAllocateInfo, GetAllocationCallbacks(), pMemory);
        -
        15889 
        -
        15890  if(res == VK_SUCCESS)
        -
        15891  {
        -
        15892 #if VMA_MEMORY_BUDGET
        -
        15893  ++m_Budget.m_OperationsSinceBudgetFetch;
        -
        15894 #endif
        +
        15855  // Initialize.
        +
        15856  InitStatInfo(pStats->total);
        +
        15857  for(size_t i = 0; i < VK_MAX_MEMORY_TYPES; ++i)
        +
        15858  InitStatInfo(pStats->memoryType[i]);
        +
        15859  for(size_t i = 0; i < VK_MAX_MEMORY_HEAPS; ++i)
        +
        15860  InitStatInfo(pStats->memoryHeap[i]);
        +
        15861 
        +
        15862  // Process default pools.
        +
        15863  for(uint32_t memTypeIndex = 0; memTypeIndex < GetMemoryTypeCount(); ++memTypeIndex)
        +
        15864  {
        +
        15865  VmaBlockVector* const pBlockVector = m_pBlockVectors[memTypeIndex];
        +
        15866  VMA_ASSERT(pBlockVector);
        +
        15867  pBlockVector->AddStats(pStats);
        +
        15868  }
        +
        15869 
        +
        15870  // Process custom pools.
        +
        15871  {
        +
        15872  VmaMutexLockRead lock(m_PoolsMutex, m_UseMutex);
        +
        15873  for(size_t poolIndex = 0, poolCount = m_Pools.size(); poolIndex < poolCount; ++poolIndex)
        +
        15874  {
        +
        15875  m_Pools[poolIndex]->m_BlockVector.AddStats(pStats);
        +
        15876  }
        +
        15877  }
        +
        15878 
        +
        15879  // Process dedicated allocations.
        +
        15880  for(uint32_t memTypeIndex = 0; memTypeIndex < GetMemoryTypeCount(); ++memTypeIndex)
        +
        15881  {
        +
        15882  const uint32_t memHeapIndex = MemoryTypeIndexToHeapIndex(memTypeIndex);
        +
        15883  VmaMutexLockRead dedicatedAllocationsLock(m_DedicatedAllocationsMutex[memTypeIndex], m_UseMutex);
        +
        15884  AllocationVectorType* const pDedicatedAllocVector = m_pDedicatedAllocations[memTypeIndex];
        +
        15885  VMA_ASSERT(pDedicatedAllocVector);
        +
        15886  for(size_t allocIndex = 0, allocCount = pDedicatedAllocVector->size(); allocIndex < allocCount; ++allocIndex)
        +
        15887  {
        +
        15888  VmaStatInfo allocationStatInfo;
        +
        15889  (*pDedicatedAllocVector)[allocIndex]->DedicatedAllocCalcStatsInfo(allocationStatInfo);
        +
        15890  VmaAddStatInfo(pStats->total, allocationStatInfo);
        +
        15891  VmaAddStatInfo(pStats->memoryType[memTypeIndex], allocationStatInfo);
        +
        15892  VmaAddStatInfo(pStats->memoryHeap[memHeapIndex], allocationStatInfo);
        +
        15893  }
        +
        15894  }
        15895 
        -
        15896  // Informative callback.
        -
        15897  if(m_DeviceMemoryCallbacks.pfnAllocate != VMA_NULL)
        -
        15898  {
        -
        15899  (*m_DeviceMemoryCallbacks.pfnAllocate)(this, pAllocateInfo->memoryTypeIndex, *pMemory, pAllocateInfo->allocationSize);
        -
        15900  }
        -
        15901  }
        -
        15902  else
        -
        15903  {
        -
        15904  m_Budget.m_BlockBytes[heapIndex] -= pAllocateInfo->allocationSize;
        -
        15905  }
        -
        15906 
        -
        15907  return res;
        -
        15908 }
        -
        15909 
        -
        15910 void VmaAllocator_T::FreeVulkanMemory(uint32_t memoryType, VkDeviceSize size, VkDeviceMemory hMemory)
        -
        15911 {
        -
        15912  // Informative callback.
        -
        15913  if(m_DeviceMemoryCallbacks.pfnFree != VMA_NULL)
        -
        15914  {
        -
        15915  (*m_DeviceMemoryCallbacks.pfnFree)(this, memoryType, hMemory, size);
        -
        15916  }
        -
        15917 
        -
        15918  // VULKAN CALL vkFreeMemory.
        -
        15919  (*m_VulkanFunctions.vkFreeMemory)(m_hDevice, hMemory, GetAllocationCallbacks());
        -
        15920 
        -
        15921  m_Budget.m_BlockBytes[MemoryTypeIndexToHeapIndex(memoryType)] -= size;
        -
        15922 }
        -
        15923 
        -
        15924 VkResult VmaAllocator_T::BindVulkanBuffer(
        -
        15925  VkDeviceMemory memory,
        -
        15926  VkDeviceSize memoryOffset,
        -
        15927  VkBuffer buffer,
        -
        15928  const void* pNext)
        -
        15929 {
        -
        15930  if(pNext != VMA_NULL)
        -
        15931  {
        -
        15932 #if VMA_VULKAN_VERSION >= 1001000 || VMA_BIND_MEMORY2
        -
        15933  if((m_UseKhrBindMemory2 || m_VulkanApiVersion >= VK_MAKE_VERSION(1, 1, 0)) &&
        -
        15934  m_VulkanFunctions.vkBindBufferMemory2KHR != VMA_NULL)
        +
        15896  // Postprocess.
        +
        15897  VmaPostprocessCalcStatInfo(pStats->total);
        +
        15898  for(size_t i = 0; i < GetMemoryTypeCount(); ++i)
        +
        15899  VmaPostprocessCalcStatInfo(pStats->memoryType[i]);
        +
        15900  for(size_t i = 0; i < GetMemoryHeapCount(); ++i)
        +
        15901  VmaPostprocessCalcStatInfo(pStats->memoryHeap[i]);
        +
        15902 }
        +
        15903 
        +
        15904 void VmaAllocator_T::GetBudget(VmaBudget* outBudget, uint32_t firstHeap, uint32_t heapCount)
        +
        15905 {
        +
        15906 #if VMA_MEMORY_BUDGET
        +
        15907  if(m_UseExtMemoryBudget)
        +
        15908  {
        +
        15909  if(m_Budget.m_OperationsSinceBudgetFetch < 30)
        +
        15910  {
        +
        15911  VmaMutexLockRead lockRead(m_Budget.m_BudgetMutex, m_UseMutex);
        +
        15912  for(uint32_t i = 0; i < heapCount; ++i, ++outBudget)
        +
        15913  {
        +
        15914  const uint32_t heapIndex = firstHeap + i;
        +
        15915 
        +
        15916  outBudget->blockBytes = m_Budget.m_BlockBytes[heapIndex];
        +
        15917  outBudget->allocationBytes = m_Budget.m_AllocationBytes[heapIndex];
        +
        15918 
        +
        15919  if(m_Budget.m_VulkanUsage[heapIndex] + outBudget->blockBytes > m_Budget.m_BlockBytesAtBudgetFetch[heapIndex])
        +
        15920  {
        +
        15921  outBudget->usage = m_Budget.m_VulkanUsage[heapIndex] +
        +
        15922  outBudget->blockBytes - m_Budget.m_BlockBytesAtBudgetFetch[heapIndex];
        +
        15923  }
        +
        15924  else
        +
        15925  {
        +
        15926  outBudget->usage = 0;
        +
        15927  }
        +
        15928 
        +
        15929  // Have to take MIN with heap size because explicit HeapSizeLimit is included in it.
        +
        15930  outBudget->budget = VMA_MIN(
        +
        15931  m_Budget.m_VulkanBudget[heapIndex], m_MemProps.memoryHeaps[heapIndex].size);
        +
        15932  }
        +
        15933  }
        +
        15934  else
        15935  {
        -
        15936  VkBindBufferMemoryInfoKHR bindBufferMemoryInfo = { VK_STRUCTURE_TYPE_BIND_BUFFER_MEMORY_INFO_KHR };
        -
        15937  bindBufferMemoryInfo.pNext = pNext;
        -
        15938  bindBufferMemoryInfo.buffer = buffer;
        -
        15939  bindBufferMemoryInfo.memory = memory;
        -
        15940  bindBufferMemoryInfo.memoryOffset = memoryOffset;
        -
        15941  return (*m_VulkanFunctions.vkBindBufferMemory2KHR)(m_hDevice, 1, &bindBufferMemoryInfo);
        -
        15942  }
        -
        15943  else
        -
        15944 #endif // #if VMA_VULKAN_VERSION >= 1001000 || VMA_BIND_MEMORY2
        -
        15945  {
        -
        15946  return VK_ERROR_EXTENSION_NOT_PRESENT;
        -
        15947  }
        -
        15948  }
        -
        15949  else
        -
        15950  {
        -
        15951  return (*m_VulkanFunctions.vkBindBufferMemory)(m_hDevice, buffer, memory, memoryOffset);
        -
        15952  }
        -
        15953 }
        -
        15954 
        -
        15955 VkResult VmaAllocator_T::BindVulkanImage(
        -
        15956  VkDeviceMemory memory,
        -
        15957  VkDeviceSize memoryOffset,
        -
        15958  VkImage image,
        -
        15959  const void* pNext)
        -
        15960 {
        -
        15961  if(pNext != VMA_NULL)
        -
        15962  {
        -
        15963 #if VMA_VULKAN_VERSION >= 1001000 || VMA_BIND_MEMORY2
        -
        15964  if((m_UseKhrBindMemory2 || m_VulkanApiVersion >= VK_MAKE_VERSION(1, 1, 0)) &&
        -
        15965  m_VulkanFunctions.vkBindImageMemory2KHR != VMA_NULL)
        -
        15966  {
        -
        15967  VkBindImageMemoryInfoKHR bindBufferMemoryInfo = { VK_STRUCTURE_TYPE_BIND_IMAGE_MEMORY_INFO_KHR };
        -
        15968  bindBufferMemoryInfo.pNext = pNext;
        -
        15969  bindBufferMemoryInfo.image = image;
        -
        15970  bindBufferMemoryInfo.memory = memory;
        -
        15971  bindBufferMemoryInfo.memoryOffset = memoryOffset;
        -
        15972  return (*m_VulkanFunctions.vkBindImageMemory2KHR)(m_hDevice, 1, &bindBufferMemoryInfo);
        -
        15973  }
        -
        15974  else
        -
        15975 #endif // #if VMA_BIND_MEMORY2
        -
        15976  {
        -
        15977  return VK_ERROR_EXTENSION_NOT_PRESENT;
        -
        15978  }
        -
        15979  }
        -
        15980  else
        +
        15936  UpdateVulkanBudget(); // Outside of mutex lock
        +
        15937  GetBudget(outBudget, firstHeap, heapCount); // Recursion
        +
        15938  }
        +
        15939  }
        +
        15940  else
        +
        15941 #endif
        +
        15942  {
        +
        15943  for(uint32_t i = 0; i < heapCount; ++i, ++outBudget)
        +
        15944  {
        +
        15945  const uint32_t heapIndex = firstHeap + i;
        +
        15946 
        +
        15947  outBudget->blockBytes = m_Budget.m_BlockBytes[heapIndex];
        +
        15948  outBudget->allocationBytes = m_Budget.m_AllocationBytes[heapIndex];
        +
        15949 
        +
        15950  outBudget->usage = outBudget->blockBytes;
        +
        15951  outBudget->budget = m_MemProps.memoryHeaps[heapIndex].size * 8 / 10; // 80% heuristics.
        +
        15952  }
        +
        15953  }
        +
        15954 }
        +
        15955 
        +
        15956 static const uint32_t VMA_VENDOR_ID_AMD = 4098;
        +
        15957 
        +
        15958 VkResult VmaAllocator_T::DefragmentationBegin(
        +
        15959  const VmaDefragmentationInfo2& info,
        +
        15960  VmaDefragmentationStats* pStats,
        +
        15961  VmaDefragmentationContext* pContext)
        +
        15962 {
        +
        15963  if(info.pAllocationsChanged != VMA_NULL)
        +
        15964  {
        +
        15965  memset(info.pAllocationsChanged, 0, info.allocationCount * sizeof(VkBool32));
        +
        15966  }
        +
        15967 
        +
        15968  *pContext = vma_new(this, VmaDefragmentationContext_T)(
        +
        15969  this, m_CurrentFrameIndex.load(), info.flags, pStats);
        +
        15970 
        +
        15971  (*pContext)->AddPools(info.poolCount, info.pPools);
        +
        15972  (*pContext)->AddAllocations(
        +
        15973  info.allocationCount, info.pAllocations, info.pAllocationsChanged);
        +
        15974 
        +
        15975  VkResult res = (*pContext)->Defragment(
        +
        15976  info.maxCpuBytesToMove, info.maxCpuAllocationsToMove,
        +
        15977  info.maxGpuBytesToMove, info.maxGpuAllocationsToMove,
        +
        15978  info.commandBuffer, pStats, info.flags);
        +
        15979 
        +
        15980  if(res != VK_NOT_READY)
        15981  {
        -
        15982  return (*m_VulkanFunctions.vkBindImageMemory)(m_hDevice, image, memory, memoryOffset);
        -
        15983  }
        -
        15984 }
        +
        15982  vma_delete(this, *pContext);
        +
        15983  *pContext = VMA_NULL;
        +
        15984  }
        15985 
        -
        15986 VkResult VmaAllocator_T::Map(VmaAllocation hAllocation, void** ppData)
        -
        15987 {
        -
        15988  if(hAllocation->CanBecomeLost())
        -
        15989  {
        -
        15990  return VK_ERROR_MEMORY_MAP_FAILED;
        -
        15991  }
        -
        15992 
        -
        15993  switch(hAllocation->GetType())
        -
        15994  {
        -
        15995  case VmaAllocation_T::ALLOCATION_TYPE_BLOCK:
        -
        15996  {
        -
        15997  VmaDeviceMemoryBlock* const pBlock = hAllocation->GetBlock();
        -
        15998  char *pBytes = VMA_NULL;
        -
        15999  VkResult res = pBlock->Map(this, 1, (void**)&pBytes);
        -
        16000  if(res == VK_SUCCESS)
        -
        16001  {
        -
        16002  *ppData = pBytes + (ptrdiff_t)hAllocation->GetOffset();
        -
        16003  hAllocation->BlockAllocMap();
        -
        16004  }
        -
        16005  return res;
        -
        16006  }
        -
        16007  case VmaAllocation_T::ALLOCATION_TYPE_DEDICATED:
        -
        16008  return hAllocation->DedicatedAllocMap(this, ppData);
        -
        16009  default:
        -
        16010  VMA_ASSERT(0);
        -
        16011  return VK_ERROR_MEMORY_MAP_FAILED;
        -
        16012  }
        -
        16013 }
        -
        16014 
        -
        16015 void VmaAllocator_T::Unmap(VmaAllocation hAllocation)
        -
        16016 {
        -
        16017  switch(hAllocation->GetType())
        -
        16018  {
        -
        16019  case VmaAllocation_T::ALLOCATION_TYPE_BLOCK:
        +
        15986  return res;
        +
        15987 }
        +
        15988 
        +
        15989 VkResult VmaAllocator_T::DefragmentationEnd(
        +
        15990  VmaDefragmentationContext context)
        +
        15991 {
        +
        15992  vma_delete(this, context);
        +
        15993  return VK_SUCCESS;
        +
        15994 }
        +
        15995 
        +
        15996 VkResult VmaAllocator_T::DefragmentationPassBegin(
        +
        15997  VmaDefragmentationPassInfo* pInfo,
        +
        15998  VmaDefragmentationContext context)
        +
        15999 {
        +
        16000  return context->DefragmentPassBegin(pInfo);
        +
        16001 }
        +
        16002 VkResult VmaAllocator_T::DefragmentationPassEnd(
        +
        16003  VmaDefragmentationContext context)
        +
        16004 {
        +
        16005  return context->DefragmentPassEnd();
        +
        16006 
        +
        16007 }
        +
        16008 
        +
        16009 void VmaAllocator_T::GetAllocationInfo(VmaAllocation hAllocation, VmaAllocationInfo* pAllocationInfo)
        +
        16010 {
        +
        16011  if(hAllocation->CanBecomeLost())
        +
        16012  {
        +
        16013  /*
        +
        16014  Warning: This is a carefully designed algorithm.
        +
        16015  Do not modify unless you really know what you're doing :)
        +
        16016  */
        +
        16017  const uint32_t localCurrFrameIndex = m_CurrentFrameIndex.load();
        +
        16018  uint32_t localLastUseFrameIndex = hAllocation->GetLastUseFrameIndex();
        +
        16019  for(;;)
        16020  {
        -
        16021  VmaDeviceMemoryBlock* const pBlock = hAllocation->GetBlock();
        -
        16022  hAllocation->BlockAllocUnmap();
        -
        16023  pBlock->Unmap(this, 1);
        -
        16024  }
        -
        16025  break;
        -
        16026  case VmaAllocation_T::ALLOCATION_TYPE_DEDICATED:
        -
        16027  hAllocation->DedicatedAllocUnmap(this);
        -
        16028  break;
        -
        16029  default:
        -
        16030  VMA_ASSERT(0);
        -
        16031  }
        -
        16032 }
        -
        16033 
        -
        16034 VkResult VmaAllocator_T::BindBufferMemory(
        -
        16035  VmaAllocation hAllocation,
        -
        16036  VkDeviceSize allocationLocalOffset,
        -
        16037  VkBuffer hBuffer,
        -
        16038  const void* pNext)
        -
        16039 {
        -
        16040  VkResult res = VK_SUCCESS;
        -
        16041  switch(hAllocation->GetType())
        -
        16042  {
        -
        16043  case VmaAllocation_T::ALLOCATION_TYPE_DEDICATED:
        -
        16044  res = BindVulkanBuffer(hAllocation->GetMemory(), allocationLocalOffset, hBuffer, pNext);
        -
        16045  break;
        -
        16046  case VmaAllocation_T::ALLOCATION_TYPE_BLOCK:
        -
        16047  {
        -
        16048  VmaDeviceMemoryBlock* const pBlock = hAllocation->GetBlock();
        -
        16049  VMA_ASSERT(pBlock && "Binding buffer to allocation that doesn't belong to any block. Is the allocation lost?");
        -
        16050  res = pBlock->BindBufferMemory(this, hAllocation, allocationLocalOffset, hBuffer, pNext);
        -
        16051  break;
        -
        16052  }
        -
        16053  default:
        -
        16054  VMA_ASSERT(0);
        -
        16055  }
        -
        16056  return res;
        -
        16057 }
        -
        16058 
        -
        16059 VkResult VmaAllocator_T::BindImageMemory(
        -
        16060  VmaAllocation hAllocation,
        -
        16061  VkDeviceSize allocationLocalOffset,
        -
        16062  VkImage hImage,
        -
        16063  const void* pNext)
        -
        16064 {
        -
        16065  VkResult res = VK_SUCCESS;
        -
        16066  switch(hAllocation->GetType())
        -
        16067  {
        -
        16068  case VmaAllocation_T::ALLOCATION_TYPE_DEDICATED:
        -
        16069  res = BindVulkanImage(hAllocation->GetMemory(), allocationLocalOffset, hImage, pNext);
        -
        16070  break;
        -
        16071  case VmaAllocation_T::ALLOCATION_TYPE_BLOCK:
        -
        16072  {
        -
        16073  VmaDeviceMemoryBlock* pBlock = hAllocation->GetBlock();
        -
        16074  VMA_ASSERT(pBlock && "Binding image to allocation that doesn't belong to any block. Is the allocation lost?");
        -
        16075  res = pBlock->BindImageMemory(this, hAllocation, allocationLocalOffset, hImage, pNext);
        -
        16076  break;
        -
        16077  }
        -
        16078  default:
        -
        16079  VMA_ASSERT(0);
        -
        16080  }
        -
        16081  return res;
        -
        16082 }
        -
        16083 
        -
        16084 void VmaAllocator_T::FlushOrInvalidateAllocation(
        -
        16085  VmaAllocation hAllocation,
        -
        16086  VkDeviceSize offset, VkDeviceSize size,
        -
        16087  VMA_CACHE_OPERATION op)
        -
        16088 {
        -
        16089  const uint32_t memTypeIndex = hAllocation->GetMemoryTypeIndex();
        -
        16090  if(size > 0 && IsMemoryTypeNonCoherent(memTypeIndex))
        -
        16091  {
        -
        16092  const VkDeviceSize allocationSize = hAllocation->GetSize();
        -
        16093  VMA_ASSERT(offset <= allocationSize);
        -
        16094 
        -
        16095  const VkDeviceSize nonCoherentAtomSize = m_PhysicalDeviceProperties.limits.nonCoherentAtomSize;
        -
        16096 
        -
        16097  VkMappedMemoryRange memRange = { VK_STRUCTURE_TYPE_MAPPED_MEMORY_RANGE };
        -
        16098  memRange.memory = hAllocation->GetMemory();
        -
        16099 
        -
        16100  switch(hAllocation->GetType())
        -
        16101  {
        -
        16102  case VmaAllocation_T::ALLOCATION_TYPE_DEDICATED:
        -
        16103  memRange.offset = VmaAlignDown(offset, nonCoherentAtomSize);
        -
        16104  if(size == VK_WHOLE_SIZE)
        -
        16105  {
        -
        16106  memRange.size = allocationSize - memRange.offset;
        -
        16107  }
        -
        16108  else
        -
        16109  {
        -
        16110  VMA_ASSERT(offset + size <= allocationSize);
        -
        16111  memRange.size = VMA_MIN(
        -
        16112  VmaAlignUp(size + (offset - memRange.offset), nonCoherentAtomSize),
        -
        16113  allocationSize - memRange.offset);
        -
        16114  }
        -
        16115  break;
        -
        16116 
        -
        16117  case VmaAllocation_T::ALLOCATION_TYPE_BLOCK:
        -
        16118  {
        -
        16119  // 1. Still within this allocation.
        -
        16120  memRange.offset = VmaAlignDown(offset, nonCoherentAtomSize);
        -
        16121  if(size == VK_WHOLE_SIZE)
        -
        16122  {
        -
        16123  size = allocationSize - offset;
        -
        16124  }
        -
        16125  else
        -
        16126  {
        -
        16127  VMA_ASSERT(offset + size <= allocationSize);
        -
        16128  }
        -
        16129  memRange.size = VmaAlignUp(size + (offset - memRange.offset), nonCoherentAtomSize);
        -
        16130 
        -
        16131  // 2. Adjust to whole block.
        -
        16132  const VkDeviceSize allocationOffset = hAllocation->GetOffset();
        -
        16133  VMA_ASSERT(allocationOffset % nonCoherentAtomSize == 0);
        -
        16134  const VkDeviceSize blockSize = hAllocation->GetBlock()->m_pMetadata->GetSize();
        -
        16135  memRange.offset += allocationOffset;
        -
        16136  memRange.size = VMA_MIN(memRange.size, blockSize - memRange.offset);
        -
        16137 
        -
        16138  break;
        -
        16139  }
        -
        16140 
        -
        16141  default:
        -
        16142  VMA_ASSERT(0);
        -
        16143  }
        -
        16144 
        -
        16145  switch(op)
        -
        16146  {
        -
        16147  case VMA_CACHE_FLUSH:
        -
        16148  (*GetVulkanFunctions().vkFlushMappedMemoryRanges)(m_hDevice, 1, &memRange);
        -
        16149  break;
        -
        16150  case VMA_CACHE_INVALIDATE:
        -
        16151  (*GetVulkanFunctions().vkInvalidateMappedMemoryRanges)(m_hDevice, 1, &memRange);
        -
        16152  break;
        -
        16153  default:
        -
        16154  VMA_ASSERT(0);
        -
        16155  }
        -
        16156  }
        -
        16157  // else: Just ignore this call.
        -
        16158 }
        -
        16159 
        -
        16160 void VmaAllocator_T::FreeDedicatedMemory(const VmaAllocation allocation)
        -
        16161 {
        -
        16162  VMA_ASSERT(allocation && allocation->GetType() == VmaAllocation_T::ALLOCATION_TYPE_DEDICATED);
        -
        16163 
        -
        16164  const uint32_t memTypeIndex = allocation->GetMemoryTypeIndex();
        -
        16165  {
        -
        16166  VmaMutexLockWrite lock(m_DedicatedAllocationsMutex[memTypeIndex], m_UseMutex);
        -
        16167  AllocationVectorType* const pDedicatedAllocations = m_pDedicatedAllocations[memTypeIndex];
        -
        16168  VMA_ASSERT(pDedicatedAllocations);
        -
        16169  bool success = VmaVectorRemoveSorted<VmaPointerLess>(*pDedicatedAllocations, allocation);
        -
        16170  VMA_ASSERT(success);
        +
        16021  if(localLastUseFrameIndex == VMA_FRAME_INDEX_LOST)
        +
        16022  {
        +
        16023  pAllocationInfo->memoryType = UINT32_MAX;
        +
        16024  pAllocationInfo->deviceMemory = VK_NULL_HANDLE;
        +
        16025  pAllocationInfo->offset = 0;
        +
        16026  pAllocationInfo->size = hAllocation->GetSize();
        +
        16027  pAllocationInfo->pMappedData = VMA_NULL;
        +
        16028  pAllocationInfo->pUserData = hAllocation->GetUserData();
        +
        16029  return;
        +
        16030  }
        +
        16031  else if(localLastUseFrameIndex == localCurrFrameIndex)
        +
        16032  {
        +
        16033  pAllocationInfo->memoryType = hAllocation->GetMemoryTypeIndex();
        +
        16034  pAllocationInfo->deviceMemory = hAllocation->GetMemory();
        +
        16035  pAllocationInfo->offset = hAllocation->GetOffset();
        +
        16036  pAllocationInfo->size = hAllocation->GetSize();
        +
        16037  pAllocationInfo->pMappedData = VMA_NULL;
        +
        16038  pAllocationInfo->pUserData = hAllocation->GetUserData();
        +
        16039  return;
        +
        16040  }
        +
        16041  else // Last use time earlier than current time.
        +
        16042  {
        +
        16043  if(hAllocation->CompareExchangeLastUseFrameIndex(localLastUseFrameIndex, localCurrFrameIndex))
        +
        16044  {
        +
        16045  localLastUseFrameIndex = localCurrFrameIndex;
        +
        16046  }
        +
        16047  }
        +
        16048  }
        +
        16049  }
        +
        16050  else
        +
        16051  {
        +
        16052 #if VMA_STATS_STRING_ENABLED
        +
        16053  uint32_t localCurrFrameIndex = m_CurrentFrameIndex.load();
        +
        16054  uint32_t localLastUseFrameIndex = hAllocation->GetLastUseFrameIndex();
        +
        16055  for(;;)
        +
        16056  {
        +
        16057  VMA_ASSERT(localLastUseFrameIndex != VMA_FRAME_INDEX_LOST);
        +
        16058  if(localLastUseFrameIndex == localCurrFrameIndex)
        +
        16059  {
        +
        16060  break;
        +
        16061  }
        +
        16062  else // Last use time earlier than current time.
        +
        16063  {
        +
        16064  if(hAllocation->CompareExchangeLastUseFrameIndex(localLastUseFrameIndex, localCurrFrameIndex))
        +
        16065  {
        +
        16066  localLastUseFrameIndex = localCurrFrameIndex;
        +
        16067  }
        +
        16068  }
        +
        16069  }
        +
        16070 #endif
        +
        16071 
        +
        16072  pAllocationInfo->memoryType = hAllocation->GetMemoryTypeIndex();
        +
        16073  pAllocationInfo->deviceMemory = hAllocation->GetMemory();
        +
        16074  pAllocationInfo->offset = hAllocation->GetOffset();
        +
        16075  pAllocationInfo->size = hAllocation->GetSize();
        +
        16076  pAllocationInfo->pMappedData = hAllocation->GetMappedData();
        +
        16077  pAllocationInfo->pUserData = hAllocation->GetUserData();
        +
        16078  }
        +
        16079 }
        +
        16080 
        +
        16081 bool VmaAllocator_T::TouchAllocation(VmaAllocation hAllocation)
        +
        16082 {
        +
        16083  // This is a stripped-down version of VmaAllocator_T::GetAllocationInfo.
        +
        16084  if(hAllocation->CanBecomeLost())
        +
        16085  {
        +
        16086  uint32_t localCurrFrameIndex = m_CurrentFrameIndex.load();
        +
        16087  uint32_t localLastUseFrameIndex = hAllocation->GetLastUseFrameIndex();
        +
        16088  for(;;)
        +
        16089  {
        +
        16090  if(localLastUseFrameIndex == VMA_FRAME_INDEX_LOST)
        +
        16091  {
        +
        16092  return false;
        +
        16093  }
        +
        16094  else if(localLastUseFrameIndex == localCurrFrameIndex)
        +
        16095  {
        +
        16096  return true;
        +
        16097  }
        +
        16098  else // Last use time earlier than current time.
        +
        16099  {
        +
        16100  if(hAllocation->CompareExchangeLastUseFrameIndex(localLastUseFrameIndex, localCurrFrameIndex))
        +
        16101  {
        +
        16102  localLastUseFrameIndex = localCurrFrameIndex;
        +
        16103  }
        +
        16104  }
        +
        16105  }
        +
        16106  }
        +
        16107  else
        +
        16108  {
        +
        16109 #if VMA_STATS_STRING_ENABLED
        +
        16110  uint32_t localCurrFrameIndex = m_CurrentFrameIndex.load();
        +
        16111  uint32_t localLastUseFrameIndex = hAllocation->GetLastUseFrameIndex();
        +
        16112  for(;;)
        +
        16113  {
        +
        16114  VMA_ASSERT(localLastUseFrameIndex != VMA_FRAME_INDEX_LOST);
        +
        16115  if(localLastUseFrameIndex == localCurrFrameIndex)
        +
        16116  {
        +
        16117  break;
        +
        16118  }
        +
        16119  else // Last use time earlier than current time.
        +
        16120  {
        +
        16121  if(hAllocation->CompareExchangeLastUseFrameIndex(localLastUseFrameIndex, localCurrFrameIndex))
        +
        16122  {
        +
        16123  localLastUseFrameIndex = localCurrFrameIndex;
        +
        16124  }
        +
        16125  }
        +
        16126  }
        +
        16127 #endif
        +
        16128 
        +
        16129  return true;
        +
        16130  }
        +
        16131 }
        +
        16132 
        +
        16133 VkResult VmaAllocator_T::CreatePool(const VmaPoolCreateInfo* pCreateInfo, VmaPool* pPool)
        +
        16134 {
        +
        16135  VMA_DEBUG_LOG(" CreatePool: MemoryTypeIndex=%u, flags=%u", pCreateInfo->memoryTypeIndex, pCreateInfo->flags);
        +
        16136 
        +
        16137  VmaPoolCreateInfo newCreateInfo = *pCreateInfo;
        +
        16138 
        +
        16139  if(newCreateInfo.maxBlockCount == 0)
        +
        16140  {
        +
        16141  newCreateInfo.maxBlockCount = SIZE_MAX;
        +
        16142  }
        +
        16143  if(newCreateInfo.minBlockCount > newCreateInfo.maxBlockCount)
        +
        16144  {
        +
        16145  return VK_ERROR_INITIALIZATION_FAILED;
        +
        16146  }
        +
        16147  // Memory type index out of range or forbidden.
        +
        16148  if(pCreateInfo->memoryTypeIndex >= GetMemoryTypeCount() ||
        +
        16149  ((1u << pCreateInfo->memoryTypeIndex) & m_GlobalMemoryTypeBits) == 0)
        +
        16150  {
        +
        16151  return VK_ERROR_FEATURE_NOT_PRESENT;
        +
        16152  }
        +
        16153 
        +
        16154  const VkDeviceSize preferredBlockSize = CalcPreferredBlockSize(newCreateInfo.memoryTypeIndex);
        +
        16155 
        +
        16156  *pPool = vma_new(this, VmaPool_T)(this, newCreateInfo, preferredBlockSize);
        +
        16157 
        +
        16158  VkResult res = (*pPool)->m_BlockVector.CreateMinBlocks();
        +
        16159  if(res != VK_SUCCESS)
        +
        16160  {
        +
        16161  vma_delete(this, *pPool);
        +
        16162  *pPool = VMA_NULL;
        +
        16163  return res;
        +
        16164  }
        +
        16165 
        +
        16166  // Add to m_Pools.
        +
        16167  {
        +
        16168  VmaMutexLockWrite lock(m_PoolsMutex, m_UseMutex);
        +
        16169  (*pPool)->SetId(m_NextPoolId++);
        +
        16170  VmaVectorInsertSorted<VmaPointerLess>(m_Pools, *pPool);
        16171  }
        16172 
        -
        16173  VkDeviceMemory hMemory = allocation->GetMemory();
        -
        16174 
        -
        16175  /*
        -
        16176  There is no need to call this, because Vulkan spec allows to skip vkUnmapMemory
        -
        16177  before vkFreeMemory.
        -
        16178 
        -
        16179  if(allocation->GetMappedData() != VMA_NULL)
        -
        16180  {
        -
        16181  (*m_VulkanFunctions.vkUnmapMemory)(m_hDevice, hMemory);
        -
        16182  }
        -
        16183  */
        -
        16184 
        -
        16185  FreeVulkanMemory(memTypeIndex, allocation->GetSize(), hMemory);
        -
        16186 
        -
        16187  VMA_DEBUG_LOG(" Freed DedicatedMemory MemoryTypeIndex=%u", memTypeIndex);
        -
        16188 }
        -
        16189 
        -
        16190 uint32_t VmaAllocator_T::CalculateGpuDefragmentationMemoryTypeBits() const
        -
        16191 {
        -
        16192  VkBufferCreateInfo dummyBufCreateInfo;
        -
        16193  VmaFillGpuDefragmentationBufferCreateInfo(dummyBufCreateInfo);
        -
        16194 
        -
        16195  uint32_t memoryTypeBits = 0;
        +
        16173  return VK_SUCCESS;
        +
        16174 }
        +
        16175 
        +
        16176 void VmaAllocator_T::DestroyPool(VmaPool pool)
        +
        16177 {
        +
        16178  // Remove from m_Pools.
        +
        16179  {
        +
        16180  VmaMutexLockWrite lock(m_PoolsMutex, m_UseMutex);
        +
        16181  bool success = VmaVectorRemoveSorted<VmaPointerLess>(m_Pools, pool);
        +
        16182  VMA_ASSERT(success && "Pool not found in Allocator.");
        +
        16183  }
        +
        16184 
        +
        16185  vma_delete(this, pool);
        +
        16186 }
        +
        16187 
        +
        16188 void VmaAllocator_T::GetPoolStats(VmaPool pool, VmaPoolStats* pPoolStats)
        +
        16189 {
        +
        16190  pool->m_BlockVector.GetPoolStats(pPoolStats);
        +
        16191 }
        +
        16192 
        +
        16193 void VmaAllocator_T::SetCurrentFrameIndex(uint32_t frameIndex)
        +
        16194 {
        +
        16195  m_CurrentFrameIndex.store(frameIndex);
        16196 
        -
        16197  // Create buffer.
        -
        16198  VkBuffer buf = VK_NULL_HANDLE;
        -
        16199  VkResult res = (*GetVulkanFunctions().vkCreateBuffer)(
        -
        16200  m_hDevice, &dummyBufCreateInfo, GetAllocationCallbacks(), &buf);
        -
        16201  if(res == VK_SUCCESS)
        -
        16202  {
        -
        16203  // Query for supported memory types.
        -
        16204  VkMemoryRequirements memReq;
        -
        16205  (*GetVulkanFunctions().vkGetBufferMemoryRequirements)(m_hDevice, buf, &memReq);
        -
        16206  memoryTypeBits = memReq.memoryTypeBits;
        -
        16207 
        -
        16208  // Destroy buffer.
        -
        16209  (*GetVulkanFunctions().vkDestroyBuffer)(m_hDevice, buf, GetAllocationCallbacks());
        -
        16210  }
        -
        16211 
        -
        16212  return memoryTypeBits;
        -
        16213 }
        -
        16214 
        -
        16215 #if VMA_MEMORY_BUDGET
        -
        16216 
        -
        16217 void VmaAllocator_T::UpdateVulkanBudget()
        -
        16218 {
        -
        16219  VMA_ASSERT(m_UseExtMemoryBudget);
        -
        16220 
        -
        16221  VkPhysicalDeviceMemoryProperties2KHR memProps = { VK_STRUCTURE_TYPE_PHYSICAL_DEVICE_MEMORY_PROPERTIES_2_KHR };
        +
        16197 #if VMA_MEMORY_BUDGET
        +
        16198  if(m_UseExtMemoryBudget)
        +
        16199  {
        +
        16200  UpdateVulkanBudget();
        +
        16201  }
        +
        16202 #endif // #if VMA_MEMORY_BUDGET
        +
        16203 }
        +
        16204 
        +
        16205 void VmaAllocator_T::MakePoolAllocationsLost(
        +
        16206  VmaPool hPool,
        +
        16207  size_t* pLostAllocationCount)
        +
        16208 {
        +
        16209  hPool->m_BlockVector.MakePoolAllocationsLost(
        +
        16210  m_CurrentFrameIndex.load(),
        +
        16211  pLostAllocationCount);
        +
        16212 }
        +
        16213 
        +
        16214 VkResult VmaAllocator_T::CheckPoolCorruption(VmaPool hPool)
        +
        16215 {
        +
        16216  return hPool->m_BlockVector.CheckCorruption();
        +
        16217 }
        +
        16218 
        +
        16219 VkResult VmaAllocator_T::CheckCorruption(uint32_t memoryTypeBits)
        +
        16220 {
        +
        16221  VkResult finalRes = VK_ERROR_FEATURE_NOT_PRESENT;
        16222 
        -
        16223  VkPhysicalDeviceMemoryBudgetPropertiesEXT budgetProps = { VK_STRUCTURE_TYPE_PHYSICAL_DEVICE_MEMORY_BUDGET_PROPERTIES_EXT };
        -
        16224  memProps.pNext = &budgetProps;
        -
        16225 
        -
        16226  GetVulkanFunctions().vkGetPhysicalDeviceMemoryProperties2KHR(m_PhysicalDevice, &memProps);
        -
        16227 
        -
        16228  {
        -
        16229  VmaMutexLockWrite lockWrite(m_Budget.m_BudgetMutex, m_UseMutex);
        -
        16230 
        -
        16231  for(uint32_t heapIndex = 0; heapIndex < GetMemoryHeapCount(); ++heapIndex)
        -
        16232  {
        -
        16233  m_Budget.m_VulkanUsage[heapIndex] = budgetProps.heapUsage[heapIndex];
        -
        16234  m_Budget.m_VulkanBudget[heapIndex] = budgetProps.heapBudget[heapIndex];
        -
        16235  m_Budget.m_BlockBytesAtBudgetFetch[heapIndex] = m_Budget.m_BlockBytes[heapIndex].load();
        -
        16236  }
        -
        16237  m_Budget.m_OperationsSinceBudgetFetch = 0;
        -
        16238  }
        -
        16239 }
        -
        16240 
        -
        16241 #endif // #if VMA_MEMORY_BUDGET
        -
        16242 
        -
        16243 void VmaAllocator_T::FillAllocation(const VmaAllocation hAllocation, uint8_t pattern)
        -
        16244 {
        -
        16245  if(VMA_DEBUG_INITIALIZE_ALLOCATIONS &&
        -
        16246  !hAllocation->CanBecomeLost() &&
        -
        16247  (m_MemProps.memoryTypes[hAllocation->GetMemoryTypeIndex()].propertyFlags & VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT) != 0)
        -
        16248  {
        -
        16249  void* pData = VMA_NULL;
        -
        16250  VkResult res = Map(hAllocation, &pData);
        -
        16251  if(res == VK_SUCCESS)
        -
        16252  {
        -
        16253  memset(pData, (int)pattern, (size_t)hAllocation->GetSize());
        -
        16254  FlushOrInvalidateAllocation(hAllocation, 0, VK_WHOLE_SIZE, VMA_CACHE_FLUSH);
        -
        16255  Unmap(hAllocation);
        -
        16256  }
        -
        16257  else
        -
        16258  {
        -
        16259  VMA_ASSERT(0 && "VMA_DEBUG_INITIALIZE_ALLOCATIONS is enabled, but couldn't map memory to fill allocation.");
        -
        16260  }
        -
        16261  }
        -
        16262 }
        -
        16263 
        -
        16264 uint32_t VmaAllocator_T::GetGpuDefragmentationMemoryTypeBits()
        -
        16265 {
        -
        16266  uint32_t memoryTypeBits = m_GpuDefragmentationMemoryTypeBits.load();
        -
        16267  if(memoryTypeBits == UINT32_MAX)
        -
        16268  {
        -
        16269  memoryTypeBits = CalculateGpuDefragmentationMemoryTypeBits();
        -
        16270  m_GpuDefragmentationMemoryTypeBits.store(memoryTypeBits);
        -
        16271  }
        -
        16272  return memoryTypeBits;
        +
        16223  // Process default pools.
        +
        16224  for(uint32_t memTypeIndex = 0; memTypeIndex < GetMemoryTypeCount(); ++memTypeIndex)
        +
        16225  {
        +
        16226  if(((1u << memTypeIndex) & memoryTypeBits) != 0)
        +
        16227  {
        +
        16228  VmaBlockVector* const pBlockVector = m_pBlockVectors[memTypeIndex];
        +
        16229  VMA_ASSERT(pBlockVector);
        +
        16230  VkResult localRes = pBlockVector->CheckCorruption();
        +
        16231  switch(localRes)
        +
        16232  {
        +
        16233  case VK_ERROR_FEATURE_NOT_PRESENT:
        +
        16234  break;
        +
        16235  case VK_SUCCESS:
        +
        16236  finalRes = VK_SUCCESS;
        +
        16237  break;
        +
        16238  default:
        +
        16239  return localRes;
        +
        16240  }
        +
        16241  }
        +
        16242  }
        +
        16243 
        +
        16244  // Process custom pools.
        +
        16245  {
        +
        16246  VmaMutexLockRead lock(m_PoolsMutex, m_UseMutex);
        +
        16247  for(size_t poolIndex = 0, poolCount = m_Pools.size(); poolIndex < poolCount; ++poolIndex)
        +
        16248  {
        +
        16249  if(((1u << m_Pools[poolIndex]->m_BlockVector.GetMemoryTypeIndex()) & memoryTypeBits) != 0)
        +
        16250  {
        +
        16251  VkResult localRes = m_Pools[poolIndex]->m_BlockVector.CheckCorruption();
        +
        16252  switch(localRes)
        +
        16253  {
        +
        16254  case VK_ERROR_FEATURE_NOT_PRESENT:
        +
        16255  break;
        +
        16256  case VK_SUCCESS:
        +
        16257  finalRes = VK_SUCCESS;
        +
        16258  break;
        +
        16259  default:
        +
        16260  return localRes;
        +
        16261  }
        +
        16262  }
        +
        16263  }
        +
        16264  }
        +
        16265 
        +
        16266  return finalRes;
        +
        16267 }
        +
        16268 
        +
        16269 void VmaAllocator_T::CreateLostAllocation(VmaAllocation* pAllocation)
        +
        16270 {
        +
        16271  *pAllocation = m_AllocationObjectAllocator.Allocate(VMA_FRAME_INDEX_LOST, false);
        +
        16272  (*pAllocation)->InitLost();
        16273 }
        16274 
        -
        16275 #if VMA_STATS_STRING_ENABLED
        -
        16276 
        -
        16277 void VmaAllocator_T::PrintDetailedMap(VmaJsonWriter& json)
        -
        16278 {
        -
        16279  bool dedicatedAllocationsStarted = false;
        -
        16280  for(uint32_t memTypeIndex = 0; memTypeIndex < GetMemoryTypeCount(); ++memTypeIndex)
        +
        16275 VkResult VmaAllocator_T::AllocateVulkanMemory(const VkMemoryAllocateInfo* pAllocateInfo, VkDeviceMemory* pMemory)
        +
        16276 {
        +
        16277  const uint32_t heapIndex = MemoryTypeIndexToHeapIndex(pAllocateInfo->memoryTypeIndex);
        +
        16278 
        +
        16279  // HeapSizeLimit is in effect for this heap.
        +
        16280  if((m_HeapSizeLimitMask & (1u << heapIndex)) != 0)
        16281  {
        -
        16282  VmaMutexLockRead dedicatedAllocationsLock(m_DedicatedAllocationsMutex[memTypeIndex], m_UseMutex);
        -
        16283  AllocationVectorType* const pDedicatedAllocVector = m_pDedicatedAllocations[memTypeIndex];
        -
        16284  VMA_ASSERT(pDedicatedAllocVector);
        -
        16285  if(pDedicatedAllocVector->empty() == false)
        -
        16286  {
        -
        16287  if(dedicatedAllocationsStarted == false)
        +
        16282  const VkDeviceSize heapSize = m_MemProps.memoryHeaps[heapIndex].size;
        +
        16283  VkDeviceSize blockBytes = m_Budget.m_BlockBytes[heapIndex];
        +
        16284  for(;;)
        +
        16285  {
        +
        16286  const VkDeviceSize blockBytesAfterAllocation = blockBytes + pAllocateInfo->allocationSize;
        +
        16287  if(blockBytesAfterAllocation > heapSize)
        16288  {
        -
        16289  dedicatedAllocationsStarted = true;
        -
        16290  json.WriteString("DedicatedAllocations");
        -
        16291  json.BeginObject();
        -
        16292  }
        -
        16293 
        -
        16294  json.BeginString("Type ");
        -
        16295  json.ContinueString(memTypeIndex);
        -
        16296  json.EndString();
        -
        16297 
        -
        16298  json.BeginArray();
        -
        16299 
        -
        16300  for(size_t i = 0; i < pDedicatedAllocVector->size(); ++i)
        -
        16301  {
        -
        16302  json.BeginObject(true);
        -
        16303  const VmaAllocation hAlloc = (*pDedicatedAllocVector)[i];
        -
        16304  hAlloc->PrintParameters(json);
        -
        16305  json.EndObject();
        -
        16306  }
        -
        16307 
        -
        16308  json.EndArray();
        -
        16309  }
        -
        16310  }
        -
        16311  if(dedicatedAllocationsStarted)
        -
        16312  {
        -
        16313  json.EndObject();
        -
        16314  }
        -
        16315 
        -
        16316  {
        -
        16317  bool allocationsStarted = false;
        -
        16318  for(uint32_t memTypeIndex = 0; memTypeIndex < GetMemoryTypeCount(); ++memTypeIndex)
        -
        16319  {
        -
        16320  if(m_pBlockVectors[memTypeIndex]->IsEmpty() == false)
        -
        16321  {
        -
        16322  if(allocationsStarted == false)
        -
        16323  {
        -
        16324  allocationsStarted = true;
        -
        16325  json.WriteString("DefaultPools");
        -
        16326  json.BeginObject();
        -
        16327  }
        -
        16328 
        -
        16329  json.BeginString("Type ");
        -
        16330  json.ContinueString(memTypeIndex);
        -
        16331  json.EndString();
        +
        16289  return VK_ERROR_OUT_OF_DEVICE_MEMORY;
        +
        16290  }
        +
        16291  if(m_Budget.m_BlockBytes[heapIndex].compare_exchange_strong(blockBytes, blockBytesAfterAllocation))
        +
        16292  {
        +
        16293  break;
        +
        16294  }
        +
        16295  }
        +
        16296  }
        +
        16297  else
        +
        16298  {
        +
        16299  m_Budget.m_BlockBytes[heapIndex] += pAllocateInfo->allocationSize;
        +
        16300  }
        +
        16301 
        +
        16302  // VULKAN CALL vkAllocateMemory.
        +
        16303  VkResult res = (*m_VulkanFunctions.vkAllocateMemory)(m_hDevice, pAllocateInfo, GetAllocationCallbacks(), pMemory);
        +
        16304 
        +
        16305  if(res == VK_SUCCESS)
        +
        16306  {
        +
        16307 #if VMA_MEMORY_BUDGET
        +
        16308  ++m_Budget.m_OperationsSinceBudgetFetch;
        +
        16309 #endif
        +
        16310 
        +
        16311  // Informative callback.
        +
        16312  if(m_DeviceMemoryCallbacks.pfnAllocate != VMA_NULL)
        +
        16313  {
        +
        16314  (*m_DeviceMemoryCallbacks.pfnAllocate)(this, pAllocateInfo->memoryTypeIndex, *pMemory, pAllocateInfo->allocationSize);
        +
        16315  }
        +
        16316  }
        +
        16317  else
        +
        16318  {
        +
        16319  m_Budget.m_BlockBytes[heapIndex] -= pAllocateInfo->allocationSize;
        +
        16320  }
        +
        16321 
        +
        16322  return res;
        +
        16323 }
        +
        16324 
        +
        16325 void VmaAllocator_T::FreeVulkanMemory(uint32_t memoryType, VkDeviceSize size, VkDeviceMemory hMemory)
        +
        16326 {
        +
        16327  // Informative callback.
        +
        16328  if(m_DeviceMemoryCallbacks.pfnFree != VMA_NULL)
        +
        16329  {
        +
        16330  (*m_DeviceMemoryCallbacks.pfnFree)(this, memoryType, hMemory, size);
        +
        16331  }
        16332 
        -
        16333  m_pBlockVectors[memTypeIndex]->PrintDetailedMap(json);
        -
        16334  }
        -
        16335  }
        -
        16336  if(allocationsStarted)
        -
        16337  {
        -
        16338  json.EndObject();
        -
        16339  }
        -
        16340  }
        -
        16341 
        -
        16342  // Custom pools
        -
        16343  {
        -
        16344  VmaMutexLockRead lock(m_PoolsMutex, m_UseMutex);
        -
        16345  const size_t poolCount = m_Pools.size();
        -
        16346  if(poolCount > 0)
        -
        16347  {
        -
        16348  json.WriteString("Pools");
        -
        16349  json.BeginObject();
        -
        16350  for(size_t poolIndex = 0; poolIndex < poolCount; ++poolIndex)
        -
        16351  {
        -
        16352  json.BeginString();
        -
        16353  json.ContinueString(m_Pools[poolIndex]->GetId());
        -
        16354  json.EndString();
        -
        16355 
        -
        16356  m_Pools[poolIndex]->m_BlockVector.PrintDetailedMap(json);
        -
        16357  }
        -
        16358  json.EndObject();
        -
        16359  }
        -
        16360  }
        -
        16361 }
        -
        16362 
        -
        16363 #endif // #if VMA_STATS_STRING_ENABLED
        -
        16364 
        -
        16366 // Public interface
        -
        16367 
        -
        16368 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCreateAllocator(
        -
        16369  const VmaAllocatorCreateInfo* pCreateInfo,
        -
        16370  VmaAllocator* pAllocator)
        -
        16371 {
        -
        16372  VMA_ASSERT(pCreateInfo && pAllocator);
        -
        16373  VMA_ASSERT(pCreateInfo->vulkanApiVersion == 0 ||
        -
        16374  (VK_VERSION_MAJOR(pCreateInfo->vulkanApiVersion) == 1 && VK_VERSION_MINOR(pCreateInfo->vulkanApiVersion) <= 1));
        -
        16375  VMA_DEBUG_LOG("vmaCreateAllocator");
        -
        16376  *pAllocator = vma_new(pCreateInfo->pAllocationCallbacks, VmaAllocator_T)(pCreateInfo);
        -
        16377  return (*pAllocator)->Init(pCreateInfo);
        -
        16378 }
        -
        16379 
        -
        16380 VMA_CALL_PRE void VMA_CALL_POST vmaDestroyAllocator(
        -
        16381  VmaAllocator allocator)
        -
        16382 {
        -
        16383  if(allocator != VK_NULL_HANDLE)
        -
        16384  {
        -
        16385  VMA_DEBUG_LOG("vmaDestroyAllocator");
        -
        16386  VkAllocationCallbacks allocationCallbacks = allocator->m_AllocationCallbacks;
        -
        16387  vma_delete(&allocationCallbacks, allocator);
        -
        16388  }
        -
        16389 }
        -
        16390 
        -
        16391 VMA_CALL_PRE void VMA_CALL_POST vmaGetPhysicalDeviceProperties(
        -
        16392  VmaAllocator allocator,
        -
        16393  const VkPhysicalDeviceProperties **ppPhysicalDeviceProperties)
        -
        16394 {
        -
        16395  VMA_ASSERT(allocator && ppPhysicalDeviceProperties);
        -
        16396  *ppPhysicalDeviceProperties = &allocator->m_PhysicalDeviceProperties;
        -
        16397 }
        -
        16398 
        -
        16399 VMA_CALL_PRE void VMA_CALL_POST vmaGetMemoryProperties(
        -
        16400  VmaAllocator allocator,
        -
        16401  const VkPhysicalDeviceMemoryProperties** ppPhysicalDeviceMemoryProperties)
        +
        16333  // VULKAN CALL vkFreeMemory.
        +
        16334  (*m_VulkanFunctions.vkFreeMemory)(m_hDevice, hMemory, GetAllocationCallbacks());
        +
        16335 
        +
        16336  m_Budget.m_BlockBytes[MemoryTypeIndexToHeapIndex(memoryType)] -= size;
        +
        16337 }
        +
        16338 
        +
        16339 VkResult VmaAllocator_T::BindVulkanBuffer(
        +
        16340  VkDeviceMemory memory,
        +
        16341  VkDeviceSize memoryOffset,
        +
        16342  VkBuffer buffer,
        +
        16343  const void* pNext)
        +
        16344 {
        +
        16345  if(pNext != VMA_NULL)
        +
        16346  {
        +
        16347 #if VMA_VULKAN_VERSION >= 1001000 || VMA_BIND_MEMORY2
        +
        16348  if((m_UseKhrBindMemory2 || m_VulkanApiVersion >= VK_MAKE_VERSION(1, 1, 0)) &&
        +
        16349  m_VulkanFunctions.vkBindBufferMemory2KHR != VMA_NULL)
        +
        16350  {
        +
        16351  VkBindBufferMemoryInfoKHR bindBufferMemoryInfo = { VK_STRUCTURE_TYPE_BIND_BUFFER_MEMORY_INFO_KHR };
        +
        16352  bindBufferMemoryInfo.pNext = pNext;
        +
        16353  bindBufferMemoryInfo.buffer = buffer;
        +
        16354  bindBufferMemoryInfo.memory = memory;
        +
        16355  bindBufferMemoryInfo.memoryOffset = memoryOffset;
        +
        16356  return (*m_VulkanFunctions.vkBindBufferMemory2KHR)(m_hDevice, 1, &bindBufferMemoryInfo);
        +
        16357  }
        +
        16358  else
        +
        16359 #endif // #if VMA_VULKAN_VERSION >= 1001000 || VMA_BIND_MEMORY2
        +
        16360  {
        +
        16361  return VK_ERROR_EXTENSION_NOT_PRESENT;
        +
        16362  }
        +
        16363  }
        +
        16364  else
        +
        16365  {
        +
        16366  return (*m_VulkanFunctions.vkBindBufferMemory)(m_hDevice, buffer, memory, memoryOffset);
        +
        16367  }
        +
        16368 }
        +
        16369 
        +
        16370 VkResult VmaAllocator_T::BindVulkanImage(
        +
        16371  VkDeviceMemory memory,
        +
        16372  VkDeviceSize memoryOffset,
        +
        16373  VkImage image,
        +
        16374  const void* pNext)
        +
        16375 {
        +
        16376  if(pNext != VMA_NULL)
        +
        16377  {
        +
        16378 #if VMA_VULKAN_VERSION >= 1001000 || VMA_BIND_MEMORY2
        +
        16379  if((m_UseKhrBindMemory2 || m_VulkanApiVersion >= VK_MAKE_VERSION(1, 1, 0)) &&
        +
        16380  m_VulkanFunctions.vkBindImageMemory2KHR != VMA_NULL)
        +
        16381  {
        +
        16382  VkBindImageMemoryInfoKHR bindBufferMemoryInfo = { VK_STRUCTURE_TYPE_BIND_IMAGE_MEMORY_INFO_KHR };
        +
        16383  bindBufferMemoryInfo.pNext = pNext;
        +
        16384  bindBufferMemoryInfo.image = image;
        +
        16385  bindBufferMemoryInfo.memory = memory;
        +
        16386  bindBufferMemoryInfo.memoryOffset = memoryOffset;
        +
        16387  return (*m_VulkanFunctions.vkBindImageMemory2KHR)(m_hDevice, 1, &bindBufferMemoryInfo);
        +
        16388  }
        +
        16389  else
        +
        16390 #endif // #if VMA_BIND_MEMORY2
        +
        16391  {
        +
        16392  return VK_ERROR_EXTENSION_NOT_PRESENT;
        +
        16393  }
        +
        16394  }
        +
        16395  else
        +
        16396  {
        +
        16397  return (*m_VulkanFunctions.vkBindImageMemory)(m_hDevice, image, memory, memoryOffset);
        +
        16398  }
        +
        16399 }
        +
        16400 
        +
        16401 VkResult VmaAllocator_T::Map(VmaAllocation hAllocation, void** ppData)
        16402 {
        -
        16403  VMA_ASSERT(allocator && ppPhysicalDeviceMemoryProperties);
        -
        16404  *ppPhysicalDeviceMemoryProperties = &allocator->m_MemProps;
        -
        16405 }
        -
        16406 
        -
        16407 VMA_CALL_PRE void VMA_CALL_POST vmaGetMemoryTypeProperties(
        -
        16408  VmaAllocator allocator,
        -
        16409  uint32_t memoryTypeIndex,
        -
        16410  VkMemoryPropertyFlags* pFlags)
        -
        16411 {
        -
        16412  VMA_ASSERT(allocator && pFlags);
        -
        16413  VMA_ASSERT(memoryTypeIndex < allocator->GetMemoryTypeCount());
        -
        16414  *pFlags = allocator->m_MemProps.memoryTypes[memoryTypeIndex].propertyFlags;
        -
        16415 }
        -
        16416 
        -
        16417 VMA_CALL_PRE void VMA_CALL_POST vmaSetCurrentFrameIndex(
        -
        16418  VmaAllocator allocator,
        -
        16419  uint32_t frameIndex)
        -
        16420 {
        -
        16421  VMA_ASSERT(allocator);
        -
        16422  VMA_ASSERT(frameIndex != VMA_FRAME_INDEX_LOST);
        -
        16423 
        -
        16424  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        16425 
        -
        16426  allocator->SetCurrentFrameIndex(frameIndex);
        -
        16427 }
        -
        16428 
        -
        16429 VMA_CALL_PRE void VMA_CALL_POST vmaCalculateStats(
        -
        16430  VmaAllocator allocator,
        -
        16431  VmaStats* pStats)
        -
        16432 {
        -
        16433  VMA_ASSERT(allocator && pStats);
        -
        16434  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        16435  allocator->CalculateStats(pStats);
        -
        16436 }
        -
        16437 
        -
        16438 VMA_CALL_PRE void VMA_CALL_POST vmaGetBudget(
        -
        16439  VmaAllocator allocator,
        -
        16440  VmaBudget* pBudget)
        -
        16441 {
        -
        16442  VMA_ASSERT(allocator && pBudget);
        -
        16443  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        16444  allocator->GetBudget(pBudget, 0, allocator->GetMemoryHeapCount());
        -
        16445 }
        -
        16446 
        -
        16447 #if VMA_STATS_STRING_ENABLED
        +
        16403  if(hAllocation->CanBecomeLost())
        +
        16404  {
        +
        16405  return VK_ERROR_MEMORY_MAP_FAILED;
        +
        16406  }
        +
        16407 
        +
        16408  switch(hAllocation->GetType())
        +
        16409  {
        +
        16410  case VmaAllocation_T::ALLOCATION_TYPE_BLOCK:
        +
        16411  {
        +
        16412  VmaDeviceMemoryBlock* const pBlock = hAllocation->GetBlock();
        +
        16413  char *pBytes = VMA_NULL;
        +
        16414  VkResult res = pBlock->Map(this, 1, (void**)&pBytes);
        +
        16415  if(res == VK_SUCCESS)
        +
        16416  {
        +
        16417  *ppData = pBytes + (ptrdiff_t)hAllocation->GetOffset();
        +
        16418  hAllocation->BlockAllocMap();
        +
        16419  }
        +
        16420  return res;
        +
        16421  }
        +
        16422  case VmaAllocation_T::ALLOCATION_TYPE_DEDICATED:
        +
        16423  return hAllocation->DedicatedAllocMap(this, ppData);
        +
        16424  default:
        +
        16425  VMA_ASSERT(0);
        +
        16426  return VK_ERROR_MEMORY_MAP_FAILED;
        +
        16427  }
        +
        16428 }
        +
        16429 
        +
        16430 void VmaAllocator_T::Unmap(VmaAllocation hAllocation)
        +
        16431 {
        +
        16432  switch(hAllocation->GetType())
        +
        16433  {
        +
        16434  case VmaAllocation_T::ALLOCATION_TYPE_BLOCK:
        +
        16435  {
        +
        16436  VmaDeviceMemoryBlock* const pBlock = hAllocation->GetBlock();
        +
        16437  hAllocation->BlockAllocUnmap();
        +
        16438  pBlock->Unmap(this, 1);
        +
        16439  }
        +
        16440  break;
        +
        16441  case VmaAllocation_T::ALLOCATION_TYPE_DEDICATED:
        +
        16442  hAllocation->DedicatedAllocUnmap(this);
        +
        16443  break;
        +
        16444  default:
        +
        16445  VMA_ASSERT(0);
        +
        16446  }
        +
        16447 }
        16448 
        -
        16449 VMA_CALL_PRE void VMA_CALL_POST vmaBuildStatsString(
        -
        16450  VmaAllocator allocator,
        -
        16451  char** ppStatsString,
        -
        16452  VkBool32 detailedMap)
        -
        16453 {
        -
        16454  VMA_ASSERT(allocator && ppStatsString);
        -
        16455  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        16456 
        -
        16457  VmaStringBuilder sb(allocator);
        -
        16458  {
        -
        16459  VmaJsonWriter json(allocator->GetAllocationCallbacks(), sb);
        -
        16460  json.BeginObject();
        -
        16461 
        -
        16462  VmaBudget budget[VK_MAX_MEMORY_HEAPS];
        -
        16463  allocator->GetBudget(budget, 0, allocator->GetMemoryHeapCount());
        -
        16464 
        -
        16465  VmaStats stats;
        -
        16466  allocator->CalculateStats(&stats);
        -
        16467 
        -
        16468  json.WriteString("Total");
        -
        16469  VmaPrintStatInfo(json, stats.total);
        -
        16470 
        -
        16471  for(uint32_t heapIndex = 0; heapIndex < allocator->GetMemoryHeapCount(); ++heapIndex)
        -
        16472  {
        -
        16473  json.BeginString("Heap ");
        -
        16474  json.ContinueString(heapIndex);
        -
        16475  json.EndString();
        -
        16476  json.BeginObject();
        -
        16477 
        -
        16478  json.WriteString("Size");
        -
        16479  json.WriteNumber(allocator->m_MemProps.memoryHeaps[heapIndex].size);
        -
        16480 
        -
        16481  json.WriteString("Flags");
        -
        16482  json.BeginArray(true);
        -
        16483  if((allocator->m_MemProps.memoryHeaps[heapIndex].flags & VK_MEMORY_HEAP_DEVICE_LOCAL_BIT) != 0)
        -
        16484  {
        -
        16485  json.WriteString("DEVICE_LOCAL");
        -
        16486  }
        -
        16487  json.EndArray();
        -
        16488 
        -
        16489  json.WriteString("Budget");
        -
        16490  json.BeginObject();
        -
        16491  {
        -
        16492  json.WriteString("BlockBytes");
        -
        16493  json.WriteNumber(budget[heapIndex].blockBytes);
        -
        16494  json.WriteString("AllocationBytes");
        -
        16495  json.WriteNumber(budget[heapIndex].allocationBytes);
        -
        16496  json.WriteString("Usage");
        -
        16497  json.WriteNumber(budget[heapIndex].usage);
        -
        16498  json.WriteString("Budget");
        -
        16499  json.WriteNumber(budget[heapIndex].budget);
        -
        16500  }
        -
        16501  json.EndObject();
        -
        16502 
        -
        16503  if(stats.memoryHeap[heapIndex].blockCount > 0)
        -
        16504  {
        -
        16505  json.WriteString("Stats");
        -
        16506  VmaPrintStatInfo(json, stats.memoryHeap[heapIndex]);
        -
        16507  }
        -
        16508 
        -
        16509  for(uint32_t typeIndex = 0; typeIndex < allocator->GetMemoryTypeCount(); ++typeIndex)
        -
        16510  {
        -
        16511  if(allocator->MemoryTypeIndexToHeapIndex(typeIndex) == heapIndex)
        -
        16512  {
        -
        16513  json.BeginString("Type ");
        -
        16514  json.ContinueString(typeIndex);
        -
        16515  json.EndString();
        -
        16516 
        -
        16517  json.BeginObject();
        -
        16518 
        -
        16519  json.WriteString("Flags");
        -
        16520  json.BeginArray(true);
        -
        16521  VkMemoryPropertyFlags flags = allocator->m_MemProps.memoryTypes[typeIndex].propertyFlags;
        -
        16522  if((flags & VK_MEMORY_PROPERTY_DEVICE_LOCAL_BIT) != 0)
        -
        16523  {
        -
        16524  json.WriteString("DEVICE_LOCAL");
        -
        16525  }
        -
        16526  if((flags & VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT) != 0)
        -
        16527  {
        -
        16528  json.WriteString("HOST_VISIBLE");
        -
        16529  }
        -
        16530  if((flags & VK_MEMORY_PROPERTY_HOST_COHERENT_BIT) != 0)
        -
        16531  {
        -
        16532  json.WriteString("HOST_COHERENT");
        -
        16533  }
        -
        16534  if((flags & VK_MEMORY_PROPERTY_HOST_CACHED_BIT) != 0)
        -
        16535  {
        -
        16536  json.WriteString("HOST_CACHED");
        -
        16537  }
        -
        16538  if((flags & VK_MEMORY_PROPERTY_LAZILY_ALLOCATED_BIT) != 0)
        -
        16539  {
        -
        16540  json.WriteString("LAZILY_ALLOCATED");
        -
        16541  }
        -
        16542  json.EndArray();
        -
        16543 
        -
        16544  if(stats.memoryType[typeIndex].blockCount > 0)
        -
        16545  {
        -
        16546  json.WriteString("Stats");
        -
        16547  VmaPrintStatInfo(json, stats.memoryType[typeIndex]);
        -
        16548  }
        -
        16549 
        -
        16550  json.EndObject();
        -
        16551  }
        -
        16552  }
        -
        16553 
        -
        16554  json.EndObject();
        -
        16555  }
        -
        16556  if(detailedMap == VK_TRUE)
        -
        16557  {
        -
        16558  allocator->PrintDetailedMap(json);
        -
        16559  }
        -
        16560 
        -
        16561  json.EndObject();
        -
        16562  }
        -
        16563 
        -
        16564  const size_t len = sb.GetLength();
        -
        16565  char* const pChars = vma_new_array(allocator, char, len + 1);
        -
        16566  if(len > 0)
        -
        16567  {
        -
        16568  memcpy(pChars, sb.GetData(), len);
        -
        16569  }
        -
        16570  pChars[len] = '\0';
        -
        16571  *ppStatsString = pChars;
        -
        16572 }
        -
        16573 
        -
        16574 VMA_CALL_PRE void VMA_CALL_POST vmaFreeStatsString(
        -
        16575  VmaAllocator allocator,
        -
        16576  char* pStatsString)
        -
        16577 {
        -
        16578  if(pStatsString != VMA_NULL)
        -
        16579  {
        -
        16580  VMA_ASSERT(allocator);
        -
        16581  size_t len = strlen(pStatsString);
        -
        16582  vma_delete_array(allocator, pStatsString, len + 1);
        -
        16583  }
        -
        16584 }
        -
        16585 
        -
        16586 #endif // #if VMA_STATS_STRING_ENABLED
        +
        16449 VkResult VmaAllocator_T::BindBufferMemory(
        +
        16450  VmaAllocation hAllocation,
        +
        16451  VkDeviceSize allocationLocalOffset,
        +
        16452  VkBuffer hBuffer,
        +
        16453  const void* pNext)
        +
        16454 {
        +
        16455  VkResult res = VK_SUCCESS;
        +
        16456  switch(hAllocation->GetType())
        +
        16457  {
        +
        16458  case VmaAllocation_T::ALLOCATION_TYPE_DEDICATED:
        +
        16459  res = BindVulkanBuffer(hAllocation->GetMemory(), allocationLocalOffset, hBuffer, pNext);
        +
        16460  break;
        +
        16461  case VmaAllocation_T::ALLOCATION_TYPE_BLOCK:
        +
        16462  {
        +
        16463  VmaDeviceMemoryBlock* const pBlock = hAllocation->GetBlock();
        +
        16464  VMA_ASSERT(pBlock && "Binding buffer to allocation that doesn't belong to any block. Is the allocation lost?");
        +
        16465  res = pBlock->BindBufferMemory(this, hAllocation, allocationLocalOffset, hBuffer, pNext);
        +
        16466  break;
        +
        16467  }
        +
        16468  default:
        +
        16469  VMA_ASSERT(0);
        +
        16470  }
        +
        16471  return res;
        +
        16472 }
        +
        16473 
        +
        16474 VkResult VmaAllocator_T::BindImageMemory(
        +
        16475  VmaAllocation hAllocation,
        +
        16476  VkDeviceSize allocationLocalOffset,
        +
        16477  VkImage hImage,
        +
        16478  const void* pNext)
        +
        16479 {
        +
        16480  VkResult res = VK_SUCCESS;
        +
        16481  switch(hAllocation->GetType())
        +
        16482  {
        +
        16483  case VmaAllocation_T::ALLOCATION_TYPE_DEDICATED:
        +
        16484  res = BindVulkanImage(hAllocation->GetMemory(), allocationLocalOffset, hImage, pNext);
        +
        16485  break;
        +
        16486  case VmaAllocation_T::ALLOCATION_TYPE_BLOCK:
        +
        16487  {
        +
        16488  VmaDeviceMemoryBlock* pBlock = hAllocation->GetBlock();
        +
        16489  VMA_ASSERT(pBlock && "Binding image to allocation that doesn't belong to any block. Is the allocation lost?");
        +
        16490  res = pBlock->BindImageMemory(this, hAllocation, allocationLocalOffset, hImage, pNext);
        +
        16491  break;
        +
        16492  }
        +
        16493  default:
        +
        16494  VMA_ASSERT(0);
        +
        16495  }
        +
        16496  return res;
        +
        16497 }
        +
        16498 
        +
        16499 void VmaAllocator_T::FlushOrInvalidateAllocation(
        +
        16500  VmaAllocation hAllocation,
        +
        16501  VkDeviceSize offset, VkDeviceSize size,
        +
        16502  VMA_CACHE_OPERATION op)
        +
        16503 {
        +
        16504  const uint32_t memTypeIndex = hAllocation->GetMemoryTypeIndex();
        +
        16505  if(size > 0 && IsMemoryTypeNonCoherent(memTypeIndex))
        +
        16506  {
        +
        16507  const VkDeviceSize allocationSize = hAllocation->GetSize();
        +
        16508  VMA_ASSERT(offset <= allocationSize);
        +
        16509 
        +
        16510  const VkDeviceSize nonCoherentAtomSize = m_PhysicalDeviceProperties.limits.nonCoherentAtomSize;
        +
        16511 
        +
        16512  VkMappedMemoryRange memRange = { VK_STRUCTURE_TYPE_MAPPED_MEMORY_RANGE };
        +
        16513  memRange.memory = hAllocation->GetMemory();
        +
        16514 
        +
        16515  switch(hAllocation->GetType())
        +
        16516  {
        +
        16517  case VmaAllocation_T::ALLOCATION_TYPE_DEDICATED:
        +
        16518  memRange.offset = VmaAlignDown(offset, nonCoherentAtomSize);
        +
        16519  if(size == VK_WHOLE_SIZE)
        +
        16520  {
        +
        16521  memRange.size = allocationSize - memRange.offset;
        +
        16522  }
        +
        16523  else
        +
        16524  {
        +
        16525  VMA_ASSERT(offset + size <= allocationSize);
        +
        16526  memRange.size = VMA_MIN(
        +
        16527  VmaAlignUp(size + (offset - memRange.offset), nonCoherentAtomSize),
        +
        16528  allocationSize - memRange.offset);
        +
        16529  }
        +
        16530  break;
        +
        16531 
        +
        16532  case VmaAllocation_T::ALLOCATION_TYPE_BLOCK:
        +
        16533  {
        +
        16534  // 1. Still within this allocation.
        +
        16535  memRange.offset = VmaAlignDown(offset, nonCoherentAtomSize);
        +
        16536  if(size == VK_WHOLE_SIZE)
        +
        16537  {
        +
        16538  size = allocationSize - offset;
        +
        16539  }
        +
        16540  else
        +
        16541  {
        +
        16542  VMA_ASSERT(offset + size <= allocationSize);
        +
        16543  }
        +
        16544  memRange.size = VmaAlignUp(size + (offset - memRange.offset), nonCoherentAtomSize);
        +
        16545 
        +
        16546  // 2. Adjust to whole block.
        +
        16547  const VkDeviceSize allocationOffset = hAllocation->GetOffset();
        +
        16548  VMA_ASSERT(allocationOffset % nonCoherentAtomSize == 0);
        +
        16549  const VkDeviceSize blockSize = hAllocation->GetBlock()->m_pMetadata->GetSize();
        +
        16550  memRange.offset += allocationOffset;
        +
        16551  memRange.size = VMA_MIN(memRange.size, blockSize - memRange.offset);
        +
        16552 
        +
        16553  break;
        +
        16554  }
        +
        16555 
        +
        16556  default:
        +
        16557  VMA_ASSERT(0);
        +
        16558  }
        +
        16559 
        +
        16560  switch(op)
        +
        16561  {
        +
        16562  case VMA_CACHE_FLUSH:
        +
        16563  (*GetVulkanFunctions().vkFlushMappedMemoryRanges)(m_hDevice, 1, &memRange);
        +
        16564  break;
        +
        16565  case VMA_CACHE_INVALIDATE:
        +
        16566  (*GetVulkanFunctions().vkInvalidateMappedMemoryRanges)(m_hDevice, 1, &memRange);
        +
        16567  break;
        +
        16568  default:
        +
        16569  VMA_ASSERT(0);
        +
        16570  }
        +
        16571  }
        +
        16572  // else: Just ignore this call.
        +
        16573 }
        +
        16574 
        +
        16575 void VmaAllocator_T::FreeDedicatedMemory(const VmaAllocation allocation)
        +
        16576 {
        +
        16577  VMA_ASSERT(allocation && allocation->GetType() == VmaAllocation_T::ALLOCATION_TYPE_DEDICATED);
        +
        16578 
        +
        16579  const uint32_t memTypeIndex = allocation->GetMemoryTypeIndex();
        +
        16580  {
        +
        16581  VmaMutexLockWrite lock(m_DedicatedAllocationsMutex[memTypeIndex], m_UseMutex);
        +
        16582  AllocationVectorType* const pDedicatedAllocations = m_pDedicatedAllocations[memTypeIndex];
        +
        16583  VMA_ASSERT(pDedicatedAllocations);
        +
        16584  bool success = VmaVectorRemoveSorted<VmaPointerLess>(*pDedicatedAllocations, allocation);
        +
        16585  VMA_ASSERT(success);
        +
        16586  }
        16587 
        -
        16588 /*
        -
        16589 This function is not protected by any mutex because it just reads immutable data.
        -
        16590 */
        -
        16591 VMA_CALL_PRE VkResult VMA_CALL_POST vmaFindMemoryTypeIndex(
        -
        16592  VmaAllocator allocator,
        -
        16593  uint32_t memoryTypeBits,
        -
        16594  const VmaAllocationCreateInfo* pAllocationCreateInfo,
        -
        16595  uint32_t* pMemoryTypeIndex)
        -
        16596 {
        -
        16597  VMA_ASSERT(allocator != VK_NULL_HANDLE);
        -
        16598  VMA_ASSERT(pAllocationCreateInfo != VMA_NULL);
        -
        16599  VMA_ASSERT(pMemoryTypeIndex != VMA_NULL);
        -
        16600 
        -
        16601  if(pAllocationCreateInfo->memoryTypeBits != 0)
        -
        16602  {
        -
        16603  memoryTypeBits &= pAllocationCreateInfo->memoryTypeBits;
        -
        16604  }
        -
        16605 
        -
        16606  uint32_t requiredFlags = pAllocationCreateInfo->requiredFlags;
        -
        16607  uint32_t preferredFlags = pAllocationCreateInfo->preferredFlags;
        -
        16608  uint32_t notPreferredFlags = 0;
        +
        16588  VkDeviceMemory hMemory = allocation->GetMemory();
        +
        16589 
        +
        16590  /*
        +
        16591  There is no need to call this, because Vulkan spec allows to skip vkUnmapMemory
        +
        16592  before vkFreeMemory.
        +
        16593 
        +
        16594  if(allocation->GetMappedData() != VMA_NULL)
        +
        16595  {
        +
        16596  (*m_VulkanFunctions.vkUnmapMemory)(m_hDevice, hMemory);
        +
        16597  }
        +
        16598  */
        +
        16599 
        +
        16600  FreeVulkanMemory(memTypeIndex, allocation->GetSize(), hMemory);
        +
        16601 
        +
        16602  VMA_DEBUG_LOG(" Freed DedicatedMemory MemoryTypeIndex=%u", memTypeIndex);
        +
        16603 }
        +
        16604 
        +
        16605 uint32_t VmaAllocator_T::CalculateGpuDefragmentationMemoryTypeBits() const
        +
        16606 {
        +
        16607  VkBufferCreateInfo dummyBufCreateInfo;
        +
        16608  VmaFillGpuDefragmentationBufferCreateInfo(dummyBufCreateInfo);
        16609 
        -
        16610  // Convert usage to requiredFlags and preferredFlags.
        -
        16611  switch(pAllocationCreateInfo->usage)
        -
        16612  {
        -
        16613  case VMA_MEMORY_USAGE_UNKNOWN:
        -
        16614  break;
        -
        16615  case VMA_MEMORY_USAGE_GPU_ONLY:
        -
        16616  if(!allocator->IsIntegratedGpu() || (preferredFlags & VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT) == 0)
        -
        16617  {
        -
        16618  preferredFlags |= VK_MEMORY_PROPERTY_DEVICE_LOCAL_BIT;
        -
        16619  }
        -
        16620  break;
        -
        16621  case VMA_MEMORY_USAGE_CPU_ONLY:
        -
        16622  requiredFlags |= VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT | VK_MEMORY_PROPERTY_HOST_COHERENT_BIT;
        -
        16623  break;
        -
        16624  case VMA_MEMORY_USAGE_CPU_TO_GPU:
        -
        16625  requiredFlags |= VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT;
        -
        16626  if(!allocator->IsIntegratedGpu() || (preferredFlags & VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT) == 0)
        -
        16627  {
        -
        16628  preferredFlags |= VK_MEMORY_PROPERTY_DEVICE_LOCAL_BIT;
        -
        16629  }
        -
        16630  break;
        -
        16631  case VMA_MEMORY_USAGE_GPU_TO_CPU:
        -
        16632  requiredFlags |= VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT;
        -
        16633  preferredFlags |= VK_MEMORY_PROPERTY_HOST_CACHED_BIT;
        -
        16634  break;
        -
        16635  case VMA_MEMORY_USAGE_CPU_COPY:
        -
        16636  notPreferredFlags |= VK_MEMORY_PROPERTY_DEVICE_LOCAL_BIT;
        -
        16637  break;
        -
        16638  case VMA_MEMORY_USAGE_GPU_LAZILY_ALLOCATED:
        -
        16639  requiredFlags |= VK_MEMORY_PROPERTY_LAZILY_ALLOCATED_BIT;
        -
        16640  break;
        -
        16641  default:
        -
        16642  VMA_ASSERT(0);
        -
        16643  break;
        -
        16644  }
        -
        16645 
        -
        16646  *pMemoryTypeIndex = UINT32_MAX;
        -
        16647  uint32_t minCost = UINT32_MAX;
        -
        16648  for(uint32_t memTypeIndex = 0, memTypeBit = 1;
        -
        16649  memTypeIndex < allocator->GetMemoryTypeCount();
        -
        16650  ++memTypeIndex, memTypeBit <<= 1)
        -
        16651  {
        -
        16652  // This memory type is acceptable according to memoryTypeBits bitmask.
        -
        16653  if((memTypeBit & memoryTypeBits) != 0)
        -
        16654  {
        -
        16655  const VkMemoryPropertyFlags currFlags =
        -
        16656  allocator->m_MemProps.memoryTypes[memTypeIndex].propertyFlags;
        -
        16657  // This memory type contains requiredFlags.
        -
        16658  if((requiredFlags & ~currFlags) == 0)
        -
        16659  {
        -
        16660  // Calculate cost as number of bits from preferredFlags not present in this memory type.
        -
        16661  uint32_t currCost = VmaCountBitsSet(preferredFlags & ~currFlags) +
        -
        16662  VmaCountBitsSet(currFlags & notPreferredFlags);
        -
        16663  // Remember memory type with lowest cost.
        -
        16664  if(currCost < minCost)
        -
        16665  {
        -
        16666  *pMemoryTypeIndex = memTypeIndex;
        -
        16667  if(currCost == 0)
        -
        16668  {
        -
        16669  return VK_SUCCESS;
        -
        16670  }
        -
        16671  minCost = currCost;
        -
        16672  }
        -
        16673  }
        -
        16674  }
        +
        16610  uint32_t memoryTypeBits = 0;
        +
        16611 
        +
        16612  // Create buffer.
        +
        16613  VkBuffer buf = VK_NULL_HANDLE;
        +
        16614  VkResult res = (*GetVulkanFunctions().vkCreateBuffer)(
        +
        16615  m_hDevice, &dummyBufCreateInfo, GetAllocationCallbacks(), &buf);
        +
        16616  if(res == VK_SUCCESS)
        +
        16617  {
        +
        16618  // Query for supported memory types.
        +
        16619  VkMemoryRequirements memReq;
        +
        16620  (*GetVulkanFunctions().vkGetBufferMemoryRequirements)(m_hDevice, buf, &memReq);
        +
        16621  memoryTypeBits = memReq.memoryTypeBits;
        +
        16622 
        +
        16623  // Destroy buffer.
        +
        16624  (*GetVulkanFunctions().vkDestroyBuffer)(m_hDevice, buf, GetAllocationCallbacks());
        +
        16625  }
        +
        16626 
        +
        16627  return memoryTypeBits;
        +
        16628 }
        +
        16629 
        +
        16630 uint32_t VmaAllocator_T::CalculateGlobalMemoryTypeBits() const
        +
        16631 {
        +
        16632  // Make sure memory information is already fetched.
        +
        16633  VMA_ASSERT(GetMemoryTypeCount() > 0);
        +
        16634 
        +
        16635  uint32_t memoryTypeBits = UINT32_MAX;
        +
        16636 
        +
        16637  if(!m_UseAmdDeviceCoherentMemory)
        +
        16638  {
        +
        16639  // Exclude memory types that have VK_MEMORY_PROPERTY_DEVICE_COHERENT_BIT_AMD.
        +
        16640  for(uint32_t memTypeIndex = 0; memTypeIndex < GetMemoryTypeCount(); ++memTypeIndex)
        +
        16641  {
        +
        16642  if((m_MemProps.memoryTypes[memTypeIndex].propertyFlags & VK_MEMORY_PROPERTY_DEVICE_COHERENT_BIT_AMD_COPY) != 0)
        +
        16643  {
        +
        16644  memoryTypeBits &= ~(1u << memTypeIndex);
        +
        16645  }
        +
        16646  }
        +
        16647  }
        +
        16648 
        +
        16649  return memoryTypeBits;
        +
        16650 }
        +
        16651 
        +
        16652 #if VMA_MEMORY_BUDGET
        +
        16653 
        +
        16654 void VmaAllocator_T::UpdateVulkanBudget()
        +
        16655 {
        +
        16656  VMA_ASSERT(m_UseExtMemoryBudget);
        +
        16657 
        +
        16658  VkPhysicalDeviceMemoryProperties2KHR memProps = { VK_STRUCTURE_TYPE_PHYSICAL_DEVICE_MEMORY_PROPERTIES_2_KHR };
        +
        16659 
        +
        16660  VkPhysicalDeviceMemoryBudgetPropertiesEXT budgetProps = { VK_STRUCTURE_TYPE_PHYSICAL_DEVICE_MEMORY_BUDGET_PROPERTIES_EXT };
        +
        16661  memProps.pNext = &budgetProps;
        +
        16662 
        +
        16663  GetVulkanFunctions().vkGetPhysicalDeviceMemoryProperties2KHR(m_PhysicalDevice, &memProps);
        +
        16664 
        +
        16665  {
        +
        16666  VmaMutexLockWrite lockWrite(m_Budget.m_BudgetMutex, m_UseMutex);
        +
        16667 
        +
        16668  for(uint32_t heapIndex = 0; heapIndex < GetMemoryHeapCount(); ++heapIndex)
        +
        16669  {
        +
        16670  m_Budget.m_VulkanUsage[heapIndex] = budgetProps.heapUsage[heapIndex];
        +
        16671  m_Budget.m_VulkanBudget[heapIndex] = budgetProps.heapBudget[heapIndex];
        +
        16672  m_Budget.m_BlockBytesAtBudgetFetch[heapIndex] = m_Budget.m_BlockBytes[heapIndex].load();
        +
        16673  }
        +
        16674  m_Budget.m_OperationsSinceBudgetFetch = 0;
        16675  }
        -
        16676  return (*pMemoryTypeIndex != UINT32_MAX) ? VK_SUCCESS : VK_ERROR_FEATURE_NOT_PRESENT;
        -
        16677 }
        -
        16678 
        -
        16679 VMA_CALL_PRE VkResult VMA_CALL_POST vmaFindMemoryTypeIndexForBufferInfo(
        -
        16680  VmaAllocator allocator,
        -
        16681  const VkBufferCreateInfo* pBufferCreateInfo,
        -
        16682  const VmaAllocationCreateInfo* pAllocationCreateInfo,
        -
        16683  uint32_t* pMemoryTypeIndex)
        -
        16684 {
        -
        16685  VMA_ASSERT(allocator != VK_NULL_HANDLE);
        -
        16686  VMA_ASSERT(pBufferCreateInfo != VMA_NULL);
        -
        16687  VMA_ASSERT(pAllocationCreateInfo != VMA_NULL);
        -
        16688  VMA_ASSERT(pMemoryTypeIndex != VMA_NULL);
        -
        16689 
        -
        16690  const VkDevice hDev = allocator->m_hDevice;
        -
        16691  VkBuffer hBuffer = VK_NULL_HANDLE;
        -
        16692  VkResult res = allocator->GetVulkanFunctions().vkCreateBuffer(
        -
        16693  hDev, pBufferCreateInfo, allocator->GetAllocationCallbacks(), &hBuffer);
        -
        16694  if(res == VK_SUCCESS)
        -
        16695  {
        -
        16696  VkMemoryRequirements memReq = {};
        -
        16697  allocator->GetVulkanFunctions().vkGetBufferMemoryRequirements(
        -
        16698  hDev, hBuffer, &memReq);
        -
        16699 
        -
        16700  res = vmaFindMemoryTypeIndex(
        -
        16701  allocator,
        -
        16702  memReq.memoryTypeBits,
        -
        16703  pAllocationCreateInfo,
        -
        16704  pMemoryTypeIndex);
        -
        16705 
        -
        16706  allocator->GetVulkanFunctions().vkDestroyBuffer(
        -
        16707  hDev, hBuffer, allocator->GetAllocationCallbacks());
        +
        16676 }
        +
        16677 
        +
        16678 #endif // #if VMA_MEMORY_BUDGET
        +
        16679 
        +
        16680 void VmaAllocator_T::FillAllocation(const VmaAllocation hAllocation, uint8_t pattern)
        +
        16681 {
        +
        16682  if(VMA_DEBUG_INITIALIZE_ALLOCATIONS &&
        +
        16683  !hAllocation->CanBecomeLost() &&
        +
        16684  (m_MemProps.memoryTypes[hAllocation->GetMemoryTypeIndex()].propertyFlags & VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT) != 0)
        +
        16685  {
        +
        16686  void* pData = VMA_NULL;
        +
        16687  VkResult res = Map(hAllocation, &pData);
        +
        16688  if(res == VK_SUCCESS)
        +
        16689  {
        +
        16690  memset(pData, (int)pattern, (size_t)hAllocation->GetSize());
        +
        16691  FlushOrInvalidateAllocation(hAllocation, 0, VK_WHOLE_SIZE, VMA_CACHE_FLUSH);
        +
        16692  Unmap(hAllocation);
        +
        16693  }
        +
        16694  else
        +
        16695  {
        +
        16696  VMA_ASSERT(0 && "VMA_DEBUG_INITIALIZE_ALLOCATIONS is enabled, but couldn't map memory to fill allocation.");
        +
        16697  }
        +
        16698  }
        +
        16699 }
        +
        16700 
        +
        16701 uint32_t VmaAllocator_T::GetGpuDefragmentationMemoryTypeBits()
        +
        16702 {
        +
        16703  uint32_t memoryTypeBits = m_GpuDefragmentationMemoryTypeBits.load();
        +
        16704  if(memoryTypeBits == UINT32_MAX)
        +
        16705  {
        +
        16706  memoryTypeBits = CalculateGpuDefragmentationMemoryTypeBits();
        +
        16707  m_GpuDefragmentationMemoryTypeBits.store(memoryTypeBits);
        16708  }
        -
        16709  return res;
        +
        16709  return memoryTypeBits;
        16710 }
        16711 
        -
        16712 VMA_CALL_PRE VkResult VMA_CALL_POST vmaFindMemoryTypeIndexForImageInfo(
        -
        16713  VmaAllocator allocator,
        -
        16714  const VkImageCreateInfo* pImageCreateInfo,
        -
        16715  const VmaAllocationCreateInfo* pAllocationCreateInfo,
        -
        16716  uint32_t* pMemoryTypeIndex)
        -
        16717 {
        -
        16718  VMA_ASSERT(allocator != VK_NULL_HANDLE);
        -
        16719  VMA_ASSERT(pImageCreateInfo != VMA_NULL);
        -
        16720  VMA_ASSERT(pAllocationCreateInfo != VMA_NULL);
        -
        16721  VMA_ASSERT(pMemoryTypeIndex != VMA_NULL);
        -
        16722 
        -
        16723  const VkDevice hDev = allocator->m_hDevice;
        -
        16724  VkImage hImage = VK_NULL_HANDLE;
        -
        16725  VkResult res = allocator->GetVulkanFunctions().vkCreateImage(
        -
        16726  hDev, pImageCreateInfo, allocator->GetAllocationCallbacks(), &hImage);
        -
        16727  if(res == VK_SUCCESS)
        -
        16728  {
        -
        16729  VkMemoryRequirements memReq = {};
        -
        16730  allocator->GetVulkanFunctions().vkGetImageMemoryRequirements(
        -
        16731  hDev, hImage, &memReq);
        -
        16732 
        -
        16733  res = vmaFindMemoryTypeIndex(
        -
        16734  allocator,
        -
        16735  memReq.memoryTypeBits,
        -
        16736  pAllocationCreateInfo,
        -
        16737  pMemoryTypeIndex);
        -
        16738 
        -
        16739  allocator->GetVulkanFunctions().vkDestroyImage(
        -
        16740  hDev, hImage, allocator->GetAllocationCallbacks());
        -
        16741  }
        -
        16742  return res;
        -
        16743 }
        +
        16712 #if VMA_STATS_STRING_ENABLED
        +
        16713 
        +
        16714 void VmaAllocator_T::PrintDetailedMap(VmaJsonWriter& json)
        +
        16715 {
        +
        16716  bool dedicatedAllocationsStarted = false;
        +
        16717  for(uint32_t memTypeIndex = 0; memTypeIndex < GetMemoryTypeCount(); ++memTypeIndex)
        +
        16718  {
        +
        16719  VmaMutexLockRead dedicatedAllocationsLock(m_DedicatedAllocationsMutex[memTypeIndex], m_UseMutex);
        +
        16720  AllocationVectorType* const pDedicatedAllocVector = m_pDedicatedAllocations[memTypeIndex];
        +
        16721  VMA_ASSERT(pDedicatedAllocVector);
        +
        16722  if(pDedicatedAllocVector->empty() == false)
        +
        16723  {
        +
        16724  if(dedicatedAllocationsStarted == false)
        +
        16725  {
        +
        16726  dedicatedAllocationsStarted = true;
        +
        16727  json.WriteString("DedicatedAllocations");
        +
        16728  json.BeginObject();
        +
        16729  }
        +
        16730 
        +
        16731  json.BeginString("Type ");
        +
        16732  json.ContinueString(memTypeIndex);
        +
        16733  json.EndString();
        +
        16734 
        +
        16735  json.BeginArray();
        +
        16736 
        +
        16737  for(size_t i = 0; i < pDedicatedAllocVector->size(); ++i)
        +
        16738  {
        +
        16739  json.BeginObject(true);
        +
        16740  const VmaAllocation hAlloc = (*pDedicatedAllocVector)[i];
        +
        16741  hAlloc->PrintParameters(json);
        +
        16742  json.EndObject();
        +
        16743  }
        16744 
        -
        16745 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCreatePool(
        -
        16746  VmaAllocator allocator,
        -
        16747  const VmaPoolCreateInfo* pCreateInfo,
        -
        16748  VmaPool* pPool)
        -
        16749 {
        -
        16750  VMA_ASSERT(allocator && pCreateInfo && pPool);
        -
        16751 
        -
        16752  VMA_DEBUG_LOG("vmaCreatePool");
        -
        16753 
        -
        16754  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        16755 
        -
        16756  VkResult res = allocator->CreatePool(pCreateInfo, pPool);
        -
        16757 
        -
        16758 #if VMA_RECORDING_ENABLED
        -
        16759  if(allocator->GetRecorder() != VMA_NULL)
        -
        16760  {
        -
        16761  allocator->GetRecorder()->RecordCreatePool(allocator->GetCurrentFrameIndex(), *pCreateInfo, *pPool);
        -
        16762  }
        -
        16763 #endif
        -
        16764 
        -
        16765  return res;
        -
        16766 }
        -
        16767 
        -
        16768 VMA_CALL_PRE void VMA_CALL_POST vmaDestroyPool(
        -
        16769  VmaAllocator allocator,
        -
        16770  VmaPool pool)
        -
        16771 {
        -
        16772  VMA_ASSERT(allocator);
        -
        16773 
        -
        16774  if(pool == VK_NULL_HANDLE)
        -
        16775  {
        -
        16776  return;
        +
        16745  json.EndArray();
        +
        16746  }
        +
        16747  }
        +
        16748  if(dedicatedAllocationsStarted)
        +
        16749  {
        +
        16750  json.EndObject();
        +
        16751  }
        +
        16752 
        +
        16753  {
        +
        16754  bool allocationsStarted = false;
        +
        16755  for(uint32_t memTypeIndex = 0; memTypeIndex < GetMemoryTypeCount(); ++memTypeIndex)
        +
        16756  {
        +
        16757  if(m_pBlockVectors[memTypeIndex]->IsEmpty() == false)
        +
        16758  {
        +
        16759  if(allocationsStarted == false)
        +
        16760  {
        +
        16761  allocationsStarted = true;
        +
        16762  json.WriteString("DefaultPools");
        +
        16763  json.BeginObject();
        +
        16764  }
        +
        16765 
        +
        16766  json.BeginString("Type ");
        +
        16767  json.ContinueString(memTypeIndex);
        +
        16768  json.EndString();
        +
        16769 
        +
        16770  m_pBlockVectors[memTypeIndex]->PrintDetailedMap(json);
        +
        16771  }
        +
        16772  }
        +
        16773  if(allocationsStarted)
        +
        16774  {
        +
        16775  json.EndObject();
        +
        16776  }
        16777  }
        -
        16778 
        -
        16779  VMA_DEBUG_LOG("vmaDestroyPool");
        -
        16780 
        -
        16781  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        16782 
        -
        16783 #if VMA_RECORDING_ENABLED
        -
        16784  if(allocator->GetRecorder() != VMA_NULL)
        -
        16785  {
        -
        16786  allocator->GetRecorder()->RecordDestroyPool(allocator->GetCurrentFrameIndex(), pool);
        -
        16787  }
        -
        16788 #endif
        -
        16789 
        -
        16790  allocator->DestroyPool(pool);
        -
        16791 }
        +
        16778 
        +
        16779  // Custom pools
        +
        16780  {
        +
        16781  VmaMutexLockRead lock(m_PoolsMutex, m_UseMutex);
        +
        16782  const size_t poolCount = m_Pools.size();
        +
        16783  if(poolCount > 0)
        +
        16784  {
        +
        16785  json.WriteString("Pools");
        +
        16786  json.BeginObject();
        +
        16787  for(size_t poolIndex = 0; poolIndex < poolCount; ++poolIndex)
        +
        16788  {
        +
        16789  json.BeginString();
        +
        16790  json.ContinueString(m_Pools[poolIndex]->GetId());
        +
        16791  json.EndString();
        16792 
        -
        16793 VMA_CALL_PRE void VMA_CALL_POST vmaGetPoolStats(
        -
        16794  VmaAllocator allocator,
        -
        16795  VmaPool pool,
        -
        16796  VmaPoolStats* pPoolStats)
        -
        16797 {
        -
        16798  VMA_ASSERT(allocator && pool && pPoolStats);
        +
        16793  m_Pools[poolIndex]->m_BlockVector.PrintDetailedMap(json);
        +
        16794  }
        +
        16795  json.EndObject();
        +
        16796  }
        +
        16797  }
        +
        16798 }
        16799 
        -
        16800  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        16800 #endif // #if VMA_STATS_STRING_ENABLED
        16801 
        -
        16802  allocator->GetPoolStats(pool, pPoolStats);
        -
        16803 }
        +
        16803 // Public interface
        16804 
        -
        16805 VMA_CALL_PRE void VMA_CALL_POST vmaMakePoolAllocationsLost(
        -
        16806  VmaAllocator allocator,
        -
        16807  VmaPool pool,
        -
        16808  size_t* pLostAllocationCount)
        -
        16809 {
        -
        16810  VMA_ASSERT(allocator && pool);
        -
        16811 
        -
        16812  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        16813 
        -
        16814 #if VMA_RECORDING_ENABLED
        -
        16815  if(allocator->GetRecorder() != VMA_NULL)
        -
        16816  {
        -
        16817  allocator->GetRecorder()->RecordMakePoolAllocationsLost(allocator->GetCurrentFrameIndex(), pool);
        -
        16818  }
        -
        16819 #endif
        -
        16820 
        -
        16821  allocator->MakePoolAllocationsLost(pool, pLostAllocationCount);
        -
        16822 }
        -
        16823 
        -
        16824 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCheckPoolCorruption(VmaAllocator allocator, VmaPool pool)
        -
        16825 {
        -
        16826  VMA_ASSERT(allocator && pool);
        +
        16805 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCreateAllocator(
        +
        16806  const VmaAllocatorCreateInfo* pCreateInfo,
        +
        16807  VmaAllocator* pAllocator)
        +
        16808 {
        +
        16809  VMA_ASSERT(pCreateInfo && pAllocator);
        +
        16810  VMA_ASSERT(pCreateInfo->vulkanApiVersion == 0 ||
        +
        16811  (VK_VERSION_MAJOR(pCreateInfo->vulkanApiVersion) == 1 && VK_VERSION_MINOR(pCreateInfo->vulkanApiVersion) <= 1));
        +
        16812  VMA_DEBUG_LOG("vmaCreateAllocator");
        +
        16813  *pAllocator = vma_new(pCreateInfo->pAllocationCallbacks, VmaAllocator_T)(pCreateInfo);
        +
        16814  return (*pAllocator)->Init(pCreateInfo);
        +
        16815 }
        +
        16816 
        +
        16817 VMA_CALL_PRE void VMA_CALL_POST vmaDestroyAllocator(
        +
        16818  VmaAllocator allocator)
        +
        16819 {
        +
        16820  if(allocator != VK_NULL_HANDLE)
        +
        16821  {
        +
        16822  VMA_DEBUG_LOG("vmaDestroyAllocator");
        +
        16823  VkAllocationCallbacks allocationCallbacks = allocator->m_AllocationCallbacks;
        +
        16824  vma_delete(&allocationCallbacks, allocator);
        +
        16825  }
        +
        16826 }
        16827 
        -
        16828  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        16829 
        -
        16830  VMA_DEBUG_LOG("vmaCheckPoolCorruption");
        -
        16831 
        -
        16832  return allocator->CheckPoolCorruption(pool);
        -
        16833 }
        -
        16834 
        -
        16835 VMA_CALL_PRE void VMA_CALL_POST vmaGetPoolName(
        -
        16836  VmaAllocator allocator,
        -
        16837  VmaPool pool,
        -
        16838  const char** ppName)
        +
        16828 VMA_CALL_PRE void VMA_CALL_POST vmaGetPhysicalDeviceProperties(
        +
        16829  VmaAllocator allocator,
        +
        16830  const VkPhysicalDeviceProperties **ppPhysicalDeviceProperties)
        +
        16831 {
        +
        16832  VMA_ASSERT(allocator && ppPhysicalDeviceProperties);
        +
        16833  *ppPhysicalDeviceProperties = &allocator->m_PhysicalDeviceProperties;
        +
        16834 }
        +
        16835 
        +
        16836 VMA_CALL_PRE void VMA_CALL_POST vmaGetMemoryProperties(
        +
        16837  VmaAllocator allocator,
        +
        16838  const VkPhysicalDeviceMemoryProperties** ppPhysicalDeviceMemoryProperties)
        16839 {
        -
        16840  VMA_ASSERT(allocator && pool);
        -
        16841 
        -
        16842  VMA_DEBUG_LOG("vmaGetPoolName");
        +
        16840  VMA_ASSERT(allocator && ppPhysicalDeviceMemoryProperties);
        +
        16841  *ppPhysicalDeviceMemoryProperties = &allocator->m_MemProps;
        +
        16842 }
        16843 
        -
        16844  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        16845 
        -
        16846  *ppName = pool->GetName();
        -
        16847 }
        -
        16848 
        -
        16849 VMA_CALL_PRE void VMA_CALL_POST vmaSetPoolName(
        -
        16850  VmaAllocator allocator,
        -
        16851  VmaPool pool,
        -
        16852  const char* pName)
        -
        16853 {
        -
        16854  VMA_ASSERT(allocator && pool);
        -
        16855 
        -
        16856  VMA_DEBUG_LOG("vmaSetPoolName");
        -
        16857 
        -
        16858  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        16859 
        -
        16860  pool->SetName(pName);
        -
        16861 
        -
        16862 #if VMA_RECORDING_ENABLED
        -
        16863  if(allocator->GetRecorder() != VMA_NULL)
        -
        16864  {
        -
        16865  allocator->GetRecorder()->RecordSetPoolName(allocator->GetCurrentFrameIndex(), pool, pName);
        -
        16866  }
        -
        16867 #endif
        -
        16868 }
        -
        16869 
        -
        16870 VMA_CALL_PRE VkResult VMA_CALL_POST vmaAllocateMemory(
        -
        16871  VmaAllocator allocator,
        -
        16872  const VkMemoryRequirements* pVkMemoryRequirements,
        -
        16873  const VmaAllocationCreateInfo* pCreateInfo,
        -
        16874  VmaAllocation* pAllocation,
        -
        16875  VmaAllocationInfo* pAllocationInfo)
        -
        16876 {
        -
        16877  VMA_ASSERT(allocator && pVkMemoryRequirements && pCreateInfo && pAllocation);
        -
        16878 
        -
        16879  VMA_DEBUG_LOG("vmaAllocateMemory");
        -
        16880 
        -
        16881  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        16882 
        -
        16883  VkResult result = allocator->AllocateMemory(
        -
        16884  *pVkMemoryRequirements,
        -
        16885  false, // requiresDedicatedAllocation
        -
        16886  false, // prefersDedicatedAllocation
        -
        16887  VK_NULL_HANDLE, // dedicatedBuffer
        -
        16888  VK_NULL_HANDLE, // dedicatedImage
        -
        16889  *pCreateInfo,
        -
        16890  VMA_SUBALLOCATION_TYPE_UNKNOWN,
        -
        16891  1, // allocationCount
        -
        16892  pAllocation);
        +
        16844 VMA_CALL_PRE void VMA_CALL_POST vmaGetMemoryTypeProperties(
        +
        16845  VmaAllocator allocator,
        +
        16846  uint32_t memoryTypeIndex,
        +
        16847  VkMemoryPropertyFlags* pFlags)
        +
        16848 {
        +
        16849  VMA_ASSERT(allocator && pFlags);
        +
        16850  VMA_ASSERT(memoryTypeIndex < allocator->GetMemoryTypeCount());
        +
        16851  *pFlags = allocator->m_MemProps.memoryTypes[memoryTypeIndex].propertyFlags;
        +
        16852 }
        +
        16853 
        +
        16854 VMA_CALL_PRE void VMA_CALL_POST vmaSetCurrentFrameIndex(
        +
        16855  VmaAllocator allocator,
        +
        16856  uint32_t frameIndex)
        +
        16857 {
        +
        16858  VMA_ASSERT(allocator);
        +
        16859  VMA_ASSERT(frameIndex != VMA_FRAME_INDEX_LOST);
        +
        16860 
        +
        16861  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        16862 
        +
        16863  allocator->SetCurrentFrameIndex(frameIndex);
        +
        16864 }
        +
        16865 
        +
        16866 VMA_CALL_PRE void VMA_CALL_POST vmaCalculateStats(
        +
        16867  VmaAllocator allocator,
        +
        16868  VmaStats* pStats)
        +
        16869 {
        +
        16870  VMA_ASSERT(allocator && pStats);
        +
        16871  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        16872  allocator->CalculateStats(pStats);
        +
        16873 }
        +
        16874 
        +
        16875 VMA_CALL_PRE void VMA_CALL_POST vmaGetBudget(
        +
        16876  VmaAllocator allocator,
        +
        16877  VmaBudget* pBudget)
        +
        16878 {
        +
        16879  VMA_ASSERT(allocator && pBudget);
        +
        16880  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        16881  allocator->GetBudget(pBudget, 0, allocator->GetMemoryHeapCount());
        +
        16882 }
        +
        16883 
        +
        16884 #if VMA_STATS_STRING_ENABLED
        +
        16885 
        +
        16886 VMA_CALL_PRE void VMA_CALL_POST vmaBuildStatsString(
        +
        16887  VmaAllocator allocator,
        +
        16888  char** ppStatsString,
        +
        16889  VkBool32 detailedMap)
        +
        16890 {
        +
        16891  VMA_ASSERT(allocator && ppStatsString);
        +
        16892  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        16893 
        -
        16894 #if VMA_RECORDING_ENABLED
        -
        16895  if(allocator->GetRecorder() != VMA_NULL)
        -
        16896  {
        -
        16897  allocator->GetRecorder()->RecordAllocateMemory(
        -
        16898  allocator->GetCurrentFrameIndex(),
        -
        16899  *pVkMemoryRequirements,
        -
        16900  *pCreateInfo,
        -
        16901  *pAllocation);
        -
        16902  }
        -
        16903 #endif
        -
        16904 
        -
        16905  if(pAllocationInfo != VMA_NULL && result == VK_SUCCESS)
        -
        16906  {
        -
        16907  allocator->GetAllocationInfo(*pAllocation, pAllocationInfo);
        -
        16908  }
        -
        16909 
        -
        16910  return result;
        -
        16911 }
        -
        16912 
        -
        16913 VMA_CALL_PRE VkResult VMA_CALL_POST vmaAllocateMemoryPages(
        -
        16914  VmaAllocator allocator,
        -
        16915  const VkMemoryRequirements* pVkMemoryRequirements,
        -
        16916  const VmaAllocationCreateInfo* pCreateInfo,
        -
        16917  size_t allocationCount,
        -
        16918  VmaAllocation* pAllocations,
        -
        16919  VmaAllocationInfo* pAllocationInfo)
        -
        16920 {
        -
        16921  if(allocationCount == 0)
        -
        16922  {
        -
        16923  return VK_SUCCESS;
        -
        16924  }
        +
        16894  VmaStringBuilder sb(allocator);
        +
        16895  {
        +
        16896  VmaJsonWriter json(allocator->GetAllocationCallbacks(), sb);
        +
        16897  json.BeginObject();
        +
        16898 
        +
        16899  VmaBudget budget[VK_MAX_MEMORY_HEAPS];
        +
        16900  allocator->GetBudget(budget, 0, allocator->GetMemoryHeapCount());
        +
        16901 
        +
        16902  VmaStats stats;
        +
        16903  allocator->CalculateStats(&stats);
        +
        16904 
        +
        16905  json.WriteString("Total");
        +
        16906  VmaPrintStatInfo(json, stats.total);
        +
        16907 
        +
        16908  for(uint32_t heapIndex = 0; heapIndex < allocator->GetMemoryHeapCount(); ++heapIndex)
        +
        16909  {
        +
        16910  json.BeginString("Heap ");
        +
        16911  json.ContinueString(heapIndex);
        +
        16912  json.EndString();
        +
        16913  json.BeginObject();
        +
        16914 
        +
        16915  json.WriteString("Size");
        +
        16916  json.WriteNumber(allocator->m_MemProps.memoryHeaps[heapIndex].size);
        +
        16917 
        +
        16918  json.WriteString("Flags");
        +
        16919  json.BeginArray(true);
        +
        16920  if((allocator->m_MemProps.memoryHeaps[heapIndex].flags & VK_MEMORY_HEAP_DEVICE_LOCAL_BIT) != 0)
        +
        16921  {
        +
        16922  json.WriteString("DEVICE_LOCAL");
        +
        16923  }
        +
        16924  json.EndArray();
        16925 
        -
        16926  VMA_ASSERT(allocator && pVkMemoryRequirements && pCreateInfo && pAllocations);
        -
        16927 
        -
        16928  VMA_DEBUG_LOG("vmaAllocateMemoryPages");
        -
        16929 
        -
        16930  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        16931 
        -
        16932  VkResult result = allocator->AllocateMemory(
        -
        16933  *pVkMemoryRequirements,
        -
        16934  false, // requiresDedicatedAllocation
        -
        16935  false, // prefersDedicatedAllocation
        -
        16936  VK_NULL_HANDLE, // dedicatedBuffer
        -
        16937  VK_NULL_HANDLE, // dedicatedImage
        -
        16938  *pCreateInfo,
        -
        16939  VMA_SUBALLOCATION_TYPE_UNKNOWN,
        -
        16940  allocationCount,
        -
        16941  pAllocations);
        -
        16942 
        -
        16943 #if VMA_RECORDING_ENABLED
        -
        16944  if(allocator->GetRecorder() != VMA_NULL)
        -
        16945  {
        -
        16946  allocator->GetRecorder()->RecordAllocateMemoryPages(
        -
        16947  allocator->GetCurrentFrameIndex(),
        -
        16948  *pVkMemoryRequirements,
        -
        16949  *pCreateInfo,
        -
        16950  (uint64_t)allocationCount,
        -
        16951  pAllocations);
        -
        16952  }
        -
        16953 #endif
        -
        16954 
        -
        16955  if(pAllocationInfo != VMA_NULL && result == VK_SUCCESS)
        -
        16956  {
        -
        16957  for(size_t i = 0; i < allocationCount; ++i)
        -
        16958  {
        -
        16959  allocator->GetAllocationInfo(pAllocations[i], pAllocationInfo + i);
        -
        16960  }
        -
        16961  }
        -
        16962 
        -
        16963  return result;
        -
        16964 }
        -
        16965 
        -
        16966 VMA_CALL_PRE VkResult VMA_CALL_POST vmaAllocateMemoryForBuffer(
        -
        16967  VmaAllocator allocator,
        -
        16968  VkBuffer buffer,
        -
        16969  const VmaAllocationCreateInfo* pCreateInfo,
        -
        16970  VmaAllocation* pAllocation,
        -
        16971  VmaAllocationInfo* pAllocationInfo)
        -
        16972 {
        -
        16973  VMA_ASSERT(allocator && buffer != VK_NULL_HANDLE && pCreateInfo && pAllocation);
        -
        16974 
        -
        16975  VMA_DEBUG_LOG("vmaAllocateMemoryForBuffer");
        -
        16976 
        -
        16977  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        16978 
        -
        16979  VkMemoryRequirements vkMemReq = {};
        -
        16980  bool requiresDedicatedAllocation = false;
        -
        16981  bool prefersDedicatedAllocation = false;
        -
        16982  allocator->GetBufferMemoryRequirements(buffer, vkMemReq,
        -
        16983  requiresDedicatedAllocation,
        -
        16984  prefersDedicatedAllocation);
        -
        16985 
        -
        16986  VkResult result = allocator->AllocateMemory(
        -
        16987  vkMemReq,
        -
        16988  requiresDedicatedAllocation,
        -
        16989  prefersDedicatedAllocation,
        -
        16990  buffer, // dedicatedBuffer
        -
        16991  VK_NULL_HANDLE, // dedicatedImage
        -
        16992  *pCreateInfo,
        -
        16993  VMA_SUBALLOCATION_TYPE_BUFFER,
        -
        16994  1, // allocationCount
        -
        16995  pAllocation);
        -
        16996 
        -
        16997 #if VMA_RECORDING_ENABLED
        -
        16998  if(allocator->GetRecorder() != VMA_NULL)
        -
        16999  {
        -
        17000  allocator->GetRecorder()->RecordAllocateMemoryForBuffer(
        -
        17001  allocator->GetCurrentFrameIndex(),
        -
        17002  vkMemReq,
        -
        17003  requiresDedicatedAllocation,
        -
        17004  prefersDedicatedAllocation,
        -
        17005  *pCreateInfo,
        -
        17006  *pAllocation);
        -
        17007  }
        -
        17008 #endif
        +
        16926  json.WriteString("Budget");
        +
        16927  json.BeginObject();
        +
        16928  {
        +
        16929  json.WriteString("BlockBytes");
        +
        16930  json.WriteNumber(budget[heapIndex].blockBytes);
        +
        16931  json.WriteString("AllocationBytes");
        +
        16932  json.WriteNumber(budget[heapIndex].allocationBytes);
        +
        16933  json.WriteString("Usage");
        +
        16934  json.WriteNumber(budget[heapIndex].usage);
        +
        16935  json.WriteString("Budget");
        +
        16936  json.WriteNumber(budget[heapIndex].budget);
        +
        16937  }
        +
        16938  json.EndObject();
        +
        16939 
        +
        16940  if(stats.memoryHeap[heapIndex].blockCount > 0)
        +
        16941  {
        +
        16942  json.WriteString("Stats");
        +
        16943  VmaPrintStatInfo(json, stats.memoryHeap[heapIndex]);
        +
        16944  }
        +
        16945 
        +
        16946  for(uint32_t typeIndex = 0; typeIndex < allocator->GetMemoryTypeCount(); ++typeIndex)
        +
        16947  {
        +
        16948  if(allocator->MemoryTypeIndexToHeapIndex(typeIndex) == heapIndex)
        +
        16949  {
        +
        16950  json.BeginString("Type ");
        +
        16951  json.ContinueString(typeIndex);
        +
        16952  json.EndString();
        +
        16953 
        +
        16954  json.BeginObject();
        +
        16955 
        +
        16956  json.WriteString("Flags");
        +
        16957  json.BeginArray(true);
        +
        16958  VkMemoryPropertyFlags flags = allocator->m_MemProps.memoryTypes[typeIndex].propertyFlags;
        +
        16959  if((flags & VK_MEMORY_PROPERTY_DEVICE_LOCAL_BIT) != 0)
        +
        16960  {
        +
        16961  json.WriteString("DEVICE_LOCAL");
        +
        16962  }
        +
        16963  if((flags & VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT) != 0)
        +
        16964  {
        +
        16965  json.WriteString("HOST_VISIBLE");
        +
        16966  }
        +
        16967  if((flags & VK_MEMORY_PROPERTY_HOST_COHERENT_BIT) != 0)
        +
        16968  {
        +
        16969  json.WriteString("HOST_COHERENT");
        +
        16970  }
        +
        16971  if((flags & VK_MEMORY_PROPERTY_HOST_CACHED_BIT) != 0)
        +
        16972  {
        +
        16973  json.WriteString("HOST_CACHED");
        +
        16974  }
        +
        16975  if((flags & VK_MEMORY_PROPERTY_LAZILY_ALLOCATED_BIT) != 0)
        +
        16976  {
        +
        16977  json.WriteString("LAZILY_ALLOCATED");
        +
        16978  }
        +
        16979  if((flags & VK_MEMORY_PROPERTY_PROTECTED_BIT) != 0)
        +
        16980  {
        +
        16981  json.WriteString(" PROTECTED");
        +
        16982  }
        +
        16983  if((flags & VK_MEMORY_PROPERTY_DEVICE_COHERENT_BIT_AMD_COPY) != 0)
        +
        16984  {
        +
        16985  json.WriteString(" DEVICE_COHERENT");
        +
        16986  }
        +
        16987  if((flags & VK_MEMORY_PROPERTY_DEVICE_UNCACHED_BIT_AMD_COPY) != 0)
        +
        16988  {
        +
        16989  json.WriteString(" DEVICE_UNCACHED");
        +
        16990  }
        +
        16991  json.EndArray();
        +
        16992 
        +
        16993  if(stats.memoryType[typeIndex].blockCount > 0)
        +
        16994  {
        +
        16995  json.WriteString("Stats");
        +
        16996  VmaPrintStatInfo(json, stats.memoryType[typeIndex]);
        +
        16997  }
        +
        16998 
        +
        16999  json.EndObject();
        +
        17000  }
        +
        17001  }
        +
        17002 
        +
        17003  json.EndObject();
        +
        17004  }
        +
        17005  if(detailedMap == VK_TRUE)
        +
        17006  {
        +
        17007  allocator->PrintDetailedMap(json);
        +
        17008  }
        17009 
        -
        17010  if(pAllocationInfo && result == VK_SUCCESS)
        -
        17011  {
        -
        17012  allocator->GetAllocationInfo(*pAllocation, pAllocationInfo);
        -
        17013  }
        -
        17014 
        -
        17015  return result;
        -
        17016 }
        -
        17017 
        -
        17018 VMA_CALL_PRE VkResult VMA_CALL_POST vmaAllocateMemoryForImage(
        -
        17019  VmaAllocator allocator,
        -
        17020  VkImage image,
        -
        17021  const VmaAllocationCreateInfo* pCreateInfo,
        -
        17022  VmaAllocation* pAllocation,
        -
        17023  VmaAllocationInfo* pAllocationInfo)
        -
        17024 {
        -
        17025  VMA_ASSERT(allocator && image != VK_NULL_HANDLE && pCreateInfo && pAllocation);
        -
        17026 
        -
        17027  VMA_DEBUG_LOG("vmaAllocateMemoryForImage");
        -
        17028 
        -
        17029  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        17030 
        -
        17031  VkMemoryRequirements vkMemReq = {};
        -
        17032  bool requiresDedicatedAllocation = false;
        -
        17033  bool prefersDedicatedAllocation = false;
        -
        17034  allocator->GetImageMemoryRequirements(image, vkMemReq,
        -
        17035  requiresDedicatedAllocation, prefersDedicatedAllocation);
        +
        17010  json.EndObject();
        +
        17011  }
        +
        17012 
        +
        17013  const size_t len = sb.GetLength();
        +
        17014  char* const pChars = vma_new_array(allocator, char, len + 1);
        +
        17015  if(len > 0)
        +
        17016  {
        +
        17017  memcpy(pChars, sb.GetData(), len);
        +
        17018  }
        +
        17019  pChars[len] = '\0';
        +
        17020  *ppStatsString = pChars;
        +
        17021 }
        +
        17022 
        +
        17023 VMA_CALL_PRE void VMA_CALL_POST vmaFreeStatsString(
        +
        17024  VmaAllocator allocator,
        +
        17025  char* pStatsString)
        +
        17026 {
        +
        17027  if(pStatsString != VMA_NULL)
        +
        17028  {
        +
        17029  VMA_ASSERT(allocator);
        +
        17030  size_t len = strlen(pStatsString);
        +
        17031  vma_delete_array(allocator, pStatsString, len + 1);
        +
        17032  }
        +
        17033 }
        +
        17034 
        +
        17035 #endif // #if VMA_STATS_STRING_ENABLED
        17036 
        -
        17037  VkResult result = allocator->AllocateMemory(
        -
        17038  vkMemReq,
        -
        17039  requiresDedicatedAllocation,
        -
        17040  prefersDedicatedAllocation,
        -
        17041  VK_NULL_HANDLE, // dedicatedBuffer
        -
        17042  image, // dedicatedImage
        -
        17043  *pCreateInfo,
        -
        17044  VMA_SUBALLOCATION_TYPE_IMAGE_UNKNOWN,
        -
        17045  1, // allocationCount
        -
        17046  pAllocation);
        -
        17047 
        -
        17048 #if VMA_RECORDING_ENABLED
        -
        17049  if(allocator->GetRecorder() != VMA_NULL)
        -
        17050  {
        -
        17051  allocator->GetRecorder()->RecordAllocateMemoryForImage(
        -
        17052  allocator->GetCurrentFrameIndex(),
        -
        17053  vkMemReq,
        -
        17054  requiresDedicatedAllocation,
        -
        17055  prefersDedicatedAllocation,
        -
        17056  *pCreateInfo,
        -
        17057  *pAllocation);
        -
        17058  }
        -
        17059 #endif
        +
        17037 /*
        +
        17038 This function is not protected by any mutex because it just reads immutable data.
        +
        17039 */
        +
        17040 VMA_CALL_PRE VkResult VMA_CALL_POST vmaFindMemoryTypeIndex(
        +
        17041  VmaAllocator allocator,
        +
        17042  uint32_t memoryTypeBits,
        +
        17043  const VmaAllocationCreateInfo* pAllocationCreateInfo,
        +
        17044  uint32_t* pMemoryTypeIndex)
        +
        17045 {
        +
        17046  VMA_ASSERT(allocator != VK_NULL_HANDLE);
        +
        17047  VMA_ASSERT(pAllocationCreateInfo != VMA_NULL);
        +
        17048  VMA_ASSERT(pMemoryTypeIndex != VMA_NULL);
        +
        17049 
        +
        17050  memoryTypeBits &= allocator->GetGlobalMemoryTypeBits();
        +
        17051 
        +
        17052  if(pAllocationCreateInfo->memoryTypeBits != 0)
        +
        17053  {
        +
        17054  memoryTypeBits &= pAllocationCreateInfo->memoryTypeBits;
        +
        17055  }
        +
        17056 
        +
        17057  uint32_t requiredFlags = pAllocationCreateInfo->requiredFlags;
        +
        17058  uint32_t preferredFlags = pAllocationCreateInfo->preferredFlags;
        +
        17059  uint32_t notPreferredFlags = 0;
        17060 
        -
        17061  if(pAllocationInfo && result == VK_SUCCESS)
        -
        17062  {
        -
        17063  allocator->GetAllocationInfo(*pAllocation, pAllocationInfo);
        -
        17064  }
        -
        17065 
        -
        17066  return result;
        -
        17067 }
        -
        17068 
        -
        17069 VMA_CALL_PRE void VMA_CALL_POST vmaFreeMemory(
        -
        17070  VmaAllocator allocator,
        -
        17071  VmaAllocation allocation)
        -
        17072 {
        -
        17073  VMA_ASSERT(allocator);
        -
        17074 
        -
        17075  if(allocation == VK_NULL_HANDLE)
        -
        17076  {
        -
        17077  return;
        -
        17078  }
        -
        17079 
        -
        17080  VMA_DEBUG_LOG("vmaFreeMemory");
        -
        17081 
        -
        17082  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        17083 
        -
        17084 #if VMA_RECORDING_ENABLED
        -
        17085  if(allocator->GetRecorder() != VMA_NULL)
        -
        17086  {
        -
        17087  allocator->GetRecorder()->RecordFreeMemory(
        -
        17088  allocator->GetCurrentFrameIndex(),
        -
        17089  allocation);
        -
        17090  }
        -
        17091 #endif
        -
        17092 
        -
        17093  allocator->FreeMemory(
        -
        17094  1, // allocationCount
        -
        17095  &allocation);
        -
        17096 }
        -
        17097 
        -
        17098 VMA_CALL_PRE void VMA_CALL_POST vmaFreeMemoryPages(
        -
        17099  VmaAllocator allocator,
        -
        17100  size_t allocationCount,
        -
        17101  VmaAllocation* pAllocations)
        -
        17102 {
        -
        17103  if(allocationCount == 0)
        -
        17104  {
        -
        17105  return;
        -
        17106  }
        -
        17107 
        -
        17108  VMA_ASSERT(allocator);
        -
        17109 
        -
        17110  VMA_DEBUG_LOG("vmaFreeMemoryPages");
        -
        17111 
        -
        17112  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        17113 
        -
        17114 #if VMA_RECORDING_ENABLED
        -
        17115  if(allocator->GetRecorder() != VMA_NULL)
        -
        17116  {
        -
        17117  allocator->GetRecorder()->RecordFreeMemoryPages(
        -
        17118  allocator->GetCurrentFrameIndex(),
        -
        17119  (uint64_t)allocationCount,
        -
        17120  pAllocations);
        -
        17121  }
        -
        17122 #endif
        -
        17123 
        -
        17124  allocator->FreeMemory(allocationCount, pAllocations);
        -
        17125 }
        -
        17126 
        -
        17127 VMA_CALL_PRE VkResult VMA_CALL_POST vmaResizeAllocation(
        -
        17128  VmaAllocator allocator,
        -
        17129  VmaAllocation allocation,
        -
        17130  VkDeviceSize newSize)
        -
        17131 {
        -
        17132  VMA_ASSERT(allocator && allocation);
        -
        17133 
        -
        17134  VMA_DEBUG_LOG("vmaResizeAllocation");
        -
        17135 
        -
        17136  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        17137 
        -
        17138  return allocator->ResizeAllocation(allocation, newSize);
        -
        17139 }
        -
        17140 
        -
        17141 VMA_CALL_PRE void VMA_CALL_POST vmaGetAllocationInfo(
        -
        17142  VmaAllocator allocator,
        -
        17143  VmaAllocation allocation,
        -
        17144  VmaAllocationInfo* pAllocationInfo)
        -
        17145 {
        -
        17146  VMA_ASSERT(allocator && allocation && pAllocationInfo);
        +
        17061  // Convert usage to requiredFlags and preferredFlags.
        +
        17062  switch(pAllocationCreateInfo->usage)
        +
        17063  {
        +
        17064  case VMA_MEMORY_USAGE_UNKNOWN:
        +
        17065  break;
        +
        17066  case VMA_MEMORY_USAGE_GPU_ONLY:
        +
        17067  if(!allocator->IsIntegratedGpu() || (preferredFlags & VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT) == 0)
        +
        17068  {
        +
        17069  preferredFlags |= VK_MEMORY_PROPERTY_DEVICE_LOCAL_BIT;
        +
        17070  }
        +
        17071  break;
        +
        17072  case VMA_MEMORY_USAGE_CPU_ONLY:
        +
        17073  requiredFlags |= VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT | VK_MEMORY_PROPERTY_HOST_COHERENT_BIT;
        +
        17074  break;
        +
        17075  case VMA_MEMORY_USAGE_CPU_TO_GPU:
        +
        17076  requiredFlags |= VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT;
        +
        17077  if(!allocator->IsIntegratedGpu() || (preferredFlags & VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT) == 0)
        +
        17078  {
        +
        17079  preferredFlags |= VK_MEMORY_PROPERTY_DEVICE_LOCAL_BIT;
        +
        17080  }
        +
        17081  break;
        +
        17082  case VMA_MEMORY_USAGE_GPU_TO_CPU:
        +
        17083  requiredFlags |= VK_MEMORY_PROPERTY_HOST_VISIBLE_BIT;
        +
        17084  preferredFlags |= VK_MEMORY_PROPERTY_HOST_CACHED_BIT;
        +
        17085  break;
        +
        17086  case VMA_MEMORY_USAGE_CPU_COPY:
        +
        17087  notPreferredFlags |= VK_MEMORY_PROPERTY_DEVICE_LOCAL_BIT;
        +
        17088  break;
        +
        17089  case VMA_MEMORY_USAGE_GPU_LAZILY_ALLOCATED:
        +
        17090  requiredFlags |= VK_MEMORY_PROPERTY_LAZILY_ALLOCATED_BIT;
        +
        17091  break;
        +
        17092  default:
        +
        17093  VMA_ASSERT(0);
        +
        17094  break;
        +
        17095  }
        +
        17096 
        +
        17097  // Avoid DEVICE_COHERENT unless explicitly requested.
        +
        17098  if(((pAllocationCreateInfo->requiredFlags | pAllocationCreateInfo->preferredFlags) &
        +
        17099  (VK_MEMORY_PROPERTY_DEVICE_COHERENT_BIT_AMD_COPY | VK_MEMORY_PROPERTY_DEVICE_UNCACHED_BIT_AMD_COPY)) == 0)
        +
        17100  {
        +
        17101  notPreferredFlags |= VK_MEMORY_PROPERTY_DEVICE_COHERENT_BIT_AMD_COPY;
        +
        17102  }
        +
        17103 
        +
        17104  *pMemoryTypeIndex = UINT32_MAX;
        +
        17105  uint32_t minCost = UINT32_MAX;
        +
        17106  for(uint32_t memTypeIndex = 0, memTypeBit = 1;
        +
        17107  memTypeIndex < allocator->GetMemoryTypeCount();
        +
        17108  ++memTypeIndex, memTypeBit <<= 1)
        +
        17109  {
        +
        17110  // This memory type is acceptable according to memoryTypeBits bitmask.
        +
        17111  if((memTypeBit & memoryTypeBits) != 0)
        +
        17112  {
        +
        17113  const VkMemoryPropertyFlags currFlags =
        +
        17114  allocator->m_MemProps.memoryTypes[memTypeIndex].propertyFlags;
        +
        17115  // This memory type contains requiredFlags.
        +
        17116  if((requiredFlags & ~currFlags) == 0)
        +
        17117  {
        +
        17118  // Calculate cost as number of bits from preferredFlags not present in this memory type.
        +
        17119  uint32_t currCost = VmaCountBitsSet(preferredFlags & ~currFlags) +
        +
        17120  VmaCountBitsSet(currFlags & notPreferredFlags);
        +
        17121  // Remember memory type with lowest cost.
        +
        17122  if(currCost < minCost)
        +
        17123  {
        +
        17124  *pMemoryTypeIndex = memTypeIndex;
        +
        17125  if(currCost == 0)
        +
        17126  {
        +
        17127  return VK_SUCCESS;
        +
        17128  }
        +
        17129  minCost = currCost;
        +
        17130  }
        +
        17131  }
        +
        17132  }
        +
        17133  }
        +
        17134  return (*pMemoryTypeIndex != UINT32_MAX) ? VK_SUCCESS : VK_ERROR_FEATURE_NOT_PRESENT;
        +
        17135 }
        +
        17136 
        +
        17137 VMA_CALL_PRE VkResult VMA_CALL_POST vmaFindMemoryTypeIndexForBufferInfo(
        +
        17138  VmaAllocator allocator,
        +
        17139  const VkBufferCreateInfo* pBufferCreateInfo,
        +
        17140  const VmaAllocationCreateInfo* pAllocationCreateInfo,
        +
        17141  uint32_t* pMemoryTypeIndex)
        +
        17142 {
        +
        17143  VMA_ASSERT(allocator != VK_NULL_HANDLE);
        +
        17144  VMA_ASSERT(pBufferCreateInfo != VMA_NULL);
        +
        17145  VMA_ASSERT(pAllocationCreateInfo != VMA_NULL);
        +
        17146  VMA_ASSERT(pMemoryTypeIndex != VMA_NULL);
        17147 
        -
        17148  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        17149 
        -
        17150 #if VMA_RECORDING_ENABLED
        -
        17151  if(allocator->GetRecorder() != VMA_NULL)
        -
        17152  {
        -
        17153  allocator->GetRecorder()->RecordGetAllocationInfo(
        -
        17154  allocator->GetCurrentFrameIndex(),
        -
        17155  allocation);
        -
        17156  }
        -
        17157 #endif
        -
        17158 
        -
        17159  allocator->GetAllocationInfo(allocation, pAllocationInfo);
        -
        17160 }
        -
        17161 
        -
        17162 VMA_CALL_PRE VkBool32 VMA_CALL_POST vmaTouchAllocation(
        -
        17163  VmaAllocator allocator,
        -
        17164  VmaAllocation allocation)
        -
        17165 {
        -
        17166  VMA_ASSERT(allocator && allocation);
        -
        17167 
        -
        17168  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17148  const VkDevice hDev = allocator->m_hDevice;
        +
        17149  VkBuffer hBuffer = VK_NULL_HANDLE;
        +
        17150  VkResult res = allocator->GetVulkanFunctions().vkCreateBuffer(
        +
        17151  hDev, pBufferCreateInfo, allocator->GetAllocationCallbacks(), &hBuffer);
        +
        17152  if(res == VK_SUCCESS)
        +
        17153  {
        +
        17154  VkMemoryRequirements memReq = {};
        +
        17155  allocator->GetVulkanFunctions().vkGetBufferMemoryRequirements(
        +
        17156  hDev, hBuffer, &memReq);
        +
        17157 
        +
        17158  res = vmaFindMemoryTypeIndex(
        +
        17159  allocator,
        +
        17160  memReq.memoryTypeBits,
        +
        17161  pAllocationCreateInfo,
        +
        17162  pMemoryTypeIndex);
        +
        17163 
        +
        17164  allocator->GetVulkanFunctions().vkDestroyBuffer(
        +
        17165  hDev, hBuffer, allocator->GetAllocationCallbacks());
        +
        17166  }
        +
        17167  return res;
        +
        17168 }
        17169 
        -
        17170 #if VMA_RECORDING_ENABLED
        -
        17171  if(allocator->GetRecorder() != VMA_NULL)
        -
        17172  {
        -
        17173  allocator->GetRecorder()->RecordTouchAllocation(
        -
        17174  allocator->GetCurrentFrameIndex(),
        -
        17175  allocation);
        -
        17176  }
        -
        17177 #endif
        -
        17178 
        -
        17179  return allocator->TouchAllocation(allocation);
        -
        17180 }
        -
        17181 
        -
        17182 VMA_CALL_PRE void VMA_CALL_POST vmaSetAllocationUserData(
        -
        17183  VmaAllocator allocator,
        -
        17184  VmaAllocation allocation,
        -
        17185  void* pUserData)
        -
        17186 {
        -
        17187  VMA_ASSERT(allocator && allocation);
        -
        17188 
        -
        17189  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17170 VMA_CALL_PRE VkResult VMA_CALL_POST vmaFindMemoryTypeIndexForImageInfo(
        +
        17171  VmaAllocator allocator,
        +
        17172  const VkImageCreateInfo* pImageCreateInfo,
        +
        17173  const VmaAllocationCreateInfo* pAllocationCreateInfo,
        +
        17174  uint32_t* pMemoryTypeIndex)
        +
        17175 {
        +
        17176  VMA_ASSERT(allocator != VK_NULL_HANDLE);
        +
        17177  VMA_ASSERT(pImageCreateInfo != VMA_NULL);
        +
        17178  VMA_ASSERT(pAllocationCreateInfo != VMA_NULL);
        +
        17179  VMA_ASSERT(pMemoryTypeIndex != VMA_NULL);
        +
        17180 
        +
        17181  const VkDevice hDev = allocator->m_hDevice;
        +
        17182  VkImage hImage = VK_NULL_HANDLE;
        +
        17183  VkResult res = allocator->GetVulkanFunctions().vkCreateImage(
        +
        17184  hDev, pImageCreateInfo, allocator->GetAllocationCallbacks(), &hImage);
        +
        17185  if(res == VK_SUCCESS)
        +
        17186  {
        +
        17187  VkMemoryRequirements memReq = {};
        +
        17188  allocator->GetVulkanFunctions().vkGetImageMemoryRequirements(
        +
        17189  hDev, hImage, &memReq);
        17190 
        -
        17191  allocation->SetUserData(allocator, pUserData);
        -
        17192 
        -
        17193 #if VMA_RECORDING_ENABLED
        -
        17194  if(allocator->GetRecorder() != VMA_NULL)
        -
        17195  {
        -
        17196  allocator->GetRecorder()->RecordSetAllocationUserData(
        -
        17197  allocator->GetCurrentFrameIndex(),
        -
        17198  allocation,
        -
        17199  pUserData);
        -
        17200  }
        -
        17201 #endif
        -
        17202 }
        -
        17203 
        -
        17204 VMA_CALL_PRE void VMA_CALL_POST vmaCreateLostAllocation(
        -
        17205  VmaAllocator allocator,
        -
        17206  VmaAllocation* pAllocation)
        +
        17191  res = vmaFindMemoryTypeIndex(
        +
        17192  allocator,
        +
        17193  memReq.memoryTypeBits,
        +
        17194  pAllocationCreateInfo,
        +
        17195  pMemoryTypeIndex);
        +
        17196 
        +
        17197  allocator->GetVulkanFunctions().vkDestroyImage(
        +
        17198  hDev, hImage, allocator->GetAllocationCallbacks());
        +
        17199  }
        +
        17200  return res;
        +
        17201 }
        +
        17202 
        +
        17203 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCreatePool(
        +
        17204  VmaAllocator allocator,
        +
        17205  const VmaPoolCreateInfo* pCreateInfo,
        +
        17206  VmaPool* pPool)
        17207 {
        -
        17208  VMA_ASSERT(allocator && pAllocation);
        -
        17209 
        -
        17210  VMA_DEBUG_GLOBAL_MUTEX_LOCK;
        -
        17211 
        -
        17212  allocator->CreateLostAllocation(pAllocation);
        -
        17213 
        -
        17214 #if VMA_RECORDING_ENABLED
        -
        17215  if(allocator->GetRecorder() != VMA_NULL)
        -
        17216  {
        -
        17217  allocator->GetRecorder()->RecordCreateLostAllocation(
        -
        17218  allocator->GetCurrentFrameIndex(),
        -
        17219  *pAllocation);
        +
        17208  VMA_ASSERT(allocator && pCreateInfo && pPool);
        +
        17209 
        +
        17210  VMA_DEBUG_LOG("vmaCreatePool");
        +
        17211 
        +
        17212  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17213 
        +
        17214  VkResult res = allocator->CreatePool(pCreateInfo, pPool);
        +
        17215 
        +
        17216 #if VMA_RECORDING_ENABLED
        +
        17217  if(allocator->GetRecorder() != VMA_NULL)
        +
        17218  {
        +
        17219  allocator->GetRecorder()->RecordCreatePool(allocator->GetCurrentFrameIndex(), *pCreateInfo, *pPool);
        17220  }
        17221 #endif
        -
        17222 }
        -
        17223 
        -
        17224 VMA_CALL_PRE VkResult VMA_CALL_POST vmaMapMemory(
        -
        17225  VmaAllocator allocator,
        -
        17226  VmaAllocation allocation,
        -
        17227  void** ppData)
        -
        17228 {
        -
        17229  VMA_ASSERT(allocator && allocation && ppData);
        -
        17230 
        -
        17231  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        17232 
        -
        17233  VkResult res = allocator->Map(allocation, ppData);
        -
        17234 
        -
        17235 #if VMA_RECORDING_ENABLED
        -
        17236  if(allocator->GetRecorder() != VMA_NULL)
        -
        17237  {
        -
        17238  allocator->GetRecorder()->RecordMapMemory(
        -
        17239  allocator->GetCurrentFrameIndex(),
        -
        17240  allocation);
        -
        17241  }
        -
        17242 #endif
        -
        17243 
        -
        17244  return res;
        -
        17245 }
        -
        17246 
        -
        17247 VMA_CALL_PRE void VMA_CALL_POST vmaUnmapMemory(
        -
        17248  VmaAllocator allocator,
        -
        17249  VmaAllocation allocation)
        -
        17250 {
        -
        17251  VMA_ASSERT(allocator && allocation);
        -
        17252 
        -
        17253  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        17254 
        -
        17255 #if VMA_RECORDING_ENABLED
        -
        17256  if(allocator->GetRecorder() != VMA_NULL)
        -
        17257  {
        -
        17258  allocator->GetRecorder()->RecordUnmapMemory(
        -
        17259  allocator->GetCurrentFrameIndex(),
        -
        17260  allocation);
        -
        17261  }
        -
        17262 #endif
        -
        17263 
        -
        17264  allocator->Unmap(allocation);
        -
        17265 }
        -
        17266 
        -
        17267 VMA_CALL_PRE void VMA_CALL_POST vmaFlushAllocation(VmaAllocator allocator, VmaAllocation allocation, VkDeviceSize offset, VkDeviceSize size)
        -
        17268 {
        -
        17269  VMA_ASSERT(allocator && allocation);
        -
        17270 
        -
        17271  VMA_DEBUG_LOG("vmaFlushAllocation");
        -
        17272 
        -
        17273  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        17274 
        -
        17275  allocator->FlushOrInvalidateAllocation(allocation, offset, size, VMA_CACHE_FLUSH);
        -
        17276 
        -
        17277 #if VMA_RECORDING_ENABLED
        -
        17278  if(allocator->GetRecorder() != VMA_NULL)
        -
        17279  {
        -
        17280  allocator->GetRecorder()->RecordFlushAllocation(
        -
        17281  allocator->GetCurrentFrameIndex(),
        -
        17282  allocation, offset, size);
        -
        17283  }
        -
        17284 #endif
        -
        17285 }
        -
        17286 
        -
        17287 VMA_CALL_PRE void VMA_CALL_POST vmaInvalidateAllocation(VmaAllocator allocator, VmaAllocation allocation, VkDeviceSize offset, VkDeviceSize size)
        -
        17288 {
        -
        17289  VMA_ASSERT(allocator && allocation);
        -
        17290 
        -
        17291  VMA_DEBUG_LOG("vmaInvalidateAllocation");
        +
        17222 
        +
        17223  return res;
        +
        17224 }
        +
        17225 
        +
        17226 VMA_CALL_PRE void VMA_CALL_POST vmaDestroyPool(
        +
        17227  VmaAllocator allocator,
        +
        17228  VmaPool pool)
        +
        17229 {
        +
        17230  VMA_ASSERT(allocator);
        +
        17231 
        +
        17232  if(pool == VK_NULL_HANDLE)
        +
        17233  {
        +
        17234  return;
        +
        17235  }
        +
        17236 
        +
        17237  VMA_DEBUG_LOG("vmaDestroyPool");
        +
        17238 
        +
        17239  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17240 
        +
        17241 #if VMA_RECORDING_ENABLED
        +
        17242  if(allocator->GetRecorder() != VMA_NULL)
        +
        17243  {
        +
        17244  allocator->GetRecorder()->RecordDestroyPool(allocator->GetCurrentFrameIndex(), pool);
        +
        17245  }
        +
        17246 #endif
        +
        17247 
        +
        17248  allocator->DestroyPool(pool);
        +
        17249 }
        +
        17250 
        +
        17251 VMA_CALL_PRE void VMA_CALL_POST vmaGetPoolStats(
        +
        17252  VmaAllocator allocator,
        +
        17253  VmaPool pool,
        +
        17254  VmaPoolStats* pPoolStats)
        +
        17255 {
        +
        17256  VMA_ASSERT(allocator && pool && pPoolStats);
        +
        17257 
        +
        17258  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17259 
        +
        17260  allocator->GetPoolStats(pool, pPoolStats);
        +
        17261 }
        +
        17262 
        +
        17263 VMA_CALL_PRE void VMA_CALL_POST vmaMakePoolAllocationsLost(
        +
        17264  VmaAllocator allocator,
        +
        17265  VmaPool pool,
        +
        17266  size_t* pLostAllocationCount)
        +
        17267 {
        +
        17268  VMA_ASSERT(allocator && pool);
        +
        17269 
        +
        17270  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17271 
        +
        17272 #if VMA_RECORDING_ENABLED
        +
        17273  if(allocator->GetRecorder() != VMA_NULL)
        +
        17274  {
        +
        17275  allocator->GetRecorder()->RecordMakePoolAllocationsLost(allocator->GetCurrentFrameIndex(), pool);
        +
        17276  }
        +
        17277 #endif
        +
        17278 
        +
        17279  allocator->MakePoolAllocationsLost(pool, pLostAllocationCount);
        +
        17280 }
        +
        17281 
        +
        17282 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCheckPoolCorruption(VmaAllocator allocator, VmaPool pool)
        +
        17283 {
        +
        17284  VMA_ASSERT(allocator && pool);
        +
        17285 
        +
        17286  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17287 
        +
        17288  VMA_DEBUG_LOG("vmaCheckPoolCorruption");
        +
        17289 
        +
        17290  return allocator->CheckPoolCorruption(pool);
        +
        17291 }
        17292 
        -
        17293  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        17294 
        -
        17295  allocator->FlushOrInvalidateAllocation(allocation, offset, size, VMA_CACHE_INVALIDATE);
        -
        17296 
        -
        17297 #if VMA_RECORDING_ENABLED
        -
        17298  if(allocator->GetRecorder() != VMA_NULL)
        -
        17299  {
        -
        17300  allocator->GetRecorder()->RecordInvalidateAllocation(
        -
        17301  allocator->GetCurrentFrameIndex(),
        -
        17302  allocation, offset, size);
        -
        17303  }
        -
        17304 #endif
        +
        17293 VMA_CALL_PRE void VMA_CALL_POST vmaGetPoolName(
        +
        17294  VmaAllocator allocator,
        +
        17295  VmaPool pool,
        +
        17296  const char** ppName)
        +
        17297 {
        +
        17298  VMA_ASSERT(allocator && pool);
        +
        17299 
        +
        17300  VMA_DEBUG_LOG("vmaGetPoolName");
        +
        17301 
        +
        17302  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17303 
        +
        17304  *ppName = pool->GetName();
        17305 }
        17306 
        -
        17307 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCheckCorruption(VmaAllocator allocator, uint32_t memoryTypeBits)
        -
        17308 {
        -
        17309  VMA_ASSERT(allocator);
        -
        17310 
        -
        17311  VMA_DEBUG_LOG("vmaCheckCorruption");
        -
        17312 
        -
        17313  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        17314 
        -
        17315  return allocator->CheckCorruption(memoryTypeBits);
        -
        17316 }
        +
        17307 VMA_CALL_PRE void VMA_CALL_POST vmaSetPoolName(
        +
        17308  VmaAllocator allocator,
        +
        17309  VmaPool pool,
        +
        17310  const char* pName)
        +
        17311 {
        +
        17312  VMA_ASSERT(allocator && pool);
        +
        17313 
        +
        17314  VMA_DEBUG_LOG("vmaSetPoolName");
        +
        17315 
        +
        17316  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        17317 
        -
        17318 VMA_CALL_PRE VkResult VMA_CALL_POST vmaDefragment(
        -
        17319  VmaAllocator allocator,
        -
        17320  VmaAllocation* pAllocations,
        -
        17321  size_t allocationCount,
        -
        17322  VkBool32* pAllocationsChanged,
        -
        17323  const VmaDefragmentationInfo *pDefragmentationInfo,
        -
        17324  VmaDefragmentationStats* pDefragmentationStats)
        -
        17325 {
        -
        17326  // Deprecated interface, reimplemented using new one.
        +
        17318  pool->SetName(pName);
        +
        17319 
        +
        17320 #if VMA_RECORDING_ENABLED
        +
        17321  if(allocator->GetRecorder() != VMA_NULL)
        +
        17322  {
        +
        17323  allocator->GetRecorder()->RecordSetPoolName(allocator->GetCurrentFrameIndex(), pool, pName);
        +
        17324  }
        +
        17325 #endif
        +
        17326 }
        17327 
        -
        17328  VmaDefragmentationInfo2 info2 = {};
        -
        17329  info2.allocationCount = (uint32_t)allocationCount;
        -
        17330  info2.pAllocations = pAllocations;
        -
        17331  info2.pAllocationsChanged = pAllocationsChanged;
        -
        17332  if(pDefragmentationInfo != VMA_NULL)
        -
        17333  {
        -
        17334  info2.maxCpuAllocationsToMove = pDefragmentationInfo->maxAllocationsToMove;
        -
        17335  info2.maxCpuBytesToMove = pDefragmentationInfo->maxBytesToMove;
        -
        17336  }
        -
        17337  else
        -
        17338  {
        -
        17339  info2.maxCpuAllocationsToMove = UINT32_MAX;
        -
        17340  info2.maxCpuBytesToMove = VK_WHOLE_SIZE;
        -
        17341  }
        -
        17342  // info2.flags, maxGpuAllocationsToMove, maxGpuBytesToMove, commandBuffer deliberately left zero.
        -
        17343 
        -
        17344  VmaDefragmentationContext ctx;
        -
        17345  VkResult res = vmaDefragmentationBegin(allocator, &info2, pDefragmentationStats, &ctx);
        -
        17346  if(res == VK_NOT_READY)
        -
        17347  {
        -
        17348  res = vmaDefragmentationEnd( allocator, ctx);
        -
        17349  }
        -
        17350  return res;
        -
        17351 }
        -
        17352 
        -
        17353 VMA_CALL_PRE VkResult VMA_CALL_POST vmaDefragmentationBegin(
        -
        17354  VmaAllocator allocator,
        -
        17355  const VmaDefragmentationInfo2* pInfo,
        -
        17356  VmaDefragmentationStats* pStats,
        -
        17357  VmaDefragmentationContext *pContext)
        -
        17358 {
        -
        17359  VMA_ASSERT(allocator && pInfo && pContext);
        -
        17360 
        -
        17361  // Degenerate case: Nothing to defragment.
        -
        17362  if(pInfo->allocationCount == 0 && pInfo->poolCount == 0)
        -
        17363  {
        -
        17364  return VK_SUCCESS;
        -
        17365  }
        -
        17366 
        -
        17367  VMA_ASSERT(pInfo->allocationCount == 0 || pInfo->pAllocations != VMA_NULL);
        -
        17368  VMA_ASSERT(pInfo->poolCount == 0 || pInfo->pPools != VMA_NULL);
        -
        17369  VMA_HEAVY_ASSERT(VmaValidatePointerArray(pInfo->allocationCount, pInfo->pAllocations));
        -
        17370  VMA_HEAVY_ASSERT(VmaValidatePointerArray(pInfo->poolCount, pInfo->pPools));
        -
        17371 
        -
        17372  VMA_DEBUG_LOG("vmaDefragmentationBegin");
        -
        17373 
        -
        17374  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        17375 
        -
        17376  VkResult res = allocator->DefragmentationBegin(*pInfo, pStats, pContext);
        -
        17377 
        -
        17378 #if VMA_RECORDING_ENABLED
        -
        17379  if(allocator->GetRecorder() != VMA_NULL)
        +
        17328 VMA_CALL_PRE VkResult VMA_CALL_POST vmaAllocateMemory(
        +
        17329  VmaAllocator allocator,
        +
        17330  const VkMemoryRequirements* pVkMemoryRequirements,
        +
        17331  const VmaAllocationCreateInfo* pCreateInfo,
        +
        17332  VmaAllocation* pAllocation,
        +
        17333  VmaAllocationInfo* pAllocationInfo)
        +
        17334 {
        +
        17335  VMA_ASSERT(allocator && pVkMemoryRequirements && pCreateInfo && pAllocation);
        +
        17336 
        +
        17337  VMA_DEBUG_LOG("vmaAllocateMemory");
        +
        17338 
        +
        17339  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17340 
        +
        17341  VkResult result = allocator->AllocateMemory(
        +
        17342  *pVkMemoryRequirements,
        +
        17343  false, // requiresDedicatedAllocation
        +
        17344  false, // prefersDedicatedAllocation
        +
        17345  VK_NULL_HANDLE, // dedicatedBuffer
        +
        17346  VK_NULL_HANDLE, // dedicatedImage
        +
        17347  *pCreateInfo,
        +
        17348  VMA_SUBALLOCATION_TYPE_UNKNOWN,
        +
        17349  1, // allocationCount
        +
        17350  pAllocation);
        +
        17351 
        +
        17352 #if VMA_RECORDING_ENABLED
        +
        17353  if(allocator->GetRecorder() != VMA_NULL)
        +
        17354  {
        +
        17355  allocator->GetRecorder()->RecordAllocateMemory(
        +
        17356  allocator->GetCurrentFrameIndex(),
        +
        17357  *pVkMemoryRequirements,
        +
        17358  *pCreateInfo,
        +
        17359  *pAllocation);
        +
        17360  }
        +
        17361 #endif
        +
        17362 
        +
        17363  if(pAllocationInfo != VMA_NULL && result == VK_SUCCESS)
        +
        17364  {
        +
        17365  allocator->GetAllocationInfo(*pAllocation, pAllocationInfo);
        +
        17366  }
        +
        17367 
        +
        17368  return result;
        +
        17369 }
        +
        17370 
        +
        17371 VMA_CALL_PRE VkResult VMA_CALL_POST vmaAllocateMemoryPages(
        +
        17372  VmaAllocator allocator,
        +
        17373  const VkMemoryRequirements* pVkMemoryRequirements,
        +
        17374  const VmaAllocationCreateInfo* pCreateInfo,
        +
        17375  size_t allocationCount,
        +
        17376  VmaAllocation* pAllocations,
        +
        17377  VmaAllocationInfo* pAllocationInfo)
        +
        17378 {
        +
        17379  if(allocationCount == 0)
        17380  {
        -
        17381  allocator->GetRecorder()->RecordDefragmentationBegin(
        -
        17382  allocator->GetCurrentFrameIndex(), *pInfo, *pContext);
        -
        17383  }
        -
        17384 #endif
        +
        17381  return VK_SUCCESS;
        +
        17382  }
        +
        17383 
        +
        17384  VMA_ASSERT(allocator && pVkMemoryRequirements && pCreateInfo && pAllocations);
        17385 
        -
        17386  return res;
        -
        17387 }
        -
        17388 
        -
        17389 VMA_CALL_PRE VkResult VMA_CALL_POST vmaDefragmentationEnd(
        -
        17390  VmaAllocator allocator,
        -
        17391  VmaDefragmentationContext context)
        -
        17392 {
        -
        17393  VMA_ASSERT(allocator);
        -
        17394 
        -
        17395  VMA_DEBUG_LOG("vmaDefragmentationEnd");
        -
        17396 
        -
        17397  if(context != VK_NULL_HANDLE)
        -
        17398  {
        -
        17399  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17386  VMA_DEBUG_LOG("vmaAllocateMemoryPages");
        +
        17387 
        +
        17388  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17389 
        +
        17390  VkResult result = allocator->AllocateMemory(
        +
        17391  *pVkMemoryRequirements,
        +
        17392  false, // requiresDedicatedAllocation
        +
        17393  false, // prefersDedicatedAllocation
        +
        17394  VK_NULL_HANDLE, // dedicatedBuffer
        +
        17395  VK_NULL_HANDLE, // dedicatedImage
        +
        17396  *pCreateInfo,
        +
        17397  VMA_SUBALLOCATION_TYPE_UNKNOWN,
        +
        17398  allocationCount,
        +
        17399  pAllocations);
        17400 
        17401 #if VMA_RECORDING_ENABLED
        -
        17402  if(allocator->GetRecorder() != VMA_NULL)
        -
        17403  {
        -
        17404  allocator->GetRecorder()->RecordDefragmentationEnd(
        -
        17405  allocator->GetCurrentFrameIndex(), context);
        -
        17406  }
        -
        17407 #endif
        -
        17408 
        -
        17409  return allocator->DefragmentationEnd(context);
        +
        17402  if(allocator->GetRecorder() != VMA_NULL)
        +
        17403  {
        +
        17404  allocator->GetRecorder()->RecordAllocateMemoryPages(
        +
        17405  allocator->GetCurrentFrameIndex(),
        +
        17406  *pVkMemoryRequirements,
        +
        17407  *pCreateInfo,
        +
        17408  (uint64_t)allocationCount,
        +
        17409  pAllocations);
        17410  }
        -
        17411  else
        -
        17412  {
        -
        17413  return VK_SUCCESS;
        -
        17414  }
        -
        17415 }
        -
        17416 
        -
        17417 VMA_CALL_PRE VkResult VMA_CALL_POST vmaBindBufferMemory(
        -
        17418  VmaAllocator allocator,
        -
        17419  VmaAllocation allocation,
        -
        17420  VkBuffer buffer)
        -
        17421 {
        -
        17422  VMA_ASSERT(allocator && allocation && buffer);
        +
        17411 #endif
        +
        17412 
        +
        17413  if(pAllocationInfo != VMA_NULL && result == VK_SUCCESS)
        +
        17414  {
        +
        17415  for(size_t i = 0; i < allocationCount; ++i)
        +
        17416  {
        +
        17417  allocator->GetAllocationInfo(pAllocations[i], pAllocationInfo + i);
        +
        17418  }
        +
        17419  }
        +
        17420 
        +
        17421  return result;
        +
        17422 }
        17423 
        -
        17424  VMA_DEBUG_LOG("vmaBindBufferMemory");
        -
        17425 
        -
        17426  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        17427 
        -
        17428  return allocator->BindBufferMemory(allocation, 0, buffer, VMA_NULL);
        -
        17429 }
        -
        17430 
        -
        17431 VMA_CALL_PRE VkResult VMA_CALL_POST vmaBindBufferMemory2(
        -
        17432  VmaAllocator allocator,
        -
        17433  VmaAllocation allocation,
        -
        17434  VkDeviceSize allocationLocalOffset,
        -
        17435  VkBuffer buffer,
        -
        17436  const void* pNext)
        -
        17437 {
        -
        17438  VMA_ASSERT(allocator && allocation && buffer);
        -
        17439 
        -
        17440  VMA_DEBUG_LOG("vmaBindBufferMemory2");
        -
        17441 
        -
        17442  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17424 VMA_CALL_PRE VkResult VMA_CALL_POST vmaAllocateMemoryForBuffer(
        +
        17425  VmaAllocator allocator,
        +
        17426  VkBuffer buffer,
        +
        17427  const VmaAllocationCreateInfo* pCreateInfo,
        +
        17428  VmaAllocation* pAllocation,
        +
        17429  VmaAllocationInfo* pAllocationInfo)
        +
        17430 {
        +
        17431  VMA_ASSERT(allocator && buffer != VK_NULL_HANDLE && pCreateInfo && pAllocation);
        +
        17432 
        +
        17433  VMA_DEBUG_LOG("vmaAllocateMemoryForBuffer");
        +
        17434 
        +
        17435  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17436 
        +
        17437  VkMemoryRequirements vkMemReq = {};
        +
        17438  bool requiresDedicatedAllocation = false;
        +
        17439  bool prefersDedicatedAllocation = false;
        +
        17440  allocator->GetBufferMemoryRequirements(buffer, vkMemReq,
        +
        17441  requiresDedicatedAllocation,
        +
        17442  prefersDedicatedAllocation);
        17443 
        -
        17444  return allocator->BindBufferMemory(allocation, allocationLocalOffset, buffer, pNext);
        -
        17445 }
        -
        17446 
        -
        17447 VMA_CALL_PRE VkResult VMA_CALL_POST vmaBindImageMemory(
        -
        17448  VmaAllocator allocator,
        -
        17449  VmaAllocation allocation,
        -
        17450  VkImage image)
        -
        17451 {
        -
        17452  VMA_ASSERT(allocator && allocation && image);
        -
        17453 
        -
        17454  VMA_DEBUG_LOG("vmaBindImageMemory");
        -
        17455 
        -
        17456  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        17457 
        -
        17458  return allocator->BindImageMemory(allocation, 0, image, VMA_NULL);
        -
        17459 }
        -
        17460 
        -
        17461 VMA_CALL_PRE VkResult VMA_CALL_POST vmaBindImageMemory2(
        -
        17462  VmaAllocator allocator,
        -
        17463  VmaAllocation allocation,
        -
        17464  VkDeviceSize allocationLocalOffset,
        -
        17465  VkImage image,
        -
        17466  const void* pNext)
        -
        17467 {
        -
        17468  VMA_ASSERT(allocator && allocation && image);
        -
        17469 
        -
        17470  VMA_DEBUG_LOG("vmaBindImageMemory2");
        -
        17471 
        -
        17472  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        17473 
        -
        17474  return allocator->BindImageMemory(allocation, allocationLocalOffset, image, pNext);
        -
        17475 }
        -
        17476 
        -
        17477 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCreateBuffer(
        -
        17478  VmaAllocator allocator,
        -
        17479  const VkBufferCreateInfo* pBufferCreateInfo,
        -
        17480  const VmaAllocationCreateInfo* pAllocationCreateInfo,
        -
        17481  VkBuffer* pBuffer,
        -
        17482  VmaAllocation* pAllocation,
        -
        17483  VmaAllocationInfo* pAllocationInfo)
        -
        17484 {
        -
        17485  VMA_ASSERT(allocator && pBufferCreateInfo && pAllocationCreateInfo && pBuffer && pAllocation);
        +
        17444  VkResult result = allocator->AllocateMemory(
        +
        17445  vkMemReq,
        +
        17446  requiresDedicatedAllocation,
        +
        17447  prefersDedicatedAllocation,
        +
        17448  buffer, // dedicatedBuffer
        +
        17449  VK_NULL_HANDLE, // dedicatedImage
        +
        17450  *pCreateInfo,
        +
        17451  VMA_SUBALLOCATION_TYPE_BUFFER,
        +
        17452  1, // allocationCount
        +
        17453  pAllocation);
        +
        17454 
        +
        17455 #if VMA_RECORDING_ENABLED
        +
        17456  if(allocator->GetRecorder() != VMA_NULL)
        +
        17457  {
        +
        17458  allocator->GetRecorder()->RecordAllocateMemoryForBuffer(
        +
        17459  allocator->GetCurrentFrameIndex(),
        +
        17460  vkMemReq,
        +
        17461  requiresDedicatedAllocation,
        +
        17462  prefersDedicatedAllocation,
        +
        17463  *pCreateInfo,
        +
        17464  *pAllocation);
        +
        17465  }
        +
        17466 #endif
        +
        17467 
        +
        17468  if(pAllocationInfo && result == VK_SUCCESS)
        +
        17469  {
        +
        17470  allocator->GetAllocationInfo(*pAllocation, pAllocationInfo);
        +
        17471  }
        +
        17472 
        +
        17473  return result;
        +
        17474 }
        +
        17475 
        +
        17476 VMA_CALL_PRE VkResult VMA_CALL_POST vmaAllocateMemoryForImage(
        +
        17477  VmaAllocator allocator,
        +
        17478  VkImage image,
        +
        17479  const VmaAllocationCreateInfo* pCreateInfo,
        +
        17480  VmaAllocation* pAllocation,
        +
        17481  VmaAllocationInfo* pAllocationInfo)
        +
        17482 {
        +
        17483  VMA_ASSERT(allocator && image != VK_NULL_HANDLE && pCreateInfo && pAllocation);
        +
        17484 
        +
        17485  VMA_DEBUG_LOG("vmaAllocateMemoryForImage");
        17486 
        -
        17487  if(pBufferCreateInfo->size == 0)
        -
        17488  {
        -
        17489  return VK_ERROR_VALIDATION_FAILED_EXT;
        -
        17490  }
        -
        17491 
        -
        17492  VMA_DEBUG_LOG("vmaCreateBuffer");
        -
        17493 
        -
        17494  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        17495 
        -
        17496  *pBuffer = VK_NULL_HANDLE;
        -
        17497  *pAllocation = VK_NULL_HANDLE;
        -
        17498 
        -
        17499  // 1. Create VkBuffer.
        -
        17500  VkResult res = (*allocator->GetVulkanFunctions().vkCreateBuffer)(
        -
        17501  allocator->m_hDevice,
        -
        17502  pBufferCreateInfo,
        -
        17503  allocator->GetAllocationCallbacks(),
        -
        17504  pBuffer);
        -
        17505  if(res >= 0)
        -
        17506  {
        -
        17507  // 2. vkGetBufferMemoryRequirements.
        -
        17508  VkMemoryRequirements vkMemReq = {};
        -
        17509  bool requiresDedicatedAllocation = false;
        -
        17510  bool prefersDedicatedAllocation = false;
        -
        17511  allocator->GetBufferMemoryRequirements(*pBuffer, vkMemReq,
        -
        17512  requiresDedicatedAllocation, prefersDedicatedAllocation);
        -
        17513 
        -
        17514  // Make sure alignment requirements for specific buffer usages reported
        -
        17515  // in Physical Device Properties are included in alignment reported by memory requirements.
        -
        17516  if((pBufferCreateInfo->usage & VK_BUFFER_USAGE_UNIFORM_TEXEL_BUFFER_BIT) != 0)
        -
        17517  {
        -
        17518  VMA_ASSERT(vkMemReq.alignment %
        -
        17519  allocator->m_PhysicalDeviceProperties.limits.minTexelBufferOffsetAlignment == 0);
        -
        17520  }
        -
        17521  if((pBufferCreateInfo->usage & VK_BUFFER_USAGE_UNIFORM_BUFFER_BIT) != 0)
        -
        17522  {
        -
        17523  VMA_ASSERT(vkMemReq.alignment %
        -
        17524  allocator->m_PhysicalDeviceProperties.limits.minUniformBufferOffsetAlignment == 0);
        -
        17525  }
        -
        17526  if((pBufferCreateInfo->usage & VK_BUFFER_USAGE_STORAGE_BUFFER_BIT) != 0)
        -
        17527  {
        -
        17528  VMA_ASSERT(vkMemReq.alignment %
        -
        17529  allocator->m_PhysicalDeviceProperties.limits.minStorageBufferOffsetAlignment == 0);
        -
        17530  }
        -
        17531 
        -
        17532  // 3. Allocate memory using allocator.
        -
        17533  res = allocator->AllocateMemory(
        -
        17534  vkMemReq,
        -
        17535  requiresDedicatedAllocation,
        -
        17536  prefersDedicatedAllocation,
        -
        17537  *pBuffer, // dedicatedBuffer
        -
        17538  VK_NULL_HANDLE, // dedicatedImage
        -
        17539  *pAllocationCreateInfo,
        -
        17540  VMA_SUBALLOCATION_TYPE_BUFFER,
        -
        17541  1, // allocationCount
        -
        17542  pAllocation);
        -
        17543 
        -
        17544 #if VMA_RECORDING_ENABLED
        -
        17545  if(allocator->GetRecorder() != VMA_NULL)
        -
        17546  {
        -
        17547  allocator->GetRecorder()->RecordCreateBuffer(
        -
        17548  allocator->GetCurrentFrameIndex(),
        -
        17549  *pBufferCreateInfo,
        -
        17550  *pAllocationCreateInfo,
        -
        17551  *pAllocation);
        -
        17552  }
        -
        17553 #endif
        -
        17554 
        -
        17555  if(res >= 0)
        -
        17556  {
        -
        17557  // 3. Bind buffer with memory.
        -
        17558  if((pAllocationCreateInfo->flags & VMA_ALLOCATION_CREATE_DONT_BIND_BIT) == 0)
        -
        17559  {
        -
        17560  res = allocator->BindBufferMemory(*pAllocation, 0, *pBuffer, VMA_NULL);
        -
        17561  }
        -
        17562  if(res >= 0)
        -
        17563  {
        -
        17564  // All steps succeeded.
        -
        17565  #if VMA_STATS_STRING_ENABLED
        -
        17566  (*pAllocation)->InitBufferImageUsage(pBufferCreateInfo->usage);
        -
        17567  #endif
        -
        17568  if(pAllocationInfo != VMA_NULL)
        -
        17569  {
        -
        17570  allocator->GetAllocationInfo(*pAllocation, pAllocationInfo);
        -
        17571  }
        -
        17572 
        -
        17573  return VK_SUCCESS;
        -
        17574  }
        -
        17575  allocator->FreeMemory(
        -
        17576  1, // allocationCount
        -
        17577  pAllocation);
        -
        17578  *pAllocation = VK_NULL_HANDLE;
        -
        17579  (*allocator->GetVulkanFunctions().vkDestroyBuffer)(allocator->m_hDevice, *pBuffer, allocator->GetAllocationCallbacks());
        -
        17580  *pBuffer = VK_NULL_HANDLE;
        -
        17581  return res;
        -
        17582  }
        -
        17583  (*allocator->GetVulkanFunctions().vkDestroyBuffer)(allocator->m_hDevice, *pBuffer, allocator->GetAllocationCallbacks());
        -
        17584  *pBuffer = VK_NULL_HANDLE;
        -
        17585  return res;
        -
        17586  }
        -
        17587  return res;
        -
        17588 }
        -
        17589 
        -
        17590 VMA_CALL_PRE void VMA_CALL_POST vmaDestroyBuffer(
        -
        17591  VmaAllocator allocator,
        -
        17592  VkBuffer buffer,
        -
        17593  VmaAllocation allocation)
        -
        17594 {
        -
        17595  VMA_ASSERT(allocator);
        -
        17596 
        -
        17597  if(buffer == VK_NULL_HANDLE && allocation == VK_NULL_HANDLE)
        -
        17598  {
        -
        17599  return;
        -
        17600  }
        -
        17601 
        -
        17602  VMA_DEBUG_LOG("vmaDestroyBuffer");
        -
        17603 
        -
        17604  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17487  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17488 
        +
        17489  VkMemoryRequirements vkMemReq = {};
        +
        17490  bool requiresDedicatedAllocation = false;
        +
        17491  bool prefersDedicatedAllocation = false;
        +
        17492  allocator->GetImageMemoryRequirements(image, vkMemReq,
        +
        17493  requiresDedicatedAllocation, prefersDedicatedAllocation);
        +
        17494 
        +
        17495  VkResult result = allocator->AllocateMemory(
        +
        17496  vkMemReq,
        +
        17497  requiresDedicatedAllocation,
        +
        17498  prefersDedicatedAllocation,
        +
        17499  VK_NULL_HANDLE, // dedicatedBuffer
        +
        17500  image, // dedicatedImage
        +
        17501  *pCreateInfo,
        +
        17502  VMA_SUBALLOCATION_TYPE_IMAGE_UNKNOWN,
        +
        17503  1, // allocationCount
        +
        17504  pAllocation);
        +
        17505 
        +
        17506 #if VMA_RECORDING_ENABLED
        +
        17507  if(allocator->GetRecorder() != VMA_NULL)
        +
        17508  {
        +
        17509  allocator->GetRecorder()->RecordAllocateMemoryForImage(
        +
        17510  allocator->GetCurrentFrameIndex(),
        +
        17511  vkMemReq,
        +
        17512  requiresDedicatedAllocation,
        +
        17513  prefersDedicatedAllocation,
        +
        17514  *pCreateInfo,
        +
        17515  *pAllocation);
        +
        17516  }
        +
        17517 #endif
        +
        17518 
        +
        17519  if(pAllocationInfo && result == VK_SUCCESS)
        +
        17520  {
        +
        17521  allocator->GetAllocationInfo(*pAllocation, pAllocationInfo);
        +
        17522  }
        +
        17523 
        +
        17524  return result;
        +
        17525 }
        +
        17526 
        +
        17527 VMA_CALL_PRE void VMA_CALL_POST vmaFreeMemory(
        +
        17528  VmaAllocator allocator,
        +
        17529  VmaAllocation allocation)
        +
        17530 {
        +
        17531  VMA_ASSERT(allocator);
        +
        17532 
        +
        17533  if(allocation == VK_NULL_HANDLE)
        +
        17534  {
        +
        17535  return;
        +
        17536  }
        +
        17537 
        +
        17538  VMA_DEBUG_LOG("vmaFreeMemory");
        +
        17539 
        +
        17540  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17541 
        +
        17542 #if VMA_RECORDING_ENABLED
        +
        17543  if(allocator->GetRecorder() != VMA_NULL)
        +
        17544  {
        +
        17545  allocator->GetRecorder()->RecordFreeMemory(
        +
        17546  allocator->GetCurrentFrameIndex(),
        +
        17547  allocation);
        +
        17548  }
        +
        17549 #endif
        +
        17550 
        +
        17551  allocator->FreeMemory(
        +
        17552  1, // allocationCount
        +
        17553  &allocation);
        +
        17554 }
        +
        17555 
        +
        17556 VMA_CALL_PRE void VMA_CALL_POST vmaFreeMemoryPages(
        +
        17557  VmaAllocator allocator,
        +
        17558  size_t allocationCount,
        +
        17559  VmaAllocation* pAllocations)
        +
        17560 {
        +
        17561  if(allocationCount == 0)
        +
        17562  {
        +
        17563  return;
        +
        17564  }
        +
        17565 
        +
        17566  VMA_ASSERT(allocator);
        +
        17567 
        +
        17568  VMA_DEBUG_LOG("vmaFreeMemoryPages");
        +
        17569 
        +
        17570  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17571 
        +
        17572 #if VMA_RECORDING_ENABLED
        +
        17573  if(allocator->GetRecorder() != VMA_NULL)
        +
        17574  {
        +
        17575  allocator->GetRecorder()->RecordFreeMemoryPages(
        +
        17576  allocator->GetCurrentFrameIndex(),
        +
        17577  (uint64_t)allocationCount,
        +
        17578  pAllocations);
        +
        17579  }
        +
        17580 #endif
        +
        17581 
        +
        17582  allocator->FreeMemory(allocationCount, pAllocations);
        +
        17583 }
        +
        17584 
        +
        17585 VMA_CALL_PRE VkResult VMA_CALL_POST vmaResizeAllocation(
        +
        17586  VmaAllocator allocator,
        +
        17587  VmaAllocation allocation,
        +
        17588  VkDeviceSize newSize)
        +
        17589 {
        +
        17590  VMA_ASSERT(allocator && allocation);
        +
        17591 
        +
        17592  VMA_DEBUG_LOG("vmaResizeAllocation");
        +
        17593 
        +
        17594  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17595 
        +
        17596  return allocator->ResizeAllocation(allocation, newSize);
        +
        17597 }
        +
        17598 
        +
        17599 VMA_CALL_PRE void VMA_CALL_POST vmaGetAllocationInfo(
        +
        17600  VmaAllocator allocator,
        +
        17601  VmaAllocation allocation,
        +
        17602  VmaAllocationInfo* pAllocationInfo)
        +
        17603 {
        +
        17604  VMA_ASSERT(allocator && allocation && pAllocationInfo);
        17605 
        -
        17606 #if VMA_RECORDING_ENABLED
        -
        17607  if(allocator->GetRecorder() != VMA_NULL)
        -
        17608  {
        -
        17609  allocator->GetRecorder()->RecordDestroyBuffer(
        -
        17610  allocator->GetCurrentFrameIndex(),
        -
        17611  allocation);
        -
        17612  }
        -
        17613 #endif
        -
        17614 
        -
        17615  if(buffer != VK_NULL_HANDLE)
        -
        17616  {
        -
        17617  (*allocator->GetVulkanFunctions().vkDestroyBuffer)(allocator->m_hDevice, buffer, allocator->GetAllocationCallbacks());
        -
        17618  }
        +
        17606  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17607 
        +
        17608 #if VMA_RECORDING_ENABLED
        +
        17609  if(allocator->GetRecorder() != VMA_NULL)
        +
        17610  {
        +
        17611  allocator->GetRecorder()->RecordGetAllocationInfo(
        +
        17612  allocator->GetCurrentFrameIndex(),
        +
        17613  allocation);
        +
        17614  }
        +
        17615 #endif
        +
        17616 
        +
        17617  allocator->GetAllocationInfo(allocation, pAllocationInfo);
        +
        17618 }
        17619 
        -
        17620  if(allocation != VK_NULL_HANDLE)
        -
        17621  {
        -
        17622  allocator->FreeMemory(
        -
        17623  1, // allocationCount
        -
        17624  &allocation);
        -
        17625  }
        -
        17626 }
        +
        17620 VMA_CALL_PRE VkBool32 VMA_CALL_POST vmaTouchAllocation(
        +
        17621  VmaAllocator allocator,
        +
        17622  VmaAllocation allocation)
        +
        17623 {
        +
        17624  VMA_ASSERT(allocator && allocation);
        +
        17625 
        +
        17626  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        17627 
        -
        17628 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCreateImage(
        -
        17629  VmaAllocator allocator,
        -
        17630  const VkImageCreateInfo* pImageCreateInfo,
        -
        17631  const VmaAllocationCreateInfo* pAllocationCreateInfo,
        -
        17632  VkImage* pImage,
        -
        17633  VmaAllocation* pAllocation,
        -
        17634  VmaAllocationInfo* pAllocationInfo)
        -
        17635 {
        -
        17636  VMA_ASSERT(allocator && pImageCreateInfo && pAllocationCreateInfo && pImage && pAllocation);
        -
        17637 
        -
        17638  if(pImageCreateInfo->extent.width == 0 ||
        -
        17639  pImageCreateInfo->extent.height == 0 ||
        -
        17640  pImageCreateInfo->extent.depth == 0 ||
        -
        17641  pImageCreateInfo->mipLevels == 0 ||
        -
        17642  pImageCreateInfo->arrayLayers == 0)
        -
        17643  {
        -
        17644  return VK_ERROR_VALIDATION_FAILED_EXT;
        -
        17645  }
        +
        17628 #if VMA_RECORDING_ENABLED
        +
        17629  if(allocator->GetRecorder() != VMA_NULL)
        +
        17630  {
        +
        17631  allocator->GetRecorder()->RecordTouchAllocation(
        +
        17632  allocator->GetCurrentFrameIndex(),
        +
        17633  allocation);
        +
        17634  }
        +
        17635 #endif
        +
        17636 
        +
        17637  return allocator->TouchAllocation(allocation);
        +
        17638 }
        +
        17639 
        +
        17640 VMA_CALL_PRE void VMA_CALL_POST vmaSetAllocationUserData(
        +
        17641  VmaAllocator allocator,
        +
        17642  VmaAllocation allocation,
        +
        17643  void* pUserData)
        +
        17644 {
        +
        17645  VMA_ASSERT(allocator && allocation);
        17646 
        -
        17647  VMA_DEBUG_LOG("vmaCreateImage");
        +
        17647  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        17648 
        -
        17649  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17649  allocation->SetUserData(allocator, pUserData);
        17650 
        -
        17651  *pImage = VK_NULL_HANDLE;
        -
        17652  *pAllocation = VK_NULL_HANDLE;
        -
        17653 
        -
        17654  // 1. Create VkImage.
        -
        17655  VkResult res = (*allocator->GetVulkanFunctions().vkCreateImage)(
        -
        17656  allocator->m_hDevice,
        -
        17657  pImageCreateInfo,
        -
        17658  allocator->GetAllocationCallbacks(),
        -
        17659  pImage);
        -
        17660  if(res >= 0)
        -
        17661  {
        -
        17662  VmaSuballocationType suballocType = pImageCreateInfo->tiling == VK_IMAGE_TILING_OPTIMAL ?
        -
        17663  VMA_SUBALLOCATION_TYPE_IMAGE_OPTIMAL :
        -
        17664  VMA_SUBALLOCATION_TYPE_IMAGE_LINEAR;
        -
        17665 
        -
        17666  // 2. Allocate memory using allocator.
        -
        17667  VkMemoryRequirements vkMemReq = {};
        -
        17668  bool requiresDedicatedAllocation = false;
        -
        17669  bool prefersDedicatedAllocation = false;
        -
        17670  allocator->GetImageMemoryRequirements(*pImage, vkMemReq,
        -
        17671  requiresDedicatedAllocation, prefersDedicatedAllocation);
        -
        17672 
        -
        17673  res = allocator->AllocateMemory(
        -
        17674  vkMemReq,
        -
        17675  requiresDedicatedAllocation,
        -
        17676  prefersDedicatedAllocation,
        -
        17677  VK_NULL_HANDLE, // dedicatedBuffer
        -
        17678  *pImage, // dedicatedImage
        -
        17679  *pAllocationCreateInfo,
        -
        17680  suballocType,
        -
        17681  1, // allocationCount
        -
        17682  pAllocation);
        -
        17683 
        -
        17684 #if VMA_RECORDING_ENABLED
        -
        17685  if(allocator->GetRecorder() != VMA_NULL)
        -
        17686  {
        -
        17687  allocator->GetRecorder()->RecordCreateImage(
        -
        17688  allocator->GetCurrentFrameIndex(),
        -
        17689  *pImageCreateInfo,
        -
        17690  *pAllocationCreateInfo,
        -
        17691  *pAllocation);
        -
        17692  }
        -
        17693 #endif
        -
        17694 
        -
        17695  if(res >= 0)
        -
        17696  {
        -
        17697  // 3. Bind image with memory.
        -
        17698  if((pAllocationCreateInfo->flags & VMA_ALLOCATION_CREATE_DONT_BIND_BIT) == 0)
        -
        17699  {
        -
        17700  res = allocator->BindImageMemory(*pAllocation, 0, *pImage, VMA_NULL);
        -
        17701  }
        -
        17702  if(res >= 0)
        -
        17703  {
        -
        17704  // All steps succeeded.
        -
        17705  #if VMA_STATS_STRING_ENABLED
        -
        17706  (*pAllocation)->InitBufferImageUsage(pImageCreateInfo->usage);
        -
        17707  #endif
        -
        17708  if(pAllocationInfo != VMA_NULL)
        -
        17709  {
        -
        17710  allocator->GetAllocationInfo(*pAllocation, pAllocationInfo);
        -
        17711  }
        +
        17651 #if VMA_RECORDING_ENABLED
        +
        17652  if(allocator->GetRecorder() != VMA_NULL)
        +
        17653  {
        +
        17654  allocator->GetRecorder()->RecordSetAllocationUserData(
        +
        17655  allocator->GetCurrentFrameIndex(),
        +
        17656  allocation,
        +
        17657  pUserData);
        +
        17658  }
        +
        17659 #endif
        +
        17660 }
        +
        17661 
        +
        17662 VMA_CALL_PRE void VMA_CALL_POST vmaCreateLostAllocation(
        +
        17663  VmaAllocator allocator,
        +
        17664  VmaAllocation* pAllocation)
        +
        17665 {
        +
        17666  VMA_ASSERT(allocator && pAllocation);
        +
        17667 
        +
        17668  VMA_DEBUG_GLOBAL_MUTEX_LOCK;
        +
        17669 
        +
        17670  allocator->CreateLostAllocation(pAllocation);
        +
        17671 
        +
        17672 #if VMA_RECORDING_ENABLED
        +
        17673  if(allocator->GetRecorder() != VMA_NULL)
        +
        17674  {
        +
        17675  allocator->GetRecorder()->RecordCreateLostAllocation(
        +
        17676  allocator->GetCurrentFrameIndex(),
        +
        17677  *pAllocation);
        +
        17678  }
        +
        17679 #endif
        +
        17680 }
        +
        17681 
        +
        17682 VMA_CALL_PRE VkResult VMA_CALL_POST vmaMapMemory(
        +
        17683  VmaAllocator allocator,
        +
        17684  VmaAllocation allocation,
        +
        17685  void** ppData)
        +
        17686 {
        +
        17687  VMA_ASSERT(allocator && allocation && ppData);
        +
        17688 
        +
        17689  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17690 
        +
        17691  VkResult res = allocator->Map(allocation, ppData);
        +
        17692 
        +
        17693 #if VMA_RECORDING_ENABLED
        +
        17694  if(allocator->GetRecorder() != VMA_NULL)
        +
        17695  {
        +
        17696  allocator->GetRecorder()->RecordMapMemory(
        +
        17697  allocator->GetCurrentFrameIndex(),
        +
        17698  allocation);
        +
        17699  }
        +
        17700 #endif
        +
        17701 
        +
        17702  return res;
        +
        17703 }
        +
        17704 
        +
        17705 VMA_CALL_PRE void VMA_CALL_POST vmaUnmapMemory(
        +
        17706  VmaAllocator allocator,
        +
        17707  VmaAllocation allocation)
        +
        17708 {
        +
        17709  VMA_ASSERT(allocator && allocation);
        +
        17710 
        +
        17711  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        17712 
        -
        17713  return VK_SUCCESS;
        -
        17714  }
        -
        17715  allocator->FreeMemory(
        -
        17716  1, // allocationCount
        -
        17717  pAllocation);
        -
        17718  *pAllocation = VK_NULL_HANDLE;
        -
        17719  (*allocator->GetVulkanFunctions().vkDestroyImage)(allocator->m_hDevice, *pImage, allocator->GetAllocationCallbacks());
        -
        17720  *pImage = VK_NULL_HANDLE;
        -
        17721  return res;
        -
        17722  }
        -
        17723  (*allocator->GetVulkanFunctions().vkDestroyImage)(allocator->m_hDevice, *pImage, allocator->GetAllocationCallbacks());
        -
        17724  *pImage = VK_NULL_HANDLE;
        -
        17725  return res;
        -
        17726  }
        -
        17727  return res;
        -
        17728 }
        -
        17729 
        -
        17730 VMA_CALL_PRE void VMA_CALL_POST vmaDestroyImage(
        -
        17731  VmaAllocator allocator,
        -
        17732  VkImage image,
        -
        17733  VmaAllocation allocation)
        -
        17734 {
        -
        17735  VMA_ASSERT(allocator);
        -
        17736 
        -
        17737  if(image == VK_NULL_HANDLE && allocation == VK_NULL_HANDLE)
        -
        17738  {
        -
        17739  return;
        -
        17740  }
        -
        17741 
        -
        17742  VMA_DEBUG_LOG("vmaDestroyImage");
        -
        17743 
        -
        17744  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        -
        17745 
        -
        17746 #if VMA_RECORDING_ENABLED
        -
        17747  if(allocator->GetRecorder() != VMA_NULL)
        -
        17748  {
        -
        17749  allocator->GetRecorder()->RecordDestroyImage(
        -
        17750  allocator->GetCurrentFrameIndex(),
        -
        17751  allocation);
        -
        17752  }
        -
        17753 #endif
        +
        17713 #if VMA_RECORDING_ENABLED
        +
        17714  if(allocator->GetRecorder() != VMA_NULL)
        +
        17715  {
        +
        17716  allocator->GetRecorder()->RecordUnmapMemory(
        +
        17717  allocator->GetCurrentFrameIndex(),
        +
        17718  allocation);
        +
        17719  }
        +
        17720 #endif
        +
        17721 
        +
        17722  allocator->Unmap(allocation);
        +
        17723 }
        +
        17724 
        +
        17725 VMA_CALL_PRE void VMA_CALL_POST vmaFlushAllocation(VmaAllocator allocator, VmaAllocation allocation, VkDeviceSize offset, VkDeviceSize size)
        +
        17726 {
        +
        17727  VMA_ASSERT(allocator && allocation);
        +
        17728 
        +
        17729  VMA_DEBUG_LOG("vmaFlushAllocation");
        +
        17730 
        +
        17731  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17732 
        +
        17733  allocator->FlushOrInvalidateAllocation(allocation, offset, size, VMA_CACHE_FLUSH);
        +
        17734 
        +
        17735 #if VMA_RECORDING_ENABLED
        +
        17736  if(allocator->GetRecorder() != VMA_NULL)
        +
        17737  {
        +
        17738  allocator->GetRecorder()->RecordFlushAllocation(
        +
        17739  allocator->GetCurrentFrameIndex(),
        +
        17740  allocation, offset, size);
        +
        17741  }
        +
        17742 #endif
        +
        17743 }
        +
        17744 
        +
        17745 VMA_CALL_PRE void VMA_CALL_POST vmaInvalidateAllocation(VmaAllocator allocator, VmaAllocation allocation, VkDeviceSize offset, VkDeviceSize size)
        +
        17746 {
        +
        17747  VMA_ASSERT(allocator && allocation);
        +
        17748 
        +
        17749  VMA_DEBUG_LOG("vmaInvalidateAllocation");
        +
        17750 
        +
        17751  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17752 
        +
        17753  allocator->FlushOrInvalidateAllocation(allocation, offset, size, VMA_CACHE_INVALIDATE);
        17754 
        -
        17755  if(image != VK_NULL_HANDLE)
        -
        17756  {
        -
        17757  (*allocator->GetVulkanFunctions().vkDestroyImage)(allocator->m_hDevice, image, allocator->GetAllocationCallbacks());
        -
        17758  }
        -
        17759  if(allocation != VK_NULL_HANDLE)
        -
        17760  {
        -
        17761  allocator->FreeMemory(
        -
        17762  1, // allocationCount
        -
        17763  &allocation);
        -
        17764  }
        -
        17765 }
        -
        17766 
        -
        17767 #endif // #ifdef VMA_IMPLEMENTATION
        +
        17755 #if VMA_RECORDING_ENABLED
        +
        17756  if(allocator->GetRecorder() != VMA_NULL)
        +
        17757  {
        +
        17758  allocator->GetRecorder()->RecordInvalidateAllocation(
        +
        17759  allocator->GetCurrentFrameIndex(),
        +
        17760  allocation, offset, size);
        +
        17761  }
        +
        17762 #endif
        +
        17763 }
        +
        17764 
        +
        17765 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCheckCorruption(VmaAllocator allocator, uint32_t memoryTypeBits)
        +
        17766 {
        +
        17767  VMA_ASSERT(allocator);
        +
        17768 
        +
        17769  VMA_DEBUG_LOG("vmaCheckCorruption");
        +
        17770 
        +
        17771  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17772 
        +
        17773  return allocator->CheckCorruption(memoryTypeBits);
        +
        17774 }
        +
        17775 
        +
        17776 VMA_CALL_PRE VkResult VMA_CALL_POST vmaDefragment(
        +
        17777  VmaAllocator allocator,
        +
        17778  VmaAllocation* pAllocations,
        +
        17779  size_t allocationCount,
        +
        17780  VkBool32* pAllocationsChanged,
        +
        17781  const VmaDefragmentationInfo *pDefragmentationInfo,
        +
        17782  VmaDefragmentationStats* pDefragmentationStats)
        +
        17783 {
        +
        17784  // Deprecated interface, reimplemented using new one.
        +
        17785 
        +
        17786  VmaDefragmentationInfo2 info2 = {};
        +
        17787  info2.allocationCount = (uint32_t)allocationCount;
        +
        17788  info2.pAllocations = pAllocations;
        +
        17789  info2.pAllocationsChanged = pAllocationsChanged;
        +
        17790  if(pDefragmentationInfo != VMA_NULL)
        +
        17791  {
        +
        17792  info2.maxCpuAllocationsToMove = pDefragmentationInfo->maxAllocationsToMove;
        +
        17793  info2.maxCpuBytesToMove = pDefragmentationInfo->maxBytesToMove;
        +
        17794  }
        +
        17795  else
        +
        17796  {
        +
        17797  info2.maxCpuAllocationsToMove = UINT32_MAX;
        +
        17798  info2.maxCpuBytesToMove = VK_WHOLE_SIZE;
        +
        17799  }
        +
        17800  // info2.flags, maxGpuAllocationsToMove, maxGpuBytesToMove, commandBuffer deliberately left zero.
        +
        17801 
        +
        17802  VmaDefragmentationContext ctx;
        +
        17803  VkResult res = vmaDefragmentationBegin(allocator, &info2, pDefragmentationStats, &ctx);
        +
        17804  if(res == VK_NOT_READY)
        +
        17805  {
        +
        17806  res = vmaDefragmentationEnd( allocator, ctx);
        +
        17807  }
        +
        17808  return res;
        +
        17809 }
        +
        17810 
        +
        17811 VMA_CALL_PRE VkResult VMA_CALL_POST vmaDefragmentationBegin(
        +
        17812  VmaAllocator allocator,
        +
        17813  const VmaDefragmentationInfo2* pInfo,
        +
        17814  VmaDefragmentationStats* pStats,
        +
        17815  VmaDefragmentationContext *pContext)
        +
        17816 {
        +
        17817  VMA_ASSERT(allocator && pInfo && pContext);
        +
        17818 
        +
        17819  // Degenerate case: Nothing to defragment.
        +
        17820  if(pInfo->allocationCount == 0 && pInfo->poolCount == 0)
        +
        17821  {
        +
        17822  return VK_SUCCESS;
        +
        17823  }
        +
        17824 
        +
        17825  VMA_ASSERT(pInfo->allocationCount == 0 || pInfo->pAllocations != VMA_NULL);
        +
        17826  VMA_ASSERT(pInfo->poolCount == 0 || pInfo->pPools != VMA_NULL);
        +
        17827  VMA_HEAVY_ASSERT(VmaValidatePointerArray(pInfo->allocationCount, pInfo->pAllocations));
        +
        17828  VMA_HEAVY_ASSERT(VmaValidatePointerArray(pInfo->poolCount, pInfo->pPools));
        +
        17829 
        +
        17830  VMA_DEBUG_LOG("vmaDefragmentationBegin");
        +
        17831 
        +
        17832  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17833 
        +
        17834  VkResult res = allocator->DefragmentationBegin(*pInfo, pStats, pContext);
        +
        17835 
        +
        17836 #if VMA_RECORDING_ENABLED
        +
        17837  if(allocator->GetRecorder() != VMA_NULL)
        +
        17838  {
        +
        17839  allocator->GetRecorder()->RecordDefragmentationBegin(
        +
        17840  allocator->GetCurrentFrameIndex(), *pInfo, *pContext);
        +
        17841  }
        +
        17842 #endif
        +
        17843 
        +
        17844  return res;
        +
        17845 }
        +
        17846 
        +
        17847 VMA_CALL_PRE VkResult VMA_CALL_POST vmaDefragmentationEnd(
        +
        17848  VmaAllocator allocator,
        +
        17849  VmaDefragmentationContext context)
        +
        17850 {
        +
        17851  VMA_ASSERT(allocator);
        +
        17852 
        +
        17853  VMA_DEBUG_LOG("vmaDefragmentationEnd");
        +
        17854 
        +
        17855  if(context != VK_NULL_HANDLE)
        +
        17856  {
        +
        17857  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17858 
        +
        17859 #if VMA_RECORDING_ENABLED
        +
        17860  if(allocator->GetRecorder() != VMA_NULL)
        +
        17861  {
        +
        17862  allocator->GetRecorder()->RecordDefragmentationEnd(
        +
        17863  allocator->GetCurrentFrameIndex(), context);
        +
        17864  }
        +
        17865 #endif
        +
        17866 
        +
        17867  return allocator->DefragmentationEnd(context);
        +
        17868  }
        +
        17869  else
        +
        17870  {
        +
        17871  return VK_SUCCESS;
        +
        17872  }
        +
        17873 }
        +
        17874 
        +
        17875 VMA_CALL_PRE VkResult VMA_CALL_POST vmaBeginDefragmentationPass(
        +
        17876  VmaAllocator allocator,
        +
        17877  VmaDefragmentationContext context,
        +
        17878  VmaDefragmentationPassInfo* pInfo
        +
        17879  )
        +
        17880 {
        +
        17881  VMA_ASSERT(allocator);
        +
        17882  VMA_ASSERT(pInfo);
        +
        17883  VMA_HEAVY_ASSERT(VmaValidatePointerArray(pInfo->moveCount, pInfo->pMoves));
        +
        17884 
        +
        17885  VMA_DEBUG_LOG("vmaBeginDefragmentationPass");
        +
        17886 
        +
        17887  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17888 
        +
        17889  if(context == VK_NULL_HANDLE)
        +
        17890  {
        +
        17891  pInfo->moveCount = 0;
        +
        17892  return VK_SUCCESS;
        +
        17893  }
        +
        17894 
        +
        17895  return allocator->DefragmentationPassBegin(pInfo, context);
        +
        17896 }
        +
        17897 VMA_CALL_PRE VkResult VMA_CALL_POST vmaEndDefragmentationPass(
        +
        17898  VmaAllocator allocator,
        +
        17899  VmaDefragmentationContext context)
        +
        17900 {
        +
        17901  VMA_ASSERT(allocator);
        +
        17902 
        +
        17903  VMA_DEBUG_LOG("vmaEndDefragmentationPass");
        +
        17904  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17905 
        +
        17906  if(context == VK_NULL_HANDLE)
        +
        17907  return VK_SUCCESS;
        +
        17908 
        +
        17909  return allocator->DefragmentationPassEnd(context);
        +
        17910 }
        +
        17911 
        +
        17912 VMA_CALL_PRE VkResult VMA_CALL_POST vmaBindBufferMemory(
        +
        17913  VmaAllocator allocator,
        +
        17914  VmaAllocation allocation,
        +
        17915  VkBuffer buffer)
        +
        17916 {
        +
        17917  VMA_ASSERT(allocator && allocation && buffer);
        +
        17918 
        +
        17919  VMA_DEBUG_LOG("vmaBindBufferMemory");
        +
        17920 
        +
        17921  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17922 
        +
        17923  return allocator->BindBufferMemory(allocation, 0, buffer, VMA_NULL);
        +
        17924 }
        +
        17925 
        +
        17926 VMA_CALL_PRE VkResult VMA_CALL_POST vmaBindBufferMemory2(
        +
        17927  VmaAllocator allocator,
        +
        17928  VmaAllocation allocation,
        +
        17929  VkDeviceSize allocationLocalOffset,
        +
        17930  VkBuffer buffer,
        +
        17931  const void* pNext)
        +
        17932 {
        +
        17933  VMA_ASSERT(allocator && allocation && buffer);
        +
        17934 
        +
        17935  VMA_DEBUG_LOG("vmaBindBufferMemory2");
        +
        17936 
        +
        17937  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17938 
        +
        17939  return allocator->BindBufferMemory(allocation, allocationLocalOffset, buffer, pNext);
        +
        17940 }
        +
        17941 
        +
        17942 VMA_CALL_PRE VkResult VMA_CALL_POST vmaBindImageMemory(
        +
        17943  VmaAllocator allocator,
        +
        17944  VmaAllocation allocation,
        +
        17945  VkImage image)
        +
        17946 {
        +
        17947  VMA_ASSERT(allocator && allocation && image);
        +
        17948 
        +
        17949  VMA_DEBUG_LOG("vmaBindImageMemory");
        +
        17950 
        +
        17951  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17952 
        +
        17953  return allocator->BindImageMemory(allocation, 0, image, VMA_NULL);
        +
        17954 }
        +
        17955 
        +
        17956 VMA_CALL_PRE VkResult VMA_CALL_POST vmaBindImageMemory2(
        +
        17957  VmaAllocator allocator,
        +
        17958  VmaAllocation allocation,
        +
        17959  VkDeviceSize allocationLocalOffset,
        +
        17960  VkImage image,
        +
        17961  const void* pNext)
        +
        17962 {
        +
        17963  VMA_ASSERT(allocator && allocation && image);
        +
        17964 
        +
        17965  VMA_DEBUG_LOG("vmaBindImageMemory2");
        +
        17966 
        +
        17967  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17968 
        +
        17969  return allocator->BindImageMemory(allocation, allocationLocalOffset, image, pNext);
        +
        17970 }
        +
        17971 
        +
        17972 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCreateBuffer(
        +
        17973  VmaAllocator allocator,
        +
        17974  const VkBufferCreateInfo* pBufferCreateInfo,
        +
        17975  const VmaAllocationCreateInfo* pAllocationCreateInfo,
        +
        17976  VkBuffer* pBuffer,
        +
        17977  VmaAllocation* pAllocation,
        +
        17978  VmaAllocationInfo* pAllocationInfo)
        +
        17979 {
        +
        17980  VMA_ASSERT(allocator && pBufferCreateInfo && pAllocationCreateInfo && pBuffer && pAllocation);
        +
        17981 
        +
        17982  if(pBufferCreateInfo->size == 0)
        +
        17983  {
        +
        17984  return VK_ERROR_VALIDATION_FAILED_EXT;
        +
        17985  }
        +
        17986 
        +
        17987  VMA_DEBUG_LOG("vmaCreateBuffer");
        +
        17988 
        +
        17989  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        17990 
        +
        17991  *pBuffer = VK_NULL_HANDLE;
        +
        17992  *pAllocation = VK_NULL_HANDLE;
        +
        17993 
        +
        17994  // 1. Create VkBuffer.
        +
        17995  VkResult res = (*allocator->GetVulkanFunctions().vkCreateBuffer)(
        +
        17996  allocator->m_hDevice,
        +
        17997  pBufferCreateInfo,
        +
        17998  allocator->GetAllocationCallbacks(),
        +
        17999  pBuffer);
        +
        18000  if(res >= 0)
        +
        18001  {
        +
        18002  // 2. vkGetBufferMemoryRequirements.
        +
        18003  VkMemoryRequirements vkMemReq = {};
        +
        18004  bool requiresDedicatedAllocation = false;
        +
        18005  bool prefersDedicatedAllocation = false;
        +
        18006  allocator->GetBufferMemoryRequirements(*pBuffer, vkMemReq,
        +
        18007  requiresDedicatedAllocation, prefersDedicatedAllocation);
        +
        18008 
        +
        18009  // Make sure alignment requirements for specific buffer usages reported
        +
        18010  // in Physical Device Properties are included in alignment reported by memory requirements.
        +
        18011  if((pBufferCreateInfo->usage & VK_BUFFER_USAGE_UNIFORM_TEXEL_BUFFER_BIT) != 0)
        +
        18012  {
        +
        18013  VMA_ASSERT(vkMemReq.alignment %
        +
        18014  allocator->m_PhysicalDeviceProperties.limits.minTexelBufferOffsetAlignment == 0);
        +
        18015  }
        +
        18016  if((pBufferCreateInfo->usage & VK_BUFFER_USAGE_UNIFORM_BUFFER_BIT) != 0)
        +
        18017  {
        +
        18018  VMA_ASSERT(vkMemReq.alignment %
        +
        18019  allocator->m_PhysicalDeviceProperties.limits.minUniformBufferOffsetAlignment == 0);
        +
        18020  }
        +
        18021  if((pBufferCreateInfo->usage & VK_BUFFER_USAGE_STORAGE_BUFFER_BIT) != 0)
        +
        18022  {
        +
        18023  VMA_ASSERT(vkMemReq.alignment %
        +
        18024  allocator->m_PhysicalDeviceProperties.limits.minStorageBufferOffsetAlignment == 0);
        +
        18025  }
        +
        18026 
        +
        18027  // 3. Allocate memory using allocator.
        +
        18028  res = allocator->AllocateMemory(
        +
        18029  vkMemReq,
        +
        18030  requiresDedicatedAllocation,
        +
        18031  prefersDedicatedAllocation,
        +
        18032  *pBuffer, // dedicatedBuffer
        +
        18033  VK_NULL_HANDLE, // dedicatedImage
        +
        18034  *pAllocationCreateInfo,
        +
        18035  VMA_SUBALLOCATION_TYPE_BUFFER,
        +
        18036  1, // allocationCount
        +
        18037  pAllocation);
        +
        18038 
        +
        18039 #if VMA_RECORDING_ENABLED
        +
        18040  if(allocator->GetRecorder() != VMA_NULL)
        +
        18041  {
        +
        18042  allocator->GetRecorder()->RecordCreateBuffer(
        +
        18043  allocator->GetCurrentFrameIndex(),
        +
        18044  *pBufferCreateInfo,
        +
        18045  *pAllocationCreateInfo,
        +
        18046  *pAllocation);
        +
        18047  }
        +
        18048 #endif
        +
        18049 
        +
        18050  if(res >= 0)
        +
        18051  {
        +
        18052  // 3. Bind buffer with memory.
        +
        18053  if((pAllocationCreateInfo->flags & VMA_ALLOCATION_CREATE_DONT_BIND_BIT) == 0)
        +
        18054  {
        +
        18055  res = allocator->BindBufferMemory(*pAllocation, 0, *pBuffer, VMA_NULL);
        +
        18056  }
        +
        18057  if(res >= 0)
        +
        18058  {
        +
        18059  // All steps succeeded.
        +
        18060  #if VMA_STATS_STRING_ENABLED
        +
        18061  (*pAllocation)->InitBufferImageUsage(pBufferCreateInfo->usage);
        +
        18062  #endif
        +
        18063  if(pAllocationInfo != VMA_NULL)
        +
        18064  {
        +
        18065  allocator->GetAllocationInfo(*pAllocation, pAllocationInfo);
        +
        18066  }
        +
        18067 
        +
        18068  return VK_SUCCESS;
        +
        18069  }
        +
        18070  allocator->FreeMemory(
        +
        18071  1, // allocationCount
        +
        18072  pAllocation);
        +
        18073  *pAllocation = VK_NULL_HANDLE;
        +
        18074  (*allocator->GetVulkanFunctions().vkDestroyBuffer)(allocator->m_hDevice, *pBuffer, allocator->GetAllocationCallbacks());
        +
        18075  *pBuffer = VK_NULL_HANDLE;
        +
        18076  return res;
        +
        18077  }
        +
        18078  (*allocator->GetVulkanFunctions().vkDestroyBuffer)(allocator->m_hDevice, *pBuffer, allocator->GetAllocationCallbacks());
        +
        18079  *pBuffer = VK_NULL_HANDLE;
        +
        18080  return res;
        +
        18081  }
        +
        18082  return res;
        +
        18083 }
        +
        18084 
        +
        18085 VMA_CALL_PRE void VMA_CALL_POST vmaDestroyBuffer(
        +
        18086  VmaAllocator allocator,
        +
        18087  VkBuffer buffer,
        +
        18088  VmaAllocation allocation)
        +
        18089 {
        +
        18090  VMA_ASSERT(allocator);
        +
        18091 
        +
        18092  if(buffer == VK_NULL_HANDLE && allocation == VK_NULL_HANDLE)
        +
        18093  {
        +
        18094  return;
        +
        18095  }
        +
        18096 
        +
        18097  VMA_DEBUG_LOG("vmaDestroyBuffer");
        +
        18098 
        +
        18099  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        18100 
        +
        18101 #if VMA_RECORDING_ENABLED
        +
        18102  if(allocator->GetRecorder() != VMA_NULL)
        +
        18103  {
        +
        18104  allocator->GetRecorder()->RecordDestroyBuffer(
        +
        18105  allocator->GetCurrentFrameIndex(),
        +
        18106  allocation);
        +
        18107  }
        +
        18108 #endif
        +
        18109 
        +
        18110  if(buffer != VK_NULL_HANDLE)
        +
        18111  {
        +
        18112  (*allocator->GetVulkanFunctions().vkDestroyBuffer)(allocator->m_hDevice, buffer, allocator->GetAllocationCallbacks());
        +
        18113  }
        +
        18114 
        +
        18115  if(allocation != VK_NULL_HANDLE)
        +
        18116  {
        +
        18117  allocator->FreeMemory(
        +
        18118  1, // allocationCount
        +
        18119  &allocation);
        +
        18120  }
        +
        18121 }
        +
        18122 
        +
        18123 VMA_CALL_PRE VkResult VMA_CALL_POST vmaCreateImage(
        +
        18124  VmaAllocator allocator,
        +
        18125  const VkImageCreateInfo* pImageCreateInfo,
        +
        18126  const VmaAllocationCreateInfo* pAllocationCreateInfo,
        +
        18127  VkImage* pImage,
        +
        18128  VmaAllocation* pAllocation,
        +
        18129  VmaAllocationInfo* pAllocationInfo)
        +
        18130 {
        +
        18131  VMA_ASSERT(allocator && pImageCreateInfo && pAllocationCreateInfo && pImage && pAllocation);
        +
        18132 
        +
        18133  if(pImageCreateInfo->extent.width == 0 ||
        +
        18134  pImageCreateInfo->extent.height == 0 ||
        +
        18135  pImageCreateInfo->extent.depth == 0 ||
        +
        18136  pImageCreateInfo->mipLevels == 0 ||
        +
        18137  pImageCreateInfo->arrayLayers == 0)
        +
        18138  {
        +
        18139  return VK_ERROR_VALIDATION_FAILED_EXT;
        +
        18140  }
        +
        18141 
        +
        18142  VMA_DEBUG_LOG("vmaCreateImage");
        +
        18143 
        +
        18144  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        18145 
        +
        18146  *pImage = VK_NULL_HANDLE;
        +
        18147  *pAllocation = VK_NULL_HANDLE;
        +
        18148 
        +
        18149  // 1. Create VkImage.
        +
        18150  VkResult res = (*allocator->GetVulkanFunctions().vkCreateImage)(
        +
        18151  allocator->m_hDevice,
        +
        18152  pImageCreateInfo,
        +
        18153  allocator->GetAllocationCallbacks(),
        +
        18154  pImage);
        +
        18155  if(res >= 0)
        +
        18156  {
        +
        18157  VmaSuballocationType suballocType = pImageCreateInfo->tiling == VK_IMAGE_TILING_OPTIMAL ?
        +
        18158  VMA_SUBALLOCATION_TYPE_IMAGE_OPTIMAL :
        +
        18159  VMA_SUBALLOCATION_TYPE_IMAGE_LINEAR;
        +
        18160 
        +
        18161  // 2. Allocate memory using allocator.
        +
        18162  VkMemoryRequirements vkMemReq = {};
        +
        18163  bool requiresDedicatedAllocation = false;
        +
        18164  bool prefersDedicatedAllocation = false;
        +
        18165  allocator->GetImageMemoryRequirements(*pImage, vkMemReq,
        +
        18166  requiresDedicatedAllocation, prefersDedicatedAllocation);
        +
        18167 
        +
        18168  res = allocator->AllocateMemory(
        +
        18169  vkMemReq,
        +
        18170  requiresDedicatedAllocation,
        +
        18171  prefersDedicatedAllocation,
        +
        18172  VK_NULL_HANDLE, // dedicatedBuffer
        +
        18173  *pImage, // dedicatedImage
        +
        18174  *pAllocationCreateInfo,
        +
        18175  suballocType,
        +
        18176  1, // allocationCount
        +
        18177  pAllocation);
        +
        18178 
        +
        18179 #if VMA_RECORDING_ENABLED
        +
        18180  if(allocator->GetRecorder() != VMA_NULL)
        +
        18181  {
        +
        18182  allocator->GetRecorder()->RecordCreateImage(
        +
        18183  allocator->GetCurrentFrameIndex(),
        +
        18184  *pImageCreateInfo,
        +
        18185  *pAllocationCreateInfo,
        +
        18186  *pAllocation);
        +
        18187  }
        +
        18188 #endif
        +
        18189 
        +
        18190  if(res >= 0)
        +
        18191  {
        +
        18192  // 3. Bind image with memory.
        +
        18193  if((pAllocationCreateInfo->flags & VMA_ALLOCATION_CREATE_DONT_BIND_BIT) == 0)
        +
        18194  {
        +
        18195  res = allocator->BindImageMemory(*pAllocation, 0, *pImage, VMA_NULL);
        +
        18196  }
        +
        18197  if(res >= 0)
        +
        18198  {
        +
        18199  // All steps succeeded.
        +
        18200  #if VMA_STATS_STRING_ENABLED
        +
        18201  (*pAllocation)->InitBufferImageUsage(pImageCreateInfo->usage);
        +
        18202  #endif
        +
        18203  if(pAllocationInfo != VMA_NULL)
        +
        18204  {
        +
        18205  allocator->GetAllocationInfo(*pAllocation, pAllocationInfo);
        +
        18206  }
        +
        18207 
        +
        18208  return VK_SUCCESS;
        +
        18209  }
        +
        18210  allocator->FreeMemory(
        +
        18211  1, // allocationCount
        +
        18212  pAllocation);
        +
        18213  *pAllocation = VK_NULL_HANDLE;
        +
        18214  (*allocator->GetVulkanFunctions().vkDestroyImage)(allocator->m_hDevice, *pImage, allocator->GetAllocationCallbacks());
        +
        18215  *pImage = VK_NULL_HANDLE;
        +
        18216  return res;
        +
        18217  }
        +
        18218  (*allocator->GetVulkanFunctions().vkDestroyImage)(allocator->m_hDevice, *pImage, allocator->GetAllocationCallbacks());
        +
        18219  *pImage = VK_NULL_HANDLE;
        +
        18220  return res;
        +
        18221  }
        +
        18222  return res;
        +
        18223 }
        +
        18224 
        +
        18225 VMA_CALL_PRE void VMA_CALL_POST vmaDestroyImage(
        +
        18226  VmaAllocator allocator,
        +
        18227  VkImage image,
        +
        18228  VmaAllocation allocation)
        +
        18229 {
        +
        18230  VMA_ASSERT(allocator);
        +
        18231 
        +
        18232  if(image == VK_NULL_HANDLE && allocation == VK_NULL_HANDLE)
        +
        18233  {
        +
        18234  return;
        +
        18235  }
        +
        18236 
        +
        18237  VMA_DEBUG_LOG("vmaDestroyImage");
        +
        18238 
        +
        18239  VMA_DEBUG_GLOBAL_MUTEX_LOCK
        +
        18240 
        +
        18241 #if VMA_RECORDING_ENABLED
        +
        18242  if(allocator->GetRecorder() != VMA_NULL)
        +
        18243  {
        +
        18244  allocator->GetRecorder()->RecordDestroyImage(
        +
        18245  allocator->GetCurrentFrameIndex(),
        +
        18246  allocation);
        +
        18247  }
        +
        18248 #endif
        +
        18249 
        +
        18250  if(image != VK_NULL_HANDLE)
        +
        18251  {
        +
        18252  (*allocator->GetVulkanFunctions().vkDestroyImage)(allocator->m_hDevice, image, allocator->GetAllocationCallbacks());
        +
        18253  }
        +
        18254  if(allocation != VK_NULL_HANDLE)
        +
        18255  {
        +
        18256  allocator->FreeMemory(
        +
        18257  1, // allocationCount
        +
        18258  &allocation);
        +
        18259  }
        +
        18260 }
        +
        18261 
        +
        18262 #endif // #ifdef VMA_IMPLEMENTATION
        -
        VmaRecordSettings
        Parameters for recording calls to VMA functions. To be used in VmaAllocatorCreateInfo::pRecordSetting...
        Definition: vk_mem_alloc.h:1982
        -
        VmaVulkanFunctions::vkAllocateMemory
        PFN_vkAllocateMemory vkAllocateMemory
        Definition: vk_mem_alloc.h:1940
        -
        VmaDeviceMemoryCallbacks::pfnFree
        PFN_vmaFreeDeviceMemoryFunction pfnFree
        Optional, can be null.
        Definition: vk_mem_alloc.h:1866
        -
        VMA_RECORD_FLAG_BITS_MAX_ENUM
        Definition: vk_mem_alloc.h:1977
        -
        VmaVulkanFunctions::vkGetPhysicalDeviceProperties
        PFN_vkGetPhysicalDeviceProperties vkGetPhysicalDeviceProperties
        Definition: vk_mem_alloc.h:1938
        +
        VmaRecordSettings
        Parameters for recording calls to VMA functions. To be used in VmaAllocatorCreateInfo::pRecordSetting...
        Definition: vk_mem_alloc.h:2058
        +
        VmaVulkanFunctions::vkAllocateMemory
        PFN_vkAllocateMemory vkAllocateMemory
        Definition: vk_mem_alloc.h:2016
        +
        VmaDeviceMemoryCallbacks::pfnFree
        PFN_vmaFreeDeviceMemoryFunction pfnFree
        Optional, can be null.
        Definition: vk_mem_alloc.h:1924
        +
        VMA_RECORD_FLAG_BITS_MAX_ENUM
        Definition: vk_mem_alloc.h:2053
        +
        VmaVulkanFunctions::vkGetPhysicalDeviceProperties
        PFN_vkGetPhysicalDeviceProperties vkGetPhysicalDeviceProperties
        Definition: vk_mem_alloc.h:2014
        vmaFreeMemory
        void vmaFreeMemory(VmaAllocator allocator, VmaAllocation allocation)
        Frees memory previously allocated using vmaAllocateMemory(), vmaAllocateMemoryForBuffer(),...
        -
        PFN_vmaAllocateDeviceMemoryFunction
        void(VKAPI_PTR * PFN_vmaAllocateDeviceMemoryFunction)(VmaAllocator allocator, uint32_t memoryType, VkDeviceMemory memory, VkDeviceSize size)
        Callback function called after successful vkAllocateMemory.
        Definition: vk_mem_alloc.h:1843
        -
        VmaAllocatorCreateInfo::physicalDevice
        VkPhysicalDevice physicalDevice
        Vulkan physical device.
        Definition: vk_mem_alloc.h:2003
        +
        PFN_vmaAllocateDeviceMemoryFunction
        void(VKAPI_PTR * PFN_vmaAllocateDeviceMemoryFunction)(VmaAllocator allocator, uint32_t memoryType, VkDeviceMemory memory, VkDeviceSize size)
        Callback function called after successful vkAllocateMemory.
        Definition: vk_mem_alloc.h:1901
        +
        VmaAllocatorCreateInfo::physicalDevice
        VkPhysicalDevice physicalDevice
        Vulkan physical device.
        Definition: vk_mem_alloc.h:2079
        VmaAllocationInfo
        struct VmaAllocationInfo VmaAllocationInfo
        Parameters of VmaAllocation objects, that can be retrieved using function vmaGetAllocationInfo().
        -
        VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT
        Enables alternative, linear allocation algorithm in this pool.
        Definition: vk_mem_alloc.h:2579
        -
        VmaDefragmentationInfo2::allocationCount
        uint32_t allocationCount
        Number of allocations in pAllocations array.
        Definition: vk_mem_alloc.h:3128
        -
        VmaAllocatorCreateInfo::frameInUseCount
        uint32_t frameInUseCount
        Maximum number of additional frames that are in use at the same time as current frame.
        Definition: vk_mem_alloc.h:2029
        -
        VMA_ALLOCATOR_CREATE_EXT_MEMORY_BUDGET_BIT
        Definition: vk_mem_alloc.h:1927
        -
        VmaBudget
        Statistics of current memory usage and available budget, in bytes, for specific memory heap.
        Definition: vk_mem_alloc.h:2180
        +
        VMA_POOL_CREATE_LINEAR_ALGORITHM_BIT
        Enables alternative, linear allocation algorithm in this pool.
        Definition: vk_mem_alloc.h:2655
        +
        VmaDefragmentationInfo2::allocationCount
        uint32_t allocationCount
        Number of allocations in pAllocations array.
        Definition: vk_mem_alloc.h:3206
        +
        VmaAllocatorCreateInfo::frameInUseCount
        uint32_t frameInUseCount
        Maximum number of additional frames that are in use at the same time as current frame.
        Definition: vk_mem_alloc.h:2105
        +
        VMA_ALLOCATOR_CREATE_EXT_MEMORY_BUDGET_BIT
        Definition: vk_mem_alloc.h:1985
        +
        VmaBudget
        Statistics of current memory usage and available budget, in bytes, for specific memory heap.
        Definition: vk_mem_alloc.h:2256
        +
        VmaDefragmentationPassMoveInfo::memory
        VkDeviceMemory memory
        Definition: vk_mem_alloc.h:3274
        vmaInvalidateAllocation
        void vmaInvalidateAllocation(VmaAllocator allocator, VmaAllocation allocation, VkDeviceSize offset, VkDeviceSize size)
        Invalidates memory of given allocation.
        -
        VMA_MEMORY_USAGE_GPU_LAZILY_ALLOCATED
        Definition: vk_mem_alloc.h:2325
        +
        VMA_MEMORY_USAGE_GPU_LAZILY_ALLOCATED
        Definition: vk_mem_alloc.h:2401
        VmaAllocationCreateInfo
        struct VmaAllocationCreateInfo VmaAllocationCreateInfo
        -
        VmaPoolStats
        Describes parameter of existing VmaPool.
        Definition: vk_mem_alloc.h:2651
        -
        VMA_ALLOCATION_CREATE_STRATEGY_BEST_FIT_BIT
        Definition: vk_mem_alloc.h:2408
        -
        VMA_ALLOCATOR_CREATE_EXTERNALLY_SYNCHRONIZED_BIT
        Allocator and all objects created from it will not be synchronized internally, so you must guarantee ...
        Definition: vk_mem_alloc.h:1875
        -
        VmaPoolStats::unusedSize
        VkDeviceSize unusedSize
        Total number of bytes in the pool not used by any VmaAllocation.
        Definition: vk_mem_alloc.h:2657
        -
        VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT
        Definition: vk_mem_alloc.h:2388
        -
        VmaRecordFlagBits
        VmaRecordFlagBits
        Flags to be used in VmaRecordSettings::flags.
        Definition: vk_mem_alloc.h:1969
        +
        VmaPoolStats
        Describes parameter of existing VmaPool.
        Definition: vk_mem_alloc.h:2727
        +
        VMA_ALLOCATION_CREATE_STRATEGY_BEST_FIT_BIT
        Definition: vk_mem_alloc.h:2484
        +
        VMA_ALLOCATOR_CREATE_EXTERNALLY_SYNCHRONIZED_BIT
        Allocator and all objects created from it will not be synchronized internally, so you must guarantee ...
        Definition: vk_mem_alloc.h:1933
        +
        VmaPoolStats::unusedSize
        VkDeviceSize unusedSize
        Total number of bytes in the pool not used by any VmaAllocation.
        Definition: vk_mem_alloc.h:2733
        +
        VMA_ALLOCATION_CREATE_USER_DATA_COPY_STRING_BIT
        Definition: vk_mem_alloc.h:2464
        +
        VmaRecordFlagBits
        VmaRecordFlagBits
        Flags to be used in VmaRecordSettings::flags.
        Definition: vk_mem_alloc.h:2045
        vmaSetPoolName
        void vmaSetPoolName(VmaAllocator allocator, VmaPool pool, const char *pName)
        Sets name of a custom pool.
        VmaAllocatorCreateInfo
        struct VmaAllocatorCreateInfo VmaAllocatorCreateInfo
        Description of a Allocator to be created.
        -
        VmaDeviceMemoryCallbacks
        Set of callbacks that the library will call for vkAllocateMemory and vkFreeMemory.
        Definition: vk_mem_alloc.h:1862
        +
        VmaDeviceMemoryCallbacks
        Set of callbacks that the library will call for vkAllocateMemory and vkFreeMemory.
        Definition: vk_mem_alloc.h:1920
        vmaTouchAllocation
        VkBool32 vmaTouchAllocation(VmaAllocator allocator, VmaAllocation allocation)
        Returns VK_TRUE if allocation is not lost and atomically marks it as used in current frame.
        -
        VMA_ALLOCATION_CREATE_CAN_BECOME_LOST_BIT
        Definition: vk_mem_alloc.h:2375
        -
        VmaAllocatorCreateInfo::preferredLargeHeapBlockSize
        VkDeviceSize preferredLargeHeapBlockSize
        Preferred size of a single VkDeviceMemory block to be allocated from large heaps > 1 GiB....
        Definition: vk_mem_alloc.h:2009
        -
        VMA_RECORD_FLUSH_AFTER_CALL_BIT
        Enables flush after recording every function call.
        Definition: vk_mem_alloc.h:1975
        +
        VMA_ALLOCATION_CREATE_CAN_BECOME_LOST_BIT
        Definition: vk_mem_alloc.h:2451
        +
        VmaAllocatorCreateInfo::preferredLargeHeapBlockSize
        VkDeviceSize preferredLargeHeapBlockSize
        Preferred size of a single VkDeviceMemory block to be allocated from large heaps > 1 GiB....
        Definition: vk_mem_alloc.h:2085
        +
        VMA_RECORD_FLUSH_AFTER_CALL_BIT
        Enables flush after recording every function call.
        Definition: vk_mem_alloc.h:2051
        vmaResizeAllocation
        VkResult vmaResizeAllocation(VmaAllocator allocator, VmaAllocation allocation, VkDeviceSize newSize)
        Deprecated.
        -
        VmaVulkanFunctions::vkUnmapMemory
        PFN_vkUnmapMemory vkUnmapMemory
        Definition: vk_mem_alloc.h:1943
        -
        VmaAllocationInfo::deviceMemory
        VkDeviceMemory deviceMemory
        Handle to Vulkan memory object.
        Definition: vk_mem_alloc.h:2794
        -
        VmaStatInfo::unusedRangeCount
        uint32_t unusedRangeCount
        Number of free ranges of memory between allocations.
        Definition: vk_mem_alloc.h:2148
        -
        VmaAllocationCreateInfo::pUserData
        void * pUserData
        Custom general-purpose pointer that will be stored in VmaAllocation, can be read as VmaAllocationInfo...
        Definition: vk_mem_alloc.h:2482
        -
        VmaStatInfo::unusedRangeSizeMax
        VkDeviceSize unusedRangeSizeMax
        Definition: vk_mem_alloc.h:2154
        -
        VmaVulkanFunctions::vkMapMemory
        PFN_vkMapMemory vkMapMemory
        Definition: vk_mem_alloc.h:1942
        -
        VMA_RECORDING_ENABLED
        #define VMA_RECORDING_ENABLED
        Definition: vk_mem_alloc.h:1769
        -
        VMA_ALLOCATION_CREATE_STRATEGY_FIRST_FIT_BIT
        Definition: vk_mem_alloc.h:2419
        +
        VmaVulkanFunctions::vkUnmapMemory
        PFN_vkUnmapMemory vkUnmapMemory
        Definition: vk_mem_alloc.h:2019
        +
        VmaAllocationInfo::deviceMemory
        VkDeviceMemory deviceMemory
        Handle to Vulkan memory object.
        Definition: vk_mem_alloc.h:2870
        +
        VmaStatInfo::unusedRangeCount
        uint32_t unusedRangeCount
        Number of free ranges of memory between allocations.
        Definition: vk_mem_alloc.h:2224
        +
        VmaAllocationCreateInfo::pUserData
        void * pUserData
        Custom general-purpose pointer that will be stored in VmaAllocation, can be read as VmaAllocationInfo...
        Definition: vk_mem_alloc.h:2558
        +
        VmaStatInfo::unusedRangeSizeMax
        VkDeviceSize unusedRangeSizeMax
        Definition: vk_mem_alloc.h:2230
        +
        VmaVulkanFunctions::vkMapMemory
        PFN_vkMapMemory vkMapMemory
        Definition: vk_mem_alloc.h:2018
        +
        VMA_RECORDING_ENABLED
        #define VMA_RECORDING_ENABLED
        Definition: vk_mem_alloc.h:1827
        +
        VmaDefragmentationPassMoveInfo::offset
        VkDeviceSize offset
        Definition: vk_mem_alloc.h:3275
        +
        VmaDefragmentationPassInfo::pMoves
        VmaDefragmentationPassMoveInfo * pMoves
        Definition: vk_mem_alloc.h:3284
        +
        VMA_ALLOCATION_CREATE_STRATEGY_FIRST_FIT_BIT
        Definition: vk_mem_alloc.h:2495
        vmaUnmapMemory
        void vmaUnmapMemory(VmaAllocator allocator, VmaAllocation allocation)
        Unmaps memory represented by given allocation, mapped previously using vmaMapMemory().
        -
        VmaBudget::usage
        VkDeviceSize usage
        Estimated current memory usage of the program, in bytes.
        Definition: vk_mem_alloc.h:2205
        +
        VmaBudget::usage
        VkDeviceSize usage
        Estimated current memory usage of the program, in bytes.
        Definition: vk_mem_alloc.h:2281
        VmaAllocator
        Represents main object of this library initialized.
        -
        VmaVulkanFunctions::vkCmdCopyBuffer
        PFN_vkCmdCopyBuffer vkCmdCopyBuffer
        Definition: vk_mem_alloc.h:1954
        -
        VmaAllocatorCreateInfo
        Description of a Allocator to be created.
        Definition: vk_mem_alloc.h:1997
        -
        VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT
        Set this flag to only try to allocate from existing VkDeviceMemory blocks and never create new such b...
        Definition: vk_mem_alloc.h:2349
        -
        VMA_DEFRAGMENTATION_FLAG_BITS_MAX_ENUM
        Definition: vk_mem_alloc.h:3114
        -
        VmaPoolStats::unusedRangeSizeMax
        VkDeviceSize unusedRangeSizeMax
        Size of the largest continuous free memory region available for new allocation.
        Definition: vk_mem_alloc.h:2670
        -
        VMA_ALLOCATION_CREATE_STRATEGY_WORST_FIT_BIT
        Definition: vk_mem_alloc.h:2412
        -
        VMA_ALLOCATOR_CREATE_KHR_DEDICATED_ALLOCATION_BIT
        Enables usage of VK_KHR_dedicated_allocation extension.
        Definition: vk_mem_alloc.h:1900
        +
        VmaVulkanFunctions::vkCmdCopyBuffer
        PFN_vkCmdCopyBuffer vkCmdCopyBuffer
        Definition: vk_mem_alloc.h:2030
        +
        VmaAllocatorCreateInfo
        Description of a Allocator to be created.
        Definition: vk_mem_alloc.h:2073
        +
        VMA_ALLOCATION_CREATE_NEVER_ALLOCATE_BIT
        Set this flag to only try to allocate from existing VkDeviceMemory blocks and never create new such b...
        Definition: vk_mem_alloc.h:2425
        +
        VMA_DEFRAGMENTATION_FLAG_BITS_MAX_ENUM
        Definition: vk_mem_alloc.h:3192
        +
        VmaPoolStats::unusedRangeSizeMax
        VkDeviceSize unusedRangeSizeMax
        Size of the largest continuous free memory region available for new allocation.
        Definition: vk_mem_alloc.h:2746
        +
        VMA_ALLOCATION_CREATE_STRATEGY_WORST_FIT_BIT
        Definition: vk_mem_alloc.h:2488
        +
        VMA_ALLOCATOR_CREATE_KHR_DEDICATED_ALLOCATION_BIT
        Enables usage of VK_KHR_dedicated_allocation extension.
        Definition: vk_mem_alloc.h:1958
        vmaSetCurrentFrameIndex
        void vmaSetCurrentFrameIndex(VmaAllocator allocator, uint32_t frameIndex)
        Sets index of the current frame.
        -
        VmaDefragmentationInfo::maxAllocationsToMove
        uint32_t maxAllocationsToMove
        Maximum number of allocations that can be moved to different place.
        Definition: vk_mem_alloc.h:3208
        -
        VMA_ALLOCATION_CREATE_WITHIN_BUDGET_BIT
        Definition: vk_mem_alloc.h:2403
        -
        VmaMemoryUsage
        VmaMemoryUsage
        Definition: vk_mem_alloc.h:2263
        +
        VmaDefragmentationInfo::maxAllocationsToMove
        uint32_t maxAllocationsToMove
        Maximum number of allocations that can be moved to different place.
        Definition: vk_mem_alloc.h:3301
        +
        VMA_ALLOCATION_CREATE_WITHIN_BUDGET_BIT
        Definition: vk_mem_alloc.h:2479
        +
        VmaMemoryUsage
        VmaMemoryUsage
        Definition: vk_mem_alloc.h:2339
        vmaGetMemoryTypeProperties
        void vmaGetMemoryTypeProperties(VmaAllocator allocator, uint32_t memoryTypeIndex, VkMemoryPropertyFlags *pFlags)
        Given Memory Type Index, returns Property Flags of this memory type.
        -
        VmaStatInfo::blockCount
        uint32_t blockCount
        Number of VkDeviceMemory Vulkan memory blocks allocated.
        Definition: vk_mem_alloc.h:2144
        -
        VmaPoolCreateInfo::memoryTypeIndex
        uint32_t memoryTypeIndex
        Vulkan memory type index to allocate this pool from.
        Definition: vk_mem_alloc.h:2607
        -
        VmaPoolCreateInfo::blockSize
        VkDeviceSize blockSize
        Size of a single VkDeviceMemory block to be allocated as part of this pool, in bytes....
        Definition: vk_mem_alloc.h:2619
        -
        VmaDefragmentationInfo2::poolCount
        uint32_t poolCount
        Numer of pools in pPools array.
        Definition: vk_mem_alloc.h:3146
        +
        VmaStatInfo::blockCount
        uint32_t blockCount
        Number of VkDeviceMemory Vulkan memory blocks allocated.
        Definition: vk_mem_alloc.h:2220
        +
        VmaPoolCreateInfo::memoryTypeIndex
        uint32_t memoryTypeIndex
        Vulkan memory type index to allocate this pool from.
        Definition: vk_mem_alloc.h:2683
        +
        VmaPoolCreateInfo::blockSize
        VkDeviceSize blockSize
        Size of a single VkDeviceMemory block to be allocated as part of this pool, in bytes....
        Definition: vk_mem_alloc.h:2695
        +
        VmaDefragmentationInfo2::poolCount
        uint32_t poolCount
        Numer of pools in pPools array.
        Definition: vk_mem_alloc.h:3224
        +
        VmaDefragmentationPassMoveInfo
        Definition: vk_mem_alloc.h:3272
        vmaBuildStatsString
        void vmaBuildStatsString(VmaAllocator allocator, char **ppStatsString, VkBool32 detailedMap)
        Builds and returns statistics as string in JSON format.
        vmaGetAllocationInfo
        void vmaGetAllocationInfo(VmaAllocator allocator, VmaAllocation allocation, VmaAllocationInfo *pAllocationInfo)
        Returns current information about specified allocation and atomically marks it as used in current fra...
        VmaDefragmentationStats
        struct VmaDefragmentationStats VmaDefragmentationStats
        Statistics returned by function vmaDefragment().
        -
        VmaPoolStats::allocationCount
        size_t allocationCount
        Number of VmaAllocation objects created from this pool that were not destroyed or lost.
        Definition: vk_mem_alloc.h:2660
        -
        VmaAllocatorCreateFlags
        VkFlags VmaAllocatorCreateFlags
        Definition: vk_mem_alloc.h:1931
        +
        VmaPoolStats::allocationCount
        size_t allocationCount
        Number of VmaAllocation objects created from this pool that were not destroyed or lost.
        Definition: vk_mem_alloc.h:2736
        +
        VmaAllocatorCreateFlags
        VkFlags VmaAllocatorCreateFlags
        Definition: vk_mem_alloc.h:2007
        vmaFreeStatsString
        void vmaFreeStatsString(VmaAllocator allocator, char *pStatsString)
        vmaAllocateMemoryForBuffer
        VkResult vmaAllocateMemoryForBuffer(VmaAllocator allocator, VkBuffer buffer, const VmaAllocationCreateInfo *pCreateInfo, VmaAllocation *pAllocation, VmaAllocationInfo *pAllocationInfo)
        -
        VMA_ALLOCATOR_CREATE_FLAG_BITS_MAX_ENUM
        Definition: vk_mem_alloc.h:1929
        -
        VmaDefragmentationFlagBits
        VmaDefragmentationFlagBits
        Flags to be used in vmaDefragmentationBegin(). None at the moment. Reserved for future use.
        Definition: vk_mem_alloc.h:3113
        -
        VmaAllocationInfo::offset
        VkDeviceSize offset
        Offset into deviceMemory object to the beginning of this allocation, in bytes. (deviceMemory,...
        Definition: vk_mem_alloc.h:2799
        -
        VmaAllocationCreateFlagBits
        VmaAllocationCreateFlagBits
        Flags to be passed as VmaAllocationCreateInfo::flags.
        Definition: vk_mem_alloc.h:2331
        -
        VmaVulkanFunctions::vkGetPhysicalDeviceMemoryProperties
        PFN_vkGetPhysicalDeviceMemoryProperties vkGetPhysicalDeviceMemoryProperties
        Definition: vk_mem_alloc.h:1939
        -
        VmaPoolCreateFlags
        VkFlags VmaPoolCreateFlags
        Definition: vk_mem_alloc.h:2600
        +
        VMA_ALLOCATOR_CREATE_FLAG_BITS_MAX_ENUM
        Definition: vk_mem_alloc.h:2005
        +
        VmaDefragmentationFlagBits
        VmaDefragmentationFlagBits
        Flags to be used in vmaDefragmentationBegin(). None at the moment. Reserved for future use.
        Definition: vk_mem_alloc.h:3190
        +
        VmaAllocationInfo::offset
        VkDeviceSize offset
        Offset into deviceMemory object to the beginning of this allocation, in bytes. (deviceMemory,...
        Definition: vk_mem_alloc.h:2875
        +
        VmaAllocationCreateFlagBits
        VmaAllocationCreateFlagBits
        Flags to be passed as VmaAllocationCreateInfo::flags.
        Definition: vk_mem_alloc.h:2407
        +
        VmaVulkanFunctions::vkGetPhysicalDeviceMemoryProperties
        PFN_vkGetPhysicalDeviceMemoryProperties vkGetPhysicalDeviceMemoryProperties
        Definition: vk_mem_alloc.h:2015
        +
        VmaPoolCreateFlags
        VkFlags VmaPoolCreateFlags
        Definition: vk_mem_alloc.h:2676
        vmaCreateLostAllocation
        void vmaCreateLostAllocation(VmaAllocator allocator, VmaAllocation *pAllocation)
        Creates new allocation that is in lost state from the beginning.
        vmaGetPhysicalDeviceProperties
        void vmaGetPhysicalDeviceProperties(VmaAllocator allocator, const VkPhysicalDeviceProperties **ppPhysicalDeviceProperties)
        -
        VmaAllocationCreateInfo::pool
        VmaPool pool
        Pool that this allocation should be created in.
        Definition: vk_mem_alloc.h:2475
        +
        VmaAllocationCreateInfo::pool
        VmaPool pool
        Pool that this allocation should be created in.
        Definition: vk_mem_alloc.h:2551
        vmaGetMemoryProperties
        void vmaGetMemoryProperties(VmaAllocator allocator, const VkPhysicalDeviceMemoryProperties **ppPhysicalDeviceMemoryProperties)
        -
        VmaStats::total
        VmaStatInfo total
        Definition: vk_mem_alloc.h:2162
        -
        VMA_ALLOCATION_CREATE_DEDICATED_MEMORY_BIT
        Set this flag if the allocation should have its own memory block.
        Definition: vk_mem_alloc.h:2338
        +
        VmaStats::total
        VmaStatInfo total
        Definition: vk_mem_alloc.h:2238
        +
        VMA_ALLOCATION_CREATE_DEDICATED_MEMORY_BIT
        Set this flag if the allocation should have its own memory block.
        Definition: vk_mem_alloc.h:2414
        vmaDefragmentationEnd
        VkResult vmaDefragmentationEnd(VmaAllocator allocator, VmaDefragmentationContext context)
        Ends defragmentation process.
        -
        VMA_ALLOCATOR_CREATE_KHR_BIND_MEMORY2_BIT
        Definition: vk_mem_alloc.h:1915
        -
        VmaDefragmentationInfo2::flags
        VmaDefragmentationFlags flags
        Reserved for future use. Should be 0.
        Definition: vk_mem_alloc.h:3125
        -
        VmaVulkanFunctions::vkBindImageMemory
        PFN_vkBindImageMemory vkBindImageMemory
        Definition: vk_mem_alloc.h:1947
        -
        VmaDefragmentationInfo2::maxGpuBytesToMove
        VkDeviceSize maxGpuBytesToMove
        Maximum total numbers of bytes that can be copied while moving allocations to different places using ...
        Definition: vk_mem_alloc.h:3177
        -
        VmaDefragmentationStats
        Statistics returned by function vmaDefragment().
        Definition: vk_mem_alloc.h:3212
        +
        VMA_ALLOCATOR_CREATE_KHR_BIND_MEMORY2_BIT
        Definition: vk_mem_alloc.h:1973
        +
        VmaDefragmentationInfo2::flags
        VmaDefragmentationFlags flags
        Reserved for future use. Should be 0.
        Definition: vk_mem_alloc.h:3203
        +
        VmaVulkanFunctions::vkBindImageMemory
        PFN_vkBindImageMemory vkBindImageMemory
        Definition: vk_mem_alloc.h:2023
        +
        VmaDefragmentationInfo2::maxGpuBytesToMove
        VkDeviceSize maxGpuBytesToMove
        Maximum total numbers of bytes that can be copied while moving allocations to different places using ...
        Definition: vk_mem_alloc.h:3255
        +
        VmaDefragmentationStats
        Statistics returned by function vmaDefragment().
        Definition: vk_mem_alloc.h:3305
        vmaDestroyPool
        void vmaDestroyPool(VmaAllocator allocator, VmaPool pool)
        Destroys VmaPool object and frees Vulkan device memory.
        -
        VmaPoolStats::size
        VkDeviceSize size
        Total amount of VkDeviceMemory allocated from Vulkan for this pool, in bytes.
        Definition: vk_mem_alloc.h:2654
        -
        VmaVulkanFunctions::vkFreeMemory
        PFN_vkFreeMemory vkFreeMemory
        Definition: vk_mem_alloc.h:1941
        -
        VmaRecordFlags
        VkFlags VmaRecordFlags
        Definition: vk_mem_alloc.h:1979
        -
        VMA_MEMORY_USAGE_CPU_ONLY
        Definition: vk_mem_alloc.h:2295
        -
        VmaDefragmentationInfo2::pPools
        VmaPool * pPools
        Either null or pointer to array of pools to be defragmented.
        Definition: vk_mem_alloc.h:3162
        +
        VmaPoolStats::size
        VkDeviceSize size
        Total amount of VkDeviceMemory allocated from Vulkan for this pool, in bytes.
        Definition: vk_mem_alloc.h:2730
        +
        VmaVulkanFunctions::vkFreeMemory
        PFN_vkFreeMemory vkFreeMemory
        Definition: vk_mem_alloc.h:2017
        +
        VmaRecordFlags
        VkFlags VmaRecordFlags
        Definition: vk_mem_alloc.h:2055
        +
        VMA_MEMORY_USAGE_CPU_ONLY
        Definition: vk_mem_alloc.h:2371
        +
        VmaDefragmentationInfo2::pPools
        VmaPool * pPools
        Either null or pointer to array of pools to be defragmented.
        Definition: vk_mem_alloc.h:3240
        VmaAllocation
        Represents single memory allocation.
        -
        VMA_MEMORY_USAGE_CPU_COPY
        Definition: vk_mem_alloc.h:2317
        +
        VMA_MEMORY_USAGE_CPU_COPY
        Definition: vk_mem_alloc.h:2393
        vmaSetAllocationUserData
        void vmaSetAllocationUserData(VmaAllocator allocator, VmaAllocation allocation, void *pUserData)
        Sets pUserData in given allocation to new value.
        -
        VmaAllocatorCreateInfo::pRecordSettings
        const VmaRecordSettings * pRecordSettings
        Parameters for recording of VMA calls. Can be null.
        Definition: vk_mem_alloc.h:2073
        -
        VmaVulkanFunctions::vkBindBufferMemory
        PFN_vkBindBufferMemory vkBindBufferMemory
        Definition: vk_mem_alloc.h:1946
        -
        VmaVulkanFunctions::vkGetBufferMemoryRequirements
        PFN_vkGetBufferMemoryRequirements vkGetBufferMemoryRequirements
        Definition: vk_mem_alloc.h:1948
        -
        VmaDefragmentationInfo2::commandBuffer
        VkCommandBuffer commandBuffer
        Optional. Command buffer where GPU copy commands will be posted.
        Definition: vk_mem_alloc.h:3191
        -
        PFN_vmaFreeDeviceMemoryFunction
        void(VKAPI_PTR * PFN_vmaFreeDeviceMemoryFunction)(VmaAllocator allocator, uint32_t memoryType, VkDeviceMemory memory, VkDeviceSize size)
        Callback function called before vkFreeMemory.
        Definition: vk_mem_alloc.h:1849
        -
        VmaStats
        General statistics from current state of Allocator.
        Definition: vk_mem_alloc.h:2158
        -
        VmaPoolCreateInfo::minBlockCount
        size_t minBlockCount
        Minimum number of blocks to be always allocated in this pool, even if they stay empty.
        Definition: vk_mem_alloc.h:2624
        -
        VmaAllocatorCreateInfo::vulkanApiVersion
        uint32_t vulkanApiVersion
        Optional. The highest version of Vulkan that the application is designed to use.
        Definition: vk_mem_alloc.h:2088
        -
        VmaStatInfo
        Calculated statistics of memory usage in entire allocator.
        Definition: vk_mem_alloc.h:2141
        -
        VmaDefragmentationStats::bytesFreed
        VkDeviceSize bytesFreed
        Total number of bytes that have been released to the system by freeing empty VkDeviceMemory objects.
        Definition: vk_mem_alloc.h:3216
        +
        VMA_DEFRAGMENTATION_FLAG_INCREMENTAL
        Definition: vk_mem_alloc.h:3191
        +
        VmaAllocatorCreateInfo::pRecordSettings
        const VmaRecordSettings * pRecordSettings
        Parameters for recording of VMA calls. Can be null.
        Definition: vk_mem_alloc.h:2149
        +
        VmaVulkanFunctions::vkBindBufferMemory
        PFN_vkBindBufferMemory vkBindBufferMemory
        Definition: vk_mem_alloc.h:2022
        +
        VmaVulkanFunctions::vkGetBufferMemoryRequirements
        PFN_vkGetBufferMemoryRequirements vkGetBufferMemoryRequirements
        Definition: vk_mem_alloc.h:2024
        +
        VmaDefragmentationInfo2::commandBuffer
        VkCommandBuffer commandBuffer
        Optional. Command buffer where GPU copy commands will be posted.
        Definition: vk_mem_alloc.h:3269
        +
        PFN_vmaFreeDeviceMemoryFunction
        void(VKAPI_PTR * PFN_vmaFreeDeviceMemoryFunction)(VmaAllocator allocator, uint32_t memoryType, VkDeviceMemory memory, VkDeviceSize size)
        Callback function called before vkFreeMemory.
        Definition: vk_mem_alloc.h:1907
        +
        VmaStats
        General statistics from current state of Allocator.
        Definition: vk_mem_alloc.h:2234
        +
        VmaPoolCreateInfo::minBlockCount
        size_t minBlockCount
        Minimum number of blocks to be always allocated in this pool, even if they stay empty.
        Definition: vk_mem_alloc.h:2700
        +
        VmaAllocatorCreateInfo::vulkanApiVersion
        uint32_t vulkanApiVersion
        Optional. The highest version of Vulkan that the application is designed to use.
        Definition: vk_mem_alloc.h:2164
        +
        VmaStatInfo
        Calculated statistics of memory usage in entire allocator.
        Definition: vk_mem_alloc.h:2217
        +
        VmaDefragmentationStats::bytesFreed
        VkDeviceSize bytesFreed
        Total number of bytes that have been released to the system by freeing empty VkDeviceMemory objects.
        Definition: vk_mem_alloc.h:3309
        VmaStatInfo
        struct VmaStatInfo VmaStatInfo
        Calculated statistics of memory usage in entire allocator.
        VmaVulkanFunctions
        struct VmaVulkanFunctions VmaVulkanFunctions
        Pointers to some Vulkan functions - a subset used by the library.
        +
        VmaDefragmentationPassMoveInfo
        struct VmaDefragmentationPassMoveInfo VmaDefragmentationPassMoveInfo
        vmaFreeMemoryPages
        void vmaFreeMemoryPages(VmaAllocator allocator, size_t allocationCount, VmaAllocation *pAllocations)
        Frees memory and destroys multiple allocations.
        +
        VmaDefragmentationPassInfo::moveCount
        uint32_t moveCount
        Definition: vk_mem_alloc.h:3283
        VmaDefragmentationInfo
        struct VmaDefragmentationInfo VmaDefragmentationInfo
        Deprecated. Optional configuration parameters to be passed to function vmaDefragment().
        -
        VMA_MEMORY_USAGE_GPU_ONLY
        Definition: vk_mem_alloc.h:2285
        +
        VMA_MEMORY_USAGE_GPU_ONLY
        Definition: vk_mem_alloc.h:2361
        +
        vmaBeginDefragmentationPass
        VkResult vmaBeginDefragmentationPass(VmaAllocator allocator, VmaDefragmentationContext context, VmaDefragmentationPassInfo *pInfo)
        vmaFindMemoryTypeIndex
        VkResult vmaFindMemoryTypeIndex(VmaAllocator allocator, uint32_t memoryTypeBits, const VmaAllocationCreateInfo *pAllocationCreateInfo, uint32_t *pMemoryTypeIndex)
        Helps to find memoryTypeIndex, given memoryTypeBits and VmaAllocationCreateInfo.
        vmaCreatePool
        VkResult vmaCreatePool(VmaAllocator allocator, const VmaPoolCreateInfo *pCreateInfo, VmaPool *pPool)
        Allocates Vulkan device memory and creates VmaPool object.
        -
        VmaStatInfo::unusedBytes
        VkDeviceSize unusedBytes
        Total number of bytes occupied by unused ranges.
        Definition: vk_mem_alloc.h:2152
        +
        VmaStatInfo::unusedBytes
        VkDeviceSize unusedBytes
        Total number of bytes occupied by unused ranges.
        Definition: vk_mem_alloc.h:2228
        vmaAllocateMemoryPages
        VkResult vmaAllocateMemoryPages(VmaAllocator allocator, const VkMemoryRequirements *pVkMemoryRequirements, const VmaAllocationCreateInfo *pCreateInfo, size_t allocationCount, VmaAllocation *pAllocations, VmaAllocationInfo *pAllocationInfo)
        General purpose memory allocation for multiple allocation objects at once.
        -
        VmaStatInfo::usedBytes
        VkDeviceSize usedBytes
        Total number of bytes occupied by all allocations.
        Definition: vk_mem_alloc.h:2150
        -
        VmaAllocatorCreateInfo::pAllocationCallbacks
        const VkAllocationCallbacks * pAllocationCallbacks
        Custom CPU memory allocation callbacks. Optional.
        Definition: vk_mem_alloc.h:2012
        -
        VmaAllocatorCreateFlagBits
        VmaAllocatorCreateFlagBits
        Flags for created VmaAllocator.
        Definition: vk_mem_alloc.h:1870
        +
        VmaStatInfo::usedBytes
        VkDeviceSize usedBytes
        Total number of bytes occupied by all allocations.
        Definition: vk_mem_alloc.h:2226
        +
        VmaAllocatorCreateInfo::pAllocationCallbacks
        const VkAllocationCallbacks * pAllocationCallbacks
        Custom CPU memory allocation callbacks. Optional.
        Definition: vk_mem_alloc.h:2088
        +
        VmaAllocatorCreateFlagBits
        VmaAllocatorCreateFlagBits
        Flags for created VmaAllocator.
        Definition: vk_mem_alloc.h:1928
        vmaAllocateMemoryForImage
        VkResult vmaAllocateMemoryForImage(VmaAllocator allocator, VkImage image, const VmaAllocationCreateInfo *pCreateInfo, VmaAllocation *pAllocation, VmaAllocationInfo *pAllocationInfo)
        Function similar to vmaAllocateMemoryForBuffer().
        -
        VmaPoolCreateInfo::maxBlockCount
        size_t maxBlockCount
        Maximum number of blocks that can be allocated in this pool. Optional.
        Definition: vk_mem_alloc.h:2632
        -
        VmaPoolCreateInfo
        Describes parameter of created VmaPool.
        Definition: vk_mem_alloc.h:2604
        -
        VmaDeviceMemoryCallbacks::pfnAllocate
        PFN_vmaAllocateDeviceMemoryFunction pfnAllocate
        Optional, can be null.
        Definition: vk_mem_alloc.h:1864
        +
        VmaPoolCreateInfo::maxBlockCount
        size_t maxBlockCount
        Maximum number of blocks that can be allocated in this pool. Optional.
        Definition: vk_mem_alloc.h:2708
        +
        VmaPoolCreateInfo
        Describes parameter of created VmaPool.
        Definition: vk_mem_alloc.h:2680
        +
        VmaDeviceMemoryCallbacks::pfnAllocate
        PFN_vmaAllocateDeviceMemoryFunction pfnAllocate
        Optional, can be null.
        Definition: vk_mem_alloc.h:1922
        VmaRecordSettings
        struct VmaRecordSettings VmaRecordSettings
        Parameters for recording calls to VMA functions. To be used in VmaAllocatorCreateInfo::pRecordSetting...
        VmaPool
        Represents custom memory pool.
        VmaBudget
        struct VmaBudget VmaBudget
        Statistics of current memory usage and available budget, in bytes, for specific memory heap.
        -
        VMA_MEMORY_USAGE_GPU_TO_CPU
        Definition: vk_mem_alloc.h:2311
        -
        VMA_ALLOCATION_CREATE_CAN_MAKE_OTHER_LOST_BIT
        Definition: vk_mem_alloc.h:2382
        -
        VmaPoolCreateInfo::flags
        VmaPoolCreateFlags flags
        Use combination of VmaPoolCreateFlagBits.
        Definition: vk_mem_alloc.h:2610
        -
        VMA_MEMORY_USAGE_MAX_ENUM
        Definition: vk_mem_alloc.h:2327
        -
        VmaStatInfo::allocationCount
        uint32_t allocationCount
        Number of VmaAllocation allocation objects allocated.
        Definition: vk_mem_alloc.h:2146
        -
        VmaVulkanFunctions::vkInvalidateMappedMemoryRanges
        PFN_vkInvalidateMappedMemoryRanges vkInvalidateMappedMemoryRanges
        Definition: vk_mem_alloc.h:1945
        +
        VMA_MEMORY_USAGE_GPU_TO_CPU
        Definition: vk_mem_alloc.h:2387
        +
        VMA_ALLOCATION_CREATE_CAN_MAKE_OTHER_LOST_BIT
        Definition: vk_mem_alloc.h:2458
        +
        VmaPoolCreateInfo::flags
        VmaPoolCreateFlags flags
        Use combination of VmaPoolCreateFlagBits.
        Definition: vk_mem_alloc.h:2686
        +
        VMA_MEMORY_USAGE_MAX_ENUM
        Definition: vk_mem_alloc.h:2403
        +
        VmaStatInfo::allocationCount
        uint32_t allocationCount
        Number of VmaAllocation allocation objects allocated.
        Definition: vk_mem_alloc.h:2222
        +
        VmaVulkanFunctions::vkInvalidateMappedMemoryRanges
        PFN_vkInvalidateMappedMemoryRanges vkInvalidateMappedMemoryRanges
        Definition: vk_mem_alloc.h:2021
        vmaAllocateMemory
        VkResult vmaAllocateMemory(VmaAllocator allocator, const VkMemoryRequirements *pVkMemoryRequirements, const VmaAllocationCreateInfo *pCreateInfo, VmaAllocation *pAllocation, VmaAllocationInfo *pAllocationInfo)
        General purpose memory allocation.
        -
        VmaDefragmentationInfo2
        Parameters for defragmentation.
        Definition: vk_mem_alloc.h:3122
        -
        VmaDefragmentationInfo::maxBytesToMove
        VkDeviceSize maxBytesToMove
        Maximum total numbers of bytes that can be copied while moving allocations to different places.
        Definition: vk_mem_alloc.h:3203
        -
        VmaBudget::blockBytes
        VkDeviceSize blockBytes
        Sum size of all VkDeviceMemory blocks allocated from particular heap, in bytes.
        Definition: vk_mem_alloc.h:2184
        -
        VMA_POOL_CREATE_FLAG_BITS_MAX_ENUM
        Definition: vk_mem_alloc.h:2598
        -
        VmaAllocationCreateInfo::requiredFlags
        VkMemoryPropertyFlags requiredFlags
        Flags that must be set in a Memory Type chosen for an allocation.
        Definition: vk_mem_alloc.h:2456
        -
        VMA_ALLOCATION_CREATE_STRATEGY_MIN_FRAGMENTATION_BIT
        Definition: vk_mem_alloc.h:2429
        -
        VmaStatInfo::allocationSizeAvg
        VkDeviceSize allocationSizeAvg
        Definition: vk_mem_alloc.h:2153
        +
        VmaDefragmentationInfo2
        Parameters for defragmentation.
        Definition: vk_mem_alloc.h:3200
        +
        VmaDefragmentationInfo::maxBytesToMove
        VkDeviceSize maxBytesToMove
        Maximum total numbers of bytes that can be copied while moving allocations to different places.
        Definition: vk_mem_alloc.h:3296
        +
        VmaBudget::blockBytes
        VkDeviceSize blockBytes
        Sum size of all VkDeviceMemory blocks allocated from particular heap, in bytes.
        Definition: vk_mem_alloc.h:2260
        +
        VMA_POOL_CREATE_FLAG_BITS_MAX_ENUM
        Definition: vk_mem_alloc.h:2674
        +
        VmaAllocationCreateInfo::requiredFlags
        VkMemoryPropertyFlags requiredFlags
        Flags that must be set in a Memory Type chosen for an allocation.
        Definition: vk_mem_alloc.h:2532
        +
        VMA_ALLOCATION_CREATE_STRATEGY_MIN_FRAGMENTATION_BIT
        Definition: vk_mem_alloc.h:2505
        +
        VmaStatInfo::allocationSizeAvg
        VkDeviceSize allocationSizeAvg
        Definition: vk_mem_alloc.h:2229
        vmaDestroyAllocator
        void vmaDestroyAllocator(VmaAllocator allocator)
        Destroys allocator object.
        -
        VmaAllocatorCreateInfo::pDeviceMemoryCallbacks
        const VmaDeviceMemoryCallbacks * pDeviceMemoryCallbacks
        Informative callbacks for vkAllocateMemory, vkFreeMemory. Optional.
        Definition: vk_mem_alloc.h:2015
        -
        VMA_ALLOCATION_CREATE_STRATEGY_MASK
        Definition: vk_mem_alloc.h:2433
        -
        VmaAllocatorCreateInfo::device
        VkDevice device
        Vulkan device.
        Definition: vk_mem_alloc.h:2006
        +
        VmaAllocatorCreateInfo::pDeviceMemoryCallbacks
        const VmaDeviceMemoryCallbacks * pDeviceMemoryCallbacks
        Informative callbacks for vkAllocateMemory, vkFreeMemory. Optional.
        Definition: vk_mem_alloc.h:2091
        +
        VMA_ALLOCATION_CREATE_STRATEGY_MASK
        Definition: vk_mem_alloc.h:2509
        +
        VmaAllocatorCreateInfo::device
        VkDevice device
        Vulkan device.
        Definition: vk_mem_alloc.h:2082
        vmaFindMemoryTypeIndexForImageInfo
        VkResult vmaFindMemoryTypeIndexForImageInfo(VmaAllocator allocator, const VkImageCreateInfo *pImageCreateInfo, const VmaAllocationCreateInfo *pAllocationCreateInfo, uint32_t *pMemoryTypeIndex)
        Helps to find memoryTypeIndex, given VkImageCreateInfo and VmaAllocationCreateInfo.
        VmaStats
        struct VmaStats VmaStats
        General statistics from current state of Allocator.
        vmaMapMemory
        VkResult vmaMapMemory(VmaAllocator allocator, VmaAllocation allocation, void **ppData)
        Maps memory represented by given allocation and returns pointer to it.
        vmaBindBufferMemory
        VkResult vmaBindBufferMemory(VmaAllocator allocator, VmaAllocation allocation, VkBuffer buffer)
        Binds buffer to allocation.
        -
        VmaAllocatorCreateInfo::pHeapSizeLimit
        const VkDeviceSize * pHeapSizeLimit
        Either null or a pointer to an array of limits on maximum number of bytes that can be allocated out o...
        Definition: vk_mem_alloc.h:2054
        +
        VmaAllocatorCreateInfo::pHeapSizeLimit
        const VkDeviceSize * pHeapSizeLimit
        Either null or a pointer to an array of limits on maximum number of bytes that can be allocated out o...
        Definition: vk_mem_alloc.h:2130
        +
        VmaDefragmentationPassMoveInfo::allocation
        VmaAllocation allocation
        Definition: vk_mem_alloc.h:3273
        vmaCreateImage
        VkResult vmaCreateImage(VmaAllocator allocator, const VkImageCreateInfo *pImageCreateInfo, const VmaAllocationCreateInfo *pAllocationCreateInfo, VkImage *pImage, VmaAllocation *pAllocation, VmaAllocationInfo *pAllocationInfo)
        Function similar to vmaCreateBuffer().
        vmaFindMemoryTypeIndexForBufferInfo
        VkResult vmaFindMemoryTypeIndexForBufferInfo(VmaAllocator allocator, const VkBufferCreateInfo *pBufferCreateInfo, const VmaAllocationCreateInfo *pAllocationCreateInfo, uint32_t *pMemoryTypeIndex)
        Helps to find memoryTypeIndex, given VkBufferCreateInfo and VmaAllocationCreateInfo.
        -
        VmaBudget::budget
        VkDeviceSize budget
        Estimated amount of memory available to the program, in bytes.
        Definition: vk_mem_alloc.h:2216
        -
        VmaVulkanFunctions
        Pointers to some Vulkan functions - a subset used by the library.
        Definition: vk_mem_alloc.h:1937
        -
        VmaAllocationInfo::pMappedData
        void * pMappedData
        Pointer to the beginning of this allocation as mapped data.
        Definition: vk_mem_alloc.h:2813
        -
        VmaAllocatorCreateInfo::flags
        VmaAllocatorCreateFlags flags
        Flags for created allocator. Use VmaAllocatorCreateFlagBits enum.
        Definition: vk_mem_alloc.h:2000
        -
        VmaDefragmentationFlags
        VkFlags VmaDefragmentationFlags
        Definition: vk_mem_alloc.h:3116
        +
        VmaBudget::budget
        VkDeviceSize budget
        Estimated amount of memory available to the program, in bytes.
        Definition: vk_mem_alloc.h:2292
        +
        VmaVulkanFunctions
        Pointers to some Vulkan functions - a subset used by the library.
        Definition: vk_mem_alloc.h:2013
        +
        VmaAllocationInfo::pMappedData
        void * pMappedData
        Pointer to the beginning of this allocation as mapped data.
        Definition: vk_mem_alloc.h:2889
        +
        VmaAllocatorCreateInfo::flags
        VmaAllocatorCreateFlags flags
        Flags for created allocator. Use VmaAllocatorCreateFlagBits enum.
        Definition: vk_mem_alloc.h:2076
        +
        VmaDefragmentationFlags
        VkFlags VmaDefragmentationFlags
        Definition: vk_mem_alloc.h:3194
        vmaGetPoolStats
        void vmaGetPoolStats(VmaAllocator allocator, VmaPool pool, VmaPoolStats *pPoolStats)
        Retrieves statistics of existing VmaPool object.
        -
        VmaVulkanFunctions::vkCreateImage
        PFN_vkCreateImage vkCreateImage
        Definition: vk_mem_alloc.h:1952
        -
        VmaStatInfo::unusedRangeSizeAvg
        VkDeviceSize unusedRangeSizeAvg
        Definition: vk_mem_alloc.h:2154
        -
        VMA_MEMORY_USAGE_CPU_TO_GPU
        Definition: vk_mem_alloc.h:2302
        +
        VmaVulkanFunctions::vkCreateImage
        PFN_vkCreateImage vkCreateImage
        Definition: vk_mem_alloc.h:2028
        +
        VmaStatInfo::unusedRangeSizeAvg
        VkDeviceSize unusedRangeSizeAvg
        Definition: vk_mem_alloc.h:2230
        +
        VMA_MEMORY_USAGE_CPU_TO_GPU
        Definition: vk_mem_alloc.h:2378
        VmaDefragmentationInfo2
        struct VmaDefragmentationInfo2 VmaDefragmentationInfo2
        Parameters for defragmentation.
        -
        VMA_ALLOCATION_CREATE_STRATEGY_MIN_TIME_BIT
        Definition: vk_mem_alloc.h:2426
        -
        VMA_ALLOCATION_CREATE_STRATEGY_MIN_MEMORY_BIT
        Definition: vk_mem_alloc.h:2423
        -
        VmaAllocationCreateInfo::usage
        VmaMemoryUsage usage
        Intended usage of memory.
        Definition: vk_mem_alloc.h:2451
        -
        VmaStatInfo::allocationSizeMin
        VkDeviceSize allocationSizeMin
        Definition: vk_mem_alloc.h:2153
        +
        VMA_ALLOCATION_CREATE_STRATEGY_MIN_TIME_BIT
        Definition: vk_mem_alloc.h:2502
        +
        VMA_ALLOCATION_CREATE_STRATEGY_MIN_MEMORY_BIT
        Definition: vk_mem_alloc.h:2499
        +
        VMA_ALLOCATOR_CREATE_AMD_DEVICE_COHERENT_MEMORY_BIT
        Definition: vk_mem_alloc.h:2003
        +
        VmaAllocationCreateInfo::usage
        VmaMemoryUsage usage
        Intended usage of memory.
        Definition: vk_mem_alloc.h:2527
        +
        VmaStatInfo::allocationSizeMin
        VkDeviceSize allocationSizeMin
        Definition: vk_mem_alloc.h:2229
        vmaBindBufferMemory2
        VkResult vmaBindBufferMemory2(VmaAllocator allocator, VmaAllocation allocation, VkDeviceSize allocationLocalOffset, VkBuffer buffer, const void *pNext)
        Binds buffer to allocation with additional parameters.
        -
        VmaAllocationInfo::size
        VkDeviceSize size
        Size of this allocation, in bytes.
        Definition: vk_mem_alloc.h:2804
        -
        VmaRecordSettings::flags
        VmaRecordFlags flags
        Flags for recording. Use VmaRecordFlagBits enum.
        Definition: vk_mem_alloc.h:1985
        -
        VmaVulkanFunctions::vkFlushMappedMemoryRanges
        PFN_vkFlushMappedMemoryRanges vkFlushMappedMemoryRanges
        Definition: vk_mem_alloc.h:1944
        -
        VmaAllocationInfo::pUserData
        void * pUserData
        Custom general-purpose pointer that was passed as VmaAllocationCreateInfo::pUserData or set using vma...
        Definition: vk_mem_alloc.h:2818
        +
        VmaAllocationInfo::size
        VkDeviceSize size
        Size of this allocation, in bytes.
        Definition: vk_mem_alloc.h:2880
        +
        VmaRecordSettings::flags
        VmaRecordFlags flags
        Flags for recording. Use VmaRecordFlagBits enum.
        Definition: vk_mem_alloc.h:2061
        +
        VmaVulkanFunctions::vkFlushMappedMemoryRanges
        PFN_vkFlushMappedMemoryRanges vkFlushMappedMemoryRanges
        Definition: vk_mem_alloc.h:2020
        +
        VmaAllocationInfo::pUserData
        void * pUserData
        Custom general-purpose pointer that was passed as VmaAllocationCreateInfo::pUserData or set using vma...
        Definition: vk_mem_alloc.h:2894
        vmaMakePoolAllocationsLost
        void vmaMakePoolAllocationsLost(VmaAllocator allocator, VmaPool pool, size_t *pLostAllocationCount)
        Marks all allocations in given pool as lost if they are not used in current frame or VmaPoolCreateInf...
        -
        VMA_POOL_CREATE_IGNORE_BUFFER_IMAGE_GRANULARITY_BIT
        Use this flag if you always allocate only buffers and linear images or only optimal images out of thi...
        Definition: vk_mem_alloc.h:2562
        +
        VMA_POOL_CREATE_IGNORE_BUFFER_IMAGE_GRANULARITY_BIT
        Use this flag if you always allocate only buffers and linear images or only optimal images out of thi...
        Definition: vk_mem_alloc.h:2638
        vmaCreateBuffer
        VkResult vmaCreateBuffer(VmaAllocator allocator, const VkBufferCreateInfo *pBufferCreateInfo, const VmaAllocationCreateInfo *pAllocationCreateInfo, VkBuffer *pBuffer, VmaAllocation *pAllocation, VmaAllocationInfo *pAllocationInfo)
        -
        VmaStats::memoryHeap
        VmaStatInfo memoryHeap[VK_MAX_MEMORY_HEAPS]
        Definition: vk_mem_alloc.h:2161
        -
        VmaAllocatorCreateInfo::pVulkanFunctions
        const VmaVulkanFunctions * pVulkanFunctions
        Pointers to Vulkan functions. Can be null if you leave define VMA_STATIC_VULKAN_FUNCTIONS 1.
        Definition: vk_mem_alloc.h:2066
        -
        VmaPoolStats::blockCount
        size_t blockCount
        Number of VkDeviceMemory blocks allocated for this pool.
        Definition: vk_mem_alloc.h:2673
        +
        VmaStats::memoryHeap
        VmaStatInfo memoryHeap[VK_MAX_MEMORY_HEAPS]
        Definition: vk_mem_alloc.h:2237
        +
        VmaAllocatorCreateInfo::pVulkanFunctions
        const VmaVulkanFunctions * pVulkanFunctions
        Pointers to Vulkan functions. Can be null if you leave define VMA_STATIC_VULKAN_FUNCTIONS 1.
        Definition: vk_mem_alloc.h:2142
        +
        VmaPoolStats::blockCount
        size_t blockCount
        Number of VkDeviceMemory blocks allocated for this pool.
        Definition: vk_mem_alloc.h:2749
        vmaCreateAllocator
        VkResult vmaCreateAllocator(const VmaAllocatorCreateInfo *pCreateInfo, VmaAllocator *pAllocator)
        Creates Allocator object.
        vmaDefragment
        VkResult vmaDefragment(VmaAllocator allocator, VmaAllocation *pAllocations, size_t allocationCount, VkBool32 *pAllocationsChanged, const VmaDefragmentationInfo *pDefragmentationInfo, VmaDefragmentationStats *pDefragmentationStats)
        Deprecated. Compacts memory by moving allocations.
        vmaCheckCorruption
        VkResult vmaCheckCorruption(VmaAllocator allocator, uint32_t memoryTypeBits)
        Checks magic number in margins around all allocations in given memory types (in both default and cust...
        -
        VmaAllocationCreateFlags
        VkFlags VmaAllocationCreateFlags
        Definition: vk_mem_alloc.h:2440
        -
        VmaStats::memoryType
        VmaStatInfo memoryType[VK_MAX_MEMORY_TYPES]
        Definition: vk_mem_alloc.h:2160
        -
        VmaAllocatorCreateInfo::instance
        VkInstance instance
        Optional handle to Vulkan instance object.
        Definition: vk_mem_alloc.h:2079
        +
        VmaDefragmentationPassInfo
        Parameters for incremental defragmentation steps.
        Definition: vk_mem_alloc.h:3282
        +
        VmaAllocationCreateFlags
        VkFlags VmaAllocationCreateFlags
        Definition: vk_mem_alloc.h:2516
        +
        VmaStats::memoryType
        VmaStatInfo memoryType[VK_MAX_MEMORY_TYPES]
        Definition: vk_mem_alloc.h:2236
        +
        VmaAllocatorCreateInfo::instance
        VkInstance instance
        Optional handle to Vulkan instance object.
        Definition: vk_mem_alloc.h:2155
        vmaFlushAllocation
        void vmaFlushAllocation(VmaAllocator allocator, VmaAllocation allocation, VkDeviceSize offset, VkDeviceSize size)
        Flushes memory of given allocation.
        VmaPoolStats
        struct VmaPoolStats VmaPoolStats
        Describes parameter of existing VmaPool.
        -
        VMA_MEMORY_USAGE_UNKNOWN
        Definition: vk_mem_alloc.h:2268
        -
        VmaDefragmentationInfo2::maxGpuAllocationsToMove
        uint32_t maxGpuAllocationsToMove
        Maximum number of allocations that can be moved to a different place using transfers on GPU side,...
        Definition: vk_mem_alloc.h:3182
        -
        VmaVulkanFunctions::vkDestroyBuffer
        PFN_vkDestroyBuffer vkDestroyBuffer
        Definition: vk_mem_alloc.h:1951
        -
        VmaPoolCreateInfo::frameInUseCount
        uint32_t frameInUseCount
        Maximum number of additional frames that are in use at the same time as current frame.
        Definition: vk_mem_alloc.h:2646
        -
        VmaVulkanFunctions::vkDestroyImage
        PFN_vkDestroyImage vkDestroyImage
        Definition: vk_mem_alloc.h:1953
        -
        VmaDefragmentationInfo2::maxCpuBytesToMove
        VkDeviceSize maxCpuBytesToMove
        Maximum total numbers of bytes that can be copied while moving allocations to different places using ...
        Definition: vk_mem_alloc.h:3167
        +
        VMA_MEMORY_USAGE_UNKNOWN
        Definition: vk_mem_alloc.h:2344
        +
        VmaDefragmentationInfo2::maxGpuAllocationsToMove
        uint32_t maxGpuAllocationsToMove
        Maximum number of allocations that can be moved to a different place using transfers on GPU side,...
        Definition: vk_mem_alloc.h:3260
        +
        VmaVulkanFunctions::vkDestroyBuffer
        PFN_vkDestroyBuffer vkDestroyBuffer
        Definition: vk_mem_alloc.h:2027
        +
        VmaPoolCreateInfo::frameInUseCount
        uint32_t frameInUseCount
        Maximum number of additional frames that are in use at the same time as current frame.
        Definition: vk_mem_alloc.h:2722
        +
        VmaVulkanFunctions::vkDestroyImage
        PFN_vkDestroyImage vkDestroyImage
        Definition: vk_mem_alloc.h:2029
        +
        VmaDefragmentationInfo2::maxCpuBytesToMove
        VkDeviceSize maxCpuBytesToMove
        Maximum total numbers of bytes that can be copied while moving allocations to different places using ...
        Definition: vk_mem_alloc.h:3245
        vmaGetPoolName
        void vmaGetPoolName(VmaAllocator allocator, VmaPool pool, const char **ppName)
        Retrieves name of a custom pool.
        -
        VmaAllocationInfo::memoryType
        uint32_t memoryType
        Memory type index that this allocation was allocated from.
        Definition: vk_mem_alloc.h:2785
        +
        VmaAllocationInfo::memoryType
        uint32_t memoryType
        Memory type index that this allocation was allocated from.
        Definition: vk_mem_alloc.h:2861
        vmaDestroyImage
        void vmaDestroyImage(VmaAllocator allocator, VkImage image, VmaAllocation allocation)
        Destroys Vulkan image and frees allocated memory.
        -
        VMA_ALLOCATION_CREATE_MAPPED_BIT
        Set this flag to use a memory that will be persistently mapped and retrieve pointer to it.
        Definition: vk_mem_alloc.h:2362
        +
        VMA_ALLOCATION_CREATE_MAPPED_BIT
        Set this flag to use a memory that will be persistently mapped and retrieve pointer to it.
        Definition: vk_mem_alloc.h:2438
        vmaCalculateStats
        void vmaCalculateStats(VmaAllocator allocator, VmaStats *pStats)
        Retrieves statistics from current state of the Allocator.
        vmaDestroyBuffer
        void vmaDestroyBuffer(VmaAllocator allocator, VkBuffer buffer, VmaAllocation allocation)
        Destroys Vulkan buffer and frees allocated memory.
        -
        VmaVulkanFunctions::vkCreateBuffer
        PFN_vkCreateBuffer vkCreateBuffer
        Definition: vk_mem_alloc.h:1950
        +
        VmaVulkanFunctions::vkCreateBuffer
        PFN_vkCreateBuffer vkCreateBuffer
        Definition: vk_mem_alloc.h:2026
        VmaDeviceMemoryCallbacks
        struct VmaDeviceMemoryCallbacks VmaDeviceMemoryCallbacks
        Set of callbacks that the library will call for vkAllocateMemory and vkFreeMemory.
        -
        VmaPoolStats::unusedRangeCount
        size_t unusedRangeCount
        Number of continuous memory ranges in the pool not used by any VmaAllocation.
        Definition: vk_mem_alloc.h:2663
        -
        VmaPoolCreateFlagBits
        VmaPoolCreateFlagBits
        Flags to be passed as VmaPoolCreateInfo::flags.
        Definition: vk_mem_alloc.h:2544
        -
        VmaDefragmentationStats::bytesMoved
        VkDeviceSize bytesMoved
        Total number of bytes that have been copied while moving allocations to different places.
        Definition: vk_mem_alloc.h:3214
        -
        VmaStatInfo::unusedRangeSizeMin
        VkDeviceSize unusedRangeSizeMin
        Definition: vk_mem_alloc.h:2154
        -
        VMA_ALLOCATION_CREATE_UPPER_ADDRESS_BIT
        Definition: vk_mem_alloc.h:2393
        +
        VmaPoolStats::unusedRangeCount
        size_t unusedRangeCount
        Number of continuous memory ranges in the pool not used by any VmaAllocation.
        Definition: vk_mem_alloc.h:2739
        +
        VmaDefragmentationPassInfo
        struct VmaDefragmentationPassInfo VmaDefragmentationPassInfo
        Parameters for incremental defragmentation steps.
        +
        VmaPoolCreateFlagBits
        VmaPoolCreateFlagBits
        Flags to be passed as VmaPoolCreateInfo::flags.
        Definition: vk_mem_alloc.h:2620
        +
        VmaDefragmentationStats::bytesMoved
        VkDeviceSize bytesMoved
        Total number of bytes that have been copied while moving allocations to different places.
        Definition: vk_mem_alloc.h:3307
        +
        VmaStatInfo::unusedRangeSizeMin
        VkDeviceSize unusedRangeSizeMin
        Definition: vk_mem_alloc.h:2230
        +
        VMA_ALLOCATION_CREATE_UPPER_ADDRESS_BIT
        Definition: vk_mem_alloc.h:2469
        vmaCheckPoolCorruption
        VkResult vmaCheckPoolCorruption(VmaAllocator allocator, VmaPool pool)
        Checks magic number in margins around all allocations in given memory pool in search for corruptions.
        vmaBindImageMemory
        VkResult vmaBindImageMemory(VmaAllocator allocator, VmaAllocation allocation, VkImage image)
        Binds image to allocation.
        -
        VmaAllocationCreateInfo::flags
        VmaAllocationCreateFlags flags
        Use VmaAllocationCreateFlagBits enum.
        Definition: vk_mem_alloc.h:2445
        -
        VmaVulkanFunctions::vkGetImageMemoryRequirements
        PFN_vkGetImageMemoryRequirements vkGetImageMemoryRequirements
        Definition: vk_mem_alloc.h:1949
        +
        VmaAllocationCreateInfo::flags
        VmaAllocationCreateFlags flags
        Use VmaAllocationCreateFlagBits enum.
        Definition: vk_mem_alloc.h:2521
        +
        VmaVulkanFunctions::vkGetImageMemoryRequirements
        PFN_vkGetImageMemoryRequirements vkGetImageMemoryRequirements
        Definition: vk_mem_alloc.h:2025
        vmaGetBudget
        void vmaGetBudget(VmaAllocator allocator, VmaBudget *pBudget)
        Retrieves information about current memory budget for all memory heaps.
        -
        VmaAllocationCreateInfo
        Definition: vk_mem_alloc.h:2442
        -
        VmaAllocationCreateInfo::preferredFlags
        VkMemoryPropertyFlags preferredFlags
        Flags that preferably should be set in a memory type chosen for an allocation.
        Definition: vk_mem_alloc.h:2461
        +
        VmaAllocationCreateInfo
        Definition: vk_mem_alloc.h:2518
        +
        VmaAllocationCreateInfo::preferredFlags
        VkMemoryPropertyFlags preferredFlags
        Flags that preferably should be set in a memory type chosen for an allocation.
        Definition: vk_mem_alloc.h:2537
        vmaDefragmentationBegin
        VkResult vmaDefragmentationBegin(VmaAllocator allocator, const VmaDefragmentationInfo2 *pInfo, VmaDefragmentationStats *pStats, VmaDefragmentationContext *pContext)
        Begins defragmentation process.
        vmaBindImageMemory2
        VkResult vmaBindImageMemory2(VmaAllocator allocator, VmaAllocation allocation, VkDeviceSize allocationLocalOffset, VkImage image, const void *pNext)
        Binds image to allocation with additional parameters.
        -
        VmaDefragmentationInfo2::pAllocationsChanged
        VkBool32 * pAllocationsChanged
        Optional, output. Pointer to array that will be filled with information whether the allocation at cer...
        Definition: vk_mem_alloc.h:3143
        -
        VmaDefragmentationStats::allocationsMoved
        uint32_t allocationsMoved
        Number of allocations that have been moved to different places.
        Definition: vk_mem_alloc.h:3218
        -
        VmaAllocationCreateInfo::memoryTypeBits
        uint32_t memoryTypeBits
        Bitmask containing one bit set for every memory type acceptable for this allocation.
        Definition: vk_mem_alloc.h:2469
        -
        VmaDefragmentationStats::deviceMemoryBlocksFreed
        uint32_t deviceMemoryBlocksFreed
        Number of empty VkDeviceMemory objects that have been released to the system.
        Definition: vk_mem_alloc.h:3220
        -
        VmaRecordSettings::pFilePath
        const char * pFilePath
        Path to the file that should be written by the recording.
        Definition: vk_mem_alloc.h:1993
        -
        VmaStatInfo::allocationSizeMax
        VkDeviceSize allocationSizeMax
        Definition: vk_mem_alloc.h:2153
        +
        vmaEndDefragmentationPass
        VkResult vmaEndDefragmentationPass(VmaAllocator allocator, VmaDefragmentationContext context)
        +
        VmaDefragmentationInfo2::pAllocationsChanged
        VkBool32 * pAllocationsChanged
        Optional, output. Pointer to array that will be filled with information whether the allocation at cer...
        Definition: vk_mem_alloc.h:3221
        +
        VmaDefragmentationStats::allocationsMoved
        uint32_t allocationsMoved
        Number of allocations that have been moved to different places.
        Definition: vk_mem_alloc.h:3311
        +
        VmaAllocationCreateInfo::memoryTypeBits
        uint32_t memoryTypeBits
        Bitmask containing one bit set for every memory type acceptable for this allocation.
        Definition: vk_mem_alloc.h:2545
        +
        VmaDefragmentationStats::deviceMemoryBlocksFreed
        uint32_t deviceMemoryBlocksFreed
        Number of empty VkDeviceMemory objects that have been released to the system.
        Definition: vk_mem_alloc.h:3313
        +
        VmaRecordSettings::pFilePath
        const char * pFilePath
        Path to the file that should be written by the recording.
        Definition: vk_mem_alloc.h:2069
        +
        VmaStatInfo::allocationSizeMax
        VkDeviceSize allocationSizeMax
        Definition: vk_mem_alloc.h:2229
        VmaPoolCreateInfo
        struct VmaPoolCreateInfo VmaPoolCreateInfo
        Describes parameter of created VmaPool.
        -
        VmaAllocationInfo
        Parameters of VmaAllocation objects, that can be retrieved using function vmaGetAllocationInfo().
        Definition: vk_mem_alloc.h:2780
        -
        VMA_POOL_CREATE_BUDDY_ALGORITHM_BIT
        Enables alternative, buddy allocation algorithm in this pool.
        Definition: vk_mem_alloc.h:2590
        -
        VmaBudget::allocationBytes
        VkDeviceSize allocationBytes
        Sum size of all allocations created in particular heap, in bytes.
        Definition: vk_mem_alloc.h:2195
        -
        VMA_ALLOCATION_CREATE_FLAG_BITS_MAX_ENUM
        Definition: vk_mem_alloc.h:2438
        +
        VmaAllocationInfo
        Parameters of VmaAllocation objects, that can be retrieved using function vmaGetAllocationInfo().
        Definition: vk_mem_alloc.h:2856
        +
        VMA_POOL_CREATE_BUDDY_ALGORITHM_BIT
        Enables alternative, buddy allocation algorithm in this pool.
        Definition: vk_mem_alloc.h:2666
        +
        VmaBudget::allocationBytes
        VkDeviceSize allocationBytes
        Sum size of all allocations created in particular heap, in bytes.
        Definition: vk_mem_alloc.h:2271
        +
        VMA_ALLOCATION_CREATE_FLAG_BITS_MAX_ENUM
        Definition: vk_mem_alloc.h:2514
        VmaDefragmentationContext
        Represents Opaque object that represents started defragmentation process.
        -
        VmaDefragmentationInfo2::pAllocations
        VmaAllocation * pAllocations
        Pointer to array of allocations that can be defragmented.
        Definition: vk_mem_alloc.h:3137
        -
        VMA_POOL_CREATE_ALGORITHM_MASK
        Definition: vk_mem_alloc.h:2594
        -
        VmaDefragmentationInfo2::maxCpuAllocationsToMove
        uint32_t maxCpuAllocationsToMove
        Maximum number of allocations that can be moved to a different place using transfers on CPU side,...
        Definition: vk_mem_alloc.h:3172
        -
        VmaDefragmentationInfo
        Deprecated. Optional configuration parameters to be passed to function vmaDefragment().
        Definition: vk_mem_alloc.h:3198
        -
        VMA_ALLOCATION_CREATE_DONT_BIND_BIT
        Definition: vk_mem_alloc.h:2399
        +
        VmaDefragmentationInfo2::pAllocations
        VmaAllocation * pAllocations
        Pointer to array of allocations that can be defragmented.
        Definition: vk_mem_alloc.h:3215
        +
        VMA_POOL_CREATE_ALGORITHM_MASK
        Definition: vk_mem_alloc.h:2670
        +
        VmaDefragmentationInfo2::maxCpuAllocationsToMove
        uint32_t maxCpuAllocationsToMove
        Maximum number of allocations that can be moved to a different place using transfers on CPU side,...
        Definition: vk_mem_alloc.h:3250
        +
        VmaDefragmentationInfo
        Deprecated. Optional configuration parameters to be passed to function vmaDefragment().
        Definition: vk_mem_alloc.h:3291
        +
        VMA_ALLOCATION_CREATE_DONT_BIND_BIT
        Definition: vk_mem_alloc.h:2475
        Generated by   diff --git a/docs/html/vk_amd_device_coherent_memory.html b/docs/html/vk_amd_device_coherent_memory.html new file mode 100644 index 0000000..1c6810a --- /dev/null +++ b/docs/html/vk_amd_device_coherent_memory.html @@ -0,0 +1,98 @@ + + + + + + + +Vulkan Memory Allocator: VK_AMD_device_coherent_memory + + + + + + + + + +
        +
        + + + + + + +
        +
        Vulkan Memory Allocator +
        +
        +
        + + + + + + + + +
        +
        + + +
        + +
        + +
        +
        +
        +
        VK_AMD_device_coherent_memory
        +
        +
        +

        VK_AMD_device_coherent_memory is a device extension that enables access to additional memory types with VK_MEMORY_PROPERTY_DEVICE_COHERENT_BIT_AMD and VK_MEMORY_PROPERTY_DEVICE_UNCACHED_BIT_AMD flag. It is useful mostly for allocation of buffers intended for writing "breadcrumb markers" in between passes or draw calls, which in turn are useful for debugging GPU crash/hang/TDR cases.

        +

        When the extension is available but has not been enabled, Vulkan physical device still exposes those memory types, but their usage is forbidden. VMA automatically takes care of that - it returns VK_ERROR_FEATURE_NOT_PRESENT when an attempt to allocate memory of such type is made.

        +

        If you want to use this extension in connection with VMA, follow these steps:

        +

        +Initialization

        +

        1) Call vkEnumerateDeviceExtensionProperties for the physical device. Check if the extension is supported - if returned array of VkExtensionProperties contains "VK_AMD_device_coherent_memory".

        +

        2) Call vkGetPhysicalDeviceFeatures2 for the physical device instead of old vkGetPhysicalDeviceFeatures. Attach additional structure VkPhysicalDeviceCoherentMemoryFeaturesAMD to VkPhysicalDeviceFeatures2::pNext to be returned. Check if the device feature is really supported - check if VkPhysicalDeviceCoherentMemoryFeaturesAMD::deviceCoherentMemory is true.

        +

        3) While creating device with vkCreateDevice, enable this extension - add "VK_AMD_device_coherent_memory" to the list passed as VkDeviceCreateInfo::ppEnabledExtensionNames.

        +

        4) While creating the device, also don't set VkDeviceCreateInfo::pEnabledFeatures. Fill in VkPhysicalDeviceFeatures2 structure instead and pass it as VkDeviceCreateInfo::pNext. Enable this device feature - attach additional structure VkPhysicalDeviceCoherentMemoryFeaturesAMD to VkPhysicalDeviceFeatures2::pNext and set its member deviceCoherentMemory to VK_TRUE.

        +

        5) While creating VmaAllocator with vmaCreateAllocator() inform VMA that you have enabled this extension and feature - add VMA_ALLOCATOR_CREATE_AMD_DEVICE_COHERENT_MEMORY_BIT to VmaAllocatorCreateInfo::flags.

        +

        +Usage

        +

        After following steps described above, you can create VMA allocations and custom pools out of the special DEVICE_COHERENT and DEVICE_UNCACHED memory types on eligible devices. There are multiple ways to do it, for example:

        + +

        +More information

        +

        To learn more about this extension, see VK_AMD_device_coherent_memory in Vulkan specification

        +

        Example use of this extension can be found in the code of the sample and test suite accompanying this library.

        +
        +
        + +
        +Generated by   +doxygen + 1.8.16 +
        + + diff --git a/docs/html/vk_khr_dedicated_allocation.html b/docs/html/vk_khr_dedicated_allocation.html index feea1b1..ac24b81 100644 --- a/docs/html/vk_khr_dedicated_allocation.html +++ b/docs/html/vk_khr_dedicated_allocation.html @@ -82,13 +82,13 @@ $(function() {

        It is OK, you should just ignore it. It happens because you use function vkGetBufferMemoryRequirements2KHR() instead of standard vkGetBufferMemoryRequirements(), while the validation layer seems to be unaware of it.

        To learn more about this extension, see:

        -
        VMA_ALLOCATOR_CREATE_KHR_DEDICATED_ALLOCATION_BIT
        Enables usage of VK_KHR_dedicated_allocation extension.
        Definition: vk_mem_alloc.h:1900
        -
        VmaAllocatorCreateInfo::flags
        VmaAllocatorCreateFlags flags
        Flags for created allocator. Use VmaAllocatorCreateFlagBits enum.
        Definition: vk_mem_alloc.h:2000
        +
        VMA_ALLOCATOR_CREATE_KHR_DEDICATED_ALLOCATION_BIT
        Enables usage of VK_KHR_dedicated_allocation extension.
        Definition: vk_mem_alloc.h:1958
        +
        VmaAllocatorCreateInfo::flags
        VmaAllocatorCreateFlags flags
        Flags for created allocator. Use VmaAllocatorCreateFlagBits enum.
        Definition: vk_mem_alloc.h:2076
        vmaCreateAllocator
        VkResult vmaCreateAllocator(const VmaAllocatorCreateInfo *pCreateInfo, VmaAllocator *pAllocator)
        Creates Allocator object.
        diff --git a/src/vk_mem_alloc.h b/src/vk_mem_alloc.h index 369817f..29d32e2 100644 --- a/src/vk_mem_alloc.h +++ b/src/vk_mem_alloc.h @@ -92,6 +92,7 @@ Documentation of all members: vk_mem_alloc.h - [Device memory allocation callbacks](@ref allocation_callbacks) - [Device heap memory limit](@ref heap_memory_limit) - \subpage vk_khr_dedicated_allocation + - \subpage vk_amd_device_coherent_memory - \subpage general_considerations - [Thread safety](@ref general_considerations_thread_safety) - [Validation layer warnings](@ref general_considerations_validation_layer_warnings) @@ -1673,11 +1674,68 @@ unaware of it. To learn more about this extension, see: -- [VK_KHR_dedicated_allocation in Vulkan specification](https://www.khronos.org/registry/vulkan/specs/1.0-extensions/html/vkspec.html#VK_KHR_dedicated_allocation) +- [VK_KHR_dedicated_allocation in Vulkan specification](https://www.khronos.org/registry/vulkan/specs/1.2-extensions/html/chap44.html#VK_KHR_dedicated_allocation) - [VK_KHR_dedicated_allocation unofficial manual](http://asawicki.info/articles/VK_KHR_dedicated_allocation.php5) +\page vk_amd_device_coherent_memory VK_AMD_device_coherent_memory + +VK_AMD_device_coherent_memory is a device extension that enables access to +additional memory types with `VK_MEMORY_PROPERTY_DEVICE_COHERENT_BIT_AMD` and +`VK_MEMORY_PROPERTY_DEVICE_UNCACHED_BIT_AMD` flag. It is useful mostly for +allocation of buffers intended for writing "breadcrumb markers" in between passes +or draw calls, which in turn are useful for debugging GPU crash/hang/TDR cases. + +When the extension is available but has not been enabled, Vulkan physical device +still exposes those memory types, but their usage is forbidden. VMA automatically +takes care of that - it returns `VK_ERROR_FEATURE_NOT_PRESENT` when an attempt +to allocate memory of such type is made. + +If you want to use this extension in connection with VMA, follow these steps: + +\section vk_amd_device_coherent_memory_initialization Initialization + +1) Call `vkEnumerateDeviceExtensionProperties` for the physical device. +Check if the extension is supported - if returned array of `VkExtensionProperties` contains "VK_AMD_device_coherent_memory". + +2) Call `vkGetPhysicalDeviceFeatures2` for the physical device instead of old `vkGetPhysicalDeviceFeatures`. +Attach additional structure `VkPhysicalDeviceCoherentMemoryFeaturesAMD` to `VkPhysicalDeviceFeatures2::pNext` to be returned. +Check if the device feature is really supported - check if `VkPhysicalDeviceCoherentMemoryFeaturesAMD::deviceCoherentMemory` is true. + +3) While creating device with `vkCreateDevice`, enable this extension - add "VK_AMD_device_coherent_memory" +to the list passed as `VkDeviceCreateInfo::ppEnabledExtensionNames`. + +4) While creating the device, also don't set `VkDeviceCreateInfo::pEnabledFeatures`. +Fill in `VkPhysicalDeviceFeatures2` structure instead and pass it as `VkDeviceCreateInfo::pNext`. +Enable this device feature - attach additional structure `VkPhysicalDeviceCoherentMemoryFeaturesAMD` to +`VkPhysicalDeviceFeatures2::pNext` and set its member `deviceCoherentMemory` to `VK_TRUE`. + +5) While creating #VmaAllocator with vmaCreateAllocator() inform VMA that you +have enabled this extension and feature - add #VMA_ALLOCATOR_CREATE_AMD_DEVICE_COHERENT_MEMORY_BIT +to VmaAllocatorCreateInfo::flags. + +\section vk_amd_device_coherent_memory_usage Usage + +After following steps described above, you can create VMA allocations and custom pools +out of the special `DEVICE_COHERENT` and `DEVICE_UNCACHED` memory types on eligible +devices. There are multiple ways to do it, for example: + +- You can request or prefer to allocate out of such memory types by adding + `VK_MEMORY_PROPERTY_DEVICE_COHERENT_BIT_AMD` to VmaAllocationCreateInfo::requiredFlags + or VmaAllocationCreateInfo::preferredFlags. Those flags can be freely mixed with + other ways of \ref choosing_memory_type, like setting VmaAllocationCreateInfo::usage. +- If you manually found memory type index to use for this purpose, force allocation + from this specific index by setting VmaAllocationCreateInfo::memoryTypeBits `= 1u << index`. + +\section vk_amd_device_coherent_memory_more_information More information + +To learn more about this extension, see [VK_AMD_device_coherent_memory in Vulkan specification](https://www.khronos.org/registry/vulkan/specs/1.2-extensions/html/chap44.html#VK_AMD_device_coherent_memory) + +Example use of this extension can be found in the code of the sample and test suite +accompanying this library. + + \page general_considerations General considerations \section general_considerations_thread_safety Thread safety