VK_NV_cooperative_vector(3)

Name

VK_NV_cooperative_vector - device extension

VK_NV_cooperative_vector

Name String

VK_NV_cooperative_vector

Extension Type

Device extension

Registered Extension Number

492

Revision

4

Ratification Status

Not ratified

Extension and Version Dependencies
SPIR-V Dependencies
Contact
Extension Proposal

VK_NV_cooperative_vector

Other Extension Metadata

Last Modified Date

2024-05-23

Interactions and External Dependencies
Contributors
  • Jeff Bolz, NVIDIA

Description

This extension adds support for using cooperative vector types in SPIR-V. Unlike cooperative matrix types, a variable with a cooperative vector type is logically stored in the invocation it belongs to, but they can cooperate behind the scenes when performing matrix-vector multiplies. Cooperative vectors do not require a fully occupied subgroup or uniform control flow like cooperative matrices, although these do increase the likelihood of being on the fast path. And unlike normal vector types, they have arbitrary length and support a relatively limited set of operations. These types are intended to help accelerate the evaluation of small neural networks, where each invocation is performing its own independent evaluation of the network.

Cooperative vector types are defined by the SPV_NV_cooperative_vector SPIR-V extension and can be used with the GL_NV_cooperative_vector GLSL extension.

This extension includes support for enumerating the combinations of types that are supported by the implementation, and for converting matrix data to and from an optimized opaque layout.

New SPIR-V Capabilities

Issues

Version History

  • Revision 4, 2024-05-23 (Jeff Bolz)

    • Add maxCooperativeVectorComponents

  • Revision 3, 2024-05-23 (Jeff Bolz)

    • Add training functions

  • Revision 2, 2024-02-10 (Jeff Bolz)

    • Add device-side matrix conversion

  • Revision 1, 2023-12-13 (Jeff Bolz)

    • Initial revisions

See Also

No cross-references are available

Document Notes

For more information, see the Vulkan Specification.

This page is a generated document. Fixes and changes should be made to the generator scripts, not directly.