Enum arm_nn_weight_format_flt

Enum Documentation

enum arm_nn_weight_format_flt

Weight storage format selector for floating-point operators.

This enum allows frameworks to describe whether weights are provided in the standard public operator layout or in a backend-specific packed layout.

ARM_NN_WEIGHT_FORMAT_NT_N_PACKED matches the packed RHS layout consumed by arm_nn_mat_mult_nt_n_packed_f16/f32.

The packed NTxN layout exists because MVE kernels typically perform best when output-channel blocks can be loaded contiguously. With the standard NT x T formulation, vectorizing over output channels tends to require gather-load accesses to the RHS, which is less efficient than a packed non-transposed RHS layout.

For operators that support ARM_NN_WEIGHT_FORMAT_NT_N_PACKED, supplying offline-repacked constant weights in this layout is therefore generally the preferred way to achieve the best MVE performance.

Values:

enumerator ARM_NN_WEIGHT_FORMAT_STANDARD

Standard public operator layout.

enumerator ARM_NN_WEIGHT_FORMAT_NT_N_PACKED

Packed [K][N-block] layout for NTxN matmul helpers.