ORKG Shapes

go to ORKG: http://orkg.org/orkg/predicate/P23053

Number of Heads

This field indicates the number of attention heads in the multi-head attention mechanism. Each attention head can focus on different parts of the input sequence, allowing the model to capture various aspects of the data simultaneously

• http://orkg.org/orkg/shapes/orkgc_Resource
• http://orkg.org/orkg/shapes/orkgc_C100022
• http://orkg.org/orkg/shapes/orkgc_Contribution