articleJun 16, 2024Closed access

Point Transformer V3: Simpler, Faster, Stronger

University of Hong Kong · Moscow Institute of Thermal Technology

Indexed incrossref

Abstract

This paper is not motivated to seek innovation within the attention mechanism. Instead, it focuses on overcoming the existing trade-offs between accuracy and efficiency within the context of point cloud processing, leveraging the power of scale. Drawing inspiration from recent advances in 3D large-scale representation learning, we recognize that model performance is more influenced by scale than by intricate design. Therefore, we present Point Transformer V3 (PTv3), which prioritizes simplicity and efficiency over the accuracy of certain mechanisms that are minor to the over-all performance after scaling, such as replacing the precise neighbor search by KNN with an efficient serialized neighbor mapping of…

Citation impact

396
total citations
FWCI
88.52
Percentile
100%
References
117
Citations per year

Authors

9

Topics & keywords

Keywords
  • Transformer
  • Computer science
  • Electrical engineering
  • Voltage
  • Engineering
UN Sustainable Development Goals
  • Affordable and clean energy
No related works found for this paper.

Funding