融合三维高斯点染和分数蒸馏采样的三维点云补全方法

    Point Cloud Completion with Gaussian Splatting and 2D Diffusion Models

    • 摘要: 针对现有三维点云补全方法依赖于配对数据的有监督学习,导致数据成本高昂且泛化能力不足的问题,本文提出了一种无需配对数据进行训练的三维点云补全方法。提出了一种结合三维高斯点染技术和分数蒸馏采样技术,将不完整点云转换为三维高斯模型,并通过预训练的二维扩散模型引导三维高斯模型逐步优化,预测完整点云,实现三维点云补全任务。引入点密集化操作以增加输入点云的稠密度,增强初始三维高斯的质量,并采用渐进式相机采样策略在优化初期控制相机采样范围,提升了优化效率。实验结果表明,本文方法在RedWood-3DScan数据集上取得了优于现有方法的性能。消融实验进一步验证了所提出优化方案的有效性,证明了本方法在处理真实数据时的优越性。

       

      Abstract: This study addressed the limitations of existing 3D point cloud completion methods, which rely on paired data and supervised learning, resulting in high data costs and limited generalization capabilities. This paper proposed a novel 3D point cloud completion method without requiring paired data for training by integrating 3D Gaussian splatting and Score Distillation Sampling (SDS) techniques. In the proposed method, incomplete point clouds were transformed into 3D Gaussian models, which were iteratively optimized using a pre-trained 2D diffusion model to predict complete point clouds and fulfill the completion task. To enhance the initial 3D Gaussian models, the authors introduced a point densification technique that increased the density of input point clouds. Additionally, a progressive camera sampling strategy was adopted during the early optimization stages to control the camera sampling range, thereby improving optimization efficiency. The experimental results demonstrate that the proposed method outperforms existing approaches on the RedWood-3DScan dataset. Ablation studies further validate the effectiveness of the optimization strategies, confirming the superiority of the proposed method in handling real-world data.

       

    /

    返回文章
    返回