Poster
Geometric Generative Modeling with Noise-Conditioned Graph Networks
Peter Pao-Huang · Mitchell Black · Xiaojie Qiu
East Exhibition Hall A-B #E-3110
Modern AI generates realistic geometric objects through a process that starts with pure noise (similar to static on a TV screen) and gradually learns to reverse this noise back into recognizable objects such as cars, furniture, or human organs. However, current AI systems use the same rigid neural network throughout this entire noise-removal process, like using the same tool to both create the scaffolding of a building and paint fine details. This one-size-fits-all approach limits the quality of generated objects because different stages of noise removal require different processing strategies.We developed Noise-Conditioned Graph Networks that work like a smart contractor who uses different tools for different stages of construction—heavy machinery for rough work and fine brushes for detailed finishing. Our AI dynamically changes how it processes information during the noise-removal process: at early, very noisy stages, it looks broadly at distant relationships and works with simplified representations, while at later, nearly clean stages, it focuses locally on fine details with full resolution. This adaptive approach is backed by mathematical theory showing that optimal information gathering requires different strategies at different noise levels.Our method improves 3D shape generation, biological data modeling, and image generation. The technique requires minimal code changes to implement, making it immediately practical for existing AI systems. This work could accelerate advances in computer graphics, medical imaging, drug discovery, and any field requiring geometric modeling, bringing us closer to AI that truly understands and creates the geometric world around us.