[edit]
Lessons Learned from Auto-Bidding in the Large-Scale Auctions Competition at NeurIPS 2024
Proceedings of the NeurIPS 2023-2025 Competition Track, PMLR 276:174-185, 2026.
Abstract
Decision-making in large-scale games is an essential research area in artificial intelligence, with significant real-world impact. An agent faces the critical task of making high-frequency strategic decisions in an uncertain and competitive environment. This environment is characterized by substantial randomness and rapidly changing strategies from numerous competitors. However, the shortage of large-scale, realistic game systems and datasets has hindered research progress in this area. To provide opportunities for in-depth research on this valuable problem, we have presented the Auto-Bidding in Large-Scale Auctions Competition, derived from online advertising, at NeurIPS 2024. This competition focuses on bidding decision-making in uncertain and competitive games. It specifically includes the AIGB (AI-Generated Bidding) track, which emphasizes the innovation of generative algorithms in the field of auto-bidding. This competition has attracted over 1,500 teams from around the world. After six months of intense competition, participants have proposed numerous innovative and forward-looking solutions, significantly promoting research and technological development in this field. In this competition, we have open-sourced AuctionNet, a benchmark for bidding decision-making in large-scale ad auctions derived from a real-world online advertising platform. We have also pre-generated a substantial dataset comprising 10 million ad opportunities, 48 diverse auto-bidding agents, and over 500 million auction records. Performance evaluations of baseline algorithms, such as linear programming, reinforcement learning, and generative models, are also presented as part of AuctionNet. AuctionNet has powered the competition at NeurIPS 2024. We believe that the proposed competition and AuctionNet provide opportunities for more researchers to gain insights and conduct research in this field, driving technical innovation for both academic research and real-world practical applications.