Ant Group Unveils SkySense: 2 Billion Parameter Multimodal Remote Sensing Model Pioneering Industry Breakthroughs

2024-02-28

Ant Group has released a groundbreaking multimodal remote sensing model called SkySense, which has 2 billion parameters. This innovative achievement represents a new breakthrough for Ant Group's Bailing model in the field of multimodal technology. The paper on SkySense has been accepted at the top computer vision conference CVPR 2024, demonstrating its academic value and application prospects. According to data, SkySense has surpassed similar products in 17 internationally recognized public datasets, achieving international leading levels in terms of parameter scale, task coverage, and recognition accuracy. This model has a wide range of applications, including terrain analysis, crop observation, and interpretation, effectively assisting agricultural production and operational decision-making. With the continuous advancement of artificial intelligence technology, the combination of large-scale models and satellite remote sensing technology is driving new breakthroughs. SkySense is based on the capabilities of Ant Group's Bailing model platform and utilizes deep learning and multimodal data processing techniques to efficiently model multispectral and multiresolution time-series remote sensing images, including text, infrared, visible light, and SAR radar. It is worth mentioning that the research achievements of SkySense have not only gained recognition in the academic community but also demonstrated strong performance in practical applications. Through Ant Group's internal MEarth platform, SkySense has provided data and recognition services for urban planning, forest conservation, emergency response, green finance, and agricultural monitoring. Ant Group has expressed plans to open the parameters of the SkySense model in the future, collaborating with the industry to promote the development of intelligent remote sensing technology and applications. This initiative is expected to promote the popularization and innovation of remote sensing technology, bringing opportunities for intelligent transformation in various fields. The development of SkySense was jointly completed by NextEvo, Ant Group's AI innovation research and development department, and Wuhan University. NextEvo, as the core technology research and development team of Ant Group's AI, has been committed to promoting the application and innovation of artificial intelligence technology in various fields. The successful development of this multimodal remote sensing model once again demonstrates the team's profound strength and innovation capabilities in the field of artificial intelligence. Currently, Ant Group's multimodal research achievements have been applied in scenarios such as Alipay's AI-based large-scale interactive activities during the Five Blessings Festival and Ant Medical's digital human, bringing users a more intelligent and convenient service experience. In the future, with the continuous advancement of technology and the expansion of application scenarios, SkySense is expected to bring revolutionary changes to more fields.