Roblox has unveiled its open-source AI model called "Cube 3D," allowing creators to generate 3D objects through text prompts, marking a significant advancement in the platform's generative AI capabilities. As reported by TechCrunch, this release is accompanied by plans for additional AI tools, including text generation, text-to-speech, and speech-to-text, set to launch in the coming months.
Announced last year at Roblox's annual developer conference, Cube 3D is now being showcased at the Game Developer Conference and will be available to creators later this week12. This foundational AI model contains 1.8 billion parameters and is designed to generate 3D objects seamlessly within the Roblox environment34. Unlike traditional 3D modeling techniques that rely on 2D image reconstruction, Cube 3D is trained on actual 3D data from Roblox's platform, ensuring created objects integrate smoothly into the game ecosystem3. While the tool will be free for developers and creators, Roblox plans to implement usage caps to manage resource allocation5.
Roblox's Cube 3D introduces a mesh generation API, currently in beta, which allows developers to create 3D models using simple text commands. Users can generate objects by typing prompts like "generate a motorcycle" or "generate orange safety cone," streamlining the 3D creation process1. The API's key features include:
Rapid prototyping: Developers can quickly explore new creative directions and increase productivity by generating and iterating on 3D models1.
Customization: Created meshes can be further refined with textures and colors, offering flexibility in design1.
Seamless integration: Objects generated by Cube 3D are optimized to work within the Roblox game environment, ensuring compatibility and performance12.
Future expansions: Roblox aims to enhance the API, allowing creators to generate entire scenes based on multimodal inputs, further simplifying the creation process13.
The open-source release of Cube 3D allows anyone, even those outside the Roblox platform, to utilize, create plugins for, or train the model with custom datasets12. This approach fosters innovation and research in AI tools and 3D generation within the gaming industry. Cube 3D's training methodology sets it apart from traditional 3D modeling techniques by leveraging actual 3D data from Roblox's platform, ensuring that generated objects are optimized for the game environment31.
Roblox is expanding its AI toolkit beyond 3D object generation, with plans to introduce several new AI-powered features in the coming months. These include text generation capabilities, which could assist developers in creating in-game dialogue or descriptions, as well as text-to-speech and speech-to-text functionalities to enhance accessibility and user interaction12. The company's long-term vision involves developing tools for entire scene generation, allowing developers to create complex environments on demand1.
Future enhancements: Roblox aims to enable creators to generate 3D objects from still images and is working on real-time language translation models1.
Multimodal approach: The Cube model is being developed to process various input types, including text, images, and video, to create more sophisticated 3D content3.
Resource management: While these AI tools will be free for developers and creators, Roblox plans to implement usage limits to ensure fair distribution of resources1.