Stability AI, OTOY, Endeavor and The Render Network are joining forces to develop next-generation AI models, IPR systems and open standards based on decentralized GPU computing

Updated 6 months ago on May 06, 2024

Emad Mostak, founder and CEO of Stability AI, joins Ariel Emanuel and Beeple on the Render Network advisory board to standardize, design and implement new Gen AI workflows and authentication systems on Render, the industry's first and largest decentralized GPU computing platform.

OTOY, Stability AI, Endeavor and Render Network are pleased to announce a partnership between industry leaders in open source generative AI models, media and entertainment and GPU computing to develop and standardize intellectual property rights, production workflows and infrastructure around emerging AI technologies.

Stability AI, OTOY, Endeavor, and The Render Network Join Forces to Develop Next Generation AI Models, IP Rights Systems, and Open Standards Powered by Decentralized GPU Computing
Examples of OctaneRender leveraging experimental SV3D models for enhanced 3D rendering in many styles at once.
Examples of OctaneRender leveraging experimental SV3D models for enhanced 3D rendering in many styles at once.
Examples of OctaneRender leveraging experimental SV3D models for enhanced 3D rendering in many styles at once.
Examples of OctaneRender leveraging experimental SV3D models for enhanced 3D rendering in many styles at once.
The partnership leverages Render’s decentralized GPU network, massively scaling AI training and inference power at cost to help democratize open source, transparent, generative AI technology and provenance systems that will soon impact 3D, VFX and Media production workflows.
As part of the integration, Stability AI models will leverage provenance systems already established on Render Network - known as Proof-of Render - providing immutable receipts and tracking of all individual components ingested and used for output of computing work on-chain. Through transparent on-chain data, royalty flows for IP and assets used in AI models, as well as their outputs, can be managed using public auditable smart contracts.

The partnership leverages Render's decentralized network of GPUs, scaling AI training and inference capabilities at cost to help democratize the open, transparent, generative AI technologies and authentication systems that will soon impact workflows in 3D, VFX and media production.

Stability AI will join OTOY as a member of the Immersive Digital Experiences Alliance (IDEA) to help develop open standards and protocols for inputting Gen AI models into 3D workflows - including product design, motion graphics, VFX, composition, spatial and holographic endpoints - that can be adapted by standards organizations across the media and entertainment ecosystem.

As part of the collaboration, Endeavor will work with Stability AI, Render Network and OTOY to create transparent IP tracking tools for emerging ML models, publishing their research for peer review through IDEA. This work will include leveraging OTOY's LightStage technology - OTOY's industry-leading reflective field facial scanning and digital twin platform - to create licensing tools that allow artists to control their image and receive royalties for their IP when used in generative AI models.

OTOY and Stability AI will work together to optimize Stability AI models to run on the Render Network's peer-to-peer pool of consumer GPUs with the ability to deliver results to the more than 26 widely used mainstream 3D software tools supported by the network. The native integration of Stability AI models into the Render Network provides seamless integration of large AI models and 3D content workflows, access to web-based APIs for third-party applications, and the ability to scale to a waiting list of more than one million consumer GPUs to create next-generation media models.

Including today's launch of Stable Video 3D, a state-of-the-art new model for view synthesis and 3D generation. Leveraging the power of Render Network's world-class decentralized GPU platform, 3D and other media models will rely on both computation and community participation. New models include the long-awaited Stable Diffusion 3, the leading image model in various tests , as well as new language, code, and sound models.

As part of the integration, Stability's AI models will utilize the Render Network's already established authentication systems known as Proof-of-Render , providing immutable receipts and tracking of all individual components entering and used to output computational work on the blockchain. With transparent data on the blockchain, royalty streams for IP and assets used in AI models, as well as their outputs, can be managed through publicly verifiable smart contracts.

Stability AI founder and CEO Emad Mostaque will reveal additional details about the partnership at the Abundance 360 conference on Monday, March 18, and on March 20 during an appearance at the USC VanEck Southern California Blockchain Conference. OTOY founder and CEO Jules Urbach will speak about the partnership on March 20 at NVIDIA's GPU Technology Conference (GTC), April 16 at NAB and May 4 at the Beeple Studios Digital Art Death Match as a keynote speaker.

According to Stability AI founder and CEO Emad Mostak, "I joined the Render Network advisory board to shape the future of decentralized computing and AI. My vision is to create transparent next-generation AI models without closed source code and leverage the Render Network's computing infrastructure to ensure that it doesn't become the domain and domain of a few centralized players." Mostak added: "We must democratize access to this powerful technology to expand creative opportunities for all while innovating with integrity."

"AI is fundamentally changing the landscape of media and entertainment, on par with the Internet and the advent of television," said Ariel Emanuel, CEO of Endeavor. "Jules and his team have been pushing the boundaries of such technologies for over two decades, before anyone was even seriously thinking about GPUs for rendering, data centers or artificial intelligence. This partnership is an important step towards helping artists, creators and rights holders control and manage their works and intellectual property in the age of AI," Emanuel added.

"Today's partnership with Stability AI and Endeavor is an important milestone that will shape the future of transparent, artist-driven artificial intelligence workflows and tools that operate at the scale of decentralized computing and enable creators and publishers to leverage their work and IP in training, inference and rendering," said OTOY CEO and Render Network founder Jules Urbach. "Our mission has always been to democratize new technologies for artists and creators. To that end, our joint R&D work with Stability AI aims to bring production-ready neural rendering to Octane and other 3D renderers in the coming year." And with today's joint SV3D announcement, the deep integration of Stability AI's latest advanced 3D and multimodal models developed and optimized for The Render Network will also help accelerate the development of the next generation of AI with 3D tools for creators," added Urbach.

"When Octane introduced fast GPU rendering for artists like me ten years ago, it changed everything. It allowed me to create my 3D paintings in near real time, giving me even more control over the final image," says digital artist Beeple. "I am excited about this partnership as I believe that image-to-image AI filters will become an integral part of 3D workflows in the future, unlocking even more creativity and giving artists even more control over what is possible. I see great potential to further improve this process and am excited to work towards this goal in collaboration with Ari, Emad and Jules," added Beeple.

About Stability AI

Stability AI is the world's leading open source generative AI company. We create breakthrough AI models with open access and minimal resource requirements in visualization, language, code, and audio.

About the Render Network Foundation

The Render Network Foundation is the governing organization for the world's leading decentralized computing network, the Render Network. The network connects node operators looking to monetize their idle GPU computing power, with artists looking to scale intensive 3D rendering work, and machine learning developers looking to train and tune AI models. With its decentralized peer-to-peer network, Render Network achieves unprecedented levels of scale, speed, and cost efficiency.

About OTOY Inc.

OTOY Inc. is a leading cloud graphics company, an innovator in technology that is redefining content creation and delivery for media and entertainment organizations worldwide. OTOY's Academy Award-winning technology is used by leading visual effects studios, artists, animators, designers, architects and engineers, providing unprecedented creative freedom, a new level of realism and a new economy in cloud-based content creation and distribution.

Let's get in touch!

Please feel free to send us a message through the contact form.

Drop us a line at mailrequest@nosota.com / Give us a call over skypenosota.skype