Your creative AI assistant to generate ART from textual descriptions

We introduce YaART

A novel production-grade text-to-image diffusion model aligned with to human preferences using Reinforcement Learning from Human Feedback (RLHF). Our safe-to-use AI system is remarkable for its creativity and strict prompt following. Users consistently prefer YaART’s high expressive capabilities over alternatives *
*
According to a user study on YaBasket and DrawBench benchmarks reported in the paper
YandexART powers Shedevrum and is used in Yandex advertisement services and as e-commerce business. It allows both general and specialized audiences to explore and create without limits.
Developers and Foundation Models customers can access YandexART via API or Playground.
Example of YandexART generating detailed human faces in various contexts
Example of YandexART generating detailed human faces in various contexts
Example of YandexART generating detailed human faces in various contexts
Example of YandexART generating detailed human faces in various contexts
Example of YandexART generating detailed human faces in various contexts
Example of YandexART generating detailed human faces in various contexts
Example of YandexART generating detailed human faces in various contexts
Example of YandexART generating detailed human faces in various contexts
Examples of YandexART generating detailed human faces in various contexts

Generation Quality
and Prompt Following

AI models learn to generate images from textual descriptions using the examples provided to them during training. Completeness of the concept representation in data and the level of text-to-image relevance are common factors limiting the performance of generative models.
Understanding that, we ensure completeness in our training set by carefully filtering our initial 110B image-text pool, allowing YandexART to learn more than any other generative system. After pre-training on the generic data, we fine-tuned our system to a small set of carefully selected samples with remarkable image quality and image-text relevance. As a result, YandexART shines with precise prompt following and exceptional generation variability, including its ability to generate art and photorealistic images.

Exploring the Full Potential
of Image Generation
with RLHF

Though beauty lies in the eye of the beholder, there exists an inherent splendor that calls to us all, stirring a collective agreement in its presence.
RLHF is a powerful tool known to empower generative language models. As the alignment of LLMs makes their generations more natural and logical, the alignment of our diffusion model makes generated images more aesthetic and consistent. Empowered by RLHF, YandexART can better understand human aesthetic preferences, allowing it to generate visually appealing pictures without tedious re-generation and prompt engineering.
Image Generation 
without RLHF
Image Generation 
with RLHF
«Cat does yoga» (01 / 04)
«baba yaga’s house in the style of Salvador Dali» (02 / 04)
Image Generation 
without RLHF
Image Generation 
with RLHF
Image Generation 
without RLHF
Image Generation 
with RLHF
«A candid photo of a young boy with his face covered in chocolate.» (03 / 04)
«A florist arranging a colorful bouquet, her hands working seamlessly through the flowers.» (04 / 04)
Image Generation 
without RLHF
Image Generation 
with RLHF
Examples of RLHF improving aesthetics and consistency.

Safety

YandexART takes the safety and security of AI very seriously. We strive to create a tool that perfectly suits both work environments and home use. For this purpose, we have implemented advanced image content filtering technology, which filters out potentially harmful content from the image data before adding it to our AI system’s training set. Thanks to content filtering, you can always trust YandexART to deliver safe and appropriate images.
We are committed to providing a high-quality AI system that is powerful, efficient, and safe for everyone. Our image content filtering technology is constantly updated to meet the latest standards, ensuring that YandexART remains reliable and secure.

Acknowledgments

We acknowledge the effort of those who helped with and provided feedback on this release: Artur Vasilov, Nikolai Gavrilov, Timur Nurutdinov, Vadim Petrov, Andrei Nechaev, Evgenii Bogdanov, Daniil Aksenov, Grigorii Kosarev, Maxim Govorov, Ivan Degtev, Konstantin Lakhman, Alexey Gusakov.
Tue Apr 09 2024 10:21:37 GMT+0300 (Moscow Standard Time)