OpenAI open source project for ‘text-to-image’ software – New DALL•E 2

OpenAI for free. OpenAI is dedicated to creating a full suite of highly interoperable Artificial Intelligence components that make the best use of today’s technologies. Current tools include Mobile Agents, Neural Networks, Genetic Algorithms and Finite State Machines.

newest system, DALL·E 2, generates more realistic and accurate images with 4x greater resolution.

DALL·E 2 can create original, realistic images and art from a text description. It can combine concepts, attributes, and styles.

DALL·E 2 can expand images beyond what’s in the original canvas, creating expansive new compositions.

DALL·E 2 can make realistic edits to existing images from a natural language caption. It can add and remove elements while taking shadows, reflections, and textures into account.

DALL·E 2 can take an image and create different variations of it inspired by the original.

DALL·E 2 has learned the relationship between images and the text used to describe them. It uses a process called “diffusion,” which starts with a pattern of random dots and gradually alters that pattern towards an image when it recognizes specific aspects of that image.

DALL·E 1

DALL·E 2

a painting of a fox sitting in a field at sunrise in the style of Claude Monet”

DALL·E 2 is preferred over DALL·E 1 for its caption matching and photorealism when evaluators were asked to compare 1,000 image generations from each model.

71.7% preferred for caption matching

88.8% preferred for photorealism

OPENAI has limited the ability for DALL·E 2 to generate violent, hate, or adult images. By removing the most explicit content from the training data, it minimized DALL·E 2’s exposure to these concepts. It also used advanced techniques to prevent photorealistic generations of real individuals’ faces, including those of public figures.

Learning from real-world use is an important part of developing and deploying AI responsibly. We began by previewing DALL·E 2 to a limited number of trusted users. As it learned more about the technology’s capabilities and limitations, and gained confidence in our safety systems, it slowly added more users and made DALL·E available in beta in July 2022.

DALL·E 2 also helps us understand how advanced AI systems see and understand our world, which is critical to our mission of creating AI that benefits humanity.

https://openai.com/dall-e-2/