Stability AI, a pioneering startup known for its image-generating model, Stable Diffusion, is unveiling Stable Doodle, a novel service that transforms sketches into vibrant images. The newly launched sketch-to-image service harnesses the advanced capabilities of the Stable Diffusion model to analyze sketch outlines and produce visually pleasing artistic renditions.
Available via ClipDrop, a platform acquired by Stability through its purchase of Init ML—an AI startup founded by former Google employees—Stable Doodle opens up a world of creative possibilities.
How capable is Stability AI’s Stable Doodle?
In a blog post they shared, Stability AI emphasizes that Stable Doodle caters to both professionals and novices, regardless of their familiarity with AI tools. The service empowers individuals with basic drawing skills and internet access to generate high-quality original images in a matter of seconds.
While there are existing sketch-to-image AI tools, including open-source projects and ad-supported apps, Stability AI claims that Stable Doodle stands out by offering precise control over the image generation process.
At the core of Stable Doodle lies the Stable Diffusion model, specifically Stable Diffusion XL, coupled with a “conditional control solution” developed by Tencent’s Applied Research Center (ARC). This control solution, called T2I-Adapter, enables Stable Diffusion XL to accept sketches as input and guides the model in fine-tuning the output artwork for better results. By comprehending sketch outlines and incorporating prompts defined by the model, T2I-Adapter empowers Stable Doodle to understand the user’s intentions and generate images accordingly.
Exciting Announcement! Stability AI proudly presents Stable Doodle, our groundbreaking sketch-to-image tool!
🖌️Unleash your creativity as a simple drawing transforms into a vibrant, dynamic image. #StabilityAI
Read more https://t.co/Oy4lGSv2e9 pic.twitter.com/vrGGlMY37f
— Stability AI (@StabilityAI) July 13, 2023
How good is the new tool?
The cherry-picked images showcased impressive quality compared to the original doodles that inspired them. Alongside a sketch, the new tool allows users to provide prompts that guide the image generation process. For example, a prompt could be “A comfy chair, isometric style” or “Cat with a jeans jacket, digital art style.” However, it’s worth noting that at launch, the new feature supports only 14 styles of art, limiting the customization options.
The company envisions Stable Doodle as a valuable tool for designers, illustrators, and other professionals, enabling them to save time and enhance efficiency in their work. The company emphasizes that the quality of output images depends on factors such as the level of detail in the initial drawing, the descriptive nature of the prompt, and the complexity of the depicted scene.
The company proposes that ideas conceptualized as sketches can be swiftly transformed into designs for clients, materials for presentation decks and websites, or even logos. Looking ahead, Stable Doodle plans to incorporate features that allow users to import sketches and explore industry-specific use cases, such as real estate applications.
With such new tools, the company aims to diversify its revenue streams following a period of reduced commercial activity. While Stable Doodle is currently available for free, there are certain limitations in place. In April, Semafor reported that Stability AI was facing financial challenges, leading the company to embark on an executive search to bolster sales efforts.
Last month, the company secured $25 million through a convertible note, bringing its total funding to over $125 million. However, the startup has yet to secure new funding at a higher valuation. Previously valued at $1 billion, the company reportedly aims to quadruple its valuation within the next few months as it forges ahead.
If you are interested in the image generative AI software, make sure to check out how you can enhance your images with Stability AI’s new SDXL 0.9.
Featured Image: Credit
