Flag

We stand with Ukraine and our team members from Ukraine. Here are ways you can help

Home ›› Artificial Intelligence ›› Flux.1 is a Mind-Blowing Open-Weights AI Image Generator with 12B Parameters

Flux.1 is a Mind-Blowing Open-Weights AI Image Generator with 12B Parameters

by Jim Clyde Monge
5 min read
Share this post on
Tweet
Share
Post
Share
Email
Print

Save

Dive into the world of Flux.1, the groundbreaking AI model with 12 billion parameters that sets a new benchmark in image generation. This article reveals how Flux.1 outperforms models like Midjourney V6 and Dall-E 3 in visual detail, prompt adherence, and diversity. Discover the innovative technology behind Flux.1, including flow matching and rotary positional embeddings, and learn how the transition from Stability AI to Black Forest Labs is driving this advancement. Perfect for AI enthusiasts and digital artists alike, explore how Flux.1 is redefining digital creativity and its future impact on the industry.

Flux.1 has arrived, setting a new benchmark in the world of open-weight image models. With 12 billion parameters, it surpasses industry giants like Midjourney V6, OpenAI’s Dall-E 3, and Stability AI’s SD3 Ultra in terms of image quality and performance.

The team behind Flux.1 has an interesting history.

They’re the original developers of the technology that powers Stable Diffusion and the inventors of latent diffusion. Following some internal issues at Stability AI, key team members left to form a new startup called Black Forest Labs.

This kind of “tech exodus” often leads to innovation. When talented individuals branch out on their own, they’re free to pursue bold new ideas without the constraints of larger organizations.

What is Flux.1?

Flux.1 is a suite of text-to-image models that define a new state-of-the-art (SOTA) in image detail, prompt adherence, style diversity, and scene complexity for text-to-image synthesis.

It comes in three variants:

  • Flux.1 Pro: This offers state-of-the-art performance in image generation, delivering top-notch prompt following, visual quality, image detail, and output diversity.
  • Flux.1 Dev: This is an open-weight, guidance-distilled model designed for non-commercial use. It is distilled from Flux.1 Pro, achieving similar quality and prompt adherence while being more efficient than a typical model of the same size.
  • Flux.1 Schnell: This is their fastest model and is designed for local development and personal use. It is openly available under an Apache 2.0 license.

All public Flux.1 models use a mix of multimodal and parallel diffusion transformer blocks and have 12 billion parameters. These models are better than earlier diffusion models because they use flow matching, an easy-to-understand method for training generative models that includes diffusion.

Additionally, the models perform better and use hardware more efficiently by using rotary positional embeddings and parallel attention layers.

Better than Midjourney?

According to the researchers, Flux.1 Pro and Flux.1 Dev surpass popular models like Midjourney v6.0, Dall-E3, and Stable Diffusion 3 Ultra in each of the following aspects:

  • Visual quality
  • Prompt coherence
  • Size and aspect variability
  • Typography
  • Output Diversity

But does it, really?

All Flux.1 model variants support a diverse range of aspect ratios and resolutions between 0.1 and 2.0 megapixels, as shown in the following example.

Example images

Check out some of the mind-blowing example images generated with Flux.1 Pro. Let’s start with an image of people with a primary focus on the fine details, like hair, wrinkles, fingers, and limbs.

The level of detail in human features like hair, wrinkles, and fingers is remarkable.
A robot holding chalk looking at a blackboard that reads the following poem: ”ln pixels’ dance, AI’s craft will rise, Transforming visions through machine eyes, From dreams to screens, new worlds unfurled, AI’s brush reshapes our visual world.”

Text rendering is one of the hardest areas in AI image generation. Even the latest version of Midjourney v6.1 still fails on my initial tests. Flux.1 seems to be really good, even with long texts.

A beautiful anime artwork, a cute anime catgirl that looks depressed holding a piece of paper with a smile drawn on it over her mouth, she is about to cry.

This looks incredibly promising. The soft tones and glowing highlights give it a professional, polished look that rivals hand-drawn artwork.

Watch the YouTube video below for different ways to try Flux.1 for free!

Next level photorealism

Some users who had access to Flux were quick to discover how eerily realistic the images are. Here are some of the most realistic selfie portraits shared on X.

As someone who’s experimented with various AI image generators, I can confidently say these are some of the most lifelike AI-generated portraits I’ve seen.

How to access Flux.1

For those eager to try Flux.1, there are several free options available:

Here’s an example generation with Replicate:

The world’s largest black forest cake, the size of a building, surrounded by trees of the black forest.

Here’s another demo of Flux in Fal:

Extreme close-up of a single tiger eye, direct frontal view. Detailed iris and pupil. Sharp focus on eye texture and color. Natural lighting to capture authentic eye shine and depth. The word “FLUX” is painted over it in big, white brush strokes with visible texture.

And finally, here’s an example screenshot of Flux in HuggingFace:

An image of an astronaut riding a horse in space.

Access via API

Flux.1 Pro can also be accessed via API here. It is currently in preview mode; some limitations apply.

  • Accounts are only activated for selected partners.
  • The API is not stable and is subject to change.

Check out the full process of how you can use the API here.

Commercial Use and Licensing

Now, some of you might be thinking, can I sell or distribute the images for commercial purposes? Well, the answer is yes or no, depending on the model you use.

  • Flux.1 Pro: Commercial use of Flux.1 Pro is supported, but access to this model is currently limited to partners through platforms such as Replicate and Fal.ai.
  • Flux.1 Dev: Use of the images is restricted to non-commercial purposes, meaning you cannot sell or distribute images generated by this model for commercial gain.
  • Flux.1 Schnell: It is openly available under an Apache 2.0 license, which allows for more flexibility in use. This means that you can use Flux.1 Schnell for both personal and commercial purposes, provided you comply with the terms of the Apache 2.0 license.

In summary, if you are looking to use Flux.1 models for commercial purposes, Flux.1 Pro and Flux.1 Schnell are your best options. Flux.1 Pro provides the highest quality and is available through specific partnerships, while Flux.1 Schnell offers a more accessible solution under an open-source license.

Final Thoughts

While the open-weight nature of Flux models is exciting, there’s a practical limitation to consider. Running these models locally alongside a large language model (LLM) requires significant computing power—typically an A100 GPU or better. With 12 billion parameters (24 GB on disk) plus a 9 GB text encoder, Flux.1 is beyond the capabilities of most consumer-grade hardware.

The open-weights model, Schnell, is already very good. I have no doubt that the community will work to find novel techniques to tune, train, and extend the step-distilled Apache 2.0 version. I am very excited to see amazing, fine-tuned models come out and generate mind-blowing images.

In the upcoming articles, I will compare Flux with Midjourney, Dall-E 3, and Gemini 2. I also plan to write a guide on how to run Flux Schnell on your local machine.

The article originally appeared on Medium.

Featured image courtesy: Vimal S.

Follow the author on LinkedIn, Zeniteq, and YouTube to stay in the loop with the latest AI stories and updates on generative AI.

post authorJim Clyde Monge

Jim Clyde Monge, Software engineer / AI enthusiast / Technical writer / Chief Editor at generativeai.pubzeniteq.com

Tweet
Share
Post
Share
Email
Print
Ideas In Brief
  • This article examines Flux.1’s 12 billion parameters and its advancements over Midjourney and Dall-E 3. Highlights its superior image detail and prompt adherence.
  • The piece explores the shift of developers from Stability AI to Black Forest Labs and how this led to Flux.1. Analyzes the innovation impact.
  • It compares Flux.1 with Midjourney V6, Dall-E 3, and SD3 Ultra, focusing on visual quality, prompt coherence, and diversity.
  • The guide explains how to access Flux.1 via Replicate, HuggingFace, and Fal. Covers the different models—Pro, Dev, Schnell—and their uses.
  • The article investigates Flux.1’s capabilities in generating photorealistic and artistic images with examples of its realism and detailed rendering.

Related Articles

Discover the future of user interfaces with aiOS, an AI-powered operating system that promises seamless, intuitive experiences by integrating dynamic interfaces, interoperable apps, and context-aware functionality. Could this be the next big thing in tech?

Article by Kshitij Agrawal
The Next Big AI-UX Trend—It’s not Conversational UI
  • The article explores the concept of an AI-powered operating system (aiOS), emphasizing dynamic interfaces, interoperable apps, context-aware functionality, and the idea that all interactions can serve as inputs and outputs.
  • It envisions a future where AI simplifies user experiences by seamlessly integrating apps and data, making interactions more intuitive and efficient.
  • The article suggests that aiOS could revolutionize how we interact with technology, bringing a more cohesive and intelligent user experience.
Share:The Next Big AI-UX Trend—It’s not Conversational UI
5 min read

Curious about the next frontier in AI design? Discover how AI can go beyond chatbots to create seamless, context-aware interactions that anticipate user needs. Dive into the future of AI in UX design with this insightful article!

Article by Maximillian Piras
When Words Cannot Describe: Designing For AI Beyond Conversational Interfaces
  • The article explores the future of AI design, moving beyond simple chatbots to more sophisticated, integrated systems.
  • It argues that while conversational interfaces have been the focus, the potential for AI lies in creating seamless, contextual interactions across different platforms and devices.
  • The piece highlights the importance of understanding user intent and context, advocating for AI systems that can anticipate needs and provide personalized experiences.
Share:When Words Cannot Describe: Designing For AI Beyond Conversational Interfaces
21 min read

Uncover the dynamic landscape of UX design as artificial intelligence continues to reshape the field. With automated tools revolutionizing our roles, what does the future hold for designers?

Article by Michal Malewicz
The End of Design?
  • The article explores the impact of AI on UX design, questioning the future role of designers as automated tools become more prevalent.
  • It highlights the historical evolution of UX design and the commodification of design roles, emphasizing the shift from creative problem-solving to efficiency-driven practices.
  • It emphasizes the need for future designers to be generalists with strong decision-making skills, capable of leading projects and maintaining creativity in an AI-driven landscape.
Share:The End of Design?
9 min read

Tell us about you. Enroll in the course.

    This website uses cookies to ensure you get the best experience on our website. Check our privacy policy and