Building the Future of Image Generation with Ideogram's CEO
Mohamad, founder/CEO of Toronto-based Ideogram (speaker A), on shipping their first **open-weights image model at 9.3B parameters — roughly 9× smaller than the ~80B 'SOTA'** and runnable on a single consumer GPU. The whole interview is a clean case study in a David-vs-Goliath wedge: **'we know we can't win on scaling'** — as an ex-Googler he's blunt that 'even if we raise 10x... we can beat Google in terms of the number of chips' is false — so the strategy is the inverse: win on *focus, differentiation and taste* in a niche the big labs ignore. Ideogram's wedge from day one was accurate **text rendering** (when image gen 'was synonymous with garbled text' and DALL·E 2 made meme travel-posters with wrong city names), which turned out to be 'the whole graphic design and storytelling industry.' Two ideas travel well beyond image models. First, **taste as a deliberate, measured moat**: 'we really want our models to have taste,' defined as 'going outside of the norm... not conforming to the average opinion — which is a little against being on top of the leaderboard'; he ran *very little RL* on purpose so the model stays stylistically diverse rather than converging on the same RL-flattened look every frontier model produces, and uses human designers (not AI) for side-by-side taste evals. Second, **the intermediate representation**: the model is trained only on JSON prompts (~4,000 tokens), so a language model expands a vague idea into structured JSON and the diffusion model renders it — 'making the task as straightforward as possible for the diffusion model' — and they *show users the actual model input* (unlike OpenAI/Google) to give control and consistency, likely migrating from custom JSON to HTML since LLMs already know it. Open weights is the GTM: partner with chip-makers, inference providers and enterprises who want on-prem, on-device and brand-DNA fine-tuning. And the build loop is already agentic — 'in a couple hours you have your landing page up and running' from an agent hitting their API/MCP. Direct line to last week's Fadell thesis: as models commoditise, taste and use-case fit, not raw capability, are the differentiator.
Key points
- The headline build: a 9.3B-parameter open-weights model, ~9× smaller than the ~80B 'SOTA', that runs on a single/consumer GPU and reaches the level of 'Nanobanana or GPT Image' on text and photorealism — chosen because 'there's still so much to do' on innovation rather than scale.
- The explicit wedge — 'we can't win on scaling': as an ex-Googler, Mohamad says even a 10× raise can't beat Google on chips, so Ideogram competes on focus (graphic design / editable text), differentiation, and open weights to be 'at least another option for people who care about design.'
- Taste as a measured moat, not a vibe: 'we really want our models to have taste' = 'going outside of the norm... not conforming to the average opinion, which is a little against being on top of the leaderboard'; he ran deliberately little RL to keep the model a 'raw' multi-style generator instead of the same RL-flattened look frontier models repeat — and evaluates taste with human designers because 'AI is not very good at doing the actual taste evaluation yet.'
- Original differentiation was accurate text rendering when image gen 'was synonymous with garbled text' (DALL·E 2 travel-poster memes) — which unexpectedly was 'the whole graphic design and storytelling industry,' making typography/logo/t-shirt design Ideogram's brand.
- The training recipe: go image→text with detailed bounding-box and per-element descriptions (via VLMs, far richer than the short/inaccurate internet alt-text the early models used), then train text→image backwards — so quality tracks how precisely the data describes every element.
- JSON prompting as an intermediate representation: the model is trained ONLY on ~4,000-token JSON, an LLM expands a vague idea into that structure ('Magic Prompt'), and — unlike OpenAI/Google — Ideogram shows users the actual model input for control and consistency; the representation may shift from custom JSON to HTML since LLMs are already trained on it.
- 'It's not about how good a model is in the general sense. It's about how good is this model for my use case' — the customization thesis: artists with ~15-50 pieces fine-tune to their own style (an artist-in-residence got '3x faster' on a comic book), and enterprises whose brand guidelines generic models miss get custom models that 'understand my brand DNA.'
- Three customization tiers map to budget: open-source quantized weights (free/low), Ideogram's self-serve training app ($60 for 2 trainings/month, ≥15 images), and white-glove enterprise work where their annotation team curates brand-specific prompts/keywords/mascots.
- Open weights is the go-to-market, not charity: it lets Ideogram partner with chip-makers, inference providers and enterprises for on-prem, on-device and data-sovereignty use — 'we are very serious about building the foundation model and we would like to work with you, whoever you are.'
- The build workflow is already agentic: Ideogram runs its own MCP internally — 'ask it to connect to the API and generate a bunch of images... in a couple hours you have your landing page up and running' — with the open problem being automated evaluation in the loop so a human needn't inspect every output.
Notable quotes
It's not about how good a model is in the general sense. It's about how good is this model for my use case.
We focused on the details of the model and we know we can't win on scaling.
I used to work for Google. I don't think even if we raise 10x the amount we've raised so far, we can beat Google in terms of the number of chips that we can dedicate to each model training.
One element of taste is kind of being— going outside of the norm a little bit and not conforming to the average opinion, which is a little against being on top of the leaderboard.
We really want our models to have taste.
I don't think a lot of labs are focusing on design, graphic design in particular, editable text that I'm talking about.
you can go into your agents and then ask it to connect to the API and generate a bunch of images and then you can go and find the best ones and like in a couple hours you have your landing page up and running.
the recipe for building more powerful models, in my opinion, is making the task as straightforward as possible for the diffusion model.
Themes
- David-vs-Goliath wedge (focus over scale)
- taste as a competitive moat
- open-weights distribution strategy
- customization for enterprise brand
- intermediate-representation prompting
Mentioned
People
Ideas
- open weights as go-to-market
- compete on focus not scale
- taste as a measured moat
- low-RL for stylistic diversity
- JSON / intermediate-representation prompting
- image-to-text-to-image training recipe
- fine-tuning for brand DNA
- editing vs customization
- on-device small models
- agentic creative workflow
- visual brand diversity exceeds text