Florida International University, doctoral research

Inferential Discovery and Design Adaptation in Visual Generative Workflows

Research question

How does a designer’s relationship to their visual work in progress shift when inferential discovery can recur across a generative workflow?

In a generative workflow, model inference produces or transforms visual material, and that material can become grounds for the designer’s inference: the designer can take something visible in it to support a conclusion about the work in progress.

Where a workflow invokes model inference recurrently rather than episodically, the work can change through model inference at more points in the process, and the occasions on which the designer finds something consequential can recur. The possibility of recurrent inferential discovery makes this research an inquiry into deciding under an abundance of options.

The research examines how designers exercise agency in responding to inferential discovery across workflows that combine automated production with direct editing, compositing and physical making. It asks how the conditions of their work can enable or constrain what they can do.

Human inference is drawing a conclusion from available information and prior understanding. The word also names the conclusion drawn.

When information is limited, prior knowledge can shape which explanations a person considers and how plausible they find them (Tenenbaum and colleagues).

In his account of human reasoning with beliefs, Boghossian explains that a person draws a conclusion because they take other beliefs to support it. In design work, a designer can take something visible in the work as grounds for a conclusion about it.

In machine learning, inference applies a trained or fitted model to supplied input to produce a prediction or generated result.

In neural networks, training adjusts numerical weights and other parameters using data; inference processes the supplied input through the network using those learned values (Google machine learning glossary).

A text-to-image system, for example, uses a trained model to generate an image guided by a prompt (Rombach and colleagues). That image becomes visual material from which the designer can draw an inference.

In natural language processing, a trained model can perform a task called natural language inference by predicting whether a premise entails, contradicts, or is neutral toward a hypothesis (Bowman et al., 2015). Using inference for both people and models can encourage anthropomorphism when the shared term is taken to imply human reasoning or understanding. Following McDermott (1976) and Shanahan (2024), this account describes model inference through the mechanisms that produce its results.

In this research, an inference a designer finds becomes an inferential discovery as the designer determines what it means for adaptation and continuation of their work.

Design adaptation names the changes a discovery can prompt in the material being developed and the aims guiding it. It develops through situated judgments, and a judgment can shape the work the designer encounters in subsequent decisions, as when the designer prepares what the next generation receives (Suchman, 1987; Hutchins, 1995; Kirsh, 1995).

Here, abundance includes the information available in generated material, the possibility of further discovery, and the range of responses available across blended practice. A blended practice combines generative computation with other ways of making and editing, within one application or across several.

Simon (1971) observed that “a wealth of information creates a poverty of attention.” Abundance in this inquiry carries that cost: each generated result, each route through blended practice and each possible further discovery asks for judgment.

A designer can pursue something found in a generated result through another kind of operation. The response may develop the existing material, change the conditions of further production, or change the intention guiding the work. Further discovery can remain possible whichever response the designer chooses. That possibility can affect present decisions about continuation, as the designer considers what further work might reveal.

Further discovery need not depend on generating another output. Relationships can also become apparent through working with material already available. In his account of designing as reflective conversation with materials, Schön describes how designers’ moves can reveal unintended consequences and how their intentions can develop through the work. A discovery can change the designer’s understanding without being incorporated into a finished artifact.

More available material does not establish what matters to the designer. An undesirable result can occasion a consequential discovery.

Further discovery can occur after work has come to depend on an earlier decision. Reconsidering that decision can then affect the work that depends on it. What pursuing an interpretation requires depends partly on the possibilities for further work that remain after an operation. Those requirements can affect whether and how the designer continues.

Green and Blackwell call this resistance to change viscosity: changing one part of a working structure can require further changes to connected parts.

Continuation concerns what becomes of the work as the designer responds to it, including the possibility of deciding not to proceed. The work can be sufficient for its purpose while further discovery remains possible. A decision to stop can therefore rest on what the work accomplishes. Looking only at a finished output would leave much of the designer’s response and its consequences unexplained.

How the designer continues the work depends partly on their reasons and agency—the exercise of their capacity to act. The amount of automated production alone does not establish that capacity or explain how it is exercised.

The research has a technical component and a qualitative component: the Inference Resolution Map assesses software operations, and a visual workbook examines the designer’s response through evolving workflow examples.

4How does the map compare software operations?

The Inference Resolution Map assigns provisional X coordinates on a proposed scale of how trained or fitted prediction affects an operation’s returned result. Because what prediction determines depends on the task and its implementation, the map assesses named software tasks, provisionally defined here as operations. For each operation, the assessment identifies the software version, model where applicable, and settings relevant to its predictive task and computation.

For each operation, the assessment asks what the designer specifies, what specified computation determines, and what depends on prediction from a trained or fitted model in the returned result. The predictive task receives graded ratings describing what prediction determines in producing the returned result (scope), how much the supplied material and task leave the model to resolve (latitude), and which relationships it resolves together (coordination). X combines these ratings with implementation counts of the model’s parameters and computation. X is 1 when trained or fitted prediction makes no contribution to the returned result; where prediction contributes, X moves toward 0 as the ratings and transformed counts increase:

X = 1 − R[½(S + U + J3 × 5) + ½(p + c2)]

Ratings describe the task the prediction performs. Each is scored 0–5 against written anchors, and the support for a rating depends on the documentation, code, model files or papers available for the assessed implementation.

5 Inference Resolution Map

↓

Current coordinates use 0–1 units; displayed values are rounded to three decimal places.

6Proposed contribution

The contribution I am developing is a shared vocabulary for designers and a method for comparing operations, and for comparing designers’ responses to what those operations produce, so that claims about agency and automation can be examined against both technical evidence and documented visual practice.

The qualitative component is a visual workbook in Miro of evolving workflow examples. The examples connect supplied material and relevant settings with working versions and, where a discovery is documented, the designer’s account of it and what follows from the response. Through the examples, the research examines how the designer’s understanding, aims and judgments develop within the work, including what makes a result “coherent enough”: sufficient for its purpose, even when further discovery remains possible. Comparing the examples can test and refine the vocabulary for describing discoveries, what the available evidence supports about them, and the forms continuation takes. Where the records support a distinction the existing terms do not describe, the vocabulary is revised or extended.

The workbook accounts can record how intentions develop and state the criteria behind judgments that designers may otherwise make tacitly (Schön and Wiggins, 1992). The aim is for someone working on different material to take up, question and develop the distinctions and questions developed through the examples (Green and Blackwell, 1998; Gaver and Bowers, 2012; Yuan et al., 2026).

In practice, I have photographed my hands and edited reference images to convey relationships I had difficulty expressing through a text prompt alone. The workbook distinguishes what a prompt requests, what the operation’s mechanism supports, and what the designer then understands or values. That understanding can change what they prepare for the next operation.

Copper-figure example

The copper-figure example shows how the technical assessment could be connected to a designer’s response within a blended workflow, one that combines generative computation with other ways of making and editing. While developing the figure, I found that the head needed a bridge to the crown and considered a do-rag as a way to connect them. The process included generation, Photoshop Generative Fill, the Pen tool, layer masks and color grading. When generation failed to produce the required relationship, I constructed and composited the do-rag in Photoshop, then used the composite as the reference image for further generation. I accepted some loss of patina texture to retain the cultural fidelity I wanted in the do-rag.

The statue at nightThe player in a black satin do-ragThe championship trophy
References: the statue at night (left), the player in a black satin do-rag (center) and the championship trophy (right).
Working version with braids over the statue’s carved hairWorking version with a cloth band under the crownWorking version with a cloth band under the crown
Working versions: braids over the statue’s carved hair (left) and cloth bands under the crown (center and right).
The black satin do-rag composited onto the figureThe same image with the do-rag in patina greenA copper-toned night version with a cloth band under the crown, braids and the trophy
The figure with a black satin do-rag (left) and the do-rag in patina green (center). Right: a copper-toned night version with a cloth band under the crown, braids and the trophy.

Constructing the composite made the head–do-rag–crown relationship I had worked out part of the material supplied for further generation. This gives the technical assessment a specific question: how did the generative operation use that supplied relationship, and what did it determine in the returned material? Assessing that operation would require its software and model versions, relevant settings and technical evidence about how it uses reference material.

7Next steps

Test how independent assessors apply the written categories, using disagreements to refine the guidelines. Agreement would address consistency; category validity and X’s numerical calibration would require further evidence.

2024 — 2025

8Earlier research

Method history

The equation moved from aspect ratings to the combined method

  • August 2026 · Prototype catalogue of 417 rows, with coordinates proposed by research agents under broad numerical guidance.
  • 20 September · Five-aspect specification score: X = ∑Si, with subject, composition, form, appearance and detail each scored 0–3 by how they are supplied.
  • 21–27 September · Five opportunity-for-inference ratings: X = 15 − 3∑Oi.
  • 29 September – 1 October · X/Y maps: X from the September assessments, with Y added for revision capacity.
  • Early October · Reference comparisons: X = XL + t(XH − XL), placing an operation between two reference operations.
  • 4 October · Decision categories for 145 operations previously at X = 2: X = 2 + 3 × kept categories ÷ (applicable categories − 1).
  • 14 October · S/U/J calibration proposal across 399 operations: X = 15 − 13(S + U + J)/15.
  • 15 October · Combined method selected, adding model size and computation to the ratings: X = 15[1 − R((S + U + J)/30 + (p + c)/4)].
  • 19 October · Output settings stop moving X; computation is counted at the implementation’s published default.
  • 26 October · U1 retired; fidelity-directed recovery is coded U2 whatever the sampling change.
  • 28 October – 3 November · The 15-point scale is dropped and X runs from 0 to 1: X = 1 − R[½(S + U + J)/(3 × 5) + ½(p + c)/2].
2025

Modalities & spatial structures

Multimodal Spatial Intelligence

Earlier work examined how different input modalities supply partial spatial information, how generative systems resolve that information, and how people interpret the resulting structures.

Read 2025 paper ↗
2024–25

Teaching, tools, and individual learning

While teaching architecture in Miami, I explored how people could learn to use tools through experiences tailored to them. My early research considered visualization and gamification as ways of making learning interactive, with climate education as an initial context. The emphasis subsequently moved toward personalized education and how learning could respond to individual needs.

As generative practice became a stronger focus, my attention shifted toward what designers encounter while working with these tools. The current dissertation focuses on the designer’s response to inferential discovery.

Research timeline
OCTOBER–NOVEMBER 2024

Visualization and interactive learning

Literature review and research-paper drafts examined 3D visualization, gamification, and AI-supported personalization in climate education.

DECEMBER 2024

Architectural education and AI

A Digital Futures paper considered prospective changes to architectural education, curricula, and relationships between educators and students.

MARCH 2025

Personalized learning

Personalized Learning in Higher Education: AI-Driven Analytics and Competency-Based Models as Catalysts for Reform placed adaptive learning and individual needs at the center of the inquiry.

9Personal reading & sources

Listening is an important part of how I learn and develop my work. My reading and listening span technology, creativity, perception, culture, and lived experience.

Linked titles and covers open their audiobook editions on Audible.

Browse titles

78 titles

  • Feeling BeautyG. Gabrielle Starr
  • RangeDavid Epstein
  • The Nvidia WayTae Kim
  • PeakAnders Ericsson and Robert Pool
  • A Paradise Built in HellRebecca Solnit
  • Algorithms to Live ByBrian Christian and Tom Griffiths
  • The Anxious GenerationJonathan Haidt
  • Building a StoryBrandDonald Miller
  • The Thinking MachineStephen Witt
  • The Infinity MachineSebastian Mallaby
  • Worldwide Evil and Misery – The Legacy of the 13 Satanic BloodlinesRobin de Ruiter and Fritz Springmeier
  • Life on EarthDavid Attenborough
  • Breaking the Habit of Being YourselfJoe Dispenza
  • Blue MindWallace J. Nichols
  • OceanDavid Attenborough and Colin Butfield
  • Africa Is Not a CountryDipo Faloyin
  • Exactly What to SayPhil M. Jones
  • GoogooshGoogoosh and Tara Dehlavi
  • QuantumManjit Kumar
  • Visual ThinkingTemple Grandin
  • The Let Them TheoryMel Robbins
  • Only God Can Judge MeJeff Pearlman
  • It Was All a DreamJustin Tinsley
  • Tupac ShakurStaci Robinson
  • Unmasking AIJoy Buolamwini
  • Energy Healing for AnimalsJoan Ranquet
  • How the Word Is PassedClint Smith
  • CasteIsabel Wilkerson
  • Re-RegulatedAnna Runkle
  • Miracle and Wonder (Special Edition)Malcolm Gladwell and Bruce Headlam
  • David and GoliathMalcolm Gladwell
  • Claim Your PowerMastin Kipp
  • Your Debt PlanRachel Rodgers
  • AbundanceEzra Klein and Derek Thompson
  • WordslutAmanda Montell
  • Reclaim Your Nervous SystemMastin Kipp
  • The Mountain Is YouBrianna Wiest
  • The Creative ActRick Rubin
  • BlinkMalcolm Gladwell
  • I Hate the Ivy LeagueMalcolm Gladwell
  • Data FeminismCatherine D’Ignazio and Lauren F. Klein
  • OutliersMalcolm Gladwell
  • SapiensYuval Noah Harari
  • ShowboatRoland Lazenby
  • Revenge of the Tipping PointMalcolm Gladwell
  • NexusYuval Noah Harari
  • The Tipping PointMalcolm Gladwell
  • What the Dog SawMalcolm Gladwell
  • Finding MeViola Davis
  • SupercommunicatorsCharles Duhigg
  • DuneFrank Herbert
  • The Deep Learning RevolutionTerrence J. Sejnowski
  • Weapons of Math DestructionCathy O’Neil
  • Invisible WomenCaroline Criado Perez
  • Stop Living on AutopilotAntonio Neves
  • It’s All in Your HeadRuss
  • The Broken LadderKeith Payne
  • Evolve Your BrainJoe Dispenza
  • The Four Horsemen
  • We Should All Be MillionairesRachel Rodgers
  • Steve JobsWalter Isaacson
  • Elon MuskAshlee Vance
  • Healing Your Attachment WoundsDiane Poole Heller
  • The AlchemistPaulo Coelho
  • The Body Keeps the ScoreBessel van der Kolk
  • The Autobiography of Malcolm XMalcolm X and Alex Haley
  • Shoe DogPhil Knight
  • WillWill Smith and Mark Manson
  • Born a CrimeTrevor Noah
  • JAY-ZMichael Eric Dyson
  • Dark PsychologyValerie Glossner
  • MetahumanDeepak Chopra
  • Atomic HabitsJames Clear
  • AttachedAmir Levine and Rachel Heller
  • Trillion Dollar Coach
  • The Spark and the GrindErik Wahl
  • Summary: 12 Rules for LifeEpicread
  • Pitch AnythingOren Klaff
Research sources

Sources cited or held for the current research. Updated 3 November 2026.

137 sources

Sources for map operations

Technical documentation and research supporting the operation records on this page.

32 sources