Speculative Fiction: Writing Science Fiction, Fantasy, and Horror
Speculative fiction is the umbrella under which science fiction, fantasy, and horror sit together — genres united by a single defining move: they ask "what if" and then take the answer seriously. This page examines how those three modes work as craft disciplines, what distinguishes them from each other, and how writers navigate the decisions that make speculative work succeed or collapse. Whether a story involves faster-than-light travel, a secondary world with its own magic system, or a creature that shouldn't exist, the underlying craft demands are specific, learnable, and worth understanding clearly.
Definition and scope
Speculative fiction is best understood as fiction that introduces at least one premise that violates or extends the known laws of nature, history, or physics — and then commits to that premise with full narrative seriousness. The term itself was popularized by Robert A. Heinlein in essays collected in his 1973 volume Expanded Universe, though the underlying tradition stretches back through H.G. Wells, Mary Shelley, and Poe.
The three major sub-genres differ in the nature of their central departure from reality:
- Science fiction grounds its departures in extrapolated science or technology. The "what if" is constrained by plausibility within a recognized scientific framework, even if that framework is speculative. Kim Stanley Robinson's The Martian Chronicles (distinct from Andy Weir's 2011 novel The Martian, which is a strong case study in hard SF's discipline) versus Arthur C. Clarke's 2001 show the range: harder extrapolation versus softer philosophical inquiry.
- Fantasy operates through the deliberate suspension of naturalistic rules in favor of a self-consistent internal logic — typically involving magic, mythological creatures, or alternate metaphysics. The critical requirement is not that anything goes, but that the invented rules hold. Brandon Sanderson's "First Law of Magic" (articulated in his 2007 essay Sanderson's Laws of Magic) states that an author's ability to solve conflict with magic is directly proportional to how well the reader understands that magic beforehand.
- Horror is less defined by its world-building premise than by its intended emotional register: dread, unease, the confrontation with something that should not be. It can operate entirely within realistic settings (psychological horror) or deploy supernatural elements (cosmic horror in the tradition of H.P. Lovecraft, or folk horror as in Shirley Jackson's The Haunting of Hill House).
How it works
All three genres share a structural requirement that distinguishes them from mainstream literary fiction: the writer must establish, early and clearly, what the rules of this world are — and then honor those rules completely. World-building is not decoration; it is load-bearing infrastructure.
The mechanism looks like this, regardless of genre:
- Establish the departure. Introduce the speculative premise as early as structurally possible — within the first 10% of the work for novels, within the first scene for short fiction. Readers calibrate their expectations immediately.
- Define the constraints. Every speculative premise has limits. A magic system has costs. A technology has failure modes. A monster has rules. Constraints generate tension; unlimited power generates nothing.
- Apply consistent consequence. Events in the story world must follow from its established logic, not from authorial convenience. Readers will tolerate almost any premise if the consequences are consistent.
- Ground the human stakes. Speculative fiction that forgets its characters behind the machinery of its premise fails as narrative. The character development work is identical to literary fiction — the world changes, people don't fundamentally stop being people.
The best writers in the field treat plot structure as inseparable from the speculative premise: the premise creates the problem, the problem reveals character, character drives plot.
Common scenarios
Writers typically encounter three recurring challenges specific to speculative work:
Exposition overload. The writer knows the world completely and attempts to transmit that knowledge in bulk before the story begins. Ursula K. Le Guin's The Left Hand of Darkness (1969) remains a masterclass in distributing worldbuilding across narrative so that the reader never experiences an information dump — only a series of revelations.
Magic or technology that solves problems too easily. If the speculative element can rescue the protagonist from any situation, tension collapses. This is sometimes called the "deus ex machina" problem — named for a device Aristotle criticized in Poetics as intellectually dishonest.
Tonal inconsistency in horror. Horror depends on sustained atmosphere. A single scene that breaks the register — an inadvertent comic moment, a character who responds too rationally to the irrational — can permanently dissolve the reader's dread. Stephen King's On Writing (2000) addresses this directly, noting that the monster is most frightening before it is seen.
Decision boundaries
The sharpest practical question writers face is genre placement — and it matters for more than marketing. Genre fiction has communities, magazines, and award structures (the Hugo, the Nebula, the Bram Stoker Award) that shape a work's reception and readership. Genre isn't a cage; it's a contract with a specific audience.
The meaningful distinctions:
- Science fiction vs. fantasy: If the premise could be explained by science, even speculative science, the work leans SF. If it requires accepting the operation of non-natural forces without scientific justification, it's fantasy. Many works straddle deliberately — Gene Wolfe's Book of the New Sun is technically science fiction that reads as fantasy by design.
- Horror vs. dark fantasy: Horror prioritizes emotional response (fear) over world-building elaboration. Dark fantasy elaborates a frightening world but may not sustain the horror register throughout. Anne Rice's Vampire Chronicles are dark fantasy; Dracula is horror.
- Literary vs. genre speculative fiction: This is the distinction that generates the most heat. The Library of America has published both Philip K. Dick and Shirley Jackson in its canon of American literature, which is at least suggestive evidence that the boundary is permeable.
For writers working across these modes, research for fiction writers and writing voice and style are the two craft areas that most directly affect how speculative premises land on the page. Finding the complete overview of creative writing craft starts at creativewritingauthority.com.