Academic

PlotTwist: A Creative Plot Generation Framework with Small Language Models

arXiv:2603.16410v1 Announce Type: new Abstract: Creative plot generation presents a fundamental challenge for language models: transforming a concise premise into a coherent narrative that sustains global structure, character development, and emotional resonance. Although recent Large Language Models (LLMs) demonstrate strong fluency across general-purpose tasks, they typically require preference alignment to perform well on specialized domains such as creative plot generation. However, conducting such alignment at the scale of frontier LLMs is computationally prohibitive, significantly limiting accessibility and practical deployment. To address this, we present PlotTwist, a structured framework that enables Small Language Models (SLMs) with $\leq$ 5B active parameters to generate high-quality, premise-conditioned plots competitive with frontier systems up to $200\times$ larger. Our approach decomposes generation into three specialized components: (1) an Aspect Rating Reward Model tra

A
Abhinav Thorat, Ravi Kolla, Jyotin Goel, Niranjan Pedanekar
· · 1 min read · 10 views

arXiv:2603.16410v1 Announce Type: new Abstract: Creative plot generation presents a fundamental challenge for language models: transforming a concise premise into a coherent narrative that sustains global structure, character development, and emotional resonance. Although recent Large Language Models (LLMs) demonstrate strong fluency across general-purpose tasks, they typically require preference alignment to perform well on specialized domains such as creative plot generation. However, conducting such alignment at the scale of frontier LLMs is computationally prohibitive, significantly limiting accessibility and practical deployment. To address this, we present PlotTwist, a structured framework that enables Small Language Models (SLMs) with $\leq$ 5B active parameters to generate high-quality, premise-conditioned plots competitive with frontier systems up to $200\times$ larger. Our approach decomposes generation into three specialized components: (1) an Aspect Rating Reward Model trained via a novel Positive-Negative prompting strategy to deliver structured narratives across five Narrative Quality Dimensions (NQDs); (2) a Mixture-of-Experts (MoE) plot generator aligned via Direct Preference Optimization on high-confidence preference pairs; and (3) an Agentic Evaluation module that emulates human critical judgment for unbiased post-hoc assessment. Extensive experiments demonstrate that PlotTwist consistently outperforms frontier models across multiple NQDs despite substantially tighter capacity constraints. Further validation confirms strong sensitivity to narrative quality, as the framework reliably distinguishes plots derived from critically acclaimed versus widely panned screenplays. Together, these results establish structured, preference-based alignment as a resource-efficient approach to high-quality creative plot generation.

Executive Summary

This study presents PlotTwist, a novel framework for creative plot generation using small language models (SLMs) with up to 5 billion active parameters. The framework decomposes generation into three specialized components, enabling the creation of high-quality, premise-conditioned plots competitive with frontier systems. PlotTwist demonstrates strong performance across multiple narrative quality dimensions, outperforming larger models despite capacity constraints. The framework's preference-based alignment approach offers a resource-efficient solution for creative plot generation, with implications for the development of more accessible and deployable AI systems. Extensive validation confirms the framework's reliability in distinguishing between critically acclaimed and widely panned screenplays. The study's findings have significant practical and policy implications for the application of AI in creative industries.

Key Points

  • PlotTwist framework enables SLMs to generate high-quality plots competitive with larger models.
  • Structured, preference-based alignment approach is resource-efficient and reliable.
  • Framework outperforms frontier models across multiple narrative quality dimensions.

Merits

Resource Efficiency

PlotTwist's preference-based alignment approach allows for high-quality plot generation with significantly fewer parameters, making it a more accessible and deployable solution.

Reliability

The framework's ability to distinguish between critically acclaimed and widely panned screenplays suggests its reliability in evaluating narrative quality.

Competitiveness

PlotTwist's competitive performance with larger models demonstrates the framework's effectiveness in generating high-quality plots.

Demerits

Capacity Constraints

The study's focus on SLMs with up to 5 billion active parameters may limit the framework's applicability to more complex tasks or larger models.

Evaluation Metrics

The reliance on narrative quality dimensions (NQDs) as evaluation metrics may not fully capture the complexity of creative plot generation.

Expert Commentary

While PlotTwist demonstrates impressive performance in creative plot generation, its limitations in capacity constraints and evaluation metrics highlight the need for continued research in this area. The study's focus on preference-based alignment approaches offers a promising direction for the development of more accessible and deployable AI systems. As AI continues to play an increasingly important role in creative industries, the implications of PlotTwist's findings will only continue to grow. Future research should prioritize exploring the framework's applicability to more complex tasks and developing more comprehensive evaluation metrics for creative plot generation.

Recommendations

  • Further research should investigate the applicability of PlotTwist to more complex tasks and larger models.
  • The development of more comprehensive evaluation metrics for creative plot generation is essential for a deeper understanding of the framework's strengths and limitations.

Sources