Academic

Human-AI collaboration in legal services: empirical insights on task-technology fit and generative AI adoption by legal professionals

Purpose This study aims to investigate the use of generative artificial intelligence (GenAI) in the legal profession, focusing on its fit with tasks performed by legal practitioners and its impact on performance and adoption. Design/methodology/approach This study uses a mixed methods approach, combining a survey of 279 legal professionals with qualitative insights from open-ended responses. The quantitative part uses structural equation modeling-partial least squares (PLS-SEM) offering statistical evidence on the relationships between Task Characteristics, Technology Characteristics, Task-Technology Fit (TTF), Utilization and Performance Impact. The qualitative analysis explores participants’ detailed experiences, perceptions and concerns through thematic and sentiment analyses, providing deeper contextual insights. Findings

T
Tina Nosrati · · 1 min read · 2 views

Purpose This study aims to investigate the use of generative artificial intelligence (GenAI) in the legal profession, focusing on its fit with tasks performed by legal practitioners and its impact on performance and adoption. Design/methodology/approach This study uses a mixed methods approach, combining a survey of 279 legal professionals with qualitative insights from open-ended responses. The quantitative part uses structural equation modeling-partial least squares (PLS-SEM) offering statistical evidence on the relationships between Task Characteristics, Technology Characteristics, Task-Technology Fit (TTF), Utilization and Performance Impact. The qualitative analysis explores participants’ detailed experiences, perceptions and concerns through thematic and sentiment analyses, providing deeper contextual insights. Findings The study highlights variability in the alignment between legal tasks and GenAI capabilities. GenAI fits data-intensive tasks like research but struggles with complex human judgment. A strong TTF improves performance and adoption. Familiarity helps results but does not increase use, as legal practitioners use GenAI selectively, even when they are highly familiar with its capabilities. Participants’ comments highlight both opportunities and challenges, including efficiency gains and concerns over data security, trust and output quality. Despite these challenges, most respondents expressed a positive sentiment. Originality/value By extending the TTF theory to GenAI in the legal domain and integrating quantitative and qualitative evidence, the study identifies where GenAI adds value and where professional oversight is essential. It offers practical recommendations, including deploying GenAI in areas where it is most suitable and promoting responsible use through targeted training, professional development and confidence-building initiatives that also address associated risks.

Executive Summary

This study examines the adoption of generative artificial intelligence (GenAI) in the legal profession, focusing on task-technology fit and performance impact. The mixed-methods approach reveals variability in alignment between legal tasks and GenAI capabilities, with strong task-technology fit improving performance and adoption. Despite challenges, most respondents expressed a positive sentiment towards GenAI, highlighting opportunities for efficiency gains and responsible use.

Key Points

  • ▸ GenAI is well-suited for data-intensive tasks like research, but struggles with complex human judgment
  • ▸ Task-technology fit is crucial for improving performance and adoption of GenAI
  • ▸ Legal practitioners use GenAI selectively, even when highly familiar with its capabilities

Merits

Comprehensive methodology

The study's mixed-methods approach provides a thorough understanding of GenAI adoption in the legal profession

Practical recommendations

The study offers actionable advice for deploying GenAI in suitable areas and promoting responsible use

Demerits

Limited generalizability

The study's findings may not be applicable to all legal professionals or jurisdictions

Dependence on participant sentiment

The study's reliance on participant comments and sentiment analysis may introduce bias

Expert Commentary

This study provides valuable insights into the adoption of GenAI in the legal profession, highlighting the importance of task-technology fit and responsible use. The findings have significant implications for legal professionals, organizations, and regulatory bodies, emphasizing the need for careful evaluation, targeted training, and confidence-building initiatives. As GenAI continues to evolve, it is crucial to address the associated risks and challenges, including data security, trust, and output quality, to ensure its effective and responsible integration into legal services.

Recommendations

  • ✓ Legal professionals should undergo targeted training and development programs to enhance their understanding of GenAI capabilities and limitations
  • ✓ Organizations should establish clear guidelines and protocols for the adoption and use of GenAI in legal services

Sources

Related Articles