Draft:Vibe testing


Vibe testing (also stylized VibeTesting) refers to AI-assisted software testing where quality is assessed in terms of perceived user experience, tone and "feel" rather than only functional correctness.[1]

Concepts

In vibe testing workflows, testers often describe high-level expectations or goals in natural language. An AI agent then explores the product or executes guided flows, surfacing potential mismatches such as confusing navigation, inconsistent layout, sluggish transitions, or other issues that could degrade user experience.[1]

Commentary sometimes frames vibe testing as a quality-assurance counterpart to Vibe coding, in which software instructions are expressed conversationally. TestZeus has used the term in marketing to describe AI agent-based test generation and execution, including in Salesforce-related workflows.[2][3]

Research and formalization

A 2026 preprint formalizes "vibe testing" for evaluating large language models (LLMs), describing it as a two-part process where users personalize both what they test and how they judge responses, and proposing an evaluation pipeline with personalized prompts and user-aware subjective criteria.[4]

An eScholarship tutorial introduces "idiomatic vibe testing" using the Julienne language, embedding test-like constraints inside LLM prompts to structure evaluation.[5]

Related research has explored automatically discovering and quantifying qualitative differences ("vibes") between LLM outputs, which connects conceptually to vibe testing by trying to systematically characterize subjective model qualities.[6]

Reception

Practitioners note that vibe testing can highlight user-experience issues that scripted test suites miss, but also caution that AI-generated assessments may be inconsistent or brittle and need human review.[7]

See also

References

Content Disclaimer

Informasi ini disarikan dari Wikipedia dan disajikan kembali untuk tujuan edukasi. Konten tersedia di bawah lisensi CC BY-SA 3.0. Kami tidak bertanggung jawab atas ketidakakuratan data yang bersumber dari kontribusi publik tersebut.

  1. The information displayed on this website is sourced in part or in whole from Wikipedia and has been adapted for the purpose of restating it. We strive to provide accurate and relevant information, however:
  2. There is no guarantee of absolute accuracy. Wikipedia is an open, collaborative project that can be edited by anyone, so information is subject to change.
  3. It is not intended to constitute professional advice. The content displayed is for informational and educational purposes only. For important decisions (e.g., medical, legal, or financial), please consult a professional.
  4. Content copyright. Wikipedia is licensed under the Creative Commons Attribution-ShareAlike License (CC BY-SA). This means that content may be reused with appropriate attribution and shared under a similar license.
  5. Responsible use. Any risk arising from the use of information from this website is entirely the responsibility of the user.