OpenAPI Specification Conformance Benchmark Dataset

#specification conformance verification #API violation detection #validation rule matching #API specification validation #OpenAPI compliance auditing #API quality assurance

3780
0.3GB
JSON
CATL
MOBIUSI INC

Updated:2026-10-24

AI Analysis & Value Prop

This benchmark contains OpenAPI specification documents in YAML, their applicable validation rules, and annotations for conformance results, violation locations, and violation counts. It covers requirements such as schema definitions, references, and parameter declarations, enabling evaluation of a model's ability to detect and locate violations with verifiable results. Typical uses include automated conformance checks and quality assurance in API development platforms.

Dataset Insights

Sample Examples

{}

Technical Specifications

Field	Type	Description
file_name	string	File name
violations	array	The detected conformance violations and their locations in the OpenAPI document.
is_conformant	boolean	Whether the OpenAPI document satisfies all applicable validation requirements.
violation_count	integer	The total number of violations found in the OpenAPI document.
openapi_document	string	The source OpenAPI specification document in YAML format.
validation_profile	object	The source constraints and rules used to evaluate the OpenAPI document.

Compliance Statement

Authorization Type	Proprietary - Commercial AI Training License (No Redistribution)
Commercial Use	Requires exclusive subscription or authorization contract (monthly or per-invocation charging)
Privacy and Anonymization	No PII, no real company names, simulated scenarios follow industry standards
Compliance System	Compliant with China's Data Security Law / EU GDPR / supports enterprise data access logs

Frequently Asked Questions

What does the dataset contain?: Each record includes an OpenAPI document in YAML, applicable validation rules, a conformance result, and annotations for violation locations and counts, enabling validation results to be checked.

Which specification checks are covered?: The benchmark covers OpenAPI requirements such as schema definitions, references, and parameter declarations. It can be used to evaluate whether models can judge conformance and identify specific violations.

What tasks is it suitable for?: It supports OpenAPI conformance judgment, violation detection and localization, as well as automated validation and model evaluation in API development platforms.

How can I access the dataset and check its license?: Consult the dataset product page for available access options, version details, and license terms. Verify the applicable permissions before commercial use or redistribution.

Can't find the data you need?

Post a request and let data providers reach out to you.

Get this Dataset

Verified for Enterprise Use

Cite this Work

@dataset{Mobiusi2026,
  title={OpenAPI Specification Conformance Benchmark Dataset},
  author={MOBIUSI INC},
  year={2026},
  url={https://www.mobiusi.com/datasets/5ab67b6e77ade87e133dbfc8afbca45a},
  urldate={2026-10-21},
  keywords={OpenAPI dataset,API specification validation,OpenAPI conformance,specification violation detection,violation location annotation,API automated evaluation,API quality assurance,YAML specification documents},
  version={1.0}
}

Using this in research? Please cite us.

placeholder

Products

Scene

Domain

Modality

Task