Source Code Management API Authorization Constraint Verification Benchmark

#Constraint verification #Authorization decisioning #Rule conflict detection #Violation localization #Source code management platforms #API security auditing #Permission policy validation #Developer tool evaluation

3216
0.5GB
JSON
CATL
MOBIUSI INC

Updated:2026-10-25

AI Analysis & Value Prop

This benchmark covers APIs for source code management platforms, providing endpoint specifications, security schemes, declared scopes, and applicable authorization rules, together with cases that satisfy or conflict with those constraints. Each case includes expected constraint status, authorization decision, operation class, and relevant violation location or rule reference for comparison during evaluation. It supports testing whether models can verify authorization requirements for read, write, and administrative operations against the specifications and rules, and identify conflicts and violations.

Dataset Insights

Sample Examples

{}

Technical Specifications

Field	Type	Description
file_name	string	File name
constraint_case	string	The benchmark scenario or constraint assertion to evaluate, encoded as JSON text.
authorization_rules	string	The applicable authorization rules, encoded as JSON text and describing requirements for read, write, or administrative operations.
expected_rule_reference	string	The identifier or location of the rule expected to determine the authorization outcome; use an empty string when no specific rule applies.
expected_operation_class	string	The operation category identified for the case.
api_endpoint_specification	string	The source API specification for the endpoint, encoded as JSON text and including its method, path, security schemes, and declared scopes.
expected_constraint_status	string	The expected assessment of whether the authorization constraints are satisfied or conflict.
expected_violation_location	string	The expected location of the relevant authorization constraint in the specification, rule set, or test case; use an empty string when no violation is expected.
expected_authorization_decision	boolean	Whether the operation is expected to be authorized under the endpoint specification and applicable rules.

Compliance Statement

Authorization Type	Proprietary - Commercial AI Training License (No Redistribution)
Commercial Use	Requires exclusive subscription or authorization contract (monthly or per-invocation charging)
Privacy and Anonymization	No PII, no real company names, simulated scenarios follow industry standards
Compliance System	Compliant with China's Data Security Law / EU GDPR / supports enterprise data access logs

Frequently Asked Questions

What does the benchmark contain?: It includes API endpoint specifications, authorization rules, constraint cases, and expected evaluation results. Cases indicate whether constraints are satisfied or conflicting, whether an operation is authorized, its operation class, and the expected violation location or rule reference.

What capabilities can this data evaluate?: It can evaluate whether a model verifies authorization constraints using endpoint security schemes, declared scopes, and applicable rules. This includes deciding whether read, write, or administrative operations are authorized and identifying rule conflicts and relevant violation locations.

How is the data structured?: The data is provided in structured fields. Endpoint specifications, authorization rules, and constraint cases are represented as JSON text, with reference results such as expected status and decision. See the data schema for field definitions.

How can I obtain the data, and what should I check before using it?: Check the product page for available access channels and versions, and review the stated license and usage terms before use. The benchmark is intended for automated evaluation and authorization policy validation; it does not replace a security review before deployment.

Can't find the data you need?

Post a request and let data providers reach out to you.

Get this Dataset

Verified for Enterprise Use

Cite this Work

@dataset{Mobiusi2026,
  title={Source Code Management API Authorization Constraint Verification Benchmark},
  author={MOBIUSI INC},
  year={2026},
  url={https://www.mobiusi.com/datasets/464ca088ed43d119405a313719d69752},
  urldate={2026-10-22},
  keywords={source code management API,API authorization verification,permission constraint benchmark,code hosting security,authorization rule evaluation,API security testing,scope validation,constraint conflict detection},
  version={1.0}
}

Using this in research? Please cite us.

placeholder

Products

Scene

Domain

Modality

Task