Licensing Agreement Definition and Cross-Reference Evidence Retrieval Benchmark
#legal evidence retrieval #cross-reference tracing #clause-level evidence matching #licensing agreement review #contract definition analysis #legal evidence retrieval
- 5000
- 0.4GB
- JSON
- CATL
MOBIUSI INC
Updated:2026-10-25
AI Analysis & Value Prop
This benchmark focuses on questions that require tracing legal support through definitions, cross-references, and incorporated materials in licensing agreements. Records include agreement text, annotated evidence segments and paths, reference answers, and reasoning summaries. It helps evaluate whether retrieval-augmented generation systems can follow contractual relationships to retrieve supporting evidence rather than relying on surface-level keyword matches, and supports legal document retrieval and contract question-answering research.
Dataset Insights
Sample Examples
{}
Technical Specifications
| Field | Type | Description |
|---|---|---|
| file_name | string | File name |
| question | string | The benchmark query that requires retrieving legal support from the licensing agreement, including through definitions, cross-references, or incorporated materials. |
| gold_answer | string | The reference answer to the question, supported by the annotated evidence and retrieval paths. |
| agreement_text | string | The source licensing agreement text to search, including any available text of materials incorporated by reference. |
| evidence_paths | array | The annotated chains of contractual relationships that connect the question or an initial clause to supporting evidence. |
| evidence_segments | array | The annotated text spans that provide relevant legal support for answering the question. |
| reasoning_summary | string | A concise explanation of how the linked contractual provisions establish the gold answer. |
Compliance Statement
| Authorization Type | Proprietary - Commercial AI Training License (No Redistribution) |
| Commercial Use | Requires exclusive subscription or authorization contract (monthly or per-invocation charging) |
| Privacy and Anonymization | No PII, no real company names, simulated scenarios follow industry standards |
| Compliance System | Compliant with China's Data Security Law / EU GDPR / supports enterprise data access logs |
Frequently Asked Questions
- What does the benchmark contain?
- Records can include a query, licensing agreement text, annotated evidence segments and paths, a reference answer, and a reasoning summary. Available text of materials incorporated by reference may also be included.
- What capabilities does it evaluate?
- It evaluates whether a system can follow definitions, cross-references, and incorporated materials to retrieve support for an answer, instead of relying only on keyword matching.
- What are suitable use cases?
- Use it for legal document retrieval, licensing agreement question answering, contract review assistance, and development or comparative evaluation of retrieval-augmented generation systems. Benchmark outputs should not be treated as legal advice.
- How can I access the data and check its license?
- Refer to the dataset product page or provider for access options, permitted uses, and licensing terms. Review the applicable license and relevant legal and privacy requirements before use.
Can't find the data you need?
Post a request and let data providers reach out to you.
Get this Dataset
Verified for Enterprise UseCite this Work
@dataset{Mobiusi2026,
title={Licensing Agreement Definition and Cross-Reference Evidence Retrieval Benchmark},
author={MOBIUSI INC},
year={2026},
url={https://www.mobiusi.com/datasets/9cf0ccf294b30699cb3a59643ac7cc83},
urldate={2026-10-20},
keywords={licensing agreement dataset,contract evidence retrieval,legal document retrieval,RAG benchmark,contract cross-references,legal QA evaluation,definition clause retrieval,contract knowledge base},
version={1.0}
}Using this in research? Please cite us.
placeholder
placeholder
placeholder
placeholder
placeholder
placeholder
placeholder