Artificial Intelligence Agent Testing and Evaluation Platform
Overview
Settle Signals
Market intelligence for public sector sales teams
RFP Hunter shows what is open. Settle shows what is forming.
Settle pieces together buyer signals, budgets, contract activity, and the sources your team already monitors. See why an opportunity fits and what to do before the RFP posts.
SUMMARY
KEY REQUIREMENTS
CONTRACT DURATION
TIMELINE
July 27th, 2026: Issuance of RFP
August 11th, 2026: Pre-Proposal conference
August 14th, 2026: Deadline for submission of questions
August 31st, 2026: Deadline for submission of Proposals
QUESTION DEADLINE
CONTACTS
Primary procurement contact — name, title, email, and phone
Additional decision-makers and their departments
Issuing Agency
Teacher Retirement System Of Texas
DESCRIPTION
A public agency in Texas is seeking an enterprise-grade artificial intelligence agent testing and evaluation platform to support the testing, evaluation, monitoring, and continuous improvement of AI-driven agents, including conversational chatbots, virtual assistants, and task-based agentic AI solutions. The requested solution may be delivered as a Software-as-a-Service platform or an equivalent commercial offering and must support testing across development, testing, and production environments.
The scope includes pre-deployment testing, post-deployment monitoring, and ongoing quality assurance activities designed to improve reliability, user experience, and governance. The platform must evaluate response accuracy, completeness, consistency, relevance, and semantic quality; identify gaps between intended and actual responses; detect hallucinations, policy inconsistencies, response errors, and unintended behavior; assess task or workflow completion; and capture source citation links for response verification against knowledge sources.
The solution must provide automated or semi-automated evaluation of AI agent responses, including auto-generated prompts and expected responses based on knowledge sources for testing teams to review and use. It must analyze semantic meaning rather than relying solely on exact text matching, compare actual responses against expected outcomes, and highlight omissions or deviations. Required capabilities also include dashboards, reporting, performance/load/stress analysis, and integration with AI agents through APIs, logs, transcripts, or other supported mechanisms.
Questions are due by August 14, 2026. A non-mandatory pre-bid conference will be held on August 11, 2026, and the resulting contract is expected to run for one year.
Similar RFPs
Frequently asked questions
- When is the submission deadline?
- Submissions are due August 31, 2026. Questions must be submitted by August 14, 2026.
- Who issued this RFP?
- It was issued by Teacher Retirement System Of Texas. The work is located in Austin, Texas, United States.
- Who is a good fit for this opportunity?
- Providers of enterprise AI testing and evaluation platforms
- SaaS vendors with semantic analysis and AI quality assurance capabilities
- Firms experienced in chatbot, virtual assistant, and agentic AI assessment
- Companies with API-based integration, transcript analysis, and monitoring tools
- Vendors offering performance, load, and stress testing for AI applications
- Teams with public sector or regulated-environment governance experience
- Companies able to support dashboards, reporting, and regression analysis
- Firms with experience delivering one-year commercial software engagements
Analysis generated by Settle AI from the source RFP.
RFP Hunter shows what is open. Settle shows what is forming.
Settle pieces together buyer signals, budgets, contract activity, and the sources your team already monitors. See why an opportunity fits and what to do before the RFP posts.