VI
VidaiMock
Open Source LLM Native Mock API Test Engine
Screenshots
Click to view full sizeAbout VidaiMock
What is VidaiMock?
Vidai.Mock is a high-fidelity simulation tool designed specifically for Continuous Integration/Continuous Deployment (CI/CD) pipelines to mimic the behavior of large language model (LLM) APIs like OpenAI GPT-4. It accurately simulates network conditions such as latency and jitter, as well as potential failure modes, ensuring deterministic and efficient testing. The tool operates without the need for complex environments like Docker or Java Virtual Machine, instead utilizing a lightweight Rust binary for quick and straightforward execution. Vidai.Mock supports multiple LLM providers, including OpenAI, Anthropic, and Bedrock, and offers advanced features such as real-time token simulation, chaos primitives for resilience testing, and support for Retrieval Augmented Generation flows. It integrates seamlessly into existing test suites and provides extensive observability through Prometheus metrics and request tracing. Vidai.Mock is suitable for both local and enterprise environments, offering an air-gapped, stateless configuration for robust testing scenarios.
Problem this tool solves
Testing LLM apps needs realistic streaming, latency and failure simulation.
How it solves the problem
Offline mock server simulates LLM APIs with streaming physics and chaos errors.
Target Audience
Developers testing LLM integrations in CI/CD pipelines
Use Cases
- · Simulate latency/TTFT in tests
- · Inject 429/500/timeouts for resilience
Main Features
Provider API compatibilityStreaming physics (TTFT/TPS)Chaos error injectionTool/JSON mode simulationPrometheus metrics/tracing
Categories
Pricing
Pricing Type: Free
Makers
G.
@gnagarajan58772 karma
Analytics
Comments
Add a comment...