Prompt datasets, tokenizer settings, concurrency, sampling options, and optional image inputs enter an asynchronous request client. It produces success counts, throughput, time to first token, total latency, and grouped error results.
The client supports repeatable gateway checks, migration comparisons, and service load tests without carrying an inference engine. It remains an active local-only project with mock-service coverage for request shape, scheduling, and metrics.