Single-file Python CLI to batch-test multiple LLM models with predefined queries. Supports YAML/JSON config, reasoning detection (<think> tags and reasoning_content field), per-query token/speed stats, and graceful API error handling. Install with `pip install -e .` to get the `llmqt` command. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
26 lines
243 B
Plaintext
26 lines
243 B
Plaintext
# Python
|
|
__pycache__/
|
|
*.py[cod]
|
|
*.pyo
|
|
*.egg
|
|
*.egg-info/
|
|
dist/
|
|
build/
|
|
.eggs/
|
|
.venv/
|
|
venv/
|
|
env/
|
|
|
|
# llmqt outputs (directories created by the script)
|
|
# Uncomment to ignore all test output dirs:
|
|
# */
|
|
|
|
# IDE
|
|
.idea/
|
|
.vscode/
|
|
*.swp
|
|
*.swo
|
|
|
|
# Env
|
|
.env
|