Changelog
Latest updates and improvements to Probefish.
v0.9.1
- SSE transport support for remote MCP access
- Fixed AI Judge Score Threshold Not Applied
- Fixed history persistence bug
- License updated to ELv2
v0.9.0 (Swordfish)
- CLI tooling - run tests, manage test cases from terminal
- MCP server - integrate with Claude Code and AI assistants
- Test case CRUD API endpoints
- Token auth support for projects endpoint
- Improved auth security - validate before DB connection
v0.8.0 (Blobfish)
- Grok (xAI) provider support - Grok 3, Grok 2 and variants
- DeepSeek provider support - DeepSeek Chat and DeepSeek Reasoner
- Run single test case - click Play button on any test case row to run it individually
- Run selected test cases - use checkboxes to select multiple test cases and run them together
- Drag-to-reorder test cases - drag the grip handle to reorder test cases in a suite
- Suspend/resume test cases - toggle individual test cases to skip them during runs without deleting
- Fixed issue with ignoring score threshold
- LLM Judge now supports all providers (Grok, DeepSeek added)
- UI improvements
- JSON syntax highlight
v0.7.1
- Prompt preview in test suite
- "Latest" prompt version option for test suites
- Change prompt version in test suite settings
- "Is JSON" and "Contains JSON" validation rules
- Documentation: Added ENCRYPTION_KEY generation instructions to README and Dockerfile
- Improved error messages for network failures (now shows root cause like DNS/connection errors)
- Run tests multiple times (N iterations) for consistency testing
- UI improvements
v0.7.0 (Mahi-mahi)
- Open Source now.