Release Notes ​

April, 2026 ​

API - v1.11.0–v1.12.2 Series ​

Trial

  • Enforced abuse limits on trial accounts

Performance

  • Improved response times for usage and limit checks

March, 2026 ​

UI - v1.13.0–v1.13.1 ​

Subscription & Billing

  • Added plan limit indicators throughout the application
  • Added trial banner to the dashboard
  • Added pricing information to plan tier display
  • Added subscription exemption controls to account admin

API - v1.9.0–v1.10.2 Series ​

Subscription

  • Enforced plan limits on data collection, project creation, and user creation
  • Added data retention enforcement based on subscription plan
  • Defined behaviour for accounts without an active subscription
  • Added pricing information to the billing tiers endpoint
  • Exposed current plan limits in API responses

API - v1.8.0 ​

Billing

  • Added subscription and billing tier support

UI - v1.11.0–v1.11.1 ​

Account Management

  • Added tag support to account management

API - v1.6.0 ​

Account

  • Added tag support to accounts

Gradle Plugin - v1.0.0–v1.0.1 ​

Initial Release

  • Gradle plugin (com.obvyr.gradle) for automatic test execution tracking with zero command wrapping
  • Hooks into every Test task; submits execution data to Obvyr after each run
  • Full DSL configuration with environment variable fallbacks (OBVYR_API_KEY, OBVYR_USER, OBVYR_TAGS, and more)
  • Silent by default — submission failures are logged as warnings and never block the build
  • Multi-module project support via subprojects {}
  • Requires JVM 17+ and the java or java-library plugin
  • Published to the Gradle Plugin Portal as com.obvyr.gradle

CLI - v2.4.0 ​

Attachments

  • Added glob pattern support in ATTACHMENT_PATHS (e.g. reports/**/*.xml)

API - v1.5.0–v1.5.3 Series ​

Bug Fixes

  • Fixed test output formatting in failure messages
  • Fixed filtering returning incomplete results in some cases

UI - v1.10.0–v1.10.1 ​

Auth & Session

  • Fixed expired sessions not redirecting correctly
  • Restored intended destination after session expiry

API - v1.4.0–v1.4.2 Series ​

Permissions

  • Enforced permission checks across all resources
  • Improved permission propagation when roles are updated

UI - v1.8.1–v1.8.2 ​

User Management

  • Added ability to flush permissions cache from the users screen

UI - v1.8.0 ​

Legal & Compliance

  • Added legal page links to app and docs footers

UI - v1.7.x Series ​

v1.7.1

  • Fixed misleading interactive states on toggle filter buttons

v1.7.0

  • Added rich filter bar to test health profiles list with status, flakiness, and volatility filters
  • Unified toggle and filter form control styling

API - v1.3.9-v1.3.12 Series ​

v1.3.12

  • Removed flakiness threshold filter from dashboard aggregation

v1.3.11

  • Fixed filtering returning incomplete results for large datasets in test execution history

v1.3.9-v1.3.10

  • Fixed status and tag filters not applying correctly in analytics

UI - v1.6.0 ​

Test Detail Filtering

  • Added full filter bar to test detail page with date range, status, and tag filters
  • Added URL synchronisation for test detail page filter state

February, 2026 ​

UI - v1.5.3 ​

Test Detail Enhancements

  • Added duration and status history charts to test detail page
  • Linked flaky and slowest test names on the dashboard to the test detail page
  • Fixed URL-encoding for test names containing slashes

API - v1.3.7-v1.3.8 Series ​

v1.3.8

  • Added server-side status and date filters to test execution history

v1.3.7

  • Added support for test names containing slashes

UI - v1.5.x Series ​

v1.5.2

  • Improved performance of the test health profiles list for large datasets
  • Fixed breadcrumb disappearing during navigation

v1.5.1

  • Added observation detail page

v1.5.0

  • Added test detail page with test execution history

API - v1.3.5-v1.3.6 Series ​

v1.3.6

  • Fixed an issue causing incorrect results in test execution history queries

v1.3.5

  • Improved flakiness detection sensitivity

UI - v1.4.x Series ​

v1.4.2-v1.4.3

  • Improved accuracy of pass rate and flakiness calculations using server-side values

v1.4.0

Tests List

  • Added Tests list page for projects with test health profile cards
  • Added Tests tab to project navigation

API - v1.3.1-v1.3.4 Series ​

v1.3.4

  • Improved accuracy of analytics by moving all calculations server-side

v1.3.2-v1.3.3

  • Fixed flakiness scoring accuracy
  • Fixed flakiness calculations to use only filtered data

v1.3.1

  • Increased maximum page size limit to 2000

UI - v1.3.x Series ​

v1.3.2

  • Limited user registration to single user during alpha

v1.3.1

  • Added test health profiles
  • Added guided onboarding flow for new users

v1.3.0

  • Persisted date range selection across navigation
  • Consolidated project creation and deletion onto the dashboard

API - v1.3.0 ​

Registration & Account Management

  • Assigned Account Admin role to users on registration
  • Added account deletion to user removal

UI - v1.2.x Series ​

v1.2.2

  • Enforced single-project limit for alpha users

v1.2.1

  • Added loading spinners to register/confirm buttons
  • Replaced email confirmation redirect with in-place success state

v1.2.0

  • Added invite management page for Obvyr admins

API - v1.2.x Series ​

v1.2.1

  • Fixed invite code lookup

v1.2.0

  • Added invite management endpoints for Obvyr admins

CLI - v2.3.1 ​

Bug Fix

  • Excluded pydantic-settings 2.13.0 due to breaking changes in environment variable decoding

API - v1.1.x Series ​

v1.1.0

  • Added invite-based registration with automatic account creation
  • Added auto-resend of confirmation code on expiry

UI - v1.1.x Series ​

v1.1.1

  • Improved register form layout and field clarity

v1.1.0

  • Implemented invite-based registration and email confirmation flow

CLI - v2.3.0 ​

Package Distribution

  • Added obvyr-cli executable as an alias to the obvyr command for improved discoverability

API - v1.0.0 ​

Major Release - Production Ready

  • Comprehensive analytics and dashboard features
  • Tag-based flakiness filtering
  • Daily unique tests aggregation
  • Test execution comparison and volatility tracking
  • Graceful degradation when data collection is unavailable

Key Features

  • Account and project dashboard aggregation
  • Test run metrics with pagination and filtering
  • Flakiness configuration per project
  • Improved authentication error handling

January, 2026 ​

UI - v1.0.0 ​

Major Release - Production Ready

  • Complete dashboard redesign with project-level insights
  • Interactive charts for test execution trends
  • Flaky tests identification and tracking
  • Slowest tests analysis
  • Date range filtering with preset options
  • Real-time metrics with proper loading states

Key Features

  • Account-level dashboard with project health overview
  • Project dashboard with detailed analytics
  • Test run metrics with timezone-safe date handling

Navigation & UX

  • Dynamic project navigation with secondary nav
  • Dashboard moved to primary project route
  • Agents and observations moved to dedicated sub-routes
  • Improved keyboard accessibility
  • Consistent layout standardisation

Permissions & Security

  • Comprehensive permissions system
  • Role-based access control
  • Settings reorganisation for better UX

CLI - v2.2.0 ​

Configuration Enhancement

  • Added support for multiple attachment paths (comma-separated ATTACHMENT_PATHS)
  • Deprecated singular ATTACHMENT_PATH in favour of ATTACHMENT_PATHS

November, 2025 ​

CLI - v2.1.0 ​

Attachment Governance

  • Added intelligent attachment handling with priority-based file selection
  • Enforced size limits: 5MB per file, 10MB total per observation
  • Added graceful degradation for oversized, invalid, or stale attachments
  • Text-based files only (XML, JSON, YAML, CSV, plain text); binary files excluded automatically

API - v0.9.1 ​

Account Management

  • Added account name availability check
  • Enforced unique account names with case-insensitive validation

API - v0.9.0 ​

Reliability

  • Added automatic retry logic for failed observation processing
  • Improved failure tracking for observations

API - v0.8.0 ​

Reliability

  • Improved infrastructure scaling and concurrency controls

API - v0.7.x Series ​

v0.7.3

  • Fixed an issue causing observation processing failures for tests with very large output

v0.7.1

  • Improved data retrieval performance

UI - v0.5.5 ​

UX Improvements

  • Added type-ahead search to dropdown fields for improved keyboard accessibility

October, 2025 ​

UI - v0.5.4 ​

Account Management

  • Added timezone and aggregation hour fields to account settings

CLI - v2.0.1 ​

Bug Fixes

  • General stability improvements and bug fixes

CLI - v2.0.0 ​

Breaking Changes

  • Renamed obvyr_agent to obvyr_cli
  • Updated configuration value names for better clarity
  • Changed command from obvyr-agent to obvyr

Configuration Improvements

  • Simplified environment variable naming convention
  • Enhanced profile-based configuration system
  • Added --list-profiles and --show-config commands for easier configuration management

CLI - v1.0.0 ​

  • First stable release of the CLI tool (formerly known as obvyr_agent).

UI - v0.5.4 ​

  • Added forgotten password flow for unauthenticated users.
  • Added change password flow for authenticated users.

API - v0.4.4–v0.4.6 ​

  • Added forgot password and change password endpoints.
  • Fixed error codes returned for password and confirmation flows.

September, 2025 ​

API - v0.4.3 ​

  • Added forgot password confirmation endpoint for anonymous users.
  • Added forgot password endpoint for anonymous users.
  • Added change password endpoint for authenticated users.

UI - v0.5.3 ​

  • Refactored login to use replace navigation rather than page redirect.
  • Moved logout from header to secondary navigation.

UI - v0.5.0 ​

  • Implemented permissions checking throughout the application.
  • Added permissions-based navigation and page access control.
  • Reworked navigation to show user settings and display.
  • Added icon support to buttons.
  • Fixed secondary navigation closing on mobile devices.
  • Moved admin section to settings.

UI - v0.4.1 ​

  • Adjusted permission display on roles.

API - v0.4.2 ​

  • Improved permission testing coverage.

UI - v0.4.0 ​

  • Added role management page.
  • Added role assignment and revocation for users.

API - v0.4.1 ​

  • Fixed token refresh to correctly return updated roles and permissions.

Historical Note

The Obvyr CLI was previously called "obvyr_agent" before version 2.0.0. All historical release notes below have been updated to use "CLI" for consistency.

CLI - v0.3.6 ​

  • General bug fixes and improvements.

CLI - v0.3.5 ​

  • General bug fixes and improvements.

CLI - v0.3.4 ​

  • General bug fixes and improvements.

CLI - v0.3.3 ​

  • General bug fixes and improvements.

CLI - v0.3.2 ​

  • General bug fixes and improvements.

CLI - v0.3.1 ​

  • General bug fixes and improvements.

UI - v0.3.0 ​

  • Updated user handling to support roles and permissions.
  • Added account switching functionality for multi-account users.

UI - v0.2.5 ​

  • Improved file content viewer performance.
  • Added raw mode toggle to file content viewer.
  • Clearly marked failed observations in the UI.

API - v0.4.0 ​

  • Added role management endpoints.
  • Added role assignment and revocation for users.

UI - v0.2.4 ​

  • Fixed spacing issue at foot of page for smaller screens.
  • Added favicons.

UI - v0.2.3 ​

  • General bug fixes and improvements.
  • Show tags on Observation cards.
  • Improve output of loaded counts on Project detail page.

CLI - v0.3.0 ​

  • General bug fixes and improvements.
  • Removed legacy agent switching logic.

API - v0.4.0 ​

  • General bug fixes and improvements.
  • Ensured automated tags are URL safe.

CLI - v0.2.2 ​

  • Added support for configured additional tags.

API - v0.3.8 ​

  • Automatically adds agent and project related tags to Observations.

UI - v0.2.2 ​

  • Updated display of files associated with an Observation.

CLI - v0.2.1 ​

  • Consolidated command output for improved reliability.

API - v0.3.7 ​

  • Updated to support consolidated output format from the CLI.

UI - v0.2.1 ​

  • Enable interrogation of files associated with an Observation.

API - v0.3.5 ​

  • Add more visibility into files associated with an Observation.

API - v0.3.4 ​

  • Ensure Observations are updated with data from collection archive.

UI - v0.2.0 ​

  • Added the new logo.
  • Added auto deployment from CI.

CLI - v0.2.0 ​

  • Refactor agent to provide all data in an archive.