Skip to content

Feature matrix

Every feature Karandash has (documented, undocumented but real, and logic-only), with the three checks that must all exist for it to count as done:

  • Behavior test: a unit or contract test that fails if the feature breaks.
  • E2E: a scenario run on the real binaries (the JVM karandash.jar and the host native cli.kexe). An id like cfg-yaml is a scenario in tools/integration-tests/feature-e2e.sh or one of its e2e.d/*.sh fragments, which run against the mock platform server (tools/integration-tests/mock-server/mock-gitlab-api.py: GitLab routes, plus one mock_*.py module per other API, such as GitHub, Gerrit, Azure DevOps and the fake LLM endpoints). A scenario that needs a host tool (node, openssl, python3) skips locally when the tool is missing and fails on CI (CI=true); the CI test-integrations job runs in the toolchain image (docker/Dockerfile.toolchain), which ships all three. A script name is another script under tools/integration-tests/. Every one of them runs from tools/integration-tests/run-tests.sh (gate part 1 and the CI test-integrations job). When a row has no scenario, the cell says why.
  • Doc: the page that documents the feature for users. A row with no page is marked gap.

Run one scenario with E2E_ONLY='^cfg-yaml$' bash tools/integration-tests/feature-e2e.sh.

Config loading

Feature Behavior test E2E Doc
YAML config plugins/plugins-core/parsers/yaml/src/commonTest/kotlin/io/karandash/plugins/parsers/yaml/YamlFormatModuleTest.kt cfg-yaml YAML config
JSON config core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ConfigFormatParityTest.kt cfg-json YAML config
Kotlin DSL config (config.kts) dsl/kts-parser/src/commonTest/kotlin/io/karandash/parser/KtsJsonInterpreterTest.kt cfg-kts YAML config
Config discovery (.karandash/config.*, first match wins) cli/src/commonTest/kotlin/io/karandash/cli/config/ConfigDiscoveryTest.kt live-doctor (discovers .karandash/config.yaml) YAML config
extends: local files cli/src/commonTest/kotlin/io/karandash/cli/commands/ValidateExtendsCommandTest.kt cfg-extends-local Config inheritance
extends: remote URL (with allow_localhost) core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/RemoteConfigFetcherClientTest.kt cfg-extends-remote, cfg-extends-remote-fetch Config inheritance
extends: override and merge semantics core/merge/src/commonTest/kotlin/io/karandash/config/merge/MergeModeMergerTest.kt cfg-extends-local (child overrides the base's maxLength) Config inheritance
extends: chain check (validate-extends) cli/src/commonTest/kotlin/io/karandash/cli/commands/ValidateExtendsCommandTest.kt cfg-validate-extends validate-extends
Remote config auth blocks core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/AuthBlockParserTest.kt, core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/RemoteConfigFetcherAuthTest.kt cfg-auth-http-refused, cfg-auth-missing, cfg-auth-wrong-token, cfg-auth-bearer, cfg-auth-bearer-fetch, cfg-auth-custom-header, cfg-auth-basic, cfg-auth-untrusted-cert (HTTPS through mock-server/tls_proxy.py with a throwaway certificate; needs openssl and keytool) Config inheritance
{ file: } references cli/src/commonTest/kotlin/io/karandash/cli/config/ExternalValueResolverTest.kt cfg-file-ref YAML config
${ENV} interpolation core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ConfigMapParserInterpolationTest.kt cfg-env, cfg-env-unset Environment variables
Env denylist (KarandashEnvSecurity.DENYLIST) core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ConfigMapParserInterpolationTest.kt cfg-env-denylist Environment variables
Key normalization (kebab/snake to camelCase) core/normalize/src/commonTest/kotlin/io/karandash/normalize/DeepNormalizeKeysTest.kt cfg-normalize YAML config
Zero-config fallback core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ZeroConfigDefaultsTest.kt cfg-zero Zero config
Dry-run and --dry-run-scope cli/src/commonTest/kotlin/io/karandash/cli/pipeline/ConfigLoaderDryRunScopeTest.kt cfg-dry-run validate
config validate / config describe cli/src/commonTest/kotlin/io/karandash/cli/commands/ConfigValidateCommandTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/commands/config/ConfigDescribeEffectiveTest.kt cfg-validate, cfg-describe, cfg-describe-effective config
Config watch mode (validate --watch) core/watcher/src/jvmTest/kotlin/io/karandash/watcher/ConfigWatcherTest.kt, cli/src/jvmTest/kotlin/io/karandash/cli/commands/validate/WatchCancellationTest.kt watch-start, watch-revalidate (the config is rewritten while the CLI runs) Watch mode
JSON schema (generate --schema) cli/src/commonTest/kotlin/io/karandash/cli/commands/GenerateCommandTest.kt cmd-generate-schema, cmd-generate-schema-file generate
$schema and version keys, schema version check core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ExtendsKeyBehaviourTest.kt, core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ConfigSchemaVersionTest.kt gap gap
Unknown top-level and nested key warnings core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/UnknownTopLevelKeysTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/compat/ConfigurationSchemaDocTest.kt, core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/UnknownNestedKeysTest.kt, core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/RuleConfigDecodeCheckTest.kt gap gap
Quoted-scalar coercion and SchemaCoercer core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/QuotedScalarCoercionTest.kt, core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/SchemaCoercerTest.kt gap gap
Rule config decode check at load core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/RuleConfigDecodeCheckTest.kt cfg-load-checks-rule gap
Condition syntax check at load core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ConditionExpressionCheckTest.kt cfg-load-checks-when conditional
Module enablement (true, false, {enabled}) core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ModuleEnablementResolverTest.kt, plugins/plugins-extended/rules/jira-ticket/src/commonTest/kotlin/io/karandash/validators/JiraTicketRegressionTest.kt gap gap
Missing-module detector, --on-missing-plugin, plugins: manifest key core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/MissingModuleDetectorTest.kt, plugins/integration-tests/contracts/src/jvmTest/kotlin/io/karandash/contracts/fw/ReportersShapeContractTest.kt, core/manifest/src/commonTest/kotlin/io/karandash/manifest/MissingPluginBehaviorTest.kt gap validate
Did-you-mean suggestions for module ids cli/src/commonTest/kotlin/io/karandash/cli/errors/SuggestionEngineTest.kt cfg-load-checks-typo gap
Named extends auth sets, validate-extends --list-sets cli/src/commonTest/kotlin/io/karandash/cli/commands/ValidateExtendsCommandTest.kt cfg-extends-sets-list, cfg-extends-auth-sets (the set's bearer token is refused over plain HTTP, never sent) validate-extends
KARANDASH_CONFIG_URL and KARANDASH_CONFIG_TOKEN core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ConfigMapParserInterpolationTest.kt, core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/EnvVarInterpolationInExtendsTest.kt gap gap
KARANDASH_CONFIG and KARANDASH_CONFIG_DIR discovery overrides cli/src/commonTest/kotlin/io/karandash/cli/config/ConfigDiscoveryTest.kt cfg-config-dir, cfg-config-env YAML_CONFIG
extends[].cache (ttl; cache.downloads.ttl/enabled inherited down the chain; ETag revalidation) cli/src/commonTest/kotlin/io/karandash/cli/config/CacheLayerTest.kt, core/cache/src/commonTest/kotlin/io/karandash/cache/cas/ConditionalFetchCacheTest.kt gap config-inheritance
Merge block modes (fail, warn, off, false) core/merge/src/commonTest/kotlin/io/karandash/config/merge/MergeModeMergerTest.kt, plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/config/BlockModeTest.kt gap config-inheritance
env: declarations and ${VAR:-default} core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ConfigMapParserEnvBlockTest.kt cfg-env environment-variables
init flags (--preset, --platform, --format, --output) cli/src/commonTest/kotlin/io/karandash/cli/commands/InitCommandTest.kt gap init
Config renderers (yaml, json, kts) cli/src/commonTest/kotlin/io/karandash/cli/config/renderers/JsonConfigRendererTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/config/renderers/YamlConfigRendererTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/config/renderers/KtsConfigRendererTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/config/ConfigRendererRegistryTest.kt gap init
format schema cli/src/commonTest/kotlin/io/karandash/cli/commands/format/FormatCommandTest.kt gap format

Config model, keys and aliases

Feature Behavior test E2E Doc
AI config synthesizer (zero-config AI) gap gap gap
Top-level options: core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ConfigMapParserDeadKeysTest.kt gap gap
Top-level extensions: gap gap gap
limits: (18 keys) cli/src/commonTest/kotlin/io/karandash/cli/config/ExtendsInheritanceKeyBehaviourTest.kt, core/validation/src/commonTest/kotlin/io/karandash/engine/PolicyKeyBehaviourTest.kt gap known-limits
timeouts: (global, http, enrichment, ruleExecution, scripts, pluginShutdown, cacheTtl) cli/src/commonTest/kotlin/io/karandash/cli/pipeline/TimeoutsKeyBehaviourTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/ResponseTtlTest.kt gap gap
--global-timeout (exit 7) cli/src/jvmTest/kotlin/io/karandash/cli/GlobalTimeoutExitCodeTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/GlobalTimeoutResolutionTest.kt gap error-codes
KARANDASH_HTTP_TIMEOUT cli/src/commonTest/kotlin/io/karandash/cli/pipeline/HttpClientSettingsWiringTest.kt gap gap
KARANDASH_PLUGIN_CALL_TIMEOUT plugins/loader/src/commonTest/kotlin/io/karandash/loader/js/JsPluginLoaderLifecycleTest.kt, plugins/loader/src/jvmTest/kotlin/io/karandash/loader/wasm/WasmPluginLoaderLifecycleJvmTest.kt plugin-run-js-timeout, plugin-run-js-timeout-bounded gap
http: (11 keys) core/http/src/commonTest/kotlin/io/karandash/http/HttpClientSettingsTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/CacheKeyBehaviourTest.kt gap gap
security.blockedHosts cli/src/commonTest/kotlin/io/karandash/cli/config/SecurityBlockedHostsWiringTest.kt gap gap
KARANDASH_TLS_INSECURE_HOSTS (per-host TLS opt-out) core/http/src/commonTest/kotlin/io/karandash/http/TlsInsecureHostsTest.kt gap gap
CA bundle override (SSL_CERT_FILE) core/http/src/commonTest/kotlin/io/karandash/http/CaBundleOverrideTest.kt, core/http/src/jvmTest/kotlin/io/karandash/http/PemBundleTrustManagerTest.kt gap gap
display: (git.shortShaLength, watcher.debounce, console marks) cli/src/commonTest/kotlin/io/karandash/cli/pipeline/ShortShaLengthWiringTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/commands/validate/ReportDisplayKeyBehaviourTest.kt gap gap
diagnostics: (output, interval, flushInterval) cli/src/commonTest/kotlin/io/karandash/cli/pipeline/DiagnosticsKeyBehaviourTest.kt gap gap
Rule key aliases (RuleKeyAliases) core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/RuleKeyAliasesTest.kt gap gap
AI config aliases (AiConfigAliases) plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/AiConfigAliasesTest.kt gap gap
PreserveKeys (keys exempt from normalization) core/normalize/src/commonTest/kotlin/io/karandash/normalize/ConfigKeyNormalizerTest.kt gap YAML_CONFIG
Module id fuzzy match (exact, camelCase, alphanumeric lowercase) core/normalize/src/commonTest/kotlin/io/karandash/normalize/ModuleIdNormalizerTest.kt, plugins/integration-tests/rules/src/commonTest/kotlin/io/karandash/validators/RuleIdDispatchConsistencyTest.kt gap gap
Explicit module aliases (draft, reviewdog) and platform alias index core/ai-pipeline/src/commonTest/kotlin/io/karandash/ai/pipeline/AiServiceImplTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/plugin/ModuleDefaultsCollectorTest.kt, plugins/bootstrap/src/commonTest/kotlin/io/karandash/bootstrap/BootstrapAliasCollisionTest.kt gap gap
Typed rule ids io.karandash.rule.<id>:<key> plugins/plugins-core/rules/file-changes/src/commonTest/kotlin/io/karandash/validators/FileChangesKeyBehaviourTest.kt, plugins/plugins-core/rules/title-format/src/commonTest/kotlin/io/karandash/validators/TitleFormatKeyBehaviourTest.kt gap gap
Typed output ids io.karandash.output.<id>:<key> plugins/plugins-extended/outputs/status-output/src/commonTest/kotlin/io/karandash/plugins/outputs/StatusOutputModuleTest.kt, plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputReconcileTest.kt gap gap
JSON schema of the config (configuration-schema) cli/src/commonTest/kotlin/io/karandash/cli/compat/ConfigurationSchemaDocTest.kt, core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ConfigFormatRegistryRuleSchemasTest.kt gap configuration-schema

Patterns, regex and value types

Feature Behavior test E2E Doc
Named patterns: and @name expansion core/multipattern/src/commonTest/kotlin/io/karandash/patterns/NamedPatternExpanderTest.kt, core/multipattern/src/commonTest/kotlin/io/karandash/patterns/CorePatternRegistryTest.kt patterns-pomsky-name-fail, patterns-pomsky-name-pass patterns
Pomsky patterns core/multipattern/src/commonTest/kotlin/io/karandash/patterns/PomskyCompilerTest.kt, core/multipattern/src/commonTest/kotlin/io/karandash/patterns/PomskyConfigCheckTest.kt patterns-pomsky-name-fail, patterns-pomsky-name-pass patterns
Text-glob patterns core/multipattern/src/commonTest/kotlin/io/karandash/patterns/TextGlobCompilerTest.kt gap patterns
Pattern fix and describe core/multipattern/src/commonTest/kotlin/io/karandash/patterns/PatternFixTest.kt, core/multipattern/src/commonTest/kotlin/io/karandash/patterns/PatternDescriberTest.kt gap patterns
Built-in pattern library core/multipattern/src/commonTest/kotlin/io/karandash/patterns/BuiltInPatternSweepTest.kt gap patterns
Regex safety (nesting analysis, SafeRegexCompiler) core/regex-safety/src/commonTest/kotlin/io/karandash/helpers/SafeRegexCompilerNestingTest.kt, core/regex-safety/src/commonTest/kotlin/io/karandash/helpers/SafeRegexCompilerLimitsTest.kt, core/regex-safety/src/commonTest/kotlin/io/karandash/helpers/RegexHelperTest.kt patterns-redos-rule gap
SafeRegex SDK helper plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/regex/SafeRegexTest.kt gap api-reference
Duration, size and percent values core/common/src/commonTest/kotlin/io/karandash/duration/KarandashDurationTest.kt, core/common/src/commonTest/kotlin/io/karandash/size/KarandashSizeTest.kt, core/common/src/commonTest/kotlin/io/karandash/percent/KarandashPercentTest.kt patterns-cache-ttl-invalid (a bad cache.default-ttl exits 2) gap
Version comparator core/common/src/commonTest/kotlin/io/karandash/utils/VersionComparatorTest.kt gap gap
Glob translator and glob matcher core/common/src/commonTest/kotlin/io/karandash/utils/GlobTranslatorTest.kt, core/glob/src/commonTest/kotlin/io/karandash/utils/GlobMatcherTest.kt gap gap
PII, ticket and URL redaction core/multipattern/src/commonTest/kotlin/io/karandash/security/TextRedactorTest.kt, core/multipattern/src/commonTest/kotlin/io/karandash/security/TicketContentRedactorTest.kt, core/multipattern/src/commonTest/kotlin/io/karandash/security/UrlSanitizerTest.kt gap gap

Profiles

Feature Behavior test E2E Doc
Built-in profiles (profile list/show/export) cli/src/commonTest/kotlin/io/karandash/cli/commands/ProfileCommandTest.kt profile-list, profile-show, profile-export profile
profile: in config, with overrides core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ProfileResolverTest.kt, plugins/integration-tests/contracts/src/jvmTest/kotlin/io/karandash/contracts/fw/ProfileOverridesContractTest.kt profile-apply Profiles
init --profile cli/src/commonTest/kotlin/io/karandash/cli/commands/InitCommandTest.kt profile-init, profile-init-file init
Profile minimal cli/src/commonTest/kotlin/io/karandash/cli/integration/SimplificationFeaturesTest.kt, plugins/integration-tests/rules/src/commonTest/kotlin/io/karandash/validators/ModuleIdConstantsCrossReferenceTest.kt gap profiles
Profile integration-mr plugins/plugins-core/profiles/integration-mr/src/commonTest/kotlin/io/karandash/profiles/IntegrationMrProfileModuleTest.kt gap gap
profile list/show/export --tag/--format/--output cli/src/commonTest/kotlin/io/karandash/cli/commands/ProfileCommandTest.kt profile-list, profile-show, profile-export profile
profileOverrides.size and profileOverrides.title core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ProfileOverridesKeyBehaviourTest.kt, plugins/integration-tests/contracts/src/jvmTest/kotlin/io/karandash/contracts/fw/ProfileOverridesContractTest.kt profile-apply profiles

Platforms and auth

Feature Behavior test E2E Doc
GitLab: fetch MR, token auth plugins/plugins-core/platforms/gitlab/src/commonTest/kotlin/io/karandash/platforms/gitlab/GitLabClientTest.kt live-validate, live-pr-url GitLab
GitLab: post the report comment plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputModuleContractTest.kt live-comment GitLab
GitLab: approvals plugins/integration-tests/contracts/src/commonTest/kotlin/io/karandash/contracts/fw/GitLabApprovalsContractTest.kt live-validate (approval rule fails against the mock) Approvals
allow_localhost for self-hosted instances cli/src/commonTest/kotlin/io/karandash/cli/commands/ConfiguredRuleCommandsTest.kt every live-* scenario (the mock runs on localhost) YAML config
GitHub: token auth plugins/plugins-core/platforms/github/src/commonTest/kotlin/io/karandash/platforms/github/GitHubClientTest.kt gh-token-validate, gh-token-fetch (GitHub Enterprise layout on the mock) GitHub
GitHub App auth (RS256 JWT, installation token, refresh) plugins/plugins-core/platforms/github/src/commonTest/kotlin/io/karandash/platforms/github/GitHubAppAuthTest.kt, core/crypto/src/commonTest/kotlin/io/karandash/crypto/JwtTest.kt gh-app-validate, gh-app-exchange, gh-app-fetch, gh-app-doctor, gh-app-wrong-key (the mock verifies the JWT signature with openssl) GitHub
Bitbucket: token (Bearer) or username + app password (Basic), configured url plugins/plugins-core/platforms/bitbucket/src/commonTest/kotlin/io/karandash/platforms/bitbucket/BitbucketClientTest.kt, plugins/plugins-core/platforms/bitbucket/src/commonTest/kotlin/io/karandash/platforms/bitbucket/BitbucketClientStatusTest.kt bb-validate, bb-validate-bearer, bb-wrong-creds, bb-doctor, bb-doctor-wrong-creds Bitbucket
Gerrit: basic auth plugins/plugins-extended/platforms/gerrit/src/commonTest/kotlin/io/karandash/platforms/gerrit/GerritAuthTest.kt gerrit-validate, gerrit-wrong-creds, gerrit-doctor, gerrit-doctor-wrong-creds Gerrit
Gitea plugins/plugins-extended/platforms/gitea/src/commonTest/kotlin/io/karandash/platforms/gitea/GiteaClientTest.kt gitea-validate, gitea-wrong-creds, gitea-doctor, gitea-doctor-wrong-creds Gitea
Azure DevOps plugins/plugins-extended/platforms/azuredevops/src/commonTest/kotlin/io/karandash/platforms/azuredevops/AzureDevOpsClientTest.kt ado-validate, ado-wrong-token, ado-validate-kebab, ado-doctor, ado-doctor-wrong, ado-doctor-kebab Azure DevOps
AWS CodeCommit: SigV4 with STS session token, endpoint override plugins/plugins-extended/platforms/awscodecommit/src/commonTest/kotlin/io/karandash/platforms/awscodecommit/AwsCodeCommitClientTest.kt, plugins/plugins-extended/platforms/awscodecommit/src/commonTest/kotlin/io/karandash/platforms/awscodecommit/AwsEndpointOverrideTest.kt aws-validate, aws-wrong-creds, aws-endpoint-ssrf, aws-doctor, aws-doctor-wrong (the mock verifies the SigV4 signature) AWS CodeCommit
Jenkins plugins/plugins-extended/platforms/jenkins/src/commonTest/kotlin/io/karandash/platforms/jenkins/JenkinsProviderTest.kt jenkins-validate, jenkins-no-change-url Jenkins
Local MR file (--mr) cli/src/commonTest/kotlin/io/karandash/cli/commands/validate/ValidateLocalAndOnceTest.kt cfg-yaml and every scenario run with --mr mr.json validate
Local git (validate-local) plugins/plugins-core/platforms/local-git/src/commonTest/kotlin/io/karandash/platforms/localgit/LocalGitProviderTest.kt localgit-validate, localgit-validate-fail, localgit-platform-flag, localgit-target-missing (a throwaway git checkout with a target branch) validate-local
SSRF protection on outbound URLs, allow_private_network core/http/src/commonTest/kotlin/io/karandash/http/SsrfUrlValidatorTest.kt, core/http/src/commonTest/kotlin/io/karandash/http/SsrfAllowPrivateNetworkTest.kt cfg-extends-remote (allowed only with allow_localhost), out-webhook-ssrf, cache-remote-ssrf, aws-endpoint-ssrf, cfg-auth-http-refused YAML config
GitLab approveToken plugins/plugins-core/platforms/gitlab/src/commonTest/kotlin/io/karandash/platforms/gitlab/GitLabApproveTokenKeyTest.kt gap gitlab
GitLab deleteInlineStrategy plugins/plugins-core/platforms/gitlab/src/commonTest/kotlin/io/karandash/platforms/gitlab/GitLabMarkedThreadsAndBlameTest.kt gap gitlab
Gerrit notify plugins/plugins-extended/platforms/gerrit/src/commonTest/kotlin/io/karandash/platforms/gerrit/GerritKeyBehaviourTest.kt gap gerrit
Jenkins changeUrl plugins/plugins-extended/platforms/jenkins/src/commonTest/kotlin/io/karandash/platforms/jenkins/JenkinsProviderTest.kt jenkins-no-change-url jenkins
AWS CodeCommit stsEndpoint plugins/plugins-extended/platforms/awscodecommit/src/commonTest/kotlin/io/karandash/platforms/awscodecommit/AwsKeyBehaviourTest.kt gap aws-codecommit
AWS CodeCommit profile (shared credentials file) plugins/plugins-extended/platforms/awscodecommit/src/commonTest/kotlin/io/karandash/platforms/awscodecommit/AwsKeyBehaviourTest.kt gap aws-codecommit
AWS credential chain (env, profile, STS) core/crypto/src/commonTest/kotlin/io/karandash/crypto/AwsCredentialChainTest.kt gap aws-codecommit
Azure DevOps organization plugins/plugins-extended/platforms/azuredevops/src/commonTest/kotlin/io/karandash/platforms/azuredevops/AzureDevOpsKeyBehaviourTest.kt ado-validate-kebab azure-devops
GitHub baseUrl (Enterprise) plugins/plugins-core/platforms/github/src/commonTest/kotlin/io/karandash/platforms/github/GitHubKeyBehaviourTest.kt gh-token-validate github
Platform and CI auto-detection (--no-auto-detect, --platform, --project, --mr-id, --pr) cli/src/commonTest/kotlin/io/karandash/cli/detect/PlatformDetectorTest.kt, core/detect/src/commonTest/kotlin/io/karandash/detect/PlatformDetectorTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/detect/ProviderAutoDetectorTest.kt, core/detect/src/commonTest/kotlin/io/karandash/detect/ProviderAutoDetectorTest.kt, plugins/integration-tests/providers/src/commonTest/kotlin/io/karandash/providers/PlatformSupportContractTest.kt gap environment-variables
KARANDASH_PLATFORM, KARANDASH_PROJECT_ID, KARANDASH_MR_ID, KARANDASH_TOKEN, KARANDASH_BASE_URL cli/src/commonTest/kotlin/io/karandash/cli/detect/PlatformDetectorTest.kt, core/detect/src/commonTest/kotlin/io/karandash/detect/PlatformDetectorTest.kt gap environment-variables
Forge CI environment (CI_FORGE_*) plugins/helpers/src/commonTest/kotlin/io/karandash/providers/common/EnrichmentProvidersTest.kt gap environment-variables
Platform capability flags (merge, reviewers, branches, pipeline, inline, resolve) plugins/integration-tests/providers/src/commonTest/kotlin/io/karandash/providers/PlatformServiceContractTest.kt, core/api/src/commonTest/kotlin/io/karandash/api/PlatformServiceDefaultsTest.kt gap gap
MR search and open-MR listing plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/pipeline/AiArchitectureChecksTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AuthorHistoryTest.kt, plugins/plugins-ai/analyzers/similar-issues/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/similarissues/SimilarIssuesAnalyzerModuleTest.kt gap gap
Repo file reader (head and base content, memoized) cli/src/commonTest/kotlin/io/karandash/cli/pipeline/MemoizedRepositoryFileReaderTest.kt, core/validation/src/commonTest/kotlin/io/karandash/content/GitRepoFileFetcherTest.kt gap gap
Blame fill and working copy at head cli/src/commonTest/kotlin/io/karandash/cli/pipeline/BlameFillTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/WorkingCopyAtHeadTest.kt gap gap
Pagination (page, cursor, probe) core/http/src/commonTest/kotlin/io/karandash/pagination/PaginatorsTest.kt gap gap
Rate-limit info core/api/src/commonTest/kotlin/io/karandash/api/PlatformServiceExtensionsTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/commands/DoctorAuthCheckTest.kt gap gap
Host-scoped auth core/http/src/commonTest/kotlin/io/karandash/http/HostScopedAuthTest.kt, core/http/src/commonTest/kotlin/io/karandash/http/HostCredentialsStaticHeadersTest.kt gap gap
Redirect SSRF check core/http/src/commonTest/kotlin/io/karandash/http/SsrfDnsRebindingTest.kt, core/http/src/commonTest/kotlin/io/karandash/http/SsrfAlwaysBlockedTest.kt gap gap
Approval signals (code review, comment keyword, emoji; rules.approval.methods) plugins/integration-tests/contracts/src/commonTest/kotlin/io/karandash/contracts/fw/GitLabApprovalsContractTest.kt, core/models/src/commonTest/kotlin/io/karandash/models/ApprovalSignalTest.kt live-validate approvals
mr close and mr reopen cli/src/commonTest/kotlin/io/karandash/cli/commands/mr/MrCommandTest.kt gap mr
Commit status publish (ResultStatusPublisher, status-output) plugins/integration-tests/providers/src/commonTest/kotlin/io/karandash/providers/ResultStatusPublisherTest.kt gap status
Git subprocess budget and argument sanitizer core/api/src/commonTest/kotlin/io/karandash/api/platform/SubprocessBudgetTest.kt, core/platform/src/commonTest/kotlin/io/karandash/platform/GitArgSanitizerTest.kt gap gap
Windows command line and environment block core/platform/src/commonTest/kotlin/io/karandash/platform/WindowsCommandLineTest.kt, core/platform/src/commonTest/kotlin/io/karandash/platform/WindowsEnvBlockTest.kt Windows only gap
Self-hosted cache server (tools/cache-server) tools/cache-server/src/test/kotlin/io/karandash/cacheserver/CacheServerModuleTest.kt, tools/cache-server/src/test/kotlin/io/karandash/cacheserver/HttpCacheBackendInteropTest.kt gap self-hosted-cache-server
Local-git platform (local-git, validate local) plugins/plugins-core/platforms/local-git/src/commonTest/kotlin/io/karandash/platforms/localgit/LocalGitRegressionTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/commands/validate/ValidateLocalAndOnceTest.kt gap local-git

Rules, policies and conditions

Feature Behavior test E2E Doc
Rule findings fail validation plugins/plugins-core/rules/title-format/src/commonTest/kotlin/io/karandash/validators/TitleFormatValidatorTest.kt rule-fail, cfg-kts Rules
Built-in rules (title, branch, labels, commits, size, files, ...) one test per rule module, e.g. plugins/plugins-core/rules/labels/src/commonTest/kotlin/io/karandash/validators/LabelsValidatorTest.kt rule-fail (title-format), live-validate (approval, labels), rule-smoke-all (all 20 built-in rules in one config run to completion) Rules
Severity overrides plugins/integration-tests/contracts/src/commonTest/kotlin/io/karandash/contracts/fw/SeverityOverrideContractTest.kt policy-severity Severity policy
--strict (warnings fail, exit 5) cli/src/commonTest/kotlin/io/karandash/cli/commands/ValidateCommandPrModeTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/PipelineStagesTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/compat/CompatExitCodesTest.kt policy-strict validate
Policies (policies: with when:) core/conditions/src/commonTest/kotlin/io/karandash/conditions/DefaultPolicyEngineTest.kt, core/validation/src/commonTest/kotlin/io/karandash/engine/PolicyApplicatorTest.kt policy-severity, policy-disable Conditional rules
Condition language (&&, \|\|, !, not(), predicates) core/validation/src/commonTest/kotlin/io/karandash/engine/MrConditionEvaluatorTest.kt policy-disable (label_exists(...) && !is_draft), rule-when-skip, rule-when-run (a rule when: false skips it, true runs it) Conditional rules
verify-policy cli/src/commonTest/kotlin/io/karandash/cli/commands/ConfiguredRuleCommandsTest.kt policy-verify verify-policy
Rule meta (when, severities, enabled, per-rule timeouts) core/validation/src/commonTest/kotlin/io/karandash/engine/RuleMetaKeyBehaviourTest.kt, core/validation/src/commonTest/kotlin/io/karandash/engine/ValidationEngineWhenTest.kt, core/validation/src/commonTest/kotlin/io/karandash/engine/ValidationEngineTimeoutTest.kt gap conditional
Required-field filter and unavailable-fields note core/validation/src/commonTest/kotlin/io/karandash/engine/ValidationEngineRequiredFieldTest.kt gap gap
Rule execution priority and two-pass run core/validation/src/commonTest/kotlin/io/karandash/engine/ValidationEnginePriorityTest.kt, core/validation/src/commonTest/kotlin/io/karandash/engine/ValidationEngineTwoPassTest.kt gap gap
Rule title-format plugins/plugins-core/rules/title-format/src/commonTest/kotlin/io/karandash/validators/TitleFormatValidatorTest.kt rule-fail, rule-smoke-titleFormat title-format
Rule commit-messages plugins/plugins-core/rules/commit-messages/src/commonTest/kotlin/io/karandash/validators/CommitMessagesValidatorTest.kt, plugins/plugins-core/rules/commit-messages/src/commonTest/kotlin/io/karandash/validators/CommitMessagesGroupingTest.kt rule-smoke-commitMessages (enabled with defaults, runs to completion) commit-messages
Rule jira-ticket plugins/plugins-extended/rules/jira-ticket/src/commonTest/kotlin/io/karandash/validators/JiraTicketValidatorTest.kt, plugins/plugins-extended/rules/jira-ticket/src/commonTest/kotlin/io/karandash/validators/JiraTicketPatternsTest.kt rule-smoke-jiraTicket (enabled with defaults, runs to completion) jira-ticket
Rule branch-naming plugins/plugins-core/rules/branch-naming/src/commonTest/kotlin/io/karandash/validators/BranchNamingValidatorTest.kt, plugins/integration-tests/rules/src/commonTest/kotlin/io/karandash/validators/MultiValidatorPerformanceTest.kt rule-smoke-branchNaming (enabled with defaults, runs to completion) branch-naming
Rule file-changes plugins/plugins-core/rules/file-changes/src/commonTest/kotlin/io/karandash/validators/FileChangesValidatorTest.kt, plugins/plugins-core/rules/file-changes/src/commonTest/kotlin/io/karandash/validators/FileChangesRegressionTest.kt rule-smoke-fileChanges (enabled with defaults, runs to completion) file-changes
Rule codeowners plugins/plugins-extended/rules/codeowners/src/commonTest/kotlin/io/karandash/validators/CodeownersValidatorTest.kt, plugins/plugins-extended/rules/codeowners/src/commonTest/kotlin/io/karandash/validators/CodeownersKeyBehaviourTest.kt rule-smoke-codeowners (enabled with defaults, runs to completion) codeowners
Rule approval plugins/plugins-extended/rules/approval/src/commonTest/kotlin/io/karandash/validators/ApprovalValidatorTest.kt, plugins/plugins-extended/rules/approval/src/commonTest/kotlin/io/karandash/validators/ApprovalKeyBehaviourTest.kt live-validate, rule-smoke-approval approvals
Rule reviewer plugins/plugins-extended/rules/reviewer/src/commonTest/kotlin/io/karandash/validators/ReviewerValidatorTest.kt, plugins/plugins-extended/rules/reviewer/src/commonTest/kotlin/io/karandash/validators/ReviewerKeyBehaviourTest.kt rule-smoke-reviewer (enabled with defaults, runs to completion) reviewers
Rule cicd-status plugins/plugins-extended/rules/cicd-status/src/commonTest/kotlin/io/karandash/validators/CicdStatusValidatorTest.kt, plugins/plugins-extended/rules/cicd-status/src/commonTest/kotlin/io/karandash/validators/CicdStatusKeyBehaviourTest.kt rule-smoke-cicdStatus (enabled with defaults, runs to completion) cicd-status
Rule conflict plugins/plugins-extended/rules/conflict/src/commonTest/kotlin/io/karandash/validators/ConflictValidatorTest.kt, plugins/plugins-extended/rules/conflict/src/commonTest/kotlin/io/karandash/validators/ConflictKeyBehaviourTest.kt rule-smoke-conflict (enabled with defaults, runs to completion) conflict-detection
Rule draft gap rule-smoke-draftPrevention (enabled with defaults, runs to completion) draft-detection
Rule labels plugins/plugins-core/rules/labels/src/commonTest/kotlin/io/karandash/validators/LabelsValidatorTest.kt live-validate, rule-smoke-labels labels
Rule size-limits plugins/plugins-core/rules/size-limits/src/commonTest/kotlin/io/karandash/validators/SizeLimitsValidatorTest.kt, plugins/plugins-core/rules/size-limits/src/commonTest/kotlin/io/karandash/validators/SizeLimitsKeyBehaviourTest.kt rule-smoke-sizeLimits (enabled with defaults, runs to completion) size-limits
Rule security plugins/plugins-core/rules/security/src/commonTest/kotlin/io/karandash/validators/SecurityValidatorTest.kt, plugins/plugins-core/rules/security/src/commonTest/kotlin/io/karandash/validators/SecurityKeyBehaviourTest.kt rule-smoke-security (enabled with defaults, runs to completion) security
Rule context-tag plugins/plugins-extended/rules/context-tag/src/commonTest/kotlin/io/karandash/validators/ContextTagValidatorTest.kt, projects/wallet/src/commonTest/kotlin/io/karandash/validators/WalletRequirementsIntegrationTest.kt rule-smoke-contextTag (enabled with defaults, runs to completion) context-tags
Rule description-format plugins/plugins-extended/rules/description-format/src/commonTest/kotlin/io/karandash/validators/DescriptionFormatValidatorTest.kt, plugins/plugins-extended/rules/description-format/src/commonTest/kotlin/io/karandash/validators/DescriptionFormatFixHintTest.kt rule-smoke-descriptionFormat (enabled with defaults, runs to completion) description-format
Rule cross-entity-consistency plugins/plugins-extended/rules/cross-entity-consistency/src/commonTest/kotlin/io/karandash/validators/CrossEntityConsistencyValidatorTest.kt, projects/base/src/commonTest/kotlin/io/karandash/validators/BaseRequirementsIntegrationTest.kt rule-smoke-crossEntityConsistency (enabled with defaults, runs to completion) cross-entity-consistency
Rule language-policy plugins/plugins-extended/rules/language-policy/src/commonTest/kotlin/io/karandash/validators/LanguagePolicyValidatorTest.kt, projects/base/src/commonTest/kotlin/io/karandash/validators/BaseRequirementsIntegrationTest.kt rule-smoke-languagePolicy (enabled with defaults, runs to completion) language-policy
Rule commit-body plugins/plugins-core/rules/commit-body/src/commonTest/kotlin/io/karandash/validators/CommitBodyValidatorTest.kt, projects/wallet/src/commonTest/kotlin/io/karandash/validators/WalletRequirementsIntegrationTest.kt rule-smoke-commitBody (enabled with defaults, runs to completion) commit-body
Rule dependencies plugins/plugins-extended/rules/dependencies/src/commonTest/kotlin/io/karandash/validators/DependencyValidatorTest.kt, plugins/plugins-extended/rules/dependencies/src/commonTest/kotlin/io/karandash/validators/DependencyValidationRuleModuleTest.kt rule-smoke-dependencyValidation (enabled with defaults, runs to completion) dependency-validation
Policy predicate families (MR data, file metrics, env, config, rule result) core/conditions/src/commonTest/kotlin/io/karandash/conditions/MrDataPredicatesTest.kt, core/conditions/src/commonTest/kotlin/io/karandash/conditions/FileMetricPredicatesTest.kt, core/conditions/src/commonTest/kotlin/io/karandash/conditions/EnvironmentPredicatesTest.kt, core/conditions/src/commonTest/kotlin/io/karandash/conditions/ConfigPredicatesTest.kt, core/conditions/src/commonTest/kotlin/io/karandash/conditions/RuleResultPredicatesTest.kt gap conditional
Severity cap extension (severityCap) plugins/plugins-core/extensions/severity-cap/src/commonTest/kotlin/io/karandash/extensions/SeverityCapExtensionTest.kt rule-severity-cap (top-level cap turns the error into a passing warning), rule-severity-cap-rule (a per-rule severity-cap: error keeps it blocking) severity-policy
Rule result cache (--no-cache, --invalidate-rules, --gate-on-cached) core/validation/src/commonTest/kotlin/io/karandash/engine/ValidationEngineCacheTest.kt, core/state/src/commonTest/kotlin/io/karandash/cache/cas/CasStateStoreTest.kt gap cache
Baseline (--baseline, --update-baseline, delta new and fixed) core/api/src/commonTest/kotlin/io/karandash/api/ReportMetricsSerializationTest.kt, plugins/helpers/src/commonTest/kotlin/io/karandash/helpers/reporter/ReportViewBuilderTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/FindingSuppressionTest.kt gap validate
Finding suppression and dismissed inline comments cli/src/commonTest/kotlin/io/karandash/cli/pipeline/FindingSuppressionTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/NotificationGateTest.kt, plugins/loader/src/commonTest/kotlin/io/karandash/loader/bridge/BridgeCallShapeTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiPlatformDismissalsTest.kt gap gap
--rules, --rules-file, --show-execution-plan, --explain cli/src/commonTest/kotlin/io/karandash/cli/CliFlagTableTest.kt gap validate
simulate --approvers cli/src/commonTest/kotlin/io/karandash/cli/commands/simulate/SimulateCommandTest.kt live-simulate simulate
test-rule --snapshot, --mr-url, --against-history, --replay-count cli/src/commonTest/kotlin/io/karandash/cli/commands/ConfiguredRuleCommandsTest.kt cmd-test-rule, live-test-rule test-rule
mutate --rule and --synthetic-mrs plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/architecture/RuleMutationTesterTest.kt cmd-mutate mutate
Jira validation (jira-ticket against Jira API) plugins/plugins-extended/rules/jira-ticket/src/commonTest/kotlin/io/karandash/validators/JiraTicketValidatorTest.kt, plugins/plugins-extended/rules/jira-ticket/src/commonTest/kotlin/io/karandash/validators/JiraTicketPatternsTest.kt gap jira-validation

Validation pipeline, fixes and state

Feature Behavior test E2E Doc
Auto-fix (--fix --yes) core/validation/src/commonTest/kotlin/io/karandash/fixing/AutoFixerCustomTest.kt, plugins/integration-tests/contracts/src/commonTest/kotlin/io/karandash/contracts/fw/AutofixCustomContractTest.kt live-fix, live-fix-write (adds the missing label on the mock) Auto-fix
Scripts block (scripts:, QuickJS sandbox) plugins/plugins-extended/scripts/src/commonTest/kotlin/io/karandash/scripts/BuiltInScriptModuleTest.kt, plugins/plugins-extended/scripts/src/commonTest/kotlin/io/karandash/scripts/SandboxScriptExecutorTest.kt, plugins/plugins-extended/scripts/src/commonTest/kotlin/io/karandash/scripts/SandboxDslFindingsTest.kt script-module-test.sh Scripts
Dangerfile (JS, via node) cli/src/commonTest/kotlin/io/karandash/cli/pipeline/JsDangerfileTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/dangerfile/DangerfileDetectorTest.kt dangerfile-js (needs node: in the toolchain image, so it runs on CI) Dangerfile
Pipeline extension hooks (onConfigured, onPostFetch, afterValidation, beforeReporting, onPipelineComplete) core/api/src/commonTest/kotlin/io/karandash/api/ModuleInterfaceDefaultsTest.kt gap api-reference
Extension hooks for incremental state (getCachedFindings, invalidateRules, needsBlame, needsHeadContent, baseFiles) plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiPipelineExtensionNeedsHeadContentTest.kt, plugins/loader/src/commonTest/kotlin/io/karandash/loader/bridge/BridgeHostProxiesTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/IncrementalCacheBypassTest.kt gap api-reference
Auto-fix handlers (request review, remove review, custom) core/validation/src/commonTest/kotlin/io/karandash/fixing/AutoFixerCustomTest.kt, core/validation/src/commonTest/kotlin/io/karandash/fixing/AutoFixerDescriptionTest.kt gap auto-fix
Fix hints and code-change suggestions core/models/src/commonTest/kotlin/io/karandash/models/finding/FindingFixHintTest.kt, core/models/src/commonTest/kotlin/io/karandash/models/finding/FindingCodeChangeTest.kt, core/common/src/commonTest/kotlin/io/karandash/utils/suggestion/ContextAwareSuggestionGeneratorTest.kt gap auto-fix
autoApprove and --auto-approve cli/src/commonTest/kotlin/io/karandash/cli/pipeline/AutoApproveHandlerTest.kt gap gap
Script mode subprocess and timeout plugins/plugins-extended/scripts/src/commonTest/kotlin/io/karandash/scripts/BuiltInScriptModuleTest.kt, plugins/plugins-extended/scripts/src/commonTest/kotlin/io/karandash/scripts/SubprocessScriptExecutorTest.kt, plugins/plugins-extended/scripts/src/commonTest/kotlin/io/karandash/scripts/ScriptRoutingAndConfigTest.kt script-module-test.sh scripts
Script DSL injector plugins/plugins-extended/scripts/src/commonTest/kotlin/io/karandash/scripts/SubprocessScriptExecutorTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/ScriptExecutorResultTest.kt gap scripts
Incremental state (snapshots, diff delta) core/state/src/commonTest/kotlin/io/karandash/state/snapshot/SnapshotManagerTest.kt, core/state/src/commonTest/kotlin/io/karandash/state/snapshot/DiffDeltaCalculatorTest.kt gap
Content resolver (content sources, symlink guard) core/validation/src/commonTest/kotlin/io/karandash/content/ContentResolverTest.kt, core/validation/src/jvmTest/kotlin/io/karandash/content/ContentResolverSymlinkTest.kt gap gap
Report data builder and report engine core/validation/src/commonTest/kotlin/io/karandash/engine/ReportDataBuilderTest.kt, core/validation/src/commonTest/kotlin/io/karandash/engine/ReportEngineTest.kt gap gap
CI log summary cli/src/commonTest/kotlin/io/karandash/cli/pipeline/CiLogSummaryTest.kt gap ci-cd-integration

Enrichment

Feature Behavior test E2E Doc
Enrichment providers (Jira, Confluence, local git) cli/src/commonTest/kotlin/io/karandash/cli/pipeline/EnrichmentStageTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/EnrichmentProviderConfigKeyTest.kt, plugins/plugins-extended/enrichment/jira-enrichment/src/commonTest/kotlin/io/karandash/enrichment/jira/JiraEnrichmentProviderTest.kt, plugins/plugins-extended/enrichment/confluence-enrichment/src/commonTest/kotlin/io/karandash/enrichment/confluence/ConfluenceEnrichmentProviderTest.kt, plugins/plugins-extended/enrichment/local-git-enrichment/src/commonTest/kotlin/io/karandash/enrichment/localgit/LocalGitEnrichmentProviderTest.kt, plugins/plugins-extended/enrichment/local-git-enrichment/src/commonTest/kotlin/io/karandash/enrichment/localgit/ContributorAnalyzerTest.kt enrich-jira, enrich-jira-issue-fetch, enrich-confluence-page-fetch (Atlassian mock), enrich-localgit-with, enrich-localgit-hotspot-kept, enrich-localgit-cold-dropped, enrich-localgit-without, enrich-localgit-control-cold-kept, enrich-localgit-control-hot-dropped, enrich-localgit-contributors Enrichment
ci-enrichment provider plugins/plugins-extended/enrichment/ci-enrichment/src/commonTest/kotlin/io/karandash/enrichment/ci/CiEnrichmentProviderTest.kt, plugins/plugins-extended/enrichment/ci-enrichment/src/commonTest/kotlin/io/karandash/enrichment/ci/CiPipelineFlowTest.kt gap enrichment
github-issue provider plugins/plugins-extended/enrichment/github-issue-enrichment/src/commonTest/kotlin/io/karandash/enrichment/github/GitHubIssueEnrichmentProviderTest.kt, plugins/plugins-extended/enrichment/github-issue-enrichment/src/commonTest/kotlin/io/karandash/enrichment/github/GitHubIssueFetchTest.kt gap enrichment
gitlab-issue provider plugins/plugins-extended/enrichment/gitlab-issue-enrichment/src/commonTest/kotlin/io/karandash/enrichment/gitlabissue/GitLabIssueEnrichmentProviderTest.kt, plugins/plugins-extended/enrichment/gitlab-issue-enrichment/src/commonTest/kotlin/io/karandash/enrichment/gitlabissue/GitLabIssueFetchTest.kt gap enrichment
symbol-context provider plugins/plugins-extended/enrichment/symbol-context-enrichment/src/commonTest/kotlin/io/karandash/enrichment/symbol/SymbolContextEnrichmentProviderTest.kt, plugins/plugins-extended/enrichment/symbol-context-enrichment/src/commonTest/kotlin/io/karandash/enrichment/symbol/SymbolContextEnrichmentBehaviourTest.kt gap enrichment
LocalGitEnrichmentContextEnricher (local git as AI context) plugins/plugins-extended/enrichment/local-git-enrichment/src/commonTest/kotlin/io/karandash/enrichment/localgit/LocalGitEnrichmentContextEnricherTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/AiPromptAssemblerLocalGitTest.kt enrich-localgit-with, enrich-localgit-without enrichment
Local-git enrichment hotspots and contributors plugins/plugins-extended/enrichment/local-git-enrichment/src/commonTest/kotlin/io/karandash/enrichment/localgit/LocalGitEnrichmentProviderTest.kt, plugins/plugins-extended/enrichment/local-git-enrichment/src/commonTest/kotlin/io/karandash/enrichment/localgit/LocalGitRepositoryTest.kt enrich-localgit-hotspot-kept, enrich-localgit-contributors enrichment
rule-enrichment: bindings (rule:provider) cli/src/commonTest/kotlin/io/karandash/cli/pipeline/ModuleInitializerEnrichmentTest.kt gap enrichment
enrichment.* keys cli/src/commonTest/kotlin/io/karandash/cli/pipeline/EnrichmentStageTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/EnrichmentProviderConfigKeyTest.kt gap enrichment
Enrichment globs core/glob/src/commonTest/kotlin/io/karandash/utils/EnrichmentGlobMatcherTest.kt gap enrichment
Enrichment DAG and required enrichment core/validation/src/commonTest/kotlin/io/karandash/enrichment/EnrichmentEngineTest.kt, core/validation/src/commonTest/kotlin/io/karandash/engine/ValidationEngineRequiredEnrichmentTest.kt gap
--enrich and --dry-run-enrich cli/src/commonTest/kotlin/io/karandash/cli/CliFlagTableTest.kt gap gap
Top-level enrichmentProviders: cli/src/commonTest/kotlin/io/karandash/cli/pipeline/EnrichmentStageTest.kt gap enrichment
AI context enrichers (convention, full-file, related-file, ticket, design-doc, CI, symbol, diff-annotations, symbol-definitions) plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/context/KnowledgeContextEnrichersTest.kt, plugins/integration-tests/rules/src/commonTest/kotlin/io/karandash/integration/rules/ai/AiContextQualityPipelineIntegrationTest.kt gap knowledge-context

Commands

Feature Behavior test E2E Doc
--version, --help cli/src/jvmTest/kotlin/io/karandash/cli/compat/CliHelpTreeTest.kt cli-version, cli-help CLI reference
doctor cli/src/commonTest/kotlin/io/karandash/cli/commands/DoctorCommandTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/commands/DoctorAuthCheckTest.kt live-doctor, cmd-doctor-noconfig doctor
explain cli/src/commonTest/kotlin/io/karandash/cli/commands/ExplainCommandTest.kt cmd-explain explain
stats cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/stats/StatsCommandDirTest.kt cmd-stats, cmd-stats-empty stats
calibrate cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/calibrate/CalibrateCommandEvtConfigTest.kt cmd-calibrate calibrate
test-rule (snapshot and live MR) cli/src/commonTest/kotlin/io/karandash/cli/commands/ConfiguredRuleCommandsTest.kt cmd-test-rule, live-test-rule test-rule
mutate plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/architecture/RuleMutationTesterTest.kt cmd-mutate mutate
simulate cli/src/commonTest/kotlin/io/karandash/cli/commands/simulate/SimulateCommandTest.kt live-simulate simulate
deps cli/src/commonTest/kotlin/io/karandash/cli/commands/DepsCommandTest.kt live-deps deps
mr merge cli/src/commonTest/kotlin/io/karandash/cli/commands/ConfiguredRuleCommandsTest.kt live-mr-merge, live-mr-merge-put mr
report summary cli/src/commonTest/kotlin/io/karandash/cli/commands/report/ReportSummaryCommandTest.kt report-summary report
wizard cli/src/commonTest/kotlin/io/karandash/cli/wizard/NativeSetupWizardTest.kt wizard-generate, wizard-config-file (answers piped on stdin) wizard
format render --template/--partial/--escape cli/src/commonTest/kotlin/io/karandash/cli/commands/format/FormatCommandTest.kt gap format
plugin verify, plugin update, plugin search cli/src/commonTest/kotlin/io/karandash/cli/plugin/PluginSearchCommandTest.kt, cli/src/jvmTest/kotlin/io/karandash/cli/commands/PluginLifecycleCommandsTest.kt cmd-plugin-verify, registry-update plugin
Plugin-contributed ai fix, ai reply, ai describe (flags parsed raw) cli/src/commonTest/kotlin/io/karandash/cli/plugin/PluginCommandBridgeTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/compat/DocsCommandLinesTest.kt ai-cmd-fix, ai-cmd-fix-call ai
stats --audit, --diagnostics, --llm-judge cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/stats/StatsAuditCommandTest.kt (audit writes the report to out and prints the table, llm judge asks the configured provider about unknown replies), cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/stats/StatsCommandModesTest.kt, cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/stats/digest/DiagnosticDigestTest.kt gap stats
stats --corpus, --bot, --seed, --cutoff, --limit, --holdout-project cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/stats/StatsAuditCommandTest.kt (--corpus --bot --seed --cutoff --out), cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/stats/StatsCommandTableTest.kt (--limit), cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/stats/audit/AuditSplitsTest.kt (holdout project) gap stats
stats --json, --rule, --stats-dir, --clear cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/stats/StatsCommandDirTest.kt cmd-stats-empty stats
calibrate --learn, --target-fp-rate, --min-samples, --window cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/calibrate/CalibrateCommandEvtConfigTest.kt, cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/HistoryFlagsTest.kt (--window) gap calibrate
calibrate --bot and --corpus cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/calibrate/CalibrateCorpusCommandTest.kt gap calibrate
explain --ai, --format text|markdown|json|doc, --output cli/src/commonTest/kotlin/io/karandash/cli/commands/ExplainCommandTest.kt, cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/explain/ExplainCommandTest.kt, cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/explain/DocExplainRendererTest.kt, cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/explain/DocAiEnhancerTest.kt cmd-explain explain
doctor --offline and --plugins cli/src/commonTest/kotlin/io/karandash/cli/commands/DoctorCommandTest.kt cmd-doctor-noconfig doctor
doctor checks (auth, config, patterns, platform auth, plugins, policies) cli/src/commonTest/kotlin/io/karandash/cli/commands/DoctorAuthCheckTest.kt live-doctor doctor
validate --once, --target, --profile, --style cli/src/commonTest/kotlin/io/karandash/cli/commands/validate/ValidateLocalAndOnceTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/CliFlagTableTest.kt gap validate
validate --no-color (and NO_COLOR, TERM=dumb) gap gap validate
validate --trace, --show-prompt, --dump-dir, --diagnostic cli/src/commonTest/kotlin/io/karandash/cli/CliFlagTableTest.kt gap validate
validate --dry-run-comment, --format, --output, --allow-localhost, --dangerfile cli/src/commonTest/kotlin/io/karandash/cli/CliFlagTableTest.kt rep-output-file validate
cache gc --remote, --backend-type, --backend-url, --cache-dir cli/src/commonTest/kotlin/io/karandash/cli/commands/cache/CacheCommandFailureExitTest.kt cmd-cache-gc cache
Global flags (-V, -v/--verbose/--debug, -q/--quiet) cli/src/jvmTest/kotlin/io/karandash/cli/compat/CliHelpTreeTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/CliLogLevelTest.kt (log level flags) cli-version cli-reference
NO_COLOR, KARANDASH_LOG_LEVEL, KARANDASH_STRICT cli/src/commonTest/kotlin/io/karandash/cli/CliLogLevelTest.kt, core/interpolation/src/commonTest/kotlin/io/karandash/interpolation/KarandashEnvSecurityTest.kt gap environment-variables
Exit codes 0 to 7 cli/src/commonTest/kotlin/io/karandash/cli/commands/validate/ExitCodeMappingTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/CliContractTest.kt, cli/src/jvmTest/kotlin/io/karandash/cli/GlobalTimeoutExitCodeTest.kt, cli/src/jvmTest/kotlin/io/karandash/cli/compat/ErrorCodeRaiseSitesTest.kt policy-strict error-codes
Error catalog and the internal-error last-resort handler cli/src/jvmTest/kotlin/io/karandash/cli/compat/CompatErrorMessagesTest.kt, core/api/src/commonTest/kotlin/io/karandash/api/errors/KarandashErrorTest.kt gap error-codes
Distribution entry point (cli-app main) cli-app/src/test/kotlin/io/karandash/cliapp/MainSmokeTest.kt cli-version README
Native to JVM bridge entry (KARANDASH_BRIDGE_JAR) plugins/loader/jar-bridge/src/test/kotlin/io/karandash/loader/jar/BridgeMainSmokeTest.kt gap JVM_VS_NATIVE_FEATURES
Distributions (native binary, jpackage, native image, JVM jar) cli-app/src/test/kotlin/io/karandash/cliapp/MainSmokeTest.kt cli-version choosing
Installers (tools/jlink-config scripts) gap release scripts jpackage

Observability and diagnostics

Feature Behavior test E2E Doc
Logger and secret redaction in logs core/logger/src/commonTest/kotlin/io/karandash/logger/LoggerDefaultsTest.kt, core/http/src/commonTest/kotlin/io/karandash/http/HttpSecretsInMessagesTest.kt gap observability
HTTP logging and diagnostics plugins core/http/src/commonTest/kotlin/io/karandash/http/HttpLoggingPluginTest.kt, core/http/src/commonTest/kotlin/io/karandash/http/HttpDiagnosticAndAuthTest.kt, core/http/src/commonTest/kotlin/io/karandash/http/RunScopedDiagnosticListenerTest.kt gap observability
HTTP client ledger core/http/src/commonTest/kotlin/io/karandash/http/HttpClientLedgerTest.kt gap gap
Diagnostic collector and report core/diagnostics/src/commonTest/kotlin/io/karandash/diagnostics/DiagnosticCollectorSummaryTest.kt, core/diagnostics/src/commonTest/kotlin/io/karandash/diagnostics/DiagnosticCollectorBoundsTest.kt, core/diagnostics/src/commonTest/kotlin/io/karandash/diagnostics/DiagnosticReportSerializationTest.kt gap observability
Diagnostic outcomes bridge cli/src/commonTest/kotlin/io/karandash/cli/pipeline/DiagnosticOutcomesTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/PipelineDiagnosticBridgeTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/DiagnosticsKeyBehaviourTest.kt gap observability
Run dump (--dump-dir: prompt, budget, dispatch) core/api/src/commonTest/kotlin/io/karandash/api/run/RunDumpTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/DumpDirWriterTest.kt gap AI_FEATURES_REFERENCE, observability
KARANDASH_AI_TRACE core/ai-pipeline/src/commonTest/kotlin/io/karandash/ai/pipeline/AiTraceTest.kt gap observability
KARANDASH_AI_DRY_RUN plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiRuleModuleEnvVarsTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/init/AiRuleInitializerEnvTest.kt gap observability
Crash handler (JVM and native) core/crash-handler/src/jvmTest/kotlin/io/karandash/crashhandler/CrashHandlerJvmTest.kt, core/crash-handler/src/nativeTest/kotlin/io/karandash/crashhandler/CrashReportTest.kt, core/crash-handler/src/posixTest/kotlin/io/karandash/crashhandler/CrashHandlerSignalTest.kt gap observability
Timing and validation metrics in reports core/api/src/commonTest/kotlin/io/karandash/api/ReportMetricsSerializationTest.kt, core/api/src/commonTest/kotlin/io/karandash/api/ApiWireContractTest.kt, core/validation/src/commonTest/kotlin/io/karandash/engine/ReportDataBuilderTest.kt, core/api/src/commonTest/kotlin/io/karandash/api/ApiValueTypesTest.kt gap observability
AI cost log, status line and usage meter plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiRuleCostLoggerTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiStatusLineTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/UsageMeterTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/CostDeltaSplitTest.kt gap observability

Reporters and outputs

Feature Behavior test E2E Doc
Console plugins/plugins-core/formats/console-format/src/commonTest/kotlin/io/karandash/plugins/formats/ConsoleFormatModuleContractTest.kt rep-console Console
JSON cli/src/commonTest/kotlin/io/karandash/cli/commands/report/ReportSummaryCommandTest.kt rep-json, rep-output-file, rep-output-file-content JSON
SARIF plugins/plugins-extended/formats/sarif-format/src/commonTest/kotlin/io/karandash/plugins/formats/SarifFormatModuleContractTest.kt rep-sarif SARIF
reviewdog (rdjson, rdjsonl) plugins/plugins-extended/formats/rdjson-format/src/commonTest/kotlin/io/karandash/plugins/formats/RdjsonFormatModuleContractTest.kt, plugins/plugins-extended/formats/rdjsonl-format/src/commonTest/kotlin/io/karandash/plugins/formats/RdjsonlFormatModuleContractTest.kt rep-rdjson, rep-rdjsonl reviewdog
Markdown plugins/plugins-core/formats/markdown-format/src/commonTest/kotlin/io/karandash/plugins/formats/MarkdownFormatModuleContractTest.kt rep-markdown Markdown
JUnit XML plugins/plugins-extended/formats/junit-format/src/commonTest/kotlin/io/karandash/plugins/formats/JunitFormatModuleContractTest.kt out-junit-html, out-junit-file, out-junit-failure (reporters: junit: output:) JUnit
HTML plugins/plugins-extended/formats/html-format/src/commonTest/kotlin/io/karandash/plugins/formats/HtmlFormatModuleContractTest.kt out-junit-html, out-html-file, out-html-finding HTML
Slack plugins/plugins-extended/outputs/slack-output/src/commonTest/kotlin/io/karandash/plugins/outputs/SlackOutputDeliveryTest.kt, plugins/plugins-extended/outputs/slack-output/src/commonTest/kotlin/io/karandash/plugins/outputs/SlackOutputLocalhostTest.kt out-slack, out-slack-post, out-slack-body (Block Kit on the mock), out-slack-guard, out-slack-no-post Slack
Webhook plugins/plugins-extended/outputs/webhook-output/src/commonTest/kotlin/io/karandash/plugins/outputs/WebhookOutputStatusTest.kt, plugins/plugins-extended/outputs/webhook-output/src/commonTest/kotlin/io/karandash/plugins/outputs/WebhookOutputLocalhostTest.kt out-webhook, out-webhook-post, out-webhook-auth, out-webhook-body, out-webhook-body-rule, out-webhook-body-failed, out-webhook-noauth, out-webhook-ssrf, out-webhook-ssrf-blocked Webhook
Email plugins/plugins-extended/outputs/email-output/src/jvmTest/kotlin/io/karandash/plugins/outputs/EmailDeliveryTest.kt, plugins/plugins-extended/outputs/email-output/src/commonTest/kotlin/io/karandash/plugins/outputs/EmailPlaintextPolicyTest.kt out-email (a loopback relay, mock-server/smtp_sink.py, logs envelope and message), out-email-tls-required, out-email-plaintext-remote Email
codequality format plugins/plugins-extended/formats/codequality-format/src/commonTest/kotlin/io/karandash/plugins/formats/CodeQualityFormatModuleTest.kt gap codequality
slack-format (and compact) plugins/plugins-extended/formats/slack-format/src/commonTest/kotlin/io/karandash/plugins/formats/SlackFormatModuleContractTest.kt, plugins/plugins-extended/formats/slack-format/src/commonTest/kotlin/io/karandash/plugins/formats/SlackFormatReportTest.kt gap slack
template-format (escapes html, markdown, slack, json, none) plugins/plugins-extended/formats/template-format/src/commonTest/kotlin/io/karandash/plugins/formats/TemplateFormatModuleContractTest.kt gap template
json-format plugins/plugins-core/parsers/json/src/commonTest/kotlin/io/karandash/plugins/parsers/json/JsonFormatModuleLoaderTest.kt, plugins/builtin/src/commonTest/kotlin/io/karandash/builtin/BuiltInModuleRegistryTest.kt rep-json json
filesystem output plugins/plugins-core/outputs/filesystem/src/commonTest/kotlin/io/karandash/plugins/outputs/FilesystemOutputModuleContractTest.kt, plugins/plugins-core/outputs/filesystem/src/commonTest/kotlin/io/karandash/plugins/outputs/FilesystemKeyBehaviourTest.kt rep-output-file-content index
stdout output plugins/plugins-core/outputs/stdout/src/commonTest/kotlin/io/karandash/plugins/outputs/StdoutOutputModuleContractTest.kt, plugins/plugins-core/outputs/stdout/src/jvmTest/kotlin/io/karandash/plugins/outputs/StdoutOutputModuleOutputTest.kt rep-console index
reporters.<format>.hideFields cli/src/jvmTest/kotlin/io/karandash/cli/pipeline/FormatFieldCoverageTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/commands/validate/FormatOutputPlannerWiringTest.kt gap gap
reporters: entries as format config carriers cli/src/commonTest/kotlin/io/karandash/cli/commands/validate/FormatOutputPlannerWiringTest.kt, cli/src/jvmTest/kotlin/io/karandash/cli/pipeline/FormatFieldCoverageTest.kt gap index
Output on-error policy gap gap gap
Notification state and gate (dedupe) plugins/helpers/src/commonTest/kotlin/io/karandash/helpers/output/NotificationStateTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/NotificationGateTest.kt gap gap
Slack notificationTarget cli/src/commonTest/kotlin/io/karandash/cli/pipeline/NotificationGateTest.kt, plugins/plugins-extended/outputs/slack-output/src/commonTest/kotlin/io/karandash/plugins/outputs/SlackBotTokenTest.kt gap slack
Commit status output (status-output) plugins/integration-tests/providers/src/commonTest/kotlin/io/karandash/providers/ResultStatusPublisherTest.kt gap status
Reviewdog diagnostic mapping plugins/helpers/src/commonTest/kotlin/io/karandash/helpers/reporter/ReviewdogDiagnosticTest.kt rep-rdjson reviewdog

Platform comments

Feature Behavior test E2E Doc
Platform comment plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputModuleContractTest.kt live-comment GitLab
Comment mode all plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputModuleContractTest.kt, plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputModuleCacheTest.kt gap markdown
Comment mode summary plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/SummaryRowsTest.kt, plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputModuleCacheTest.kt gap markdown
Comment mode inline plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputModuleCacheTest.kt gap markdown
Comment mode none plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputModuleCacheTest.kt gap markdown
Summary comment edit in place versus reply, UpdatedStamp plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputModuleCacheTest.kt, plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/SummaryRowsTest.kt gap gap
Inline comments: batch versus each plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputModuleContractTest.kt, plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputModuleCacheTest.kt gap gap
Reconcile: resolve and outdated threads plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/InlineReconcilerTest.kt, plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputReconcileTest.kt gap gap
Reconcile: superseded inline comments plugins/helpers/src/commonTest/kotlin/io/karandash/providers/common/SupersededInlineCommentTest.kt gap gap
Reconcile: lifecycle text plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputReconcileTest.kt gap gap
Inline thread matching and markers core/api/src/commonTest/kotlin/io/karandash/api/finding/InlineThreadMatcherTest.kt, core/api/src/commonTest/kotlin/io/karandash/api/finding/InlineFindingMarkerTest.kt, core/api/src/commonTest/kotlin/io/karandash/api/finding/InlineFindingThreadTest.kt gap gap
markdown flag, when: and onError on the platform output plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputModuleContractTest.kt, plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputReconcileTest.kt, cli/src/jvmTest/kotlin/io/karandash/cli/pipeline/OutputDestinationContractTest.kt gap markdown
GitHub review threads (GraphQL, 100 cap) plugins/plugins-core/platforms/github/src/commonTest/kotlin/io/karandash/platforms/github/GitHubReviewThreadsTest.kt gap github
Review threads and AI thread answers (ai.threadCommands) plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/ThreadAnswerStageTest.kt, core/api/src/commonTest/kotlin/io/karandash/api/ReviewThreadApiTest.kt gap gap

Presentation, templating and i18n

Feature Behavior test E2E Doc
report: language and style plugins/plugins-core/formats/markdown-format/src/commonTest/kotlin/io/karandash/plugins/formats/MarkdownReportLanguageTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/commands/validate/ReportDisplayKeyBehaviourTest.kt, core/config/src/commonTest/kotlin/io/karandash/config/ConfigBoundsAndLookupTest.kt gap gap
report walkthrough and transparency (summary collapsed, inlineWhy, flowDiagram) plugins/plugins-core/formats/markdown-format/src/commonTest/kotlin/io/karandash/plugins/formats/MarkdownFlowDiagramTest.kt, plugins/plugins-core/formats/markdown-format/src/commonTest/kotlin/io/karandash/plugins/formats/MarkdownGoldenTest.kt gap gap
Severity presentation (emoji, tag, ANSI) core/models/src/commonTest/kotlin/io/karandash/models/finding/SeverityFormatTest.kt, core/models/src/commonTest/kotlin/io/karandash/models/finding/SeverityAndTemplateGapsTest.kt gap gap
Success and failure marks, ReportStyle (quiet, standard, verbose) core/models/src/commonTest/kotlin/io/karandash/models/report/ReportModelsTest.kt, plugins/helpers/src/commonTest/kotlin/io/karandash/helpers/reporter/ReportViewBuilderTest.kt gap gap
ReportView template data plugins/helpers/src/commonTest/kotlin/io/karandash/helpers/reporter/ReportSupportTest.kt, plugins/helpers/src/commonTest/kotlin/io/karandash/helpers/reporter/ReportViewBuilderTest.kt gap gap
Mustache engine (vars, sections, partials, lambdas, size cap) core/models/src/commonTest/kotlin/io/karandash/models/template/MustacheTest.kt gap template
Email templates gap gap email
format render through Mustache cli/src/commonTest/kotlin/io/karandash/cli/commands/format/FormatCommandTest.kt gap format
templateApi versioning and TemplateParityTest gap gap gap
Report language versus ai.responseLanguage precedence core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ConfigMapParserReportLanguageTest.kt gap gap
i18n: English built in, packs by base tag core/models/src/commonTest/kotlin/io/karandash/models/finding/TranslationsTest.kt, core/models/src/commonTest/kotlin/io/karandash/models/finding/LocalizedTextTest.kt gap gap
Polish translation module plugins/plugins-extended/translations/polish/src/commonTest/kotlin/io/karandash/translations/polish/PolishTranslationModuleContractTest.kt, plugins/integration-tests/rules/src/jvmTest/kotlin/io/karandash/integration/rules/TranslationPackCoverageTest.kt gap gap
Russian translation module plugins/plugins-extended/translations/russian/src/commonTest/kotlin/io/karandash/translations/russian/RussianTranslationModuleContractTest.kt, plugins/plugins-extended/translations/russian/src/commonTest/kotlin/io/karandash/translations/russian/FormerBuiltInRussianTest.kt, plugins/integration-tests/rules/src/jvmTest/kotlin/io/karandash/integration/rules/TranslationPackCoverageTest.kt gap Language packs
TranslationModule and base-language fallback core/models/src/commonTest/kotlin/io/karandash/models/finding/TranslationsTest.kt gap gap
AI output language overlays plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/LanguagePromptOverlaysTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/AiPromptAssemblerOutputLanguageTest.kt gap ai-rules

Caches

Feature Behavior test E2E Doc
Local cache and CAS (cache stats/clear/gc/remote-stats) core/cache/src/commonTest/kotlin/io/karandash/cache/CacheManagerTest.kt, core/cache/src/commonTest/kotlin/io/karandash/cache/cas/CasCacheTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/commands/cache/CacheCommandFailureExitTest.kt (cache gc removes an unreferenced blob) cmd-cache-stats, cmd-cache-clear, cmd-cache-gc, cmd-cache-remote-stats cache
Remote cache (HTTP, S3, GCS; cache push) core/cache/src/commonTest/kotlin/io/karandash/cache/remote/RemoteCacheLayerTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/cache/RemoteCacheWiringTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/commands/cache/CachePushRemoteConfigTest.kt (GCS: PUTs under the bucket prefix with the config auth, on a MockEngine), cli/src/jvmTest/kotlin/io/karandash/cli/commands/cache/CachePushAllowLocalhostTest.kt cache-remote-push, cache-remote-body (blobs PUT to their hash paths; the mock rejects a wrong hash), cache-remote-stored (a second push finds both blobs by HEAD and skips them), cache-remote-refused (a backend answering 400 counts every blob as failed, exit 6), cache-remote-ssrf, cache-remote-ssrf-blocked, cache-remote-s3-push, cache-remote-s3-put, cache-remote-s3-hit, cache-remote-s3-head (S3 path-style mock: a second push finds both blobs by HEAD and skips them), cache-remote-s3-unsigned (a signed-* bucket refuses anonymous PUTs, exit 6), cache-remote-s3-signed, cache-remote-s3-signed-hit (backend, URL and SigV4 credentials from cache.remote in --config; the mock verifies each signature); SigV4 known vector in core/crypto/src/commonTest/kotlin/io/karandash/crypto/AwsSigV4SignerTest.kt cache
In-memory and file cache tiers (TieredCache: memory LRU over the on-disk CAS) core/cache/src/commonTest/kotlin/io/karandash/cache/TieredCacheTest.kt ai-cache-miss, ai-cache-hit (the second run is served from the file tier) cache
cache.downloads plugins/loader/src/commonTest/kotlin/io/karandash/loader/DownloadCacheTest.kt gap configuration-schema
cache.memory core/cache/src/commonTest/kotlin/io/karandash/utils/BoundedCacheTest.kt, core/cache/src/commonTest/kotlin/io/karandash/cache/CacheConfigTest.kt gap configuration-schema
cache.state core/state/src/commonTest/kotlin/io/karandash/cache/cas/CasStateStoreTest.kt gap configuration-schema
cache.responses (provider response cache) core/http/src/commonTest/kotlin/io/karandash/http/ProviderResponseCacheTest.kt, core/http/src/commonTest/kotlin/io/karandash/http/ResponseCacheDiskTierTest.kt gap configuration-schema
Remote cache auth and S3 ambient credentials core/cache/src/commonTest/kotlin/io/karandash/cache/remote/S3AmbientCredentialsTest.kt cache-remote-s3-signed cache
gcs backend (the http backend with cache.remote.auth; no ambient Google credentials, GOOGLE_APPLICATION_CREDENTIALS is denylisted) cli/src/commonTest/kotlin/io/karandash/cli/commands/cache/CachePushRemoteConfigTest.kt gap cache
Cache garbage collector and index store core/cache/src/commonTest/kotlin/io/karandash/cache/cas/CacheGarbageCollectorTest.kt, core/cache/src/commonTest/kotlin/io/karandash/cache/cas/CacheIndexStoreTest.kt cmd-cache-gc cache
Conditional fetch cache core/cache/src/commonTest/kotlin/io/karandash/cache/cas/ConditionalFetchCacheTest.kt gap gap

Plugins

Feature Behavior test E2E Doc
plugin create / generate scaffolds (every --type) cli/src/commonTest/kotlin/io/karandash/cli/plugin/PluginTemplateGeneratorTest.kt plugin-create-test.sh Creating plugins
Install, list, remove, re-install cli/src/jvmTest/kotlin/io/karandash/cli/commands/PluginLifecycleCommandsTest.kt plugin-lifecycle-test.sh, cmd-plugin-list plugin
plugin info (--source, --dependencies), uninstall, rebuild, registry show/set cli/src/jvmTest/kotlin/io/karandash/cli/commands/PluginLifecycleCommandsTest.kt registry-show, registry-info, registry-info-deps, registry-rebuild, registry-uninstall, registry-info-missing, registry-set, registry-set-manifest plugin
JVM plugins (JAR) plugins/loader/src/jvmTest/kotlin/io/karandash/loader/jar/JarPluginLoaderLifecycleTest.kt, plugins/loader/src/nativeTest/kotlin/io/karandash/loader/jar/JarPluginLoaderNativeLifecycleTest.kt plugin-run-jar (the JVM loader on the JVM binary, the JAR bridge on the native one), plugin-examples-test.sh, plugin-lifecycle-test.sh Creating plugins
JS plugins (QuickJS) plugins/loader/src/commonTest/kotlin/io/karandash/loader/js/JsPluginLoaderLifecycleTest.kt plugin-run-js, multi-language-plugin-test.sh JS plugins
WASM plugins (C, Rust) plugins/loader/src/commonTest/kotlin/io/karandash/loader/wasm/WasmModuleBridgeTest.kt plugin-run-wasm (the C example), multi-language-plugin-test.sh WASM plugins
Native plugins (C, C++, Go, Rust, Python, Kotlin/Native) plugins/loader/src/nativeTest/kotlin/io/karandash/loader/native/NativePluginLoaderLifecycleTest.kt, plugins/loader/src/commonTest/kotlin/io/karandash/loader/native/NativePluginLoaderDirectoryTest.kt plugin-run-native (the C example), native-plugin-test.sh, plugin-examples-test.sh Native plugins
Registry install, update, --pin cli/src/commonTest/kotlin/io/karandash/cli/plugin/RegistryClientTest.kt, plugins/registry/src/commonTest/kotlin/io/karandash/registry/PluginInstallChecksumTest.kt registry-no-token, registry-install, registry-index-fetch, registry-download, registry-pin-manifest, registry-list, registry-bad-checksum, registry-update-check, registry-update, registry-update-download, registry-updated-artifact (HTTPS registry on the mock through tls_proxy.py) plugin
Registry search, offline fallback to the stale cache cli/src/commonTest/kotlin/io/karandash/cli/plugin/PluginSearchCommandTest.kt registry-search-offline (an unreachable registry URL whose cache entry is the v1 index fetched earlier) plugin
Plugin signing and verification cli/src/jvmTest/kotlin/io/karandash/cli/commands/SignCommandRoundTripTest.kt, plugins/loader/src/commonTest/kotlin/io/karandash/loader/SignatureVerifierTest.kt cmd-plugin-sign, cmd-plugin-sign-file, cmd-plugin-verify (needs openssl: in the toolchain image, so it runs on CI) sign
plugin load (check a file without installing), plugin cache clear cli/src/jvmTest/kotlin/io/karandash/cli/commands/PluginLifecycleCommandsTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/commands/PluginCommandTest.kt cmd-plugin-load-invalid, cmd-plugin-cache-clear plugin
Plugin discovery (--plugin-dir, KARANDASH_PLUGIN_DIR) plugins/loader/src/commonTest/kotlin/io/karandash/loader/PluginDiscoveryTest.kt gap plugin
--allow-unsigned, --probe, --no-git cli/src/jvmTest/kotlin/io/karandash/cli/commands/PluginLifecycleCommandsTest.kt gap plugin
--package, --registry, --pin cli/src/commonTest/kotlin/io/karandash/cli/plugin/RegistryClientTest.kt, plugins/registry/src/commonTest/kotlin/io/karandash/registry/RegistryClientTest.kt, plugins/registry/src/commonTest/kotlin/io/karandash/registry/PluginInstallChecksumTest.kt registry-pin-manifest plugin
Plugin API compatibility check plugins/loader/src/commonTest/kotlin/io/karandash/loader/ApiCompatibilityTest.kt gap gap
Plugin cache plugins/loader/src/commonTest/kotlin/io/karandash/loader/PluginCacheTest.kt cmd-plugin-cache-clear gap
Plugin inspector (list without loading) plugins/inspector/src/jvmTest/kotlin/io/karandash/inspector/JvmPluginInspectorNoExecTest.kt, plugins/inspector/src/nativeTest/kotlin/io/karandash/inspector/NativePluginInspectorStaticTest.kt, plugins/inspector/src/commonTest/kotlin/io/karandash/inspector/InstalledPluginListerImplTest.kt gap plugin
Artifact download per OS and architecture core/download/src/commonTest/kotlin/io/karandash/download/ArtifactDownloaderTest.kt, plugins/loader/src/commonTest/kotlin/io/karandash/loader/PlatformArtifactResolverTest.kt, core/download/src/commonTest/kotlin/io/karandash/download/PlatformArtifactResolverTest.kt gap gap
Plugin bootstrap: module selection, defaults and lifecycle plugins/bootstrap/src/commonTest/kotlin/io/karandash/bootstrap/ModuleSelectionTest.kt, plugins/bootstrap/src/commonTest/kotlin/io/karandash/bootstrap/ModuleDefaultsAndInitTest.kt, plugins/bootstrap/src/commonTest/kotlin/io/karandash/bootstrap/BuiltInPluginLoaderLifecycleTest.kt gap
Bootstrap plugin context env allowlist plugins/bootstrap/src/commonTest/kotlin/io/karandash/bootstrap/BootstrapPluginContextEnvAllowlistTest.kt gap gap
Module lifecycle manager core/api/src/commonTest/kotlin/io/karandash/api/lifecycle/ModuleLifecycleManagerTest.kt gap
SDK abstract module bases plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/SdkModuleBasesTest.kt, plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/AbstractTypedSingleRuleModuleTest.kt gap api-reference
SDK typed modules (rule, reporter, platform, provider, mutator) plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/TypedRuleModuleTest.kt, plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/TypedReporterModuleTest.kt, plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/TypedPlatformServiceModuleTest.kt, plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/TypedProviderModuleTest.kt gap api-reference
SDK ConfigHover, MetaKey, RuleCacheHelper plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/typed/ConfigHoverTest.kt, plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/finding/MetaKeyTest.kt, plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/cache/RuleCacheHelperTest.kt gap api-reference
SDK EnrichmentConfigParser and BridgeHostSettings plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/enrichment/EnrichmentConfigParserTest.kt, plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/context/BridgeHostSettingsTest.kt gap api-reference
SDK ReinitializableClient plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/platform/ReinitializableClientTest.kt gap api-reference
SDK serialization audit plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/SdkSerializationAuditTest.kt gap gap
plugins:builtin generated registry (builtin-modules.txt) plugins/builtin/src/commonTest/kotlin/io/karandash/builtin/BuiltInModuleRegistryTest.kt gap gap
Plugin publishing and templates (plugin create) cli/src/commonTest/kotlin/io/karandash/cli/plugin/PluginTemplateGeneratorTest.kt, plugins/registry/src/commonTest/kotlin/io/karandash/registry/PluginTemplateGeneratorTest.kt plugin-create-test.sh publishing-plugins

Plugin bridges

Feature Behavior test E2E Doc
Native to JAR subprocess bridge plugins/loader/src/nativeTest/kotlin/io/karandash/loader/jar/JarPluginLoaderNativeLifecycleTest.kt, plugins/loader/src/jvmTest/kotlin/io/karandash/loader/jar/JarBridgeServerTest.kt, plugins/loader/src/jvmTest/kotlin/io/karandash/loader/jar/JarBridgeSessionTest.kt gap adding-bridge-types
Bridge ABI parity plugins/loader/src/jvmTest/kotlin/io/karandash/loader/bridge/BridgeAbiParityTest.kt gap adding-bridge-types
Bridge typed modules and host proxies plugins/loader/src/commonTest/kotlin/io/karandash/loader/bridge/BridgeTypedPartTest.kt, plugins/loader/src/commonTest/kotlin/io/karandash/loader/bridge/BridgeHostProxiesTest.kt gap adding-bridge-types
Guest content policy plugins/loader/src/jvmTest/kotlin/io/karandash/loader/bridge/GuestContentPolicyTest.kt gap gap
Host service dispatcher plugins/loader/src/commonTest/kotlin/io/karandash/loader/bridge/host/HostServiceDispatcherTest.kt gap gap
C ABI host (CAbi*) plugins/helpers/src/nativeTest/kotlin/io/karandash/helpers/CAbiBridgeDispatcherTest.kt, plugins/helpers/src/nativeTest/kotlin/io/karandash/helpers/CAbiHostTest.kt gap wasm-exports
Guest call timeouts and deadlines plugins/loader/src/jvmTest/kotlin/io/karandash/loader/wasm/WasmPluginLoaderLifecycleJvmTest.kt plugin-run-js-timeout (a JS guest in an endless loop is interrupted after 2s on both binaries) gap
WASM watchdog and timed engine plugins/loader/src/commonTest/kotlin/io/karandash/loader/wasm/WasmTimeoutWatchdogTest.kt, core/wasm/src/commonTest/kotlin/io/karandash/wasm/TimedWasmEngineTest.kt gap gap
WASM host imports and memory protocol core/wasm/src/commonTest/kotlin/io/karandash/wasm/WasmHostImportsTest.kt, core/wasm/src/commonTest/kotlin/io/karandash/wasm/WasmMemoryProtocolTest.kt, plugins/loader/src/commonTest/kotlin/io/karandash/loader/wasm/WasmMemoryProtocolTest.kt gap wasm-exports
JS host calls and env secrets plugins/loader/src/commonTest/kotlin/io/karandash/loader/js/JsHostCallTest.kt, plugins/loader/src/commonTest/kotlin/io/karandash/loader/js/JsEnvSecretsTest.kt gap js-plugin-guide

AI

Every AI feature below calls a model. The e2e runs them offline against the fake LLM endpoints of the mock server (mock-server/mock_llm.py, under /llm/<provider>/v1): OpenAI-compatible chat completions (OpenAI, Gemini, Ollama, LiteLLM, Bifrost) and Anthropic messages. The scenarios are in e2e.d/ai.sh, e2e.d/ai-prompts.sh and e2e.d/ai-wire.sh; they check the finding the binary reports and, through the mock's request-body log, what reached the model. Every config key in the AI features reference is read by the code.

Feature Behavior test E2E Doc
ai command group (env-gated) cli/src/commonTest/kotlin/io/karandash/cli/compat/DocsCommandLinesTest.kt ai-gated, ai-fix-usage, ai-cmd-fix, ai-cmd-fix-call (Ollama via OLLAMA_HOST) ai
Providers: OpenAI, Anthropic, Gemini, Ollama, LiteLLM, Bifrost plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/OpenAiProviderTest.kt and the sibling *ProviderTest.kt files ai-openai-findings, ai-anthropic-findings, ai-gemini-findings, ai-ollama-findings, ai-litellm-findings, ai-bifrost-findings, each with its ai-<provider>-call request check AI rules
Provider fallback chain plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/FallbackAiProviderTest.kt ai-fallback, ai-fallback-primary-call, ai-fallback-secondary-call (the first model answers 500), ai-wire-model-fallback (the first model answers 404 model_not_found) AI rules
Consensus plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/AiRuleDispatcherConsensusTest.kt ai-consensus, ai-consensus-second AI features
Custom prompts, prompt files and per-scope overrides plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiPluginConfigTest.kt, plugins/integration-tests/contracts/src/commonTest/kotlin/io/karandash/contracts/ai/AiPromptAssemblyContractTest.kt ai-prompt-overlays, ai-prompt-system-file, ai-prompt-extra, ai-prompt-scope, ai-prompt-scope-unmatched AI rules
AI response cache plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/CachingAiProviderTest.kt ai-cache-miss, ai-cache-miss-call, ai-cache-hit (the second run makes no model call) AI features
Provider OpenAI plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/OpenAiProviderTest.kt ai-openai-findings AI_FEATURES_REFERENCE
Provider Anthropic plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/AnthropicProviderTest.kt ai-anthropic-findings AI_FEATURES_REFERENCE
Provider Gemini plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/GeminiProviderTest.kt gap AI_FEATURES_REFERENCE
Provider Ollama (OLLAMA_HOST, host policy) plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/OllamaProviderTest.kt, plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/OllamaHostPolicyTest.kt ai-cmd-fix-call AI_FEATURES_REFERENCE
Provider LiteLLM (LITELLM_*) plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/LiteLLMProviderTest.kt gap AI_FEATURES_REFERENCE
Provider Bifrost (BIFROST_*) plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/BifrostProviderTest.kt gap AI_FEATURES_REFERENCE
Stub provider (provider: stub) plugins/plugins-extended/ai/stub-provider/src/commonTest/kotlin/io/karandash/plugins/ai/stub/StubAiProviderTest.kt, plugins/integration-tests/providers/src/commonTest/kotlin/io/karandash/providers/ProviderContractTest.kt gap gap
Custom provider registration and resolver plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/AiProviderResolverTest.kt, plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/AiProviderResolverRegistryTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/CustomProviderIntegrationTest.kt gap gap
Provider API key env vars and auth header plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/ProviderAuthHeaderTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiRuleModuleEnvVarsTest.kt gap environment-variables
Provider defaults and default models plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/ProviderDefaultsTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiDefaultModelsTest.kt gap gap
Provider error mapping plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/ProviderErrorMappingTest.kt ai-wire-retry-after (429 with Retry-After, then an answer) gap
Provider lifecycle and reinitialization plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/ProviderLifecycleTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiRuleModuleProviderReinitTest.kt gap gap
Structured output and OpenAI strict schema plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/StructuredOutputProviderTest.kt, plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/OpenAiStrictSchemaTest.kt gap gap
Streaming provider plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/StreamingProviderTest.kt gap gap
ai.streamStall plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/StallLimitTest.kt, plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/RunAiProviderSourceTest.kt ai-wire-stream-stall gap
ai.streamDeadline plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/StreamLimitsConfigTest.kt, plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/RunAiProviderSourceTest.kt gap gap
Slow response body timeout plugins/plugins-ai/providers/src/jvmTest/kotlin/io/karandash/plugins/ai/providers/SlowBodyTimeoutTest.kt, plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/AiTimeoutConfigTest.kt gap gap
ai.promptCacheTtl plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/RunAiProviderSourceTest.kt gap AI features
ai.consensusStrategy plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/ConsensusStrategyTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/AiRuleDispatcherConsensusTest.kt gap AI_FEATURES_REFERENCE
AI decision log plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/AiDecisionLogTest.kt gap gap
Usage metering and cost estimate plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiCostEstimatorTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiCostSummaryTest.kt gap gap
pricing: overrides plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiCostEstimatorTest.kt gap gap
Remote prompt fetch plugins/plugins-ai/prompts/src/commonTest/kotlin/io/karandash/plugins/ai/prompts/RemotePromptFetcherTest.kt gap gap
Prompt template engine and resolver plugins/plugins-ai/prompts/src/commonTest/kotlin/io/karandash/plugins/ai/prompts/PromptTemplateEngineTest.kt, plugins/plugins-ai/prompts/src/commonTest/kotlin/io/karandash/plugins/ai/prompts/PromptResolverTest.kt, plugins/plugins-ai/prompts/src/commonTest/kotlin/io/karandash/plugins/ai/prompts/PromptResolverSourcesTest.kt gap gap
Analyzer prompts plugins/plugins-ai/prompts/src/commonTest/kotlin/io/karandash/plugins/ai/prompts/AnalyzerPromptsTest.kt gap gap
ruleProviders per-rule provider routing plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiProviderKeyBehaviourTest.kt gap gap
reasoningEffort plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/RunAiProviderSourceTest.kt ai-wire-reasoning-custom, ai-wire-reasoning-gemini, ai-wire-reasoning-litellm, ai-wire-reasoning-bifrost (reasoning.effort in the request body) gap
Temperatures and sampling plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiTemperatureConfigTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiRuleTemperatureTest.kt gap gap
ai.reviewSampling plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/SampleAgreementTest.kt gap gap

AI stages and analyzers

Feature Behavior test E2E Doc
Custom AI rules (customRules:) plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/AiRuleDispatcherCustomRuleTest.kt ai-custom-rule, ai-custom-rule-prompt AI features
Review modes and size policy (diff mode, partial review) plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/DiffModeTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/rules/AiSizePolicyTest.kt ai-size-policy, ai-partial-review, ai-partial-review-kept, ai-partial-review-dropped, ai-size-exclude, ai-added-only AI rules
Secret redaction before the model call plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/SecretRedactorTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiRuleModuleRedactedMrTest.kt ai-redaction, ai-redaction-secret (the secret never reaches the mock), ai-redaction-marker AI features
End-to-end AI review pipeline plugins/integration-tests/contracts/src/commonTest/kotlin/io/karandash/contracts/ai/AiReviewEndToEndContractTest.kt ai-openai-findings and every other ai-*-findings scenario (fetch, redact, prompt, parse, report) AI features
Analyzer change-categorization plugins/plugins-ai/analyzers/change-categorization/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/changecategorization/ChangeCategorizationAnalyzerModuleTest.kt gap ai-rules
Analyzer code-quality plugins/plugins-ai/analyzers/code-quality/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/codequality/CodeQualityAnalyzerModuleTest.kt gap ai-rules
Analyzer code-suggestions plugins/plugins-ai/analyzers/code-suggestions/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/codesuggestions/CodeSuggestionsAnalyzerModuleTest.kt ai-analyzers-review (ai-analyzers-suggestion) ai-rules
Analyzer review-thread-analysis plugins/plugins-ai/analyzers/comment-analysis/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/commentanalysis/CommentAnalysisAnalyzerModuleTest.kt, plugins/plugins-ai/analyzers/comment-analysis/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/commentanalysis/ThreadSessions.kt gap ai-rules
Analyzer description-quality plugins/plugins-ai/analyzers/description-quality/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/descriptionquality/DescriptionQualityAnalyzerModuleTest.kt gap ai-rules
Analyzer design-doc-drift plugins/plugins-ai/analyzers/design-doc-drift/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/designdocdrift/DesignDocDriftAnalyzerModuleTest.kt, plugins/plugins-ai/analyzers/design-doc-drift/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/designdocdrift/DesignDocDriftGateTest.kt gap ai-rules
Analyzer fix-suggestions plugins/plugins-ai/analyzers/fix-suggestions/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/fixsuggestions/FixSuggestionsAnalyzerModuleTest.kt gap ai-rules
Analyzer generate-description plugins/plugins-ai/analyzers/generate-description/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/generatedescription/GenerateDescriptionAnalyzerModuleTest.kt gap ai-rules
Analyzer mr-summary plugins/plugins-ai/analyzers/mr-summary/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/mrsummary/MrSummaryAnalyzerModuleTest.kt, plugins/plugins-ai/analyzers/mr-summary/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/mrsummary/MrSummaryWalkthroughTest.kt gap ai-rules
Analyzer outdated-docs plugins/plugins-ai/analyzers/outdated-docs/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/outdateddocs/OutdatedDocsAnalyzerModuleTest.kt gap ai-rules
Analyzer ownership-analysis plugins/plugins-ai/analyzers/ownership-analysis/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/ownership/OwnershipAnalyzerModuleTest.kt gap ai-rules
Analyzer pr-split plugins/plugins-ai/analyzers/pr-split/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/prsplit/PrSplitAnalyzerModuleTest.kt gap ai-rules
Analyzer review-comments (cap, protected categories, categories) plugins/plugins-ai/analyzers/review-comments/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/reviewcomments/ReviewCommentsAnalyzerModuleTest.kt, plugins/plugins-ai/analyzers/review-comments/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/reviewcomments/ReviewCategoryTest.kt ai-openai-findings ai-rules
Analyzer risk-scoring plugins/plugins-ai/analyzers/risk-scoring/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/riskscoring/RiskScoringAnalyzerModuleTest.kt ai-analyzers-review (ai-analyzers-risk) ai-rules
Analyzer similar-issues plugins/plugins-ai/analyzers/similar-issues/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/similarissues/SimilarIssuesAnalyzerModuleTest.kt gap ai-rules
JSON recovery of malformed model output plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/JsonRecoveryWiringTest.kt gap AI features
Line validation and anchors plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AnchorResolverTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/FindingLocationValidatorTest.kt, cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/stats/audit/AnchorCheckTest.kt gap AI features, evidence anchoring
Suggestion ranges plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/SuggestionRangeTest.kt gap gap
Confidence filter and ai.ranking plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/pipeline/FindingCapTest.kt gap AI features
Finding dedup (within rule and cross-rule) plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/AiRuleDispatcherDedupTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/pipeline/AiSuggestionDedupeTest.kt gap AI features
Grounding (local) and verifier plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/pipeline/LocalGroundingTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/pipeline/AiGroundingVerifierTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/AiRuleDispatcherHeadGroundingTest.kt gap AI features
Retries and error handlers (ai.maxRetries) plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/AiDecisionLogTest.kt, plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/AnthropicProviderTest.kt, plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/FallbackAiProviderTest.kt gap configuration-schema, AI features
Diff chunking and parallel chunks plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/DiffChunkerTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/DiffChunkerOverlapTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiChunkContextTest.kt gap AI features
Hunk-aware truncation and expansion plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/HunkAwareTruncatorTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/HunkExpanderTest.kt gap gap
Diff preprocessing and exclusions plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/DiffPreprocessorTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/AiMrPreprocessorExclusionTest.kt gap gap
Token budget, reservation and tier planner plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/TokenBudgetTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/BudgetReservationTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/PromptTierPlannerTest.kt gap AI_FEATURES_REFERENCE
Per-rule and per-chunk budgets and sample budget plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/TokenBudgetPerRuleTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/ChunkBudgetPlanTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/SampleBudgetTest.kt gap gap
Auxiliary budget and budget-skip disclosure plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiAuxiliaryBudgetTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiBudgetSkipDisclosureTest.kt gap gap
Context budget plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/ContextBudgetTest.kt gap gap
Trivial diff skip plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiTrivialDiffSkipTest.kt gap gap
Sensitive file filter plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/SensitiveFileFilterTest.kt gap gap
Rule gate and rule sandbox plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/RuleGateTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/RuleSandboxTest.kt gap AI features, rule sandbox
Review strictness plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/ReviewStrictnessTest.kt gap gap
Pre-merge check mode plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/PreMergeCheckModeTest.kt gap AI features
Context: cross-file and dependency plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/CrossFileContextBuilderTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/DependencyContextBuilderTest.kt gap knowledge-context
Context: diff context and file priority plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/DiffContextBuilderTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/FilePriorityScorerTest.kt gap knowledge-context
Context quality diagnostics (projects/ai-context-quality) plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiContextQualityIntegrationTest.kt gap knowledge-context
Context routing config plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiContextRoutingConfigTest.kt gap knowledge-context
Language detection and prompt overlays plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/LanguageDetectorTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/LanguagePromptOverlaysTest.kt gap gap
Prior findings prompt enrichment plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/PriorFindingsPromptEnricherTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiFixSuggestionsPriorFindingsTest.kt gap gap
Thread asker and replies (ai reply) plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/ThreadAskerTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/ReplyClassifierTest.kt gap ai
ai.feedbackSkipRepeatFindingTypes plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiFeedbackConfigTest.kt gap gap
ai.feedbackReplyJudge plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/LlmReplyJudgeTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiThreadFeedbackTest.kt gap gap
Feedback store and thread feedback plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/FeedbackStoreTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/ThreadFeedbackTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiThreadFeedbackTest.kt gap AI features
Correlation, contradictions and learnings cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/calibrate/ReviewLearningsTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/ConsensusAnalyzerTest.kt gap AI features, contradiction detection, review learnings
Process risk, triage risk and author history plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/ProcessRiskCalculatorTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/TriageRiskTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AuthorHistoryTest.kt gap AI features
Model routing by risk plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/router/ModelRouterTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiResearchRoutingKeyBehaviourTest.kt gap AI features
Temporal rule tracker and escalation plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/TemporalRuleTrackerTest.kt gap AI features
Defect predictor plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiPipelineExtensionDefectPredictorTest.kt gap gap
ai.pgoEnabled plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/performance/PgoProfileTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/pipeline/AiPipelineKeyBehaviourTest.kt gap gap
ai.testGap plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/LargeMrSummaryTest.kt gap gap
Research metrics (entropy, cognitive load, clone, naturalness, PageRank) plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/metrics/ChangeEntropyCalculatorTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiPipelineIntegrationTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/metrics/CognitiveLoadEstimatorTest.kt gap AI features
Semantic diff checker plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/architecture/SemanticDiffCheckerTest.kt gap gap
ADR validator plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/architecture/AdrValidatorTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/architecture/AdrKeyBehaviourTest.kt gap gap
Provenance chain and log plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/architecture/ProvenanceChainTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiRuleProvenanceTest.kt gap gap
Cross-MR dependency analyzer plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/architecture/CrossMrDependencyAnalyzerTest.kt gap gap
Policy verifier (verify-policy) plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/architecture/PolicyVerifierTest.kt gap verify-policy
Rule mutation tester plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/architecture/RuleMutationTesterTest.kt cmd-mutate mutate
Review funnel plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/ReviewFunnelTest.kt gap gap

AI config features, reports and eval

Feature Behavior test E2E Doc
AI reports and metrics from run history (ai.statistics, ai.metrics, ai.reports) core/validation/src/commonTest/kotlin/io/karandash/engine/ReportEngineTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/metrics/modules/HistoryMetricModulesTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/pipeline/AiReportGeneratorHistoryTest.kt ai-history-first-run (empty stats store: the metric is skipped), ai-history-metric (the second run reports metric:hours-saved) AI features
ai.macroReferences plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/RuleMacroExpanderTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/pipeline/AiConfigFeatureApplicatorTest.kt gap AI features
ai.enforcementSchedule plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/ProgressiveEnforcementTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/pipeline/AiConfigFeatureApplicatorTest.kt ai-transform-enforcement (a warn phase turns the error into a passing warning) AI features
ai.severityOverrides (reclassify) plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/SeverityReclassifierTest.kt ai-transform-reclassify AI features
Violation budgets and grace periods plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/ViolationBudgetEvaluatorTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/GracePeriodEvaluatorTest.kt gap AI features, grace periods
Canary promotion plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/CanaryPromotionEvaluatorTest.kt gap AI features
Execution profiles and tracks plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiExecutionProfileTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/EnvironmentTrackResolverTest.kt gap AI features, environment tracks
Seniority tiers plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/AuthorSeniorityResolverTest.kt gap AI features
Conditional prompt sections plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/ConditionalSectionCheckerTest.kt gap AI features
AI cost budget (ai.costBudget) plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/AiCostBudgetResolverTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/AiCostBudgetWarnTest.kt ai-transform-cost-budget AI features
AI budget limits and large-MR validation plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/AiBudgetLimitsTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiLargeMrConfigValidationTest.kt gap gap
Debug config plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/AiDebugConfigTest.kt gap gap
Calibration (EVT) keys plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiCalibrationKeyBehaviourTest.kt, cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/calibrate/AnalyzerCalibrationTest.kt gap calibrate
AI state persistence and MR snapshot store plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiStatePersistenceTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/CoreStateSnapshotStoreTest.kt gap gap
AI incremental cache plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiPipelineExtensionIncrementalTest.kt gap AI features
AI statistics history cap plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiStatisticsMaxHistoryTest.kt gap gap
AI platform dismissals plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiPlatformDismissalsTest.kt gap gap
Per-finding hook metadata plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiPerFindingHookMetadataTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiHookOncePerRunTest.kt gap gap
AI pipeline extension enablement plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiPipelineExtensionEnablementTest.kt gap gap
AI key behaviour (provider, prompt, rule module) plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiProviderKeyBehaviourTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiPromptKeysTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiRuleModuleKeyBehaviourTest.kt gap gap
AI dead and deprecated keys plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiDeadKeysTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiDeprecatedKeysEffectTest.kt gap CHANGELOG.md
AI config parsing (camelCase, scope, warnings) plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiConfigCamelCaseKeysTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiPluginConfigScopeParsingTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiConfigKeyWarningsTest.kt gap gap
AI report generator (digest, history, sections) plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/pipeline/AiReportGeneratorDigestTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/pipeline/AiReportGeneratorHistoryTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/pipeline/AiReportGeneratorSectionsTest.kt gap gap
AI report: developer growth plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/reporters/modules/DeveloperGrowthReportModuleTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/reporters/DeveloperGrowthReportGeneratorTest.kt gap gap
AI report: cross-platform consistency plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/reporters/modules/CrossPlatformConsistencyReportModuleTest.kt gap gap
AI report: digest and compliance plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/reporters/modules/DigestAndComplianceReportModuleTest.kt gap gap
AI report: prediction plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/reporters/AiPredictionReporterTest.kt gap gap
Check-run annotations report plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/pipeline/CheckRunAnnotationReportTest.kt gap gap
DORA metrics plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/reporters/DoraMetricsCalculatorTest.kt gap gap
History metric modules plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/metrics/modules/HistoryMetricModulesTest.kt gap gap
Report percent rounding plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/reporters/ReportPercentRoundingTest.kt gap gap
AI eval harness (replay, scorer) plugins/integration-tests/ai-eval/src/commonTest/kotlin/io/karandash/eval/EvalReplayTest.kt, plugins/integration-tests/ai-eval/src/commonTest/kotlin/io/karandash/eval/EvalScorerTest.kt gap ai-eval
KARANDASH_EVAL_* live eval env test-fixtures/src/nativeTest/kotlin/io/karandash/testfixtures/NativeTestEnvTest.kt gap ai-eval
ai stats fire rate and history flags cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/FireRateRoundingTest.kt, cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/HistoryFlagsTest.kt gap stats

DSL and LSP

Feature Behavior test E2E Doc
LSP server (lsp, JVM only) dsl/lsp-server/src/test/kotlin/io/karandash/lsp/KarandashLanguageServerTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/commands/LspCommandTest.kt lsp-initialize (JSON-RPC over stdio on the jar; the native binary exits 6) CLI reference
KTS parser (Kotlin DSL config) dsl/kts-parser/src/commonTest/kotlin/io/karandash/parser/KtsJsonInterpreterTest.kt, dsl/kts-parser/src/commonTest/kotlin/io/karandash/parser/ParserBasicTest.kt, dsl/kts-parser/src/commonTest/kotlin/io/karandash/parser/KtsParserEdgeCaseTest.kt gap YAML_CONFIG
LSP completion dsl/lsp-server/src/test/kotlin/io/karandash/lsp/CompletionProviderTest.kt lsp-completion, lsp-completion-title-format CLI reference
LSP hover dsl/lsp-server/src/test/kotlin/io/karandash/lsp/HoverProviderTest.kt, dsl/lsp-server/src/test/kotlin/io/karandash/lsp/HoverMergeTest.kt lsp-hover CLI reference
LSP diagnostics dsl/lsp-server/src/test/kotlin/io/karandash/lsp/DiagnosticProviderTest.kt, dsl/lsp-server/src/test/kotlin/io/karandash/lsp/ConfigPipelineDiagnosticsTest.kt gap gap
LSP native build absent (OPEN) gap no native LSP gap

Dogfooding

Feature Behavior test E2E Doc
projects/base projects/base/src/commonTest/kotlin/io/karandash/validators/BaseConfigIntegrationTest.kt, projects/base/src/commonTest/kotlin/io/karandash/validators/BaseRemoteExtendsTest.kt gap gap
projects/base-kmp projects/base-kmp/src/commonTest/kotlin/io/karandash/validators/BaseKmpConfigIntegrationTest.kt, projects/base-kmp/src/commonTest/kotlin/io/karandash/validators/BaseKmpRemoteExtendsTest.kt gap gap
projects/wallet (extends base-kmp) projects/wallet/src/commonTest/kotlin/io/karandash/validators/WalletConfigIntegrationTest.kt, projects/wallet/src/commonTest/kotlin/io/karandash/validators/WalletRemoteExtendsTest.kt gap gap
projects/navigator projects/navigator/src/commonTest/kotlin/io/karandash/validators/NavigatorConfigIntegrationTest.kt, projects/navigator/src/commonTest/kotlin/io/karandash/validators/NavigatorRemoteExtendsTest.kt gap gap
projects/telecom projects/telecom/src/commonTest/kotlin/io/karandash/validators/TelecomRequirementsIntegrationTest.kt gap gap
projects/coinbox, projects/gridmon, projects/ledger projects/base/src/commonTest/kotlin/io/karandash/validators/ProjectSpec.kt, projects/ledger/src/commonTest/kotlin/io/karandash/validators/ProjectSpec.kt gap gap
projects/shared-tests projects/shared-tests/src/realChainTest/kotlin/io/karandash/validators/ProjectRealConfigChainTest.kt, projects/shared-tests/src/commonTest/kotlin/io/karandash/validators/ProjectConfigIntegrationTest.kt gap gap

Dev tooling

Feature Behavior test E2E Doc
tools:detekt-rules (karandash rule set) tools/detekt-rules/src/test/kotlin/io/karandash/detekt/CallRulesTest.kt, tools/detekt-rules/src/test/kotlin/io/karandash/detekt/CatchRulesTest.kt, tools/detekt-rules/src/test/kotlin/io/karandash/detekt/DynamicRegexTest.kt, tools/detekt-rules/src/test/kotlin/io/karandash/detekt/OtherRulesTest.kt internal lint rules gap
test-fixtures (golden files, temp dirs) test-fixtures/src/commonTest/kotlin/io/karandash/testfixtures/GoldenFilesTest.kt, cli/src/jvmTest/kotlin/io/karandash/cli/consumers/ConsumerChainsTest.kt gap gap
Compat sync tests (docs, CLI help, error messages) cli/src/commonTest/kotlin/io/karandash/cli/compat/DocsCommandLinesTest.kt, cli/src/jvmTest/kotlin/io/karandash/cli/compat/CompatErrorMessagesTest.kt, cli/src/jvmTest/kotlin/io/karandash/cli/compat/CliHelpTreeTest.kt gap gap
Config-key behaviour inventory (cli/src/jvmTest/config-keys/*.tsv) cli/src/jvmTest/kotlin/io/karandash/cli/keys/ConfigKeyBehaviourInventoryTest.kt gap gap
plugins:integration-tests contract tests plugins/integration-tests/contracts/src/commonTest/kotlin/io/karandash/contracts/ai/AiReviewEndToEndContractTest.kt gap gap
Example plugin (tools/examples/standalone-jvm-plugin) tools/examples/standalone-jvm-plugin/src/test/kotlin/com/example/karandash/PluginLoadSmokeTest.kt gap creating-plugins