Feature matrix
Every feature Karandash has (documented, undocumented but real, and logic-only), with the three checks that must all exist for it to count as done:
- Behavior test: a unit or contract test that fails if the feature breaks.
- E2E: a scenario run on the real binaries (the JVM
karandash.jarand the host nativecli.kexe). An id likecfg-yamlis a scenario intools/integration-tests/feature-e2e.shor one of itse2e.d/*.shfragments, which run against the mock platform server (tools/integration-tests/mock-server/mock-gitlab-api.py: GitLab routes, plus onemock_*.pymodule per other API, such as GitHub, Gerrit, Azure DevOps and the fake LLM endpoints). A scenario that needs a host tool (node,openssl,python3) skips locally when the tool is missing and fails on CI (CI=true); the CItest-integrationsjob runs in the toolchain image (docker/Dockerfile.toolchain), which ships all three. A script name is another script undertools/integration-tests/. Every one of them runs fromtools/integration-tests/run-tests.sh(gate part 1 and the CItest-integrationsjob). When a row has no scenario, the cell says why. - Doc: the page that documents the feature for users. A row with no page is marked gap.
Run one scenario with E2E_ONLY='^cfg-yaml$' bash tools/integration-tests/feature-e2e.sh.
Config loading
| Feature | Behavior test | E2E | Doc |
|---|---|---|---|
| YAML config | plugins/plugins-core/parsers/yaml/src/commonTest/kotlin/io/karandash/plugins/parsers/yaml/YamlFormatModuleTest.kt |
cfg-yaml |
YAML config |
| JSON config | core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ConfigFormatParityTest.kt |
cfg-json |
YAML config |
Kotlin DSL config (config.kts) |
dsl/kts-parser/src/commonTest/kotlin/io/karandash/parser/KtsJsonInterpreterTest.kt |
cfg-kts |
YAML config |
Config discovery (.karandash/config.*, first match wins) |
cli/src/commonTest/kotlin/io/karandash/cli/config/ConfigDiscoveryTest.kt |
live-doctor (discovers .karandash/config.yaml) |
YAML config |
extends: local files |
cli/src/commonTest/kotlin/io/karandash/cli/commands/ValidateExtendsCommandTest.kt |
cfg-extends-local |
Config inheritance |
extends: remote URL (with allow_localhost) |
core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/RemoteConfigFetcherClientTest.kt |
cfg-extends-remote, cfg-extends-remote-fetch |
Config inheritance |
extends: override and merge semantics |
core/merge/src/commonTest/kotlin/io/karandash/config/merge/MergeModeMergerTest.kt |
cfg-extends-local (child overrides the base's maxLength) |
Config inheritance |
extends: chain check (validate-extends) |
cli/src/commonTest/kotlin/io/karandash/cli/commands/ValidateExtendsCommandTest.kt |
cfg-validate-extends |
validate-extends |
| Remote config auth blocks | core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/AuthBlockParserTest.kt, core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/RemoteConfigFetcherAuthTest.kt |
cfg-auth-http-refused, cfg-auth-missing, cfg-auth-wrong-token, cfg-auth-bearer, cfg-auth-bearer-fetch, cfg-auth-custom-header, cfg-auth-basic, cfg-auth-untrusted-cert (HTTPS through mock-server/tls_proxy.py with a throwaway certificate; needs openssl and keytool) |
Config inheritance |
{ file: } references |
cli/src/commonTest/kotlin/io/karandash/cli/config/ExternalValueResolverTest.kt |
cfg-file-ref |
YAML config |
${ENV} interpolation |
core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ConfigMapParserInterpolationTest.kt |
cfg-env, cfg-env-unset |
Environment variables |
Env denylist (KarandashEnvSecurity.DENYLIST) |
core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ConfigMapParserInterpolationTest.kt |
cfg-env-denylist |
Environment variables |
| Key normalization (kebab/snake to camelCase) | core/normalize/src/commonTest/kotlin/io/karandash/normalize/DeepNormalizeKeysTest.kt |
cfg-normalize |
YAML config |
| Zero-config fallback | core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ZeroConfigDefaultsTest.kt |
cfg-zero |
Zero config |
Dry-run and --dry-run-scope |
cli/src/commonTest/kotlin/io/karandash/cli/pipeline/ConfigLoaderDryRunScopeTest.kt |
cfg-dry-run |
validate |
config validate / config describe |
cli/src/commonTest/kotlin/io/karandash/cli/commands/ConfigValidateCommandTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/commands/config/ConfigDescribeEffectiveTest.kt |
cfg-validate, cfg-describe, cfg-describe-effective |
config |
Config watch mode (validate --watch) |
core/watcher/src/jvmTest/kotlin/io/karandash/watcher/ConfigWatcherTest.kt, cli/src/jvmTest/kotlin/io/karandash/cli/commands/validate/WatchCancellationTest.kt |
watch-start, watch-revalidate (the config is rewritten while the CLI runs) |
Watch mode |
JSON schema (generate --schema) |
cli/src/commonTest/kotlin/io/karandash/cli/commands/GenerateCommandTest.kt |
cmd-generate-schema, cmd-generate-schema-file |
generate |
$schema and version keys, schema version check |
core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ExtendsKeyBehaviourTest.kt, core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ConfigSchemaVersionTest.kt |
gap | gap |
| Unknown top-level and nested key warnings | core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/UnknownTopLevelKeysTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/compat/ConfigurationSchemaDocTest.kt, core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/UnknownNestedKeysTest.kt, core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/RuleConfigDecodeCheckTest.kt |
gap | gap |
Quoted-scalar coercion and SchemaCoercer |
core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/QuotedScalarCoercionTest.kt, core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/SchemaCoercerTest.kt |
gap | gap |
| Rule config decode check at load | core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/RuleConfigDecodeCheckTest.kt |
cfg-load-checks-rule |
gap |
| Condition syntax check at load | core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ConditionExpressionCheckTest.kt |
cfg-load-checks-when |
conditional |
Module enablement (true, false, {enabled}) |
core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ModuleEnablementResolverTest.kt, plugins/plugins-extended/rules/jira-ticket/src/commonTest/kotlin/io/karandash/validators/JiraTicketRegressionTest.kt |
gap | gap |
Missing-module detector, --on-missing-plugin, plugins: manifest key |
core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/MissingModuleDetectorTest.kt, plugins/integration-tests/contracts/src/jvmTest/kotlin/io/karandash/contracts/fw/ReportersShapeContractTest.kt, core/manifest/src/commonTest/kotlin/io/karandash/manifest/MissingPluginBehaviorTest.kt |
gap | validate |
| Did-you-mean suggestions for module ids | cli/src/commonTest/kotlin/io/karandash/cli/errors/SuggestionEngineTest.kt |
cfg-load-checks-typo |
gap |
Named extends auth sets, validate-extends --list-sets |
cli/src/commonTest/kotlin/io/karandash/cli/commands/ValidateExtendsCommandTest.kt |
cfg-extends-sets-list, cfg-extends-auth-sets (the set's bearer token is refused over plain HTTP, never sent) |
validate-extends |
KARANDASH_CONFIG_URL and KARANDASH_CONFIG_TOKEN |
core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ConfigMapParserInterpolationTest.kt, core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/EnvVarInterpolationInExtendsTest.kt |
gap | gap |
KARANDASH_CONFIG and KARANDASH_CONFIG_DIR discovery overrides |
cli/src/commonTest/kotlin/io/karandash/cli/config/ConfigDiscoveryTest.kt |
cfg-config-dir, cfg-config-env |
YAML_CONFIG |
extends[].cache (ttl; cache.downloads.ttl/enabled inherited down the chain; ETag revalidation) |
cli/src/commonTest/kotlin/io/karandash/cli/config/CacheLayerTest.kt, core/cache/src/commonTest/kotlin/io/karandash/cache/cas/ConditionalFetchCacheTest.kt |
gap | config-inheritance |
Merge block modes (fail, warn, off, false) |
core/merge/src/commonTest/kotlin/io/karandash/config/merge/MergeModeMergerTest.kt, plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/config/BlockModeTest.kt |
gap | config-inheritance |
env: declarations and ${VAR:-default} |
core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ConfigMapParserEnvBlockTest.kt |
cfg-env |
environment-variables |
init flags (--preset, --platform, --format, --output) |
cli/src/commonTest/kotlin/io/karandash/cli/commands/InitCommandTest.kt |
gap | init |
| Config renderers (yaml, json, kts) | cli/src/commonTest/kotlin/io/karandash/cli/config/renderers/JsonConfigRendererTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/config/renderers/YamlConfigRendererTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/config/renderers/KtsConfigRendererTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/config/ConfigRendererRegistryTest.kt |
gap | init |
format schema |
cli/src/commonTest/kotlin/io/karandash/cli/commands/format/FormatCommandTest.kt |
gap | format |
Config model, keys and aliases
| Feature | Behavior test | E2E | Doc |
|---|---|---|---|
| AI config synthesizer (zero-config AI) | gap | gap | gap |
Top-level options: |
core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ConfigMapParserDeadKeysTest.kt |
gap | gap |
Top-level extensions: |
gap | gap | gap |
limits: (18 keys) |
cli/src/commonTest/kotlin/io/karandash/cli/config/ExtendsInheritanceKeyBehaviourTest.kt, core/validation/src/commonTest/kotlin/io/karandash/engine/PolicyKeyBehaviourTest.kt |
gap | known-limits |
timeouts: (global, http, enrichment, ruleExecution, scripts, pluginShutdown, cacheTtl) |
cli/src/commonTest/kotlin/io/karandash/cli/pipeline/TimeoutsKeyBehaviourTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/ResponseTtlTest.kt |
gap | gap |
--global-timeout (exit 7) |
cli/src/jvmTest/kotlin/io/karandash/cli/GlobalTimeoutExitCodeTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/GlobalTimeoutResolutionTest.kt |
gap | error-codes |
KARANDASH_HTTP_TIMEOUT |
cli/src/commonTest/kotlin/io/karandash/cli/pipeline/HttpClientSettingsWiringTest.kt |
gap | gap |
KARANDASH_PLUGIN_CALL_TIMEOUT |
plugins/loader/src/commonTest/kotlin/io/karandash/loader/js/JsPluginLoaderLifecycleTest.kt, plugins/loader/src/jvmTest/kotlin/io/karandash/loader/wasm/WasmPluginLoaderLifecycleJvmTest.kt |
plugin-run-js-timeout, plugin-run-js-timeout-bounded |
gap |
http: (11 keys) |
core/http/src/commonTest/kotlin/io/karandash/http/HttpClientSettingsTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/CacheKeyBehaviourTest.kt |
gap | gap |
security.blockedHosts |
cli/src/commonTest/kotlin/io/karandash/cli/config/SecurityBlockedHostsWiringTest.kt |
gap | gap |
KARANDASH_TLS_INSECURE_HOSTS (per-host TLS opt-out) |
core/http/src/commonTest/kotlin/io/karandash/http/TlsInsecureHostsTest.kt |
gap | gap |
CA bundle override (SSL_CERT_FILE) |
core/http/src/commonTest/kotlin/io/karandash/http/CaBundleOverrideTest.kt, core/http/src/jvmTest/kotlin/io/karandash/http/PemBundleTrustManagerTest.kt |
gap | gap |
display: (git.shortShaLength, watcher.debounce, console marks) |
cli/src/commonTest/kotlin/io/karandash/cli/pipeline/ShortShaLengthWiringTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/commands/validate/ReportDisplayKeyBehaviourTest.kt |
gap | gap |
diagnostics: (output, interval, flushInterval) |
cli/src/commonTest/kotlin/io/karandash/cli/pipeline/DiagnosticsKeyBehaviourTest.kt |
gap | gap |
Rule key aliases (RuleKeyAliases) |
core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/RuleKeyAliasesTest.kt |
gap | gap |
AI config aliases (AiConfigAliases) |
plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/AiConfigAliasesTest.kt |
gap | gap |
PreserveKeys (keys exempt from normalization) |
core/normalize/src/commonTest/kotlin/io/karandash/normalize/ConfigKeyNormalizerTest.kt |
gap | YAML_CONFIG |
| Module id fuzzy match (exact, camelCase, alphanumeric lowercase) | core/normalize/src/commonTest/kotlin/io/karandash/normalize/ModuleIdNormalizerTest.kt, plugins/integration-tests/rules/src/commonTest/kotlin/io/karandash/validators/RuleIdDispatchConsistencyTest.kt |
gap | gap |
Explicit module aliases (draft, reviewdog) and platform alias index |
core/ai-pipeline/src/commonTest/kotlin/io/karandash/ai/pipeline/AiServiceImplTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/plugin/ModuleDefaultsCollectorTest.kt, plugins/bootstrap/src/commonTest/kotlin/io/karandash/bootstrap/BootstrapAliasCollisionTest.kt |
gap | gap |
Typed rule ids io.karandash.rule.<id>:<key> |
plugins/plugins-core/rules/file-changes/src/commonTest/kotlin/io/karandash/validators/FileChangesKeyBehaviourTest.kt, plugins/plugins-core/rules/title-format/src/commonTest/kotlin/io/karandash/validators/TitleFormatKeyBehaviourTest.kt |
gap | gap |
Typed output ids io.karandash.output.<id>:<key> |
plugins/plugins-extended/outputs/status-output/src/commonTest/kotlin/io/karandash/plugins/outputs/StatusOutputModuleTest.kt, plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputReconcileTest.kt |
gap | gap |
JSON schema of the config (configuration-schema) |
cli/src/commonTest/kotlin/io/karandash/cli/compat/ConfigurationSchemaDocTest.kt, core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ConfigFormatRegistryRuleSchemasTest.kt |
gap | configuration-schema |
Patterns, regex and value types
| Feature | Behavior test | E2E | Doc |
|---|---|---|---|
Named patterns: and @name expansion |
core/multipattern/src/commonTest/kotlin/io/karandash/patterns/NamedPatternExpanderTest.kt, core/multipattern/src/commonTest/kotlin/io/karandash/patterns/CorePatternRegistryTest.kt |
patterns-pomsky-name-fail, patterns-pomsky-name-pass |
patterns |
| Pomsky patterns | core/multipattern/src/commonTest/kotlin/io/karandash/patterns/PomskyCompilerTest.kt, core/multipattern/src/commonTest/kotlin/io/karandash/patterns/PomskyConfigCheckTest.kt |
patterns-pomsky-name-fail, patterns-pomsky-name-pass |
patterns |
| Text-glob patterns | core/multipattern/src/commonTest/kotlin/io/karandash/patterns/TextGlobCompilerTest.kt |
gap | patterns |
| Pattern fix and describe | core/multipattern/src/commonTest/kotlin/io/karandash/patterns/PatternFixTest.kt, core/multipattern/src/commonTest/kotlin/io/karandash/patterns/PatternDescriberTest.kt |
gap | patterns |
| Built-in pattern library | core/multipattern/src/commonTest/kotlin/io/karandash/patterns/BuiltInPatternSweepTest.kt |
gap | patterns |
Regex safety (nesting analysis, SafeRegexCompiler) |
core/regex-safety/src/commonTest/kotlin/io/karandash/helpers/SafeRegexCompilerNestingTest.kt, core/regex-safety/src/commonTest/kotlin/io/karandash/helpers/SafeRegexCompilerLimitsTest.kt, core/regex-safety/src/commonTest/kotlin/io/karandash/helpers/RegexHelperTest.kt |
patterns-redos-rule |
gap |
SafeRegex SDK helper |
plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/regex/SafeRegexTest.kt |
gap | api-reference |
| Duration, size and percent values | core/common/src/commonTest/kotlin/io/karandash/duration/KarandashDurationTest.kt, core/common/src/commonTest/kotlin/io/karandash/size/KarandashSizeTest.kt, core/common/src/commonTest/kotlin/io/karandash/percent/KarandashPercentTest.kt |
patterns-cache-ttl-invalid (a bad cache.default-ttl exits 2) |
gap |
| Version comparator | core/common/src/commonTest/kotlin/io/karandash/utils/VersionComparatorTest.kt |
gap | gap |
| Glob translator and glob matcher | core/common/src/commonTest/kotlin/io/karandash/utils/GlobTranslatorTest.kt, core/glob/src/commonTest/kotlin/io/karandash/utils/GlobMatcherTest.kt |
gap | gap |
| PII, ticket and URL redaction | core/multipattern/src/commonTest/kotlin/io/karandash/security/TextRedactorTest.kt, core/multipattern/src/commonTest/kotlin/io/karandash/security/TicketContentRedactorTest.kt, core/multipattern/src/commonTest/kotlin/io/karandash/security/UrlSanitizerTest.kt |
gap | gap |
Profiles
| Feature | Behavior test | E2E | Doc |
|---|---|---|---|
Built-in profiles (profile list/show/export) |
cli/src/commonTest/kotlin/io/karandash/cli/commands/ProfileCommandTest.kt |
profile-list, profile-show, profile-export |
profile |
profile: in config, with overrides |
core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ProfileResolverTest.kt, plugins/integration-tests/contracts/src/jvmTest/kotlin/io/karandash/contracts/fw/ProfileOverridesContractTest.kt |
profile-apply |
Profiles |
init --profile |
cli/src/commonTest/kotlin/io/karandash/cli/commands/InitCommandTest.kt |
profile-init, profile-init-file |
init |
Profile minimal |
cli/src/commonTest/kotlin/io/karandash/cli/integration/SimplificationFeaturesTest.kt, plugins/integration-tests/rules/src/commonTest/kotlin/io/karandash/validators/ModuleIdConstantsCrossReferenceTest.kt |
gap | profiles |
Profile integration-mr |
plugins/plugins-core/profiles/integration-mr/src/commonTest/kotlin/io/karandash/profiles/IntegrationMrProfileModuleTest.kt |
gap | gap |
profile list/show/export --tag/--format/--output |
cli/src/commonTest/kotlin/io/karandash/cli/commands/ProfileCommandTest.kt |
profile-list, profile-show, profile-export |
profile |
profileOverrides.size and profileOverrides.title |
core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ProfileOverridesKeyBehaviourTest.kt, plugins/integration-tests/contracts/src/jvmTest/kotlin/io/karandash/contracts/fw/ProfileOverridesContractTest.kt |
profile-apply |
profiles |
Platforms and auth
| Feature | Behavior test | E2E | Doc |
|---|---|---|---|
| GitLab: fetch MR, token auth | plugins/plugins-core/platforms/gitlab/src/commonTest/kotlin/io/karandash/platforms/gitlab/GitLabClientTest.kt |
live-validate, live-pr-url |
GitLab |
| GitLab: post the report comment | plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputModuleContractTest.kt |
live-comment |
GitLab |
| GitLab: approvals | plugins/integration-tests/contracts/src/commonTest/kotlin/io/karandash/contracts/fw/GitLabApprovalsContractTest.kt |
live-validate (approval rule fails against the mock) |
Approvals |
allow_localhost for self-hosted instances |
cli/src/commonTest/kotlin/io/karandash/cli/commands/ConfiguredRuleCommandsTest.kt |
every live-* scenario (the mock runs on localhost) |
YAML config |
| GitHub: token auth | plugins/plugins-core/platforms/github/src/commonTest/kotlin/io/karandash/platforms/github/GitHubClientTest.kt |
gh-token-validate, gh-token-fetch (GitHub Enterprise layout on the mock) |
GitHub |
| GitHub App auth (RS256 JWT, installation token, refresh) | plugins/plugins-core/platforms/github/src/commonTest/kotlin/io/karandash/platforms/github/GitHubAppAuthTest.kt, core/crypto/src/commonTest/kotlin/io/karandash/crypto/JwtTest.kt |
gh-app-validate, gh-app-exchange, gh-app-fetch, gh-app-doctor, gh-app-wrong-key (the mock verifies the JWT signature with openssl) |
GitHub |
Bitbucket: token (Bearer) or username + app password (Basic), configured url |
plugins/plugins-core/platforms/bitbucket/src/commonTest/kotlin/io/karandash/platforms/bitbucket/BitbucketClientTest.kt, plugins/plugins-core/platforms/bitbucket/src/commonTest/kotlin/io/karandash/platforms/bitbucket/BitbucketClientStatusTest.kt |
bb-validate, bb-validate-bearer, bb-wrong-creds, bb-doctor, bb-doctor-wrong-creds |
Bitbucket |
| Gerrit: basic auth | plugins/plugins-extended/platforms/gerrit/src/commonTest/kotlin/io/karandash/platforms/gerrit/GerritAuthTest.kt |
gerrit-validate, gerrit-wrong-creds, gerrit-doctor, gerrit-doctor-wrong-creds |
Gerrit |
| Gitea | plugins/plugins-extended/platforms/gitea/src/commonTest/kotlin/io/karandash/platforms/gitea/GiteaClientTest.kt |
gitea-validate, gitea-wrong-creds, gitea-doctor, gitea-doctor-wrong-creds |
Gitea |
| Azure DevOps | plugins/plugins-extended/platforms/azuredevops/src/commonTest/kotlin/io/karandash/platforms/azuredevops/AzureDevOpsClientTest.kt |
ado-validate, ado-wrong-token, ado-validate-kebab, ado-doctor, ado-doctor-wrong, ado-doctor-kebab |
Azure DevOps |
AWS CodeCommit: SigV4 with STS session token, endpoint override |
plugins/plugins-extended/platforms/awscodecommit/src/commonTest/kotlin/io/karandash/platforms/awscodecommit/AwsCodeCommitClientTest.kt, plugins/plugins-extended/platforms/awscodecommit/src/commonTest/kotlin/io/karandash/platforms/awscodecommit/AwsEndpointOverrideTest.kt |
aws-validate, aws-wrong-creds, aws-endpoint-ssrf, aws-doctor, aws-doctor-wrong (the mock verifies the SigV4 signature) |
AWS CodeCommit |
| Jenkins | plugins/plugins-extended/platforms/jenkins/src/commonTest/kotlin/io/karandash/platforms/jenkins/JenkinsProviderTest.kt |
jenkins-validate, jenkins-no-change-url |
Jenkins |
Local MR file (--mr) |
cli/src/commonTest/kotlin/io/karandash/cli/commands/validate/ValidateLocalAndOnceTest.kt |
cfg-yaml and every scenario run with --mr mr.json |
validate |
Local git (validate-local) |
plugins/plugins-core/platforms/local-git/src/commonTest/kotlin/io/karandash/platforms/localgit/LocalGitProviderTest.kt |
localgit-validate, localgit-validate-fail, localgit-platform-flag, localgit-target-missing (a throwaway git checkout with a target branch) |
validate-local |
SSRF protection on outbound URLs, allow_private_network |
core/http/src/commonTest/kotlin/io/karandash/http/SsrfUrlValidatorTest.kt, core/http/src/commonTest/kotlin/io/karandash/http/SsrfAllowPrivateNetworkTest.kt |
cfg-extends-remote (allowed only with allow_localhost), out-webhook-ssrf, cache-remote-ssrf, aws-endpoint-ssrf, cfg-auth-http-refused |
YAML config |
GitLab approveToken |
plugins/plugins-core/platforms/gitlab/src/commonTest/kotlin/io/karandash/platforms/gitlab/GitLabApproveTokenKeyTest.kt |
gap | gitlab |
GitLab deleteInlineStrategy |
plugins/plugins-core/platforms/gitlab/src/commonTest/kotlin/io/karandash/platforms/gitlab/GitLabMarkedThreadsAndBlameTest.kt |
gap | gitlab |
Gerrit notify |
plugins/plugins-extended/platforms/gerrit/src/commonTest/kotlin/io/karandash/platforms/gerrit/GerritKeyBehaviourTest.kt |
gap | gerrit |
Jenkins changeUrl |
plugins/plugins-extended/platforms/jenkins/src/commonTest/kotlin/io/karandash/platforms/jenkins/JenkinsProviderTest.kt |
jenkins-no-change-url |
jenkins |
AWS CodeCommit stsEndpoint |
plugins/plugins-extended/platforms/awscodecommit/src/commonTest/kotlin/io/karandash/platforms/awscodecommit/AwsKeyBehaviourTest.kt |
gap | aws-codecommit |
AWS CodeCommit profile (shared credentials file) |
plugins/plugins-extended/platforms/awscodecommit/src/commonTest/kotlin/io/karandash/platforms/awscodecommit/AwsKeyBehaviourTest.kt |
gap | aws-codecommit |
| AWS credential chain (env, profile, STS) | core/crypto/src/commonTest/kotlin/io/karandash/crypto/AwsCredentialChainTest.kt |
gap | aws-codecommit |
Azure DevOps organization |
plugins/plugins-extended/platforms/azuredevops/src/commonTest/kotlin/io/karandash/platforms/azuredevops/AzureDevOpsKeyBehaviourTest.kt |
ado-validate-kebab |
azure-devops |
GitHub baseUrl (Enterprise) |
plugins/plugins-core/platforms/github/src/commonTest/kotlin/io/karandash/platforms/github/GitHubKeyBehaviourTest.kt |
gh-token-validate |
github |
Platform and CI auto-detection (--no-auto-detect, --platform, --project, --mr-id, --pr) |
cli/src/commonTest/kotlin/io/karandash/cli/detect/PlatformDetectorTest.kt, core/detect/src/commonTest/kotlin/io/karandash/detect/PlatformDetectorTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/detect/ProviderAutoDetectorTest.kt, core/detect/src/commonTest/kotlin/io/karandash/detect/ProviderAutoDetectorTest.kt, plugins/integration-tests/providers/src/commonTest/kotlin/io/karandash/providers/PlatformSupportContractTest.kt |
gap | environment-variables |
KARANDASH_PLATFORM, KARANDASH_PROJECT_ID, KARANDASH_MR_ID, KARANDASH_TOKEN, KARANDASH_BASE_URL |
cli/src/commonTest/kotlin/io/karandash/cli/detect/PlatformDetectorTest.kt, core/detect/src/commonTest/kotlin/io/karandash/detect/PlatformDetectorTest.kt |
gap | environment-variables |
Forge CI environment (CI_FORGE_*) |
plugins/helpers/src/commonTest/kotlin/io/karandash/providers/common/EnrichmentProvidersTest.kt |
gap | environment-variables |
| Platform capability flags (merge, reviewers, branches, pipeline, inline, resolve) | plugins/integration-tests/providers/src/commonTest/kotlin/io/karandash/providers/PlatformServiceContractTest.kt, core/api/src/commonTest/kotlin/io/karandash/api/PlatformServiceDefaultsTest.kt |
gap | gap |
| MR search and open-MR listing | plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/pipeline/AiArchitectureChecksTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AuthorHistoryTest.kt, plugins/plugins-ai/analyzers/similar-issues/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/similarissues/SimilarIssuesAnalyzerModuleTest.kt |
gap | gap |
| Repo file reader (head and base content, memoized) | cli/src/commonTest/kotlin/io/karandash/cli/pipeline/MemoizedRepositoryFileReaderTest.kt, core/validation/src/commonTest/kotlin/io/karandash/content/GitRepoFileFetcherTest.kt |
gap | gap |
| Blame fill and working copy at head | cli/src/commonTest/kotlin/io/karandash/cli/pipeline/BlameFillTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/WorkingCopyAtHeadTest.kt |
gap | gap |
| Pagination (page, cursor, probe) | core/http/src/commonTest/kotlin/io/karandash/pagination/PaginatorsTest.kt |
gap | gap |
| Rate-limit info | core/api/src/commonTest/kotlin/io/karandash/api/PlatformServiceExtensionsTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/commands/DoctorAuthCheckTest.kt |
gap | gap |
| Host-scoped auth | core/http/src/commonTest/kotlin/io/karandash/http/HostScopedAuthTest.kt, core/http/src/commonTest/kotlin/io/karandash/http/HostCredentialsStaticHeadersTest.kt |
gap | gap |
| Redirect SSRF check | core/http/src/commonTest/kotlin/io/karandash/http/SsrfDnsRebindingTest.kt, core/http/src/commonTest/kotlin/io/karandash/http/SsrfAlwaysBlockedTest.kt |
gap | gap |
Approval signals (code review, comment keyword, emoji; rules.approval.methods) |
plugins/integration-tests/contracts/src/commonTest/kotlin/io/karandash/contracts/fw/GitLabApprovalsContractTest.kt, core/models/src/commonTest/kotlin/io/karandash/models/ApprovalSignalTest.kt |
live-validate |
approvals |
mr close and mr reopen |
cli/src/commonTest/kotlin/io/karandash/cli/commands/mr/MrCommandTest.kt |
gap | mr |
Commit status publish (ResultStatusPublisher, status-output) |
plugins/integration-tests/providers/src/commonTest/kotlin/io/karandash/providers/ResultStatusPublisherTest.kt |
gap | status |
| Git subprocess budget and argument sanitizer | core/api/src/commonTest/kotlin/io/karandash/api/platform/SubprocessBudgetTest.kt, core/platform/src/commonTest/kotlin/io/karandash/platform/GitArgSanitizerTest.kt |
gap | gap |
| Windows command line and environment block | core/platform/src/commonTest/kotlin/io/karandash/platform/WindowsCommandLineTest.kt, core/platform/src/commonTest/kotlin/io/karandash/platform/WindowsEnvBlockTest.kt |
Windows only | gap |
Self-hosted cache server (tools/cache-server) |
tools/cache-server/src/test/kotlin/io/karandash/cacheserver/CacheServerModuleTest.kt, tools/cache-server/src/test/kotlin/io/karandash/cacheserver/HttpCacheBackendInteropTest.kt |
gap | self-hosted-cache-server |
Local-git platform (local-git, validate local) |
plugins/plugins-core/platforms/local-git/src/commonTest/kotlin/io/karandash/platforms/localgit/LocalGitRegressionTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/commands/validate/ValidateLocalAndOnceTest.kt |
gap | local-git |
Rules, policies and conditions
| Feature | Behavior test | E2E | Doc |
|---|---|---|---|
| Rule findings fail validation | plugins/plugins-core/rules/title-format/src/commonTest/kotlin/io/karandash/validators/TitleFormatValidatorTest.kt |
rule-fail, cfg-kts |
Rules |
| Built-in rules (title, branch, labels, commits, size, files, ...) | one test per rule module, e.g. plugins/plugins-core/rules/labels/src/commonTest/kotlin/io/karandash/validators/LabelsValidatorTest.kt |
rule-fail (title-format), live-validate (approval, labels), rule-smoke-all (all 20 built-in rules in one config run to completion) |
Rules |
| Severity overrides | plugins/integration-tests/contracts/src/commonTest/kotlin/io/karandash/contracts/fw/SeverityOverrideContractTest.kt |
policy-severity |
Severity policy |
--strict (warnings fail, exit 5) |
cli/src/commonTest/kotlin/io/karandash/cli/commands/ValidateCommandPrModeTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/PipelineStagesTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/compat/CompatExitCodesTest.kt |
policy-strict |
validate |
Policies (policies: with when:) |
core/conditions/src/commonTest/kotlin/io/karandash/conditions/DefaultPolicyEngineTest.kt, core/validation/src/commonTest/kotlin/io/karandash/engine/PolicyApplicatorTest.kt |
policy-severity, policy-disable |
Conditional rules |
Condition language (&&, \|\|, !, not(), predicates) |
core/validation/src/commonTest/kotlin/io/karandash/engine/MrConditionEvaluatorTest.kt |
policy-disable (label_exists(...) && !is_draft), rule-when-skip, rule-when-run (a rule when: false skips it, true runs it) |
Conditional rules |
verify-policy |
cli/src/commonTest/kotlin/io/karandash/cli/commands/ConfiguredRuleCommandsTest.kt |
policy-verify |
verify-policy |
Rule meta (when, severities, enabled, per-rule timeouts) |
core/validation/src/commonTest/kotlin/io/karandash/engine/RuleMetaKeyBehaviourTest.kt, core/validation/src/commonTest/kotlin/io/karandash/engine/ValidationEngineWhenTest.kt, core/validation/src/commonTest/kotlin/io/karandash/engine/ValidationEngineTimeoutTest.kt |
gap | conditional |
| Required-field filter and unavailable-fields note | core/validation/src/commonTest/kotlin/io/karandash/engine/ValidationEngineRequiredFieldTest.kt |
gap | gap |
| Rule execution priority and two-pass run | core/validation/src/commonTest/kotlin/io/karandash/engine/ValidationEnginePriorityTest.kt, core/validation/src/commonTest/kotlin/io/karandash/engine/ValidationEngineTwoPassTest.kt |
gap | gap |
Rule title-format |
plugins/plugins-core/rules/title-format/src/commonTest/kotlin/io/karandash/validators/TitleFormatValidatorTest.kt |
rule-fail, rule-smoke-titleFormat |
title-format |
Rule commit-messages |
plugins/plugins-core/rules/commit-messages/src/commonTest/kotlin/io/karandash/validators/CommitMessagesValidatorTest.kt, plugins/plugins-core/rules/commit-messages/src/commonTest/kotlin/io/karandash/validators/CommitMessagesGroupingTest.kt |
rule-smoke-commitMessages (enabled with defaults, runs to completion) |
commit-messages |
Rule jira-ticket |
plugins/plugins-extended/rules/jira-ticket/src/commonTest/kotlin/io/karandash/validators/JiraTicketValidatorTest.kt, plugins/plugins-extended/rules/jira-ticket/src/commonTest/kotlin/io/karandash/validators/JiraTicketPatternsTest.kt |
rule-smoke-jiraTicket (enabled with defaults, runs to completion) |
jira-ticket |
Rule branch-naming |
plugins/plugins-core/rules/branch-naming/src/commonTest/kotlin/io/karandash/validators/BranchNamingValidatorTest.kt, plugins/integration-tests/rules/src/commonTest/kotlin/io/karandash/validators/MultiValidatorPerformanceTest.kt |
rule-smoke-branchNaming (enabled with defaults, runs to completion) |
branch-naming |
Rule file-changes |
plugins/plugins-core/rules/file-changes/src/commonTest/kotlin/io/karandash/validators/FileChangesValidatorTest.kt, plugins/plugins-core/rules/file-changes/src/commonTest/kotlin/io/karandash/validators/FileChangesRegressionTest.kt |
rule-smoke-fileChanges (enabled with defaults, runs to completion) |
file-changes |
Rule codeowners |
plugins/plugins-extended/rules/codeowners/src/commonTest/kotlin/io/karandash/validators/CodeownersValidatorTest.kt, plugins/plugins-extended/rules/codeowners/src/commonTest/kotlin/io/karandash/validators/CodeownersKeyBehaviourTest.kt |
rule-smoke-codeowners (enabled with defaults, runs to completion) |
codeowners |
Rule approval |
plugins/plugins-extended/rules/approval/src/commonTest/kotlin/io/karandash/validators/ApprovalValidatorTest.kt, plugins/plugins-extended/rules/approval/src/commonTest/kotlin/io/karandash/validators/ApprovalKeyBehaviourTest.kt |
live-validate, rule-smoke-approval |
approvals |
Rule reviewer |
plugins/plugins-extended/rules/reviewer/src/commonTest/kotlin/io/karandash/validators/ReviewerValidatorTest.kt, plugins/plugins-extended/rules/reviewer/src/commonTest/kotlin/io/karandash/validators/ReviewerKeyBehaviourTest.kt |
rule-smoke-reviewer (enabled with defaults, runs to completion) |
reviewers |
Rule cicd-status |
plugins/plugins-extended/rules/cicd-status/src/commonTest/kotlin/io/karandash/validators/CicdStatusValidatorTest.kt, plugins/plugins-extended/rules/cicd-status/src/commonTest/kotlin/io/karandash/validators/CicdStatusKeyBehaviourTest.kt |
rule-smoke-cicdStatus (enabled with defaults, runs to completion) |
cicd-status |
Rule conflict |
plugins/plugins-extended/rules/conflict/src/commonTest/kotlin/io/karandash/validators/ConflictValidatorTest.kt, plugins/plugins-extended/rules/conflict/src/commonTest/kotlin/io/karandash/validators/ConflictKeyBehaviourTest.kt |
rule-smoke-conflict (enabled with defaults, runs to completion) |
conflict-detection |
Rule draft |
gap | rule-smoke-draftPrevention (enabled with defaults, runs to completion) |
draft-detection |
Rule labels |
plugins/plugins-core/rules/labels/src/commonTest/kotlin/io/karandash/validators/LabelsValidatorTest.kt |
live-validate, rule-smoke-labels |
labels |
Rule size-limits |
plugins/plugins-core/rules/size-limits/src/commonTest/kotlin/io/karandash/validators/SizeLimitsValidatorTest.kt, plugins/plugins-core/rules/size-limits/src/commonTest/kotlin/io/karandash/validators/SizeLimitsKeyBehaviourTest.kt |
rule-smoke-sizeLimits (enabled with defaults, runs to completion) |
size-limits |
Rule security |
plugins/plugins-core/rules/security/src/commonTest/kotlin/io/karandash/validators/SecurityValidatorTest.kt, plugins/plugins-core/rules/security/src/commonTest/kotlin/io/karandash/validators/SecurityKeyBehaviourTest.kt |
rule-smoke-security (enabled with defaults, runs to completion) |
security |
Rule context-tag |
plugins/plugins-extended/rules/context-tag/src/commonTest/kotlin/io/karandash/validators/ContextTagValidatorTest.kt, projects/wallet/src/commonTest/kotlin/io/karandash/validators/WalletRequirementsIntegrationTest.kt |
rule-smoke-contextTag (enabled with defaults, runs to completion) |
context-tags |
Rule description-format |
plugins/plugins-extended/rules/description-format/src/commonTest/kotlin/io/karandash/validators/DescriptionFormatValidatorTest.kt, plugins/plugins-extended/rules/description-format/src/commonTest/kotlin/io/karandash/validators/DescriptionFormatFixHintTest.kt |
rule-smoke-descriptionFormat (enabled with defaults, runs to completion) |
description-format |
Rule cross-entity-consistency |
plugins/plugins-extended/rules/cross-entity-consistency/src/commonTest/kotlin/io/karandash/validators/CrossEntityConsistencyValidatorTest.kt, projects/base/src/commonTest/kotlin/io/karandash/validators/BaseRequirementsIntegrationTest.kt |
rule-smoke-crossEntityConsistency (enabled with defaults, runs to completion) |
cross-entity-consistency |
Rule language-policy |
plugins/plugins-extended/rules/language-policy/src/commonTest/kotlin/io/karandash/validators/LanguagePolicyValidatorTest.kt, projects/base/src/commonTest/kotlin/io/karandash/validators/BaseRequirementsIntegrationTest.kt |
rule-smoke-languagePolicy (enabled with defaults, runs to completion) |
language-policy |
Rule commit-body |
plugins/plugins-core/rules/commit-body/src/commonTest/kotlin/io/karandash/validators/CommitBodyValidatorTest.kt, projects/wallet/src/commonTest/kotlin/io/karandash/validators/WalletRequirementsIntegrationTest.kt |
rule-smoke-commitBody (enabled with defaults, runs to completion) |
commit-body |
Rule dependencies |
plugins/plugins-extended/rules/dependencies/src/commonTest/kotlin/io/karandash/validators/DependencyValidatorTest.kt, plugins/plugins-extended/rules/dependencies/src/commonTest/kotlin/io/karandash/validators/DependencyValidationRuleModuleTest.kt |
rule-smoke-dependencyValidation (enabled with defaults, runs to completion) |
dependency-validation |
| Policy predicate families (MR data, file metrics, env, config, rule result) | core/conditions/src/commonTest/kotlin/io/karandash/conditions/MrDataPredicatesTest.kt, core/conditions/src/commonTest/kotlin/io/karandash/conditions/FileMetricPredicatesTest.kt, core/conditions/src/commonTest/kotlin/io/karandash/conditions/EnvironmentPredicatesTest.kt, core/conditions/src/commonTest/kotlin/io/karandash/conditions/ConfigPredicatesTest.kt, core/conditions/src/commonTest/kotlin/io/karandash/conditions/RuleResultPredicatesTest.kt |
gap | conditional |
Severity cap extension (severityCap) |
plugins/plugins-core/extensions/severity-cap/src/commonTest/kotlin/io/karandash/extensions/SeverityCapExtensionTest.kt |
rule-severity-cap (top-level cap turns the error into a passing warning), rule-severity-cap-rule (a per-rule severity-cap: error keeps it blocking) |
severity-policy |
Rule result cache (--no-cache, --invalidate-rules, --gate-on-cached) |
core/validation/src/commonTest/kotlin/io/karandash/engine/ValidationEngineCacheTest.kt, core/state/src/commonTest/kotlin/io/karandash/cache/cas/CasStateStoreTest.kt |
gap | cache |
Baseline (--baseline, --update-baseline, delta new and fixed) |
core/api/src/commonTest/kotlin/io/karandash/api/ReportMetricsSerializationTest.kt, plugins/helpers/src/commonTest/kotlin/io/karandash/helpers/reporter/ReportViewBuilderTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/FindingSuppressionTest.kt |
gap | validate |
| Finding suppression and dismissed inline comments | cli/src/commonTest/kotlin/io/karandash/cli/pipeline/FindingSuppressionTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/NotificationGateTest.kt, plugins/loader/src/commonTest/kotlin/io/karandash/loader/bridge/BridgeCallShapeTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiPlatformDismissalsTest.kt |
gap | gap |
--rules, --rules-file, --show-execution-plan, --explain |
cli/src/commonTest/kotlin/io/karandash/cli/CliFlagTableTest.kt |
gap | validate |
simulate --approvers |
cli/src/commonTest/kotlin/io/karandash/cli/commands/simulate/SimulateCommandTest.kt |
live-simulate |
simulate |
test-rule --snapshot, --mr-url, --against-history, --replay-count |
cli/src/commonTest/kotlin/io/karandash/cli/commands/ConfiguredRuleCommandsTest.kt |
cmd-test-rule, live-test-rule |
test-rule |
mutate --rule and --synthetic-mrs |
plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/architecture/RuleMutationTesterTest.kt |
cmd-mutate |
mutate |
Jira validation (jira-ticket against Jira API) |
plugins/plugins-extended/rules/jira-ticket/src/commonTest/kotlin/io/karandash/validators/JiraTicketValidatorTest.kt, plugins/plugins-extended/rules/jira-ticket/src/commonTest/kotlin/io/karandash/validators/JiraTicketPatternsTest.kt |
gap | jira-validation |
Validation pipeline, fixes and state
| Feature | Behavior test | E2E | Doc |
|---|---|---|---|
Auto-fix (--fix --yes) |
core/validation/src/commonTest/kotlin/io/karandash/fixing/AutoFixerCustomTest.kt, plugins/integration-tests/contracts/src/commonTest/kotlin/io/karandash/contracts/fw/AutofixCustomContractTest.kt |
live-fix, live-fix-write (adds the missing label on the mock) |
Auto-fix |
Scripts block (scripts:, QuickJS sandbox) |
plugins/plugins-extended/scripts/src/commonTest/kotlin/io/karandash/scripts/BuiltInScriptModuleTest.kt, plugins/plugins-extended/scripts/src/commonTest/kotlin/io/karandash/scripts/SandboxScriptExecutorTest.kt, plugins/plugins-extended/scripts/src/commonTest/kotlin/io/karandash/scripts/SandboxDslFindingsTest.kt |
script-module-test.sh |
Scripts |
| Dangerfile (JS, via node) | cli/src/commonTest/kotlin/io/karandash/cli/pipeline/JsDangerfileTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/dangerfile/DangerfileDetectorTest.kt |
dangerfile-js (needs node: in the toolchain image, so it runs on CI) |
Dangerfile |
Pipeline extension hooks (onConfigured, onPostFetch, afterValidation, beforeReporting, onPipelineComplete) |
core/api/src/commonTest/kotlin/io/karandash/api/ModuleInterfaceDefaultsTest.kt |
gap | api-reference |
Extension hooks for incremental state (getCachedFindings, invalidateRules, needsBlame, needsHeadContent, baseFiles) |
plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiPipelineExtensionNeedsHeadContentTest.kt, plugins/loader/src/commonTest/kotlin/io/karandash/loader/bridge/BridgeHostProxiesTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/IncrementalCacheBypassTest.kt |
gap | api-reference |
| Auto-fix handlers (request review, remove review, custom) | core/validation/src/commonTest/kotlin/io/karandash/fixing/AutoFixerCustomTest.kt, core/validation/src/commonTest/kotlin/io/karandash/fixing/AutoFixerDescriptionTest.kt |
gap | auto-fix |
| Fix hints and code-change suggestions | core/models/src/commonTest/kotlin/io/karandash/models/finding/FindingFixHintTest.kt, core/models/src/commonTest/kotlin/io/karandash/models/finding/FindingCodeChangeTest.kt, core/common/src/commonTest/kotlin/io/karandash/utils/suggestion/ContextAwareSuggestionGeneratorTest.kt |
gap | auto-fix |
autoApprove and --auto-approve |
cli/src/commonTest/kotlin/io/karandash/cli/pipeline/AutoApproveHandlerTest.kt |
gap | gap |
Script mode subprocess and timeout |
plugins/plugins-extended/scripts/src/commonTest/kotlin/io/karandash/scripts/BuiltInScriptModuleTest.kt, plugins/plugins-extended/scripts/src/commonTest/kotlin/io/karandash/scripts/SubprocessScriptExecutorTest.kt, plugins/plugins-extended/scripts/src/commonTest/kotlin/io/karandash/scripts/ScriptRoutingAndConfigTest.kt |
script-module-test.sh |
scripts |
| Script DSL injector | plugins/plugins-extended/scripts/src/commonTest/kotlin/io/karandash/scripts/SubprocessScriptExecutorTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/ScriptExecutorResultTest.kt |
gap | scripts |
| Incremental state (snapshots, diff delta) | core/state/src/commonTest/kotlin/io/karandash/state/snapshot/SnapshotManagerTest.kt, core/state/src/commonTest/kotlin/io/karandash/state/snapshot/DiffDeltaCalculatorTest.kt |
gap | |
| Content resolver (content sources, symlink guard) | core/validation/src/commonTest/kotlin/io/karandash/content/ContentResolverTest.kt, core/validation/src/jvmTest/kotlin/io/karandash/content/ContentResolverSymlinkTest.kt |
gap | gap |
| Report data builder and report engine | core/validation/src/commonTest/kotlin/io/karandash/engine/ReportDataBuilderTest.kt, core/validation/src/commonTest/kotlin/io/karandash/engine/ReportEngineTest.kt |
gap | gap |
| CI log summary | cli/src/commonTest/kotlin/io/karandash/cli/pipeline/CiLogSummaryTest.kt |
gap | ci-cd-integration |
Enrichment
| Feature | Behavior test | E2E | Doc |
|---|---|---|---|
| Enrichment providers (Jira, Confluence, local git) | cli/src/commonTest/kotlin/io/karandash/cli/pipeline/EnrichmentStageTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/EnrichmentProviderConfigKeyTest.kt, plugins/plugins-extended/enrichment/jira-enrichment/src/commonTest/kotlin/io/karandash/enrichment/jira/JiraEnrichmentProviderTest.kt, plugins/plugins-extended/enrichment/confluence-enrichment/src/commonTest/kotlin/io/karandash/enrichment/confluence/ConfluenceEnrichmentProviderTest.kt, plugins/plugins-extended/enrichment/local-git-enrichment/src/commonTest/kotlin/io/karandash/enrichment/localgit/LocalGitEnrichmentProviderTest.kt, plugins/plugins-extended/enrichment/local-git-enrichment/src/commonTest/kotlin/io/karandash/enrichment/localgit/ContributorAnalyzerTest.kt |
enrich-jira, enrich-jira-issue-fetch, enrich-confluence-page-fetch (Atlassian mock), enrich-localgit-with, enrich-localgit-hotspot-kept, enrich-localgit-cold-dropped, enrich-localgit-without, enrich-localgit-control-cold-kept, enrich-localgit-control-hot-dropped, enrich-localgit-contributors |
Enrichment |
ci-enrichment provider |
plugins/plugins-extended/enrichment/ci-enrichment/src/commonTest/kotlin/io/karandash/enrichment/ci/CiEnrichmentProviderTest.kt, plugins/plugins-extended/enrichment/ci-enrichment/src/commonTest/kotlin/io/karandash/enrichment/ci/CiPipelineFlowTest.kt |
gap | enrichment |
github-issue provider |
plugins/plugins-extended/enrichment/github-issue-enrichment/src/commonTest/kotlin/io/karandash/enrichment/github/GitHubIssueEnrichmentProviderTest.kt, plugins/plugins-extended/enrichment/github-issue-enrichment/src/commonTest/kotlin/io/karandash/enrichment/github/GitHubIssueFetchTest.kt |
gap | enrichment |
gitlab-issue provider |
plugins/plugins-extended/enrichment/gitlab-issue-enrichment/src/commonTest/kotlin/io/karandash/enrichment/gitlabissue/GitLabIssueEnrichmentProviderTest.kt, plugins/plugins-extended/enrichment/gitlab-issue-enrichment/src/commonTest/kotlin/io/karandash/enrichment/gitlabissue/GitLabIssueFetchTest.kt |
gap | enrichment |
symbol-context provider |
plugins/plugins-extended/enrichment/symbol-context-enrichment/src/commonTest/kotlin/io/karandash/enrichment/symbol/SymbolContextEnrichmentProviderTest.kt, plugins/plugins-extended/enrichment/symbol-context-enrichment/src/commonTest/kotlin/io/karandash/enrichment/symbol/SymbolContextEnrichmentBehaviourTest.kt |
gap | enrichment |
LocalGitEnrichmentContextEnricher (local git as AI context) |
plugins/plugins-extended/enrichment/local-git-enrichment/src/commonTest/kotlin/io/karandash/enrichment/localgit/LocalGitEnrichmentContextEnricherTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/AiPromptAssemblerLocalGitTest.kt |
enrich-localgit-with, enrich-localgit-without |
enrichment |
Local-git enrichment hotspots and contributors |
plugins/plugins-extended/enrichment/local-git-enrichment/src/commonTest/kotlin/io/karandash/enrichment/localgit/LocalGitEnrichmentProviderTest.kt, plugins/plugins-extended/enrichment/local-git-enrichment/src/commonTest/kotlin/io/karandash/enrichment/localgit/LocalGitRepositoryTest.kt |
enrich-localgit-hotspot-kept, enrich-localgit-contributors |
enrichment |
rule-enrichment: bindings (rule:provider) |
cli/src/commonTest/kotlin/io/karandash/cli/pipeline/ModuleInitializerEnrichmentTest.kt |
gap | enrichment |
enrichment.* keys |
cli/src/commonTest/kotlin/io/karandash/cli/pipeline/EnrichmentStageTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/EnrichmentProviderConfigKeyTest.kt |
gap | enrichment |
| Enrichment globs | core/glob/src/commonTest/kotlin/io/karandash/utils/EnrichmentGlobMatcherTest.kt |
gap | enrichment |
| Enrichment DAG and required enrichment | core/validation/src/commonTest/kotlin/io/karandash/enrichment/EnrichmentEngineTest.kt, core/validation/src/commonTest/kotlin/io/karandash/engine/ValidationEngineRequiredEnrichmentTest.kt |
gap | |
--enrich and --dry-run-enrich |
cli/src/commonTest/kotlin/io/karandash/cli/CliFlagTableTest.kt |
gap | gap |
Top-level enrichmentProviders: |
cli/src/commonTest/kotlin/io/karandash/cli/pipeline/EnrichmentStageTest.kt |
gap | enrichment |
| AI context enrichers (convention, full-file, related-file, ticket, design-doc, CI, symbol, diff-annotations, symbol-definitions) | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/context/KnowledgeContextEnrichersTest.kt, plugins/integration-tests/rules/src/commonTest/kotlin/io/karandash/integration/rules/ai/AiContextQualityPipelineIntegrationTest.kt |
gap | knowledge-context |
Commands
| Feature | Behavior test | E2E | Doc |
|---|---|---|---|
--version, --help |
cli/src/jvmTest/kotlin/io/karandash/cli/compat/CliHelpTreeTest.kt |
cli-version, cli-help |
CLI reference |
doctor |
cli/src/commonTest/kotlin/io/karandash/cli/commands/DoctorCommandTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/commands/DoctorAuthCheckTest.kt |
live-doctor, cmd-doctor-noconfig |
doctor |
explain |
cli/src/commonTest/kotlin/io/karandash/cli/commands/ExplainCommandTest.kt |
cmd-explain |
explain |
stats |
cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/stats/StatsCommandDirTest.kt |
cmd-stats, cmd-stats-empty |
stats |
calibrate |
cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/calibrate/CalibrateCommandEvtConfigTest.kt |
cmd-calibrate |
calibrate |
test-rule (snapshot and live MR) |
cli/src/commonTest/kotlin/io/karandash/cli/commands/ConfiguredRuleCommandsTest.kt |
cmd-test-rule, live-test-rule |
test-rule |
mutate |
plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/architecture/RuleMutationTesterTest.kt |
cmd-mutate |
mutate |
simulate |
cli/src/commonTest/kotlin/io/karandash/cli/commands/simulate/SimulateCommandTest.kt |
live-simulate |
simulate |
deps |
cli/src/commonTest/kotlin/io/karandash/cli/commands/DepsCommandTest.kt |
live-deps |
deps |
mr merge |
cli/src/commonTest/kotlin/io/karandash/cli/commands/ConfiguredRuleCommandsTest.kt |
live-mr-merge, live-mr-merge-put |
mr |
report summary |
cli/src/commonTest/kotlin/io/karandash/cli/commands/report/ReportSummaryCommandTest.kt |
report-summary |
report |
wizard |
cli/src/commonTest/kotlin/io/karandash/cli/wizard/NativeSetupWizardTest.kt |
wizard-generate, wizard-config-file (answers piped on stdin) |
wizard |
format render --template/--partial/--escape |
cli/src/commonTest/kotlin/io/karandash/cli/commands/format/FormatCommandTest.kt |
gap | format |
plugin verify, plugin update, plugin search |
cli/src/commonTest/kotlin/io/karandash/cli/plugin/PluginSearchCommandTest.kt, cli/src/jvmTest/kotlin/io/karandash/cli/commands/PluginLifecycleCommandsTest.kt |
cmd-plugin-verify, registry-update |
plugin |
Plugin-contributed ai fix, ai reply, ai describe (flags parsed raw) |
cli/src/commonTest/kotlin/io/karandash/cli/plugin/PluginCommandBridgeTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/compat/DocsCommandLinesTest.kt |
ai-cmd-fix, ai-cmd-fix-call |
ai |
stats --audit, --diagnostics, --llm-judge |
cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/stats/StatsAuditCommandTest.kt (audit writes the report to out and prints the table, llm judge asks the configured provider about unknown replies), cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/stats/StatsCommandModesTest.kt, cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/stats/digest/DiagnosticDigestTest.kt |
gap | stats |
stats --corpus, --bot, --seed, --cutoff, --limit, --holdout-project |
cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/stats/StatsAuditCommandTest.kt (--corpus --bot --seed --cutoff --out), cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/stats/StatsCommandTableTest.kt (--limit), cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/stats/audit/AuditSplitsTest.kt (holdout project) |
gap | stats |
stats --json, --rule, --stats-dir, --clear |
cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/stats/StatsCommandDirTest.kt |
cmd-stats-empty |
stats |
calibrate --learn, --target-fp-rate, --min-samples, --window |
cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/calibrate/CalibrateCommandEvtConfigTest.kt, cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/HistoryFlagsTest.kt (--window) |
gap | calibrate |
calibrate --bot and --corpus |
cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/calibrate/CalibrateCorpusCommandTest.kt |
gap | calibrate |
explain --ai, --format text|markdown|json|doc, --output |
cli/src/commonTest/kotlin/io/karandash/cli/commands/ExplainCommandTest.kt, cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/explain/ExplainCommandTest.kt, cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/explain/DocExplainRendererTest.kt, cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/explain/DocAiEnhancerTest.kt |
cmd-explain |
explain |
doctor --offline and --plugins |
cli/src/commonTest/kotlin/io/karandash/cli/commands/DoctorCommandTest.kt |
cmd-doctor-noconfig |
doctor |
doctor checks (auth, config, patterns, platform auth, plugins, policies) |
cli/src/commonTest/kotlin/io/karandash/cli/commands/DoctorAuthCheckTest.kt |
live-doctor |
doctor |
validate --once, --target, --profile, --style |
cli/src/commonTest/kotlin/io/karandash/cli/commands/validate/ValidateLocalAndOnceTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/CliFlagTableTest.kt |
gap | validate |
validate --no-color (and NO_COLOR, TERM=dumb) |
gap | gap | validate |
validate --trace, --show-prompt, --dump-dir, --diagnostic |
cli/src/commonTest/kotlin/io/karandash/cli/CliFlagTableTest.kt |
gap | validate |
validate --dry-run-comment, --format, --output, --allow-localhost, --dangerfile |
cli/src/commonTest/kotlin/io/karandash/cli/CliFlagTableTest.kt |
rep-output-file |
validate |
cache gc --remote, --backend-type, --backend-url, --cache-dir |
cli/src/commonTest/kotlin/io/karandash/cli/commands/cache/CacheCommandFailureExitTest.kt |
cmd-cache-gc |
cache |
Global flags (-V, -v/--verbose/--debug, -q/--quiet) |
cli/src/jvmTest/kotlin/io/karandash/cli/compat/CliHelpTreeTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/CliLogLevelTest.kt (log level flags) |
cli-version |
cli-reference |
NO_COLOR, KARANDASH_LOG_LEVEL, KARANDASH_STRICT |
cli/src/commonTest/kotlin/io/karandash/cli/CliLogLevelTest.kt, core/interpolation/src/commonTest/kotlin/io/karandash/interpolation/KarandashEnvSecurityTest.kt |
gap | environment-variables |
| Exit codes 0 to 7 | cli/src/commonTest/kotlin/io/karandash/cli/commands/validate/ExitCodeMappingTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/CliContractTest.kt, cli/src/jvmTest/kotlin/io/karandash/cli/GlobalTimeoutExitCodeTest.kt, cli/src/jvmTest/kotlin/io/karandash/cli/compat/ErrorCodeRaiseSitesTest.kt |
policy-strict |
error-codes |
| Error catalog and the internal-error last-resort handler | cli/src/jvmTest/kotlin/io/karandash/cli/compat/CompatErrorMessagesTest.kt, core/api/src/commonTest/kotlin/io/karandash/api/errors/KarandashErrorTest.kt |
gap | error-codes |
Distribution entry point (cli-app main) |
cli-app/src/test/kotlin/io/karandash/cliapp/MainSmokeTest.kt |
cli-version |
README |
Native to JVM bridge entry (KARANDASH_BRIDGE_JAR) |
plugins/loader/jar-bridge/src/test/kotlin/io/karandash/loader/jar/BridgeMainSmokeTest.kt |
gap | JVM_VS_NATIVE_FEATURES |
| Distributions (native binary, jpackage, native image, JVM jar) | cli-app/src/test/kotlin/io/karandash/cliapp/MainSmokeTest.kt |
cli-version |
choosing |
Installers (tools/jlink-config scripts) |
gap | release scripts | jpackage |
Observability and diagnostics
| Feature | Behavior test | E2E | Doc |
|---|---|---|---|
| Logger and secret redaction in logs | core/logger/src/commonTest/kotlin/io/karandash/logger/LoggerDefaultsTest.kt, core/http/src/commonTest/kotlin/io/karandash/http/HttpSecretsInMessagesTest.kt |
gap | observability |
| HTTP logging and diagnostics plugins | core/http/src/commonTest/kotlin/io/karandash/http/HttpLoggingPluginTest.kt, core/http/src/commonTest/kotlin/io/karandash/http/HttpDiagnosticAndAuthTest.kt, core/http/src/commonTest/kotlin/io/karandash/http/RunScopedDiagnosticListenerTest.kt |
gap | observability |
| HTTP client ledger | core/http/src/commonTest/kotlin/io/karandash/http/HttpClientLedgerTest.kt |
gap | gap |
| Diagnostic collector and report | core/diagnostics/src/commonTest/kotlin/io/karandash/diagnostics/DiagnosticCollectorSummaryTest.kt, core/diagnostics/src/commonTest/kotlin/io/karandash/diagnostics/DiagnosticCollectorBoundsTest.kt, core/diagnostics/src/commonTest/kotlin/io/karandash/diagnostics/DiagnosticReportSerializationTest.kt |
gap | observability |
| Diagnostic outcomes bridge | cli/src/commonTest/kotlin/io/karandash/cli/pipeline/DiagnosticOutcomesTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/PipelineDiagnosticBridgeTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/DiagnosticsKeyBehaviourTest.kt |
gap | observability |
Run dump (--dump-dir: prompt, budget, dispatch) |
core/api/src/commonTest/kotlin/io/karandash/api/run/RunDumpTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/DumpDirWriterTest.kt |
gap | AI_FEATURES_REFERENCE, observability |
KARANDASH_AI_TRACE |
core/ai-pipeline/src/commonTest/kotlin/io/karandash/ai/pipeline/AiTraceTest.kt |
gap | observability |
KARANDASH_AI_DRY_RUN |
plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiRuleModuleEnvVarsTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/init/AiRuleInitializerEnvTest.kt |
gap | observability |
| Crash handler (JVM and native) | core/crash-handler/src/jvmTest/kotlin/io/karandash/crashhandler/CrashHandlerJvmTest.kt, core/crash-handler/src/nativeTest/kotlin/io/karandash/crashhandler/CrashReportTest.kt, core/crash-handler/src/posixTest/kotlin/io/karandash/crashhandler/CrashHandlerSignalTest.kt |
gap | observability |
| Timing and validation metrics in reports | core/api/src/commonTest/kotlin/io/karandash/api/ReportMetricsSerializationTest.kt, core/api/src/commonTest/kotlin/io/karandash/api/ApiWireContractTest.kt, core/validation/src/commonTest/kotlin/io/karandash/engine/ReportDataBuilderTest.kt, core/api/src/commonTest/kotlin/io/karandash/api/ApiValueTypesTest.kt |
gap | observability |
| AI cost log, status line and usage meter | plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiRuleCostLoggerTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiStatusLineTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/UsageMeterTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/CostDeltaSplitTest.kt |
gap | observability |
Reporters and outputs
| Feature | Behavior test | E2E | Doc |
|---|---|---|---|
| Console | plugins/plugins-core/formats/console-format/src/commonTest/kotlin/io/karandash/plugins/formats/ConsoleFormatModuleContractTest.kt |
rep-console |
Console |
| JSON | cli/src/commonTest/kotlin/io/karandash/cli/commands/report/ReportSummaryCommandTest.kt |
rep-json, rep-output-file, rep-output-file-content |
JSON |
| SARIF | plugins/plugins-extended/formats/sarif-format/src/commonTest/kotlin/io/karandash/plugins/formats/SarifFormatModuleContractTest.kt |
rep-sarif |
SARIF |
| reviewdog (rdjson, rdjsonl) | plugins/plugins-extended/formats/rdjson-format/src/commonTest/kotlin/io/karandash/plugins/formats/RdjsonFormatModuleContractTest.kt, plugins/plugins-extended/formats/rdjsonl-format/src/commonTest/kotlin/io/karandash/plugins/formats/RdjsonlFormatModuleContractTest.kt |
rep-rdjson, rep-rdjsonl |
reviewdog |
| Markdown | plugins/plugins-core/formats/markdown-format/src/commonTest/kotlin/io/karandash/plugins/formats/MarkdownFormatModuleContractTest.kt |
rep-markdown |
Markdown |
| JUnit XML | plugins/plugins-extended/formats/junit-format/src/commonTest/kotlin/io/karandash/plugins/formats/JunitFormatModuleContractTest.kt |
out-junit-html, out-junit-file, out-junit-failure (reporters: junit: output:) |
JUnit |
| HTML | plugins/plugins-extended/formats/html-format/src/commonTest/kotlin/io/karandash/plugins/formats/HtmlFormatModuleContractTest.kt |
out-junit-html, out-html-file, out-html-finding |
HTML |
| Slack | plugins/plugins-extended/outputs/slack-output/src/commonTest/kotlin/io/karandash/plugins/outputs/SlackOutputDeliveryTest.kt, plugins/plugins-extended/outputs/slack-output/src/commonTest/kotlin/io/karandash/plugins/outputs/SlackOutputLocalhostTest.kt |
out-slack, out-slack-post, out-slack-body (Block Kit on the mock), out-slack-guard, out-slack-no-post |
Slack |
| Webhook | plugins/plugins-extended/outputs/webhook-output/src/commonTest/kotlin/io/karandash/plugins/outputs/WebhookOutputStatusTest.kt, plugins/plugins-extended/outputs/webhook-output/src/commonTest/kotlin/io/karandash/plugins/outputs/WebhookOutputLocalhostTest.kt |
out-webhook, out-webhook-post, out-webhook-auth, out-webhook-body, out-webhook-body-rule, out-webhook-body-failed, out-webhook-noauth, out-webhook-ssrf, out-webhook-ssrf-blocked |
Webhook |
plugins/plugins-extended/outputs/email-output/src/jvmTest/kotlin/io/karandash/plugins/outputs/EmailDeliveryTest.kt, plugins/plugins-extended/outputs/email-output/src/commonTest/kotlin/io/karandash/plugins/outputs/EmailPlaintextPolicyTest.kt |
out-email (a loopback relay, mock-server/smtp_sink.py, logs envelope and message), out-email-tls-required, out-email-plaintext-remote |
||
codequality format |
plugins/plugins-extended/formats/codequality-format/src/commonTest/kotlin/io/karandash/plugins/formats/CodeQualityFormatModuleTest.kt |
gap | codequality |
slack-format (and compact) |
plugins/plugins-extended/formats/slack-format/src/commonTest/kotlin/io/karandash/plugins/formats/SlackFormatModuleContractTest.kt, plugins/plugins-extended/formats/slack-format/src/commonTest/kotlin/io/karandash/plugins/formats/SlackFormatReportTest.kt |
gap | slack |
template-format (escapes html, markdown, slack, json, none) |
plugins/plugins-extended/formats/template-format/src/commonTest/kotlin/io/karandash/plugins/formats/TemplateFormatModuleContractTest.kt |
gap | template |
json-format |
plugins/plugins-core/parsers/json/src/commonTest/kotlin/io/karandash/plugins/parsers/json/JsonFormatModuleLoaderTest.kt, plugins/builtin/src/commonTest/kotlin/io/karandash/builtin/BuiltInModuleRegistryTest.kt |
rep-json |
json |
filesystem output |
plugins/plugins-core/outputs/filesystem/src/commonTest/kotlin/io/karandash/plugins/outputs/FilesystemOutputModuleContractTest.kt, plugins/plugins-core/outputs/filesystem/src/commonTest/kotlin/io/karandash/plugins/outputs/FilesystemKeyBehaviourTest.kt |
rep-output-file-content |
index |
stdout output |
plugins/plugins-core/outputs/stdout/src/commonTest/kotlin/io/karandash/plugins/outputs/StdoutOutputModuleContractTest.kt, plugins/plugins-core/outputs/stdout/src/jvmTest/kotlin/io/karandash/plugins/outputs/StdoutOutputModuleOutputTest.kt |
rep-console |
index |
reporters.<format>.hideFields |
cli/src/jvmTest/kotlin/io/karandash/cli/pipeline/FormatFieldCoverageTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/commands/validate/FormatOutputPlannerWiringTest.kt |
gap | gap |
reporters: entries as format config carriers |
cli/src/commonTest/kotlin/io/karandash/cli/commands/validate/FormatOutputPlannerWiringTest.kt, cli/src/jvmTest/kotlin/io/karandash/cli/pipeline/FormatFieldCoverageTest.kt |
gap | index |
| Output on-error policy | gap | gap | gap |
| Notification state and gate (dedupe) | plugins/helpers/src/commonTest/kotlin/io/karandash/helpers/output/NotificationStateTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/pipeline/NotificationGateTest.kt |
gap | gap |
Slack notificationTarget |
cli/src/commonTest/kotlin/io/karandash/cli/pipeline/NotificationGateTest.kt, plugins/plugins-extended/outputs/slack-output/src/commonTest/kotlin/io/karandash/plugins/outputs/SlackBotTokenTest.kt |
gap | slack |
Commit status output (status-output) |
plugins/integration-tests/providers/src/commonTest/kotlin/io/karandash/providers/ResultStatusPublisherTest.kt |
gap | status |
| Reviewdog diagnostic mapping | plugins/helpers/src/commonTest/kotlin/io/karandash/helpers/reporter/ReviewdogDiagnosticTest.kt |
rep-rdjson |
reviewdog |
Platform comments
| Feature | Behavior test | E2E | Doc |
|---|---|---|---|
| Platform comment | plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputModuleContractTest.kt |
live-comment |
GitLab |
Comment mode all |
plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputModuleContractTest.kt, plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputModuleCacheTest.kt |
gap | markdown |
Comment mode summary |
plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/SummaryRowsTest.kt, plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputModuleCacheTest.kt |
gap | markdown |
Comment mode inline |
plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputModuleCacheTest.kt |
gap | markdown |
Comment mode none |
plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputModuleCacheTest.kt |
gap | markdown |
Summary comment edit in place versus reply, UpdatedStamp |
plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputModuleCacheTest.kt, plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/SummaryRowsTest.kt |
gap | gap |
| Inline comments: batch versus each | plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputModuleContractTest.kt, plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputModuleCacheTest.kt |
gap | gap |
| Reconcile: resolve and outdated threads | plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/InlineReconcilerTest.kt, plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputReconcileTest.kt |
gap | gap |
| Reconcile: superseded inline comments | plugins/helpers/src/commonTest/kotlin/io/karandash/providers/common/SupersededInlineCommentTest.kt |
gap | gap |
| Reconcile: lifecycle text | plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputReconcileTest.kt |
gap | gap |
| Inline thread matching and markers | core/api/src/commonTest/kotlin/io/karandash/api/finding/InlineThreadMatcherTest.kt, core/api/src/commonTest/kotlin/io/karandash/api/finding/InlineFindingMarkerTest.kt, core/api/src/commonTest/kotlin/io/karandash/api/finding/InlineFindingThreadTest.kt |
gap | gap |
markdown flag, when: and onError on the platform output |
plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputModuleContractTest.kt, plugins/plugins-core/outputs/platform-output/src/commonTest/kotlin/io/karandash/plugins/outputs/PlatformOutputReconcileTest.kt, cli/src/jvmTest/kotlin/io/karandash/cli/pipeline/OutputDestinationContractTest.kt |
gap | markdown |
| GitHub review threads (GraphQL, 100 cap) | plugins/plugins-core/platforms/github/src/commonTest/kotlin/io/karandash/platforms/github/GitHubReviewThreadsTest.kt |
gap | github |
Review threads and AI thread answers (ai.threadCommands) |
plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/ThreadAnswerStageTest.kt, core/api/src/commonTest/kotlin/io/karandash/api/ReviewThreadApiTest.kt |
gap | gap |
Presentation, templating and i18n
| Feature | Behavior test | E2E | Doc |
|---|---|---|---|
report: language and style |
plugins/plugins-core/formats/markdown-format/src/commonTest/kotlin/io/karandash/plugins/formats/MarkdownReportLanguageTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/commands/validate/ReportDisplayKeyBehaviourTest.kt, core/config/src/commonTest/kotlin/io/karandash/config/ConfigBoundsAndLookupTest.kt |
gap | gap |
report walkthrough and transparency (summary collapsed, inlineWhy, flowDiagram) |
plugins/plugins-core/formats/markdown-format/src/commonTest/kotlin/io/karandash/plugins/formats/MarkdownFlowDiagramTest.kt, plugins/plugins-core/formats/markdown-format/src/commonTest/kotlin/io/karandash/plugins/formats/MarkdownGoldenTest.kt |
gap | gap |
| Severity presentation (emoji, tag, ANSI) | core/models/src/commonTest/kotlin/io/karandash/models/finding/SeverityFormatTest.kt, core/models/src/commonTest/kotlin/io/karandash/models/finding/SeverityAndTemplateGapsTest.kt |
gap | gap |
Success and failure marks, ReportStyle (quiet, standard, verbose) |
core/models/src/commonTest/kotlin/io/karandash/models/report/ReportModelsTest.kt, plugins/helpers/src/commonTest/kotlin/io/karandash/helpers/reporter/ReportViewBuilderTest.kt |
gap | gap |
ReportView template data |
plugins/helpers/src/commonTest/kotlin/io/karandash/helpers/reporter/ReportSupportTest.kt, plugins/helpers/src/commonTest/kotlin/io/karandash/helpers/reporter/ReportViewBuilderTest.kt |
gap | gap |
| Mustache engine (vars, sections, partials, lambdas, size cap) | core/models/src/commonTest/kotlin/io/karandash/models/template/MustacheTest.kt |
gap | template |
| Email templates | gap | gap | |
format render through Mustache |
cli/src/commonTest/kotlin/io/karandash/cli/commands/format/FormatCommandTest.kt |
gap | format |
templateApi versioning and TemplateParityTest |
gap | gap | gap |
Report language versus ai.responseLanguage precedence |
core/config-pipeline/src/commonTest/kotlin/io/karandash/config/pipeline/ConfigMapParserReportLanguageTest.kt |
gap | gap |
| i18n: English built in, packs by base tag | core/models/src/commonTest/kotlin/io/karandash/models/finding/TranslationsTest.kt, core/models/src/commonTest/kotlin/io/karandash/models/finding/LocalizedTextTest.kt |
gap | gap |
| Polish translation module | plugins/plugins-extended/translations/polish/src/commonTest/kotlin/io/karandash/translations/polish/PolishTranslationModuleContractTest.kt, plugins/integration-tests/rules/src/jvmTest/kotlin/io/karandash/integration/rules/TranslationPackCoverageTest.kt |
gap | gap |
| Russian translation module | plugins/plugins-extended/translations/russian/src/commonTest/kotlin/io/karandash/translations/russian/RussianTranslationModuleContractTest.kt, plugins/plugins-extended/translations/russian/src/commonTest/kotlin/io/karandash/translations/russian/FormerBuiltInRussianTest.kt, plugins/integration-tests/rules/src/jvmTest/kotlin/io/karandash/integration/rules/TranslationPackCoverageTest.kt |
gap | Language packs |
TranslationModule and base-language fallback |
core/models/src/commonTest/kotlin/io/karandash/models/finding/TranslationsTest.kt |
gap | gap |
| AI output language overlays | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/LanguagePromptOverlaysTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/AiPromptAssemblerOutputLanguageTest.kt |
gap | ai-rules |
Caches
| Feature | Behavior test | E2E | Doc |
|---|---|---|---|
Local cache and CAS (cache stats/clear/gc/remote-stats) |
core/cache/src/commonTest/kotlin/io/karandash/cache/CacheManagerTest.kt, core/cache/src/commonTest/kotlin/io/karandash/cache/cas/CasCacheTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/commands/cache/CacheCommandFailureExitTest.kt (cache gc removes an unreferenced blob) |
cmd-cache-stats, cmd-cache-clear, cmd-cache-gc, cmd-cache-remote-stats |
cache |
Remote cache (HTTP, S3, GCS; cache push) |
core/cache/src/commonTest/kotlin/io/karandash/cache/remote/RemoteCacheLayerTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/cache/RemoteCacheWiringTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/commands/cache/CachePushRemoteConfigTest.kt (GCS: PUTs under the bucket prefix with the config auth, on a MockEngine), cli/src/jvmTest/kotlin/io/karandash/cli/commands/cache/CachePushAllowLocalhostTest.kt |
cache-remote-push, cache-remote-body (blobs PUT to their hash paths; the mock rejects a wrong hash), cache-remote-stored (a second push finds both blobs by HEAD and skips them), cache-remote-refused (a backend answering 400 counts every blob as failed, exit 6), cache-remote-ssrf, cache-remote-ssrf-blocked, cache-remote-s3-push, cache-remote-s3-put, cache-remote-s3-hit, cache-remote-s3-head (S3 path-style mock: a second push finds both blobs by HEAD and skips them), cache-remote-s3-unsigned (a signed-* bucket refuses anonymous PUTs, exit 6), cache-remote-s3-signed, cache-remote-s3-signed-hit (backend, URL and SigV4 credentials from cache.remote in --config; the mock verifies each signature); SigV4 known vector in core/crypto/src/commonTest/kotlin/io/karandash/crypto/AwsSigV4SignerTest.kt |
cache |
In-memory and file cache tiers (TieredCache: memory LRU over the on-disk CAS) |
core/cache/src/commonTest/kotlin/io/karandash/cache/TieredCacheTest.kt |
ai-cache-miss, ai-cache-hit (the second run is served from the file tier) |
cache |
cache.downloads |
plugins/loader/src/commonTest/kotlin/io/karandash/loader/DownloadCacheTest.kt |
gap | configuration-schema |
cache.memory |
core/cache/src/commonTest/kotlin/io/karandash/utils/BoundedCacheTest.kt, core/cache/src/commonTest/kotlin/io/karandash/cache/CacheConfigTest.kt |
gap | configuration-schema |
cache.state |
core/state/src/commonTest/kotlin/io/karandash/cache/cas/CasStateStoreTest.kt |
gap | configuration-schema |
cache.responses (provider response cache) |
core/http/src/commonTest/kotlin/io/karandash/http/ProviderResponseCacheTest.kt, core/http/src/commonTest/kotlin/io/karandash/http/ResponseCacheDiskTierTest.kt |
gap | configuration-schema |
| Remote cache auth and S3 ambient credentials | core/cache/src/commonTest/kotlin/io/karandash/cache/remote/S3AmbientCredentialsTest.kt |
cache-remote-s3-signed |
cache |
gcs backend (the http backend with cache.remote.auth; no ambient Google credentials, GOOGLE_APPLICATION_CREDENTIALS is denylisted) |
cli/src/commonTest/kotlin/io/karandash/cli/commands/cache/CachePushRemoteConfigTest.kt |
gap | cache |
| Cache garbage collector and index store | core/cache/src/commonTest/kotlin/io/karandash/cache/cas/CacheGarbageCollectorTest.kt, core/cache/src/commonTest/kotlin/io/karandash/cache/cas/CacheIndexStoreTest.kt |
cmd-cache-gc |
cache |
| Conditional fetch cache | core/cache/src/commonTest/kotlin/io/karandash/cache/cas/ConditionalFetchCacheTest.kt |
gap | gap |
Plugins
| Feature | Behavior test | E2E | Doc |
|---|---|---|---|
plugin create / generate scaffolds (every --type) |
cli/src/commonTest/kotlin/io/karandash/cli/plugin/PluginTemplateGeneratorTest.kt |
plugin-create-test.sh |
Creating plugins |
| Install, list, remove, re-install | cli/src/jvmTest/kotlin/io/karandash/cli/commands/PluginLifecycleCommandsTest.kt |
plugin-lifecycle-test.sh, cmd-plugin-list |
plugin |
plugin info (--source, --dependencies), uninstall, rebuild, registry show/set |
cli/src/jvmTest/kotlin/io/karandash/cli/commands/PluginLifecycleCommandsTest.kt |
registry-show, registry-info, registry-info-deps, registry-rebuild, registry-uninstall, registry-info-missing, registry-set, registry-set-manifest |
plugin |
| JVM plugins (JAR) | plugins/loader/src/jvmTest/kotlin/io/karandash/loader/jar/JarPluginLoaderLifecycleTest.kt, plugins/loader/src/nativeTest/kotlin/io/karandash/loader/jar/JarPluginLoaderNativeLifecycleTest.kt |
plugin-run-jar (the JVM loader on the JVM binary, the JAR bridge on the native one), plugin-examples-test.sh, plugin-lifecycle-test.sh |
Creating plugins |
| JS plugins (QuickJS) | plugins/loader/src/commonTest/kotlin/io/karandash/loader/js/JsPluginLoaderLifecycleTest.kt |
plugin-run-js, multi-language-plugin-test.sh |
JS plugins |
| WASM plugins (C, Rust) | plugins/loader/src/commonTest/kotlin/io/karandash/loader/wasm/WasmModuleBridgeTest.kt |
plugin-run-wasm (the C example), multi-language-plugin-test.sh |
WASM plugins |
| Native plugins (C, C++, Go, Rust, Python, Kotlin/Native) | plugins/loader/src/nativeTest/kotlin/io/karandash/loader/native/NativePluginLoaderLifecycleTest.kt, plugins/loader/src/commonTest/kotlin/io/karandash/loader/native/NativePluginLoaderDirectoryTest.kt |
plugin-run-native (the C example), native-plugin-test.sh, plugin-examples-test.sh |
Native plugins |
Registry install, update, --pin |
cli/src/commonTest/kotlin/io/karandash/cli/plugin/RegistryClientTest.kt, plugins/registry/src/commonTest/kotlin/io/karandash/registry/PluginInstallChecksumTest.kt |
registry-no-token, registry-install, registry-index-fetch, registry-download, registry-pin-manifest, registry-list, registry-bad-checksum, registry-update-check, registry-update, registry-update-download, registry-updated-artifact (HTTPS registry on the mock through tls_proxy.py) |
plugin |
Registry search, offline fallback to the stale cache |
cli/src/commonTest/kotlin/io/karandash/cli/plugin/PluginSearchCommandTest.kt |
registry-search-offline (an unreachable registry URL whose cache entry is the v1 index fetched earlier) |
plugin |
| Plugin signing and verification | cli/src/jvmTest/kotlin/io/karandash/cli/commands/SignCommandRoundTripTest.kt, plugins/loader/src/commonTest/kotlin/io/karandash/loader/SignatureVerifierTest.kt |
cmd-plugin-sign, cmd-plugin-sign-file, cmd-plugin-verify (needs openssl: in the toolchain image, so it runs on CI) |
sign |
plugin load (check a file without installing), plugin cache clear |
cli/src/jvmTest/kotlin/io/karandash/cli/commands/PluginLifecycleCommandsTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/commands/PluginCommandTest.kt |
cmd-plugin-load-invalid, cmd-plugin-cache-clear |
plugin |
Plugin discovery (--plugin-dir, KARANDASH_PLUGIN_DIR) |
plugins/loader/src/commonTest/kotlin/io/karandash/loader/PluginDiscoveryTest.kt |
gap | plugin |
--allow-unsigned, --probe, --no-git |
cli/src/jvmTest/kotlin/io/karandash/cli/commands/PluginLifecycleCommandsTest.kt |
gap | plugin |
--package, --registry, --pin |
cli/src/commonTest/kotlin/io/karandash/cli/plugin/RegistryClientTest.kt, plugins/registry/src/commonTest/kotlin/io/karandash/registry/RegistryClientTest.kt, plugins/registry/src/commonTest/kotlin/io/karandash/registry/PluginInstallChecksumTest.kt |
registry-pin-manifest |
plugin |
| Plugin API compatibility check | plugins/loader/src/commonTest/kotlin/io/karandash/loader/ApiCompatibilityTest.kt |
gap | gap |
| Plugin cache | plugins/loader/src/commonTest/kotlin/io/karandash/loader/PluginCacheTest.kt |
cmd-plugin-cache-clear |
gap |
| Plugin inspector (list without loading) | plugins/inspector/src/jvmTest/kotlin/io/karandash/inspector/JvmPluginInspectorNoExecTest.kt, plugins/inspector/src/nativeTest/kotlin/io/karandash/inspector/NativePluginInspectorStaticTest.kt, plugins/inspector/src/commonTest/kotlin/io/karandash/inspector/InstalledPluginListerImplTest.kt |
gap | plugin |
| Artifact download per OS and architecture | core/download/src/commonTest/kotlin/io/karandash/download/ArtifactDownloaderTest.kt, plugins/loader/src/commonTest/kotlin/io/karandash/loader/PlatformArtifactResolverTest.kt, core/download/src/commonTest/kotlin/io/karandash/download/PlatformArtifactResolverTest.kt |
gap | gap |
| Plugin bootstrap: module selection, defaults and lifecycle | plugins/bootstrap/src/commonTest/kotlin/io/karandash/bootstrap/ModuleSelectionTest.kt, plugins/bootstrap/src/commonTest/kotlin/io/karandash/bootstrap/ModuleDefaultsAndInitTest.kt, plugins/bootstrap/src/commonTest/kotlin/io/karandash/bootstrap/BuiltInPluginLoaderLifecycleTest.kt |
gap | |
| Bootstrap plugin context env allowlist | plugins/bootstrap/src/commonTest/kotlin/io/karandash/bootstrap/BootstrapPluginContextEnvAllowlistTest.kt |
gap | gap |
| Module lifecycle manager | core/api/src/commonTest/kotlin/io/karandash/api/lifecycle/ModuleLifecycleManagerTest.kt |
gap | |
| SDK abstract module bases | plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/SdkModuleBasesTest.kt, plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/AbstractTypedSingleRuleModuleTest.kt |
gap | api-reference |
| SDK typed modules (rule, reporter, platform, provider, mutator) | plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/TypedRuleModuleTest.kt, plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/TypedReporterModuleTest.kt, plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/TypedPlatformServiceModuleTest.kt, plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/TypedProviderModuleTest.kt |
gap | api-reference |
SDK ConfigHover, MetaKey, RuleCacheHelper |
plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/typed/ConfigHoverTest.kt, plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/finding/MetaKeyTest.kt, plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/cache/RuleCacheHelperTest.kt |
gap | api-reference |
SDK EnrichmentConfigParser and BridgeHostSettings |
plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/enrichment/EnrichmentConfigParserTest.kt, plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/context/BridgeHostSettingsTest.kt |
gap | api-reference |
SDK ReinitializableClient |
plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/platform/ReinitializableClientTest.kt |
gap | api-reference |
| SDK serialization audit | plugins/sdk/src/commonTest/kotlin/io/karandash/sdk/SdkSerializationAuditTest.kt |
gap | gap |
plugins:builtin generated registry (builtin-modules.txt) |
plugins/builtin/src/commonTest/kotlin/io/karandash/builtin/BuiltInModuleRegistryTest.kt |
gap | gap |
Plugin publishing and templates (plugin create) |
cli/src/commonTest/kotlin/io/karandash/cli/plugin/PluginTemplateGeneratorTest.kt, plugins/registry/src/commonTest/kotlin/io/karandash/registry/PluginTemplateGeneratorTest.kt |
plugin-create-test.sh |
publishing-plugins |
Plugin bridges
| Feature | Behavior test | E2E | Doc |
|---|---|---|---|
| Native to JAR subprocess bridge | plugins/loader/src/nativeTest/kotlin/io/karandash/loader/jar/JarPluginLoaderNativeLifecycleTest.kt, plugins/loader/src/jvmTest/kotlin/io/karandash/loader/jar/JarBridgeServerTest.kt, plugins/loader/src/jvmTest/kotlin/io/karandash/loader/jar/JarBridgeSessionTest.kt |
gap | adding-bridge-types |
| Bridge ABI parity | plugins/loader/src/jvmTest/kotlin/io/karandash/loader/bridge/BridgeAbiParityTest.kt |
gap | adding-bridge-types |
| Bridge typed modules and host proxies | plugins/loader/src/commonTest/kotlin/io/karandash/loader/bridge/BridgeTypedPartTest.kt, plugins/loader/src/commonTest/kotlin/io/karandash/loader/bridge/BridgeHostProxiesTest.kt |
gap | adding-bridge-types |
| Guest content policy | plugins/loader/src/jvmTest/kotlin/io/karandash/loader/bridge/GuestContentPolicyTest.kt |
gap | gap |
| Host service dispatcher | plugins/loader/src/commonTest/kotlin/io/karandash/loader/bridge/host/HostServiceDispatcherTest.kt |
gap | gap |
C ABI host (CAbi*) |
plugins/helpers/src/nativeTest/kotlin/io/karandash/helpers/CAbiBridgeDispatcherTest.kt, plugins/helpers/src/nativeTest/kotlin/io/karandash/helpers/CAbiHostTest.kt |
gap | wasm-exports |
| Guest call timeouts and deadlines | plugins/loader/src/jvmTest/kotlin/io/karandash/loader/wasm/WasmPluginLoaderLifecycleJvmTest.kt |
plugin-run-js-timeout (a JS guest in an endless loop is interrupted after 2s on both binaries) |
gap |
| WASM watchdog and timed engine | plugins/loader/src/commonTest/kotlin/io/karandash/loader/wasm/WasmTimeoutWatchdogTest.kt, core/wasm/src/commonTest/kotlin/io/karandash/wasm/TimedWasmEngineTest.kt |
gap | gap |
| WASM host imports and memory protocol | core/wasm/src/commonTest/kotlin/io/karandash/wasm/WasmHostImportsTest.kt, core/wasm/src/commonTest/kotlin/io/karandash/wasm/WasmMemoryProtocolTest.kt, plugins/loader/src/commonTest/kotlin/io/karandash/loader/wasm/WasmMemoryProtocolTest.kt |
gap | wasm-exports |
| JS host calls and env secrets | plugins/loader/src/commonTest/kotlin/io/karandash/loader/js/JsHostCallTest.kt, plugins/loader/src/commonTest/kotlin/io/karandash/loader/js/JsEnvSecretsTest.kt |
gap | js-plugin-guide |
AI
Every AI feature below calls a model. The e2e runs them offline against the fake LLM endpoints of the mock server
(mock-server/mock_llm.py, under /llm/<provider>/v1): OpenAI-compatible chat completions (OpenAI, Gemini, Ollama,
LiteLLM, Bifrost) and Anthropic messages. The scenarios are in e2e.d/ai.sh, e2e.d/ai-prompts.sh and e2e.d/ai-wire.sh; they check
the finding the binary reports and, through the mock's request-body log, what reached the model. Every config key
in the AI features reference is read by the code.
| Feature | Behavior test | E2E | Doc |
|---|---|---|---|
ai command group (env-gated) |
cli/src/commonTest/kotlin/io/karandash/cli/compat/DocsCommandLinesTest.kt |
ai-gated, ai-fix-usage, ai-cmd-fix, ai-cmd-fix-call (Ollama via OLLAMA_HOST) |
ai |
| Providers: OpenAI, Anthropic, Gemini, Ollama, LiteLLM, Bifrost | plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/OpenAiProviderTest.kt and the sibling *ProviderTest.kt files |
ai-openai-findings, ai-anthropic-findings, ai-gemini-findings, ai-ollama-findings, ai-litellm-findings, ai-bifrost-findings, each with its ai-<provider>-call request check |
AI rules |
| Provider fallback chain | plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/FallbackAiProviderTest.kt |
ai-fallback, ai-fallback-primary-call, ai-fallback-secondary-call (the first model answers 500), ai-wire-model-fallback (the first model answers 404 model_not_found) |
AI rules |
| Consensus | plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/AiRuleDispatcherConsensusTest.kt |
ai-consensus, ai-consensus-second |
AI features |
| Custom prompts, prompt files and per-scope overrides | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiPluginConfigTest.kt, plugins/integration-tests/contracts/src/commonTest/kotlin/io/karandash/contracts/ai/AiPromptAssemblyContractTest.kt |
ai-prompt-overlays, ai-prompt-system-file, ai-prompt-extra, ai-prompt-scope, ai-prompt-scope-unmatched |
AI rules |
| AI response cache | plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/CachingAiProviderTest.kt |
ai-cache-miss, ai-cache-miss-call, ai-cache-hit (the second run makes no model call) |
AI features |
| Provider OpenAI | plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/OpenAiProviderTest.kt |
ai-openai-findings |
AI_FEATURES_REFERENCE |
| Provider Anthropic | plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/AnthropicProviderTest.kt |
ai-anthropic-findings |
AI_FEATURES_REFERENCE |
| Provider Gemini | plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/GeminiProviderTest.kt |
gap | AI_FEATURES_REFERENCE |
Provider Ollama (OLLAMA_HOST, host policy) |
plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/OllamaProviderTest.kt, plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/OllamaHostPolicyTest.kt |
ai-cmd-fix-call |
AI_FEATURES_REFERENCE |
Provider LiteLLM (LITELLM_*) |
plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/LiteLLMProviderTest.kt |
gap | AI_FEATURES_REFERENCE |
Provider Bifrost (BIFROST_*) |
plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/BifrostProviderTest.kt |
gap | AI_FEATURES_REFERENCE |
Stub provider (provider: stub) |
plugins/plugins-extended/ai/stub-provider/src/commonTest/kotlin/io/karandash/plugins/ai/stub/StubAiProviderTest.kt, plugins/integration-tests/providers/src/commonTest/kotlin/io/karandash/providers/ProviderContractTest.kt |
gap | gap |
| Custom provider registration and resolver | plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/AiProviderResolverTest.kt, plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/AiProviderResolverRegistryTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/CustomProviderIntegrationTest.kt |
gap | gap |
| Provider API key env vars and auth header | plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/ProviderAuthHeaderTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiRuleModuleEnvVarsTest.kt |
gap | environment-variables |
| Provider defaults and default models | plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/ProviderDefaultsTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiDefaultModelsTest.kt |
gap | gap |
| Provider error mapping | plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/ProviderErrorMappingTest.kt |
ai-wire-retry-after (429 with Retry-After, then an answer) |
gap |
| Provider lifecycle and reinitialization | plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/ProviderLifecycleTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiRuleModuleProviderReinitTest.kt |
gap | gap |
| Structured output and OpenAI strict schema | plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/StructuredOutputProviderTest.kt, plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/OpenAiStrictSchemaTest.kt |
gap | gap |
| Streaming provider | plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/StreamingProviderTest.kt |
gap | gap |
ai.streamStall |
plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/StallLimitTest.kt, plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/RunAiProviderSourceTest.kt |
ai-wire-stream-stall |
gap |
ai.streamDeadline |
plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/StreamLimitsConfigTest.kt, plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/RunAiProviderSourceTest.kt |
gap | gap |
| Slow response body timeout | plugins/plugins-ai/providers/src/jvmTest/kotlin/io/karandash/plugins/ai/providers/SlowBodyTimeoutTest.kt, plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/AiTimeoutConfigTest.kt |
gap | gap |
ai.promptCacheTtl |
plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/RunAiProviderSourceTest.kt |
gap | AI features |
ai.consensusStrategy |
plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/ConsensusStrategyTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/AiRuleDispatcherConsensusTest.kt |
gap | AI_FEATURES_REFERENCE |
| AI decision log | plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/AiDecisionLogTest.kt |
gap | gap |
| Usage metering and cost estimate | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiCostEstimatorTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiCostSummaryTest.kt |
gap | gap |
pricing: overrides |
plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiCostEstimatorTest.kt |
gap | gap |
| Remote prompt fetch | plugins/plugins-ai/prompts/src/commonTest/kotlin/io/karandash/plugins/ai/prompts/RemotePromptFetcherTest.kt |
gap | gap |
| Prompt template engine and resolver | plugins/plugins-ai/prompts/src/commonTest/kotlin/io/karandash/plugins/ai/prompts/PromptTemplateEngineTest.kt, plugins/plugins-ai/prompts/src/commonTest/kotlin/io/karandash/plugins/ai/prompts/PromptResolverTest.kt, plugins/plugins-ai/prompts/src/commonTest/kotlin/io/karandash/plugins/ai/prompts/PromptResolverSourcesTest.kt |
gap | gap |
| Analyzer prompts | plugins/plugins-ai/prompts/src/commonTest/kotlin/io/karandash/plugins/ai/prompts/AnalyzerPromptsTest.kt |
gap | gap |
ruleProviders per-rule provider routing |
plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiProviderKeyBehaviourTest.kt |
gap | gap |
reasoningEffort |
plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/RunAiProviderSourceTest.kt |
ai-wire-reasoning-custom, ai-wire-reasoning-gemini, ai-wire-reasoning-litellm, ai-wire-reasoning-bifrost (reasoning.effort in the request body) |
gap |
| Temperatures and sampling | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiTemperatureConfigTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiRuleTemperatureTest.kt |
gap | gap |
ai.reviewSampling |
plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/SampleAgreementTest.kt |
gap | gap |
AI stages and analyzers
| Feature | Behavior test | E2E | Doc |
|---|---|---|---|
Custom AI rules (customRules:) |
plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/AiRuleDispatcherCustomRuleTest.kt |
ai-custom-rule, ai-custom-rule-prompt |
AI features |
| Review modes and size policy (diff mode, partial review) | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/DiffModeTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/rules/AiSizePolicyTest.kt |
ai-size-policy, ai-partial-review, ai-partial-review-kept, ai-partial-review-dropped, ai-size-exclude, ai-added-only |
AI rules |
| Secret redaction before the model call | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/SecretRedactorTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiRuleModuleRedactedMrTest.kt |
ai-redaction, ai-redaction-secret (the secret never reaches the mock), ai-redaction-marker |
AI features |
| End-to-end AI review pipeline | plugins/integration-tests/contracts/src/commonTest/kotlin/io/karandash/contracts/ai/AiReviewEndToEndContractTest.kt |
ai-openai-findings and every other ai-*-findings scenario (fetch, redact, prompt, parse, report) |
AI features |
Analyzer change-categorization |
plugins/plugins-ai/analyzers/change-categorization/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/changecategorization/ChangeCategorizationAnalyzerModuleTest.kt |
gap | ai-rules |
Analyzer code-quality |
plugins/plugins-ai/analyzers/code-quality/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/codequality/CodeQualityAnalyzerModuleTest.kt |
gap | ai-rules |
Analyzer code-suggestions |
plugins/plugins-ai/analyzers/code-suggestions/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/codesuggestions/CodeSuggestionsAnalyzerModuleTest.kt |
ai-analyzers-review (ai-analyzers-suggestion) |
ai-rules |
Analyzer review-thread-analysis |
plugins/plugins-ai/analyzers/comment-analysis/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/commentanalysis/CommentAnalysisAnalyzerModuleTest.kt, plugins/plugins-ai/analyzers/comment-analysis/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/commentanalysis/ThreadSessions.kt |
gap | ai-rules |
Analyzer description-quality |
plugins/plugins-ai/analyzers/description-quality/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/descriptionquality/DescriptionQualityAnalyzerModuleTest.kt |
gap | ai-rules |
Analyzer design-doc-drift |
plugins/plugins-ai/analyzers/design-doc-drift/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/designdocdrift/DesignDocDriftAnalyzerModuleTest.kt, plugins/plugins-ai/analyzers/design-doc-drift/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/designdocdrift/DesignDocDriftGateTest.kt |
gap | ai-rules |
Analyzer fix-suggestions |
plugins/plugins-ai/analyzers/fix-suggestions/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/fixsuggestions/FixSuggestionsAnalyzerModuleTest.kt |
gap | ai-rules |
Analyzer generate-description |
plugins/plugins-ai/analyzers/generate-description/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/generatedescription/GenerateDescriptionAnalyzerModuleTest.kt |
gap | ai-rules |
Analyzer mr-summary |
plugins/plugins-ai/analyzers/mr-summary/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/mrsummary/MrSummaryAnalyzerModuleTest.kt, plugins/plugins-ai/analyzers/mr-summary/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/mrsummary/MrSummaryWalkthroughTest.kt |
gap | ai-rules |
Analyzer outdated-docs |
plugins/plugins-ai/analyzers/outdated-docs/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/outdateddocs/OutdatedDocsAnalyzerModuleTest.kt |
gap | ai-rules |
Analyzer ownership-analysis |
plugins/plugins-ai/analyzers/ownership-analysis/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/ownership/OwnershipAnalyzerModuleTest.kt |
gap | ai-rules |
Analyzer pr-split |
plugins/plugins-ai/analyzers/pr-split/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/prsplit/PrSplitAnalyzerModuleTest.kt |
gap | ai-rules |
Analyzer review-comments (cap, protected categories, categories) |
plugins/plugins-ai/analyzers/review-comments/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/reviewcomments/ReviewCommentsAnalyzerModuleTest.kt, plugins/plugins-ai/analyzers/review-comments/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/reviewcomments/ReviewCategoryTest.kt |
ai-openai-findings |
ai-rules |
Analyzer risk-scoring |
plugins/plugins-ai/analyzers/risk-scoring/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/riskscoring/RiskScoringAnalyzerModuleTest.kt |
ai-analyzers-review (ai-analyzers-risk) |
ai-rules |
Analyzer similar-issues |
plugins/plugins-ai/analyzers/similar-issues/src/commonTest/kotlin/io/karandash/plugins/ai/analyzers/similarissues/SimilarIssuesAnalyzerModuleTest.kt |
gap | ai-rules |
| JSON recovery of malformed model output | plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/JsonRecoveryWiringTest.kt |
gap | AI features |
| Line validation and anchors | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AnchorResolverTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/FindingLocationValidatorTest.kt, cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/stats/audit/AnchorCheckTest.kt |
gap | AI features, evidence anchoring |
| Suggestion ranges | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/SuggestionRangeTest.kt |
gap | gap |
Confidence filter and ai.ranking |
plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/pipeline/FindingCapTest.kt |
gap | AI features |
| Finding dedup (within rule and cross-rule) | plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/AiRuleDispatcherDedupTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/pipeline/AiSuggestionDedupeTest.kt |
gap | AI features |
| Grounding (local) and verifier | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/pipeline/LocalGroundingTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/pipeline/AiGroundingVerifierTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/AiRuleDispatcherHeadGroundingTest.kt |
gap | AI features |
Retries and error handlers (ai.maxRetries) |
plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/AiDecisionLogTest.kt, plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/AnthropicProviderTest.kt, plugins/plugins-ai/providers/src/commonTest/kotlin/io/karandash/plugins/ai/providers/FallbackAiProviderTest.kt |
gap | configuration-schema, AI features |
| Diff chunking and parallel chunks | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/DiffChunkerTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/DiffChunkerOverlapTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiChunkContextTest.kt |
gap | AI features |
| Hunk-aware truncation and expansion | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/HunkAwareTruncatorTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/HunkExpanderTest.kt |
gap | gap |
| Diff preprocessing and exclusions | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/DiffPreprocessorTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/AiMrPreprocessorExclusionTest.kt |
gap | gap |
| Token budget, reservation and tier planner | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/TokenBudgetTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/BudgetReservationTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/PromptTierPlannerTest.kt |
gap | AI_FEATURES_REFERENCE |
| Per-rule and per-chunk budgets and sample budget | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/TokenBudgetPerRuleTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/ChunkBudgetPlanTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/SampleBudgetTest.kt |
gap | gap |
| Auxiliary budget and budget-skip disclosure | plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiAuxiliaryBudgetTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiBudgetSkipDisclosureTest.kt |
gap | gap |
| Context budget | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/ContextBudgetTest.kt |
gap | gap |
| Trivial diff skip | plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiTrivialDiffSkipTest.kt |
gap | gap |
| Sensitive file filter | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/SensitiveFileFilterTest.kt |
gap | gap |
| Rule gate and rule sandbox | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/RuleGateTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/RuleSandboxTest.kt |
gap | AI features, rule sandbox |
| Review strictness | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/ReviewStrictnessTest.kt |
gap | gap |
| Pre-merge check mode | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/PreMergeCheckModeTest.kt |
gap | AI features |
| Context: cross-file and dependency | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/CrossFileContextBuilderTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/DependencyContextBuilderTest.kt |
gap | knowledge-context |
| Context: diff context and file priority | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/DiffContextBuilderTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/FilePriorityScorerTest.kt |
gap | knowledge-context |
Context quality diagnostics (projects/ai-context-quality) |
plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiContextQualityIntegrationTest.kt |
gap | knowledge-context |
| Context routing config | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiContextRoutingConfigTest.kt |
gap | knowledge-context |
| Language detection and prompt overlays | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/LanguageDetectorTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/LanguagePromptOverlaysTest.kt |
gap | gap |
| Prior findings prompt enrichment | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/PriorFindingsPromptEnricherTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiFixSuggestionsPriorFindingsTest.kt |
gap | gap |
Thread asker and replies (ai reply) |
plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/ThreadAskerTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/ReplyClassifierTest.kt |
gap | ai |
ai.feedbackSkipRepeatFindingTypes |
plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiFeedbackConfigTest.kt |
gap | gap |
ai.feedbackReplyJudge |
plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/LlmReplyJudgeTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiThreadFeedbackTest.kt |
gap | gap |
| Feedback store and thread feedback | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/FeedbackStoreTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/ThreadFeedbackTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiThreadFeedbackTest.kt |
gap | AI features |
| Correlation, contradictions and learnings | cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/calibrate/ReviewLearningsTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/ConsensusAnalyzerTest.kt |
gap | AI features, contradiction detection, review learnings |
| Process risk, triage risk and author history | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/ProcessRiskCalculatorTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/TriageRiskTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AuthorHistoryTest.kt |
gap | AI features |
| Model routing by risk | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/router/ModelRouterTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiResearchRoutingKeyBehaviourTest.kt |
gap | AI features |
| Temporal rule tracker and escalation | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/TemporalRuleTrackerTest.kt |
gap | AI features |
| Defect predictor | plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiPipelineExtensionDefectPredictorTest.kt |
gap | gap |
ai.pgoEnabled |
plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/performance/PgoProfileTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/pipeline/AiPipelineKeyBehaviourTest.kt |
gap | gap |
ai.testGap |
plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/LargeMrSummaryTest.kt |
gap | gap |
| Research metrics (entropy, cognitive load, clone, naturalness, PageRank) | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/metrics/ChangeEntropyCalculatorTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiPipelineIntegrationTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/metrics/CognitiveLoadEstimatorTest.kt |
gap | AI features |
| Semantic diff checker | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/architecture/SemanticDiffCheckerTest.kt |
gap | gap |
| ADR validator | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/architecture/AdrValidatorTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/architecture/AdrKeyBehaviourTest.kt |
gap | gap |
| Provenance chain and log | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/architecture/ProvenanceChainTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiRuleProvenanceTest.kt |
gap | gap |
| Cross-MR dependency analyzer | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/architecture/CrossMrDependencyAnalyzerTest.kt |
gap | gap |
Policy verifier (verify-policy) |
plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/architecture/PolicyVerifierTest.kt |
gap | verify-policy |
| Rule mutation tester | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/architecture/RuleMutationTesterTest.kt |
cmd-mutate |
mutate |
| Review funnel | plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/ReviewFunnelTest.kt |
gap | gap |
AI config features, reports and eval
| Feature | Behavior test | E2E | Doc |
|---|---|---|---|
AI reports and metrics from run history (ai.statistics, ai.metrics, ai.reports) |
core/validation/src/commonTest/kotlin/io/karandash/engine/ReportEngineTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/metrics/modules/HistoryMetricModulesTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/pipeline/AiReportGeneratorHistoryTest.kt |
ai-history-first-run (empty stats store: the metric is skipped), ai-history-metric (the second run reports metric:hours-saved) |
AI features |
ai.macroReferences |
plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/RuleMacroExpanderTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/pipeline/AiConfigFeatureApplicatorTest.kt |
gap | AI features |
ai.enforcementSchedule |
plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/ProgressiveEnforcementTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/pipeline/AiConfigFeatureApplicatorTest.kt |
ai-transform-enforcement (a warn phase turns the error into a passing warning) |
AI features |
ai.severityOverrides (reclassify) |
plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/SeverityReclassifierTest.kt |
ai-transform-reclassify |
AI features |
| Violation budgets and grace periods | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/ViolationBudgetEvaluatorTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/GracePeriodEvaluatorTest.kt |
gap | AI features, grace periods |
| Canary promotion | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/CanaryPromotionEvaluatorTest.kt |
gap | AI features |
| Execution profiles and tracks | plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiExecutionProfileTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/EnvironmentTrackResolverTest.kt |
gap | AI features, environment tracks |
| Seniority tiers | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/AuthorSeniorityResolverTest.kt |
gap | AI features |
| Conditional prompt sections | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/ConditionalSectionCheckerTest.kt |
gap | AI features |
AI cost budget (ai.costBudget) |
plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/AiCostBudgetResolverTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/dispatch/AiCostBudgetWarnTest.kt |
ai-transform-cost-budget |
AI features |
| AI budget limits and large-MR validation | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/AiBudgetLimitsTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiLargeMrConfigValidationTest.kt |
gap | gap |
| Debug config | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/config/AiDebugConfigTest.kt |
gap | gap |
| Calibration (EVT) keys | plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiCalibrationKeyBehaviourTest.kt, cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/calibrate/AnalyzerCalibrationTest.kt |
gap | calibrate |
| AI state persistence and MR snapshot store | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiStatePersistenceTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/CoreStateSnapshotStoreTest.kt |
gap | gap |
| AI incremental cache | plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiPipelineExtensionIncrementalTest.kt |
gap | AI features |
| AI statistics history cap | plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiStatisticsMaxHistoryTest.kt |
gap | gap |
| AI platform dismissals | plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiPlatformDismissalsTest.kt |
gap | gap |
| Per-finding hook metadata | plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiPerFindingHookMetadataTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiHookOncePerRunTest.kt |
gap | gap |
| AI pipeline extension enablement | plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiPipelineExtensionEnablementTest.kt |
gap | gap |
| AI key behaviour (provider, prompt, rule module) | plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiProviderKeyBehaviourTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiPromptKeysTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/AiRuleModuleKeyBehaviourTest.kt |
gap | gap |
| AI dead and deprecated keys | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiDeadKeysTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiDeprecatedKeysEffectTest.kt |
gap | CHANGELOG.md |
| AI config parsing (camelCase, scope, warnings) | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiConfigCamelCaseKeysTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiPluginConfigScopeParsingTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/AiConfigKeyWarningsTest.kt |
gap | gap |
| AI report generator (digest, history, sections) | plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/pipeline/AiReportGeneratorDigestTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/pipeline/AiReportGeneratorHistoryTest.kt, plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/pipeline/AiReportGeneratorSectionsTest.kt |
gap | gap |
| AI report: developer growth | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/reporters/modules/DeveloperGrowthReportModuleTest.kt, plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/reporters/DeveloperGrowthReportGeneratorTest.kt |
gap | gap |
| AI report: cross-platform consistency | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/reporters/modules/CrossPlatformConsistencyReportModuleTest.kt |
gap | gap |
| AI report: digest and compliance | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/reporters/modules/DigestAndComplianceReportModuleTest.kt |
gap | gap |
| AI report: prediction | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/reporters/AiPredictionReporterTest.kt |
gap | gap |
| Check-run annotations report | plugins/plugins-ai/rules/ai/src/commonTest/kotlin/io/karandash/plugins/ai/pipeline/CheckRunAnnotationReportTest.kt |
gap | gap |
| DORA metrics | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/reporters/DoraMetricsCalculatorTest.kt |
gap | gap |
| History metric modules | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/metrics/modules/HistoryMetricModulesTest.kt |
gap | gap |
| Report percent rounding | plugins/plugins-ai/ai-core/src/commonTest/kotlin/io/karandash/plugins/ai/core/reporters/ReportPercentRoundingTest.kt |
gap | gap |
| AI eval harness (replay, scorer) | plugins/integration-tests/ai-eval/src/commonTest/kotlin/io/karandash/eval/EvalReplayTest.kt, plugins/integration-tests/ai-eval/src/commonTest/kotlin/io/karandash/eval/EvalScorerTest.kt |
gap | ai-eval |
KARANDASH_EVAL_* live eval env |
test-fixtures/src/nativeTest/kotlin/io/karandash/testfixtures/NativeTestEnvTest.kt |
gap | ai-eval |
ai stats fire rate and history flags |
cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/FireRateRoundingTest.kt, cli-ai/src/commonTest/kotlin/io/karandash/cli/commands/HistoryFlagsTest.kt |
gap | stats |
DSL and LSP
| Feature | Behavior test | E2E | Doc |
|---|---|---|---|
LSP server (lsp, JVM only) |
dsl/lsp-server/src/test/kotlin/io/karandash/lsp/KarandashLanguageServerTest.kt, cli/src/commonTest/kotlin/io/karandash/cli/commands/LspCommandTest.kt |
lsp-initialize (JSON-RPC over stdio on the jar; the native binary exits 6) |
CLI reference |
| KTS parser (Kotlin DSL config) | dsl/kts-parser/src/commonTest/kotlin/io/karandash/parser/KtsJsonInterpreterTest.kt, dsl/kts-parser/src/commonTest/kotlin/io/karandash/parser/ParserBasicTest.kt, dsl/kts-parser/src/commonTest/kotlin/io/karandash/parser/KtsParserEdgeCaseTest.kt |
gap | YAML_CONFIG |
| LSP completion | dsl/lsp-server/src/test/kotlin/io/karandash/lsp/CompletionProviderTest.kt |
lsp-completion, lsp-completion-title-format |
CLI reference |
| LSP hover | dsl/lsp-server/src/test/kotlin/io/karandash/lsp/HoverProviderTest.kt, dsl/lsp-server/src/test/kotlin/io/karandash/lsp/HoverMergeTest.kt |
lsp-hover |
CLI reference |
| LSP diagnostics | dsl/lsp-server/src/test/kotlin/io/karandash/lsp/DiagnosticProviderTest.kt, dsl/lsp-server/src/test/kotlin/io/karandash/lsp/ConfigPipelineDiagnosticsTest.kt |
gap | gap |
| LSP native build absent (OPEN) | gap | no native LSP | gap |
Dogfooding
| Feature | Behavior test | E2E | Doc |
|---|---|---|---|
projects/base |
projects/base/src/commonTest/kotlin/io/karandash/validators/BaseConfigIntegrationTest.kt, projects/base/src/commonTest/kotlin/io/karandash/validators/BaseRemoteExtendsTest.kt |
gap | gap |
projects/base-kmp |
projects/base-kmp/src/commonTest/kotlin/io/karandash/validators/BaseKmpConfigIntegrationTest.kt, projects/base-kmp/src/commonTest/kotlin/io/karandash/validators/BaseKmpRemoteExtendsTest.kt |
gap | gap |
projects/wallet (extends base-kmp) |
projects/wallet/src/commonTest/kotlin/io/karandash/validators/WalletConfigIntegrationTest.kt, projects/wallet/src/commonTest/kotlin/io/karandash/validators/WalletRemoteExtendsTest.kt |
gap | gap |
projects/navigator |
projects/navigator/src/commonTest/kotlin/io/karandash/validators/NavigatorConfigIntegrationTest.kt, projects/navigator/src/commonTest/kotlin/io/karandash/validators/NavigatorRemoteExtendsTest.kt |
gap | gap |
projects/telecom |
projects/telecom/src/commonTest/kotlin/io/karandash/validators/TelecomRequirementsIntegrationTest.kt |
gap | gap |
projects/coinbox, projects/gridmon, projects/ledger |
projects/base/src/commonTest/kotlin/io/karandash/validators/ProjectSpec.kt, projects/ledger/src/commonTest/kotlin/io/karandash/validators/ProjectSpec.kt |
gap | gap |
projects/shared-tests |
projects/shared-tests/src/realChainTest/kotlin/io/karandash/validators/ProjectRealConfigChainTest.kt, projects/shared-tests/src/commonTest/kotlin/io/karandash/validators/ProjectConfigIntegrationTest.kt |
gap | gap |
Dev tooling
| Feature | Behavior test | E2E | Doc |
|---|---|---|---|
tools:detekt-rules (karandash rule set) |
tools/detekt-rules/src/test/kotlin/io/karandash/detekt/CallRulesTest.kt, tools/detekt-rules/src/test/kotlin/io/karandash/detekt/CatchRulesTest.kt, tools/detekt-rules/src/test/kotlin/io/karandash/detekt/DynamicRegexTest.kt, tools/detekt-rules/src/test/kotlin/io/karandash/detekt/OtherRulesTest.kt |
internal lint rules | gap |
test-fixtures (golden files, temp dirs) |
test-fixtures/src/commonTest/kotlin/io/karandash/testfixtures/GoldenFilesTest.kt, cli/src/jvmTest/kotlin/io/karandash/cli/consumers/ConsumerChainsTest.kt |
gap | gap |
| Compat sync tests (docs, CLI help, error messages) | cli/src/commonTest/kotlin/io/karandash/cli/compat/DocsCommandLinesTest.kt, cli/src/jvmTest/kotlin/io/karandash/cli/compat/CompatErrorMessagesTest.kt, cli/src/jvmTest/kotlin/io/karandash/cli/compat/CliHelpTreeTest.kt |
gap | gap |
Config-key behaviour inventory (cli/src/jvmTest/config-keys/*.tsv) |
cli/src/jvmTest/kotlin/io/karandash/cli/keys/ConfigKeyBehaviourInventoryTest.kt |
gap | gap |
plugins:integration-tests contract tests |
plugins/integration-tests/contracts/src/commonTest/kotlin/io/karandash/contracts/ai/AiReviewEndToEndContractTest.kt |
gap | gap |
Example plugin (tools/examples/standalone-jvm-plugin) |
tools/examples/standalone-jvm-plugin/src/test/kotlin/com/example/karandash/PluginLoadSmokeTest.kt |
gap | creating-plugins |