Codesecure SolutionsA Codesecure Solutions product
Pillar 02 of 12

Every field is searchable.
You planned no index for it.

ClickHouse stores columns, so a field that appeared for the first time this morning is queryable this morning. Discover reads the live catalog rather than a hand kept list, at any nesting depth, so nothing is missing because nobody registered it.

nullsoc.in / discover
The NullSOC Discover view: source picker, filter bar, histogram and a results table of decoded events.

Source, filters, histogram and results. The field rail is one click away.

3
Queryable layers
Raw, decoded and findings, each with its own retention.
0
Index definitions
No mappings to plan, no reindex when a field appears.
16
Filter operators
The same registry the detection engine evaluates.
1
Trace id
One identifier links a raw line to its decoded event and finding.
Three layers

Raw, decoded and finding are all kept.

Most platforms keep the alert and discard the evidence. NullSOC stores the untouched line, the decoded event and the finding as three queryable layers joined by one trace identifier, so an investigation can always walk back to what actually arrived on the wire.

  • Raw events are the original line, verbatim, timestamped in UTC and never rewritten.
  • Decoded events are the same record normalized to ECS with GeoIP and ASN attached.
  • Findings are what a rule or correlation produced, carrying severity, groups, ATT&CK and compliance.
  • Retention is per layer. Keep findings for a year and raw for a fortnight, or any other split, as a setting.
The three layers
Raw eventsoriginal line, UTC, never rewritten
Decoded eventsECS fields, GeoIP, ASN, enrichment
Findingsseverity, groups, ATT&CK, compliance
Joined bytrace_id, stamped at ingest
Retentioneditable per table, no support ticket
StorageClickHouse columnar, compressed
Field discoverylive catalog, any nesting depth
ExportCSV from the table, Excel from a report
Saved views

A search you repeat should not be retyped.

Name a filtered search and it becomes an alias: a first class source in the picker, exactly like the built in ones. Save it as an Events chart instead and it becomes a dashboard tile, or the body of a scheduled report.

  • Aliases are a named filter over a base source, with no data copied and no second pipeline.
  • Save as chart turns a Discover view into a chart you can drop on any dashboard.
  • Dashboard tiles stay live. An embedded view keeps its histogram, filters and row expansion inside the tile.
  • Reports reuse the same view so the PDF and the screen cannot disagree about what was asked.
nullsoc.in / charts
The chart library grouped into folders, each card previewing its chart type.

A saved view becomes a chart, and a chart becomes a tile or a report page.

Ingest control

Drop the noise before it costs you anything.

The cheapest event is the one never stored. Ingest filters are evaluated inside the collector, before ClickHouse, so junk never reaches disk. Because a filter is a security decision, you dry run it first and see exactly what it would have removed.

  • Dry run before apply. See the matched percentage, sample lines, and how many findings came from those lines.
  • Findings from matched is the safety number: a filter that would have removed real detections says so.
  • Raw door fields only. Filters read what exists at the door, so they cannot depend on a decode that has not happened.
  • A bad filter never applies. An invalid rule is refused and the previous configuration keeps running. Ingest does not stop.
Ingest facts
CollectorVector
Filter pointbefore storage, in the collector
Dry runmatched percent, samples, findings impact
Failure moderefuse and keep running
Bufferingon disk, survives a restart
Sourcesagents, syslog, files, cloud APIs
Identitytrace_id stamped at the door
Get started

Search a field nobody indexed.
That is the whole demo.

Name a field you gave up on because it was not in the mapping. We will filter on it live, then pivot from the result to the raw line that carried it.

Powered by Codesecure Solutions. Self hosted, cloud or fully managed.