SteelThumb Field Demo

A living digital twin for your garden.

Map your real beds, bags, rows, plants, devices, notes, watering, harvests, and propagation history in one self-hosted garden record.

This demo is not autonomous gardening. This demo is a real garden digital twin with grow areas, plant IDs, notes, and projected overlays.

Inspect the map Follow the build

Map the gardenGrow areas become stable semantic objects.

Assign plant IDsIndividual plants get locations and lifecycle state.

Track the lifecycleNotes, tasks, harvests, and propagation attach over time.

Stylized SteelThumb digital twin preview with grow bag outlines and HUD cards — SIMULATED Generated preview / SVG approximation

LIVE

Real field-demo data or real garden reference media.

MANUAL

Human-authored annotation, label, note, or task.

SIMULATED

Plausible demo metric not yet coming from live sensors or models.

COMING SOON

Planned workflow that is not live in this public slice.

What this shows

Real garden -> digital twin -> grow areas -> plant IDs -> notes over time.

Real garden reference

The demo starts from the field grow-bag row and keeps the real-world garden visible.

Manual grow-area map

Normalized SVG polygons and ellipses make the semantic map clickable before reconstruction is automated.

Plant IDs

Plants are not loose labels. They are stable records with root positions, stages, notes, and tasks.

Projected overlays

HUD cards, markers, and PlotTags point back to the same semantic garden twin.

Real SteelThumb field garden reference with grow bags, gravel, patio edge, tree, fence, and PlotTags. — LIVE real photo

Stylized SteelThumb digital twin preview of the grow-bag row with HUD overlays and map geometry. — SIMULATED generated digital twin

Interactive garden map

Click a grow area, PlotTag, or device marker.

MANUAL

Geometry uses normalized 2D image coordinates for the MVP. It is intentionally not claiming final metric `garden_world` alignment.

Selected Grow Bag Zone

Grow area

Grow Bag Zone

MANUAL

Manual polygon around the primary row of black grow bags along the patio edge.

ID: grow-bag-zone
Kind: grow bag zone
Plants: 5
Geometry: polygon / normalized 2D

health: 92 %SIMULATED
moisture: 62 %SIMULATED
activePlants: 18MANUAL
nextWater: In 8hSIMULATED

Plants in this area

plant-001 · Nasturtium edge plant
plant-002 · Tomato
plant-003 · Basil companion
plant-004 · Lettuce cluster
plant-005 · Unknown volunteer

Linked devices

Tendril Node 01

PlotTags

ST-GARDEN-OAK-GROW-BAG-ZONE

Notes and tasks

MANUALnote2026-06-27

Manual grow-area polygon traces the visible row. It is intentionally image-normalized, not final garden_world geometry.

MANUALTODO taskNext scan

Review grow-bag polygon after next field capture.

Grow area

Bag 01 - Nasturtium Edge

MANUAL

Front-left grow bag with flowering nasturtium spilling toward the patio edge.

ID: bag-01
Kind: grow bag
Plants: 1
Geometry: ellipse / normalized 2D

soilCover: highMANUAL

Plants in this area

plant-001 · Nasturtium edge plant

Notes and tasks

No grow-area notes yet.

Grow area

Bag 02 - Seedling Mix

MANUAL

Second bag in the row with smaller greens and volunteer starts.

ID: bag-02
Kind: grow bag
Plants: 1
Geometry: ellipse / normalized 2D

Plants in this area

plant-004 · Lettuce cluster

Notes and tasks

No grow-area notes yet.

Grow area

Bag 03 - Mid-Row Support

MANUAL

Middle bag with upright stakes and young transplants.

ID: bag-03
Kind: grow bag
Plants: 1
Geometry: ellipse / normalized 2D

Plants in this area

plant-005 · Unknown volunteer

Notes and tasks

No grow-area notes yet.

Grow area

Bag 04 - Tomato + Basil

MANUAL

Primary labeled bag for the click-through demo: tomato, basil, PlotTag, notes, and next task.

ID: bag-04
Kind: grow bag
Plants: 2
Geometry: ellipse / normalized 2D

supportRisk: watchMANUAL

Plants in this area

plant-002 · Tomato
plant-003 · Basil companion

PlotTags

ST-BAG-04

Notes and tasks

No grow-area notes yet.

Grow area

Bag 05 - Herb Watch

MANUAL

Right-side grow bag with vining growth and harvest estimate demo data.

ID: bag-05
Kind: grow bag
Plants: 0
Geometry: ellipse / normalized 2D

harvestEstimate: 2.7 kg zucchiniSIMULATED

Notes and tasks

No grow-area notes yet.

Grow area

Tree Climbing Support

MANUAL

Tree trunk and training line used as a vertical support for climbing or vining plants.

ID: tree-support
Kind: tree support
Plants: 0
Geometry: polygon / normalized 2D

tendrils: 12SIMULATED
attachment: strongSIMULATED
growthRate: +18 %SIMULATED

Notes and tasks

No grow-area notes yet.

Grow area

Patio Edge

MANUAL

Hardscape boundary used as a stable reference edge for the first normalized image coordinate frame.

ID: patio-edge
Kind: patio edge
Plants: 0
Geometry: polygon / normalized 2D

Notes and tasks

No grow-area notes yet.

Grow area

Drip Irrigation Water Zone

MANUAL

Visible irrigation line feeding the grow-bag row. Autonomous watering is not live in this slice.

ID: water-zone
Kind: water zone
Plants: 0
Geometry: polygon / normalized 2D

nextRun: 8:00 PMSIMULATED
duration: 15 minSIMULATED
method: Drip irrigationMANUAL

Linked devices

Tendril Node 01

Notes and tasks

No grow-area notes yet.

Device

Tendril Node 01

MANUAL

Semantic device anchor for Tendril field-demo data. Sensor ingestion is not live in this page.

ID: tendril-node-01
Kind: tendril node
Linked areas: grow-bag-zone, water-zone

online: trueSIMULATED
moisture: 62 %SIMULATED
cameraView: field-demo rowMANUAL

Notes and tasks

MANUALnote2026-06-27

Tendril node is represented as a semantic device anchor. Live sensor ingestion is coming later; page metrics are clearly marked simulated.

MANUALTODO taskBefore public video

Confirm Tendril camera angle covers bag-04 and the water line.

PlotTag

Grow Bag Zone PlotTag

MANUAL

Physical marker linking the field object to its digital record.

ID: tag-grow-bag-zone
Code: ST-GARDEN-OAK-GROW-BAG-ZONE
Kind: hybrid
Target: grow_area: grow-bag-zone
URL: /field-demo/#grow-bag-zone

PlotTag

Bag 04 PlotTag

LIVE

Physical marker linking the field object to its digital record.

ID: tag-bag-04
Code: ST-BAG-04
Kind: hybrid
Target: grow_area: bag-04
URL: /field-demo/#bag-04

PlotTag

Tendril Node PlotTag

MANUAL

Physical marker linking the field object to its digital record.

ID: tag-tendril-01
Code: ST-TENDRIL-01
Kind: hybrid
Target: device: tendril-node-01
URL: /field-demo/#tendril-node-01

Grow Bag Zone Bag 01 - Nasturtium Edge Bag 02 - Seedling Mix Bag 03 - Mid-Row Support Bag 04 - Tomato + Basil Bag 05 - Herb Watch Tree Climbing Support Patio Edge Drip Irrigation Water Zone Tendril Node 01 Grow Bag Zone PlotTag Bag 04 PlotTag Tendril Node PlotTag

Example plant records

SteelThumb tracks individual plants, not just zones.

MANUAL

plant-001

Nasturtium edge plant

MANUAL

Species: Tropaeolum majus
Cultivar: unknown
Grow area: Bag 01 - Nasturtium Edge
Root: 35%, 58%
Stage: flowering
Health: good

Latest note

Nasturtium is flowering at the patio edge and provides the easiest proof of plant-level memory over time.

Next task

No task assigned.

plant-002

Tomato

MANUAL

Species: Solanum lycopersicum
Cultivar: unknown cultivar
Grow area: Bag 04 - Tomato + Basil
Root: 42%, 61%
Stage: flowering
Health: watch

Latest note

Tomato growth spurt needs a support check. Tie/stake task added so the plant record drives an action, not just a label.

Next task

Inspect tomato stake and tie after growth spurt.

plant-003

Basil companion

MANUAL

Species: Ocimum basilicum
Cultivar: unknown
Grow area: Bag 04 - Tomato + Basil
Root: 64%, 54%
Stage: vegetative
Health: good

Latest note

Basil companion plant is healthy and mapped as a separate plant instance inside bag-04.

Next task

No task assigned.

plant-004

Lettuce cluster

MANUAL

Species: Lactuca sativa
Cultivar: unknown
Grow area: Bag 02 - Seedling Mix
Root: 47%, 57%
Stage: vegetative
Health: good

Latest note

Lettuce cluster is the demo example for observation history; moisture and next-water values remain simulated until device data is wired.

Next task

No task assigned.

plant-005

Unknown volunteer

MANUAL

Species: unknown
Cultivar: unknown
Grow area: Bag 03 - Mid-Row Support
Root: 52%, 51%
Stage: unknown
Health: unknown

Latest note

Unknown volunteer kept as an explicit unknown rather than pretending automated plant identification is live.

Next task

No task assigned.

Projected overlay cards

HUD cards bind to semantic targets, not decorative pixels.

grow_area: grow-bag-zone

Grow Bag Zone

Bags detected: 9MANUAL
Health: 92%SIMULATED
Moisture: 62%SIMULATED
Next water: In 8hSIMULATED

device: tendril-node-01

Tendril Node

Linked zone: Grow Bag ZoneMANUAL
Moisture: 62%SIMULATED
Camera view: field-demo rowMANUAL

plant: plant-002

Tomato Record

Plant ID: plant-002MANUAL
Stage: FloweringMANUAL
Next task: Inspect stake and tieMANUAL

Pipeline coming next

Walkthrough video -> PlotTags -> COLMAP -> Gaussian splat -> semantic garden twin.

COMING SOON

Walkthrough video

Capture a slow garden walkthrough or overlapping photo set from the current field garden.

Inputs, outputs, checks

Inputs: Phone video, 20-80 overlapping photos
Outputs: Capture session, raw media set
Checks: coverage of grow areas, low blur, stable lighting

COMING SOON

PlotTag / AprilTag detection

Detect printed tags and use known tag size to ground scale, orientation, and semantic targets.

Inputs, outputs, checks

Inputs: keyframes, tag family, known tag size
Outputs: fiducial observations, tag corner coordinates
Checks: multiple tags per view, low reprojection error, target link verified

COMING SOON

COLMAP alignment

Recover camera poses and sparse point cloud from overlapping frames.

Inputs, outputs, checks

Inputs: keyframes, feature matches, tag observations
Outputs: camera poses, sparse point cloud
Checks: registered frame count, coverage, mean reprojection error

COMING SOON

Gaussian splat

Train and export a web-optimized visual reconstruction layer for the garden.

Inputs, outputs, checks

Inputs: registered keyframes, camera poses, point cloud
Outputs: splat asset, web preview
Checks: low floaters, web size, first render time

COMING SOON

Top-down map

Render an orthographic map for annotation and garden-world alignment.

Inputs, outputs, checks

Inputs: splat or proxy scene, garden-world transform
Outputs: top-down image, annotation frame
Checks: full garden extents, stable axes, no cropped grow areas

MANUAL

Grow-area annotation

Draw or accept polygons, ellipses, and markers for grow bags, beds, rows, tags, and water zones.

Inputs, outputs, checks

Inputs: top-down map, field photo, operator review
Outputs: GrowArea records, geometry history
Checks: stable IDs, reviewed geometry, explicit status labels

MANUAL

Plant IDs

Pin root positions and assign durable plant identities inside grow areas.

Inputs, outputs, checks

Inputs: GrowArea records, plant pins, planting notes
Outputs: PlantInstance records, plant locations
Checks: plant belongs to a grow area, root coordinate saved, unknowns allowed

MANUAL

Notes / tasks / harvests

Attach time-series memory to plants, grow areas, and devices so the visual twin becomes useful.

Inputs, outputs, checks

Inputs: PlantInstance records, observations, tasks
Outputs: timeline, next task, harvest and propagation history
Checks: notes target stable IDs, fake data labeled, no live autonomy overclaim

Status table

Every feature says what it is.

Feature	Status	Note
Garden reference visual	LIVE	Grounded in the field demo garden row.
Grow-area polygons and ellipses	MANUAL	Hand-authored normalized 2D geometry.
Plant IDs and notes	MANUAL	Static demo records with stable IDs.
PlotTags	MANUAL	Marker-to-record examples with one live field-label reference.
Moisture, health, harvest estimate	SIMULATED	Plausible dashboard metrics only.
COLMAP / Gaussian splat pipeline	COMING SOON	Roadmap sequence shown without claiming it is live.
Autonomous watering	COMING SOON	Explicitly not live in this slice.

Build log

Field Demo 001: Turning the garden into a digital twin

Read exactly what shipped, what is manual, what is simulated, and what comes next.

Read the build log