Map My Garden with AR: How It Works on iPhone and iPad

To map your garden with AR, you hold up an iPhone or iPad and the camera shows each plant's position on the real ground, instead of a dot on a flat map. It fixes the biggest problem with phone garden maps: GPS is only good to several feet, and in a bed that is the difference between the right plant and its neighbour. Here is how AR garden mapping works, what it needs, and where it stops being accurate.

Why a GPS pin is not enough

A normal garden map drops a pin where the phone thinks you are standing. Consumer GPS is usually good to a few metres in the open and worse near buildings, hedges, and tree canopy, which is where gardens are. Pin ten shrubs a foot apart and several will land on top of each other. For a record of which bed holds which tree, that is fine. For finding a dormant perennial in February, it is not.

AR adds what GPS lacks: the phone tracks its own movement frame by frame, so once it knows where a plant is relative to a known point, it can show that spot precisely from any angle.

How AR garden mapping works

1. Find a fixed reference. The phone needs an anchor it can recognise every time: a printed marker, or two plants whose positions are already known. One anchor gives position; two give direction.
2. Track the ground. Apple's ARKit framework combines camera images with motion sensor data to follow the phone through space. On iPhones and iPads with a LiDAR scanner, depth sensing helps it find surfaces such as soil and paving faster and more steadily.
3. Place each plant on the ground. You aim at the base of a plant and mark the spot. The position is stored relative to your anchors, not to a satellite fix.
4. Show it back. On your next walk, scan the anchor again and every stored plant appears where you put it.

What it can and cannot do

Anything that relies on the camera needs decent light and a clear view of the ground. Thick mulch and low sun glare make surfaces harder to read.

How GardenPin does it: Live View

GardenPin 2.0 adds Live View. Hold up your iPhone or iPad and a ring appears on the ground at the base of every plant you have pinned, with its photo, name, and distance above it. Tap a label to open the plant's page. Pills at the edge of the screen point to plants out of frame, and a small radar shows what is around you.

A real screen recording of Live View on iPad.

Garden Markers

Markers are printable AR targets, twelve designs in four sizes (60, 100, 150, and 400 mm). Print at 100% on matte paper and fix one flat on the ground, on a stake, or on a post. Lay two per garden, 8 m (about 26 ft) or more apart: one gives position, and the line between them gives heading. No printer? Use Align to two plants instead.

Place Precisely

Plants pinned from GPS can be feet out. With Place Precisely you tap the ground through the camera at the base of each plant and choose Place Here. Scanning your first marker again at the end of a walk measures drift and corrects every plant. A garden can hold more than one layout, so last year's beds are kept when you replant.

Private by design

There is no account. Your gardens live on your device and, if you turn it on, in your own iCloud. No cloud AI service is involved in Live View or in care information. Care details in GardenPin name their source: the USDA PLANTS database for watering, soil, growth rate, and cold hardiness across over 500 species, and quoted Wikipedia sentences with a link where those do not cover a plant.

What you need, and what it costs

• iOS 26 on an iPhone or iPad. Live View works best on models with LiDAR.
• GardenPin, free to download. The free plan includes unlimited plants, gardens, notes, photos, and reminders, 5 plant identifications a week, sharing, and iCloud sync.
• Premium for Live View and Place Precisely. $0.99 a week, $19.99 a year, or $49.99 once. Premium also adds unlimited identifications, nursery-tag scanning, the garden map view, QR labels, and CSV/JSON export.
• Plants already pinned. Live View shows plants you have added; it does not identify new ones.

A simple way to start

1. Pin your plants. Add each plant to a garden. This works on the free plan.
2. Print two garden markers and fix them 8 m or more apart.
3. Open the garden, tap ···, choose Live View, and scan a marker from about half a metre away.
4. Use Place Precisely to place the plants that were pinned by GPS, and close the loop by rescanning your first marker.

The step-by-step version, with troubleshooting, is in How to Use Live View.

Sources

• Apple, ARKit: camera and motion tracking, and LiDAR-assisted scene understanding.
• USDA, PLANTS Database: plant characteristics used for care information in GardenPin.