3a3f07628d
- New magneticLasso module: Sobel energy map + Dijkstra shortest-path + Douglas-Peucker - New activeContour module: greedy snake + balloon force for polygon-to-edge refinement - wallTextureSplit: edge barrier mask, morphological mask hole closing, Moore boundary tracing, simplified polygon contours, manual pick map patching, gap absorption - MaskSegmentCanvas: full lasso gesture pipeline (tap vertices, drag, magnetic paths, close polygon, endLasso/cancelLasso/deleteLasso) - New maskConfig options: splitWallsEdgeBarrierThreshold, splitWallsCloseMaskRadius, manualSplitWalls, manualSplitWallsMaxCount, manualSplitWallsGapAbsorbDilatePx, magneticLasso, activeContourRefine - New ref methods: startLasso, endLasso, cancelLasso, getManualRegions, deleteLasso - New exported types: LassoPolygon, ManualWallPartition - RegionMaskData carries indexToName and wallSemanticIdx through downsample - Simplify README to point to documentation site - Update documentation site (EN + ZH-CN) with all new APIs and interaction guide - Example app: lasso mode toggles and operation buttons Co-authored-by: Cursor <cursoragent@cursor.com>
2.7 KiB
2.7 KiB
| id | title |
|---|---|
| interaction-guide | Interaction Guide |
🎮 Interaction Guide
Paint Mode
- 🔁 Initial Carousel: After regions are ready, each region's dashed outline flashes sequentially per
initRegionFlashMs(default 1s); stops on first user touch. - 🔍 Preview (no brush selected): Long-press a region to show dashed outline for the connected component under the touch point; tapping a black area shows no outline.
- 🎨 Paint (brush selected): Tap a color in the bottom color bar or call
ref.setPaintColor(or preselect viainitialPaintColor), then tap a region to paint; tapping the same region again overwrites the color. - 💬 Tap without brush: No paint is performed;
onPaintCallbackfires withkind: 'brush_required', carrying ahintand target region info for the host to show a toast/modal prompting color selection. - ↩️ Undo: Bottom-left button or
ref.reset(); steps backward through paint history one action at a time. - 👁️ Compare with Origin: Bottom-right button or
ref.swap(); hides the paint layer to show the original image.
Lasso Mode (Manual Wall Split)
When manualSplitWalls is enabled and lasso mode is active:
- 🧲 Enter Lasso: Call
ref.startLasso()to activate lasso mode. The lasso polygon overlay (orange) appears. - 👆 Place Vertices: Tap on wall areas to place polygon vertices. Vertices snap to wall-mask edges/corners automatically.
- 🧲 Magnetic Lasso (when
magneticLasso: true): Paths between taps automatically follow strong image edges (green path overlay) via Sobel gradient + Dijkstra shortest-path. - 🔒 Close Polygon: Tap near the first vertex to close the polygon. A closed polygon is outlined in orange.
- ✋ Drag Vertices: Touch and drag an existing vertex to reposition it. The vertex snaps to wall boundary/corner points, or stays within the wall mask for interior positions.
- ✅ End Lasso: Call
ref.endLasso()to convert all closed polygons intowall-Nsub-regions ready for painting. - 🗑️ Cancel Lasso: Call
ref.cancelLasso()to discard all in-progress lasso polygons without saving. - 🗑️ Delete Lasso: Call
ref.deleteLasso(id)to remove a previously committed lasso polygon and its associatedwall-Nregion.
Active Contour Refinement
When activeContourRefine: true, the closed lasso polygon is automatically refined after endLasso():
- Each vertex samples positions along its outward normal direction
- Vertices expand to the nearest wall-mask boundary edge (balloon force)
- Douglas-Peucker simplification removes redundant vertices
- Result: the polygon hugs the true wall outline rather than the raw tap positions