501 lines
4.8 KiB
Plaintext
501 lines
4.8 KiB
Plaintext
|
|
Material Intelligence Platform v3
|
||
|
|
|
||
|
|
Version: 3.0
|
||
|
|
|
||
|
|
Status: Design
|
||
|
|
|
||
|
|
1. Objective
|
||
|
|
|
||
|
|
The goal of Version 3 is no longer feature extraction.
|
||
|
|
|
||
|
|
Version 3 focuses on transforming Material Assets into an intelligent knowledge base that can directly support AI image generation, material retrieval, quality assurance, and future recommendation systems.
|
||
|
|
|
||
|
|
Material Analyzer is considered feature-complete.
|
||
|
|
|
||
|
|
Version 3 extends it into a Material Intelligence Platform.
|
||
|
|
|
||
|
|
2. Architecture
|
||
|
|
Crawler
|
||
|
|
|
||
|
|
↓
|
||
|
|
|
||
|
|
Material Analyzer (Completed)
|
||
|
|
|
||
|
|
↓
|
||
|
|
|
||
|
|
Material Asset Library
|
||
|
|
|
||
|
|
↓
|
||
|
|
|
||
|
|
Material Intelligence
|
||
|
|
|
||
|
|
├── Prompt Builder
|
||
|
|
├── Material Knowledge Base
|
||
|
|
├── Similarity Search
|
||
|
|
├── Material Ground Truth
|
||
|
|
├── Vision Provider
|
||
|
|
└── Dataset Builder
|
||
|
|
|
||
|
|
↓
|
||
|
|
|
||
|
|
Gemini Image Renderer
|
||
|
|
|
||
|
|
↓
|
||
|
|
|
||
|
|
Material QA (Future)
|
||
|
|
3. Replace Vision Provider
|
||
|
|
|
||
|
|
Current implementation:
|
||
|
|
|
||
|
|
Rule Provider
|
||
|
|
|
||
|
|
↓
|
||
|
|
|
||
|
|
HTTP Provider
|
||
|
|
|
||
|
|
Upgrade to Provider Architecture.
|
||
|
|
|
||
|
|
vision/
|
||
|
|
|
||
|
|
internvl3/
|
||
|
|
|
||
|
|
florence2/
|
||
|
|
|
||
|
|
qwen2_5vl/
|
||
|
|
|
||
|
|
gemini/
|
||
|
|
|
||
|
|
gpt4o/
|
||
|
|
|
||
|
|
Every provider implements
|
||
|
|
|
||
|
|
AnalyzeMaterial(image) -> MaterialSemantic
|
||
|
|
|
||
|
|
Analyzer must not depend on any specific model.
|
||
|
|
|
||
|
|
4. Default Vision Model
|
||
|
|
|
||
|
|
Default local model
|
||
|
|
|
||
|
|
InternVL3
|
||
|
|
|
||
|
|
Reason
|
||
|
|
|
||
|
|
Fully offline
|
||
|
|
Reproducible
|
||
|
|
No API cost
|
||
|
|
Fine-grained material understanding
|
||
|
|
Future LoRA support
|
||
|
|
|
||
|
|
Gemini becomes optional.
|
||
|
|
|
||
|
|
Gemini is no longer the default analyzer.
|
||
|
|
|
||
|
|
Gemini is recommended only for image generation.
|
||
|
|
|
||
|
|
5. Semantic Fusion
|
||
|
|
|
||
|
|
Instead of trusting one model.
|
||
|
|
|
||
|
|
Support multiple providers.
|
||
|
|
|
||
|
|
Example
|
||
|
|
|
||
|
|
InternVL3
|
||
|
|
|
||
|
|
↓
|
||
|
|
|
||
|
|
Semantic A
|
||
|
|
|
||
|
|
Florence2
|
||
|
|
|
||
|
|
↓
|
||
|
|
|
||
|
|
Semantic B
|
||
|
|
|
||
|
|
↓
|
||
|
|
|
||
|
|
Fusion
|
||
|
|
|
||
|
|
↓
|
||
|
|
|
||
|
|
Final Semantic
|
||
|
|
|
||
|
|
Fusion strategy
|
||
|
|
|
||
|
|
voting
|
||
|
|
confidence weighting
|
||
|
|
field-level merge
|
||
|
|
|
||
|
|
Output
|
||
|
|
|
||
|
|
semantic.json
|
||
|
|
6. Material Fingerprint
|
||
|
|
|
||
|
|
Generate a readable fingerprint.
|
||
|
|
|
||
|
|
Example
|
||
|
|
|
||
|
|
{
|
||
|
|
"brightness":0.71,
|
||
|
|
"contrast":0.18,
|
||
|
|
"saturation":0.14,
|
||
|
|
"variation":0.22,
|
||
|
|
"texture_entropy":0.64,
|
||
|
|
"texture_frequency":0.39,
|
||
|
|
"orientation":89,
|
||
|
|
"dominant_lab":[67,-1,8]
|
||
|
|
}
|
||
|
|
|
||
|
|
Purpose
|
||
|
|
|
||
|
|
Prompt Builder
|
||
|
|
QA
|
||
|
|
Recommendation
|
||
|
|
Search
|
||
|
|
|
||
|
|
Unlike embedding,
|
||
|
|
|
||
|
|
Fingerprint is human-readable.
|
||
|
|
|
||
|
|
7. Prompt Builder
|
||
|
|
|
||
|
|
New module.
|
||
|
|
|
||
|
|
Input
|
||
|
|
|
||
|
|
Material Asset
|
||
|
|
|
||
|
|
Output
|
||
|
|
|
||
|
|
Prompt Block
|
||
|
|
|
||
|
|
Example
|
||
|
|
|
||
|
|
Material Constraints
|
||
|
|
|
||
|
|
Species:
|
||
|
|
European Oak
|
||
|
|
|
||
|
|
Surface:
|
||
|
|
Low Satin
|
||
|
|
|
||
|
|
Variation:
|
||
|
|
Medium
|
||
|
|
|
||
|
|
Gloss:
|
||
|
|
Low
|
||
|
|
|
||
|
|
Keep all material properties identical to the reference texture.
|
||
|
|
|
||
|
|
Do not alter species,
|
||
|
|
finish,
|
||
|
|
grain,
|
||
|
|
or gloss.
|
||
|
|
|
||
|
|
The rendering pipeline should consume Prompt Blocks instead of manually assembled prompts.
|
||
|
|
|
||
|
|
8. Ground Truth Builder
|
||
|
|
|
||
|
|
Convert low-level features into canonical material definitions.
|
||
|
|
|
||
|
|
Example
|
||
|
|
|
||
|
|
Analyzer
|
||
|
|
|
||
|
|
↓
|
||
|
|
|
||
|
|
Ground Truth Builder
|
||
|
|
|
||
|
|
↓
|
||
|
|
|
||
|
|
ground_truth.json
|
||
|
|
|
||
|
|
Purpose
|
||
|
|
|
||
|
|
Separate computer vision features from rendering constraints.
|
||
|
|
|
||
|
|
9. Material Knowledge Base
|
||
|
|
|
||
|
|
Generate
|
||
|
|
|
||
|
|
knowledge.db
|
||
|
|
|
||
|
|
Store
|
||
|
|
|
||
|
|
SKU
|
||
|
|
|
||
|
|
↓
|
||
|
|
|
||
|
|
Embedding
|
||
|
|
|
||
|
|
↓
|
||
|
|
|
||
|
|
Semantic
|
||
|
|
|
||
|
|
↓
|
||
|
|
|
||
|
|
Fingerprint
|
||
|
|
|
||
|
|
Support
|
||
|
|
|
||
|
|
search
|
||
|
|
recommendation
|
||
|
|
clustering
|
||
|
|
analytics
|
||
|
|
10. Similarity Graph
|
||
|
|
|
||
|
|
Build
|
||
|
|
|
||
|
|
KNN
|
||
|
|
|
||
|
|
↓
|
||
|
|
|
||
|
|
Material Graph
|
||
|
|
|
||
|
|
Example
|
||
|
|
|
||
|
|
Bruce Cinnamon
|
||
|
|
|
||
|
|
↓
|
||
|
|
|
||
|
|
Most Similar
|
||
|
|
|
||
|
|
Mohawk Brown Oak
|
||
|
|
|
||
|
|
0.96
|
||
|
|
|
||
|
|
Output
|
||
|
|
|
||
|
|
similarity.json
|
||
|
|
11. Prompt Dataset
|
||
|
|
|
||
|
|
Automatically generate
|
||
|
|
|
||
|
|
prompt_dataset.json
|
||
|
|
|
||
|
|
Example
|
||
|
|
|
||
|
|
{
|
||
|
|
"sku":"67907_847",
|
||
|
|
|
||
|
|
"system_prompt":"...",
|
||
|
|
|
||
|
|
"material_prompt":"...",
|
||
|
|
|
||
|
|
"negative_prompt":"..."
|
||
|
|
}
|
||
|
|
|
||
|
|
This dataset becomes the standard prompt source for Gemini.
|
||
|
|
|
||
|
|
12. Embedding Index
|
||
|
|
|
||
|
|
Generate
|
||
|
|
|
||
|
|
faiss.index
|
||
|
|
|
||
|
|
Purpose
|
||
|
|
|
||
|
|
Nearest-neighbor search
|
||
|
|
|
||
|
|
Duplicate detection
|
||
|
|
|
||
|
|
Recommendation
|
||
|
|
|
||
|
|
Visual search
|
||
|
|
|
||
|
|
13. Statistics Center
|
||
|
|
|
||
|
|
Generate
|
||
|
|
|
||
|
|
statistics.json
|
||
|
|
|
||
|
|
Examples
|
||
|
|
|
||
|
|
Species Distribution
|
||
|
|
|
||
|
|
Brightness Distribution
|
||
|
|
|
||
|
|
Material Distribution
|
||
|
|
|
||
|
|
Color Distribution
|
||
|
|
|
||
|
|
Gloss Distribution
|
||
|
|
|
||
|
|
Embedding PCA
|
||
|
|
|
||
|
|
Cluster Statistics
|
||
|
|
|
||
|
|
14. Asset Integrity
|
||
|
|
|
||
|
|
Upgrade manifest.
|
||
|
|
|
||
|
|
Current
|
||
|
|
|
||
|
|
files
|
||
|
|
|
||
|
|
New
|
||
|
|
|
||
|
|
SHA256
|
||
|
|
|
||
|
|
File Size
|
||
|
|
|
||
|
|
Created Time
|
||
|
|
|
||
|
|
Analyzer Version
|
||
|
|
|
||
|
|
Feature Version
|
||
|
|
|
||
|
|
Every asset must pass integrity verification.
|
||
|
|
|
||
|
|
15. Regression Test
|
||
|
|
|
||
|
|
Every Analyzer update automatically compares
|
||
|
|
|
||
|
|
Old Asset
|
||
|
|
|
||
|
|
↓
|
||
|
|
|
||
|
|
New Asset
|
||
|
|
|
||
|
|
Compare
|
||
|
|
|
||
|
|
Brightness
|
||
|
|
|
||
|
|
Histogram
|
||
|
|
|
||
|
|
Embedding
|
||
|
|
|
||
|
|
Semantic
|
||
|
|
|
||
|
|
Drift
|
||
|
|
|
||
|
|
Generate
|
||
|
|
|
||
|
|
regression_report.json
|
||
|
|
16. Vision Benchmark
|
||
|
|
|
||
|
|
Evaluate every Vision Provider.
|
||
|
|
|
||
|
|
Example
|
||
|
|
|
||
|
|
InternVL3
|
||
|
|
|
||
|
|
Accuracy
|
||
|
|
|
||
|
|
Latency
|
||
|
|
|
||
|
|
Memory
|
||
|
|
|
||
|
|
Semantic Stability
|
||
|
|
|
||
|
|
Compare
|
||
|
|
|
||
|
|
InternVL3
|
||
|
|
|
||
|
|
VS
|
||
|
|
|
||
|
|
Qwen2.5VL
|
||
|
|
|
||
|
|
VS
|
||
|
|
|
||
|
|
Florence2
|
||
|
|
|
||
|
|
Generate
|
||
|
|
|
||
|
|
benchmark_vision.json
|
||
|
|
17. Material Dataset
|
||
|
|
|
||
|
|
Generate
|
||
|
|
|
||
|
|
dataset/
|
||
|
|
|
||
|
|
assets/
|
||
|
|
|
||
|
|
prompts/
|
||
|
|
|
||
|
|
embeddings/
|
||
|
|
|
||
|
|
fingerprints/
|
||
|
|
|
||
|
|
statistics/
|
||
|
|
|
||
|
|
labels/
|
||
|
|
|
||
|
|
Future
|
||
|
|
|
||
|
|
Training
|
||
|
|
|
||
|
|
Fine-tuning
|
||
|
|
|
||
|
|
LoRA
|
||
|
|
|
||
|
|
Recommendation
|
||
|
|
|
||
|
|
QA
|
||
|
|
|
||
|
|
18. Development Priority
|
||
|
|
Phase A
|
||
|
|
|
||
|
|
Replace Rule Semantic
|
||
|
|
|
||
|
|
↓
|
||
|
|
|
||
|
|
InternVL3
|
||
|
|
|
||
|
|
Phase B
|
||
|
|
|
||
|
|
Prompt Builder
|
||
|
|
|
||
|
|
Ground Truth Builder
|
||
|
|
|
||
|
|
Fingerprint
|
||
|
|
|
||
|
|
Phase C
|
||
|
|
|
||
|
|
Similarity Graph
|
||
|
|
|
||
|
|
Knowledge Base
|
||
|
|
|
||
|
|
FAISS Index
|
||
|
|
|
||
|
|
Phase D
|
||
|
|
|
||
|
|
Statistics Center
|
||
|
|
|
||
|
|
Regression Test
|
||
|
|
|
||
|
|
Benchmark
|
||
|
|
|
||
|
|
19. Out of Scope
|
||
|
|
|
||
|
|
The following modules belong to Version 4.
|
||
|
|
|
||
|
|
Material QA
|
||
|
|
Drift Detection
|
||
|
|
Tile Detection
|
||
|
|
Canonical Texture Generator
|
||
|
|
Image Quilting
|
||
|
|
Pattern Detector
|
||
|
|
Seamless Texture Generation
|
||
|
|
20. Deliverables
|
||
|
|
|
||
|
|
Version 3 should produce:
|
||
|
|
|
||
|
|
MaterialAssets/
|
||
|
|
|
||
|
|
KnowledgeBase/
|
||
|
|
|
||
|
|
PromptDataset/
|
||
|
|
|
||
|
|
Statistics/
|
||
|
|
|
||
|
|
Embeddings/
|
||
|
|
|
||
|
|
Fingerprints/
|
||
|
|
|
||
|
|
GroundTruth/
|
||
|
|
|
||
|
|
Regression/
|
||
|
|
|
||
|
|
Benchmarks/
|