bryanchang commited on
Commit
d047579
·
verified ·
1 Parent(s): 9ea6572

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +171 -3
README.md CHANGED
@@ -1,3 +1,171 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ tags:
4
+ - point-cloud
5
+ - semantic-segmentation
6
+ - autonomous-driving
7
+ - lane-detection
8
+ ---
9
+
10
+ # Model Card for Point Transformer V3 Lane Detection
11
+
12
+ This model performs semantic segmentation (lane line) on LiDAR point cloud data to detect and segment lane markings for autonomous vehicle navigation.
13
+
14
+ ## Model Details
15
+
16
+ ### Model Description
17
+
18
+ Point Transformer V3 model adapted for lane detection from LiDAR point clouds, featuring hierarchical encoder-decoder architecture with self-attention mechanisms for point cloud processing.
19
+
20
+ - **Developed by:** Bryan Chang
21
+ - **Model type:** Point Transformer V3 (PT-v3m1)
22
+ - **License:** MIT
23
+ - **Finetuned from model:** Nuscence-pretrained model
24
+
25
+ ### Model Sources
26
+
27
+ - **Repository:** https://github.com/Bryan1203/LiDAR-Based-Lane-Navigation
28
+ - **Demo:** https://www.youtube.com/watch?v=cCTi2zFftlY
29
+
30
+ ## Uses
31
+
32
+ ### Direct Use
33
+
34
+ The model can be directly used for:
35
+ - Lane detection from LiDAR point cloud data (ouster lidar with signal attribute)
36
+ - Semantic segmentation of road surfaces
37
+ - Real-time autonomous navigation systems
38
+
39
+ ### Downstream Use
40
+
41
+ Can be integrated into:
42
+ - Autonomous vehicle navigation systems
43
+ - Road infrastructure mapping
44
+ - Traffic monitoring systems
45
+ - Path planning algorithms
46
+
47
+ ### Out-of-Scope Use
48
+
49
+ This model should not be used for:
50
+ - Non-LiDAR point cloud data
51
+ - Indoor navigation
52
+ - Object detection tasks
53
+ - High-speed autonomous driving without additional safety systems
54
+
55
+ ## Bias, Risks, and Limitations
56
+
57
+ - Performance may degrade in adverse weather conditions
58
+ - Requires high-quality LiDAR data
59
+ - Limited to ground-level lane markings
60
+ - May struggle with unusual road geometries
61
+ - Real-time performance depends on hardware capabilities
62
+
63
+ ### Recommendations
64
+
65
+ Users should:
66
+ - Validate model performance in their specific deployment environment
67
+ - Implement appropriate safety fallbacks
68
+ - Consider sensor fusion for robust operation
69
+ - Monitor inference time for real-time applications
70
+ - Regularly evaluate model performance on new data
71
+
72
+ ## How to Get Started with the Model
73
+
74
+ refer to the repo, src/pointcept151/inference_ros_filter.py for implementation
75
+
76
+ ## Training Details
77
+
78
+ ### Training Data
79
+
80
+ - Based on SemanticKITTI dataset format
81
+ - Binary classification: background (0) and lane (1)
82
+ - Point cloud data with 4 channels: x, y, z, intensity (signal)
83
+
84
+ ### Training Procedure
85
+
86
+ #### Preprocessing
87
+ - Grid sampling with size 0.05
88
+ - Random rotation, scaling, and flipping augmentations
89
+ - Random jittering (σ=0.005, clip=0.02)
90
+
91
+ #### Training Hyperparameters
92
+
93
+ - **Training regime:** Mixed precision (fp16)
94
+ - Batch size: 4
95
+ - Epochs: 50
96
+ - Optimizer: AdamW (lr=0.004, weight_decay=0.005)
97
+ - Scheduler: OneCycleLR
98
+ - Loss functions: CrossEntropy + Lovasz Loss
99
+
100
+ #### Speeds, Sizes, Times
101
+
102
+ - Inference time: 300-400ms per frame on RTX A4000
103
+ - Model size: ~500MB
104
+ - Training time: ~24 hours on single GPU
105
+
106
+ ## Evaluation
107
+
108
+ ### Testing Data, Factors & Metrics
109
+
110
+ #### Testing Data
111
+ - Custom labeled high-bay dataset (UIUC testing facility)
112
+ - Test split from training data
113
+
114
+ #### Factors
115
+ - Time of day
116
+ - Weather conditions
117
+ - Road surface types
118
+ - Lane marking visibility
119
+
120
+ #### Metrics
121
+ - Mean IoU
122
+ - Per-class accuracy
123
+ - Inference time
124
+ - Memory usage
125
+
126
+ ### Results
127
+
128
+ Performance metrics on test set:
129
+ - Mean IoU: [Pending final evaluation]
130
+ - Background accuracy: [Pending final evaluation]
131
+ - Lane accuracy: [Pending final evaluation]
132
+
133
+ ## Environmental Impact
134
+
135
+ - **Hardware Type:** NVIDIA RTX A4000
136
+ - **Hours used:** ~24 for training
137
+ - **Cloud Provider:** Local computation
138
+ - **Carbon Emitted:** [To be calculated]
139
+
140
+ ## Technical Specifications
141
+
142
+ ### Model Architecture and Objective
143
+
144
+ Detailed in configuration:
145
+ - Encoder depths: (2, 2, 2, 6, 2)
146
+ - Encoder channels: (32, 64, 128, 256, 512)
147
+ - Decoder depths: (2, 2, 2, 2)
148
+ - MLP ratio: 4
149
+ - Attention heads: Varies by layer
150
+
151
+ ### Compute Infrastructure
152
+
153
+ #### Hardware
154
+ - NVIDIA RTX A4000 (16GB VRAM)
155
+ - 32GB RAM minimum
156
+ - Multi-core CPU
157
+
158
+ #### Software
159
+ - Python 3.8+
160
+ - PyTorch 1.10+
161
+ - CUDA 11.3+
162
+ - ROS Noetic
163
+ - Pointcept framework
164
+
165
+ ## Model Card Authors
166
+
167
+ Bryan Chang
168
+
169
+ ## Model Card Contact
170
+
171
+ bryanchang1234@gmail.com