Keypoint order and format for TGCN-WLASL input
#1
by mederbekaiana - opened
Hi,
I’m using your TGCN-WLASL model for sign language recognition and need to match the exact keypoint format used during training. The model expects input of shape (batch, 55, num_samples*2), but the order of the 55 keypoints is not documented. I’d like to clarify :
- Order of keypoint groups: Is it body (13) + left_hand (21) + right_hand (21), or another order ?
- Body subset: Which body keypoints are used?
- Hand keypoints: Are hand keypoints in OpenPose hand format (21 points per hand)? If so, what is the exact order (e.g. wrist, thumb CMC→tip, index MCP→tip, etc.)?
- Coordinate system: Are coordinates in pixel space (x, y in image dimensions) or normalized (e.g. 0–1)? Is there centering or scaling applied?
- Temporal format: For each keypoint, is the feature vector ordered as [x_t1, y_t1, x_t2, y_t2, ...] or [x_t1..x_t50, y_t1..y_t50]?
If you have any preprocessing script that shows how WLASL keypoints are converted to the model input, that would be very helpful.
Thank you for your work and for any guidance you can provide.
Best regards,
Aiana
mederbekaiana changed discussion title from eypoint order and format for TGCN-WLASL input to Keypoint order and format for TGCN-WLASL input
I am also having this issue. Did you work it out somehow?