如何正确标记四边形标记形状的内角？

Question

我在图像中有 4 个红色标记，我正在检测它们的轮廓并获得直角坐标 [x0,y0,w,h]。

我的目标是识别这个序列中的角：

我的问题是当我应用这个很酷的东西时我有时会遇到问题，因为根据 Y 值排序并不总是正确的，如您在此处看到的那样：

import numpy as np
import cv2

boundRectsList = [(282, 236, 33, 44), (432, 235, 35, 46), (432, 68, 37, 44), (282, 68, 34, 46)]

# Sort the list based on ascending y values:
boundRectsSorted = sorted(boundRectsList, key=lambda x: x[1])

maskCopy = 255*np.ones((512,768,3), dtype=np.uint8)

# Rectangle dictionary:
# Each entry is an index of the currentRect list
# 0 - X, 1 - Y, 2 - Width, 3 - Height
# Additionally: -1 is 0 (no dimension):
pointsDictionary = {0: (2, 3),
                    1: (-1, 3),
                    2: (2, -1),
                    3: (-1, -1)}

# Store center rectangle coordinates here:
centerRectangle = [None]*4

# Process the sorted rects:
rectCounter = 0

for i in range(len(boundRectsSorted)):

    # Get sorted rect:
    currentRect = boundRectsSorted[i]

    # Get the bounding rect's data:
    rectX = currentRect[0]
    rectY = currentRect[1]
    rectWidth = currentRect[2]
    rectHeight = currentRect[3]

    # Draw sorted rect:
    cv2.rectangle(maskCopy, (int(rectX), int(rectY)), (int(rectX + rectWidth),
                             int(rectY + rectHeight)), (0, 255, 0), 5)

    # Get the inner points:
    currentInnerPoint = pointsDictionary[i]
    borderPoint = [None]*2

    # Check coordinates:
    for p in range(2):
        # Check for '0' index:
        idx = currentInnerPoint[p]
        if idx == -1:
            borderPoint[p] = 0
        else:
            borderPoint[p] = currentRect[idx]

    # Draw the border points:
    color = (0, 0, 255)
    thickness = 2
    centerX = rectX + borderPoint[0]
    centerY = rectY + borderPoint[1]
    radius = 10
    cv2.circle(maskCopy, (centerX, centerY), radius, color, thickness)

    # Mark the circle
    org = (centerX - 5, centerY + 5)
    font = cv2.FONT_HERSHEY_SIMPLEX
    cv2.putText(maskCopy, str(rectCounter), org, font,
            2, (0, 0, 0), 2, cv2.LINE_8)

    # Store the coordinates into list
    if rectCounter == 0:
        centerRectangle[0] = centerX
        centerRectangle[1] = centerY
    else:
        if rectCounter == 1:
            centerRectangle[2] = centerX - centerRectangle[0]
        else:
            if rectCounter == 2:
                centerRectangle[3] = centerY - centerRectangle[1]
    # Increase rectCounter:
    rectCounter += 1

cv2.namedWindow("Sorted Rects", cv2.WINDOW_NORMAL)
cv2.imshow("Sorted Rects", maskCopy)
cv2.waitKey(0)

有没有正确的方法来获取内角的上序列？提前致谢。

Answer 1

我会使用自定义排序函数，该函数同时考虑了 x 和 y 坐标，并允许一定的容差 w.r.t。 y 坐标。在这里，我只是回收 earlier answer from me 中的代码（另外，有关所描述函数的详细信息，请参见此处）：

import numpy as np
import cv2
from functools import cmp_to_key                                        # <--


def rect_sort(a, b):                                                    # <--
    if abs(a[1] - b[1]) <= 15:                                          # <--
        return a[0] - b[0]                                              # <--
    return a[1] - b[1]                                                  # <--


boundRectsList = [(282, 236, 33, 44), (432, 235, 35, 46), (432, 68, 37, 44), (282, 68, 34, 46)]

boundRectsSorted = sorted(boundRectsList, key=cmp_to_key(rect_sort))    # <--

# [...]

我得到了想要的输出：

----------------------------------------
System information
----------------------------------------
Platform:      Windows-10-10.0.16299-SP0
Python:        3.9.1
PyCharm:       2021.1
NumPy:         1.20.2
OpenCV:        4.5.1
----------------------------------------

Answer 2

如果如问题中所述，您在一般情况下的目标是 quad 而不仅仅是矩形，那么您应该考虑一种更通用的方法，它不会仅仅假设您有细微差别在其中一个轴上。

1-求两条对角线的交点（使用简单的直线inters

2-交点坐标将space分为4个区域（左、上、右、下）。

3- 通过比较角的坐标与交点坐标，您可以将它们标记为 (TL, TR .. ) 或 (0, 1, 2, 3)

如何正确标记四边形标记形状的内角？

How to mark the inner corners of a quad marker shape correctly?

python

geometry

opencv

list

image-processing

有没有正确的方法来获取内角的上序列？提前致谢。