The aim of this study was to develop a tool to classify breast lesions using ultrasound elastography. Our dataset included a total of 78 patients enrolled for percutaneous biopsy of 85 breast lesions. These lesions were classified into three sonoelastographic scores, where scores of 1 and 2 were considered negative – soft and intermediate respectively; the score 3 was considered positive – hardware. The visual classification of elastography performed by two radiologists was compared with our semi-automatic method. This classification aims to segment the red pixels found in the color elastography, quantify them and characterize the lesion by comparing the areas in red with the manually segmented lesion by the two radiologists. Our semi-automated technique had comparable performance to that of the two radiologists: sensitivity of 54.5% and specificity of 90.5%. The agreement kappa was greater than 0.8 for all observers. Thus, we concluded that the proposed method achieved a high rate of agreement between observers. In addition, the method presented high diagnostic specificity in classifying breast elastography images. By including more image features in the future, we expect our classifier to have a higher performance than radiologists.