Harvesting fruits is a seasonal work with great labor intensity and its cost is up to 50%~70% of the production cost. Therefore, the reduction of harvesting the fruit time and the harvesting cost are an effective way of increase the agricultural income. Hence, an automated harvesting system is essential. In this research, an automated image detection method for pepper harvesting system is proposed. The main objective of this project is to determine the location of ripe peppers.