Feeling attraction towards someone is not haram. However, if we choose to act on such impulses it could lead to sin. That's why God in Quran instructs believers to lower their gaze in order to avoid such temptation. In other words, we must do our best to avoid staring at the one we feel attracted to.