The "honors" you see in your profile are the number of times you've been honored, not the amount of honor you have. Each time you're honored, you gain a quantity of honor depending on who honored you. If someone rarely hands out honor, its "worth" more than someone who honors each and every time he plays a game. There is no way to know your exact honor value, they keep that number secret on purpose.
As stated in the honorHonor System FAQ, honor can decay over time, and this may cause your Crests (ribbons) to disappear. Crests are not permanent by design, you have to constantly keep playing and receive honor from your fellow players to keep a Crest.