Since this is army green, you can always wear it with military colors: black, khaki, navy and red.
My art professor used to say, "If it is found in nature, the colors coordinate." He was so sick of students saying silly things like "Pink and green don't go together!" In that light, flowering cacti mix olive drab and bright flowers like professionals. If plants love olive drab so much, don't be afraid to wear it as the solid with your florals or as the base to your brights.
Olive in a more iridescent, less drab form, is also a prevalent color in beetles. (I think beetles are freaking cool.) Use them as a guide for mixing in bright jewel tones.
Olive drab shows up in, -- gasp -- olives. Trying adding some dark purple to your black and olive.
Since olive drab is found so often in nature, it's safe to call it an earth tone. This color will work seamlessly with shades of brown, black, orange, deep reds and muted yellows.