How can you get rid of stubborn grease and lotion marks on an armchair?

The fabric armrests on my favorite lounge chair in our Portland living room have built up dark, oily grime over time from body lotions and natural hair oils. I tried wiping them down with mild dish soap, but it left stiff, discolored spots on the material. Is there a safe method to clean this off?