Is it ok to use up memory?

For CPU, I know that it depends on each provider how much it could be used. But for memory (RAM/SWAP), is it fine if I use it up (or nearly, let's say about 90%) for prolong period of time.

And, will it reduce the overall performance of the VPS if my instance is using like 90% of memory?