French ATMs look very much like those in the US, see below, and are easy to find. Just look for the sign of the hand holding a card. They distribute anywhere from 10 to 200+ euro at a time.
Just about all banks in France have an ATM either inside the bank itself or on the street.
In France there are now ATMs that let you select your language, so using an ATM in France should not be difficult. The only problems that could arise are hidden transfer fees (ask your card issuer) and the fact that French ATMs only accept a four-digit pin number.

For information on exchange rates ask inside the bank of the ATM you are using. Also some credit cards charge a processing fee when used in selective countries so you might find out if yours does before using it in France.