An exchange of contracts means that the agreement to buy or sell a property becomes legally binding between the parties involved. When the contracts have been exchanged you cannot back out of the agreement. Penalties can be imposed on a party involved in a transaction if they try to withdraw from it after the exchange of contracts takes place.
Sometimes the exchange of contracts and completion can happen at the same time but in a lot of instances an exchange of contracts will take place before the completion.