You may want to take a look here: www.ibm.com/developerworks/websphere/tec...
I copied the below from the above link:
"This function only works well when the update to the application is "compatible" with the prior version of the application. In other words, it must be feasible for both versions of the application to be executing at the same time in the same cluster, and clients should be able to direct requests to either version of the application without failure. Many modifications to applications fall into the category of compatible updates, but it does require consideration by the application developers to know which are and which are not."
The deployments I've performed have required us to stop the application and deploy the application as the changes made by developers typically fall into the "non-compatible" classification.
Erik