If you are using ArcGIS Server 9.3.1 for Java then please read the following alert.
Description
In ArcGIS Server, failover and round-robin are two methods for configuring multiple server object manager (SOM) machines.
After applying Service Pack 1 to ArcGIS Server 9.3.1 for the Java Platform, unexpected behavior has been experienced with round-robin and/or failover in the server environment.
With round-robin, the request is always sent to the secondary host.
With failover, if a failure occurs with the primary host SOM machine, the initial failover from the primary host machine to a secondary SOM host works as expected. However, if the primary host machine becomes available again, the requests continue to go to the secondary host and if the secondary host goes down, the requests do not failover back to the primary host machine.
If you are experiencing this problem then please read the knowledge base article which can be found here: http://support.esri.com/index.cfm… The knowledge base article contains information on this bug along with workarounds and a planned fix which is coming soon.
Since this is a very specific issue it will only affect a subset of ArcGIS Server Enterprise Java Customers. Note that this DO NOT apply to users of ArcGIS Server 9.3.1 for the Microsoft .NET Framework.