When trying to connect to the powershell virtual directory url using the load balancer fqdn in the url, the connection fails.
You have to connect directly to one of the CAS exchange 2010 servers for more information about connecting to exchange using remote powershell: http://www.howexchangeworks.com/2009/09/connecting-to-exchange-2010-using.html