Did you include Schedule OSC (Credit for tax paid to another state) for your Virginia tax return? I think you should get credit for your tax withholding by CA when you file your state tax return

http://www.tax.virginia.gov/taxforms/Individual/Income%20Tax/2007/Schedule%20OSC.pdf