I too had the bug to trade my Heritage for an Ultra. I also bailed out on the idea and am glad I did. I originally thought I would need the larger bike to accommodate my wife, but she ended up buying her own bike! She has a beautiful Softail Deluxe.
I believe in this situation you have made the correct decision. Financially it would have been a bad move and cause you to really dislike new bike, and be very upside down money wise. There will always be another and better day to make the move. So continue to put miles of smiles on your face with your Heritage.:s