The organisers of a popular hot air balloon festival have said they are “devastated” that it will not be returning to York this summer.