Abstract: For visible and infrared color fusion images of typical scenes, objective color harmony assessment models are proposed to evaluate the color quality of fusion images without reference images. The harmony between image colors and scene contents for natural scene images (green plants, sea and sky) was evaluated by measuring the similarity between image colors and memory colors of corresponding typical categories, and that for town and building images was calculated by selecting the optimum colorfulness rang. Simultaneously, based on the harmony model of color combination, the weighted harmony model for image color region combinations with different sizes was established using the areas' sum of color regions as the weighting. Above two aspects were combined in the proposed color harmony models for fusion images of typical scenes. Experimental results show that the proposed harmony models are consistent well with the human perception and they can evaluate the color harmony for color fusion images effectively.