This research focuses on the design of an optimized meta color filter structure as a replacement for the traditional geometric optical lens and color filter in a camera. Even the problem has objective functions with difficult adjoint formulations, we could optimize the structure by using the software that is enable automatic differentiation. The final device achieved an optical efficiency of 72%, more than double that of a classic color filter.