METHOD OF OPERATING IMAGE SIGNAL PROCESSOR ADJUSTING IMAGE BRIGHTNESS BASED ON ORDINARY DIFFERENTIAL EQUATION, ELECTRONIC DEVICE INCLUDING THE IMAGE SIGNAL PROCESSOR, AND METHOD OF OPERATING THE ELECTRONIC DEVICE

Smart overview of the Invention

The patent application describes a method for operating an image signal processor (ISP) that adjusts image brightness using a neural ordinary differential equation (ODE) network model. This approach involves receiving pixel values from an image sensor, computing adjustment functions for these pixel values, and generating adjusted pixel values. The neural ODE network model is trained using a loss function to optimize the adjustment process, ensuring accurate brightness adjustments without relying on preset data sets.

Background

The technique leverages advancements in neural networks and deep learning, which have significantly evolved due to improvements in data processing capabilities. Traditional methods of brightness adjustment in electronic devices often depend on static data sets, which can lead to biased results. The proposed method addresses this limitation by employing a dynamic neural ODE network model that adapts to various input data, enhancing the versatility and accuracy of image processing.

Methodology

The method involves several key steps: receiving initial pixel values from an image sensor, calculating corresponding adjustment functions using the neural ODE model, and generating adjusted pixel values. The adjustment functions represent optimal trajectories for modifying pixel values to achieve desired brightness levels. The model undergoes continuous learning through a loss function, refining its performance based on differences between initial and adjusted pixel values.

Implementation in Electronic Devices

An electronic device incorporating this method includes an image sensor and an ISP. The image sensor captures images and outputs pixel values, while the ISP processes these values using the neural ODE model to adjust brightness. This setup is applicable to various devices such as cameras, smartphones, and IoT devices, providing enhanced image quality through precise brightness adjustments.

Technical Details

The image sensor consists of a pixel array that converts light into electrical signals, which are then digitized into pixel values. The ISP performs various processing tasks such as noise reduction and color correction before adjusting brightness with the neural ODE model. This model calculates optimal adjustment functions for each pixel value, ensuring consistent and accurate brightness across different images and lighting conditions.