Image sensor for generating depth data by a path difference of light generated through micro lens covering a plurality of sub-pixels and electronic device including the image sensor
地域：
Suwon-si
摘要
An electronic device is provided. The electronic device includes a camera module including a lens assembly and an image sensor, a display, and a processor. At least one pixel of the image sensor includes a first sub-pixel, a second sub-pixel, a third sub-pixel, and a fourth sub-pixel. The first sub-pixel may be covered by a first micro lens, the second sub-pixel may be covered by a second micro lens, and the third sub-pixel and the fourth sub-pixel may be covered by a third micro lens. The processor obtains a light reflected from an external object, generates depth data, generates pixel data generates an image based on the pixel data, outputs the image, and moves one or more lenses based on the depth data.
說(shuō)明書
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
This application is based on and claims priority under 35 U.S.C. § 119(a) of a Korean patent application number 10-2018-0156107, filed on Dec. 6, 2018, in the Korean Intellectual Property Office, the disclosure of which is incorporated by reference herein in its entirety.
The disclosure relates to a technology for generating depth data by using an image sensor. More particularly, the disclosure relates to an image sensor that generates depth data by a path difference of light generated through micro lens covering a plurality of sub-pixels.
An image sensor may include pixels for detection of a phase difference. The image sensor may generate phase difference information by using the pixels.
The above information is presented as background information only to assist with an understanding of the disclosure. No determination has been made, and no assertion is made, as to whether any of the above might be applicable as prior art with regard to the disclosure.
Aspects of the disclosure are to address at least the above-mentioned problems and/or disadvantages and to provide at least the advantages described below. Accordingly, an aspect of the disclosure is to provide an image sensor that designates some (e.g., 1%) of all the pixels for detecting a phase difference and generates depth data. However, data that is obtained from the designated pixels may be used only to generate depth data. In other words, the data obtained from the designated pixels may not be used as image data.
權(quán)利要求
What is claimed is:1. An electronic device comprising:a camera, wherein the camera includes a lens assembly including one or more lenses, an image sensor including at least one pixel,wherein the at least one pixel includes a first sub-pixel, a second sub-pixel, a third sub-pixel, and a fourth sub-pixel, and wherein the first sub-pixel is covered by a first micro lens, the second sub-pixel is covered by a second micro lens, and the third sub-pixel and the fourth sub-pixel are covered by a third micro lens; a display; and a processor configured to:obtain a light reflected from an external object and permeating through the one or more lenses by using the at least one pixel, obtain data from the third sub-pixel and the fourth sub-pixel based on light permeating through the third micro lens and generate depth data associated with the external object, obtain data from the first sub-pixel, the second sub-pixel, the third sub-pixel, and the fourth sub-pixel and generate pixel data, generate an image based on the pixel data, control the display to output the image, and move the one or more lenses based on the depth data. 2. The electronic device of claim 1 , wherein the third sub-pixel and the fourth sub-pixel are adjacent to each other in a transverse direction of the at least one pixel. 3. The electronic device of claim 1 , wherein the third sub-pixel and the fourth sub-pixel are adjacent to each other in a longitudinal direction of the at least one pixel. 4. The electronic device of claim 1 , wherein the third sub-pixel and the fourth sub-pixel are adjacent each other in a diagonal direction in the at least one pixel. 5. The electronic device of claim 1 ,wherein the at least one pixel includes a plurality of pixels, and wherein the third sub-pixel and the fourth sub-pixel included in each of the plurality of pixels are adjacent to each other in a transverse direction of each of the pixels, a longitudinal direction of each of the pixels, or a diagonal direction of each of the pixels. 6. The electronic device of claim 1 , wherein the processor is further configured to:control the image sensor to obtain first data from the first sub-pixel and second data from the second sub-pixel, control the image sensor to restore third data of the third sub-pixel and fourth data of the fourth sub-pixel based on the first data and the second data, and control the image sensor to generate pixel data of the at least one pixel based on the first data, the second data, the third data, and the fourth data. 7. The electronic device of claim 1 , wherein the processor is further configured to:bin data from the first sub-pixel, the second sub-pixel, the third sub-pixel, and the fourth sub-pixel, and generate pixel data of the at least one pixel. 8. An image sensor comprising:at least one pixel including a first sub-pixel, a second sub-pixel, a third sub-pixel, and a fourth sub-pixel, wherein the first sub-pixel is covered by a first micro lens, the second sub-pixel is covered by a second micro lens, and the third sub-pixel and the fourth sub-pixel are covered by a third micro lens; and a control circuit configured to:obtain a light reflected from an external object, obtain data from the third sub-pixel and the fourth sub-pixel based on light permeating through the third micro lens and generate depth data associated with the external object, obtain data from the first sub-pixel, the second sub-pixel, the third sub-pixel, and the fourth sub-pixel and generate pixel data; and transmit the pixel data and the depth data to an external processor. 9. The image sensor of claim 8 , wherein a color filter of the third micro lens is configured to transmit a light having a wavelength corresponding to a green light. 10. The image sensor of claim 8 , wherein the third sub-pixel and the fourth sub-pixel are adjacent to each other in a transverse direction in the at least one pixel. 11. The image sensor of claim 8 , wherein the third sub-pixel and the fourth sub-pixel are adjacent to each other in a longitudinal direction in the at least one pixel. 12. The image sensor of claim 8 , wherein the third sub-pixel and the fourth sub-pixel are adjacent to each other in a diagonal direction in the at least one pixel. 13. The image sensor of claim 8 ,wherein the at least one pixel includes a plurality of pixels, and wherein the third sub-pixel and the fourth sub-pixel included in each of the plurality of pixels are adjacent to each other in a transverse direction of each of the pixels, a longitudinal direction of each of the pixels, or a diagonal direction of each of the pixels. 14. The image sensor of claim 8 , wherein the control circuit is further configured to:control the image sensor to obtain first data from the first sub-pixel and second data from the second sub-pixel, restore third data of the third sub-pixel and fourth data of the fourth sub-pixel based at least on the first data and the second data, and generate pixel data of the at least one pixel based on the first data, the second data, the third data, and the fourth data. 15. The image sensor of claim 8 , wherein the control circuit is configured to:binning the data from the first sub-pixel, the second sub-pixel, the third sub-pixel, and the fourth sub-pixel and generate pixel data on the at least one pixel. 16. An image sensor comprising:a plurality of pixels arranged based on a specified channel pattern, wherein each of the plurality of pixels includes a first sub-pixel, a second sub-pixel, a third sub-pixel, and a fourth sub-pixel covered by a color filter; and a control circuit configured to control the plurality of pixels, wherein a portion of pixels from the plurality of pixels each includes a first micro lens covering the first sub-pixel, a second micro lens covering the second sub-pixel, and a third micro lens covering the third sub-pixel and the fourth sub-pixel, and wherein the control circuit is further configured to:control the plurality of pixels to obtain a light reflected by an external object, obtain data from the third sub-pixel and the fourth sub-pixel included in each of the portion of pixels and generate depth data, obtain data from the first to fourth sub-pixels included in each of the plurality of pixels and generate pixel data for each of the pixels, and transmit the pixel data and the depth data to an external processor. 17. The image sensor of claim 16 , wherein the color filter is formed to transmit a light having a wavelength corresponding to a green light. 18. The image sensor of claim 16 , wherein the third sub-pixel and the fourth sub-pixel are adjacent to each other in at least one of a transverse direction of each of the at least some pixels, a longitudinal direction of each of the at least some pixels, or a diagonal direction of each of the at least some pixels. 19. The image sensor of claim 16 , wherein the control circuit is further configured to:obtain data from the first sub-pixel and the second sub-pixel and restore data of the third sub-pixel and data of the fourth sub-pixel, and generate pixel data for each of the portion of pixels based on the restored data and the data obtained from the first sub-pixel and the second sub-pixel. 20. The image sensor of claim 16 , wherein the control circuit is further configured to:bin the data obtained from the first sub-pixel, the second sub-pixel, the third sub-pixel, and the fourth sub-pixel and generate pixel data for each of the portion of pixels. 21. The image sensor of claim 16 , wherein the third micro lens controls an angle of incident light to focus received light to the third sub-pixel and the fourth sub-pixel. 22. The image sensor of claim 16 , wherein the control circuit is further configured to determine a distance between data from the third sub-pixel and the fourth sub-pixel, and generate phase difference data based on the distance. 23. The image sensor of claim 16 , wherein the control circuit is further configured to:select the portion of pixels from the plurality of pixels based on proximity to the external object, and control one or more lenses based on phase difference data from the portion of pixels.
意見反饋
使用該功能遇到問(wèn)題
該功能需要專業(yè)版企業(yè)版VIP權(quán)限，您可以：
您也可以聯(lián)系官方QQ: 2157717237 電話: 13264338900