Chun monatóireacht a dhéanamh ar an gcomhshaol agus an saol fíor a nascleanúint, ba cheart go mbeadh an robot in ann íomhánna agus tomhais comhshaoil a fháil faoi choinníollacha soilsithe cúlra éagsúla. Le blianta beaga anuas, tá taighdeoirí agus innealtóirí ar fud an domhain ag obair chun braiteoirí níos mó agus níos airde a fhorbairt chun comhtháthú le robots, córais faireachais nó gléasanna eile ar féidir leo a dtimpeallacht a mhothú.
De réir Memes Consulting, tá taighdeoirí ó Ollscoil Polytechnic Hong Cong, Ollscoil Peking, Ollscoil Yonsei agus Ollscoil Fudan tar éis cineál nua braiteoir fís bionic a fhorbairt le déanaí a úsáideann meicníocht a insamhladh go saorga feidhm reitineach agus is féidir é a úsáid i réimse de Bailíodh sonraí. faoi choinníollacha éadroma. Tá an braiteoir físe bionic seo bunaithe ar fhóta-aistritheoirí déanta as déshilfíd moluibdín.
Grianghraf den eagar braite bithmhiméadach fís (ar chlé); struchtúr scéimreach an aonaid braite fís agus íomhá micreascóp optúil (ar dheis)
"Our research team started work on optoelectronic memory five years ago," said Yang Chai, one of the researchers who developed the vision sensor. "This emerging device can output light-dependent and history-dependent signals, enabling image integration. , Weak signal accumulation, spectral analysis and other complex image processing functions, the multi-functional integration of sensing, data storage and data processing into one device."
In 2018, d'fhoilsigh Yang Chai agus a chomhghleacaithe an chéad pháipéar ar chuimhne optoelectronic, inar thug siad isteach gléas cuimhne lasctha resistive ar féidir leo oibríochtaí braite solais agus loighic a dhéanamh. Bliain ina dhiaidh sin, thug an fhoireann isteach cineál nua de chuimhne rochtana randamach photoresistive le trí fheidhm éagsúla. Go sonrach, is féidir leis an bhfeiste nua an timpeallacht a mhothú, an fhaisnéis a stóráil sa chuimhne, agus oibríochtaí réamhphróiseála amhairc néaramorfacha a dhéanamh.
"We studied the concepts of near-sensor and in-sensor computing paradigms in 2020 and published our views in the field." Yang Chai continued, "This new research on biomimetic vision sensors builds on our On top of all previous efforts."
The intensity of ambient natural light varies widely, with a total range of 280 dB. When the human retina senses external light signals, it adjusts the light sensitivity of its photoreceptors (i.e., rods and cones) according to the strength of the signal. This ultimately enables the human eye to gradually adapt to varying levels of lighting, allowing it to see clearly in both dark and bright environments, an ability known as "visual adaptation."
"For example, when you enter a dark cinema from a bright hall, you can hardly see anything at first, but after a while in the cinema, it becomes easier to see things," explains Yang Chai. "This phenomenon is called scotopic adaptation. Conversely, if you go from a dark movie theater to a sunny outdoors, you'll feel very dazzled at first, and it takes a while to get used to seeing what's going on around you. The process The opposite of dark adaptation is called photopic adaptation."
The main goal of Yang Chai and his colleagues' recent work is to build a vision sensor inspired by the structure and function of the human retina. To do this, they first started by studying the human retina and then tried to design perceptual strategies that would allow them to artificially simulate visual adaptations.
Luaigh{0}}de-na-bhraiteoirí íomhánna ealaíne atá bunaithe ar theicneolaíocht CMOS, go hiondúil go mbíonn raon teoranta dinimiciúil de 70 dB acu. Mar sin féin, tá an raon dinimiciúil seo i bhfad níos cúinge ná an raon soilsithe radhairc nádúrtha (280 dB).
"To achieve visual perception over a wide range of light intensities, researchers have explored the use of controlled optical apertures, liquid lenses, adjustable exposure times, and denoising algorithms in post-processing," said Yang Chai. "However, these Methods often require complex hardware and software resources."
Dark and light adaptation of biomimetic vision sensor arrays. (a) Schematic of the dark adaptation test: recognition of low-light images using an 8 x 8 pixel array in a dark environment. (b) Schematic diagram of light adaptation test: recognition of high-illuminance images using an 8 x 8 pixel array in a bright environment. (c) Dark adaptation process to identify the "8" pattern. (d) The photoadaptation process to identify the "8" pattern.
D’fhéadfadh feidhmchláir an-luachmhara a bheith ag gléasanna optoelectronic a bhfuil fís oiriúnaitheach solais orthu agus raon braite leathan ag teirminéil céadfacha. Mar shampla, is féidir leo cabhrú le feidhmíocht uirlisí fís ríomhaireachta a fheabhsú, an chastacht crua-earraí a theastaíonn chun robots nó córais braite eile a thógáil a laghdú, agus cruinneas na gcóras aitheantais íomhá a fheabhsú.
Cé, d'fhorbair foirne taighde eile feistí optoelectronic ar féidir leo a oiriúnú do choinníollacha soilsithe éagsúla san am atá caite. Mar sin féin, ní féidir leis an gcuid is mó de na feistí a léiríodh roimhe seo ach aithris a dhéanamh ar mheicníocht oiriúnaithe solais an reitine. Bhí sé níos deacra go dtí seo an próiseas oiriúnaithe dorcha a insamhladh.
"There is still a long way to go to fully replicate the visual adaptation function of the retina," explains Yang Chai. "To achieve this, we designed a phototransistor-based vision sensor using ultra-thin semiconductors that can The degree of dark adaptation and light adaptation in the same device was controlled by applying different gate voltages. In this way, we simulated photoreceptors and horizontal cells in the retina and successfully achieved a sensing range of 199 dB. Vision-adaptive devices in biomimetic sensors."
Insamhladh saorga de photoreceptors agus cealla cothrománacha sa reitine le haghaidh oiriúnú amhairc (oiriúnú dorcha agus oiriúnú solais)
Tá an braiteoir fís bithmhiméadach a d'fhorbair Yang Chai agus a chomhghleacaithe bunaithe ar fhótatransistors déanta as ábhar leathsheoltóra ultrathin ar a dtugtar disulfide moluibdín. Tá stáit ilghaistí luchta ag na fóta-trasraitheoirí a d'úsáid siad ar féidir leo leictreoin a ghabháil nó a scaoileadh laistigh den chainéal ag voltas geata éagsúla.
Ultimately, these states allow researchers to dynamically tune the conductance of their devices. This, in turn, allowed them to artificially simulate the dark- and light-adaptive mechanisms of the human retina, thereby expanding the range of their sensor's perception of different lighting conditions.
"Our bionic vision sensor has several advantages and features," said Yang Chai. "First, the visual adaptation function is implemented in a single device, which greatly reduces the footprint. Second, multiple functions can be implemented on a single device. , including light sensing, memory, and processing. Finally, dark and light adaptation under different light intensities can be achieved by controlling its gate voltage."
Rinne Yang Chai agus a chomhghleacaithe measúnú ar an braiteoir fís bionic i sraith tástálacha agus fuarthas amach go bhféadfadh sé aithris a dhéanamh go héifeachtach ar fheidhm an reitine daonna, ag baint amach torthaí suntasacha in oiriúnú dorcha agus éadrom araon. Ina theannta sin, tá raon aireachtála i bhfad níos airde aige (199 dB) i gcomparáid le réitigh a moladh roimhe seo.
"Our vision sensor can enrich machine vision functions, reduce hardware complexity, and achieve high image recognition efficiency," said Yang Chai, "All these advantages are available in areas such as autonomous driving, face recognition, and industrial manufacturing in complex lighting environments. great application prospects."
I staidéir amach anseo, tá sé beartaithe ag na taighdeoirí feidhmíocht an bhraiteora radhairc a fheabhsú tuilleadh, agus é a úsáid freisin chun córais mhórscála a dhéanamh ina bhfuil eagair braiteoirí. Go hidéalach, ba mhaith leo an t-eagar braiteora seo a thógáil ar fhoshraith sholúbtha nó leathsféarúil chun réimse radhairc níos leithne a chumasú.
"One area that needs improvement is the adaptation time of our vision sensor, as it is still not enough to support machine vision applications." Yang Chai added, "Our goal is to reduce the adaptation time to the microsecond level. In addition, the vision sensor array scale Further improvements are also needed. Our near-term target for array size is greater than 100 x 100 pixels. Finally, the heterogeneous integration of vision sensors and post-processing units, including silicon-based control circuits, is a very important step toward practical applications."
Tá GMKJ Technology ag gabháil go mór le foinsí solais sláintiúla agus cliste, ag soláthar raon iomlán de tháirgí UVA UVB UVC LED, infridhearg IR LED VCSEL agus réitigh don mhargadh. Tá na céadta comhpháirtithe ardchaighdeáin aige i margaí baile agus eachtrannacha chun úsáid na teicneolaíochta solais a chur chun cinn le chéile chun saol sláintiúil agus cliste a chruthú. .
