Выделить слова:


Патент США №	10099610
Автор(ы)	Schofield
Дата выдачи	16 октября 2018 г.

Driver assistance system for a vehicle

РЕФЕРАТ

A driver assistance system for a vehicle includes a vision system, a sensing system and a control. The vision system includes a camera and the sensing system includes a radar sensor. Image data captured by the camera is provided to the control and is processed by an image processor of the control. Responsive to image processing of captured image data, lane markers on the road being traveled along by the equipped vehicle are detected and the control determines a lane being traveled by the equipped vehicle. Radar data generated by the radar sensor is provided to the control, which receives vehicle data relating to the equipped vehicle via a vehicle bus of the equipped vehicle. Responsive at least in part to processing of generated radar data and captured image data, the control detects another vehicle present on the road being traveled along by the equipped vehicle.

Авторы:

Kenneth Schofield (Holland, MI)

Патентообладатель:

Имя	Город	Штат	Страна	Тип
MAGNA ELECTRONICS INC.	Auburn Hills	MI	US

Заявитель:

MAGNA ELECTRONICS INC. (Auburn Hills, MI)

ID семейства патентов

26903905

Номер заявки:

15/289,341

Дата регистрации:

10 октября 2016 г.

Prior Publication Data


	Document Identifier	Publication Date
	US 20170028916 A1	Feb 2, 2017

Отсылочные патентные документы США


Application Number	Filing Date	Patent Number	Issue Date
14997831	Jan 18, 2016	9463744
13919483	Jan 26, 2016	9245448
12483996	Jun 18, 2013	8466806
12058155	Jun 23, 2009	7551103
11735782	Apr 8, 2008	7355524
11108474	Apr 17, 2007	7205904
10209173	Apr 19, 2005	6882287
60309022	Jul 31, 2001

Класс патентной классификации США:	1/1
Класс совместной патентной классификации:	B60Q 1/346 (20130101); B62D 15/029 (20130101); G01S 13/931 (20130101); G08G 1/163 (20130101); G08G 1/167 (20130101); B60R 1/00 (20130101); B60R 11/04 (20130101); G06K 9/00798 (20130101); G06K 9/00805 (20130101); G06K 9/6267 (20130101); H04N 5/247 (20130101); B60Q 9/008 (20130101); B60R 2300/804 (20130101); B60T 2201/08 (20130101); B60T 2201/089 (20130101); G01S 2013/9325 (20130101); G01S 2013/9332 (20130101); G01S 2013/9353 (20130101); G01S 2013/936 (20130101); G01S 2013/9364 (20130101); G01S 2013/9367 (20130101); G01S 2013/9385 (20130101)
Класс международной патентной классификации (МПК):	G08G 1/16 (20060101); B62D 15/02 (20060101); B60Q 1/34 (20060101); B60Q 9/00 (20060101); G01S 13/93 (20060101); B60R 1/00 (20060101); B60R 11/04 (20060101); G06K 9/00 (20060101); G06K 9/62 (20060101); H04N 5/247 (20060101)

Использованные источники

[Referenced By]

Патентные документы США


4200361	April 1980	Malvano
4214266	July 1980	Myers
4218698	August 1980	Bart et al.
4236099	November 1980	Rosenblum
4247870	January 1981	Gabel et al.
4249160	February 1981	Chilvers
4254931	March 1981	Aikens
4266856	May 1981	Wainwright
4277804	July 1981	Robison
4281898	August 1981	Ochiai
4288814	September 1981	Talley et al.
4348652	September 1982	Barnes et al.
4355271	October 1982	Noack
4357558	November 1982	Massoni et al.
4381888	May 1983	Momiyama
4420238	December 1983	Felix
4431896	February 1984	Lodetti
4443057	April 1984	Bauer
4460831	July 1984	Oettinger et al.
4481450	November 1984	Watanabe et al.
4491390	January 1985	Tong-Shen
4512637	April 1985	Ballmer
4521804	June 1985	Bendell
4529275	July 1985	Ballmer
4529873	July 1985	Ballmer
4532550	July 1985	Bendell et al.
4546551	October 1985	Franks
4549208	October 1985	Kamejima et al.
4571082	February 1986	Downs
4572619	February 1986	Reininger
4580875	April 1986	Bechtel
4600913	July 1986	Caine
4603946	August 1986	Kato
4614415	September 1986	Hyatt
4620141	October 1986	McCumber et al.
4623222	November 1986	Itoh
4626850	December 1986	Chey
4629941	December 1986	Ellis
4630109	December 1986	Barton
4632509	December 1986	Ohmi
4638287	January 1987	Umebayashi et al.
4645975	February 1987	Meitzler et al.
4647161	March 1987	Muller
4653316	March 1987	Fukuhara
4669825	June 1987	Itoh
4669826	June 1987	Itoh
4671615	June 1987	Fukada
4672457	June 1987	Hyatt
4676601	June 1987	Itoh
4690508	September 1987	Jacob
4692798	September 1987	Seko et al.
4697883	October 1987	Suzuki
4701022	October 1987	Jacob
4713685	December 1987	Nishimura et al.
4717830	January 1988	Botts
4727290	February 1988	Smith
4731669	March 1988	Hayashi et al.
4741603	May 1988	Miyagi
4758883	July 1988	Kawahara et al.
4768135	August 1988	Kretschmer et al.
4772942	September 1988	Tuck
4789904	December 1988	Peterson
4793690	December 1988	Gahan
4817948	April 1989	Simonelli
4820933	April 1989	Hong
4825232	April 1989	Howdle
4838650	June 1989	Stewart
4847772	July 1989	Michalopoulos et al.
4855822	August 1989	Narendra et al.
4862037	August 1989	Farber et al.
4867561	September 1989	Fujii et al.
4871917	October 1989	O'Farrell et al.
4872051	October 1989	Dye
4881019	November 1989	Shiraishi et al.
4882565	November 1989	Gallmeyer
4886960	December 1989	Molyneux
4891559	January 1990	Matsumoto et al.
4892345	January 1990	Rachael, III
4895790	January 1990	Swanson et al.
4896030	January 1990	Miyaji
4907870	March 1990	Brucker
4910591	March 1990	Petrossian et al.
4916374	April 1990	Schierbeek
4917477	April 1990	Bechtel et al.
4937796	June 1990	Tendler
4953305	September 1990	Van Lente et al.
4956591	September 1990	Schierbeek
4961625	October 1990	Wood et al.
4967319	October 1990	Seko
4970653	November 1990	Kenue
4971430	November 1990	Lynas
4974078	November 1990	Tsai
4975703	December 1990	Delisle et al.
4987357	January 1991	Masaki
4991054	February 1991	Walters
5001558	March 1991	Burley et al.
5003288	March 1991	Wilhelm
5012082	April 1991	Watanabe
5016977	May 1991	Baude et al.
5027001	June 1991	Torbert
5027200	June 1991	Petrossian et al.
5044706	September 1991	Chen
5055668	October 1991	French
5059877	October 1991	Teder
5064274	November 1991	Alten
5072154	December 1991	Chen
5075768	December 1991	Wirtz et al.
5086253	February 1992	Lawler
5096287	March 1992	Kakinami et al.
5097362	March 1992	Lynas
5121200	June 1992	Choi
5124549	June 1992	Michaels et al.
5130709	July 1992	Toyama et al.
5148014	September 1992	Lynam
5166681	November 1992	Bottesch et al.
5168378	December 1992	Black
5170374	December 1992	Shimohigashi et al.
5172235	December 1992	Wilm et al.
5177606	January 1993	Koshizawa
5177685	January 1993	Davis et al.
5182502	January 1993	Slotkowski et al.
5184956	February 1993	Langlais et al.
5189561	February 1993	Hong
5193000	March 1993	Lipton et al.
5193029	March 1993	Schofield
5204778	April 1993	Bechtel
5208701	May 1993	Maeda
5225827	July 1993	Persson
5245422	September 1993	Borcherts et al.
5253109	October 1993	O'Farrell
5276389	January 1994	Levers
5285060	February 1994	Larson et al.
5289182	February 1994	Brillard et al.
5289321	February 1994	Secor
5305012	April 1994	Faris
5307136	April 1994	Saneyoshi
5309137	May 1994	Kajiwara
5313072	May 1994	Vachss
5325096	June 1994	Pakett
5325386	June 1994	Jewell et al.
5329206	July 1994	Slotkowski et al.
5331312	July 1994	Kudoh
5336980	August 1994	Levers
5339075	August 1994	Abst et al.
5341437	August 1994	Nakayama
5351044	September 1994	Mathur et al.
5355118	October 1994	Fukuhara
5374852	December 1994	Parkes
5386285	January 1995	Asayama
5394333	February 1995	Kao
5406395	April 1995	Wilson et al.
5410346	April 1995	Saneyoshi et al.
5414257	May 1995	Stanton
5414461	May 1995	Kishi et al.
5416313	May 1995	Larson et al.
5416318	May 1995	Hegyi
5416478	May 1995	Morinaga
5424952	June 1995	Asayama
5426294	June 1995	Kobayashi et al.
5430431	July 1995	Nelson
5434407	July 1995	Bauer et al.
5434927	July 1995	Brady et al.
5440428	August 1995	Hegg et al.
5444478	August 1995	Lelong et al.
5451822	September 1995	Bechtel et al.
5457493	October 1995	Leddy et al.
5461357	October 1995	Yoshioka et al.
5461361	October 1995	Moore
5467284	November 1995	Yoshioka et al.
5469298	November 1995	Suman et al.
5471515	November 1995	Fossum et al.
5475494	December 1995	Nishida et al.
5487116	January 1996	Nakano et al.
5498866	March 1996	Bendicks et al.
5500766	March 1996	Stonecypher
5510983	April 1996	Iino
5515448	May 1996	Nishitani
5521633	May 1996	Nakajima et al.
5528698	June 1996	Kamei et al.
5529138	June 1996	Shaw et al.
5530240	June 1996	Larson et al.
5530420	June 1996	Tsuchiya et al.
5535314	July 1996	Alves et al.
5537003	July 1996	Bechtel et al.
5539397	July 1996	Asanuma et al.
5541590	July 1996	Nishio
5550677	August 1996	Schofield et al.
5555312	September 1996	Shima et al.
5555555	September 1996	Sato et al.
5568027	October 1996	Teder
5574443	November 1996	Hsieh
5581464	December 1996	Woll et al.
5594222	January 1997	Caldwell
5612883	March 1997	Shaffer et al.
5614788	March 1997	Mullins
5619370	April 1997	Guinosso
5634709	June 1997	Iwama
5642299	June 1997	Hardin et al.
5646612	July 1997	Byon
5648835	July 1997	Uzawa
5650944	July 1997	Kise
5660454	August 1997	Mori et al.
5661303	August 1997	Teder
5666028	September 1997	Bechtel et al.
5668663	September 1997	Varaprasad et al.
5670935	September 1997	Schofield et al.
5673019	September 1997	Dantoni
5675489	October 1997	Pomerleau
5677851	October 1997	Kingdon et al.
5680123	October 1997	Lee
5699044	December 1997	Van Lente et al.
5699057	December 1997	Ikeda et al.
5715093	February 1998	Schierbeek et al.
5724187	March 1998	Varaprasad et al.
5724316	March 1998	Brunts
5737226	April 1998	Olson et al.
5757949	May 1998	Kinoshita et al.
5760826	June 1998	Nayer
5760828	June 1998	Cortes
5760931	June 1998	Saburi et al.
5760962	June 1998	Schofield et al.
5761094	June 1998	Olson et al.
5765116	June 1998	Wilson-Jones et al.
5781437	July 1998	Wiemer et al.
5786772	July 1998	Schofield et al.
5790403	August 1998	Nakayama
5790973	August 1998	Blaker et al.
5793308	August 1998	Rosinski et al.
5793420	August 1998	Schmidt
5796094	August 1998	Schofield et al.
5798575	August 1998	O'Farrell et al.
5835255	November 1998	Miles
5837994	November 1998	Stam et al.
5844505	December 1998	Van Ryzin
5844682	December 1998	Kiyomoto et al.
5845000	December 1998	Breed et al.
5848802	December 1998	Breed et al.
5850176	December 1998	Kinoshita et al.
5850254	December 1998	Takano et al.
5867591	February 1999	Onda
5877707	March 1999	Kowalick
5877897	March 1999	Schofield et al.
5878370	March 1999	Olson
5883739	March 1999	Ashihara et al.
5884212	March 1999	Lion
5890021	March 1999	Onoda
5896085	April 1999	Mori et al.
5899956	May 1999	Chan
5914815	June 1999	Bos
5923027	July 1999	Stam et al.
5929786	July 1999	Schofield et al.
5940120	August 1999	Frankhouse et al.
5949331	September 1999	Schofield et al.
5956181	September 1999	Lin
5959367	September 1999	O'Farrell et al.
5959555	September 1999	Furuta
5963247	October 1999	Banitt
5964822	October 1999	Alland et al.
5971552	October 1999	O'Farrell et al.
5986796	November 1999	Miles
5990469	November 1999	Bechtel et al.
5990649	November 1999	Nagao et al.
6001486	December 1999	Varaprasad et al.
6009336	December 1999	Harris et al.
6020704	February 2000	Buschur
6031484	February 2000	Bullinger et al.
6037860	March 2000	Zander et al.
6037975	March 2000	Aoyama
6049171	April 2000	Stam et al.
6057754	May 2000	Kinoshita et al.
6066933	May 2000	Ponziana
6084519	July 2000	Coulling et al.
6087953	July 2000	DeLine et al.
6097023	August 2000	Schofield et al.
6097024	August 2000	Stam et al.
6107939	August 2000	Sorden
6116743	September 2000	Hoek
6124647	September 2000	Marcus et al.
6124886	September 2000	DeLine et al.
6139172	October 2000	Bos et al.
6144022	November 2000	Tenenbaum et al.
6151539	November 2000	Bergholz et al.
6172613	January 2001	DeLine et al.
6175164	January 2001	O'Farrell et al.
6175300	January 2001	Kendrick
6198409	March 2001	Schofield et al.
6201642	March 2001	Bos
6222447	April 2001	Schofield et al.
6222460	April 2001	DeLine et al.
6226592	May 2001	Luckscheiter et al.
6243003	June 2001	DeLine et al.
6250148	June 2001	Lynam
6259412	July 2001	Duroux
6266082	July 2001	Yonezawa et al.
6266442	July 2001	Laumeyer et al.
6278377	August 2001	DeLine et al.
6281806	August 2001	Smith et al.
6285393	September 2001	Shimoura et al.
6291906	September 2001	Marcus et al.
6292752	September 2001	Franke et al.
6294989	September 2001	Schofield et al.
6297781	October 2001	Turnbull et al.
6302545	October 2001	Schofield et al.
6310611	October 2001	Caldwell
6311119	October 2001	Sawamoto et al.
6313454	November 2001	Bos et al.
6317057	November 2001	Lee
6320176	November 2001	Schofield et al.
6320282	November 2001	Caldwell
6324450	November 2001	Iwama
6326613	December 2001	Heslin et al.
6329925	December 2001	Skiver et al.
6333759	December 2001	Mazzilli
6341523	January 2002	Lynam
6353392	March 2002	Schofield et al.
6360170	March 2002	Ishikawa et al.
6362729	March 2002	Hellmann et al.
6363326	March 2002	Scully
6366213	April 2002	DeLine et al.
6366236	April 2002	Farmer et al.
6370329	April 2002	Teuchert
6388565	May 2002	Bernhard et al.
6388580	May 2002	Graham et al.
6396397	May 2002	Bos et al.
6411204	June 2002	Bloomfield et al.
6411328	June 2002	Franke et al.
6420975	July 2002	DeLine et al.
6424273	July 2002	Gutta et al.
6428172	August 2002	Hutzel et al.
6430303	August 2002	Naoi et al.
6433676	August 2002	DeLine et al.
6433817	August 2002	Guerra
6441748	August 2002	Takagi et al.
6442465	August 2002	Breed et al.
6477464	November 2002	McCarthy et al.
6485155	November 2002	Duroux et al.
6497503	December 2002	Dassanayake et al.
6498620	December 2002	Schofield et al.
6513252	February 2003	Schierbeek et al.
6516664	February 2003	Lynam
6523964	February 2003	Schofield et al.
6534884	March 2003	Marcus et al.
6539306	March 2003	Turnbull
6547133	April 2003	DeVries, Jr. et al.
6553130	April 2003	Lemelson et al.
6559435	May 2003	Schofield et al.
6574033	June 2003	Chui et al.
6578017	June 2003	Ebersole et al.
6587573	July 2003	Stam et al.
6589625	July 2003	Kothari et al.
6593565	July 2003	Heslin et al.
6594583	July 2003	Ogura et al.
6611202	August 2003	Schofield et al.
6611610	August 2003	Stam et al.
6627918	September 2003	Getz et al.
6631316	October 2003	Stam et al.
6631994	October 2003	Suzuki et al.
6636258	October 2003	Strumolo
6648477	November 2003	Hutzel et al.
6650233	November 2003	DeLine et al.
6650455	November 2003	Miles
6672731	January 2004	Schnell et al.
6674562	January 2004	Miles
6678056	January 2004	Downs
6678614	January 2004	McCarthy et al.
6680792	January 2004	Miles
6683969	January 2004	Nishigaki et al.
6690268	February 2004	Schofield et al.
6700605	March 2004	Toyoda et al.
6703925	March 2004	Steffel
6704621	March 2004	Stein et al.
6710908	March 2004	Miles et al.
6711474	March 2004	Treyz et al.
6714331	March 2004	Lewis et al.
6717610	April 2004	Bos et al.
6728623	April 2004	Takenaga et al.
6735506	May 2004	Breed et al.
6741377	May 2004	Miles
6744353	June 2004	Sjonell
6757109	June 2004	Bos
6762867	July 2004	Lippert et al.
6784828	August 2004	Delcheccolo et al.
6794119	September 2004	Miles
6795221	September 2004	Urey
6802617	October 2004	Schofield et al.
6806452	October 2004	Bos et al.
6813370	November 2004	Arai
6822563	November 2004	Bos et al.
6823241	November 2004	Shirato et al.
6824281	November 2004	Schofield
6831261	December 2004	Schofield et al.
6847487	January 2005	Burgner
6873253	March 2005	Veriris
6882287	April 2005	Schofield
6888447	May 2005	Hori et al.
6889161	May 2005	Winner et al.
6891563	May 2005	Schofield et al.
6906639	June 2005	Lemelson et al.
6909753	June 2005	Meehan et al.
6946978	September 2005	Schofield
6953253	October 2005	Schofield et al.
6968736	November 2005	Lynam
6975775	December 2005	Rykowski et al.
7004593	February 2006	Weller et al.
7004606	February 2006	Schofield
7005974	February 2006	McMahon et al.
7038577	May 2006	Pawlicki et al.
7046448	May 2006	Burgner
7062300	June 2006	Kim
7065432	June 2006	Moisel et al.
7085637	August 2006	Breed et al.
7092548	August 2006	Laumeyer et al.
7116246	October 2006	Winter et al.
7123168	October 2006	Schofield
7133661	November 2006	Hatae et al.
7149613	December 2006	Stam et al.
7167796	January 2007	Taylor et al.
7195381	March 2007	Lynam et al.
7202776	April 2007	Breed
7205904	April 2007	Schofield
7224324	May 2007	Quist et al.
7227459	June 2007	Bos et al.
7227611	June 2007	Hull et al.
7249860	July 2007	Kulas et al.
7253723	August 2007	Lindahl et al.
7255451	August 2007	McCabe et al.
7311406	December 2007	Schofield et al.
7325934	February 2008	Schofield et al.
7325935	February 2008	Schofield et al.
7338177	March 2008	Lynam
7339149	March 2008	Schofield et al.
7344261	March 2008	Schofield et al.
7355524	April 2008	Schofield
7360932	April 2008	Uken et al.
7370983	May 2008	DeWind et al.
7375803	May 2008	Bamji
7380948	June 2008	Schofield et al.
7388182	June 2008	Schofield et al.
7402786	July 2008	Schofield et al.
7423248	September 2008	Schofield et al.
7423821	September 2008	Bechtel et al.
7425076	September 2008	Schofield et al.
7459664	December 2008	Schofield et al.
7526103	April 2009	Schofield et al.
7541743	June 2009	Salmeen et al.
7551103	June 2009	Schofield
7561181	July 2009	Schofield et al.
7565006	July 2009	Stam et al.
7616781	November 2009	Schofield et al.
7619508	November 2009	Lynam et al.
7633383	December 2009	Dunsmoir et al.
7639149	December 2009	Katoh
7655894	February 2010	Schofield et al.
7676087	March 2010	Dhua et al.
7720580	May 2010	Higgins-Luthman
7792329	September 2010	Schofield et al.
7843451	November 2010	Lafon
7855778	December 2010	Yung et al.
7859565	December 2010	Schofield et al.
7877175	January 2011	Higgins-Luthman
7881496	February 2011	Camilleri
7914187	March 2011	Higgins-Luthman et al.
7930160	April 2011	Hosagrahara et al.
7991522	August 2011	Higgins-Luthman
7994462	August 2011	Schofield et al.
8017898	September 2011	Lu et al.
8095310	January 2012	Taylor et al.
8098142	January 2012	Schofield et al.
8203440	June 2012	Schofield et al.
8222588	July 2012	Schofield et al.
8224031	July 2012	Saito
8314689	November 2012	Schofield et al.
8324552	December 2012	Schofield et al.
8386114	February 2013	Higgins-Luthman et al.
8466806	June 2013	Schofield
9245448	January 2016	Schofield
9463744	October 2016	Schofield
2001/0031068	October 2001	Ohta
2001/0034575	October 2001	Takenaga et al.
2001/0056326	December 2001	Kirmura
2002/0005778	January 2002	Breed
2002/0113873	August 2002	Williams
2002/0116126	August 2002	Lin
2002/0159270	October 2002	Lynam et al.
2003/0016143	January 2003	Ghazarian
2003/0025597	February 2003	Schofield
2003/0137586	July 2003	Lewellen
2003/0222982	December 2003	Hamdan et al.
2004/0016870	January 2004	Pawlicki et al.
2004/0164228	August 2004	Fogg et al.
2005/0046978	March 2005	Schofield et al.
2005/0219852	October 2005	Stam et al.
2005/0237385	October 2005	Kosaka et al.
2006/0018511	January 2006	Stam et al.
2006/0018512	January 2006	Stam et al.
2006/0050018	March 2006	Hutzel et al.
2006/0091813	May 2006	Stam et al.
2006/0103727	May 2006	Tseng
2006/0250501	November 2006	Wildmann et al.
2007/0104476	May 2007	Yasutomi et al.
2007/0109406	May 2007	Schofield et al.
2007/0120657	May 2007	Schofield et al.
2007/0242339	October 2007	Bradley
2008/0147321	June 2008	Howard et al.
2008/0192132	August 2008	Bechtel et al.
2009/0113509	April 2009	Tseng et al.
2009/0160987	June 2009	Bechtel et al.
2009/0190015	July 2009	Bechtel et al.
2009/0256938	October 2009	Bechtel et al.
2012/0045112	February 2012	Lundblad et al.

Зарубежные патентные документы


0353200	Jan 1990	EP
0426503	May 1991	EP
0492591	Jul 1992	EP
0640903	Mar 1995	EP
0788947	Aug 1997	EP
1074430	Feb 2001	EP
59114139	Jul 1984	JP
6079889	May 1985	JP
6080953	May 1985	JP
6272245	May 1987	JP
S62131837	Jun 1987	JP
6414700	Jan 1989	JP
03099952	Apr 1991	JP
4114587	Apr 1992	JP
H04127280	Apr 1992	JP
0577657	Mar 1993	JP
05050883	Mar 1993	JP
5213113	Aug 1993	JP
6227318	Aug 1994	JP
06267304	Sep 1994	JP
06276524	Sep 1994	JP
06295601	Oct 1994	JP
07004170	Jan 1995	JP
0732936	Feb 1995	JP
0747878	Feb 1995	JP
07052706	Feb 1995	JP
0769125	Mar 1995	JP
07105496	Apr 1995	JP
2630604	Jul 1997	JP
200274339	Mar 2002	JP
2003083742	Mar 2003	JP
20041658	Jan 2004	JP
WO1994019212	Feb 1994	WO
WO1996038319	Dec 1996	WO

Другие источники

Achler et al., "Vehicle Wheel Detector using 2D Filter Banks," IEEE Intelligent Vehicles Symposium of Jun. 2004. cited by applicant .
Borenstein et al., "Where am I? Sensors and Method for Mobile Robot Positioning", University of Michigan, Apr. 1996, pp. 2, 125-128. cited by applicant .
Bow, Sing T., "Pattern Recognition and Image Preprocessing (Signal Processing and Communications)", CRC Press, Jan. 15, 2002, pp. 557-559. cited by applicant .
Broggi et al., "Automatic Vehicle Guidance: The Experience of the ARGO Vehicle", World Scientific Publishing Co., 1999. cited by applicant .
Broggi et al., "Multi-Resolution Vehicle Detection using Artificial Vision," IEEE Intelligent Vehicles Symposium of Jun. 2004. cited by applicant .
Kastrinaki et al., "A survey of video processing techniques for traffic applications". cited by applicant .
Mei Chen et al., AURORA: A Vision-Based Roadway Departure Warning System, The Robotics Institute, Carnegie Mellon University, published Aug. 9, 1995. cited by applicant .
Parker (ed.), McGraw-Hill Dictionary of Scientific and Technical Terms Fifth Edition (1993). cited by applicant .
Philomin et al., "Pedestrain Tracking from a Moving Vehicle". cited by applicant .
Pratt, "Digital Image Processing, Passage--ED.3", John Wiley & Sons, US, Jan. 1, 2001, pp. 657-659, XP002529771. cited by applicant .
Sun et al., "On-road vehicle detection using optical sensors: a review". cited by applicant .
Tokimaru et al., "CMOS Rear-View TV System with CCD Camera", National Technical Report vol. 34, No. 3, pp. 329-336, Jun. 1988 (Japan). cited by applicant .
Van Leeuwen et al., "Motion Estimation with a Mobile Camera for Traffic Applications", IEEE, US, vol. 1, Oct. 3, 2000, pp. 58-63. cited by applicant .
Van Leeuwen et al., "Motion Interpretation for In-Car Vision Systems", IEEE, US, vol. 1, Sep. 30, 2002, p. 135-140. cited by applicant .
Van Leeuwen et al., "Real-Time Vehicle Tracking in Image Sequences", IEEE, US, vol. 3, May 21, 2001, pp. 2049-2054, XP010547308. cited by applicant .
Van Leeuwen et al., "Requirements for Motion Estimation in Image Sequences for Traffic Applications", IEEE, US, vol. 1, May 24, 1999, pp. 145-150, XP010340272. cited by applicant .
Vellacott, Oliver, "CMOS in Camera," IEE Review, pp. 111-114 (May 1994). cited by applicant .
Vlacic et al., (Eds), "Intelligent Vehicle Tecnologies, Theory and Applications", Society of Automotive Engineers Inc., edited by SAE International, 2001. cited by applicant .
Wang et al., CMOS Video Cameras, article, 1991, 4 pages, University of Edinburgh, UK. cited by applicant .
Zheng et al., "An Adaptive System for Traffic Sign Recognition," IEEE Proceedings of the Intelligent Vehicles '94 Symposium, pp. 165-170 (Oct. 1994). cited by applicant.

Главный эксперт: Swarthout; Brent
Уполномоченный, доверенный или фирма: Honigman Miller Schwartz and Cohn, LLP

Текст решения-прецедента

ПЕРЕКРЁСТНАЯ ССЫЛКА НА "РОДСТВЕННЫЕ" ЗАЯВКИ

This application is a continuation of U.S. patent application Ser. No. 14/997,831, filed Jan. 18, 2016, now U.S. Pat. No. 9,463,744, which is a continuation of U.S. patent application Ser. No. 13/919,483, filed Jun. 17, 2013, now U.S. Pat. No. 9,245,448, which is a continuation of U.S. patent application Ser. No. 12/483,996, filed Jun. 12, 2009, now U.S. Pat. No. 8,466,806, which is a continuation of U.S. patent application Ser. No. 12/058,155, filed Mar. 28, 2008, now U.S. Pat. No. 7,551,103, which is a continuation of U.S. patent application Ser. No. 11/735,782, filed Apr. 16, 2007, now U.S. Pat. No. 7,355,524, which is a continuation of U.S. patent application Ser. No. 11/108,474, filed Apr. 18, 2005, now U.S. Pat. No. 7,205,904, which is a continuation of U.S. patent application Ser. No. 10/209,173, filed on Jul. 31, 2002, now U.S. Pat. No. 6,882,287, which claims priority from U.S. provisional application Ser. No. 60/309,022, filed on Jul. 31, 2001, the disclosures of which are hereby incorporated herein by reference in their entireties.

ФОРМУЛА ИЗОБРЕТЕНИЯ

The invention claimed is:

1. A driver assistance system for a vehicle, said driver assistance system comprising: a vision system comprising a first camera disposed at a vehicle equipped with said driver assistance system, said first camera having a field of view forward of the equipped vehicle that encompasses a road being traveled along by the equipped vehicle; wherein the road has at least three lanes comprising (i) a first lane along which the vehicle is traveling, (ii) a second lane immediately adjacent the first lane, and (iii) a third lane immediately adjacent the second lane at the opposite side of the second lane from the first lane; a control disposed at or in the equipped vehicle and comprising a data processor; wherein said data processor comprises an image processor; wherein image data captured by said first camera is provided to said control and is processed by said image processor; wherein said data processor processes data at a processing speed of at least 30 MIPS; wherein, responsive to processing by said image processor of image data captured by said first camera, lane markers on the road being traveled along by the equipped vehicle are detected; wherein, responsive to processing by said image processor of image data captured by said first camera, said control determines the first, second and third lanes of the road being traveled by the equipped vehicle; a sensing system operable to detect other vehicles present exterior the equipped vehicle; wherein said sensing system comprises a second camera disposed at the equipped vehicle and having a field of view at least rearward and sideward of the equipped vehicle as the equipped vehicle travels along the road; wherein said sensing system further comprises a radar sensor disposed at the equipped vehicle and having a field of sensing at least rearward and sideward of the equipped vehicle as the equipped vehicle travels along the road; wherein image data captured by said second camera is provided to said control; wherein radar data generated by said radar sensor is provided to said control; wherein said control receives vehicle data relating to the equipped vehicle via a vehicle bus of the equipped vehicle; wherein, responsive at least in part to processing at said data processor of radar data generated by said radar sensor and of image data captured by said second camera, said control detects another vehicle present on the road being traveled along by the equipped vehicle and approaching the equipped vehicle from its rear; wherein, with the equipped vehicle traveling along the first lane, and responsive at least in part to processing at said data processor of radar data generated by said radar sensor and of image data captured by said second camera, said control determines that the other vehicle is travelling in a next but one lane to the lane the second lane or in the third lane of the road along which the equipped vehicle is travelling; wherein, responsive to determination that the other vehicle is approaching the equipped vehicle and is traveling in the second lane, and responsive to said control detecting a lane change maneuver of the equipped vehicle toward the second lane, said control generates an alert that a lane change by the equipped vehicle from the first lane to the second lane is not safe; and wherein, responsive to determination that the other vehicle is approaching the equipped vehicle and is traveling in the third lane, and responsive to said control detecting a lane change maneuver of the equipped vehicle toward the second lane, said control determines that a lane change from the first lane to the second lane can proceed without hazard of impact with the other vehicle detected travelling in the third lane.

2. The driver assistance system of claim 1, wherein said control is operable to detect a lane change maneuver of the equipped vehicle to a lane adjacent to the lane the equipped vehicle is travelling along.

3. The driver assistance system of claim 2, wherein said radar sensor comprises a Doppler radar sensor.

4. The driver assistance system of claim 2, wherein, responsive at least in part to processing at said data processor of image data captured by said second camera, said control develops a vehicle path history of the other vehicle.

5. The driver assistance system of claim 4, wherein determination by said control that the lane change can proceed without hazard of impact with the other vehicle detected travelling in the third lane utilizes said vehicle path history.

6. The driver assistance system of claim 1, wherein said radar sensor has a field of sensing to a side of and rearward of the equipped vehicle as the equipped vehicle travels along the road.

7. The driver assistance system of claim 6, wherein said control is operable to detect a lane change maneuver of the equipped vehicle from the first lane to the second lane.

8. The driver assistance system of claim 7, wherein detection of the lane change maneuver by said control is based at least in part on vehicle steering data received at said control via said bus.

9. The driver assistance system of claim 7, wherein, responsive to said control detecting the lane change maneuver of the equipped vehicle, said control determines that the lane change can proceed without hazard of impact with the other vehicle detected approaching from the rear in the third lane.

10. The driver assistance system of claim 9, wherein said vehicle bus system comprises at least one of (a) a CAN bus of the vehicle and (b) a LIN bus of the vehicle.

11. The driver assistance system of claim 10, wherein the other vehicle detected in the third lane is overtaking the equipped vehicle.

12. The driver assistance system of claim 11, wherein said control determines a position history of the other vehicle.

13. The driver assistance system of claim 7, wherein detection of the lane change maneuver by said control is irrespective of activation by a driver of the equipped vehicle of a turn signal indicator of the equipped vehicle.

14. The driver assistance system of claim 1, wherein said vision system further comprises at least one other camera disposed at the equipped vehicle and having a field of view exterior the equipped vehicle, and wherein said sensing system further comprises at least one other radar sensor disposed at the equipped vehicle and having a field of sensing exterior the equipped vehicle, and wherein image data captured by said at least one other camera is provided to and processed at said control, and wherein radar data generated by said at least one other radar sensor is provided to and processed at said control.

15. The driver assistance system of claim 1, wherein said camera comprises a forward-viewing camera disposed in an interior cabin of the equipped vehicle at and behind a windshield of the equipped vehicle and viewing through the windshield to capture image data at least forward of the equipped vehicle.

16. The driver assistance system of claim 15, wherein, responsive at least in part to processing of radar data generated by said radar sensor and of image data captured by said camera, said control determines a hazard of collision of the equipped vehicle with another vehicle.

17. The driver assistance system of claim 16, wherein, responsive at least in part to said control determining said hazard of collision with the other vehicle, said control controls a system of the equipped vehicle to mitigate potential collision with the other vehicle that is in hazard of collision with the equipped vehicle.

18. The driver assistance system of claim 17, wherein, responsive at least in part to said control determining said hazard of collision, said control controls activation of at least one of (i) a horn system of the equipped vehicle to mitigate potential collision with the other vehicle that is in hazard of collision with the equipped vehicle and (ii) a lighting system of the equipped vehicle to mitigate potential collision with the other vehicle that is in hazard of collision with the equipped vehicle.

19. The driver assistance system of claim 17, wherein, responsive at least in part to said control determining said hazard of collision, said control controls a wireless transmission system of the equipped vehicle to transmit a safety warning to the other vehicle that is in hazard of collision with the equipped vehicle.

20. A driver assistance system for a vehicle, said driver assistance system comprising: a vision system comprising a first camera disposed at a vehicle equipped with said driver assistance system, said first camera having a field of view forward of the equipped vehicle that encompasses a road being traveled along by the equipped vehicle; wherein the road has at least three lanes comprising (i) a first lane along which the vehicle is traveling, (ii) a second lane immediately adjacent the first lane, and (iii) a third lane immediately adjacent the second lane at the opposite side of the second lane from the first lane; wherein said first camera comprises a forward-viewing camera disposed in an interior cabin of the equipped vehicle at and behind a windshield of the equipped vehicle and viewing through the windshield to capture image data at least forward of the equipped vehicle; a control disposed at or in the equipped vehicle and comprising a data processor; wherein said data processor comprises an image processor; wherein image data captured by said first camera is provided to said control and is processed by said image processor; wherein said data processor processes data at a processing speed of at least 30 MIPS; wherein, responsive to processing by said image processor of image data captured by said first camera, lane markers on the road being traveled along by the equipped vehicle are detected; wherein, responsive to processing by said image processor of image data captured by said first camera, said control determines the first, second and third lanes of the road being traveled by the equipped vehicle; a sensing system operable to detect other vehicles present exterior the equipped vehicle; wherein said sensing system comprises a first radar sensor disposed at the equipped vehicle and having a field of sensing exterior of the equipped vehicle as the equipped vehicle travels along the road; wherein radar data generated by said first radar sensor is provided to said control; wherein said control receives vehicle data relating to the equipped vehicle via a vehicle bus of the equipped vehicle; wherein said vision system further comprises a second camera disposed at the equipped vehicle and having a field of view at least rearward and sideward of the equipped vehicle as the equipped vehicle travels along the road, and wherein said sensing system further comprises a second radar sensor disposed at the equipped vehicle and having a field of sensing at least rearward and sideward the equipped vehicle as the equipped vehicle travels along the road, and wherein image data captured by said second camera is provided to and processed at said control, and wherein radar data generated by said second radar sensor is provided to and processed at said control; wherein, responsive at least in part to processing at said data processor of radar data generated by at least one of said first and second radar sensors of said sensing system and of image data captured by at least one of said first and second cameras of said vision system, said control determines a hazard of collision of the equipped vehicle with another vehicle; wherein, with the equipped vehicle traveling along the first lane, and responsive at least in part to processing at said data processor of radar data generated by said radar sensor and of image data captured by said second camera, said control determines that the other vehicle is travelling in the second lane or in the third lane of the road along which the equipped vehicle is travelling; wherein, responsive to determination that the other vehicle is approaching the equipped vehicle and is traveling in the second lane, and responsive to said control detecting a lane change maneuver of the equipped vehicle toward the second lane, said control generates an alert that a lane change by the equipped vehicle from the first lane to the second lane is not safe; wherein, responsive to determination that the other vehicle is approaching the equipped vehicle and is traveling in the third lane, and responsive to said control detecting a lane change maneuver of the equipped vehicle toward the second lane, said control determines that a lane change from the first lane to the second lane can proceed without hazard of impact with the other vehicle detected travelling in the third lane; and wherein, responsive at least in part to said control determining said hazard of collision with the other vehicle, said control controls a system of the equipped vehicle to mitigate potential collision with the other vehicle.

21. The driver assistance system of claim 20, wherein, responsive at least in part to said control determining said hazard of collision, said control controls activation of at least one of (i) a horn system of the equipped vehicle to mitigate potential collision with the other vehicle that is in hazard of collision with the equipped vehicle and (ii) a lighting system of the equipped vehicle to mitigate potential collision with the other vehicle.

22. The driver assistance system of claim 20, wherein, responsive at least in part to said control determining said hazard of collision, said control controls a wireless transmission system of the equipped vehicle to transmit a safety warning to the other vehicle.

23. The driver assistance system of claim 20, wherein the other vehicle is approaching the equipped vehicle from rearward of the equipped vehicle, and wherein said control is operable to detect a lane change maneuver of the equipped vehicle to the second lane the equipped vehicle is travelling along, and wherein detection of the lane change maneuver by said control is based at least in part on vehicle steering data received at said control via said bus.

24. The driver assistance system of claim 23, wherein radar data generated by at least one of said first and second radar sensors of said sensing system and image data captured by at least one of said first and second cameras of said vision system are fused at said control.

25. The driver assistance system of claim 23, wherein radar data generated by at least one of said first and second radar sensors of said sensing system and image data captured by said first camera of said vision system are fused at said control.

26. The driver assistance system of claim 23, wherein said first radar sensor has a field of sensing to a side of and rearward of the equipped vehicle as the equipped vehicle travels along the road, and wherein radar data generated by said first radar sensor of said sensing system and image data captured by at least one of said first and second cameras of said vision system are fused at said control.

27. The driver assistance system of claim 23, wherein, responsive at least in part to processing at said data processor of at least one of (i) radar data generated by at least one of said first and second radar sensors of said sensing system and (ii) image data captured by at least one of said first and second cameras of said vision system, said control determines that the other vehicle is travelling in the third lane.

28. A driver assistance system for a vehicle, said driver assistance system comprising: a vision system comprising a first camera disposed at a vehicle equipped with said driver assistance system, said first camera having a field of view that encompasses a road being traveled along by the equipped vehicle; wherein said first camera comprises a forward-viewing camera disposed in an interior cabin of the equipped vehicle at and behind a windshield of the equipped vehicle and viewing through the windshield to capture image data at least forward of the equipped vehicle; wherein the road has at least three lanes comprising (i) a first lane along which the vehicle is traveling, (ii) a second lane immediately adjacent the first lane, and (iii) a third lane immediately adjacent the second lane at the opposite side of the second lane from the first lane; a control disposed at or in the equipped vehicle and comprising a data processor; wherein said data processor comprises an image processor; wherein image data captured by said first camera is provided to said control and is processed by said image processor; wherein said data processor processes data at a processing speed of at least 30 MIPS; wherein, responsive to processing by said image processor of image data captured by said first camera, lane markers on the road being traveled along by the equipped vehicle are detected; wherein, responsive to processing by said image processor of image data captured by said first camera, said control determines the first, second and third lanes of the road being traveled by the equipped vehicle; a sensing system operable to detect other vehicles present exterior the equipped vehicle; wherein said sensing system comprises a first radar sensor disposed at the equipped vehicle and having a field of sensing exterior of the equipped vehicle as the equipped vehicle travels along the road; wherein radar data generated by said first radar sensor is provided to said control; wherein said control receives vehicle data relating to the equipped vehicle via a vehicle bus of the equipped vehicle; wherein said first radar sensor has a field of sensing at least to a side of and rearward of the equipped vehicle as the equipped vehicle travels along the road; wherein said sensing system further comprises a second camera disposed at the equipped vehicle and having a field of view at least rearward and sideward of the equipped vehicle as the equipped vehicle travels along the road; wherein image data captured by said second camera is provided to said control; wherein, responsive at least in part to processing at said data processor of radar data generated by said first radar sensor and of image data captured by said second camera, said control detects another vehicle present on the road being traveled along by the equipped vehicle that is approaching the equipped vehicle from rearward of the equipped vehicle; wherein said control is operable to detect a lane change maneuver of the equipped vehicle toward the second lane; wherein detection of the lane change maneuver by said control is based at least in part on vehicle steering data received at said control via said bus; wherein, responsive to said control detecting a lane change maneuver of the equipped vehicle, said control determines that the lane change can proceed without hazard of impact with the other vehicle approaching the equipped vehicle from rearward of the equipped vehicle; wherein, with the equipped vehicle traveling along the first lane, and responsive at least in part to processing at said data processor of radar data generated by said first radar sensor and of image data captured by said second camera, said control determines that the other vehicle is travelling in the second lane or in the third lane of the road along which the equipped vehicle is travelling; wherein, responsive to determination that the other vehicle is approaching the equipped vehicle and is traveling in the second lane, and responsive to said control detecting a lane change maneuver of the equipped vehicle toward the second lane, said control generates an alert that a lane change by the equipped vehicle from the first lane to the second lane is not safe; and wherein, responsive to determination that the other vehicle is approaching the equipped vehicle and is traveling in the third lane, and responsive to said control detecting a lane change maneuver of the equipped vehicle toward the second lane, said control determines that a lane change from the first lane to the second lane can proceed without hazard of impact with the other vehicle detected travelling in the third lane.

29. The driver assistance system of claim 28, wherein said vehicle bus system comprises a CAN bus of the equipped vehicle.

30. The driver assistance system of claim 28, wherein said control determines a position history of the other vehicle approaching the equipped vehicle from rearward of the equipped vehicle.

31. The driver assistance system of claim 28, wherein detection of the lane change maneuver by said control is irrespective of activation by a driver of the equipped vehicle of a turn signal indicator of the equipped vehicle.

32. The driver assistance system of claim 28, wherein said sensing system further comprises a second radar sensor disposed at the equipped vehicle and having a field of sensing exterior the equipped vehicle, and wherein image data captured by said second camera is provided to and processed at said control, and wherein radar data generated by said second radar sensor is provided to and processed at said control.

33. The driver assistance system of claim 32, wherein, responsive at least in part to processing of radar data generated by at least one of said first and second radar sensors of said sensing system and of image data captured by at least one of said first and second cameras of said vision system, said control determines a hazard of collision of the equipped vehicle with the other vehicle approaching the equipped vehicle from rearward of the equipped vehicle.

34. The driver assistance system of claim 33, wherein, responsive at least in part to said control determining said hazard of collision with the other vehicle approaching the equipped vehicle from rearward of the equipped vehicle, said control controls a system of the equipped vehicle to mitigate potential collision with the other vehicle approaching the equipped vehicle from rearward of the equipped vehicle.

35. The driver assistance system of claim 34, wherein radar data generated by at least one of said first and second radar sensors of said sensing system and image data captured by at least one of said first and second cameras of said vision system are fused at said control.

36. The driver assistance system of claim 34, wherein radar data generated by at least one of said first and second radar sensors of said sensing system and image data captured by said first camera of said vision system are fused at said control.

37. The driver assistance system of claim 34, wherein radar data generated by said first radar sensor of said sensing system and image data captured by at least one of said first and second cameras of said vision system are fused at said control.

ОПИСАНИЕ

ОБЛАСТЬ ТЕХНИКИ ИЗОБРЕТЕНИЯ

This invention relates to object detection adjacent a motor vehicle as it travels along a highway, and more particularly relates to imaging systems that view the blind spot adjacent a vehicle and/or that view the lane adjacent the side of a vehicle and/or view the lane behind or forward the vehicle as it travels down a highway.

УРОВЕНЬ ТЕХНИКИ ИЗОБРЕТЕНИЯ

Camera-based systems have been proposed, such as in commonly assigned patent application Ser. No. 09/372,915, filed Aug. 12, 1999, now U.S. Pat. No. 6,396,397, the disclosure of which is hereby incorporated herein by reference, that detect and display the presence, position of, distance to and rate of approach of vehicles, motorcycles, bicyclists, and the like, approaching a vehicle such as approaching from behind to overtake in a side lane to the vehicle. The image captured by such vehicular image capture systems can be displayed as a real-time image or by icons on a video screen, and with distances, rates of approach and object identifiers being displayed by indicia and/or overlays, such as is disclosed in U.S. Pat. Nos. 5,670,935; 5,949,331 and 6,222,447, the disclosures of which are hereby incorporated herein by reference. Such prior art systems work well. However, it is desirable for a vehicle driver to have visual access to the full 360 degrees surrounding the vehicle. It is not uncommon, however, for a vehicle driver to experience blind spots due to the design of the vehicle bodywork, windows and the rearview mirror system. A blind spot commonly exists between the field of view available to the driver through the exterior rearview mirror and the driver's peripheral limit of sight. Blind Spot Detection Systems (BSDS), in which a specified zone, or set of zones in the proximity of the vehicle, is monitored for the presence of other road users or hazardous objects, have been developed. A typical BSDS may monitor at least one zone approximately one traffic lane wide on the left- or right-hand side of the vehicle, and generally from the driver's position to approximately 10 m rearward. The objective of these systems is to provide the driver an indication of the presence of other road users located in the targeted blind spot.

Imaging systems have been developed in the prior art, such as discussed above, to perform this function, providing a visual, audio or tactile warning to the driver should a lane change or merge maneuver be attempted when another road user or hazard is detected within the monitored zone or zones. These systems are typically used in combination with a system of rearview mirrors in order to determine if a traffic condition suitable for a safe lane change maneuver exists. They are particularly effective when the detected object is moving at a low relative velocity with reference to the detecting vehicle, since the detected object may spend long periods of time in the blind spot and the driver may lose track of surrounding objects. However, prior art systems are inadequate in many driving conditions.

Known lane departure warning systems typically rely on visually detecting markers on the road on both sides of the vehicle for lane center determination. These markers must be fairly continuous or frequently occurring and generally must exist on both sides of the vehicle for the lane center position to be determined. Failure to detect a marker usually means failure of the departure-warning algorithm to adequately recognize a lane change event.

СУЩНОСТЬ ИЗОБРЕТЕНИЯ

The present invention provides a Lane Change Aid (LCA) system wherein the driver of a motor vehicle traveling along a highway is warned if any unsafe lane change or merge maneuver is attempted, regardless of information available through the vehicle's rearview mirror system. The Lane Change Aid (LCA) system of the present invention extends the detection capability of the blind spot detection systems of the prior art.

A vehicle lane change aid system, according to an aspect of the invention, includes a detector that is operative to detect the presence of another vehicle adjacent the vehicle, an indicator for providing an indication that a lane change maneuver of the equipped vehicle may affect the other vehicle and a control receiving movement information of the equipped vehicle. The control develops a position history of the equipped vehicle at least as a function of the movement information. The control compares the detected presence of the other vehicle with the position history and provides the indication when a lane change maneuver may affect the other vehicle.

A vehicle lane change aid system, according to an aspect of the invention, includes an imaging device for capturing lane edge images and a control that is responsive to an output of the imaging device to recognize lane edge positions. The control is operable to distinguish between certain types of lane markers. The control may distinguish between dashed-lane markers and non-dashed-line markers.

A vehicle lane change aid system, according to an aspect of the invention, includes an imaging device for capturing lane edge images and a control that is responsive to an output of the imaging device to recognize lane edge positions. The control is operative to determine that the vehicle has departed a lane. The control may notify the driver that a lane has been departed. The control may further include oncoming vehicle monitoring and side object detection.

A vehicle lane change aid system, according to an aspect of the invention, includes a forward-facing imaging device for capturing images of other vehicles and a control that is responsive to an output of the imaging device to determine an imminent collision with another vehicle. The control may include a wireless transmission channel to transmit a safety warning to the other vehicle. The control may also activate a horn or headlights of the equipped vehicle of an imminent collision.

These and other objects, advantages and features of this invention will become apparent upon review of the following specification in conjunction with the drawings.

КРАТКОЕ ОПИСАНИЕ РИСУНКОВ

FIGS. 1A-1C are top plan views illustrating a vehicle equipped with a lane change aid system, according to the invention, traveling a straight section of road;

FIG. 2 is a block diagram of a lane change aid system, according to the invention; and

FIG. 3 is a top plan view illustrating a vehicle equipped with a lane change aid system traveling a curved section of road.

DESCRIPTION OF THE PREFERRED EMBODIMENT

Referring to the drawings and the illustrative embodiments depicted therein, a Lane Change Aid (LCA) system 12 of the present invention as illustrated with a vehicle 10 includes a control 18 and an indicator and/or display system 16 that warns a vehicle operator if an intended, or attempted, lane change maneuver could cause an approaching rearward vehicle to brake and decelerate at an unsafe rate, or that otherwise constitutes a highway hazard. In Lane Change Aid (LCA) system 12, the dimension, in the direction of travel, of a zone 20 to be monitored may be calculated based on an assumed maximum relative velocity between a detecting vehicle and an approaching rearward vehicle, and a safe braking and deceleration assumption. Depending on the assumptions made, the required detection zone may vary in length, such as extending rearward from 50 to 100 m, or more. At 100 m, the road curvature behind the vehicle may have a significant impact on the position of the lane of the detected vehicle, relative to the detecting vehicle. Since it is important to know which lane an approaching rearward vehicle is in, relative to the detecting vehicle, in order to provide the driver an appropriate warning, and to avoid many false warnings, the Lane Change Aid (LCA) system 12 includes developing and maintaining a lane position history 20 for the space rearward of the detecting vehicle.

By combining distance traveled with steering angle, the detecting vehicle path may be plotted. Details of the last approximately 100 m traveled are of value for lane change aids and may be stored by the Lane Change Aid (LCA) system. Data may be stored by several methods including the method described below.

Vehicle speed information in the Lane Change Aid (LCA) system 12 is typically derived from a wheel rotation sensor signal 24, which consists of a number of pulses, n, per revolution of the road wheel, and available on a vehicle data bus 26, such as a CAN or LIN bus, or the like. Sensing and signal detail may vary depending on vehicle design, but for any particular design, a distance, d, traveled between pulses can be established. Also, as each pulse is detected, the current value of the steering angle, +/-.alpha., determined by a steering angle encoder 22 may be read from vehicle data bus 26. Again, the sensing and signal detail may vary depending on vehicle design, but, for any particular vehicle design, an effective turning radius, r, for the vehicle can be established.

Image-based blind spot detection devices and lane change aids, generally shown at 14, are but two of a variety of sensing devices and technologies and devices suitable for the purpose of monitoring the local environment in which a vehicle operates. Radar, infrared, sonar, and laser devices are all capable of interrogating the local environment for the presence of other road users or obstacles to be avoided. GPS systems can accurately determine the vehicle position on the earth's surface, and map data can provide detailed information of a mobile local environment. Other wireless communication systems 28 such as short-range wireless communication protocols, such as BLUETOOTH, can provide information such as the position of road works, lane restrictions, or other hazards, which can be translated by on-board vehicle electronics into position data relative to the vehicle position. Lane Change Aid (LCA) system 12 may integrate all the available information from a multiplicity of sensors including non-image-based detectors 14b, such as a radar sensor, such as a Doppler radar sensor, and at least one image-based detector 14a such as a CMOS video camera imaging sensor, and converts the various sensor outputs into a single database with a common format, so that data from various sources, such as a Doppler radar source and a video camera source, may be easily compared, combined and maintained.

Consider a spherical space of radius R, and center (x, y, z)=(0, 0, 0) in Cartesian coordinates or (r, .theta., .beta.=(0,0,0)) in polar coordinates. It is convenient to describe the space in both coordinate systems since several operations will be used to fill the data space and to maintain it and a choice of systems allows for efficient computation methods. Let the center of this space (0, 0, 0) be at the center of the vehicle's rear axle, or nominal rear axle described by the line which passes through the center of the two rear non-steering wheels. Let the horizontal centerline of the vehicle, in the primary direction of travel, lie on (x, 0, 0), such that positive x values describe the space forward of the center of the vehicle's rear axle. Let the rear axle coincide with (0, y, 0), such that positive values of y describe the space to the right of the vehicle centerline when looking forward. (R, 90, 0) describes the positive y axis. Let positive z values describe the space above the centerline of the rear axle. (R, 0, 90) describes the positive z axis. This "sphere of awareness" 20 moves with the vehicle as it moves through space and provides a common frame of reference for all sensed or otherwise derived data concerning the vehicle's local environment.

For the purpose of storing vehicle path data, which may be used to improve the performance of lane change aid 12, the discussion may be simplified by considering only the horizontal plane. The use of polar coordinates simplifies operations used in this application. The first data point, as the vehicle starts with no history, is at point (0, 0). The steering angle is read from the data bus and stored as .alpha..sub.0. When wheel rotation pulse, p.sub.1 is detected, steering angle .alpha..sub.1 is recorded. Since the distance traveled between wheel pulses is known to be d, a new position for the previous data point can be calculated as ([2(1-Cos .alpha..sub.0))]1/2, (180+.alpha..sub.0)). This point is stored and recorded as historical vehicle path data. When pulse p.sub.2 is detected, the above calculation is repeated to yield ([2(1-Cos .alpha..sub.1)]1/2, (180+.alpha..sub.1)) as the new position for the previous data point. This requires the repositioning of the original data to ([2(1-Cos .alpha..sub.0)]1/2+[2(1-Cos .alpha..sub.1)]1/2, [(180+.alpha..sub.0)+.alpha..sub.1]). This process is continued until the distance from the vehicle, R, reaches the maximum required value, such as 100 m in the case of a lane change aid. Data beyond this point is discarded. Thus, a continuous record of the vehicle path for the last 100 m, or whatever distance is used, may be maintained. By maintaining a running record of the path traveled, rearward approaching vehicles detected by a lane change aid image analysis system may be positioned relative to that path as can be seen by comparing the other vehicle 40 in FIGS. 1B and 1C. In FIG. 1B, other vehicle 40 is overlapping zone 20 so an indication of potential conflict may be delayed or discarded. In FIG. 1C, the other vehicle 40 is moving outside of other vehicle 40 and in a blind spot of vehicle 10 so an indication of potential conflict would be given to the driver with indicator 16. Thus, a determination may be made if the approaching vehicle is in the same, adjacent or next but one lane, etc. By this means, the number of inappropriate or unnecessary warnings may be reduced.

Lane change aid system 12 may include a controller, such as a microprocessor including a digital signal processor microcomputer of CPU speed at least about 5 MIPS, more preferably at least about 12 MIPS and most preferably at least about 30 MIPS, that processes inputs from multiple cameras 14a and other sensors 14b and that includes a vehicle path history function whereby, for example, an object, such as a rear-approaching car or motorcycle or truck, or the like, is selected and its presence highlighted to the driver's attention, such as by icons on a dashboard or interior mirror-mounted display, based on the recent history of the side and rear lanes that the host vehicle equipped with the controller of this invention has recently traveled in. An example is over a previous interval of about 60 seconds or less, or over a longer period such as about 3 minutes or more. The vehicle path history function works to determine the lane positioning of an approaching other vehicle, and whether the host vehicle is traveling on, or has recently traveled on, a straight road as illustrated in FIGS. 1A, 1B and 1C, or a curved road portion as illustrated in FIG. 3.

Control 18 may comprise a central video processor module such as is disclosed in commonly assigned provisional patent application Ser. No. 60/309,023, filed Jul. 31, 2001, and utility patent application filed concurrently herewith, now U.S. patent application Ser. No. 10/209,181, filed Jul. 31, 2002, and published Feb. 6, 2003 as U.S. Publication No. US 2003/0025793, the disclosures of which are hereby incorporated herein by reference. Such video processor module operates to receive multiple image outputs from vehicle-mounted cameras, such as disclosed in commonly assigned patent application Ser. No. 09/793,002, filed Feb. 26, 2001, now U.S. Pat. No. 6,690,268, the disclosure of which is hereby incorporated herein by reference, and integrates these in a central processing module to allow reaction to the local vehicle environment. Optionally, and when bandwidth limitations exist that limit the ability to send raw image data, particularly high-resolution images, from a remote camera to a central processing unit across robust transmission means, such as a fiber-optic cable or a high-density wireless link, distributed processing can occur, at least local to some of the image capture sensors. In such an at least partial distributed processing environment, the local processors are adapted to preprocess images captured by the local camera or cameras and any other device such as a Doppler radar sensor viewing a blind spot in an adjacent side lane and to format this preprocessed data into a standard format and transmit this standard formatted data. The data can be transmitted via a wired network or a wireless network or over a vehicle bus system, such as a CAN bus and/or a LIN bus, or the like, to the central processor for effective, centralized mapping and combination of the total local environment around the vehicle. This provides the driver with a display of what is happening in both the right and the left side lanes, and in the lane that the host vehicle is itself traveling in.

In this regard, the vehicle can be provided with a dedicated bus and central processor, as described above, for providing a vehicle environment awareness, which can be both internal such as might be provided by interior cabin or trunk monitors/sensors that determine occupant presence, head position and/or movement, eye movement, air bag deployment, microphone aiming, seat positioning, air conditioning and/or heating targeting, audio controls, and the like, or can be external to the vehicle such as in blind spot detecting or lane change detecting. The present invention includes provision of an automatic environment awareness function that comprises automatic gathering of sensor-derived data collection and transmission in a standard format via a vehicle bus network, the data including data relating to the vehicle environment such as the exterior environment, for example, the presence of rear-approaching traffic in side and rear lanes to the host vehicle as captured by rear-facing CMOS or CCD cameras on the side of the host vehicle, such as included in a side view mirror assembly on either or both sides of the host vehicle and/or as detected by a rear lane/side lane-viewing Doppler radar sensor, and preferably includes processing in a central video processing unit.

The information relating to the external environment can be relayed/displayed to the driver in a variety of ways. For example, a blind-spot vehicle-presence indication can be displayed adjacent the exterior mirror assembly, such as inside the vehicle cabin local to where the exterior mirror assembly is attached to the vehicle door so that the indicator display used, typically an LED flashing light source, or the like, is visible to the driver but not visible to any traffic/drivers exterior to the vehicle, but is cognitively associated with the side of the vehicle to which that particular nearby exterior mirror is attached to, and as disclosed in commonly assigned U.S. Pat. Nos. 5,786,772; 5,929,786 and 6,198,409, the disclosures of which are hereby incorporated herein by reference. Optionally, a vibration transducer can be included in the steering wheel that trembles or otherwise vibrates to tactilely warn the driver of the presence of an overtaking vehicle in a side lane that the driver is using the steering wheel to turn the driver's vehicle into where an overtaking or following vehicle may constitute a collision hazard. Hazard warnings can be communicated to the driver by voice commands and/or audible warnings, and/or by heads-up-displays. The coordinate scheme for data collection of the present invention enables an improved blind spot and/or lane change detection system for vehicles and particularly in busy traffic on a winding, curved road.

The present invention includes the fusion of outputs from video and non-video sensors, such as, for example, a CMOS video camera sensor and a Doppler radar sensor, to allow all-weather and visibility side object detection. The present invention includes the fusion of outputs from video and non-video sensors, such as, for example, a CMOS video camera sensor and a Doppler radar sensor, to allow all-weather and visibility side object detection. The present invention can be utilized in a variety of applications such as disclosed in commonly assigned U.S. Pat. Nos. 5,670,935; 5,949,331; 6,222,447; 6,201,642; 6,097,023; 5,715,093; 5,796,094 and 5,877,897 and commonly assigned patent application Ser. No. 09/793,002 filed Feb. 26, 2001, now U.S. Pat. No. 6,690,268, Ser. No. 09/372,915, filed Aug. 12, 1999, now U.S. Pat. No. 6,396,397, Ser. No. 09/767,939, filed Jan. 23, 2001, now U.S. Pat. No. 6,590,719, Ser. No. 09/776,625, filed Feb. 5, 2001, now U.S. Pat. No. 6,611,202, Ser. No. 09/799,993, filed Mar. 6, 2001, now U.S. Pat. No. 6,538,827, Ser. No. 09/493,522, filed Jan. 28, 2000, now U.S. Pat. No. 6,426,492, Ser. No. 09/199,907, filed Nov. 25, 1998, now U.S. Pat. No. 6,717,610, Ser. No. 08/952,026, filed Nov. 19, 1997, now U.S. Pat. No. 6,498,620, Ser. No. 09/227,344, filed Jan. 8, 1999, now U.S. Pat. No. 6,302,545, International Publication No. WO 96/38319, published Dec. 5, 1996, and International Publication No. WO 99/23828, published May 14, 1999, the disclosures of which are collectively incorporated herein by reference.

Lane change aid system 12 may include a lane marker type recognition algorithm, or capability 32. Lane marker type recognition capability 32 utilizes classifying lane markers as one of many specific types for the purpose of interpreting the original purpose of the lane marker and issuing reliable and meaningful warnings based on this interpretation. As an example, a double line on the left side of a left-hand drive vehicle typically indicates a no-encroachment zone or no passing zone. A solid line with adjacent dashed line will indicate either an ability to pass safely if the dashed line is on the near side of the solid line or a do not encroach zone if the dashed line is on the far side of the solid line. Road edges can be distinctly recognized and classified as no-encroachment zones. Conversely, dashed lines may have no significance to lane departure warning algorithms since they merely indicate lane edge positions. Recognizing dashed lines as such gives the ability to not initiate nuisance warnings. The recognition algorithm can further be enhanced by recognizing road features when lane markers are too weak or missing. Features, such as curbs, road seams, grease or rubber slicks, road signs, vehicles in same, neighboring, and/or opposing lanes when recognized, could be used to interpret lane-vehicle positioning and issue intelligent warning alerts to the driver. Fewer false or nuisance type warnings with improved real warning functionality and speed can be realized with this improvement. Operation under difficult lighting and environmental conditions can be extended.

Note that collision avoidance functionality 34 can optionally be achieved using a forward-facing camera 14a in the present invention. For example, should the forward-looking camera detect an oncoming car likely to collide with the vehicle equipped with the present invention, or if another vehicle tries to pull in front of it, the system of the present invention can issue a warning (visual and/or audible) to one or both drivers involved. Such warning can be flash headlights and/or sound car horn. Similarly, the system can detect that the driver of the vehicle equipped with the present invention is failing to recognize a stop sign and/or a signal light, or some other warning sign and the driver can be warned visually, such as with a warning light at the interior mirror in the vehicle cabin, or audibly, such as via a warning beeper, or tactilely, such as via a rumble/vibration transducer that vibrates the steering wheel to alert the driver of a potential hazard.

System 12 may also include a lane departure warning algorithm, or system 36. For example, when a left-hand drive vehicle equipped with system 10 is making a left-hand turn generally across a line on the road. System 36 can monitor for a lane crossing and combine it with detection of an oncoming vehicle. The system 12 may also calculate closing speed for warning of potential impact of closing vehicles.

Also, the vehicle can be provided on its front fender or elsewhere at the front of the vehicle with a side-looking camera as an image-based detector 14a operable to warn the driver when he/she is making a left turn across lanes of traffic coming from his/her left (left-side warning) and then again when he/she is about to enter traffic lanes with traffic coming from his right (right-side warning). While executing this turn, the system of the present invention may utilize the detection of the lane markers when the driver's car is about to enter the specific lane combined with oncoming vehicle detection as a means of predictive warning before he actually enters the danger zone.

System 12 is also capable of performing one or more vehicle functions 30. For example, should the lane departure warning system 36 detect that the vehicle equipped with the system is intending to make or is making a lane change and the driver has neglected to turn on the appropriate turn signal indicators, then the system performs a vehicle function 30 of automatically turning on the turn signals on the appropriate side of the vehicle.

The lane departure warning system 36 of the present invention is operable to differentiate between solid and dashed lines and double lines on the road being traveled. Also, should the vehicle be equipped with a side object detection (SOD) system such as a Doppler radar unit or a camera vision side object detection system that detects the presence of overtaking vehicles in the adjacent side lane, then the SOD system can work in conjunction with the lane departure warning system such that as the lane departure system detects that the driver is making a lane change into a side lane when the SOD system detects an overtaking vehicle in that same side lane, then the driver is alerted and warned of the possible hazard, such as by a visual, audible and/or tactile alert.

As indicated above, the forward-facing camera can include stoplight or sign detection, and the system can further include a broadcast with wireless communication system 28 on a safety warning band when the forward-facing camera detects the stoplight or sign and determines the vehicle is not going to stop based on current speed and deceleration. This would warn crossing drivers of an unsafe condition. Such alerts can dynamically vary depending on road surface conditions (wet, snow, ice, etc.) as visually detected and determined by the forward-facing, road-monitoring camera. For example, wet or snowy roads would change the distance and/or speed at which it would warn based on camera vision recognition of stoplights and/or stop signs. When approaching a stoplight when it changes or the vehicle does not slow down for the light after the driver was warned, the system can blow the horn and/or flash the lights to warn vehicles at the stoplight of the oncoming vehicle. The car may also broadcast one of the safety alerts radar detectors pick up.

Changes and modifications in the specifically described embodiments can be carried out without departing from the principles of the invention, which is intended to be limited only by the scope of the appended claims, as interpreted according to the principles of patent law including the doctrine of equivalents.

* * * * *

Патент США №

Автор(ы)

Дата выдачи