Artificial intelligence enables people who are blind to “see”

An app that allows people who are blind to identify the world directly in front of them using machine vision technology.

This short video shows the reactions of first users: Youtube clip

Media release

Artificial intelligence enables blind people to “see”

Students at Singularity University have created an app that allows blind people to identify the world directly in front of them using machine vision technology.

The app, Aipoly, is an intelligent assistant for the visually impaired that empowers them to explore and understand their surroundings through computer vision and audio-feedback.

“The power is in helping us construct the mental picture. And not everybody has the same skill at creating mental images,” says Steve Mahan, president of the Santa Clara Blind Centre and Google’s self-driving car’s first user. “Most of us are trying to do [that]. Knowing where we are is sometimes more than an address.”

The user takes a picture that is automatically uploaded to the Aipoly servers, where it is analysed and tagged, and a description is sent back and read out loud using text-to-speech. This means that blind people may be able to see what their kids are wearing each day, recognise street signs, find objects that are out of reach, and have freedom to purchase gifts for their friends by themselves.

The machine vision algorithm is optimised for use by the visually impaired with training in street signs and objects commonly used by blind people.

Machine vision, or computer vision, is an exponential technology that has more than doubled in accuracy between 2012 and 2013. Convolutional neural networks are used to identify the elements within a picture and neural image caption generation to feed back a semantic description of its content.

There are 285M visually impaired people in the world and in the next 5 years, two thirds of them will become smartphone users.

As for the bigger vision, “developing this technology further could help us identify and search for objects around our homes and outdoors like we do with websites online,” says Aipoly cofounder Alberto Rizzoli.

Singularity University was founded in 2008 by Ray Kurzweil, a pioneer in blind technology having created optical character recognition (OCR) and the first text-to-speech synthesizer, with over 40 years of experience in the field.

“This complements the work that Ray Kurzweil has done,” says Aipoly cofounder and 2012 Young Australian of the Year Marita Cheng. “In every focus group, people mention a Kurzweil technology they use to get about their daily lives.”

Singularity University students learn about using exponential technologies to impact the lives of a billion people within 10 years. The Aipoly technology will be showcased at Singularity University’s Demo Day on 18 August at NASA AMES Research Park in Mountain View.

Aipoly is now looking for beta testers from around the world. Beta testers of all visual abilities (including fully sighted and blind) are sought.

Press kit, video, photos, logo, images:

Contact:
Marita Cheng
Cofounder, Aipoly
+1 (650) 695-7409
marita.cheng@singularityu.org

Computer vision and mobile technology could help people with vision disabilities

Source: Global Accessibility News

UK: Computer scientists are developing new adaptive mobile technology which could enable people who are blind or have low vision to ‘see’ through their smartphone or tablet.

Mobile phones could help people who are blind ‘see’. Aqeel Qureshi Funded by a Google Faculty Research Award, specialists in computer vision and machine learning based at the University of Lincoln, UK, are aiming to embed a smart vision system in mobile devices to help people with sight problems navigate unfamiliar indoor environments.

Based on preliminary work on assistive technologies done by the Lincoln Centre for Autonomous Systems, the team plans to use colour and depth sensor technology inside new smartphones and tablets, like the recent Project Tango by Google, to enable 3D mapping and localisation, navigation and object recognition. The team will then develop the best interface to relay that to users – whether that is vibrations, sounds or the spoken word.

Project lead Dr Nicola Bellotto, an expert on machine perception and human-centred robotics from Lincoln’s School of Computer Science, said: “This project will build on our previous research to create an interface that can be used to help people with vision disabilities.

“There are many visual aids already available, from guide dogs to cameras and wearable sensors. Typical problems with the latter are usability and acceptability. If people were able to use technology embedded in devices such as smartphones, it would not require them to wear extra equipment which could make them feel self-conscious. There are also existing smartphone apps that are able to, for example, recognise an object or speak text to describe places. But the sensors embedded in the device are still not fully exploited. We aim to create a system with ‘human-in-the-loop’ that provides good localisation relevant to visually impaired users and, most importantly, that understands how people observe and recognise particular features of their environment.”

The research team, which includes Dr Oscar Martinez Mozos, a specialist in machine learning and quality of life technologies, and Dr Grzegorz Cielniak, who works in mobile robotics and machine perception, aims to develop a system that will recognise visual clues in the environment. This data would be detected through the device camera and used to identify the type of room as the user moves around the space.

A key aspect of the system will be its capacity to adapt to individual users’ experiences, modifying the guidance it provides as the machine ‘learns’ from its landscape and from the human interaction. So, as the user becomes more accustomed to the technology, the quicker and easier it would be to identify the environment.

The research team will work with a Google sponsor and will be collaborating with specialists at Google throughout the ‘Active Vision with Human-in-the-Loop for the Visually Impaired’ project.

Blind Citizens Australia Appoints New Executive Officer

22 June 2015

Blind Citizens Australia’s position as the united voice of blind and vision-impaired Australians has been secured through the appointment of Leah van Poppel as its new Executive Officer. Leah is well-known to BCA members and across the blindness sector as a former Policy Officer with BCA and through her current role with the Australian Federation of Disability Organisations (AFDO).

Leah brings significant strategic development and policy skills along with her personal experience of vision-impairment to the role. The board is delighted to have the opportunity to work with her to grow our organisation.

The board also takes this opportunity to publicly acknowledge and sincerely thank Tony Iezzi for his extraordinary work as Operations Manager over the past five months.

Tony has tirelessly and passionately steered BCA through a period of significant challenge. Without his management expertise and his willingness to take on the role at short notice, our organisation would have floundered. We wish Tony all the very best for the future.

Tony will continue in his role until the end of August. Leah will commence on 3 August.

The board also wishes to acknowledge the support of Brooker Consulting and the work of the recruitment subcommittee throughout the recruitment process.

Greg Madson
President
Blind Citizens Australia

Media contact: Emma Bennison, 0410 553 383

Australian Banknotes: Assisting People with Vision Impairment

Bulletin – March Quarter 2015
Australian Banknotes: Assisting People with Vision Impairment
Kylie Springer, Priya Subramanian and Terence Turton

Abstract:

A key function of the Reserve Bank is to design and produce banknotes that meet the needs of all sections of the community. The Bank has consulted a wide range of subject matter experts and stakeholders to ensure that the next generation of Australia’s banknotes reflects Australia’s cultural identity, is secure and remains functional. One aspect of functionality is that the banknotes are accessible to people with vision impairment. This article outlines the work the Bank has undertaken to meet the needs of the vision-impaired community, from the paper decimal banknote series that was issued in 1966 through to the forthcoming next generation series of banknotes.

Australian Banknotes: Assisting People with Vision Impairment – YouTube Clip

View transcript

Disability groups granted temporary funding reprieve

The Sydney Morning Herald
Date: March 1, 2015
Julia May

Federal government delays a 40 per cent funding cut to the disability sector amid allegations it was in breach of United Nations convention.

The federal government has made a partial backflip on its cuts to disability groups, granting a temporary reprieve to eight bodies whose funding was due to run out on Saturday.

Last month the Department of Social Services announced it would cut funding to the disability sector by 40 per cent and support an alliance of just five representative bodies. It left eight bodies representing 200,000 people with disabilities under threat and sparked allegations that the government was in breach of the United Nations convention on the rights of disabled people.

But on Thursday the eight organisations – including the Australian Federation of Disability Organisations, Blind Citizens Australia, Brain Injury Australia and Inclusion Australia, representing people with an intellectual disability – were told they had secured “transition funding” of $450,000 until the end of June.

Assistant Social Services Minister Mitch Fifield said he decided to extend the groups’ funding and to “provide an additional payment to each of them to assist with a smooth transition”.
“I have also directed my department to explore other potential capacity-building projects and funding that may be suitable for organisations to apply for, such as NDIS preparedness activities,” he said. The minister did not explain what prompted the change of heart, what “capacity-building” meant or how much extra funding would be available.

Australian Federation of Disability Organisations chief executive Matthew Wright welcomed the reprieve, saying the government had listened to the voice of people with disability. He said he had noticed a new willingness from the department to engage with the sector.
“That’s definitely a positive and a very recent development,” he said. “We’re looking forward to further negotiations on our long-term future.”

Greens Senator Rachel Siewert, who is leading a Senate inquiry into how the Department of Social Services awards funding, also applauded the funding extension but questioned the government’s plans beyond June. She said the new alliance model did not reflect the grassroots needs or views of people with disabilities and accusing the government of being “top-down in its approach: this is what we want, now do it”.

The funding cuts had attracted the ire of Ron McCallum, the former chairman of the United Nations Committee on the Rights of Disabled Persons, and former disability commissioner, Graeme Innes.