Bing Text to Speech API, Microsoft Cognitive Services.To get an idea of what this API can do, play around with it. You'll need to generate a free key replace the TODO section in the code with your key to make this extension work on your machine. Computer Vision API, Microsoft Cognitive Services.You’ll notice that, even when the Computer Vision API is analyzing some CGI images, it’s very accurate! I’m really impressed by the progress the industry has made on this in recent months. The video below demonstrates it in Edge, Chrome, Firefox, Opera and Brave. When you click on one of the images, the extension queries the Computer Vision API to get some descriptive text for the image and then uses either the Web Speech API or Bing Speech API to share it with the visitor. My little proof of concept simply extracts images from a web page (the one in the active tab) and displays the thumbnails in a list. Indeed, using today’s AI algorithms in the cloud, as well as text-to-speech technologies, exposed in the browser with the Web Speech API or using a remote cloud service, we can very easily build an extension that analyzes web page images with missing or improperly filled alt text properties. I was recently inspired while listening to a great talk by Chris Heilmann in Lisbon: “ Pixels and Hidden Meaning in Pixels.” Still, I’ve been looking for something that would help blind people in a more general way. In my case, I’m concerned with accessibility on the web and I’ve already spent some time thinking about how to make a breakout game accessible using web audio and SVG, for instance. We’ll see that, with a few lines of code, we can create some powerful features in the browser. Let’s build a proof of concept - an extension that uses artificial intelligence (AI) and computer vision to help the blind analyze images on a web page. Don’t worry: Building one is simple and straightforward. So, if you’ve never built an extension before or don’t know how it works, have a quick look at those resources.
0 Comments
Leave a Reply. |
Details
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |