Recognizing Textures with Mobile Cameras for Pedestrian Safety Applications

by   Shubham Jain, et al.

As smartphone rooted distractions become commonplace, the lack of compelling safety measures has led to a rise in the number of injuries to distracted walkers. Various solutions address this problem by sensing a pedestrian's walking environment. Existing camera-based approaches have been largely limited to obstacle detection and other forms of object detection. Instead, we present TerraFirma, an approach that performs material recognition on the pedestrian's walking surface. We explore, first, how well commercial off-the-shelf smartphone cameras can learn texture to distinguish among paving materials in uncontrolled outdoor urban settings. Second, we aim at identifying when a distracted user is about to enter the street, which can be used to support safety functions such as warning the user to be cautious. To this end, we gather a unique dataset of street/sidewalk imagery from a pedestrian's perspective, that spans major cities like New York, Paris, and London. We demonstrate that modern phone cameras can be enabled to distinguish materials of walking surfaces in urban areas with more than 90 identify when pedestrians transition from sidewalk to street.


page 4

page 5

page 6

page 10


Acoustic-based Object Detection for Pedestrian Using Smartphone

Walking while using a smartphone is becoming a major pedestrian safety c...

APE: An Open and Shared Annotated Dataset for Learning Urban Pedestrian Path Networks

Inferring the full transportation network, including sidewalks and cycle...

Impact of Urban Micromobility Technology on Pedestrian and Rider Safety: A Field Study Using Pedestrian Crowd-Sensing

The proliferation of micromobility vehicles, such as e-scooters, as last...

Flying Guide Dog: Walkable Path Discovery for the Visually Impaired Utilizing Drones and Transformer-based Semantic Segmentation

Lacking the ability to sense ambient environments effectively, blind and...

Enabling WiFi P2P-Based Pedestrian Safety App

Recent studies reported a significant increase in the number of accident...

Herd Routes: A Preventative IoT-Based System for Improving Female Pedestrian Safety on City Streets

Over two thirds of women of all ages in the UK have experienced some for...

Detecting, identifying, and localizing radiological material in urban environments using scan statistics

A method is proposed, based on scan statistics, to detect, identify, and...

Please sign up or login with your details

Forgot password? Click here to reset