Skin cancer phone apps aren't very accurate: study

NEW YORK Wed Jan 16, 2013 4:10pm EST

Related Topics

NEW YORK (Reuters Health) - Smartphone applications that use algorithms to analyze skin lesions may not be very good at determining which ones are cancerous, a new study suggests.

The apps are marketed as educational only and so aren't covered as medical devices under the Food and Drug Administration's regulations.

But that may not stop some people from relying on the inexpensive tools instead of going to see a dermatologist, researchers said - which could mean slower diagnosis of potentially dangerous lesions.

"There's no substitute, at this point, for a complete skin exam performed by an expert dermatologist for picking up melanoma as well as other skin cancers," said Dr. Karen Edison, a dermatologist from University of Missouri in Columbia who wasn't involved in the new study.

"Just sending a picture to someone you don't know anywhere in the world can be reassuring if it's very clear that (the lesion) is benign, so that's a good thing," she told Reuters Health, "but it's kind of fraught with other issues that we haven't grappled with adequately, I don't think."

For example, even if an app makes a correct diagnosis of melanoma, that doesn't necessarily help if the patient doesn't know where to get a biopsy or doesn't have insurance to pay for it, Edison said. "We're all for technology, but we need to keep it in perspective, and make it a tool."

For the new study, researchers used photos of 188 pre-diagnosed lesions - 60 melanomas and 128 benign lesions - to check the accuracy of four Smartphone apps made to look for melanoma in previously-taken images.

Three of those apps, which cost under $5 to own, use algorithms to determine whether a lesion is likely to be cancerous or not. The fourth sends images to a certified dermatologist for evaluation, at a price of $5 per lesion.

Of the three algorithm-based apps, the most accurate still missed 18 of the 60 melanomas, mistakenly classifying them as lower-risk, Dr. Laura Ferris from the University of Pittsburgh Medical Center in Pennsylvania and her colleagues reported Wednesday in JAMA Dermatology.

App users "need to know that that's a pretty big risk to take," Ferris said.

"If you delay removal or evaluation for your melanoma, it gets deeper, and the chance of it spreading and getting deadly really increases with time," she told Reuters Health.

The dermatologist consultation app did better than the others, misdiagnosing just one out of 53 evaluable images of cancerous lesions.

All but one of the apps classified more than half of the benign, non-cancerous lesions as problematic.

The researchers said they chose not to release the commercial names of the apps evaluated because their purpose was to determine the accuracy of this type of tool, in general.

The website of a similar company that markets an app for skin lesion analysis using real-time photos, SkinVision, cautions customers to, "Never disregard professional medical advice, or delay in seeking it, because of something you have read on SkinVision. Do not rely on information from SkinVision instead of seeking professional medical advice."

Likewise, the website for the Mole Detective app says, "Always defer to a medical professional if you feel that a mole looks suspicious. Mole Detective's intent is not to diagnosis but to help you better track the symptoms of melanoma at home."

Ferris said there are certain dermatology apps that can help patients.

"There are apps that will do things like teach you about melanomas," she said. "There are ones that will remind you to do your own skin check - that's great."

Both researchers said teledermatology - giving people who live in rural areas, for example, the chance to consult with a dermatologist through photos or video - can be useful. Edison, for example, once used it to diagnose a farmer living hours away with melanoma during harvest season.

But they agreed that for now - and probably for the foreseeable future - machines and apps can't beat in-person exams when it comes to checking for skin cancer.

SOURCE: bit.ly/QidEGa JAMA Dermatology, online January 16, 2013.

FILED UNDER:
We welcome comments that advance the story through relevant opinion, anecdotes, links and data. If you see a comment that you believe is irrelevant or inappropriate, you can flag it to our editors by using the report abuse links. Views expressed in the comments do not represent those of Reuters. For more information on our comment policy, see http://blogs.reuters.com/fulldisclosure/2010/09/27/toward-a-more-thoughtful-conversation-on-stories/
Comments (1)
elhamb3166 wrote:
Speaking to the three apps that use algorithms in lieu of a trained human expert to evaluate the possible melanoma–

Who in their right mind would trust software written by some unknown individual who probably does not have any sort of formal medical training much less a degree in computer science to tell them if they had a potentially deadly skin cancer?

Moreover, is the resolution and color field on every phone camera appropriate for obtaining photographs of high enough quality that a general purpose ‘one size fits all’ application would even have a better than coin-flip chance at making a correct diagnoses?

Oh, well–its just a cheap phone app so no harm done.

Jan 18, 2013 10:08am EST  --  Report as abuse
This discussion is now closed. We welcome comments on our articles for a limited period after their publication.

A tourist takes a plunge as she swims at Ngapali Beach, a popular tourist site, in the Thandwe township of the Rakhine state, October 6, 2013. Picture taken October 6, 2013. REUTERS/Soe Zeya Tun (MYANMAR - Tags: SOCIETY) - RTR3FOI0

Where do you want to go?

We look at when to take trips, budget considerations and the popularity of multigenerational family travel.   Video