AI Detects Heart Failure from One Heartbeat: Study

126 点作者 rusht超过 5 年前

21 条评论

corodra超过 5 年前

Wasn't a similar claim made about an AI detecting skin cancer from moles? Once the AI was deployed in the real world is failed miserably. I think it was a ton of false-positives because it was trained on images where cancerous moles all had images of rulers with them and the benign ones didn't have rulers in the image. So it just picked up on the ruler as a cancer indicator.

评论 #21293275 未加载

评论 #21291288 未加载

评论 #21294505 未加载

评论 #21291627 未加载

Cass超过 5 年前

As a doctor as opposed to an AI researcher, so many of the choices this study makes are baffling to me.First of all, why just one heartbeat? You never capture just one heartbeat on an ECG anyway, and "Is the next heartbeat identical to the first one?" is such an important source of information, it seems completely irrational to exclude it. At least pick TWO heartbeats. If you're gonna pick one random heartbeat, how do you know you didn't pick an extra systole on accident? (Extra systoles look different, and often less healthy, than "normal" heart beats, as they originate from different regions of the heart.)Secondly, why heart failure and not a heart attack? One definition of heart failure is "the heart is unable to pump sufficiently to maintain blood flow to meet the body's needs," which can be caused by all sorts of factors, many of them external to the actual function of the heart - do we even know for sure that there are ANY ECG changes definitely tied to heart failure? Why not instead try to detect heart attacks, which cause well-defined and well-researched known ECG changes?(I realize AIs that claim to be able to detect heart attacks already exist. None of the ones I've personally worked with have ever been usable. The false positive rate is ridiculously high. I suppose maybe some research hospital somewhere has a working one?)

评论 #21295687 未加载

评论 #21297759 未加载

et2o超过 5 年前

I'm going to sound like a skeptical jerk here, but 490,000 heartbeats is how many patients? From what I recall these public ECG datasets are like 20 patients who underwent longitudinal ECGs. 500k heart beats is like 5 person-days of ECG recordings.Ninja Edit: N=~30 patients. For something like ECGs which are readily available, they really should have tried to get more patients. A single clinic anywhere does than 30 EKGs per day. Suggesting this is clinically applicable is ridiculous. It's way too easy to overfit. Chopping up a time series from one patient into 1000 pieces doesn't give you 1000x the patients.I even think this approach probably will work. Very reasonable given recent work from Geisinger and Mayo. But why are ML people doing press releases about such underwhelming studies?

评论 #21293449 未加载

评论 #21292665 未加载

评论 #21291302 未加载

评论 #21293268 未加载

评论 #21291634 未加载

评论 #21291832 未加载

brilee超过 5 年前

So first clarification is that heart failure != heart attack. Heart failure is a chronic condition where the heart is unable to pump hard enough to keep blood flowing through the body. Typically results in blood pooling in the leg, shortness of breath, etc.The study avoids the obvious pitfall, which is to put different slices of one patient's data into both training and test. The press also reports the training accuracy (100%) when the test accuracy/sensitivity/precision metrics are all at around 98%.Another encouraging sign is that when you dig into the 2% error rate, a majority of those errors turned out to be mislabeled data.The study also acknowledges the following:"Our study must also be seen in light of its limitations... First the CHF subjects used in this study suffer from severe CHF only...could yield less accurate results for milder CHF."I think this is a good proof of concept but that the severe CHF and tiny sample size (33 patients) means that we're a long ways away from clinical usage.

评论 #21293521 未加载

评论 #21293440 未加载

qiqitori超过 5 年前

Pff, I can detect heart failure with no heartbeats at all.

评论 #21291650 未加载

binalpatel超过 5 年前

Discussion of this on /r/machinelearning:<a href="https://www.reddit.com/r/MachineLearning/comments/dj5psh/n_new_ai_neural_network_approach_detects_heart/" rel="nofollow">https://www.reddit.com/r/MachineLearning/comments/dj5psh/n_n...</a>

评论 #21292103 未加载

fencepost超过 5 年前

This is interesting, but more because it indicates that there's adequate data in a single heartbeat to do such diagnosis. In practical terms it's probably not nearly so relevant because it sounds like they were working with the raw data not tracing. By the time you have a patient hooked up to the proper equipment to do this diagnosis you're going to be getting adequate data anyway.The main impact might be that if this holds up people could be tested with a short hook up in an office instead of with a 24-hour monitoring where they have to bring back a Holter device the next day. Of course, that 24 hour dataset may have independent value of its own for further diagnostics beyond just whether the patient has CHF.

评论 #21294510 未加载

ryanschneider超过 5 年前

IMO, the important part is Section 3.3 of the [paper](<a href="https://www.sciencedirect.com/science/article/pii/S1746809419301776" rel="nofollow">https://www.sciencedirect.com/science/article/pii/S174680941...</a>), particularly the image at [<a href="https://ars.els-cdn.com/content/image/1-s2.0-S1746809419301776-gr4_lrg.jpg](https://ars.els-cdn.com/content/image/1-s2.0-S1746809419301776-gr4_lrg.jpg)" rel="nofollow">https://ars.els-cdn.com/content/image/1-s2.0-S17468094193017...</a>. To my eye the difference in shape of the orange and green signals could also be found through more traditional signal processing/statistical means that machine learning.In a past job I did a combination of manual and machine-learning-based analysis of cardiac signals. We didn't have ECG, but did have PPG (blood flow) and PCG (sound) signals, and a pretty large study group. I recall there being one study participant who's signals were very clearly indicative of heart failure, enough that we raised the issue with our medical advisor about whether the subject should be deanonymized and contacted. In the paper they state that "the CHF subjects used in this study suffer from severe CHF only"; my suspicion is that a simpler, "hand rolled" model based on the features of the ECG could compete very well with this CNN approach for finding the same level of pathology in the ECG signal, without the "black box" of a CNN casting doubt on the technique.

nradov超过 5 年前

Congestive heart failure can also be detected fairly reliably based on a sudden increase in weight. It causes fluid retention. There are several programs underway to give Internet connected scales to high risk patients and those report weight every day.

评论 #21294109 未加载

nycbenf超过 5 年前

Heart failure patient here. This is kinda cool but tempered a bit by the fact that I've seen multiple cardiologists make a diagnosis by just glancing at a 12 lead ECG sheet. There are some pretty recognizable hallmarks.

mikece超过 5 年前

Perhaps the title/premise might best be summarized as based on everything we know we can detect heart failure form monitoring one's body for one heartbeat.Along with doing a lot of good and making a lot of early catches, I suspect that relying on AI to do medical analysis is going to bring into sharp relief just how much medical science DOESN'T know about the human body and its mysteries. I think we're a long, long way away from handling medical science over to AI and the real fun of AI-guided exploration is about to begin.

kbody超过 5 年前

Clickbait title aside. I find that ethical issues around AI raised by Musk etc. shouldn't be around AI taking over the planet, but rather have ethics around overfitted models or otherwise unrealistic models being pushed for PR or whatever and responsibly playing with people's health and hopes.

querious超过 5 年前

One of our simplest “screening” questions for DS roles at my company is: “your model is 100% accurate. How do you feel?” If the answer is anything other than deep skepticism (Data leakage, trivial dataset etc), it’s a big red flag

wil421超过 5 年前

How long until society becomes Gattaca? Sorry citizen our “AI” has detected genetic anomalies you will be a disposable factory worker. The rich would surely pay for their children to be genetically altered.

评论 #21291918 未加载

logicbombr超过 5 年前

last year we've started to cloud recording obstetric ultrasound videos. we add more than 17,000 ultrasound exams to our platform each month. It's probably the largest dataset in the world of obstetric ultrasounds videos (~ 300,000 exams). reading news like this makes me think about how we can explore our dataset using ML/AI and help produce better diagnosis. I have no idea how (We're not an AI company).If someone here wants to start a project with AI on top of ultrasounds, I'm all in.let me know at hn at angra.ltd and I can give more details

评论 #21291522 未加载

评论 #21293495 未加载

godelzilla超过 5 年前

I guess adding "Congestive" to the title would've ruined the click bait.Also how can the detection of a progressive disease be 100% accurate? I guess details ruin the click bait too.

ryanmcbride超过 5 年前

Don't see any mention of how many false-positives they had in the article so... Yeah we'll see how effective this actually is.

conjectures超过 5 年前

Guy detects bullshit from one headline.

m3kw9超过 5 年前

Or zero heart beat

counterpig超过 5 年前

if it doesn't beat the heart has failed.

cat199超过 5 年前

Dear Elizabeth Holmes,I found a great startup opportunity for you.- Recruiter