Implant failed. Now what?

One of my lower molars cracked so I had an implant put in. However, it failed to integrate into my bone , so I had it removed, and did a bone graft to prepare for a second try.

I went in for a consultation today and was advised by the surgeon that the rate of failure for a second try is high. And since my chewing ability is not affected, he suggested that we leave it alone and not put another implant in.

It all feels a bit futile to me after all the expense, time and pain to walk away without an implant. But it's also pointless to try and have it fail again.

Did anybody opt for doing nothing after an implant failure? Do you think it's worth a second try?