"Ah--" When Popp asked him if he remembered his grandfather, Avan was expecting that Popp had gotten a memory of the man, not... the after. That statement's not quite enough for him to nail down exactly what memory Popp got, but it certainly does narrow down the possibilities. None of it's anything he really wants to talk about, but he should at least clarify.

"I think you might have misunderstood the situation, Popp," he says with a nervous, awkward smile. "My grandfather wasn't especially famous or well-connected; at least, not more than any other noble. Anyone who informed us that they wouldn't be at the funeral only did that much out of a sense of propriety. We were never actually expecting any of them to come."

So it's totally fine that they didn't, see? Don't think too hard about why that was the expectation and how that's where the actual injustice lies, okay?