Just head back.

"Given that we seem to be heading to the monastery soon, it might be better to just go for now, and resume this later," Byleth replied, now knowing Jeralt would be coming soon.

"Awww..." Sothis pouted, but didn't argue, instead going right back into the lamp. 'Well, I'll be looking forward to exploring your sexual side more later, Master!' her voice chimed in his head.

To be honest, he was looking forward to it as well as he packed the lamp onto his travel bag. Which he found a bit odd. He'd never had that much interest in sexual intercourse in the past. He had indulged on occasion after coming of age, usually with an attractive and flirty barmaid, and he would admit those were enjoyable experiences, but he wasn't exactly looking for more opportunities to indulge constantly.

As he walked back towards the direction of Jeralt, he wondered why he was suddenly more interested in sex. 'Eh, it probably has to do with our link, Master,' Sothis, apparently getting the gist of his thoughts, explained in his head. "I got turned into a sexual being after all, so I now have a huge libido! I bet some of it is bleeding into you! Not enough to make you a sex freak, but enough that you won't pass up on some fun!"

Okay, that would explain it a bit. Byleth soon ran into Jeralt. "Oh, I was just wondering what was taking you so long, but I guess I was worried about nothing," the old man chuckled, before sighing. "Come on... We've got business to attend to that I am not fully looking forward to."

Byleth nodded and followed him.

...

Meanwhile, the Adrestian Heir was gazing off in the distance where the bandits had fled. Under her alias, she had instructed Kostas to flee towards the Red Canyon, but since he was now dead, killed by that mercenary girl with similar powers to... them, as he had attempted to flee, and since he had clearly not had a coherent chain of command with his bandit band, they hadn't been told where to flee to.

Instead, they were fleeing towards an old fortress, the last point of contact between them and her... "Allies." Those Who Slither in The Dark. They employed those bandits, hence why, under her alias, she had given them a suicide mission disguised as an attempt on Dimitri and Claude's lives, so she could remove those pawns, and weaken Those Who Slither, however miniscule it was, while having plausible deniability with them.

But now, she had a means of striking potentially a greater blow against them, and save one of her most loyal subjects... While maintaining her plausible deniability if she played it right. After all, loathe as she was to admit it, she still needed their power, so couldn't afford to outright betray them yet... But any chance to weaken them so when the time came to turn on them, her odds of success would increase was something she couldn't pass up.

And who knows? Depending on just how powerful these mercenaries were, and if she could get them on her side... She might not even need her uneasy allies much longer.