Any way to get away from this? I'm happy I didn't lose my whole stack.

With 105 hands of observation, MP2 has VP$IP of 61%, PFR 12%, WTSD=37%, Agg=.63, and .40 BB/100.

Party Poker No-Limit Hold'em, $ .10/.25 (8 handed)

Button ($28.25)
SB ($9.36)
BB ($18.30)
UTG ($19.65)
Hero ($25.15)
MP1 ($24.75)
MP2 ($25.78)
CO ($28.42)

Preflop: Hero is UTG+1 with , . SB posts a blind of $0.10.
1 fold, Hero raises to $0.5, 1 fold, MP2 calls $0.50, 3 folds, BB calls $0.25.
This is a slightly tight table (don't remember the exact stats), so I'm making a minimum raise here to try to push out any cheap limpers, and since I'm going to be out of position on successive streets.

Flop: ($1.60) , , (3 players)
BB bets $0.25, Hero calls $0.25, MP2 raises to $0.5, BB folds, Hero calls $0.25.

Turn: ($2.85) (2 players)
Hero bets $1.5, MP2 raises to $4, Hero calls $2.50.

River: ($10.85) (2 players)
Hero bets $8, MP2 calls $8.

Final Pot: $26.85

Results in white below:
Hero has Jh Kh (flush, king high).
MP2 has Ah 4h (flush, ace high).
Outcome: MP2 wins $26.85.