I think cream cheese should do the trick. Chives would also be a good addition. I'd go very light on the garlic. The olives sound good and the jalapenos if you like the kick should do well, too.

I remember that Kraft had (probably still does) a salmon cream cheese spread that was quite tasty so you're on the right track with the cream cheese. I think I'd cut the mayo totally or only use just barely enough to thin the cream cheese.

Oh, yes, some freshly squeezed lemon (not too much) will add a zip like you wouldn't believe. I'd add maybe a 1/2 tsp. of lemon juice and taste. And then increase as per your taste buds (and the amount of the dip).

Usually dill goes well with seafood but in this instance I'm thinking no dill.