Make the marinade: In a medium size bowl, whisk together the olive oil and lemon juice until blended and emulsified. Add the olives, garlic, zest and pepper and continue mixing to combine.
Place the fish in the marinade in a covered bowl or in a Ziploc bag and marinate at room temperature for 30 minutes to 1 hour. Soak the bay leaves in warm water for one hour to soften.
Light the grill to medium according to individual unit directions. .
Remove the fish from the marinade, reserving the marinade.
Thread the tomatoes, fish, bay leaves, and onion pieces in that order onto four 15-inch metal skewers, filling all but the top inch and a half or so on each skewer.
Lightly oil the grill rack. Place the swordfish souvlaki on the grill and cover it, making sure the air vents are open. Grill, turning and basting with the reserved marinade, until fish is cooked and the vegetables lightly charred, about 15 minutes. Serve immediately.