Lightly grease the bottom of a casserole dish. In a bowl, combined 3 cups cranberries, brown sugar, melted butter, cinnamon, and clove. Spread on the bottom of the casserole dish.
In a large bowl, whisk eggs, milk, and vanilla until foamy and fully incorporated. Dip each slice of bread into the mixture, allowing excess to drip off, then place in the casserole dish on a slight angle. Repeat with remaining bread slices. Pour any remaining egg filling as well as the orange juice evenly overtop. Toss 1/2 cup cranberries with granulated sugar and scatter on top of the bread slices. Cover dish tightly with plastic wrap or aluminum foil and refrigerate at least 2 hours or, preferably, overnight.
When ready to bake, remove dish from fridge and allow to come to room temperature, about 20 minutes. Preheat oven to 375 degrees. Bake uncovered for 45-50 minutes or until tops of bread slices reach a nice golden brown and the filling is no longer liquidy. If the bread browns too quickly, tent loosely with aluminum foil. Serve warm with butter, maple syrup, honey, and/or whipped cream, as desired.