I would take a box and cut the hole as big as the vent duct and then put a box around the fan... I would fill the box with the packaging stuffing puffy things and that would make a silencer to the centerline fan.
I agree with frank make a silencing box. It helps alot when done right. I used 1/2" plywood and 1" insulation board with insulated ducting. But the packing peanuts work good as well.